1.ES的背景:
ElasticSearch是一個基於Lucene的搜索服務器。它提供了一個分布式多用戶能力的全文搜索引擎,基於RESTful web接口。Elasticsearch是用Java開發的,並作為Apache許可條款下的開放源碼發布,是當前流行的企業級搜索引擎。設計用於雲計算中,能夠達到實時搜索,穩定,可靠,快速,安裝使用方便。官方客戶端在Java、.NET(C#)、PHP、Python、Apache Groovy、Ruby和許多其他語言中都是可用的。根據DB-Engines的排名顯示,Elasticsearch是最受歡迎的企業搜索引擎,其次是Apache Solr,也是基於Lucene。
2.注意事項:ElasticSearch的版本跟ElasticSearch的客戶端要保持一致的版本,另外不同版本的客戶端,他們的編碼風格也不一致。ElasticSearch7.0的版本跟以往的版本風格是不一樣的,詳細的可以查看官方文檔。
3.這里用到的工具有idea,ElasticSearch7.2,跟es的Java High Level REST Client,要了解Java High Level REST Client客戶端的api,可以到看這個文檔。基於ssm框架來實現一個簡單的,結合mysql和es的增刪改查。
4.可以用ES官網中的Kibana工具,來實現對ES API的操作。如果需要配置多個ES;
5.ES中的conf/elasticsearch.yml對其修改,在下面添加修改:
這是一個主節點的配置
http.cors.enabled: true http.cors.allow-origin: "*" cluster.name: xiao node.name: slave node.master: true network.host: 127.0.0.1
配置第二個節點
cluster.name: xiao node.name: slave1 network.host: 127.0.0.1 http.port: 8200
配置第三個節點
cluster.name: xiao node.name: slave2 network.host: 127.0.0.1 http.port: 7200 discovery.zen.ping.unicast.hosts: ["127.0.0.1"]
6.也可以配一個Elasticsearch-head來看集群中的內容:
1.pom:
<?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>com.zhongmin</groupId> <artifactId>zhongDemo</artifactId> <version>1.0-SNAPSHOT</version> <packaging>war</packaging> <dependencies> <!-- https://mvnrepository.com/artifact/log4j/log4j --> <dependency> <groupId>log4j</groupId> <artifactId>log4j</artifactId> <version>1.2.17</version> </dependency> <dependency> <groupId>ch.qos.logback</groupId> <artifactId>logback-core</artifactId> <version>1.1.1</version> <scope>provided</scope> </dependency> <!--實現slf4j接口並整合--> <dependency> <groupId>ch.qos.logback</groupId> <artifactId>logback-classic</artifactId> <version>1.1.1</version> <scope>provided</scope> </dependency> <dependency> <groupId>com.oracle</groupId> <artifactId>ojdbc</artifactId> <version>6</version> </dependency> <!--druid==>阿里巴巴數據庫連接池--> <dependency> <groupId>com.alibaba</groupId> <artifactId>druid</artifactId> <version>1.0.25</version> </dependency> <!--2.dao框架:MyBatis依賴--> <dependency> <groupId>org.mybatis</groupId> <artifactId>mybatis</artifactId> <version>3.3.0</version> </dependency> <!--mybatis自身實現的spring整合依賴--> <dependency> <groupId>org.mybatis</groupId> <artifactId>mybatis-spring</artifactId> <version>1.3.2</version> </dependency> <!--3.Servlet web相關依賴--> <dependency> <groupId>taglibs</groupId> <artifactId>standard</artifactId> <version>1.1.2</version> </dependency> <dependency> <groupId>jstl</groupId> <artifactId>jstl</artifactId> <version>1.2</version> </dependency> <dependency> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>jackson-databind</artifactId> <version>2.5.4</version> </dependency> <dependency> <groupId>javax.servlet</groupId> <artifactId>javax.servlet-api</artifactId> <version>3.1.0</version> <scope>provided</scope> </dependency> <!--4:spring依賴--> <!--1)spring核心依賴--> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-core</artifactId> <version>4.3.14.RELEASE</version> </dependency> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-beans</artifactId> <version>4.3.14.RELEASE</version> </dependency> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-context</artifactId> <version>4.3.14.RELEASE</version> </dependency> <!--2)spring dao層依賴--> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-jdbc</artifactId> <version>4.3.14.RELEASE</version> </dependency> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-tx</artifactId> <version>4.3.14.RELEASE</version> </dependency> <!--3)springweb相關依賴--> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-web</artifactId> <version>4.3.14.RELEASE</version> </dependency> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-webmvc</artifactId> <version>4.3.14.RELEASE</version> </dependency> <!--4)spring test相關依賴--> <dependency> <groupId>org.springframework</groupId> <artifactId>spring-test</artifactId> <version>4.3.14.RELEASE</version> </dependency> <dependency> <groupId>mysql</groupId> <artifactId>mysql-connector-java</artifactId> <version>5.1.35</version> <scope>runtime</scope> </dependency> <!--Aop要導入的包--> <dependency> <groupId>org.aspectj</groupId> <artifactId>aspectjweaver</artifactId> <version>1.8.9</version> </dependency> <dependency> <groupId>org.json</groupId> <artifactId>json</artifactId> <version>20170516</version> </dependency> <!-- https://mvnrepository.com/artifact/com.fasterxml.jackson.core/jackson-core --> <dependency> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>jackson-core</artifactId> <version>2.9.8</version> </dependency> <!-- ElasticSearch核心包 --> <!-- https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch --> <dependency> <groupId>org.elasticsearch</groupId> <artifactId>elasticsearch</artifactId> <version>7.2.0</version> </dependency> <dependency> <groupId>org.elasticsearch.client</groupId> <artifactId>elasticsearch-rest-high-level-client</artifactId> <version>7.2.0</version> </dependency> <dependency> <groupId>junit</groupId> <artifactId>junit</artifactId> <version>4.12</version> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-war-plugin</artifactId> <version>2.6</version> <configuration> <includeEmptyDirectories>true</includeEmptyDirectories> </configuration> </plugin> </plugins> </build> </project>
2.es客戶端連接集群:
package com.xiaoqiang.servic.impl; import com.xiaoqiang.dao.CompanyDao; import com.xiaoqiang.entiy.Company; import com.xiaoqiang.servic.search.CompanyIndexservic; import com.xiaoqiang.util.CompanyKey; import com.xiaoqiang.util.InitDemo; import org.apache.lucene.search.TotalHits; import org.elasticsearch.action.DocWriteResponse; import org.elasticsearch.action.index.IndexRequest; import org.elasticsearch.action.index.IndexResponse; import org.elasticsearch.action.search.SearchRequest; import org.elasticsearch.action.search.SearchResponse; import org.elasticsearch.action.update.UpdateRequest; import org.elasticsearch.action.update.UpdateResponse; import org.elasticsearch.client.RequestOptions; import org.elasticsearch.client.RestHighLevelClient; import org.elasticsearch.index.query.QueryBuilders; import org.elasticsearch.index.query.TermQueryBuilder; import org.elasticsearch.index.reindex.BulkByScrollResponse; import org.elasticsearch.index.reindex.DeleteByQueryRequest; import org.elasticsearch.search.SearchHits; import org.elasticsearch.search.builder.SearchSourceBuilder; import org.slf4j.Logger; import org.slf4j.LoggerFactory; import org.springframework.beans.factory.annotation.Autowired; import org.springframework.stereotype.Service; import java.io.IOException; import java.util.HashMap; import java.util.Map; @Service public class CompanyIndexservicImpl implements CompanyIndexservic { private static final Logger logger = LoggerFactory.getLogger(CompanyIndexservic.class); private static final String INDEX_NAME = "mycompany"; private RestHighLevelClient client = InitDemo.getClient(); @Autowired private CompanyDao companyDao; @Override public void index(Long companyId) { Company company = companyDao.findOne(companyId); if (company == null) { logger.error("Index Company {} does not exist", companyId); return; } SearchRequest searchRequest = new SearchRequest(INDEX_NAME); SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder(); searchSourceBuilder.query(QueryBuilders.termQuery(CompanyKey.companyId,company.getId())); searchRequest.source(searchSourceBuilder); SearchResponse searchResponse = null; try { searchResponse = client.search(searchRequest, RequestOptions.DEFAULT); } catch (IOException e) { e.printStackTrace(); } logger.debug(searchRequest.toString()); SearchHits hits = searchResponse.getHits(); TotalHits totalHits = hits.getTotalHits(); long numHits = totalHits.value; boolean success; if(numHits==0) { success=create(company); } else if(numHits==1){ success=update(company); } else { success=deleteAndCreate(numHits,company); } if(success) { logger.debug("創建索引成功"+company.getId()); } } private boolean create(Company company) { Map<String, Object> jsonMap = new HashMap<>(); jsonMap.put(CompanyKey.companyName, company.getCompanyname()); jsonMap.put(CompanyKey.companyId, company.getId()); IndexRequest indexRequest = new IndexRequest("mycompany") .id(String.valueOf(company.getId())).source(jsonMap); logger.debug("獲取公司id=" + company.getId()); IndexResponse indexResponse = null; try { indexResponse = client.index(indexRequest, RequestOptions.DEFAULT); } catch (IOException e) { logger.error("創建失敗失敗Id=" + company.getId(), e); } if (indexResponse.getResult() == DocWriteResponse.Result.CREATED) { return true; } else { return false; } } private boolean update(Company company) { Map<String, Object> jsonMap = new HashMap<>(); jsonMap.put("companyname", company.getCompanyname()); jsonMap.put("id", company.getId()); UpdateRequest request = new UpdateRequest(INDEX_NAME, company.getId().toString()).doc(jsonMap); UpdateResponse updateResponse = null; try { updateResponse = client.update( request, RequestOptions.DEFAULT); } catch (IOException e) { logger.error("更新失敗失敗Id=" + company.getId(), e); } if (updateResponse.getResult() == DocWriteResponse.Result.UPDATED) { return true; } else { return false; } } private boolean deleteAndCreate(long total, Company company) { DeleteByQueryRequest request = new DeleteByQueryRequest(INDEX_NAME); request.setQuery(new TermQueryBuilder(CompanyKey.companyId, company.getId())); BulkByScrollResponse bulkResponse = null; try { bulkResponse = client.deleteByQuery(request, RequestOptions.DEFAULT); logger.debug("delete company " + bulkResponse); } catch (IOException e) { e.printStackTrace(); } long deleted = bulkResponse.getDeleted(); if (deleted != total) { logger.warn("應該要刪除{},但是只刪除了{}", total, deleted); return false; } else { return create(company); } } @Override public void remvoe(Long companyId) { DeleteByQueryRequest request = new DeleteByQueryRequest(INDEX_NAME); request.setQuery(new TermQueryBuilder(CompanyKey.companyId,companyId)); BulkByScrollResponse bulkResponse = null; try { bulkResponse = client.deleteByQuery(request, RequestOptions.DEFAULT); logger.debug("delete company " + bulkResponse); } catch (IOException e) { e.printStackTrace(); } long deleted=bulkResponse.getDeleted(); logger.debug("刪除了{}條",deleted); } }
3.獲取連接服務的代碼:
package com.xiaoqiang.util; import org.apache.http.HttpHost; import org.elasticsearch.client.RestClient; import org.elasticsearch.client.RestHighLevelClient; /** * * @Description: 獲取Java High Level REST Client客戶端 * @author lgs * @date * */ public class InitDemo { public static RestHighLevelClient getClient() { RestHighLevelClient client = new RestHighLevelClient( RestClient.builder( new HttpHost("localhost", 9200, "http"))); return client; } }