Elasticsearch搜索引擎的入門實戰


1.ES的背景:

ElasticSearch是一個基於Lucene的搜索服務器。它提供了一個分布式多用戶能力的全文搜索引擎,基於RESTful web接口。Elasticsearch是用Java開發的,並作為Apache許可條款下的開放源碼發布,是當前流行的企業級搜索引擎。設計用於雲計算中,能夠達到實時搜索,穩定,可靠,快速,安裝使用方便。官方客戶端在Java、.NET(C#)、PHP、Python、Apache Groovy、Ruby和許多其他語言中都是可用的。根據DB-Engines的排名顯示,Elasticsearch是最受歡迎的企業搜索引擎,其次是Apache Solr,也是基於Lucene。

 

2.注意事項:ElasticSearch的版本跟ElasticSearch的客戶端要保持一致的版本,另外不同版本的客戶端,他們的編碼風格也不一致。ElasticSearch7.0的版本跟以往的版本風格是不一樣的,詳細的可以查看官方文檔

 

3.這里用到的工具有idea,ElasticSearch7.2,跟es的Java High Level REST Client,要了解Java High Level REST Client客戶端的api,可以到看這個文檔。基於ssm框架來實現一個簡單的,結合mysql和es的增刪改查。

 

4.可以用ES官網中的Kibana工具,來實現對ES API的操作。如果需要配置多個ES;

 

5.ES中的conf/elasticsearch.yml對其修改,在下面添加修改:

這是一個主節點的配置

http.cors.enabled: true
http.cors.allow-origin: "*"
cluster.name: xiao
node.name: slave
node.master: true
network.host: 127.0.0.1

配置第二個節點

cluster.name: xiao
node.name: slave1
network.host: 127.0.0.1
http.port: 8200

配置第三個節點

cluster.name: xiao
node.name: slave2
network.host: 127.0.0.1
http.port: 7200
discovery.zen.ping.unicast.hosts: ["127.0.0.1"]

6.也可以配一個Elasticsearch-head來看集群中的內容:

 

1.pom:

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>com.zhongmin</groupId>
    <artifactId>zhongDemo</artifactId>
    <version>1.0-SNAPSHOT</version>
    <packaging>war</packaging>
    <dependencies>
        <!-- https://mvnrepository.com/artifact/log4j/log4j -->
        <dependency>
            <groupId>log4j</groupId>
            <artifactId>log4j</artifactId>
            <version>1.2.17</version>
        </dependency>

        <dependency>
            <groupId>ch.qos.logback</groupId>
            <artifactId>logback-core</artifactId>
            <version>1.1.1</version>
            <scope>provided</scope>
        </dependency>
        <!--實現slf4j接口並整合-->
        <dependency>
            <groupId>ch.qos.logback</groupId>
            <artifactId>logback-classic</artifactId>
            <version>1.1.1</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>com.oracle</groupId>
            <artifactId>ojdbc</artifactId>
            <version>6</version>
        </dependency>
        <!--druid==>阿里巴巴數據庫連接池-->
        <dependency>
            <groupId>com.alibaba</groupId>
            <artifactId>druid</artifactId>
            <version>1.0.25</version>
        </dependency>
        <!--2.dao框架:MyBatis依賴-->
        <dependency>
            <groupId>org.mybatis</groupId>
            <artifactId>mybatis</artifactId>
            <version>3.3.0</version>
        </dependency>
        <!--mybatis自身實現的spring整合依賴-->
        <dependency>
            <groupId>org.mybatis</groupId>
            <artifactId>mybatis-spring</artifactId>
            <version>1.3.2</version>
        </dependency>

        <!--3.Servlet web相關依賴-->
        <dependency>
            <groupId>taglibs</groupId>
            <artifactId>standard</artifactId>
            <version>1.1.2</version>
        </dependency>
        <dependency>
            <groupId>jstl</groupId>
            <artifactId>jstl</artifactId>
            <version>1.2</version>

        </dependency>
        <dependency>
            <groupId>com.fasterxml.jackson.core</groupId>
            <artifactId>jackson-databind</artifactId>
            <version>2.5.4</version>
        </dependency>

        <dependency>
            <groupId>javax.servlet</groupId>
            <artifactId>javax.servlet-api</artifactId>
            <version>3.1.0</version>
            <scope>provided</scope>
        </dependency>

        <!--4:spring依賴-->
        <!--1)spring核心依賴-->
        <dependency>
            <groupId>org.springframework</groupId>
            <artifactId>spring-core</artifactId>
            <version>4.3.14.RELEASE</version>
        </dependency>
        <dependency>
            <groupId>org.springframework</groupId>
            <artifactId>spring-beans</artifactId>
            <version>4.3.14.RELEASE</version>
        </dependency>
        <dependency>
            <groupId>org.springframework</groupId>
            <artifactId>spring-context</artifactId>
            <version>4.3.14.RELEASE</version>
        </dependency>
        <!--2)spring dao層依賴-->
        <dependency>
            <groupId>org.springframework</groupId>
            <artifactId>spring-jdbc</artifactId>
            <version>4.3.14.RELEASE</version>
        </dependency>
        <dependency>
            <groupId>org.springframework</groupId>
            <artifactId>spring-tx</artifactId>
            <version>4.3.14.RELEASE</version>
        </dependency>
        <!--3)springweb相關依賴-->
        <dependency>
            <groupId>org.springframework</groupId>
            <artifactId>spring-web</artifactId>
            <version>4.3.14.RELEASE</version>
        </dependency>
        <dependency>
            <groupId>org.springframework</groupId>
            <artifactId>spring-webmvc</artifactId>
            <version>4.3.14.RELEASE</version>
        </dependency>
        <!--4)spring test相關依賴-->
        <dependency>
            <groupId>org.springframework</groupId>
            <artifactId>spring-test</artifactId>
            <version>4.3.14.RELEASE</version>
        </dependency>
        <dependency>
            <groupId>mysql</groupId>
            <artifactId>mysql-connector-java</artifactId>
            <version>5.1.35</version>
            <scope>runtime</scope>
        </dependency>

        <!--Aop要導入的包-->
        <dependency>
            <groupId>org.aspectj</groupId>
            <artifactId>aspectjweaver</artifactId>
            <version>1.8.9</version>
        </dependency>

        <dependency>
            <groupId>org.json</groupId>
            <artifactId>json</artifactId>
            <version>20170516</version>
        </dependency>
        <!-- https://mvnrepository.com/artifact/com.fasterxml.jackson.core/jackson-core -->
        <dependency>
            <groupId>com.fasterxml.jackson.core</groupId>
            <artifactId>jackson-core</artifactId>
            <version>2.9.8</version>
        </dependency>

        <!-- ElasticSearch核心包 -->
        <!-- https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch -->
        <dependency>
            <groupId>org.elasticsearch</groupId>
            <artifactId>elasticsearch</artifactId>
            <version>7.2.0</version>
        </dependency>

        <dependency>
            <groupId>org.elasticsearch.client</groupId>
            <artifactId>elasticsearch-rest-high-level-client</artifactId>
            <version>7.2.0</version>
        </dependency>
        <dependency>
            <groupId>junit</groupId>
            <artifactId>junit</artifactId>
            <version>4.12</version>
        </dependency>



    </dependencies>
    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-compiler-plugin</artifactId>
                <configuration>
                    <source>1.8</source>
                    <target>1.8</target>
                </configuration>
            </plugin>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-war-plugin</artifactId>
                <version>2.6</version>
                <configuration>
                    <includeEmptyDirectories>true</includeEmptyDirectories>
                </configuration>
            </plugin>

        </plugins>
    </build>

</project>

2.es客戶端連接集群:

package com.xiaoqiang.servic.impl;

import com.xiaoqiang.dao.CompanyDao;
import com.xiaoqiang.entiy.Company;
import com.xiaoqiang.servic.search.CompanyIndexservic;

import com.xiaoqiang.util.CompanyKey;
import com.xiaoqiang.util.InitDemo;
import org.apache.lucene.search.TotalHits;
import org.elasticsearch.action.DocWriteResponse;
import org.elasticsearch.action.index.IndexRequest;
import org.elasticsearch.action.index.IndexResponse;
import org.elasticsearch.action.search.SearchRequest;
import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.action.update.UpdateRequest;
import org.elasticsearch.action.update.UpdateResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.index.query.TermQueryBuilder;
import org.elasticsearch.index.reindex.BulkByScrollResponse;
import org.elasticsearch.index.reindex.DeleteByQueryRequest;
import org.elasticsearch.search.SearchHits;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.stereotype.Service;

import java.io.IOException;
import java.util.HashMap;
import java.util.Map;
@Service
public class CompanyIndexservicImpl implements CompanyIndexservic {
    private static final Logger logger = LoggerFactory.getLogger(CompanyIndexservic.class);
    private static final String INDEX_NAME = "mycompany";

    private RestHighLevelClient client = InitDemo.getClient();
    @Autowired
    private CompanyDao companyDao;

    @Override
    public void index(Long companyId)  {
        Company company = companyDao.findOne(companyId);
        if (company == null) {
            logger.error("Index Company {} does not exist", companyId);
            return;
        }
        SearchRequest searchRequest = new SearchRequest(INDEX_NAME);
        SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
        searchSourceBuilder.query(QueryBuilders.termQuery(CompanyKey.companyId,company.getId()));
        searchRequest.source(searchSourceBuilder);
        SearchResponse searchResponse = null;
        try {
            searchResponse = client.search(searchRequest, RequestOptions.DEFAULT);
        } catch (IOException e) {
            e.printStackTrace();
        }
        logger.debug(searchRequest.toString());
        SearchHits hits = searchResponse.getHits();
        TotalHits totalHits = hits.getTotalHits();
        long numHits = totalHits.value;
        boolean success;
        if(numHits==0)
        {
            success=create(company);
        }
        else if(numHits==1){
            success=update(company);
        }
        else
        {
            success=deleteAndCreate(numHits,company);
        }
        if(success)
        {
            logger.debug("創建索引成功"+company.getId());
        }
    }

    private boolean create(Company company)  {
        Map<String, Object> jsonMap = new HashMap<>();
        jsonMap.put(CompanyKey.companyName, company.getCompanyname());
        jsonMap.put(CompanyKey.companyId, company.getId());
        IndexRequest indexRequest = new IndexRequest("mycompany")
                .id(String.valueOf(company.getId())).source(jsonMap);
        logger.debug("獲取公司id=" + company.getId());
        IndexResponse indexResponse = null;
        try {
            indexResponse = client.index(indexRequest, RequestOptions.DEFAULT);
        } catch (IOException e) {
            logger.error("創建失敗失敗Id=" + company.getId(), e);
        }
        if (indexResponse.getResult() == DocWriteResponse.Result.CREATED) {
            return true;
        } else {
            return false;
        }

    }

    private boolean update(Company company) {
        Map<String, Object> jsonMap = new HashMap<>();
        jsonMap.put("companyname", company.getCompanyname());
        jsonMap.put("id", company.getId());
        UpdateRequest request = new UpdateRequest(INDEX_NAME, company.getId().toString()).doc(jsonMap);
        UpdateResponse updateResponse = null;
        try {
            updateResponse = client.update(
                    request, RequestOptions.DEFAULT);
        } catch (IOException e) {
            logger.error("更新失敗失敗Id=" + company.getId(), e);
        }

        if (updateResponse.getResult() == DocWriteResponse.Result.UPDATED) {
            return true;
        } else {
            return false;
        }


    }

    private boolean deleteAndCreate(long total, Company company) {
        DeleteByQueryRequest request =
                new DeleteByQueryRequest(INDEX_NAME);
        request.setQuery(new TermQueryBuilder(CompanyKey.companyId, company.getId()));
        BulkByScrollResponse bulkResponse = null;
        try {
            bulkResponse =
                    client.deleteByQuery(request, RequestOptions.DEFAULT);
            logger.debug("delete company " + bulkResponse);

        } catch (IOException e) {
            e.printStackTrace();
        }
        long deleted = bulkResponse.getDeleted();
        if (deleted != total) {
            logger.warn("應該要刪除{},但是只刪除了{}", total, deleted);
            return false;
        } else {
            return create(company);
        }

    }


    @Override
    public void remvoe(Long companyId) {
        DeleteByQueryRequest request =
                new DeleteByQueryRequest(INDEX_NAME);
        request.setQuery(new TermQueryBuilder(CompanyKey.companyId,companyId));
        BulkByScrollResponse bulkResponse = null;
        try {
            bulkResponse =
                    client.deleteByQuery(request, RequestOptions.DEFAULT);
            logger.debug("delete company " + bulkResponse);

        } catch (IOException e) {
            e.printStackTrace();
        }

        long deleted=bulkResponse.getDeleted();
        logger.debug("刪除了{}條",deleted);


    }
}

3.獲取連接服務的代碼:

package com.xiaoqiang.util;

import org.apache.http.HttpHost;
import org.elasticsearch.client.RestClient;
import org.elasticsearch.client.RestHighLevelClient;


/**
 * 
 * @Description: 獲取Java High Level REST Client客戶端
 * @author lgs
 * @date 
 *
 */
public class InitDemo {

    public static RestHighLevelClient getClient() {

        RestHighLevelClient client = new RestHighLevelClient(
                RestClient.builder(
                        new HttpHost("localhost", 9200, "http")));

        return client;
    }
}

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM