一般来说,学习ES都是自己先搭建几台虚拟机,然后在虚拟机里部署ES集群,这样做资源消耗比较大,一般的电脑都没有这么高的配置,我们可以使用Docker来快速部署一套Elasticsearch集群,这里以3节点集群为例:

准备Docker网络

集群节点之间是通过ip进行交互的,所以需要固定一下ip,固定ip之前需要先创建一个Docker私有网络,并固定网段(网段不要和你的内网冲突)

1
docker network create --subnet=172.16.0.0/24 elasticsearch-br0

集群版Elasticsearch需要生成证书

默认生成3年证书,我指定生成了100年的证书, 生成到了 certs 目录下。

1
2
3
4
5
docker run --rm -it -v $(pwd)/certs:/tmp/certs elasticsearch:${ELASTIC_VERSION} bash -c \
'echo -e "\n\n" | /usr/share/elasticsearch/bin/elasticsearch-certutil ca -s -days 36500 && \
echo -e "\n\n\n" | /usr/share/elasticsearch/bin/elasticsearch-certutil cert -s -days 36500 --ca elastic-stack-ca.p12 && \
mv /usr/share/elasticsearch/*.p12 /tmp/certs && \
chmod 777 -R /tmp/certs'

指定IP运行容器

我这里将数据持久化到了docker卷中,通过docker volume ls可以查看。

elasticsearch1

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
docker run -d --name elasticsearch1 \
--ulimit memlock=-1:-1 \
-e "ES_JAVA_OPTS=-Xms512m -Xmx512m" \
-e node.name=elasticsearch1 \
-e cluster.name=es-cluster \
-e discovery.seed_hosts=elasticsearch2,elasticsearch3 \
-e cluster.initial_master_nodes=elasticsearch1,elasticsearch2,elasticsearch3 \
-e bootstrap.memory_lock=true \
-e xpack.security.enabled=true \
-e http.cors.enabled=true \
-e http.cors.allow-origin="*" \
-e http.cors.allow-headers=Authorization \
-e xpack.security.enabled=true \
-e xpack.security.transport.ssl.enabled=true \
-e xpack.security.transport.ssl.verification_mode=certificate \
-e xpack.security.transport.ssl.keystore.path=/usr/share/elasticsearch/config/elastic-certificates.p12 \
-e xpack.security.transport.ssl.truststore.path=/usr/share/elasticsearch/config/elastic-certificates.p12 \
-v es-data1:/usr/share/elasticsearch/data:rw \
-v es-logs1:/usr/share/elasticsearch/logs:rw \
--mount type=bind,source=$(pwd)/certs/elastic-certificates.p12,target=/usr/share/elasticsearch/config/elastic-certificates.p12 \
--network elasticsearch-br0 \
--ip 172.16.0.11 \
-p 9201:9200 -p 9301:9300 \
elasticsearch:7.17.14

elasticsearch2

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
docker run -d --name elasticsearch2 \
--ulimit memlock=-1:-1 \
-e "ES_JAVA_OPTS=-Xms512m -Xmx512m" \
-e node.name=elasticsearch2 \
-e cluster.name=es-cluster \
-e discovery.seed_hosts=elasticsearch1,elasticsearch3 \
-e cluster.initial_master_nodes=elasticsearch1,elasticsearch2,elasticsearch3 \
-e bootstrap.memory_lock=true \
-e xpack.security.enabled=true \
-e http.cors.enabled=true \
-e http.cors.allow-origin="*" \
-e http.cors.allow-headers=Authorization \
-e xpack.security.enabled=true \
-e xpack.security.transport.ssl.enabled=true \
-e xpack.security.transport.ssl.verification_mode=certificate \
-e xpack.security.transport.ssl.keystore.path=/usr/share/elasticsearch/config/elastic-certificates.p12 \
-e xpack.security.transport.ssl.truststore.path=/usr/share/elasticsearch/config/elastic-certificates.p12 \
-v es-data2:/usr/share/elasticsearch/data:rw \
-v es-logs2:/usr/share/elasticsearch/logs:rw \
--mount type=bind,source=$(pwd)/certs/elastic-certificates.p12,target=/usr/share/elasticsearch/config/elastic-certificates.p12 \
--network elasticsearch-br0 \
--ip 172.16.0.12 \
-p 9202:9200 -p 9302:9300 \
elasticsearch:7.17.14

elasticsearch3

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
docker run -d --name elasticsearch3 \
--ulimit memlock=-1:-1 \
-e "ES_JAVA_OPTS=-Xms512m -Xmx512m" \
-e node.name=elasticsearch3 \
-e cluster.name=es-cluster \
-e discovery.seed_hosts=elasticsearch1,elasticsearch2 \
-e cluster.initial_master_nodes=elasticsearch1,elasticsearch2,elasticsearch3 \
-e bootstrap.memory_lock=true \
-e xpack.security.enabled=true \
-e http.cors.enabled=true \
-e http.cors.allow-origin="*" \
-e http.cors.allow-headers=Authorization \
-e xpack.security.enabled=true \
-e xpack.security.transport.ssl.enabled=true \
-e xpack.security.transport.ssl.verification_mode=certificate \
-e xpack.security.transport.ssl.keystore.path=/usr/share/elasticsearch/config/elastic-certificates.p12 \
-e xpack.security.transport.ssl.truststore.path=/usr/share/elasticsearch/config/elastic-certificates.p12 \
-v es-data3:/usr/share/elasticsearch/data:rw \
-v es-logs3:/usr/share/elasticsearch/logs:rw \
--mount type=bind,source=$(pwd)/certs/elastic-certificates.p12,target=/usr/share/elasticsearch/config/elastic-certificates.p12 \
--network elasticsearch-br0 \
--ip 172.16.0.13 \
-p 9203:9200 -p 9303:9300 \
elasticsearch:7.17.14

初始化密码

需要等待服务启动后才可设置初始化密码,命令只能生成一次。

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
# 自动生成密码
docker exec elasticsearch1 bash -c "echo y | /usr/share/elasticsearch/bin/elasticsearch-setup-passwords auto"

# 生成指定的密码
docker exec -it elasticsearch1 bash -c 'echo -e "y
123456
123456
123456
123456
123456
123456
123456
123456
123456
123456
123456
123456" | /usr/share/elasticsearch/bin/elasticsearch-setup-passwords interactive'

部署kibana

准备 kibana.yml

密码按照实际情况修改

1
2
3
4
5
6
7
8
server.name: kibana
server.port: 5601
server.host: "0.0.0.0"
elasticsearch.username: "elastic"
elasticsearch.password: "123456"

elasticsearch.hosts: ["http://elasticsearch1:9200", "http://elasticsearch2:9200", "http://elasticsearch3:9200"]
i18n.locale: "zh-CN"

准备 kibana.sh

1
2
3
4
5
docker run -d --name kibana \
--net elasticsearch-br0 \
-p 5601:5601 \
-v "$(pwd)"/kibana.yml:/usr/share/kibana/config/kibana.yml \
kibana:7.17.14