cronicle 后端存儲是可配置的 ,通過使用不同的存儲配置,我們可以解決多實例部署以及數據共享的問題
cronicle 的后端存儲模型,設計的特別方便,包含了基於文件的,基於s3 的,同時我們也可以開發自己的
存儲引擎
以下是一個集成minio s3 部署單master,多slave 實際上我們可以擴展為多master
環境准備
- docker-compose 文件
version: "3"
services:
s3:
image: minio/minio
command: server /data
ports:
- "9000:9000"
environment:
- "MINIO_ACCESS_KEY=dalongapp"
- "MINIO_SECRET_KEY=dalongapp"
volumes:
- "./data:/data"
cronicle:
build: ./
hostname: master
image: dalongrong/cronicle
volumes:
- "./config.json:/opt/cronicle/conf/config.json"
ports:
- "3012:3012"
cronicle2:
build: ./
hostname: cronicle2
image: dalongrong/cronicle
volumes:
- "./config.json:/opt/cronicle/conf/config.json"
ports:
- "3013:3012"
cronicle3:
build: ./
hostname: cronicle3
image: dalongrong/cronicle
volumes:
- "./config.json:/opt/cronicle/conf/config.json"
ports:
- "3014:3012"
- cronicle dockerfile
添加了aws sdk
FROM node:12.10.0-stretch-slim
LABEL AUTHOR="rongfengliang"
LABEL EMAIL="1141591465@qq.com"
RUN npm config set registry https://registry.npm.taobao.org
RUN curl -s https://raw.githubusercontent.com/jhuckaby/Cronicle/master/bin/install.js | node
RUN cd /opt/cronicle && npm install aws-sdk
EXPOSE 3012
ENTRYPOINT ["tail", "-f", "/dev/null"]
- 存儲配置
config.json ,以下截取部分關於存儲的配置
"Storage": {
"engine": "S3",
"AWS": {
"accessKeyId": "dalongapp",
"secretAccessKey": "dalongapp",
"region": "us-east-1",
"correctClockSkew": true,
"endpoint": "s3:9000",
"sslEnabled": false,
"s3ForcePathStyle": true,
"maxRetries": 5,
"httpOptions": {
"connectTimeout": 5000,
"timeout": 5000
}
},
"S3": {
"keyPrefix": "cronicle",
"fileExtensions": true,
"params": {
"Bucket": "cronicle"
}
}
}
啟動&&運行
- 啟動
docker-compose up -d
- 創建s3桶
通過UI - 啟動master
docker-compose exec cronicle /opt/cronicle/bin/control.sh setup
docker-compose exec cronicle /opt/cronicle/bin/control.sh start
- s3 內容
- 啟動slave
docker-compose exec cronicle2 /opt/cronicle/bin/control.sh start
docker-compose exec cronicle3 /opt/cronicle/bin/control.sh start
- 添加slave 節點
- 配置一個簡單的調度任務
- 執行調度效果
說明
以上是一個簡單的基於minio s3 實現的配置共享,實際上基於s3 我們可以配置cronicle 的多master
參考資料
https://github.com/jhuckaby/Cronicle
https://github.com/awsdocs/aws-doc-sdk-examples/blob/master/javascript/example_code/s3/s3_setcors.js
https://github.com/rongfengliang/cronicle-docker