binlogo

README

Binlogo

中文 | English

Binlogo is the distributed, visualized application based on MySQL binlog. In short, binlogo is to process the data changes of MySQL into easy to understand messages and send them to different places according to the user's configuration. This is some advantages:

• Distributed, multi node improves availability.
• Visualization, can complete common operations and observe the status of the whole cluster in the control background

Get Started

• Install etcd. Binlogo relies on etcd, so you must install etcd first.

• Install binlogo. Binlogo's download address: Download Address

• Message Format： Data format of binlogo output

• Start binlogo.

  • Edit config. ${binlogo-path}/configs/binlogo.yaml

    

  • $ ./binlogo server --config ./configs/binlogo.yaml

• Open browser: http://127.0.0.1:9999/console

• Create Pipeline:

Follow the steps.

• Run pipeline.

Click button to run the pipeline instance.

• Operation condition.

You can see the operation condition of pipeline.

• See the output

Insert some into mysql, watch the ouput on stdout.

• Configuration output to Kafka

• High performance, possible data loss.
  • acks=1
  • enable.idempotence=false
  • compression.type=snappy
  • retries=0
• For reliability performance:
  • acks=-1
  • enable.idempotence=true
  • retries=3 or larger one

Docker

$ docker pull jin06/binlogo
$ docker run -e "ETCD_ENDPOINTS=172.17.0.3:2379" --name BinlogoNode -it -d -p 9999:9999 jin06/binlogo:latest
Open browser access http://127.0.0.1:9999/console
I started five nodes with docker. The following is a screenshot

Docs

• 文档链接

Questions

• To Report bug: GitHub Issue
• Contact author: jinlong4696@163.com