application

README

Backend of ToIoT

Table of contents

• Installation
• Run

Installation

$ go get github.com/KumKeeHyun/toiot

or

// toiot/application
$ go get github.com/KumKeeHyun/toiot/application

// toiot/logic-core
$ go get github.com/KumKeeHyun/toiot/logic-core

// toiot/health-check (will be implemented in later version)
$ go get github.com/KumKeeHyun/toiot/health-check

docker

// latest tag is 0.0.1

// toiot/application
$ docker pull kbzjung359/toiot-app:0.0.1

// toiot/logic-core
$ docker pull kbzjung359/toiot-logic:0.0.1

// toiot/health-check (will be implemented in later version)
$ docker pull kbzjung359/toiot-health

or

// In the directory where the Dockerfile are located
$ docker build -t (image name) .

Run

// toiot/application, toiot/logic-core, toiot/health-check
$ go run main.go

or

// In the directory where the docker-compose.yml are located
$ docker-compose up

Environment variable

The setting value of each microservice is set by reading environment variables.

toiot/application (Registration)

Key	Example	Explain
APP_SERVER	0.0.0.0:8081	Registration microservice address
DB_DRIVER	mysql	DBMS type
DB_SERVER	localhost:3306	DBMS address
DB_USER	pdk	User name
DB_PASS	pdk1234	User password
DB_DATABASE	pdk-db	mysql database name
TOPIC_NAME	sensor-data	default kafka topic for registration info
TOPIC_PARTITIONS	1	topic's partitions
TOPIC_RePLICATIONS	1	topic's replications

• Currently DBMS only supports mysql
• This service does not create Kafka topics to Kafka Automatically. Just register DB information for logic-service.

toiot/logic-core (Sensor Data Stream Processing)

Key	Example	Explain
LOGIC_SERVER	0.0.0.0:8082	Logic microservice address
LOGIC_LISTEN	10.5.110.1:8082	Externally accessible address
APP_SERVER	127.0.0.1:8081	Registration microservice server address
KAFKA_BROKER	localhost:9092	Kafka Cluster address
KAFKA_GROUP	logic-core	Kafka consumer group id
KAFKA_TOPIC	sensor-data	Kafka topic to steam sensor data
KAFKA_BUFSIZE	500	channel size for stream process in goroutines
ELASTIC_SERVER	localhost:9200	Elasticsearch cluster address
ELASTIC_RETRY	3	Rest API request retry when the requests fail
ELASTIC_BUFSIZE	500	channel size of stream process in goroutines
ELASTIC_BATCHTICKER	5	Bulk Indexing interval second
ELASTIC_BATCHSIZE	400	Bulk Indexing documents size

• Kafka topics must be prepared before running the service.
• Because LOGIC_LISTEN is used when calling from the application service to this service, external access must be possible.