masterdata-api

README

masterdata-api

This Microservice provides the source of truth for master data.

• tenant master-data
  • name/desc
• tenant settings
  • cloud
    • limit max projects
    • limit max clusters
  • cluster
    • limit
• tenant project
  • settings
    • limit max clusters

Design

The services are exposed as grpc-services. The included client can be used in other services by simply importing it.

The data is stored in a generic way using a postgres database with tables consisting of id and json-document fields.

Changes to the data are reflected in a history table-twin per entity. When data is created, updated or deleted, the change is also written to the history table.

The main entities are generated from a <type>.proto-file plus some additional mapping-code in a <type>.go file. Using a go-generate-statement the db-schema and some boilerplating code is generated using naming-conventions.

Initial Data

It is possible to insert data on startup, this is done by placing one ore more yaml documents into the initdb.d directory. Multi document yaml files are not supported at the moment. If the given version of the entity is lower or equal the entity version stored in the database, no create or update happens. Otherwise a update is executed. On every error happening during initdb is logged, but the affected entity is not processed.

Build

make all

Install protoc

* https://github.com/protocolbuffers/protobuf
* latest https://gist.github.com/sofyanhadia/37787e5ed098c97919b8c593f0ec44d8#gistcomment-2760267

Install protoc-gen-go

go get -u github.com/golang/protobuf/protoc-gen-go

Run

make postgres-up

Start client with extensive logging

make clean protoc client
GRPC_GO_LOG_VERBOSITY_LEVEL=99 GRPC_GO_LOG_SEVERITY_LEVEL=info bin/client

Start server

make clean protoc server
bin/server

Metrics

http://localhost:2112/metrics

pprof

go tool pprof -http :8080 localhost:2113/debug/pprof/heap
go tool pprof -http :8080 localhost:2113/debug/pprof/goroutine