maestro-old

README

maestro

Pelion Edge systems management daemon for Pelion Edge OS.

Overview

Maestro is a replacement for a number of typical Linux OS system utilities and management programs, while providing cloud-connected systems management. Maestro is designed specifically for cloud-connected Linux OS embedded computers, with somewhat limited RAM and disk space, where file systems are often flash - and would prefer less writing to the FS over time.

Major tasks maestro provides:

• syslog daemon (replaces syslog-ng, syslogd, and others)
• more advanced logging via the grease-log-client library
• to-the-cloud logging
• periodic system stats to cloud
• config management for apps / container (config file templating, config API)
• process creation & control
• container management - starting / stoppping & installation
• network setup (DHCP, static IP settings, with more to come)
• critical systems control (reboot, remote command execution, etc.)
• watchdog support
• time sync
• initial provisioning of system

Maestro can communicate in two ways:

• locally with other process over its local API
• a 'phone-home' style communication with its 'mothership' - this is WigWag's DCS

Advantages:

• less memory footprint
• less installation on disk
• cloud connectivity
• managment via local API

Maestro communicates to Pelion Cloud over https outbouund. It stores its config locally in a private database, but can also use DeviceDB for storage of applications, network settings, configs and other data when used in conjuction with standard Pelion Cloud services.

Interacting

If you are locally on a gateway / edge system using maestro, you should explore maestro-shell which will let you interact with maestro directly using the local API.

Building

prerequisites

Build pre-requisites:

• golang
• m4
• python
• gcc

Maestro has a simple internal preprocessor build.sh script which use m4 - make sure m4 is installed on your build system (normally included with gcc)

You will need gcc for compiling maestro's dependencies.

On Ubuntu

sudo apt-get install build-essential m4 python should take care of all this.

If you go not have a Go build environment up, you will need to install golang. Just expand the tar ball and put in in /opt, with sudo mv go /opt

You also will need your golang env vars setup correctly. Here is a script you can just run, assuming your Go workspace is at $HOME/work/gostuff:

setup-go.sh

#!/bin/bash

export GIT_TERMINAL_PROMPT=1
export GOROOT=/opt/go
export GOPATH="$HOME/work/gostuff"
export GOBIN="$HOME/work/gostuff/bin"
export PATH="$PATH:$GOROOT/bin:$GOPATH/bin"

(env PS1="[golang:work/gostuff] ${debian_chroot:+($debian_chroot)}\u@\h:\w\$ " bash --norc)

then just run: bash ./setup-go.sh

Run your build commands from this sub-shell.

build instructions

go get github.com/armPelionEdge/maestro

Enter github credentials as needed. Now, where $GOPATH is your go workspace folder, as in the sub-shell above...

cd $GOPATH/src/github.com/armPelionEdge/maestro/vendor/github.com/armPelionEdge/greaseg o/deps/src/greaseLib/deps

If in the libuv-v1.10.1 folder of deps a build folder does not exist, then do this - otherwise skip it:

cd libuv-v1.10.1
git clone https://chromium.googlesource.com/external/gyp.git build/gyp
cd ..

(This just "installs" gyp which is a Python script libuv likes for doing its builds.)

Now, back in the greaseLib/deps dir we first cd into, run:

./install-deps.sh

This will take a bit. You're building a bunch of libs used by grease / greaseGo

Next, build greaseGo direct deps and then greaseGo:

cd $GOPATH/src/github.com/armPelionEdge/maestro/vendor/github.com/armPelionEdge/greasego
./build-deps.sh
DEBUG=1 DEBUG2=1 ./build.sh

Omit the DEBUG vars if you don't want copious amount of debug.

Next build maestro:

cd $GOPATH/src/github.com/armPelionEdge/maestro
DEBUG=1 DEBUG2=1 ./build.sh

Running tests

Different subsystems have different test suites. Running these may require root privleges, for instance networking. You also need to run the pre-processor if making changes.

Example:

cd .. && DEBUG=1 DEBUG2=1 ./build.sh && cd networking && sudo \
  LD_LIBRARY_PATH=../../greasego/deps/lib GOROOT=/opt/go \
  GOPATH=/home/ed/work/gostuff go test -v -run DhcpRequest

Other examples

The Docker build file, for djs-soft-relay shows build instruction also, using this exact above method. https://github.com/armPelionEdge/cloud-installer/blob/master/djs-soft-relay/build-wwcontainer.sh#L155