gaia

package module
v0.2.7 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Nov 29, 2020 License: Apache-2.0 Imports: 5 Imported by: 48

README 

.. raw:: html

    <img src="https://cdn.rawgit.com/michelvocks/ef3894f63c3bb004bca1a2fd5f7eb644/raw/c36d614db8afe229b466b38de1636a82ad809f64/gaia-logo-text.png" width="650px">

|build-status| |go-report| |go-doc| |apache2| |chat| |codecov|

Gaia is an open source automation platform which makes it easy and fun to build powerful pipelines in any programming language. Based on `HashiCorp's go-plugin`_ and `gRPC`_, gaia is efficient, fast, lightweight, and developer friendly. Gaia is currently alpha! `Do not use it for mission critical jobs yet!`_

Develop powerful `pipelines <What is a pipeline?_>`_ with the help of `SDKs <Why do I need an SDK?_>`_ and simply check-in your code into a git repository. Gaia automatically clones your code repository, compiles your code to a binary, and executes it on-demand. All results are streamed back and formatted as a user-friendly graphical output.

Check out `gaia-pipeline.io`_ to learn more.

Motivation
==========

.. begin-motivation

*Automation Engineer*, *DevOps*, *SRE*, *Cloud Engineer*,
*Platform Engineer* - they all have one in common:
The majority of tech people are not motivated to take up this work and they are hard to recruit.

One of the main reasons for this is the abstraction and poor execution of many automation tools. They come with their own configuration (`YAML`_ syntax) specification or limit the user to one specific programming language. Testing is nearly impossible because most automation tools lack the ability to mock services and subsystems. Even tiny things, for example parsing a JSON file, are sometimes really painful because external, outdated libraries were used and not included in the standard framework.

We believe it's time to remove all those abstractions and come back to our roots. Are you tired of writing endless lines of YAML-code? Are you sick of spending days forced to write in a language that does not suit you and is not fun at all? Do you enjoy programming in a language you like? Then Gaia is for you.

How does it work?
=================

.. begin-architecture

Gaia is based on `HashiCorp's go-plugin`_. It's a `plugin system`_ that uses `gRPC`_ to communicate over `HTTP/2`_. Initially, HashiCorp developed this tool for `Packer`_ but now it's heavily used by `Terraform`_, `Nomad`_, and `Vault`_ too.

Plugins, which we named `pipelines <What is a pipeline?_>`_, are applications which can be written in any programming language, as long as `gRPC`_ is supported. All functions, which we call `jobs <What is a job?>`_, are exposed to Gaia and can form up a dependency graph which describes the order of execution.

Pipelines can be compiled locally or simply over the build system. Gaia clones the git repository and automatically builds the included pipeline. If a change (`git push`_) happened, Gaia will automatically rebuild the pipeline for you*.

After a pipeline has been started, all log output is returned back to Gaia and displayed in a detailed overview with their final result status.

Gaia uses `boltDB` for storage. This makes the installation step super easy. No external database is currently required.

\* *This requires polling or webhook to be activated.*

Screenshots
===========

.. begin-screenshots

|sh-login|
|sh-overview|
|sh-create-pipeline|
|sh-pipeline-detailed|
|sh-pipeline-logs|
|sh-vault|
|sh-settings|

Getting Started
===============

.. begin-getting-started

Installation
------------

The installation of gaia is simple and often takes a few minutes.

Using docker
~~~~~~~~~~~~

The following command starts gaia as a daemon process and mounts all data to the current folder. Afterwards, gaia will be available on the host system on port 8080. Use the standard user **admin** and password **admin** as initial login. It is recommended to change the password afterwards.

.. code:: sh

    docker run -d -p 8080:8080 -v $PWD:/data gaiapipeline/gaia:latest

This uses the image with the *latest* tag which includes all required libraries and compilers for all supported languages. If you prefer a smaller image suited for your preferred language, have a look at the `available docker image tags`_.

Manually
~~~~~~~~

It is possible to install Gaia directly on the host system.
This can be achieved by downloading the binary from the `releases page`_.

Gaia will automatically detect the folder of the binary and will place all data next to it. You can change the data directory with the startup parameter *-home-path* if you want.

Using helm
~~~~~~~~~~

If you haven't got an ingress controller pod yet, make sure that you have `kube-dns` or `coredns` enabled, run this command to set it up.

.. code:: sh

    make kube-ingress

To init helm:

.. code:: sh

    helm init

To deploy gaia:

.. code:: sh

    make deploy-kube

Usage
-----

Go
~~~

.. code:: go

    package main

    import (
        "log"
	    
	sdk "github.com/gaia-pipeline/gosdk"
    )

    // This is one job. Add more if you want.
    func DoSomethingAwesome(args sdk.Arguments) error {
        log.Println("This output will be streamed back to gaia and will be displayed in the pipeline logs.")

	// An error occurred? Return it back so gaia knows that this job failed.
	return nil
    }

    func main() {
        jobs := sdk.Jobs{
            sdk.Job{
                Handler:     DoSomethingAwesome,
	        Title:       "DoSomethingAwesome",
		Description: "This job does something awesome.",
	    },
	}

	// Serve
	if err := sdk.Serve(jobs); err != nil {
	    panic(err)
	}
}

Python
~~~~~~~

.. code:: python

    from gaiasdk import sdk
    import logging

    def MyAwesomeJob(args):
        logging.info("This output will be streamed back to gaia and will be displayed in the pipeline logs.")
        # Just raise an exception to tell Gaia if a job failed.
        # raise Exception("Oh no, this job failed!")

    def main():
        logging.basicConfig(level=logging.INFO)
        myjob = sdk.Job("MyAwesomeJob", "Do something awesome", MyAwesomeJob)
        sdk.serve([myjob])

Java
~~~~

.. code:: java

    package io.gaiapipeline;

    import io.gaiapipeline.javasdk.*;

    import java.util.ArrayList;
    import java.util.Arrays;
    import java.util.logging.Logger;

    public class Pipeline
    {
        private static final Logger LOGGER = Logger.getLogger(Pipeline.class.getName());

        private static Handler MyAwesomeJob = (gaiaArgs) -> {
            LOGGER.info("This output will be streamed back to gaia and will be displayed in the pipeline logs.");
	    // Just raise an exception to tell Gaia if a job failed.
            // throw new IllegalArgumentException("Oh no, this job failed!");
        };

        public static void main( String[] args )
        {
            PipelineJob myjob = new PipelineJob();
            myjob.setTitle("MyAwesomeJob");
            myjob.setDescription("Do something awesome.");
            myjob.setHandler(MyAwesomeJob);

            Javasdk sdk = new Javasdk();
            try {
                sdk.Serve(new ArrayList<>(Arrays.asList(myjob)));
            } catch (Exception ex) {
                ex.printStackTrace();
            }
        }
    }

C++
~~~~

.. code:: cpp

   #include "cppsdk/sdk.h"
   #include <list>
   #include <iostream>

   void DoSomethingAwesome(std::list<gaia::argument> args) throw(std::string) {
      std::cerr << "This output will be streamed back to gaia and will be displayed in the pipeline logs." << std::endl;

      // An error occurred? Return it back so gaia knows that this job failed.
      // throw "Uhh something badly happened!"
   }

   int main() {
      std::list<gaia::job> jobs;
      gaia::job awesomejob;
      awesomejob.handler = &DoSomethingAwesome;
      awesomejob.title = "DoSomethingAwesome";
      awesomejob.description = "This job does something awesome.";
      jobs.push_back(awesomejob);

      try {
         gaia::Serve(jobs);
      } catch (string e) {
         std::cerr << "Error: " << e << std::endl;
      }
   }

Ruby
~~~~

.. code:: ruby

   require 'rubysdk'

   class Main
       AwesomeJob = lambda do |args|
           STDERR.puts "This output will be streamed back to gaia and will be displayed in the pipeline logs."

           # An error occurred? Raise an exception and gaia will fail the pipeline.
           # raise "Oh gosh! Something went wrong!"
       end

       def self.main
           awesomejob = Interface::Job.new(title: "Awesome Job",
                                           handler: AwesomeJob,
                                           desc: "This job does something awesome.")

           begin
               RubySDK.Serve([awesomejob])
           rescue => e
               puts "Error occured: #{e}"
               exit(false)
           end
       end
   end

Node.JS
~~~~

.. code:: javascript

   const nodesdk = require('@gaia-pipeline/nodesdk');

   function DoSomethingAwesome(args) {
       console.error('This output will be streamed back to gaia and will be displayed in the pipeline logs.');

       // An error occurred? Throw it back so gaia knows that this job failed.
       // throw new Error('My error message');
   }

   // Serve
   try {
       nodesdk.Serve([{
           handler: DoSomethingAwesome,
           title: 'DoSomethingAwesome',
           description: 'This job does something awesome.'
       }]);
   } catch (err) {
       console.error(err);
   }

Pipelines are defined by jobs and a function usually represents a job. You can define as many jobs in your pipeline as you want.

Every function accepts arguments. Those arguments can be requested from the pipeline itself and the values passed back in from the UI.

Some pipeline jobs need a specific order of execution. `DependsOn` allows you to declare dependencies for every job.

You can find real examples and more information on `how to develop a pipeline`_ in the docs.

Security
========

See the Documentation located here: `security-docs`_.

Documentation and more
======================

Please find the docs at https://docs.gaia-pipeline.io. We also have a tutorials section over there with examples and real use-case scenarios. For example, `Kubernetes deployment with vault integration`_.

Questions and Answers (Q&A)
---------------------------

What problem solves **Gaia**?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Literally every tool which were designed for automation, continuous integration (CI), and continuous deployment (CD) like Spinnaker, Jenkins, Gitlab CI/CD, TravisCI, CircleCI, Codeship, Bamboo and many more, introduced their own configuration format. Some of them don't even support *configuration/automation as code*. This works well for simple tasks like running a ``go install`` or ``mvn clean install`` but in the real world there is more to do.

Gaia is the first platform which does not limit the user and provides full support for almost all common programming languages without losing the features offered by todays CI/CD tools.

What is a **pipeline**?
~~~~~~~~~~~~~~~~~~~~~~~
A pipeline is a real application with at least one function (we call it a Job). Every programming language can be used as long as gRPC is supported. We offer SDKs to support the development.

What is a **job**?
~~~~~~~~~~~~~~~~~~
A job is a function, usually globally exposed to Gaia. Dependent on the dependency graph, Gaia will execute this function in a specific order.

Why do I need an **SDK**?
~~~~~~~~~~~~~~~~~~~~~~~~~~
The SDK implements the Gaia plugin gRPC interface and offers helper functions like serving the gRPC-Server. This helps you to focus on the real problem instead of doing the boring stuff.

Which programming languages are supported?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
We currently fully support Go, Java, Python, C++, Ruby and Node.JS.

When do you support programming language **XYZ**?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
We are working hard to support as much programming languages as possible but our resources are limited and we are also mostly no experts in all programming languages. If you are willing to contribute, feel free to open an issue and start working.

Roadmap
=======

Gaia is currently available as alpha version. We extremely recommend to not use it for mission critical jobs and for production yet. Things will change in the future and essential features may break.

One of the main issues currently is the lack of unit- and integration tests. This is on our to-do list and we are working on this topic with high priority.

It is planned that other programming languages should be supported in the next few months. It is up to the community which languages will be supported next.

Contributing
============

Gaia can only evolve and become a great product with the help of contributors. If you like to contribute, please have a look at our `issues section`_. We do our best to mark issues for new contributors with the label *good first issue*.

If you think you found a good first issue, please consider this list as a short guide:

* If the issue is clear and you have no questions, please leave a short comment that you started working on this. The issue will be usually blocked for two weeks for you to solve it.
* If something is not clear or you are unsure what to do, please leave a comment so we can add more detailed description.
* Make sure your development environment is configured and set up. You need `Go installed`_ on your machine and also `nodeJS`_ for the frontend. Clone this repository and run the **make** command inside the cloned folder. This will start the backend. To start the frontend you have to open a new terminal window and go into the frontend folder. There you run **npm install** and then **npm run serve**. This should automatically open a new browser window.
* Before you start your work, you should fork this repository and push changes to your fork. Afterwards, send a merge request back to upstream.

Contact
=======

If you have any questions feel free to contact us on `slack`_.

.. _`HashiCorp's go-plugin`: https://github.com/hashicorp/go-plugin
.. _`gRPC`: https://grpc.io/
.. _`Do not use it for mission critical jobs yet!`: https://tenor.com/view/enter-at-your-own-risk-gif-8912210
.. _`YAML`: https://en.wikipedia.org/wiki/YAML
.. _`releases page`: https://github.com/gaia-pipeline/gaia/releases
.. _`Packer`: https://www.packer.io/
.. _`Terraform`: https://www.terraform.io/
.. _`Nomad`: https://www.nomadproject.io/
.. _`Vault`: https://www.vaultproject.io/
.. _`boltDB`: https://github.com/coreos/bbolt
.. _`Unix nice level`: https://en.wikipedia.org/wiki/Nice_(Unix)
.. _`issues section`: https://github.com/gaia-pipeline/gaia/issues
.. _`Go installed`: https://golang.org/doc/install
.. _`nodeJS`: https://nodejs.org/
.. _`go-example repo`: https://github.com/gaia-pipeline/go-example
.. _`slack`: https://slack.gaia-pipeline.io/
.. _`Kubernetes deployment with vault integration`: https://docs.gaia-pipeline.io/tutorials/kube-vault-deploy/
.. _`git push`: https://git-scm.com/docs/git-push
.. _`HTTP/2`: https://http2.github.io/
.. _`security-docs`: https://github.com/gaia-pipeline/gaia/blob/master/security/README.md
.. _`plugin system`: https://en.wikipedia.org/wiki/Plug-in_(computing)
.. _`available docker image tags`: https://hub.docker.com/r/gaiapipeline/gaia/tags/
.. _`how to develop a pipeline`: https://docs.gaia-pipeline.io/develop-pipelines/
.. _`gaia-pipeline.io`: https://gaia-pipeline.io/

.. |build-status| image:: https://circleci.com/gh/gaia-pipeline/gaia/tree/master.svg?style=shield&circle-token=c0e15edfb08f8076076cbbb55558af6cfecb89b8
    :alt: Build Status
    :scale: 100%
    :target: https://circleci.com/gh/gaia-pipeline/gaia/tree/master

.. |go-report| image:: https://goreportcard.com/badge/github.com/gaia-pipeline/gaia
    :alt: Go Report Card
    :target: https://goreportcard.com/report/github.com/gaia-pipeline/gaia

.. |go-doc| image:: https://godoc.org/github.com/gaia-pipeline/gaia?status.svg
    :alt: GoDoc
    :target: https://godoc.org/github.com/gaia-pipeline/gaia

.. |apache2| image:: https://img.shields.io/badge/license-Apache-blue.svg
    :alt: Apache licensed
    :target: https://github.com/gaia-pipeline/gaia/blob/master/LICENSE

.. |chat| image:: https://gaia-slack-invite.herokuapp.com/badge.svg
    :alt: Slack
    :target: https://gaia-slack-invite.herokuapp.com/

.. |codecov| image:: https://codecov.io/gh/gaia-pipeline/gaia/branch/master/graph/badge.svg
    :target: https://codecov.io/gh/gaia-pipeline/gaia

.. |sh-login| image:: https://github.com/gaia-pipeline/gaia/blob/master/screenshots/login.png
    :alt: gaia login screenshot
    :width: 650px

.. |sh-overview| image:: https://github.com/gaia-pipeline/gaia/blob/master/screenshots/overview.png
    :alt: gaia overview screenshot
    :width: 650px

.. |sh-create-pipeline| image:: https://github.com/gaia-pipeline/gaia/blob/master/screenshots/create-pipeline.png
    :alt: gaia create pipeline screenshot
    :width: 650px

.. |sh-vault| image:: https://github.com/gaia-pipeline/gaia/blob/master/screenshots/vault.png
    :alt: gaia Vault screenshot
    :width: 650px

.. |sh-pipeline-detailed| image:: https://github.com/gaia-pipeline/gaia/blob/master/screenshots/detail-pipeline.png
    :alt: gaia pipeline detailed screenshot
    :width: 650px

.. |sh-pipeline-logs| image:: https://github.com/gaia-pipeline/gaia/blob/master/screenshots/logs-pipeline.png
    :alt: gaia pipeline logs screenshot
    :width: 650px

.. |sh-settings| image:: https://github.com/gaia-pipeline/gaia/blob/master/screenshots/settings.png
    :alt: gaia settings screenshot
    :width: 650px

Documentation

Index

Constants

View Source 
const (
	// PTypeUnknown unknown plugin type
	PTypeUnknown PipelineType = "unknown"

	// PTypeGolang golang plugin type
	PTypeGolang PipelineType = "golang"

	// PTypeJava java plugin type
	PTypeJava PipelineType = "java"

	// PTypePython python plugin type
	PTypePython PipelineType = "python"

	// PTypeCpp C++ plugin type
	PTypeCpp PipelineType = "cpp"

	// PTypeRuby ruby plugin type
	PTypeRuby PipelineType = "ruby"

	// PTypeNodeJS NodeJS plugin type
	PTypeNodeJS PipelineType = "nodejs"

	// CreatePipelineFailed status
	CreatePipelineFailed CreatePipelineType = "failed"

	// CreatePipelineRunning status
	CreatePipelineRunning CreatePipelineType = "running"

	// CreatePipelineSuccess status
	CreatePipelineSuccess CreatePipelineType = "success"

	// RunNotScheduled status
	RunNotScheduled PipelineRunStatus = "not scheduled"

	// RunScheduled status
	RunScheduled PipelineRunStatus = "scheduled"

	// RunFailed status
	RunFailed PipelineRunStatus = "failed"

	// RunSuccess status
	RunSuccess PipelineRunStatus = "success"

	// RunRunning status
	RunRunning PipelineRunStatus = "running"

	// RunCancelled status
	RunCancelled PipelineRunStatus = "cancelled"

	// RunReschedule status
	RunReschedule PipelineRunStatus = "reschedule"

	// JobWaitingExec status
	JobWaitingExec JobStatus = "waiting for execution"

	// JobSuccess status
	JobSuccess JobStatus = "success"

	// JobFailed status
	JobFailed JobStatus = "failed"

	// JobRunning status
	JobRunning JobStatus = "running"

	// ModeServer mode
	ModeServer Mode = "server"

	// ModeWorker mode
	ModeWorker Mode = "worker"

	// WorkerActive status
	WorkerActive WorkerStatus = "active"

	// WorkerInactive status
	WorkerInactive WorkerStatus = "inactive"

	// WorkerSuspended status
	WorkerSuspended WorkerStatus = "suspended"

	// LogsFolderName represents the Name of the logs folder in pipeline run folder
	LogsFolderName = "logs"

	// LogsFileName represents the file name of the logs output
	LogsFileName = "output.log"

	// APIVersion represents the current API version
	APIVersion = "v1"

	// SrcFolder folder name where the sources are stored
	SrcFolder = "src"

	// TmpFolder is the temp folder for temporary files
	TmpFolder = "tmp"

	// TmpPythonFolder is the name of the python temporary folder
	TmpPythonFolder = "python"

	// TmpGoFolder is the name of the golang temporary folder
	TmpGoFolder = "golang"

	// TmpCppFolder is the name of the c++ temporary folder
	TmpCppFolder = "cpp"

	// TmpRubyFolder is the name of the ruby temporary folder
	TmpRubyFolder = "ruby"

	// TmpNodeJSFolder is the name of the nodejs temporary folder
	TmpNodeJSFolder = "nodejs"

	// TmpJavaFolder is the name of the java temporary folder
	TmpJavaFolder = "java"

	// WorkerRegisterKey is the used key for worker registration secret
	WorkerRegisterKey = "WORKER_REGISTER_KEY"

	// ExecutablePermission is the permission used for gaia created executables.
	ExecutablePermission = 0700

	// StartReasonRemote label for pipelines which were triggered through a remote token.
	StartReasonRemote = "remote"

	// StartReasonManual label for pipelines which were triggered through the admin site.
	StartReasonManual = "manual"

	// StartReasonScheduled label for pipelines which were triggered automated process, i.e. cron job.
	StartReasonScheduled = "scheduled"

	// SecretNamePrefix defines the prefix for github secrets for pipelines.
	SecretNamePrefix = "GITHUB_WEBHOOK_SECRET_"

	// LegacySecretName is the old name for a secret that has been created by previous versions.
	// Deprecated
	LegacySecretName = "GITHUB_WEBHOOK_SECRET"
)
View Source 
const JwtExpiry = 12 * 60 * 60

JwtExpiry is the default JWT expiry.

Variables

View Source 
var Cfg = &Config{}

Cfg represents the global config instance

Functions

This section is empty.

Types

type Argument added in v0.2.1 

type Argument struct {
	Description string `json:"desc,omitempty"`
	Type        string `json:"type,omitempty"`
	Key         string `json:"key,omitempty"`
	Value       string `json:"value,omitempty"`
}

Argument represents a single argument of a job

type Config 

type Config struct {
	DevMode                 bool
	ModeRaw                 string
	Mode                    Mode
	VersionSwitch           bool
	Poll                    bool
	PVal                    int
	ListenPort              string
	HomePath                string
	Hostname                string
	VaultPath               string
	DataPath                string
	PipelinePath            string
	WorkspacePath           string
	Worker                  int
	JwtPrivateKeyPath       string
	JWTKey                  interface{}
	Logger                  hclog.Logger
	CAPath                  string
	WorkerServerPort        string
	PreventPrimaryWork      bool
	AutoDockerMode          bool
	DockerHostURL           string
	DockerRunImage          string
	DockerWorkerHostURL     string
	DockerWorkerGRPCHostURL string
	RBACEnabled             bool
	RBACDebug               bool

	// Worker
	WorkerName        string
	WorkerHostURL     string
	WorkerGRPCHostURL string
	WorkerSecret      string
	WorkerTags        string

	Bolt struct {
		Mode os.FileMode
	}
}

Config holds all config options

type CreatePipeline 

type CreatePipeline struct {
	ID          string             `json:"id,omitempty"`
	Pipeline    Pipeline           `json:"pipeline,omitempty"`
	Status      int                `json:"status,omitempty"`
	StatusType  CreatePipelineType `json:"statustype,omitempty"`
	Output      string             `json:"output,omitempty"`
	Created     time.Time          `json:"created,omitempty"`
	GitHubToken string             `json:"githubtoken,omitempty"`
}

CreatePipeline represents a pipeline which is not yet compiled.

type CreatePipelineType 

type CreatePipelineType string

CreatePipelineType represents the different status types a create pipeline can have.

type GitRepo 

type GitRepo struct {
	URL            string     `json:"url,omitempty"`
	Username       string     `json:"user,omitempty"`
	Password       string     `json:"password,omitempty"`
	PrivateKey     PrivateKey `json:"privatekey,omitempty"`
	SelectedBranch string     `json:"selectedbranch,omitempty"`
	Branches       []string   `json:"branches,omitempty"`
	LocalDest      string     `json:"-"`
}

GitRepo represents a single git repository

type Job 

type Job struct {
	ID           uint32      `json:"id,omitempty"`
	Title        string      `json:"title,omitempty"`
	Description  string      `json:"desc,omitempty"`
	DependsOn    []*Job      `json:"dependson,omitempty"`
	Status       JobStatus   `json:"status,omitempty"`
	Args         []*Argument `json:"args,omitempty"`
	FailPipeline bool        `json:"failpipeline,omitempty"`
}

Job represents a single job of a pipeline

type JobStatus 

type JobStatus string

JobStatus represents the different status a job can have

type JwtCustomClaims added in v0.2.6 

type JwtCustomClaims struct {
	Username string   `json:"username"`
	Roles    []string `json:"roles"`
	jwt.StandardClaims
}

JwtCustomClaims is the custom JWT claims for a Gaia session.

type Mode added in v0.2.4 

type Mode string

Mode represents the different modes for Gaia

type Pipeline 

type Pipeline struct {
	ID                int          `json:"id,omitempty"`
	Name              string       `json:"name,omitempty"`
	Repo              *GitRepo     `json:"repo,omitempty"`
	Type              PipelineType `json:"type,omitempty"`
	ExecPath          string       `json:"execpath,omitempty"`
	SHA256Sum         []byte       `json:"sha256sum,omitempty"`
	Jobs              []*Job       `json:"jobs,omitempty"`
	Created           time.Time    `json:"created,omitempty"`
	UUID              string       `json:"uuid,omitempty"`
	IsNotValid        bool         `json:"notvalid,omitempty"`
	PeriodicSchedules []string     `json:"periodicschedules,omitempty"`
	TriggerToken      string       `json:"trigger_token,omitempty"`
	Tags              []string     `json:"tags,omitempty"`
	Docker            bool         `json:"docker"`
	CronInst          *cron.Cron   `json:"-"`
}

Pipeline represents a single pipeline

type PipelineRun 

type PipelineRun struct {
	UniqueID       string            `json:"uniqueid"`
	ID             int               `json:"id"`
	PipelineID     int               `json:"pipelineid"`
	StartDate      time.Time         `json:"startdate,omitempty"`
	StartReason    string            `json:"started_reason"`
	FinishDate     time.Time         `json:"finishdate,omitempty"`
	ScheduleDate   time.Time         `json:"scheduledate,omitempty"`
	Status         PipelineRunStatus `json:"status,omitempty"`
	Jobs           []*Job            `json:"jobs,omitempty"`
	PipelineType   PipelineType      `json:"pipelinetype,omitempty"`
	PipelineTags   []string          `json:"pipelinetags,omitempty"`
	Docker         bool              `json:"docker,omitempty"`
	DockerWorkerID string            `json:"dockerworkerid,omitempty"`
}

PipelineRun represents a single run of a pipeline.

type PipelineRunStatus 

type PipelineRunStatus string

PipelineRunStatus represents the different status a run can have.

type PipelineType 

type PipelineType string

PipelineType represents supported plugin types

func (PipelineType) String 

func (p PipelineType) String() string

String returns a pipeline type string back

type PrivateKey 

type PrivateKey struct {
	Key      string `json:"key,omitempty"`
	Username string `json:"username,omitempty"`
	Password string `json:"password,omitempty"`
}

PrivateKey represents a pem encoded private key

type SHAPair added in v0.2.4 

type SHAPair struct {
	Original   []byte `json:"original"`
	Worker     []byte `json:"worker"`
	PipelineID int    `json:"pipelineid"`
}

SHAPair struct contains the original sha of a pipeline executable and the new sha which was created when the worker had to rebuild it.

type StoreConfig added in v0.2.4 

type StoreConfig struct {
	ID          int
	Poll        bool
	RBACEnabled bool
}

StoreConfig defines config settings to be stored in DB.

type User 

type User struct {
	Username     string    `json:"username,omitempty"`
	Password     string    `json:"password,omitempty"`
	DisplayName  string    `json:"display_name,omitempty"`
	Tokenstring  string    `json:"tokenstring,omitempty"`
	JwtExpiry    int64     `json:"jwtexpiry,omitempty"`
	LastLogin    time.Time `json:"lastlogin,omitempty"`
	TriggerToken string    `json:"trigger_token,omitempty"`
}

User is the user object

type UserPermission added in v0.2.3 

type UserPermission struct {
	Username string   `json:"username"`
	Roles    []string `json:"roles"`
	Groups   []string `json:"groups"`
}

UserPermission is stored in its own data structure away from the core user. It represents all permission data for a single user.

type UserRole added in v0.2.3 

type UserRole struct {
	Name        string              `json:"name"`
	Description string              `json:"description"`
	APIEndpoint []*UserRoleEndpoint `json:"api_endpoints"`
}

UserRole represents a single permission role.

type UserRoleCategory added in v0.2.3 

type UserRoleCategory struct {
	Name        string      `json:"name"`
	Description string      `json:"description"`
	Roles       []*UserRole `json:"roles"`
}

UserRoleCategory represents the top-level of the permission role system

type UserRoleEndpoint added in v0.2.3 

type UserRoleEndpoint struct {
	Path   string `json:"path"`
	Method string `json:"method"`
}

UserRoleEndpoint represents the path and method of the API endpoint to be secured.

type Worker added in v0.2.4 

type Worker struct {
	UniqueID     string       `json:"uniqueid"`
	Name         string       `json:"name"`
	Status       WorkerStatus `json:"status"`
	Slots        int32        `json:"slots"`
	RegisterDate time.Time    `json:"registerdate"`
	LastContact  time.Time    `json:"lastcontact"`
	FinishedRuns int64        `json:"finishedruns"`
	Tags         []string     `json:"tags"`
}

Worker represents a single registered worker.

type WorkerStatus added in v0.2.4 

type WorkerStatus string

WorkerStatus represents the different status a worker can have

Source Files

View all Source files

Directories

Path Synopsis
cmd
gaia
errors
helper
assethelper
filehelper
pipelinehelper
rolehelper
stringhelper
pipelines
rbac
user
workers
rbac
memdb
workers
agent
agent/api
docker
pipeline
proto
scheduler/gaiascheduler
scheduler/service
server

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.