Overview
This project provides an experimental operator for managing FoundationDB
clusters on Kubernetes.
Running the Operator
To run the operator in your environment, you need to install the controller and
the CRDs:
kubectl apply -f https://raw.githubusercontent.com/FoundationDB/fdb-kubernetes-operator/master/config/crd/bases/apps.foundationdb.org_foundationdbclusters.yaml
kubectl apply -f https://raw.githubusercontent.com/FoundationDB/fdb-kubernetes-operator/master/config/crd/bases/apps.foundationdb.org_foundationdbbackups.yaml
kubectl apply -f https://raw.githubusercontent.com/FoundationDB/fdb-kubernetes-operator/master/config/crd/bases/apps.foundationdb.org_foundationdbrestores.yaml
kubectl apply -f https://raw.githubusercontent.com/foundationdb/fdb-kubernetes-operator/master/config/samples/deployment.yaml
At that point, you can set up a sample cluster:
kubectl apply -f https://raw.githubusercontent.com/foundationdb/fdb-kubernetes-operator/master/config/samples/cluster.yaml
You can see logs from the operator by running
kubectl logs -f -l app=fdb-kubernetes-operator-controller-manager --container=manager
. To determine whether the reconciliation has completed, you can run kubectl get foundationdbcluster my-cluster
. This will show the latest generation of the
spec and the last reconciled generation of the spec. Once reconciliation has completed, these values will be the same.
Once the reconciliation is complete, you can run kubectl exec -it my-cluster-log-1 -- fdbcli
to open up a CLI on your cluster.
You can also browse the sample directory for more examples of different resource configurations.
For more information about using the operator, including detailed discussion of how to customize your deployments, see the user manual.
For more information on version compatibility, see our compatibility guide.
For more information on the fields you can define on the cluster resource, see
the API documentation.
Local Development
Environment Set-up
- Install GO on your machine, see the Getting Started guide for more information.
- Install KubeBuilder and its dependencies on your machine, see The KubeBuilder Book for more information (currently version
2.3.2
is used).
- Set your $GOPATH, e.x.
/Users/me/Code/go
.
- Install kustomize.
- Install the foundationDB client package.
- If you want to modify the manifests you currently need yq, we use the
v4.6.1
version.
Running Locally
To get this controller running in a local Kubernetes cluster:
- Change your current directory to $GOPATH/src/github.com using the
command
cd $GOPATH/src/github.com
and run mkdir foundationdb
to create the directory foundationdb
.
- CD into the newly created directory and clone this github repo inside
$GOPATH/src/github.com/foundationdb
.
- Run
config/test-certs/generate_secrets.bash
to set up a secret with
self-signed test certs.
- Run
make rebuild-operator
to install the operator.
- Run
kubectl apply -k ./config/tests/base
to create a new FoundationDB cluster with the operator.
Running locally with nerdctl
Instead of Docker you can also use nerdctl to build and push your images.
In order to use a different image builder than docker you can use the env variable BUILDER
:
# This will use nerdctl for building the image in the k8s.io namespace
export BUILDER='nerdctl -n k8s.io'
You can test your setup with SKIP_TEST=1 make container-build
which will build the image locally.
After the command successfully finished you can verify with nerdctl -n k8s.io images fdb-kubernetes-operator:latest
that the image is available.