jaeger-s3

README

jaeger-s3

jaeger-s3 is gRPC storage plugin for Jaeger, which uses Amazon Kinesis Data Firehose to store spans on Amazon S3. The stored spans are queried using Amazon Athena.

Usage

Prepare your environment

Prepare our environment using terraform a comparable tool. The setup instructions are not final yet and might change in the future.

TBD

Install the plugin

kind: ConfigMap
apiVersion: v1
metadata:
  name: jaeger-s3
  namespace: jaeger-collector
data:
  config.yaml: >
    kinesis:
      spanStreamName: jaeger
    athena:
      databaseName: default
      tableName: jaeger
      outputLocation: s3://athena-results-bucket/

---
apiVersion: v1
kind: Secret
metadata:
  name: jaeger
  namespace: jaeger-collector
type: Opaque
data:
  AWS_REGION: ZXUtd2VzdC0x # encode your region (us-east-1) in this case
---
apiVersion: jaegertracing.io/v1
kind: Jaeger
metadata:
  name: jaeger
  namespace: jaeger-collector
spec:
  strategy: production
  collector:
    maxReplicas: 10
    options:
      collector:
        # queue size and memory requests / limits based on
        # https://github.com/jaegertracing/jaeger-operator/issues/872#issuecomment-596618094
        queue-size-memory: 64
    resources:
      requests:
        memory: 128Mi
        cpu: "150m"
      limits:
        memory: 512Mi
        cpu: "500m"
  query:
    replicas: 2
    resources:
      requests:
        memory: 125Mi
        cpu: "150m"
      limits:
        memory: 1024Mi
        cpu: "500m"
  annotations:
    iam.amazonaws.com/role: jaeger
  storage:
    type: grpc-plugin
    grpcPlugin:
      image: ghcr.io/johanneswuerbach/jaeger-s3:v0.0.1
    options:
      grpc-storage-plugin:
        binary: /plugin/jaeger-s3
        configuration-file: /plugin-config/config.yaml
        log-level: debug
    esIndexCleaner:
      enabled: false
    dependencies:
      enabled: false
    # Not really a secret, but there is no other way to get environment
    # variables into the container currently
    secretName: jaeger
  volumeMounts:
    - name: plugin-config
      mountPath: /plugin-config
  volumes:
    - name: plugin-config
      configMap:
        name: jaeger-s3