cortex

README

Get started: Install • Tutorial • Demo Video • Docs • Examples

Learn more: Website • FAQ • Blog • Subscribe • Twitter • Contact

Deploy, manage, and scale machine learning applications

Deploy machine learning applications without worrying about setting up infrastructure, managing dependencies, or orchestrating data pipelines.

Cortex is actively maintained by Cortex Labs. We're a venture-backed team of infrastructure engineers and we're hiring.

How it works

1. Define your app: define your app using Python, TensorFlow, and PySpark.

2. $ cortex deploy: deploy end-to-end machine learning pipelines to AWS with one command.

3. Serve predictions: serve real time predictions via horizontally scalable JSON APIs.

End-to-end machine learning workflow

Data ingestion: connect to your data warehouse and ingest data.

- kind: environment
  name: dev
  data:
    type: csv
    path: s3a://my-bucket/data.csv
    schema: [@col1, @col2, ...]

Data validation: prevent data quality issues early.

- kind: raw_column
  name: col1
  type: INT_COLUMN
  min: 0
  max: 10

Data transformation: use custom Python and PySpark code to transform data.

- kind: transformed_column
  name: col1_normalized
  transformer_path: normalize.py  # Python / PySpark code
  input: @col1

Model training: train models with custom TensorFlow code.

- kind: model
  name: my_model
  estimator_path: dnn.py  # TensorFlow code
  target_column: @label_col
  input: [@col1_normalized, @col2_indexed, ...]
  hparams:
    hidden_units: [16, 8]
  training:
    batch_size: 32
    num_steps: 10000

Prediction serving: serve real time predictions via JSON APIs.

- kind: api
  name: my-api
  model: @my_model
  compute:
    replicas: 3

Deployment: Cortex deploys your pipeline on scalable cloud infrastructure.

$ cortex deploy
Ingesting data ...
Transforming data ...
Training models ...
Deploying API ...
Ready! https://abc.amazonaws.com/my-api

Key features

• Machine learning pipelines as code: Cortex applications are defined using a simple declarative syntax that enables flexibility and reusability.

• End-to-end machine learning workflow: Cortex spans the machine learning workflow from feature management to model training to prediction serving.

• TensorFlow and PySpark support: Cortex supports custom TensorFlow code for model training and custom PySpark code for data processing.

• Built for the cloud: Cortex can handle production workloads and can be deployed in any AWS account in minutes.