terraform-provider-databricks

README

Terraform Provider

NOTE: Databricks seems to have created an official Terraform provider available here. Having an official, supported implementation makes this provider obsolete. Thus, this repository is now archived.

• Website: https://www.terraform.io
• 
• Mailing list: Google Groups

Requirements

• Terraform 0.10.x
• Go 1.9 (to build the provider plugin)

Usage

# For example, restrict provider version in 0.1.x
provider "databricks" {
  version = "~> 0.1"
}

Building The Provider

Clone repository to: $GOPATH/src/github.com/betabandido/terraform-provider-databricks

$ mkdir -p $GOPATH/src/github.com/betabandido; cd $GOPATH/src/github.com/betabandido
$ git clone git@github.com:betabandido/terraform-provider-databricks

Enter the provider directory and build the provider

$ cd $GOPATH/src/github.com/betabandido/terraform-provider-databricks
$ make build

Using the provider

provider "databricks" {
    domain = "<your-account>.cloud.databricks.com"
    token = "<your token>"
}

resource "databricks_notebook" "notebook" {
    path = "/Users/<username>/tf-test"
    language = "PYTHON"
    content = "${base64encode("print('generated by terraform')")}"
}

resource "databricks_cluster" "cluster" {
    name                    = "tf-test"
    spark_version           = "4.1.x-scala2.11"
    node_type_id            = "m4.large"
    num_workers             = 1
    autotermination_minutes = 10

    aws_attributes = {
        zone_id          = "eu-west-1c"
        ebs_volume_type  = "GENERAL_PURPOSE_SSD"
        ebs_volume_count = 1
        ebs_volume_size  = 100
    }    
}

Developing the Provider

If you wish to work on the provider, you'll first need Go installed on your machine (version 1.9+ is required). You'll also need to correctly setup a GOPATH, as well as adding $GOPATH/bin to your $PATH.

To compile the provider, run make build. This will build the provider and put the provider binary in the $GOPATH/bin directory.

$ make bin
...
$ $GOPATH/bin/terraform-provider-databricks
...

In order to test the provider, you can simply run make test.

$ make test

In order to run the full suite of Acceptance tests, run make testacc.

Note: Acceptance tests create real resources, and often cost money to run.

$ make testacc