How to pass argument value to databricks_global_init_script resource

I am trying to call datadog-install-driver-workers.sh using terraform resource databricks_global_init_script and this script required 2 input values to pass DD_API_KEY and DD_ENV How do I pass these these values along with source script path?

resource "databricks_global_init_script" "init1" {
  source = "${path.module}/datadog-install-driver-workers.sh"
  name   = "my init script"
}

I would go a different route - instead of the requiring each job & cluster to specify necessary values, you can use the templatefile function to substitute necessary values in the script, like this:

locals {
  script_path = "${path.module}/datadog-install-driver-workers.sh"
  params = {
    DD_ENV = "dev"
    DD_API_KEY = "aaaaa"
  }
}

resource "databricks_global_init_script" "init" {
  name = "datadog script"
  content_base64 = base64encode(templatefile(local.script_path, local.params))
}

with the script template as following:

#!/bin/bash
#


DD_ENV="${DD_ENV}"
DD_API_KEY="${DD_API_KEY}"

echo "Some code that outputs $${DD_ENV}"

and this will generate it correctly:

The only thing that you need to take into account is that you may need to escape shell variables substitutions that use the same syntax as Terraform: ${var} to $${var} - see documentation.

Init scripts do not take any parameters. Your code is fine as is.

Datadog docs mention that DD_API_KEY and DD_ENV are expected to be set as environment variables. Those can be defined during cluster creation. Using UI, this is done on Advances Options -> Spark -> Environment variables (docs). Also both Cluster API and Terraform databricks_cluster resource support spark_env_vars parameter that you can use. For example, with Cluster API this would be the relevant payload:

{
  "cluster_name": "my-cluster",
  "spark_env_vars": {
    "DD_API_KEY": "blahblah",
    "DD_ENV": "blah"
  },
  [...other attributes...]
}

Note that you could enforce that specific environment variables are always defined using cluster policies.