Databricks sync

​

Prerequisites

• A project with secrets configured
• A Databricks secret scope you want secrets synced into. If you don’t have one yet, create a scope in your workspace first.

​

Step 1: Set up in Databricks

1

Open workspace settings

In Databricks, open the dropdown in the top right and select Settings.

2

Open service principals

Under Identity & Access, select Manage in the Service Principals section.

3

Add a service principal

Select Add Service Principal, then Add New, and create a service principal for Infisical.

4

Generate a secret

Open the new service principal, select the Secrets tab, and select Generate Secret. Save the Client ID and Secret for the Infisical form.

​

Step 2: Set up the sync in Infisical

1

Add the sync

In your project, go to Integrations and open the Secret Syncs tab. Select + Add Sync.Then, select the Databricks sync.

2

Configure the source

Configure the Source to specify which secrets to sync from Infisical.

• Environment: The project environment to retrieve secrets from.
• Secret Path: The folder path to retrieve secrets from.

If you need to sync secrets from multiple folder locations, check out secret imports.

Then select Next to configure the sync’s destination.

3

Configure the app connection

Create or select the Databricks app connection the sync will use.

• Create a new app connection
• Use an existing connection

Under Databricks Connection, select Create Connection in the dropdown, then choose Databricks Connection. Select the Service Principal method, then fill in:

• Name: A descriptive name for the connection.
• Description (optional): A note for future reference.
• Workspace URL: The URL of your Databricks workspace.
• Client ID: The Client ID of the Databricks service principal created for Infisical.
• Client Secret: The secret generated for that service principal.

Select Connect to Databricks. Infisical returns you to the sync form with the new connection selected.

This creates a connection scoped to the current project. To share the connection across other projects, create it at the organization level first, then select it here.

Under Databricks Connection, select the app connection you’d like to use.

4

Configure the target scope

Configure the Databricks secret scope where secrets should be deployed.

• Scope: The Databricks secret scope to sync secrets to.

Ensure your service principal has Write permissions for the specified secret scope. We recommend a designated scope for the sync so it doesn’t remove secrets managed elsewhere.

When you’re done, select Next.

5

Configure the sync options

Configure the Sync Options to specify how secrets should be synced.

• Initial Sync Behavior: How Infisical resolves the initial sync.
  • Overwrite Destination Secrets: Removes any secrets at the destination not present in Infisical.
  The Databricks Secret Sync doesn’t support importing secrets.
• Key Schema: Template that transforms secret names when syncing. Use {{secretKey}} for the original secret name and {{environment}} for the environment.
  Use a Key Schema so Infisical only manages the keys that match the schema, leaving other keys untouched.
• Auto-Sync Enabled: When enabled, secrets sync automatically as the source changes. Disable to sync manually only.
• Disable Secret Deletion: When enabled, Infisical doesn’t remove secrets from the destination. Enable this if you intend to manage some secrets manually outside of Infisical.

When you’re done, select Next.

6

Configure the details

Give the sync a Name and an optional Description. The name must be slug-friendly.Then select Next.

7

Review and create

Review your Databricks Sync configuration, then select Create Sync.

The sync is created. If auto-sync is enabled, it begins syncing secrets to the selected Databricks secret scope right away.