Skip to main content

Databricks Model Provider

To use a language model deployed to Databricks Mosaic AI Model Serving, specify the model endpoint name prefixed with databricks: in the from field and include the required parameters in the params section.

Parameters​

ParameterDescription
databricks_endpointThe Databricks workspace endpoint, e.g., dbc-a12cd3e4-56f7.cloud.databricks.com.
databricks_tokenThe Databricks API token to authenticate with the Unity Catalog API. Use the secret replacement syntax to reference a secret, e.g., ${secrets:my_databricks_token}.

Example spicepod.yaml Configuration​

models:
  - from: databricks:jeadie
    name: food
    params:
      databricks_endpoint: dbc-46470731-42e5.cloud.databricks.com
      databricks_token: ${ secrets:SPICE_DATABRICKS_TOKEN }

Additional Information​

Refer to the Mosaic AI Model Serving documentation for more details on available models and configurations.