Search
⌃K

Databricks

Databricks is a cloud-based collaborative data science, data engineering, and data analytics platform. This article will cover how to connect to Databricks from Noteable.
Noteable’s Databricks connector uses the Databricks SQL Connector for Python.

Prepare

You will need the following information to create the connection:
If your data source is behind a firewall, you will need to ensure your firewall accepts incoming connections from Noteable. Read more: Query external data

Create connections

To create a data connection:
  1. 1.
    Pick connection type.
  2. 2.
    Store credentials.
  3. 3.
    Start or restart the kernel.
There are multiple places you can create data connections:
Notebook
Resources page
To add a data connection from the notebook:
  1. 1.
    Open the Data Connections panel by clicking on the database icon (
    ) in the left sidebar.
  2. 2.
    Click on the
    sign to launch the Create a data connection modal.
  3. 3.
    Select Databricks for the connection type.
  4. 4.
    Provide a Name for the data connection and a description, if desired.
  5. 5.
    Provide the Databricks Host.
  6. 6.
    Provide your Access Token.
  7. 7.
    Provide the Database name (default: default).
  8. 8.
    Provide the HTTP Path.
  9. 9.
    Choose the connection's Visibility - this cannot be changed later:
    • Private connections can only be seen, managed, or accessed by the user who created the connections, and can be used in any space.
    • Space-level connections can be seen and managed by all users who have Contributor or Owner access for the space but can only be used in notebooks within the designated space.
  10. 10.
    Click Create.
  11. 11.
    Restart the kernel, if prompted.
To add a data connection from the resources page:
  1. 1.
    Click on the Data Connections link in the main sidebar. This sidebar is visible from all space or project pages.
  2. 2.
    Click on the +Create a data connection button to launch the Add data connection modal.
  3. 3.
    Select Databricks for the connection type.
  4. 4.
    Provide a Name for the data connection and a description, if desired.
  5. 5.
    Provide the Databricks Host.
  6. 6.
    Provide your Access Token.
  7. 7.
    Provide the Database name (default: default).
  8. 8.
    Provide the HTTP Path.
  9. 9.
    Choose the connection's Visibility - this cannot be changed later:
    • Private connections can only be seen, managed, or accessed by the user who created the connections, and can be used in any space.
    • Space-level connections can be seen and managed by all users who have Contributor or Owner access for the space but can only be used in notebooks within the designated space.
  10. 10.
    Click Create.
  11. 11.
    Restart any running kernels to use this connection.

Use connections

Learn more about how to use SQL cells here.