Search
⌃K

BigQuery

Google BigQuery is a fully managed cloud-based enterprise data warehouse. This article will cover how to connect to BigQuery from Noteable.

Prepare

In order to create a BigQuery connection, you need a ​​Google Cloud Service Account Key (SAK) in JSON. This JSON file is generated at the time you create the service account and is not retrievable afterward. For steps to create a new service account and download the key, click here.
Optional parameters:
  • Project ID: can be helpful if the SAK has access to multiple projects
  • Default dataset: can be helpful if the project has multiple datasets.
  • Batch fetch size: specifies the number of results to return (default: 5000). Learn more.
If your data source is behind a firewall, you will need to ensure your firewall accepts incoming connections from Noteable. Read more: Query external data.

Create connections

To create a data connection:
  1. 1.
    Pick connection type.
  2. 2.
    Store credentials.
  3. 3.
    Start or restart the kernel.
There are multiple places you can create data connections:
Notebook
Resources page
To add a data connection from the notebook:
  1. 1.
    Open the Data Connections panel by clicking on the database icon (
    ) in the left sidebar.
  2. 2.
    Click on the
    sign to launch the Create a data connection modal.
  3. 3.
    Select BigQuery for the connection type.
  4. 4.
    Provide a Name for the data connection and a description, if desired.
  5. 5.
    Paste the contents of the JSON file into the Service Account Key field.
  6. 6.
    Provide the Project ID, Default Dataset, and Batch Fetch Size, if desired.
  7. 7.
    Choose the connection's Visibility - this cannot be changed later:
    • Private connections can only be seen, managed, or accessed by the user who created the connections, and can be used in any space.
    • Space-level connections can be seen and managed by all users who have Contributor or Owner access for the space but can only be used in notebooks within the designated space.
  8. 8.
    Click Create.
  9. 9.
    Restart the kernel, if prompted.
To add a data connection from the resources page:
  1. 1.
    Click on the Data Connections link in the main sidebar. This sidebar is visible from all space or project pages.
  2. 2.
    Click on the +Create a data connection button to launch the Add data connection modal.
  3. 3.
    Select BigQuery for the connection type.
  4. 4.
    Provide a Name for the data connection and a description, if desired.
  5. 5.
    Paste the contents of the JSON file into the Service Account Key field.
  6. 6.
    Provide the Project ID, Default Dataset, and Batch Fetch Size, if desired.
  7. 7.
    Choose the connection's Visibility - this cannot be changed later:
    • Private connections can only be seen, managed, or accessed by the user who created the connections, and can be used in any space.
    • Space-level connections can be seen and managed by all users who have Contributor or Owner access for the space but can only be used in notebooks within the designated space.
  8. 8.
    Click Create.
  9. 9.
    Restart any running kernels to use this connection.

Use connections

Learn more about how to use SQL cells here.
Noteable Integrations - Previous
Amazon Redshift
Next - Noteable Integrations
CockroachDB
Last modified 3mo ago