Big Query Setup

Connecting to Google BigQuery involves first providing a mechanism to authenticate to BigQuery using one of three methods. Once authenticated, users then need to select the relevant project to enable the connection.

  • First, go to the security tab and setup BigQuery Authentication (see below)
  • Next, go to the connection tab and setup the Project selections.
  • Click here for more details on setting BigQuery as a data source.

Security and Authentication

On the security tab, select the authentication method:

  • Service Account - via JSON file
  • SSO specific user - via interactive authentication to Google with a single account for all users
  • SSO end user - via interactive authentication to Google by each INDIVIDUAL user as the login into Pyramid

Service Account OAuth Connections

When using a service account, the authentication is common to all users of the connection. The details of the authentication are contained in a JSON file downloaded from the BigQuery administrative console. It contains details like details like Client ID and client secret.

User Account OAuth Connections

Another way to connect to BigQuery is via SSO OAuth Authentication. This type of authentication utilizes the user's credentials to connect and authenticate access to a given data source. The process is often used in big organizations that have centralized security and are using one framework to secure all data assets.

Authentication Options for Google BigQuery and Google Analytics

When creating a data source in Pyramid and completing the setup 'card', administrators can elect which type of authentication model to use:

  • Single Sign On (OAuth) – Specific User: All users of this data source will share and use the credentials and sign in code defined here.

  • Single Sign On (OAuth) – End User: Each user will be prompted to sign into Google when starting Pyramid or when connecting to the data source. This is a “one off” event. The user’s sign in code will be stored and reused for subsequent data access. Pyramid will automatically refresh this as needed. All users will share the Client ID and Client Secret defined here.

Enabling End User OAuth Authentication

Google BigQuery requires the creation of Client ID and Client Secret strings that provide in an encoded manner, the information needed to connect to the particular BigQuery data required. These strings are generated through the Google BigQuery management console and copied and pasted to the relevant dialogue boxes on the data card.

Once logged into Google BigQuery, Client ID and Client Secret strings can be generated from the “Get Credentials” button on this page.

  • Client ID: Google BigQuery Client ID

  • Client Secret: Google BigQuery Client Secret

The Client ID and Client Secret used by all users to access the Google BigQuery application. With the drop down set to “Single Sign On (OAuth) – End User”, each user will be prompted to sign into Google for individually authenticated data access.

With the drop down set to “Single Sign On (OAuth) – Specific User”, each user will share the Google account as well as the Client ID and Client Secret.

  • Sign Into Google: Use this button to sign into Google to retrieve the Refresh Code

  • Refresh Code: Returned by Google and used by Pyramid to connect to the Google Account.

Project Selection

After the authentication has been configured, return to the connection tab and select the relevant BigQuery Project from the drop down. optionally, also select the Quota Project from the second drop down.