Skip to main content

Google BigQuery

With the BigQuery Action Flow module, you can monitor tables and completed query jobs, and manage the datasets and tables in your BigQuery account.

Before you begin

To use the BigQuery Action Flow module, you must have a Google account and a project created. You can create an account at Google Cloud Platform.

Connecting your Action Flow with BigQuery

To get started, you must first create a connection between BigQuery and the Action Flow, allowing the two services to communicate:

  1. In Studio, go to your package and click New asset > Action Flow.

  2. Click Add module and from the list select  BigQuery.

  3. Add a connection to the module:

    1. In your module settings, click Create a connection.

    2. Enter a name for your new connection.

    3. Optional: Switch on the Show advanced settings toggle and enter your Google Cloud Platform project client credentials. For more information, see the below.

    4. Click Sign in with Google.

    5. If prompted, authenticate your account and confirm access.

You've successfully created the connection and can now use the BigQuery module in your Action Flows.

Create and Configure a Google Cloud Platform Project for BigQuery

To connect to Action Flows using your own client credentials, you can create and configure a project in the Google Cloud Platform.

Create a Google Cloud Platform project for BigQuery

Note

To create a new project or work in the existing one, you need to have the serviceusage.services.enable permission. If you don’t have this permission, ask the Google Cloud Platform Project Owner or Project IAM Admin to grant it to you.

  1. Log in to the Goole Cloud Platform using your Google credentials.

  2. On the welcome page, click Create or select a project >New project.

  3. Enter a Project name and select the Location for your project.

  4. Click Create.

  5. In the top menu, check if your new project is selected in the Select a project dropdown. If not, select the project you just created.

Enable APIs for BigQuery

To configure your OAuth consent screen:

  1. In the left sidebar, click Google Auth Platform.

  2. Click Get Started.

  3. In the Overview section, under App information, enter Make as the app name and provide your Gmail address. Click Next.

  4. Under Audience, select External.

    For more information regarding user types, see Google's Exceptions to verification requirements documentation.

  5. Under Contact Information, enter your Gmail address.

  6. Under Finish, agree to the Google User Data Policy.

  7. Click Continue > Create.

  8. In the Branding section, under Authorized domains, add celonis.com and click Save.

  9. (optional) In the Audience section, add your Gmail address on the Test users page, then click Save and continue if you want the project to remain in the Testing publishing status.

  10. In the Data Access section, click Add or remove scopes, add the following scopes, and click Update:

    • https://www.googleapis.com/auth/userinfo.email

    • https://www.googleapis.com/auth/bigquery

    • https://www.googleapis.com/auth/bigquery.readonly

    • https://www.googleapis.com/auth/drive.readonly

  11. Click Save.

Testing: If you keep your project in the Testing status, you will be required to reauthorize your connection Make every week. To avoid weekly reauthorization, update the project status to In production.

In production: If you update your project to the In production status, you will not be required to reauthorize the connection weekly. To update your project's status, go to the Google Auth Platform, the Audience section, and click Publish app. If you see the notice Needs verification, you can choose whether to go through the  for the app or to connect to your unverified app. Currently connecting to unverified apps works in Make, but we cannot guarantee the Google will allow connections to unverified apps for an indefinite period.

For more information regarding the publishing status, refer to the Publishing status section of Google's Setting up your OAuth consent screen help.

Create your BigQuery client credentials

  1. In Google Auth Platform, click Clients.

  2. Click + Create Client.

  3. In the Application type dropdown, select Web application.

  4. Update the Name of your OAuth client. This will help you identify it in the platform.

  5. In the Authorized redirect URIs section, click + Add URI and enter the following redirect URI:

    https://auth.redirect.celonis.cloud/oauth/cb/google/

  6. Click Create.

  7. Click the OAuth 2.0 Client you created, copy your Client ID and Client secret values, and store them in a safe place.

    You'll use these values in the Client ID and Client Secret connection fields in Action Flow modules.

BigQuery modules

After connecting to the app, you can use the following types of modules to build your scenarios.

Dataset

  • List Datasets

  • Get a Dataset

  • Create a Dataset

  • Update a Dataset

  • Delete a Dataset

Table

  • Watch Tables

  • List Tables

  • Get a Table

  • Create a Table

  • Update a Table

  • Delete a Table

Table Data

  • Watch Rows

  • List Table Data

  • Upload Data (Streaming)

  • Update a File

Query Job

  • Watch Query Jobs Completed

  • List Jobs

  • Get Query Results by Job ID

  • Run a Query

Other

  • Make an API Call

Related topics