Big Query Authenticate an Element Instance

You can authenticate with Google to create your own instance of the Big Query element through the UI or through APIs. Once authenticated, you can use the element instance to access the different functionalities offered by the Google Big Query platform.

Authenticate Through the UI

Use the UI to authenticate with Big Query and create an element instance. Because you authenticate with Big Query via OAuth 2.0, add a name for the instance and provide your OAuth API Key and API Secret along with your Project ID and Dataset ID. If you do not already have a Project ID and a Dataset ID, you can find more information on how to locate them in the API Provider Setup. After you create the instance, you'll log in to Google to authorize Cloud Elements access your account. For more information about authenticating an element instance, see Authenticate an Element Instance (UI). 

After successfully authenticating, we give you several options for next steps. Make requests using the API docs associated with the instance, map the instance to a virtual data resource, or use it in a formula template. 

Authenticate Through API

Authenticating through API is similar to authenticating via the UI. Instead of clicking and typing through a series of buttons, text boxes, and menus, you will instead send a request to our /instances endpoint. The end result is the same: an authenticated element instance with a token and id.

Authenticating through API follows a multi-step OAuth 2.0 process that involves:

• Getting a redirect URL. This URL sends users to the vendor to log in to their account.
• Authenticating users and receiving the authorization grant code. After the user logs in, the vendor makes a callback to the specified url with an authorization grant code.
• Authenticating the element instance. Using the authorization code from the vendor, authenticate with the vendor to create an element instance at Cloud Elements.

Getting a Redirect URL

Use the following API call to request a redirect URL where the user can authenticate with the API provider. Replace {keyOrId} with the element key,bigquery.

curl -X GET /elements/{keyOrId}/oauth/url?apiKey=<api_key>&apiSecret=<api_secret>&callbackUrl=<url>

Query Parameters

Example cURL

curl -X GET \
  'https://api.cloud-elements.com/elements/api-v2/elements/bigquery/oauth/url?apiKey=fake_api_key&apiSecret=fake_api_secret&callbackUrl=https://www.mycoolapp.com/auth&state=bigquery' \

Example Response

Use the oauthUrl in the response to allow users to authenticate with the vendor.

{
  "oauthUrl": "https://accounts.google.com/o/oauth2/auth?prompt=consent&access_type=offline&scope=https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fbigquery&response_type=code&redirect_uri=https%3A%2F%2Fauth.cloudelements.io%2Foauth&state=bigquery&client_id=fake_id",
  "element": "bigquery"
}

Authenticating Users and Receiving the Authorization Grant Code

Provide the response from the previous step to the users. After they authenticate, Big Query provides the following information in the response:

• code
• state

Authenticating the Element Instance

Use the /instances endpoint to authenticate with Big Query and create an element instance.

To authenticate an element instance:

1. Construct a JSON body as shown below (see Parameters):

   {
     "element": {
       "key": "bigquery"
     },
     "configuration": {
       "oauth.api.secret": "<API_SECRET>",
       "oauth.callback.url": "<CALLBACK_URL>",
       "secret": null,
       "oauth.api.key": "<API_KEY>",
       "filter.response.nulls": "true",
       "project.id": "<Project_id>",
       "dataset.id": "<Dataset_id>",
       "oauth.user.refresh_time": null,
       "oauth.user.refresh_token": null
     },
     "name": "<INSTANCE_NAME>",
     "eventsEnabled": null,
     "providerData": {
       "state": "bigquery",
       "code": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
       "scope": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
       "debug": false,
       "secret": "xxxxxxxxxxxxxxxx"
     }
   }

2. Call the following, including the JSON body you constructed in the previous step:

   POST /instances
   

   Note: Make sure that you include the User and Organization keys in the header. For more information, see Authorization Headers, Organization Secret, and User Secret.

3. Locate the token and id in the response and save them for all future requests using the element instance.

Example cURL

curl -X POST https://api.cloud-elements.com/elements/api-v2/instances \
 -H "Authorization: User <USER_SECRET>, Organization <ORGANIZATION_SECRET>"  \
 -H "Content-Type: application/json"  \
-d 
'{
  "name": "<INSTANCE_NAME>",
  "tags": [
    "xxxxxxxxx"
  ],
  "providerData": {
    "code": "<INSERT>"
  },
  "configuration": {
    "oauth.api.secret": "<API_SECRET>",
    "oauth.callback.url": "<CALLBACK_URL>",
    "secret": null,
    "oauth.api.key": "<API_KEY>",
    "filter.response.nulls": "true",
    "project.id": "<Project_id>",
    "dataset.id": "<Dataset_id>",
    "oauth.user.refresh_time": null,
    "oauth.user.refresh_token": null
  }
}'

Parameters

API parameters not shown in Cloud Elements are in code formatting.

Example Response for an Authenticated Element Instance

In this example, the instance ID is 12345 and the instance token starts with "ABC/D...". The actual values returned to you will be unique: make sure you save them for future requests to this new instance.

{
  "id": 12345,
  "name": "Bigquery",
  "createdDate": "2020-03-23T12:50:12Z",
  "token": "xxxxxxxxxxx",
  "elementId": 35153,
  "tags": [
    "Bigquery"
  ],
  "valid": true,
  "disabled": false,
  "maxCacheSize": 0,
  "cacheTimeToLive": 0,
  "providerData": {
    "state": "xxxxx",
    "code": "xxxxxxx",
    "scope": "xxxxxxx",
    "debug": false,
    "secret": "xxxxxxxx"
  },
  "configuration": {
    "base.url": "<Base_url>",
    "project.id": "<Project_id>",
    "event.notification.basic.username": null,
    "filter.response.nulls": "true",
    "pagination.type": "cursor",
    "db.table.names": null,
    "oauth.callback.url": "<Callback_Url>",
    "event.notification.signature.key": null,
    "oauth.user.refresh_token": "xxxxxxxxxxx",
    "oauth.user.refresh_interval": "xxxxxx",
    "oauth.token.revoke_url": null,
    "oauth.api.key": "<Oauth_API_Key>",
    "oauth.api.secret": "********",
    "default.select.fields.map": null,
    "oauth.token.url": "xxxxxxxx",
    "pagination.max": "100",
    "event.notification.basic.password": "********",
    "oauth.scope": "xxxxxxx",
    "oauth.token.refresh_url": "xxxxxxxxx",
    "oauth.user.token": "xxxxxxx",
    "oauth.authorization.url": "xxxxxxx",
    "dataset.id": "<Dataset_Id>",
    "authentication.time": "xxxx",
    "oauth.user.refresh_time": "xxxxx",
    "oauth.basic.header": "true",
    "db.schema": "{...}",
  "authenticationType": "oauth2",
  "eventsEnabled": false,
  "organizationId": xxxx,
  "cachingEnabled": false,
  "traceLoggingEnabled": false,
  "accountId": xxxxx,
  "externalAuthentication": "none",
  "userId": xxxxx,
  "element": {..},
  "user": {
    "id": xxxxx,
    "emailAddress": "xxxxxxxx",
    "firstName": "xxxxx",
    "lastName": "xxxxxx"
  }
}