The BigQueryDataUpdater Activity

The following operations are supported by the Updater activity of Google BigQuery: Insert and Update.

General

The General tab contains the following fields.

Field Module Property? Description
Name No The name to be displayed as the label for the activity in the process. The default name displayed is BigQueryDataUpdater.
Configuration Resource Yes Shared configuration resource containing the information about the Google BigQuery connection.
Schema No The Updater schema which is configured with the schema table by the Updater schema.

Description

On the Description tab, provide a short description for the activity.

Advanced

On the Advanced tab, provide the Batch Size.This property specifies the number of records to be batched before invoking an insert operation. The default value is 1. You can set this property if you want to enable batch insert. This field value must be a positive integer. This field is not applicable if you are performing the Update operation. You can chose from the following values:
  • Literal Value: This field accepts non-zero positive integer. A negative, or zero value results in a fault.
  • Process Property
  • Module Property

Input

Input mapping structure is based on the Schema selected in the General tab. All the columns and the datatypes are displayed. Additionally a field Opcode is displayed which performs Insert for value '1' and Update for value '2'. For more information, see Supported Datatypes.
Note: If you insert multiple records for the BigQueryDataUpdater Activity and the first record has a valid Opcode (1) and the following records have an invalid Opcode then all the records are inserted in the table. If the first record has an invalid Opcode and the following records have a valid Opcode then none of the records are inserted in the table. The same criteria is applicable for the Update operation as well.
Note: If an opcode is not provided, the default activity performed is Insert.

The Input tab displays the input schema of the activity as a tree structure. You must enter information as required for any mandatory fields.

Note: The timezones supported by Google BigQuery are 'UTC' or 'Z'.

Output

The Output tab shows the response of the invoked service. The Output tab displays the output schema of the activity as a tree structure. The output is read-only. Output tree structure remains the same even if schema in the General tab for activity is changed.
Field Description
BQ_STATUS SUCCESS if the SQL statement is executed successfully. FAILURE if an error occurs.
ROWS_ATTEMPTED It displays the number of rows attempted for the Insert operation.
ROWS_AFFECTED It displays the number of rows affected by the Insert/Update operation.
BQ_ERROR_TEXT Displays the error in case of any failures.

Fault

The Fault tab lists exceptions that are thrown by this activity. The following table describes the types of exceptions thrown by the BigQueryDataUpdater activity:
Error Schema Element Datatype Description
BQException String It has a msg and msgCode field for the exception.
BQValidationException String It has a msg and msgCode field for the exception.
msg String The error message returned by the plug-in.
msgCode String The error code returned by the plug-in.