The Snowflake Insert Activity

General

You can use this activity to run the insert SQL statements on the Snowflake data warehouse. You can insert multiple rows in the database in batches. Error in one batch does not stop the execution of the subsequent batch. The failure record of a batch depends on the behavior of the underlying Snowflake JDBC driver and Snowflake data warehouse engine. If a batch fails to insert one or more records, the detailed message is displayed in logs including the batch number, reason of failure, and rows that failed to insert. The insertion operation results in the formation of total rows attempted and total rows affected.

The General tab contains the following fields.

Field Module Property Description
Name No Specify the name to be displayed as the label for the activity in the process.
Snowflake Connection Resource Yes Click to select a Snowflake JDBC Connection shared resource. If no matching Snowflake JDBC Connection shared resource is found, click Create Shared Resource to create one. For more details, see Creating and Configuring the Snowflake JDBC Connection Resource.
Entity No Click to select an entity. The entities downloaded in Snowflake JDBC Connection shared resource's Schema tab is available for selection.
Batch Size Yes All incoming mesages are inserted performing SQL, number specified here defines how many SQL statements can be batched together that can be represented as a single SQL. The default value is 100.
Time Out Yes Defines activity timeout in seconds. Default value is 0, means activity timeout disabled.
Note: Insert activity works in multiple batches, so per batch timeout is evaluated using timeout value specified. Refrain from using smaller timeout value.

Description

On the Description tab, provide a short description for the activity.

SQL Builder

The SQL Builder tab displays the metadata of the entity selected in the General tab.

Field Editable Description
Field Name No Displays name of the column.
Data Type No Displays the data type of the column.
Primary Key No Displays if the column is a primary key.
Not Null No Displays if the column accepts null value.
Dimension No Displays the dimension of the column.
Values Yes Displays the fields that must be part of the Values clause for an insert SQL statement. By default, Values column is selected for all the fields.

Input

All the fields in the SQL Builder tab that have Values column selected are a part of the Input tab. The Input tab displays the input schema of the activity as a tree structure. The information in the schema depends on the fields selected on the SQL Builder tab.

Output

The Output tab displays the rowsAttempted and rowsAffected fields. The rowsAttempted field holds the count of number of rows that were attempted by Snowflake Insert activity and the rowsAffected field holds the count of number of rows inserted successfully after the Snowflake Insert activity is invoked. The difference between these two is the number of rows that failed to insert. The Output tab displays the output schema of the activity as a tree structure. The output is read-only.

Fault

The Fault tab lists exceptions that are thrown by this activity.