Copy Between Databases

Provides a mechanism for copying data from a table on one database server to another database server.

Copy between databases

Information at a Glance

Parameter

 Description
Category Load Data
Data source type DB
Send output to other operators Yes
Data processing tool No

Input

A database table or a database operator that emits tabular output.

Bad or Missing Values
Missing values in the original database table are transferred as null values to the table in the target database.

Restrictions

If you are using Google BigQuery as a data source, and your data set is very large, the copy operation can time out unexpectedly. See your system administrator to increase the value of the timeout property if you encounter this problem.

Configuration

Parameter Description
Notes Notes or helpful information about this operator's parameter settings. When you enter content in the Notes field, a yellow asterisk appears on the operator.
Copy To The database to copy the data set to.
Destination The schema to copy the data set to.
Table Name The name for the new table.

Default value: alp@user_id_@flow_id_dbtodb_0.

If Table Exists The desired behavior if the table exists in the destination location.
  • Append - Append the data to the end of the table.
  • Drop (the default) - Drop the table and replace it with the new one.
  • Error - Produce an error.
  • Skip - Skip this table.
Result Table Structure The table structure for the resulting table to which to copy. When the dialog is opened, if the resulting table exists, the schema is read from the resulting table. If the resulting table does not exist, the schema is determined from the source table. Data types for the resulting table are inferred for the target database, but the data types can be edited.
Fetch Size The number of rows at a time to fetch from the source table. Depending on the features of the source database JDBC driver, changes to the fetch size can improve performance.

Default value: 20000.

Batch Size The number of rows to insert into the resulting table at one time.

Default value: 5000.

Note: Larger batches can improve speed, but they use more memory.

Output

Visual Output
A preview of the rows of the resulting copied data on the target database server.
Data Output
A data set that corresponds to the destination table.