SubmitJob

You can use the SubmitJob activity to submit and start an Oozie workflow, bundle, coordinator jobs or a proxy job (MapReduce, Pig, Hive, Sqoop). The workflow parameters can be provided through job properties input. The activity returns Job ID after successful job submission.

General

On the General tab, you can specify the activity name in the process, establish a connection with Oozie, and select the specific Oozie operation that you want to perform.

The following table lists the configurations on the General tab of the SubmitJob activity:

Field Module Property? Description
Name No The name to be displayed as the label for the activity in the process.
Oozie Connection Yes The Oozie Connection shared resource that is used to create a connection between the plug-in and the Oozie server. Click to select an Oozie Connection shared resource.

If no matching Oozie Connection shared resources are found, click Create Shared Resource. For more information about creating a shared resource, see Creating an Oozie Shared Resource Connection.

Job Type No The Oozie operation that you want to perform. Select an Oozie operation from the following list:
  • workflow: Sequence of actions arranged in a control dependency Direct Acyclic Graph (DAG).
  • coordinator: Schedule workflow jobs to run at regular time intervals or depending on data availability.
  • bundle: Define and run a set of coordinator applications.
  • mapreduce: Proxy mapReduce job.
  • pig: Proxy Pig job.
  • hive: Proxy Hive job.
  • sqoop: Proxy Sqoop job.
Note: You can use the Oozie proxy submission to submit a workflow that contains a single MapReduce, Hive, Pig, or Sqoop action without writing a workflow.xml.
Job Properties No Name-value parameter for the Oozie job.
Note: Every job type needs job properties that are mandatory. For more information about the required job properties based on the job type, see the Oozie documentation.
Timeout (Sec) Yes The amount of time, in seconds, to wait for this activity to complete.

By default, this activity times out in 180 seconds.

Description

On the Description tab, you can enter a short description for the SubmitJob activity.

Input

On the Input tab, you can configure the Oozie operation that you select on the General tab.

The following table lists all the possible input elements on the Input tab of the SubmitJob activity:

Input Item Data Type Description
jobType String The Oozie operation configuration.
jobProperties String Enter the name-value parameters.
timeout Int The amount of time, in milliseconds, to wait for this activity to complete.

By default, this activity times out in 180 seconds.

Output

On the Output tab, you can view whether the process ran successfully.

The following table lists the output element on the Output tab of the SubmitJob activity:

Output Item Data Type Description
jobId String Job ID of the submitted Oozie job.
Note: The job ID can be mapped as an input to the GetJobInfo activity to retrieve job status and other details about the job.

Fault

On the Fault tab, you can view the error code and error message of the SubmitJob activity. For more information about errors, see Error Codes.

The following table lists the error schema elements on the Fault tab of the SubmitJob activity:

Error Schema Element Data Type Description
msg String The error message description that is returned by the plug-in.
msgCode String The error code that is returned by the plug-in.