Custom Operators

Use the Custom Operator Framework to create an analytic packages in Scala and Java, and then run them in the Team Studio workflow environment.

Data scientists and programmers can use the framework to create a wide variety of custom operators to use within a Team Studio analytics workflow. They can develop the custom operators in Scala and Java using the framework and examples that are provided with the SDK. The framework supports both Spark and Database operators, but this section covers developing only for Spark-enabled operators.

After custom operators are deployed to a Team Studio instance, the user does not need to read, write, or understand any code to use them. Specifically, users can easily integrate with their own specific Spark jobs, or they can run their own custom code against their data within the Team Studio framework. The custom operators can consume one or more tabular data sets and can produce a tabular dataset as output to following operators.

An entire customer team can share pre-existing libraries of analytics and have those incorporated into the Team Studio visual workflows as simply another operator that can be quickly chosen and configured through the Team Studio drag and drop interface.

The Custom Operator SDK is available on Github.

Related concepts