Date and Time functions
Year, Quarter, Month, WeekOfYear, Week, DayOfMonth, Day, Hour, Minute, Second, DateDiff, Date_Add, Date_sub, To_date, From_utc_timestamp, To_utc_timestamp,
Conversion functions
SN
Math functions
Abs, ACos, ASin, Bin, Hex, Conv, Ceil, Ceiling, Cos, Degrees, E, Exp, Floor, Ln, Log, Log10, Log2, Negative, Pi, Radians, Sign, Sin, Sqrt, Tan, Atan, Pow, Power, Pmod, Positive, Rand, Round,
Operators
%, +, -, *, /
Statistical functions
Sum, Avg, Min, Max, Count, UniqueCount, Variance, Var_Pop, Var_Samp, StdDev_Pop, StdDev_Samp, Covar_pop, Covar_samp, Corr, Percentile
Text functions
ASCII, Concat, Concat_ws, Find_in_set, Get_json_object, Instr, Length, Locate, Lower, Lcase, LPad, Parse_url, RPad, Rtrim, Trim, LTrim, Regexp_extract, Regexp_replace, Repeat, Space, Reverse, Translate, Upper, Ucase
Other supported functionality
Temporary view / Temporary tables
Global temporary views
Note: Binning is not supported by this connector.
Apache Spark SQL temporary views and tables in custom queries
If you are creating a custom query and you want to use data from an Apache Spark SQL temporary table or view, you must refer to those objects using their qualified names, specifying both the name and the location of the object. The qualified names required have the following format:
databaseName.tempViewName
By default, global temporary views are stored in the global_temp database. The database name can vary, and you can see it in the hierarchy of available database tables in Spotfire. To select all columns from a global temporary view named myGlobalTempView, that is stored in the global_temp database:
SELECT * FROM global_temp.myGlobalTempView
Temporary views/tables (listed in Spotfire under ‘Temporary views’ or ‘Temporary tables’) are always located in the #temp database. To select all columns in a temporary view named myTempView:
SELECT * FROM #temp.myTempView