Java Spark to Python spark integration

I would like to know if its possible to invoke python spark code from java. I have a java based framework where a sparksession is created and a some dataframes are passed as argument to an api . Transformation.java interface Transformation { Dataset transform(Set inputDatasets ,

Pivot Column ordering in spark

I am doing a pivot transformation on an input dataset Following input schema = |-- c_salutation: string (nullable = true) |-- c_preferred_cust_flag: string (nullable = true) |-- integer_type_col: integer (nullable = false) |-- long_type_col: long