Can we deploy python script on a spark cluster

We are trying to deploy python script on spark cluster . However as per documentations , it is not possible to deploy python applications on a cluster . Is there any alternative -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

How to read csv in dataframe

I am trying to read csv in spark dataframe . My Os = Ubuntu 18.04, spark-version 2.3.1, python -version 2.7.15 My code : from pyspark import SparkConf from pyspark import SparkContext from pyspark import SQLContext from pyspark.sql import SparkSession conf = SparkConf() sc = SparkContext(conf =