Unsubscribe
unsubscribe
Many thanks all, especially to Mich. That is what I was looking for.
On Friday, 15 October 2021, 09:28:24 BST, Mich Talebzadeh
wrote:
Spark allows one to define the column format as StructType or list. By default
Spark assumes that all fields are nullable when creating a dataframe.
To
Spark allows one to define the column format as StructType or list. By
default Spark assumes that all fields are nullable when creating a
dataframe.
To change nullability you need to provide the structure of the columns.
Assume that I have created an RDD in the form
rdd = sc.parallelize(Range).
