I am a newbie to spark, and I program in Python. I use textFile function to make an RDD from a file. I notice that the default limiter is newline. However I want to change this default limiter to something else. After searching the web, I came to know about textinputformat.record.delimiter property, but doesn't seem to have any effect, when I use it with SparkConf. So my question is, how do I change the default limiter in python?
