Re: add arraylist to dataframe

2017-08-29 Thread yohann jardin
Hello Asmath, Your list exist inside the driver, but you try to add element in it from the executors. They are in different processes, on different nodes, they do not communicate just like that. https://spark.apache.org/docs/latest/rdd-programming-guide.html#actions There exist an action

add arraylist to dataframe

2017-08-29 Thread KhajaAsmath Mohammed
Hi, I am initiating arraylist before iterating throuugh the map method. I am always getting the list size value as zero after map operation. How do I add values to list inside the map method of dataframe ? any suggestions? val points = new