RE: Query on Profiling Spark Code

2018-07-31 Thread Patil, Prashasth
Hi Aakash, On a related note, you may want to try SparkLens for profiling which is quite helpful in my opinion. -Prash From: Aakash Basu [mailto:aakash.spark@gmail.com] Sent: Tuesday, July 17, 2018 12:41 PM To: user Subject: Query on Profiling Spark Code Hi guys, I'm trying to profile my

RE: Split a row into multiple rows Java

2018-07-31 Thread Patil, Prashasth
Hi, Have you tried using spark dataframe's Pivot feature ? -Original Message- From: nookala [mailto:srinook...@gmail.com] Sent: Thursday, July 26, 2018 7:33 AM To: user@spark.apache.org Subject: Split a row into multiple rows Java I'm trying to generate multiple rows from a single row