Does feature parity exist between Spark and PySpark

2015-10-06 Thread dant
Hi I'm hearing a common theme running that I should only do serious programming in Scala on Spark (1.5.1). Real power users use Scala. It is said that Python is great for analytics but in the end the code should be written to Scala to finalise. There are a number of reasons I'm hearing: 1. Spark

Does feature parity exist between Scala and Python on Spark

2015-10-06 Thread dant
Hi, I'm hearing a common theme running that I should only do serious programming in Scala on Spark (1.5.1). Real power users use Scala. It is said that Python is great for analytics but in the end the code should be written to Scala to finalise. There are a number of reasons I'm hearing: 1. Spark