The answer always is "it depends". At the outset it seems you are in pretty good shape and have all the key skills you need. All I can suggest is try to take inherent benefits of the language and hone your coding practices
On Thu, 15 Apr 2021 at 2:25 am, ashok34...@yahoo.com.INVALID <ashok34...@yahoo.com.invalid> wrote: > Hi gurus, > > I have knowledge of Java, Scala and good enough knowledge of Spark, Spark > SQL and Spark Functional programing with Scala. > > I have started using Python with Spark PySpark. > > Wondering, in order to be proficient in PySpark, how much good knowledge > of Python programing is needed? I know the answer may be very good > knowledge, but in practice how much is good enough. I can write Python in > IDE like PyCharm similar to the way Scala works and can run the programs. > Does expert knowledge of Python is prerequisite for PySpark? I also know > Pandas and am also familiar with plotting routines like matplotlib. > > Warmest > > Ashok > -- Best Regards, Ayan Guha