Hi all,In the python object to java conversion done in the method _py2java in spark/python/pyspark/mllib/common.py, why we are doing individual conversion using MpaConverter,ListConverter? The same can be acheived using
bytearray(PickleSerializer().dumps(obj)) obj = sc._jvm.SerDe.loads(bytes)Is there any performance gain or something in using individual converters rather than PickleSerializer?
-- Regards, *Meethu*