[ https://issues.apache.org/jira/browse/SPARK-2603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Armbrust updated SPARK-2603: ------------------------------------ Fix Version/s: 1.0.2 1.1.0 > Remove unnecessary toMap and toList in converting Java collections to Scala > collections JsonRDD.scala > ----------------------------------------------------------------------------------------------------- > > Key: SPARK-2603 > URL: https://issues.apache.org/jira/browse/SPARK-2603 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Yin Huai > Assignee: Yin Huai > Priority: Minor > Fix For: 1.1.0, 1.0.2 > > > In JsonRDD.scalafy, we are using toMap/toList to convert a Java Map/List to a > Scala one. These two operations are pretty expensive because they read > elements from a Java Map/List and then load to a Scala Map/List. We can use > Scala wrappers to wrap those Java collections instead of using toMap/toList. -- This message was sent by Atlassian JIRA (v6.2#6252)