[jira] [Commented] (SPARK-16998) select($"column1", explode($"column2")) is extremely slow

2017-11-18 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258340#comment-16258340 ] Ruslan Dautkhanov commented on SPARK-16998: --- Can somebody please help review PR

[jira] [Assigned] (SPARK-22554) Add a config to control if PySpark should use daemon or not

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22554: Assignee: (was: Apache Spark) > Add a config to control if PySpark should use daemon o

[jira] [Commented] (SPARK-22554) Add a config to control if PySpark should use daemon or not

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258335#comment-16258335 ] Apache Spark commented on SPARK-22554: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-22554) Add a config to control if PySpark should use daemon or not

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22554: Assignee: Apache Spark > Add a config to control if PySpark should use daemon or not > ---

[jira] [Created] (SPARK-22554) Add a config to control if PySpark should use daemon or not

2017-11-18 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-22554: Summary: Add a config to control if PySpark should use daemon or not Key: SPARK-22554 URL: https://issues.apache.org/jira/browse/SPARK-22554 Project: Spark

[jira] [Updated] (SPARK-22552) Cannot Union multiple kafka streams

2017-11-18 Thread sachin malhotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin malhotra updated SPARK-22552: Description: When unioning multiple kafka streams I learned that the resulting dataframe o

[jira] [Updated] (SPARK-22552) Cannot Union multiple kafka streams

2017-11-18 Thread sachin malhotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin malhotra updated SPARK-22552: Description: When unioning multiple kafka streams I learned that the resulting dataframe o

[jira] [Updated] (SPARK-22552) Cannot Union multiple kafka streams

2017-11-18 Thread sachin malhotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin malhotra updated SPARK-22552: Description: When unioning multiple kafka streams I learned that the resulting dataframe o

[jira] [Commented] (SPARK-19476) Running threads in Spark DataFrame foreachPartition() causes NullPointerException

2017-11-18 Thread Gal Topper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258313#comment-16258313 ] Gal Topper commented on SPARK-19476: The issue with doing this synchronously is that,

[jira] [Commented] (SPARK-22553) Drop FROM in nonReserved

2017-11-18 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258283#comment-16258283 ] Takeshi Yamamuro commented on SPARK-22553: -- cc: [~hvanhovell] [~smilegator] > D

[jira] [Created] (SPARK-22553) Drop FROM in nonReserved

2017-11-18 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-22553: Summary: Drop FROM in nonReserved Key: SPARK-22553 URL: https://issues.apache.org/jira/browse/SPARK-22553 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-22445) move CodegenContext.copyResult to CodegenSupport

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258268#comment-16258268 ] Apache Spark commented on SPARK-22445: -- User 'maropu' has created a pull request for

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.3.0 (was: 2.2.2) > ReorderJoinPredicates can break when child's partitioning

[jira] [Updated] (SPARK-22552) Cannot Union multiple kafka streams

2017-11-18 Thread sachin malhotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin malhotra updated SPARK-22552: Description: When unioning multiple kafka streams I learned that the resulting dataframe o

[jira] [Updated] (SPARK-22552) Cannot Union multiple kafka streams

2017-11-18 Thread sachin malhotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin malhotra updated SPARK-22552: Description: When unioning multiple kafka streams and I learned that the resulting datafram

[jira] [Created] (SPARK-22552) Cannot Union multiple kafka streams

2017-11-18 Thread sachin malhotra (JIRA)
sachin malhotra created SPARK-22552: --- Summary: Cannot Union multiple kafka streams Key: SPARK-22552 URL: https://issues.apache.org/jira/browse/SPARK-22552 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-22498) 64KB JVM bytecode limit problem with concat

2017-11-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22498. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull req

[jira] [Assigned] (SPARK-22498) 64KB JVM bytecode limit problem with concat

2017-11-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22498: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with concat > -

[jira] [Assigned] (SPARK-22551) Fix 64kb compile error for common expression types

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22551: Assignee: (was: Apache Spark) > Fix 64kb compile error for common expression types > -

[jira] [Commented] (SPARK-22551) Fix 64kb compile error for common expression types

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258106#comment-16258106 ] Apache Spark commented on SPARK-22551: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-22551) Fix 64kb compile error for common expression types

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22551: Assignee: Apache Spark > Fix 64kb compile error for common expression types >

[jira] [Updated] (SPARK-22551) Fix 64kb compile error for common expression types

2017-11-18 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-22551: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > Fix 64kb compile error for c

[jira] [Created] (SPARK-22551) Fix 64kb compile error for common expression types

2017-11-18 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-22551: --- Summary: Fix 64kb compile error for common expression types Key: SPARK-22551 URL: https://issues.apache.org/jira/browse/SPARK-22551 Project: Spark Issu

[jira] [Assigned] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17920: Assignee: (was: Apache Spark) > HiveWriterContainer passes null configuration to serde

[jira] [Commented] (SPARK-19580) Support for avro.schema.url while writing to hive table

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257985#comment-16257985 ] Apache Spark commented on SPARK-19580: -- User 'vinodkc' has created a pull request fo

[jira] [Assigned] (SPARK-19878) Add hive configuration when initialize hive serde in InsertIntoHiveTable.scala

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19878: Assignee: Apache Spark > Add hive configuration when initialize hive serde in InsertIntoHi

[jira] [Commented] (SPARK-19878) Add hive configuration when initialize hive serde in InsertIntoHiveTable.scala

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257986#comment-16257986 ] Apache Spark commented on SPARK-19878: -- User 'vinodkc' has created a pull request fo

[jira] [Assigned] (SPARK-19878) Add hive configuration when initialize hive serde in InsertIntoHiveTable.scala

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19878: Assignee: (was: Apache Spark) > Add hive configuration when initialize hive serde in I

[jira] [Assigned] (SPARK-19580) Support for avro.schema.url while writing to hive table

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19580: Assignee: Apache Spark > Support for avro.schema.url while writing to hive table > ---

[jira] [Assigned] (SPARK-19580) Support for avro.schema.url while writing to hive table

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19580: Assignee: (was: Apache Spark) > Support for avro.schema.url while writing to hive tabl

[jira] [Commented] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257984#comment-16257984 ] Apache Spark commented on SPARK-17920: -- User 'vinodkc' has created a pull request fo

[jira] [Assigned] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

2017-11-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17920: Assignee: Apache Spark > HiveWriterContainer passes null configuration to serde.initialize