[jira] [Resolved] (SPARK-21650) Insert into hive partitioned table from spark-sql taking hours to complete

2017-08-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21650. --- Resolution: Invalid This isn't a place to ask questions about troubleshooting your app and there's n

[jira] [Created] (SPARK-21650) Insert into hive partitioned table from spark-sql taking hours to complete

2017-08-06 Thread Madhavi Vaddepalli (JIRA)
Madhavi Vaddepalli created SPARK-21650: -- Summary: Insert into hive partitioned table from spark-sql taking hours to complete Key: SPARK-21650 URL: https://issues.apache.org/jira/browse/SPARK-21650

[jira] [Commented] (SPARK-21649) Support writing data into hive bucket table.

2017-08-06 Thread jin xing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16116132#comment-16116132 ] jin xing commented on SPARK-21649: -- made a pr: https://github.com/apache/spark/pull/1886

[jira] [Comment Edited] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-06 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16116126#comment-16116126 ] Jen-Ming Chung edited comment on SPARK-21610 at 8/7/17 6:33 AM: ---

[jira] [Comment Edited] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-06 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16116126#comment-16116126 ] Jen-Ming Chung edited comment on SPARK-21610 at 8/7/17 6:33 AM: ---

[jira] [Commented] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-06 Thread Jen-Ming Chung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16116126#comment-16116126 ] Jen-Ming Chung commented on SPARK-21610: User 'jmchung' has created a pull reques

[jira] [Created] (SPARK-21649) Support writing data into hive bucket table.

2017-08-06 Thread jin xing (JIRA)
jin xing created SPARK-21649: Summary: Support writing data into hive bucket table. Key: SPARK-21649 URL: https://issues.apache.org/jira/browse/SPARK-21649 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-21648) Confusing assert failure in JDBC source when users misspell the option `partitionColumn`

2017-08-06 Thread Xiao Li (JIRA)
Xiao Li created SPARK-21648: --- Summary: Confusing assert failure in JDBC source when users misspell the option `partitionColumn` Key: SPARK-21648 URL: https://issues.apache.org/jira/browse/SPARK-21648 Projec

[jira] [Updated] (SPARK-21624) Optimize communication cost of RF/GBT/DT

2017-08-06 Thread Peng Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Meng updated SPARK-21624: -- Description: {quote}The implementation of RF is bound by either the cost of statistics computation on

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-06 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115998#comment-16115998 ] Burak Yavuz commented on SPARK-21590: - [~KevinZwx] there's nothing wrong. It works as

[jira] [Commented] (SPARK-21647) SortMergeJoin failed when using CROSS

2017-08-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115987#comment-16115987 ] Xiao Li commented on SPARK-21647: - https://github.com/apache/spark/pull/18863 > SortMerg

[jira] [Created] (SPARK-21647) SortMergeJoin failed when using CROSS

2017-08-06 Thread Xiao Li (JIRA)
Xiao Li created SPARK-21647: --- Summary: SortMergeJoin failed when using CROSS Key: SPARK-21647 URL: https://issues.apache.org/jira/browse/SPARK-21647 Project: Spark Issue Type: Bug Compone

[jira] [Resolved] (SPARK-21622) Support Offset in SparkR

2017-08-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21622. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0 Target

[jira] [Commented] (SPARK-21622) Support Offset in SparkR

2017-08-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115951#comment-16115951 ] Felix Cheung commented on SPARK-21622: -- https://github.com/apache/spark/pull/18831

[jira] [Commented] (SPARK-21629) OR nullability is incorrect

2017-08-06 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115702#comment-16115702 ] Liang-Chi Hsieh commented on SPARK-21629: - No problem. Mentees still learn someth

[jira] [Closed] (SPARK-21629) OR nullability is incorrect

2017-08-06 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-21629. - Resolution: Not A Problem Assignee: (was: Liang-Chi Hsieh) This is not a bug, b

[jira] [Commented] (SPARK-20025) Driver fail over will not work, if SPARK_LOCAL* env is set.

2017-08-06 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115696#comment-16115696 ] Liang-Chi Hsieh commented on SPARK-20025: - I think there is an unsolved issue SPA