[jira] [Commented] (SPARK-26819) ArrayIndexOutOfBoundsException while loading a CSV to a Dataset with dependencies spark-core_2.12 and spark-sql_2.12 (with spark-core_2.11 and spark-sql_2.11 : working

2019-02-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759617#comment-16759617 ] Hyukjin Kwon commented on SPARK-26819: -- It works fine in Spark. Can you clarify what {quote} if

[jira] [Assigned] (SPARK-26603) Update minikube backend in K8s integration tests

2019-02-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-26603: Assignee: Stavros Kontopoulos > Update minikube backend in K8s integration tests >

[jira] [Resolved] (SPARK-26603) Update minikube backend in K8s integration tests

2019-02-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26603. -- Resolution: Fixed Fix Version/s: 3.0.0 > Update minikube backend in K8s integration

[jira] [Resolved] (SPARK-26810) Fixing SPARK-25072 broke existing code and fails to show error message

2019-02-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26810. -- Resolution: Duplicate SPARK-23299 (I think > Fixing SPARK-25072 broke existing code and

[jira] [Commented] (SPARK-26810) Fixing SPARK-25072 broke existing code and fails to show error message

2019-02-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759571#comment-16759571 ] Hyukjin Kwon commented on SPARK-26810: -- I'm leaving this as a duplicate of SPARK-23299. Thanks for

[jira] [Issue Comment Deleted] (SPARK-26810) Fixing SPARK-25072 broke existing code and fails to show error message

2019-02-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26810: - Comment: was deleted (was: SPARK-23299 (I think) > Fixing SPARK-25072 broke existing code and

[jira] [Commented] (SPARK-26810) Fixing SPARK-25072 broke existing code and fails to show error message

2019-02-03 Thread Arttu Voutilainen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759549#comment-16759549 ] Arttu Voutilainen commented on SPARK-26810: --- Yup, no worries. Now that you understood the

[jira] [Assigned] (SPARK-26572) Join on distinct column with monotonically_increasing_id produces wrong output

2019-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26572: Assignee: Apache Spark > Join on distinct column with monotonically_increasing_id

[jira] [Assigned] (SPARK-26572) Join on distinct column with monotonically_increasing_id produces wrong output

2019-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26572: Assignee: (was: Apache Spark) > Join on distinct column with

[jira] [Commented] (SPARK-26810) Fixing SPARK-25072 broke existing code and fails to show error message

2019-02-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759468#comment-16759468 ] Hyukjin Kwon commented on SPARK-26810: -- Ah, gotya. Yea, it looks the cuase indeed. Sorry thst i

[jira] [Created] (SPARK-26822) Upgrade the deprecated module 'optparse'

2019-02-03 Thread Neil Chien (JIRA)
Neil Chien created SPARK-26822: -- Summary: Upgrade the deprecated module 'optparse' Key: SPARK-26822 URL: https://issues.apache.org/jira/browse/SPARK-26822 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-26822) Upgrade the deprecated module 'optparse'

2019-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26822: Assignee: Apache Spark > Upgrade the deprecated module 'optparse' >

[jira] [Assigned] (SPARK-26822) Upgrade the deprecated module 'optparse'

2019-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26822: Assignee: (was: Apache Spark) > Upgrade the deprecated module 'optparse' >

[jira] [Commented] (SPARK-26822) Upgrade the deprecated module 'optparse'

2019-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759441#comment-16759441 ] Apache Spark commented on SPARK-26822: -- User 'cchung100m' has created a pull request for this

[jira] [Updated] (SPARK-26751) HiveSessionImpl might have memory leak since Operation do not close properly

2019-02-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26751: -- Priority: Minor (was: Major) > HiveSessionImpl might have memory leak since Operation do not close

[jira] [Assigned] (SPARK-26751) HiveSessionImpl might have memory leak since Operation do not close properly

2019-02-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26751: - Assignee: zhoukang > HiveSessionImpl might have memory leak since Operation do not close

[jira] [Resolved] (SPARK-26751) HiveSessionImpl might have memory leak since Operation do not close properly

2019-02-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26751. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

[jira] [Commented] (SPARK-26810) Fixing SPARK-25072 broke existing code and fails to show error message

2019-02-03 Thread Arttu Voutilainen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759423#comment-16759423 ] Arttu Voutilainen commented on SPARK-26810: --- [~hyukjin.kwon] thanks for checking this! You

[jira] [Resolved] (SPARK-26818) Make MLEvents JSON ser/de safe

2019-02-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26818. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23728

[jira] [Commented] (SPARK-26821) filters not working with char datatype when querying against hive table

2019-02-03 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759381#comment-16759381 ] Sujith commented on SPARK-26821: As per the initial analysis, this phenomenon is happening because the

[jira] [Commented] (SPARK-26821) filters not working with char datatype when querying against hive table

2019-02-03 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759382#comment-16759382 ] Sujith commented on SPARK-26821: cc [~dongjoon] > filters not working with char datatype when querying

[jira] [Comment Edited] (SPARK-26821) filters not working with char datatype when querying against hive table

2019-02-03 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759382#comment-16759382 ] Sujith edited comment on SPARK-26821 at 2/3/19 11:44 AM: - cc [~dongjoon]

[jira] [Updated] (SPARK-26821) filters not working with char datatype when querying against hive table

2019-02-03 Thread Sujith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-26821: --- Description: creates a table with a char type field, While inserting data to char data type column, if the

[jira] [Created] (SPARK-26821) filters not working with char datatype when querying against hive table

2019-02-03 Thread Sujith (JIRA)
Sujith created SPARK-26821: -- Summary: filters not working with char datatype when querying against hive table Key: SPARK-26821 URL: https://issues.apache.org/jira/browse/SPARK-26821 Project: Spark

[jira] [Created] (SPARK-26820) Issue Error/Warning when Hint is not applicable

2019-02-03 Thread Xiao Li (JIRA)
Xiao Li created SPARK-26820: --- Summary: Issue Error/Warning when Hint is not applicable Key: SPARK-26820 URL: https://issues.apache.org/jira/browse/SPARK-26820 Project: Spark Issue Type: