[jira] [Updated] (SPARK-26819) ArrayIndexOutOfBoundsException while loading a CSV to a Dataset with dependencies spark-core_2.12 and spark-sql_2.12 (with spark-core_2.11 and spark-sql_2.11 : working f

2019-02-02 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Le Bihan updated SPARK-26819: Attachment: comptes-communes-Entr'Allier.csv > ArrayIndexOutOfBoundsException while loading a CSV

[jira] [Comment Edited] (SPARK-26819) ArrayIndexOutOfBoundsException while loading a CSV to a Dataset with dependencies spark-core_2.12 and spark-sql_2.12 (with spark-core_2.11 and spark-sql_2.11 : wo

2019-02-02 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759280#comment-16759280 ] M. Le Bihan edited comment on SPARK-26819 at 2/3/19 3:57 AM: - About the

[jira] [Commented] (SPARK-26819) ArrayIndexOutOfBoundsException while loading a CSV to a Dataset with dependencies spark-core_2.12 and spark-sql_2.12 (with spark-core_2.11 and spark-sql_2.11 : working

2019-02-02 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759280#comment-16759280 ] M. Le Bihan commented on SPARK-26819: - About the attachment provided : remove the _extends

[jira] [Updated] (SPARK-26819) ArrayIndexOutOfBoundsException while loading a CSV to a Dataset with dependencies spark-core_2.12 and spark-sql_2.12 (with spark-core_2.11 and spark-sql_2.11 : working f

2019-02-02 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Le Bihan updated SPARK-26819: Attachment: CompteResultatCSV.java > ArrayIndexOutOfBoundsException while loading a CSV to a

[jira] [Created] (SPARK-26819) ArrayIndexOutOfBoundsException while loading a CSV to a Dataset with dependencies spark-core_2.12 and spark-sql_2.12 (with spark-core_2.11 and spark-sql_2.11 : working f

2019-02-02 Thread M. Le Bihan (JIRA)
M. Le Bihan created SPARK-26819: --- Summary: ArrayIndexOutOfBoundsException while loading a CSV to a Dataset with dependencies spark-core_2.12 and spark-sql_2.12 (with spark-core_2.11 and spark-sql_2.11 : working fine) Key:

[jira] [Updated] (SPARK-26819) ArrayIndexOutOfBoundsException while loading a CSV to a Dataset with dependencies spark-core_2.12 and spark-sql_2.12 (with spark-core_2.11 and spark-sql_2.11 : working f

2019-02-02 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Le Bihan updated SPARK-26819: Attachment: ComptesResultatsIT.java > ArrayIndexOutOfBoundsException while loading a CSV to a

[jira] [Updated] (SPARK-26712) Single disk broken causing YarnShuffleSerivce not available

2019-02-02 Thread liupengcheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-26712: - Summary: Single disk broken causing YarnShuffleSerivce not available (was: Disk broken causing

[jira] [Assigned] (SPARK-26805) Eliminate double checking of stringToDate and stringToTimestamp inputs

2019-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26805: - Assignee: Maxim Gekk > Eliminate double checking of stringToDate and stringToTimestamp inputs

[jira] [Resolved] (SPARK-26805) Eliminate double checking of stringToDate and stringToTimestamp inputs

2019-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26805. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23717

[jira] [Commented] (SPARK-25128) multiple simultaneous job submissions against k8s backend cause driver pods to hang

2019-02-02 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759173#comment-16759173 ] Olivier Girardot commented on SPARK-25128: -- I think I observed this too on GKE recently - I'll

[jira] [Resolved] (SPARK-26677) Incorrect results of not(eqNullSafe) when data read from Parquet file

2019-02-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26677. --- Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 3.0.0

[jira] [Assigned] (SPARK-26818) Make MLEvents JSON ser/de safe

2019-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26818: Assignee: Apache Spark (was: Hyukjin Kwon) > Make MLEvents JSON ser/de safe >

[jira] [Assigned] (SPARK-26818) Make MLEvents JSON ser/de safe

2019-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26818: Assignee: Hyukjin Kwon (was: Apache Spark) > Make MLEvents JSON ser/de safe >

[jira] [Created] (SPARK-26818) Make MLEvents JSON ser/de safe

2019-02-02 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-26818: Summary: Make MLEvents JSON ser/de safe Key: SPARK-26818 URL: https://issues.apache.org/jira/browse/SPARK-26818 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-26817) Use System.nanoTime to measure time intervals

2019-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26817: Assignee: Apache Spark > Use System.nanoTime to measure time intervals >

[jira] [Updated] (SPARK-26817) Use System.nanoTime to measure time intervals

2019-02-02 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-26817: --- Description: Replace System.currentTimeMillis() by System.nanoTime in time intervals measurements.

[jira] [Assigned] (SPARK-26817) Use System.nanoTime to measure time intervals

2019-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26817: Assignee: (was: Apache Spark) > Use System.nanoTime to measure time intervals >

[jira] [Created] (SPARK-26817) Use System.nanoTime to measure time intervals

2019-02-02 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-26817: -- Summary: Use System.nanoTime to measure time intervals Key: SPARK-26817 URL: https://issues.apache.org/jira/browse/SPARK-26817 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-26812) PushProjectionThroughUnion nullability issue

2019-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26812: Assignee: (was: Apache Spark) > PushProjectionThroughUnion nullability issue >

[jira] [Assigned] (SPARK-26812) PushProjectionThroughUnion nullability issue

2019-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26812: Assignee: Apache Spark > PushProjectionThroughUnion nullability issue >

[jira] [Commented] (SPARK-26786) Handle to treat escaped newline characters('\r','\n') in spark csv

2019-02-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758963#comment-16758963 ] Hyukjin Kwon commented on SPARK-26786: -- When I post a repo in other repos, usually I put a

[jira] [Assigned] (SPARK-18161) Default PickleSerializer pickle protocol doesn't handle > 4GB objects

2019-02-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-18161: Assignee: Boris Shminke > Default PickleSerializer pickle protocol doesn't handle > 4GB

[jira] [Created] (SPARK-26816) Benchmark for XORShiftRandom

2019-02-02 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-26816: -- Summary: Benchmark for XORShiftRandom Key: SPARK-26816 URL: https://issues.apache.org/jira/browse/SPARK-26816 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-26815) run command "Spark-shell --proxy-user " failed in kerberos environment

2019-02-02 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-26815: -- Attachment: spark-shell-error.png > run command "Spark-shell --proxy-user " failed in

[jira] [Created] (SPARK-26815) run command "Spark-shell --proxy-user " failed in kerberos environment

2019-02-02 Thread KaiXinXIaoLei (JIRA)
KaiXinXIaoLei created SPARK-26815: - Summary: run command "Spark-shell --proxy-user " failed in kerberos environment Key: SPARK-26815 URL: https://issues.apache.org/jira/browse/SPARK-26815 Project:

[jira] [Resolved] (SPARK-26814) Avoid unnecessary block concatenation while empty block exists

2019-02-02 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-26814. -- Resolution: Won't Fix > Avoid unnecessary block concatenation while empty block exists >

[jira] [Assigned] (SPARK-26814) Avoid unnecessary block concatenation while empty block exists

2019-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26814: Assignee: (was: Apache Spark) > Avoid unnecessary block concatenation while empty

[jira] [Assigned] (SPARK-26814) Avoid unnecessary block concatenation while empty block exists

2019-02-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26814: Assignee: Apache Spark > Avoid unnecessary block concatenation while empty block exists

[jira] [Created] (SPARK-26814) Avoid unnecessary block concatenation while empty block exists

2019-02-02 Thread wuyi (JIRA)
wuyi created SPARK-26814: Summary: Avoid unnecessary block concatenation while empty block exists Key: SPARK-26814 URL: https://issues.apache.org/jira/browse/SPARK-26814 Project: Spark Issue Type: