[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2018-01-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319855#comment-16319855 ] Felix Cheung commented on SPARK-21727: -- good call... if ( (is.atomic(object) && !is.raw(object)) &&

[jira] [Commented] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319807#comment-16319807 ] guoxiaolongzte commented on SPARK-23002: Good idea. I tend to ip address, not the host name. So

[jira] [Resolved] (SPARK-22982) Remove unsafe asynchronous close() call from FileDownloadChannel

2018-01-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22982. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20179

[jira] [Resolved] (SPARK-23009) PySpark should not assume Pandas cols are a basestring type

2018-01-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23009. -- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.3.0 Fixed in

[jira] [Resolved] (SPARK-23018) PySpark creatDataFrame causes Pandas warning of assignment to a copy of a reference

2018-01-09 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23018. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20213

[jira] [Assigned] (SPARK-23018) PySpark creatDataFrame causes Pandas warning of assignment to a copy of a reference

2018-01-09 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23018: - Assignee: Bryan Cutler > PySpark creatDataFrame causes Pandas warning of assignment to

[jira] [Commented] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319664#comment-16319664 ] Sean Owen commented on SPARK-23002: --- Utils.localHostName is used elsewhere, so I don't think we can or

[jira] [Assigned] (SPARK-23001) NullPointerException when running desc database

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23001: Assignee: Apache Spark (was: Xiao Li) > NullPointerException when running desc database

[jira] [Commented] (SPARK-23001) NullPointerException when running desc database

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319659#comment-16319659 ] Apache Spark commented on SPARK-23001: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23001) NullPointerException when running desc database

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23001: Assignee: Xiao Li (was: Apache Spark) > NullPointerException when running desc database

[jira] [Comment Edited] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread Ran Tao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319653#comment-16319653 ] Ran Tao edited comment on SPARK-23002 at 1/10/18 3:46 AM: -- I found that in the

[jira] [Comment Edited] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread Ran Tao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319653#comment-16319653 ] Ran Tao edited comment on SPARK-23002 at 1/10/18 3:44 AM: -- I found that in the

[jira] [Comment Edited] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread Ran Tao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319653#comment-16319653 ] Ran Tao edited comment on SPARK-23002 at 1/10/18 3:43 AM: -- I found that in the

[jira] [Comment Edited] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread Ran Tao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319653#comment-16319653 ] Ran Tao edited comment on SPARK-23002 at 1/10/18 3:43 AM: -- I found that in the

[jira] [Commented] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread Ran Tao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319653#comment-16319653 ] Ran Tao commented on SPARK-23002: - I found that in the YARN mode, how to get driver hostname and executor

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

2018-01-09 Thread Neil Alexander McQuarrie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319647#comment-16319647 ] Neil Alexander McQuarrie commented on SPARK-21727: -- Oh -- interesting... thanks. I

[jira] [Resolved] (SPARK-23022) Spark Thrift Server always cache resource issues

2018-01-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23022. --- Resolution: Invalid It's not at all clear what specific problem with Spark you're reporting. For

[jira] [Commented] (SPARK-23001) NullPointerException when running desc database

2018-01-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319637#comment-16319637 ] Xiao Li commented on SPARK-23001: - Let me do a quick fix. > NullPointerException when running desc

[jira] [Assigned] (SPARK-23001) NullPointerException when running desc database

2018-01-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23001: --- Assignee: Xiao Li > NullPointerException when running desc database >

[jira] [Assigned] (SPARK-23023) Incorrect results of printing Array/Map/Struct in showString

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23023: Assignee: (was: Apache Spark) > Incorrect results of printing Array/Map/Struct in

[jira] [Commented] (SPARK-23023) Incorrect results of printing Array/Map/Struct in showString

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319629#comment-16319629 ] Apache Spark commented on SPARK-23023: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23023) Incorrect results of printing Array/Map/Struct in showString

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23023: Assignee: Apache Spark > Incorrect results of printing Array/Map/Struct in showString >

[jira] [Created] (SPARK-23023) Incorrect results of printing Array/Map/Struct in showString

2018-01-09 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-23023: Summary: Incorrect results of printing Array/Map/Struct in showString Key: SPARK-23023 URL: https://issues.apache.org/jira/browse/SPARK-23023 Project: Spark

[jira] [Updated] (SPARK-23022) Spark Thrift Server always cache resource issues

2018-01-09 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xinzhang updated SPARK-23022: - Description: Hi. I use the Thrift Server for SparkSQL . I queried muiltle queries.I deploy the Spark

[jira] [Updated] (SPARK-23022) Spark Thrift Server always cache resource issues

2018-01-09 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xinzhang updated SPARK-23022: - Description: Hi. I use the Thrift Server for SparkSQL . I queried muiltle queries.I deply the Spark on

[jira] [Resolved] (SPARK-23005) Improve RDD.take on small number of partitions

2018-01-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23005. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20200

[jira] [Assigned] (SPARK-23005) Improve RDD.take on small number of partitions

2018-01-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-23005: --- Assignee: Gengliang Wang > Improve RDD.take on small number of partitions >

[jira] [Created] (SPARK-23022) Spark Thrift Server always cache resource issues

2018-01-09 Thread xinzhang (JIRA)
xinzhang created SPARK-23022: Summary: Spark Thrift Server always cache resource issues Key: SPARK-23022 URL: https://issues.apache.org/jira/browse/SPARK-23022 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319562#comment-16319562 ] Alex Bozarth commented on SPARK-23002: -- I've noticed this in the past, if no one claims it I can

[jira] [Updated] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors

2018-01-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23002: -- Priority: Minor (was: Major) Good point, I had never really noticed that, but except in local most

[jira] [Updated] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

2018-01-09 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23021: --- Target Version/s: 2.3.0 Priority: Major (was: Minor) > AnalysisBarrier should

[jira] [Created] (SPARK-23021) AnalysisBarrier should not cut off the explain output for Parsed Logical Plan

2018-01-09 Thread Kris Mok (JIRA)
Kris Mok created SPARK-23021: Summary: AnalysisBarrier should not cut off the explain output for Parsed Logical Plan Key: SPARK-23021 URL: https://issues.apache.org/jira/browse/SPARK-23021 Project: Spark

[jira] [Assigned] (SPARK-23000) Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23000: Assignee: Apache Spark (was: Xiao Li) > Flaky test suite

[jira] [Assigned] (SPARK-23000) Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23000: Assignee: Xiao Li (was: Apache Spark) > Flaky test suite

[jira] [Updated] (SPARK-23000) Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3

2018-01-09 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23000: --- Target Version/s: 2.3.0 > Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark

[jira] [Reopened] (SPARK-23000) Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3

2018-01-09 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reopened SPARK-23000: > Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3 >

[jira] [Updated] (SPARK-23000) Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3

2018-01-09 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23000: --- Priority: Blocker (was: Major) > Flaky test suite DataSourceWithHiveMetastoreCatalogSuite

[jira] [Commented] (SPARK-22517) NullPointerException in ShuffleExternalSorter.spill()

2018-01-09 Thread William Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319496#comment-16319496 ] William Shen commented on SPARK-22517: -- I came across a similar stack trace when debugging our spark

[jira] [Commented] (SPARK-23020) Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

2018-01-09 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319492#comment-16319492 ] Sameer Agarwal commented on SPARK-23020: cc [~vanzin] > Flaky Test:

[jira] [Created] (SPARK-23020) Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

2018-01-09 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-23020: -- Summary: Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher Key: SPARK-23020 URL: https://issues.apache.org/jira/browse/SPARK-23020

[jira] [Created] (SPARK-23019) Flaky Test: org.apache.spark.JavaJdbcRDDSuite.testJavaJdbcRDD

2018-01-09 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-23019: -- Summary: Flaky Test: org.apache.spark.JavaJdbcRDDSuite.testJavaJdbcRDD Key: SPARK-23019 URL: https://issues.apache.org/jira/browse/SPARK-23019 Project: Spark

[jira] [Updated] (SPARK-23019) Flaky Test: org.apache.spark.JavaJdbcRDDSuite.testJavaJdbcRDD

2018-01-09 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23019: --- Priority: Blocker (was: Major) > Flaky Test:

[jira] [Commented] (SPARK-23017) Why would spark-kafka stream fail stating `Got wrong record for even after seeking to offset #` when using kafka API to commit offset

2018-01-09 Thread Bhaskar E (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319462#comment-16319462 ] Bhaskar E commented on SPARK-23017: --- [~srowen]: How to start a mailing list? > Why would spark-kafka

[jira] [Resolved] (SPARK-23017) Why would spark-kafka stream fail stating `Got wrong record for even after seeking to offset #` when using kafka API to commit offset

2018-01-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23017. --- Resolution: Invalid This is more of a question, and at the moment, it's still sounding more likely

[jira] [Assigned] (SPARK-23018) PySpark creatDataFrame causes Pandas warning of assignment to a copy of a reference

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23018: Assignee: (was: Apache Spark) > PySpark creatDataFrame causes Pandas warning of

[jira] [Assigned] (SPARK-23018) PySpark creatDataFrame causes Pandas warning of assignment to a copy of a reference

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23018: Assignee: Apache Spark > PySpark creatDataFrame causes Pandas warning of assignment to a

[jira] [Commented] (SPARK-23018) PySpark creatDataFrame causes Pandas warning of assignment to a copy of a reference

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319433#comment-16319433 ] Apache Spark commented on SPARK-23018: -- User 'BryanCutler' has created a pull request for this

[jira] [Commented] (SPARK-23018) PySpark creatDataFrame causes Pandas warning of assignment to a copy of a reference

2018-01-09 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319417#comment-16319417 ] Bryan Cutler commented on SPARK-23018: -- I can submit a PR > PySpark creatDataFrame causes Pandas

[jira] [Created] (SPARK-23018) PySpark creatDataFrame causes Pandas warning of assignment to a copy of a reference

2018-01-09 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-23018: Summary: PySpark creatDataFrame causes Pandas warning of assignment to a copy of a reference Key: SPARK-23018 URL: https://issues.apache.org/jira/browse/SPARK-23018

[jira] [Updated] (SPARK-23017) Why would spark-kafka stream fail stating `Got wrong record for even after seeking to offset #` when using kafka API to commit offset

2018-01-09 Thread Bhaskar E (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhaskar E updated SPARK-23017: -- Priority: Major (was: Minor) > Why would spark-kafka stream fail stating `Got wrong record for >

[jira] [Created] (SPARK-23017) Why would spark-kafka stream fail stating `Got wrong record for even after seeking to offset #` when using kafka API to commit offset

2018-01-09 Thread Bhaskar E (JIRA)
Bhaskar E created SPARK-23017: - Summary: Why would spark-kafka stream fail stating `Got wrong record foreven after seeking to offset #` when using kafka API to commit offset Key: SPARK-23017 URL:

[jira] [Updated] (SPARK-23017) Why would spark-kafka stream fail stating `Got wrong record for even after seeking to offset #` when using kafka API to commit offset

2018-01-09 Thread Bhaskar E (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhaskar E updated SPARK-23017: -- Description: My spark-kafka streaming job started failing after multiple messages stating - `Got

[jira] [Commented] (SPARK-23016) Spark UI access and documentation

2018-01-09 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319412#comment-16319412 ] Anirudh Ramanathan commented on SPARK-23016: cc/ [~mccheah] > Spark UI access and

[jira] [Created] (SPARK-23016) Spark UI access and documentation

2018-01-09 Thread Anirudh Ramanathan (JIRA)
Anirudh Ramanathan created SPARK-23016: -- Summary: Spark UI access and documentation Key: SPARK-23016 URL: https://issues.apache.org/jira/browse/SPARK-23016 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319399#comment-16319399 ] Marcelo Vanzin commented on SPARK-23015: The {{%RANDOM%}} thing is not something I added

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23015: -- Affects Version/s: (was: 1.4.0) Target Version/s: (was: 2.3.0) CC [~vanzin] > spark-submit

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Updated] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hugh Zabriskie updated SPARK-23015: --- Description: Spark Submit's launching library prints the command to execute the launcher

[jira] [Created] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-01-09 Thread Hugh Zabriskie (JIRA)
Hugh Zabriskie created SPARK-23015: -- Summary: spark-submit fails when submitting several jobs in parallel Key: SPARK-23015 URL: https://issues.apache.org/jira/browse/SPARK-23015 Project: Spark

[jira] [Created] (SPARK-23014) Migrate MemorySink fully to v2

2018-01-09 Thread Jose Torres (JIRA)
Jose Torres created SPARK-23014: --- Summary: Migrate MemorySink fully to v2 Key: SPARK-23014 URL: https://issues.apache.org/jira/browse/SPARK-23014 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-23013) Migrate MemoryStream to V2

2018-01-09 Thread Jose Torres (JIRA)
Jose Torres created SPARK-23013: --- Summary: Migrate MemoryStream to V2 Key: SPARK-23013 URL: https://issues.apache.org/jira/browse/SPARK-23013 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-23011) Prepend missing grouping columns in groupby apply

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319148#comment-16319148 ] Apache Spark commented on SPARK-23011: -- User 'icexelloss' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23011) Prepend missing grouping columns in groupby apply

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23011: Assignee: (was: Apache Spark) > Prepend missing grouping columns in groupby apply >

[jira] [Assigned] (SPARK-23011) Prepend missing grouping columns in groupby apply

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23011: Assignee: Apache Spark > Prepend missing grouping columns in groupby apply >

[jira] [Created] (SPARK-23012) Support for predicate pushdown and partition pruning when left joining large Hive tables

2018-01-09 Thread Rick Kramer (JIRA)
Rick Kramer created SPARK-23012: --- Summary: Support for predicate pushdown and partition pruning when left joining large Hive tables Key: SPARK-23012 URL: https://issues.apache.org/jira/browse/SPARK-23012

[jira] [Commented] (SPARK-22853) K8s or Kubernetes?

2018-01-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319147#comment-16319147 ] Reynold Xin commented on SPARK-22853: - Thanks for looking into this. > K8s or Kubernetes? >

[jira] [Resolved] (SPARK-22853) K8s or Kubernetes?

2018-01-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-22853. - Resolution: Fixed Assignee: Anirudh Ramanathan > K8s or Kubernetes? > -- >

[jira] [Commented] (SPARK-22853) K8s or Kubernetes?

2018-01-09 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319119#comment-16319119 ] Anirudh Ramanathan commented on SPARK-22853: It turns out this was a Kubernetes community

[jira] [Updated] (SPARK-23011) Prepend missing grouping columns in groupby apply

2018-01-09 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-23011: --- Affects Version/s: (was: 2.2.0) 2.3.0 > Prepend missing grouping columns in

[jira] [Created] (SPARK-23011) Prepend missing grouping columns in groupby apply

2018-01-09 Thread Li Jin (JIRA)
Li Jin created SPARK-23011: -- Summary: Prepend missing grouping columns in groupby apply Key: SPARK-23011 URL: https://issues.apache.org/jira/browse/SPARK-23011 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-23010) Add integration testing for Kubernetes backend into the apache/spark repository

2018-01-09 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-23010: --- Summary: Add integration testing for Kubernetes backend into the apache/spark

[jira] [Created] (SPARK-23010) Add integration

2018-01-09 Thread Anirudh Ramanathan (JIRA)
Anirudh Ramanathan created SPARK-23010: -- Summary: Add integration Key: SPARK-23010 URL: https://issues.apache.org/jira/browse/SPARK-23010 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-23009) PySpark should not assume Pandas cols are a basestring type

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23009: Assignee: Apache Spark > PySpark should not assume Pandas cols are a basestring type >

[jira] [Commented] (SPARK-23009) PySpark should not assume Pandas cols are a basestring type

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319054#comment-16319054 ] Apache Spark commented on SPARK-23009: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-23009) PySpark should not assume Pandas cols are a basestring type

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23009: Assignee: (was: Apache Spark) > PySpark should not assume Pandas cols are a

[jira] [Updated] (SPARK-23009) PySpark should not assume Pandas cols are a basestring type

2018-01-09 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-23009: - Description: When calling {{SparkSession.createDataFrame}} using a Pandas DataFrame as input,

[jira] [Commented] (SPARK-23009) PySpark should not assume Pandas cols are a basestring type

2018-01-09 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318990#comment-16318990 ] Bryan Cutler commented on SPARK-23009: -- I can put in a fix for this > PySpark should not assume

[jira] [Updated] (SPARK-23009) PySpark should not assume Pandas cols are a basestring type

2018-01-09 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-23009: - Description: When calling {{SparkSession.createDataFrame}} using a Pandas DataFrame as input,

[jira] [Created] (SPARK-23009) PySpark should not assume Pandas cols are a basestring type

2018-01-09 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-23009: Summary: PySpark should not assume Pandas cols are a basestring type Key: SPARK-23009 URL: https://issues.apache.org/jira/browse/SPARK-23009 Project: Spark

[jira] [Assigned] (SPARK-21783) Turn on ORC filter push-down by default

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21783: Assignee: (was: Apache Spark) > Turn on ORC filter push-down by default >

[jira] [Assigned] (SPARK-21783) Turn on ORC filter push-down by default

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21783: Assignee: Apache Spark > Turn on ORC filter push-down by default >

[jira] [Assigned] (SPARK-23008) OnehotEncoderEstimator python API

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23008: Assignee: Apache Spark > OnehotEncoderEstimator python API >

[jira] [Assigned] (SPARK-23008) OnehotEncoderEstimator python API

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23008: Assignee: (was: Apache Spark) > OnehotEncoderEstimator python API >

[jira] [Commented] (SPARK-23008) OnehotEncoderEstimator python API

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318934#comment-16318934 ] Apache Spark commented on SPARK-23008: -- User 'WeichenXu123' has created a pull request for this

[jira] [Created] (SPARK-23008) OnehotEncoderEstimator python API

2018-01-09 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-23008: -- Summary: OnehotEncoderEstimator python API Key: SPARK-23008 URL: https://issues.apache.org/jira/browse/SPARK-23008 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-23007) Add schema evolution test suite for file-based data sources

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23007: Assignee: (was: Apache Spark) > Add schema evolution test suite for file-based data

[jira] [Commented] (SPARK-23007) Add schema evolution test suite for file-based data sources

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318892#comment-16318892 ] Apache Spark commented on SPARK-23007: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-23007) Add schema evolution test suite for file-based data sources

2018-01-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23007: Assignee: Apache Spark > Add schema evolution test suite for file-based data sources >

[jira] [Commented] (SPARK-23007) Add schema evolution test suite for file-based data sources

2018-01-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318883#comment-16318883 ] Dongjoon Hyun commented on SPARK-23007: --- I hope this should be in Apache Spark 2.3.0 since this is

[jira] [Updated] (SPARK-23007) Add schema evolution test suite for file-based data sources

2018-01-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23007: -- Summary: Add schema evolution test suite for file-based data sources (was: Add schema

[jira] [Created] (SPARK-23007) Add schema evolution test suite

2018-01-09 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-23007: - Summary: Add schema evolution test suite Key: SPARK-23007 URL: https://issues.apache.org/jira/browse/SPARK-23007 Project: Spark Issue Type: Bug

  1   2   >