[jira] [Resolved] (SPARK-25673) Remove Travis CI which enables Java lint check

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25673. -- Resolution: Fixed Fix Version/s: 2.4.0 3.0.0 Issue resolved by pull

[jira] [Assigned] (SPARK-25673) Remove Travis CI which enables Java lint check

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25673: Assignee: Hyukjin Kwon > Remove Travis CI which enables Java lint check > ---

[jira] [Created] (SPARK-25678) SPIP: Adding support in Spark for HPC cluster manager (PBS Professional)

2018-10-08 Thread Utkarsh Maheshwari (JIRA)
Utkarsh Maheshwari created SPARK-25678: -- Summary: SPIP: Adding support in Spark for HPC cluster manager (PBS Professional) Key: SPARK-25678 URL: https://issues.apache.org/jira/browse/SPARK-25678

[jira] [Assigned] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25591: Assignee: Liang-Chi Hsieh > PySpark Accumulators with multiple PythonUDFs > -

[jira] [Resolved] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25591. -- Resolution: Fixed Fix Version/s: 2.4.1 Fixed in https://github.com/apache/spark/pull/22

[jira] [Assigned] (SPARK-25677) Configuring zstd compression in JDBC throwing IllegalArgumentException Exception

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25677: Assignee: shivusondur > Configuring zstd compression in JDBC throwing IllegalArgumentExce

[jira] [Resolved] (SPARK-25677) Configuring zstd compression in JDBC throwing IllegalArgumentException Exception

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25677. -- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 Issue resolved by pull

[jira] [Resolved] (SPARK-25666) Internally document type conversion between Python data and SQL types in UDFs

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25666. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22655 [https://gi

[jira] [Assigned] (SPARK-25666) Internally document type conversion between Python data and SQL types in UDFs

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25666: Assignee: Hyukjin Kwon > Internally document type conversion between Python data and SQL

[jira] [Resolved] (SPARK-25282) Document custom builds needed for K8S development

2018-10-08 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-25282. - Resolution: Not A Problem Fix Version/s: 3.0.0 Looks like this is working without

[jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark

2018-10-08 Thread Jackey Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641516#comment-16641516 ] Jackey Lee commented on SPARK-24630: [~kabhwan] The DDL in SQLStreaming has nothing

[jira] [Comment Edited] (SPARK-24630) SPIP: Support SQLStreaming in Spark

2018-10-08 Thread Jackey Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641516#comment-16641516 ] Jackey Lee edited comment on SPARK-24630 at 10/8/18 8:36 AM: -

[jira] [Commented] (SPARK-25643) Performance issues querying wide rows

2018-10-08 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641554#comment-16641554 ] Liang-Chi Hsieh commented on SPARK-25643: - {quote}predicate push down is not hel

[jira] [Assigned] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25615: Assignee: Apache Spark > KafkaSinkSuite: streaming - write to non-existing topic 1 min >

[jira] [Commented] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641566#comment-16641566 ] Apache Spark commented on SPARK-25615: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25615) KafkaSinkSuite: streaming - write to non-existing topic 1 min

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25615: Assignee: (was: Apache Spark) > KafkaSinkSuite: streaming - write to non-existing top

[jira] [Updated] (SPARK-25674) If the records are incremented by more than 1 at a time,the number of bytes might rarely ever get updated

2018-10-08 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25674: Priority: Minor (was: Trivial) > If the records are incremented by more than 1 at a time,the number of by

[jira] [Commented] (SPARK-25663) Refactor BuiltInDataSourceWriteBenchmark and DataSourceWriteBenchmark to use main method

2018-10-08 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641791#comment-16641791 ] Gengliang Wang commented on SPARK-25663: I wonder whether we should do this. The

[jira] [Commented] (SPARK-25605) CastSuite: cast string to timestamp 2 mins 31 sec

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641812#comment-16641812 ] Apache Spark commented on SPARK-25605: -- User 'srowen' has created a pull request fo

[jira] [Created] (SPARK-25679) OOM Killed observed for spark thrift executors with dynamic allocation enabled

2018-10-08 Thread neenu (JIRA)
neenu created SPARK-25679: - Summary: OOM Killed observed for spark thrift executors with dynamic allocation enabled Key: SPARK-25679 URL: https://issues.apache.org/jira/browse/SPARK-25679 Project: Spark

[jira] [Updated] (SPARK-25679) OOM Killed observed for spark thrift executors with dynamic allocation enabled

2018-10-08 Thread neenu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] neenu updated SPARK-25679: -- Issue Type: Question (was: Bug) > OOM Killed observed for spark thrift executors with dynamic allocation > e

[jira] [Updated] (SPARK-25408) Move to idiomatic Java 8

2018-10-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25408: -- Priority: Minor (was: Major) > Move to idiomatic Java 8 > > >

[jira] [Commented] (SPARK-20144) spark.read.parquet no long maintains ordering of the data

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642036#comment-16642036 ] Apache Spark commented on SPARK-20144: -- User 'darabos' has created a pull request f

[jira] [Commented] (SPARK-20144) spark.read.parquet no long maintains ordering of the data

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642038#comment-16642038 ] Apache Spark commented on SPARK-20144: -- User 'darabos' has created a pull request f

[jira] [Assigned] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown.

2018-10-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25295: - Assignee: Stavros Kontopoulos > Pod names conflicts in client mode, if previous submiss

[jira] [Commented] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown.

2018-10-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642055#comment-16642055 ] Dongjoon Hyun commented on SPARK-25295: --- Hi, [~liyinan926] . Please update the as

[jira] [Assigned] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

2018-10-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25291: - Assignee: Ilan Filonenko > Flakiness of tests in terms of executor memory (SecretsTestS

[jira] [Assigned] (SPARK-25283) A deadlock in UnionRDD

2018-10-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25283: - Assignee: Maxim Gekk > A deadlock in UnionRDD > -- > >

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-10-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Priority: Blocker (was: Critical) > Use quoted attribute names if needed in pushed ORC predic

[jira] [Created] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

2018-10-08 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-25680: --- Summary: SQL execution listener shouldn't happen on execution thread Key: SPARK-25680 URL: https://issues.apache.org/jira/browse/SPARK-25680 Project: Spark Is

[jira] [Commented] (SPARK-16707) TransportClientFactory.createClient may throw NPE

2018-10-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642191#comment-16642191 ] John Zhuge commented on SPARK-16707: Saw the same NPE with 2.1.1: {noformat} org.apa

[jira] [Updated] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-08 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Heuer updated SPARK-25588: -- Affects Version/s: (was: 2.4.0) 2.3.2 > SchemaParseException: Can't

[jira] [Updated] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-08 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Heuer updated SPARK-25588: -- Environment: Spark version 2.3.2 (was: Spark version 2.4.0 (RC2). {noformat} $ spark-submit -

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-08 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642200#comment-16642200 ] Michael Heuer commented on SPARK-25588: --- I moved the version back to 2.3.2, see [h

[jira] [Commented] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642201#comment-16642201 ] Apache Spark commented on SPARK-25680: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642202#comment-16642202 ] Apache Spark commented on SPARK-25680: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25680: Assignee: Apache Spark (was: Wenchen Fan) > SQL execution listener shouldn't happen on e

[jira] [Assigned] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25680: Assignee: Wenchen Fan (was: Apache Spark) > SQL execution listener shouldn't happen on e

[jira] [Commented] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

2018-10-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642233#comment-16642233 ] Dongjoon Hyun commented on SPARK-25680: --- Hi, [~cloud_fan] . Is this targeting both

[jira] [Assigned] (SPARK-25641) Change the spark.shuffle.server.chunkFetchHandlerThreadsPercent default to 100

2018-10-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-25641: - Assignee: Sanket Reddy > Change the spark.shuffle.server.chunkFetchHandlerThreadsPercen

[jira] [Resolved] (SPARK-25641) Change the spark.shuffle.server.chunkFetchHandlerThreadsPercent default to 100

2018-10-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-25641. --- Resolution: Fixed Fix Version/s: 3.0.0 > Change the spark.shuffle.server.chunkFetchHa

[jira] [Commented] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None

2018-10-08 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642379#comment-16642379 ] Bryan Cutler commented on SPARK-25461: -- Just wanted to add that the resolution here

[jira] [Commented] (SPARK-25679) OOM Killed observed for spark thrift executors with dynamic allocation enabled

2018-10-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642393#comment-16642393 ] Yuming Wang commented on SPARK-25679: - Thanks [~nanndomi], Could you provide which q

[jira] [Commented] (SPARK-20144) spark.read.parquet no long maintains ordering of the data

2018-10-08 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642401#comment-16642401 ] Daniel Darabos commented on SPARK-20144: Sorry, I had an idea for a quick fix fo

[jira] [Resolved] (SPARK-25630) HiveOrcHadoopFsRelationSuite: SPARK-8406: Avoids name collision while writing files 21 sec

2018-10-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25630. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0 > HiveOrcHadoopFsRelatio

[jira] [Updated] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

2018-10-08 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25681: --- Labels: Hadoop Kerberos (was: ) > Delegation Tokens fetched twice upon HadoopFSDelegationTo

[jira] [Created] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

2018-10-08 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25681: -- Summary: Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation Key: SPARK-25681 URL: https://issues.apache.org/jira/browse/SPARK-25681 Pro

[jira] [Created] (SPARK-25682) Docker images generated from dev build and from dist tarball are different

2018-10-08 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-25682: -- Summary: Docker images generated from dev build and from dist tarball are different Key: SPARK-25682 URL: https://issues.apache.org/jira/browse/SPARK-25682 Projec

[jira] [Updated] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2018-10-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25591: Fix Version/s: (was: 2.4.1) 2.4.0 > PySpark Accumulators with multiple PythonUDFs >

[jira] [Updated] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2018-10-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25591: Priority: Blocker (was: Critical) > PySpark Accumulators with multiple PythonUDFs > -

[jira] [Updated] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2018-10-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25591: Labels: correctness (was: data-loss) > PySpark Accumulators with multiple PythonUDFs > --

[jira] [Commented] (SPARK-25591) PySpark Accumulators with multiple PythonUDFs

2018-10-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642506#comment-16642506 ] Xiao Li commented on SPARK-25591: - RC3 is not out yet. Thus, RC3 will include the fix.

[jira] [Resolved] (SPARK-25639) Add documentation on foreachBatch, and multiple watermark policy

2018-10-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-25639. --- Resolution: Fixed Fix Version/s: 2.4.1 Issue resolved by pull request 22627 [https://

[jira] [Assigned] (SPARK-25639) Add documentation on foreachBatch, and multiple watermark policy

2018-10-08 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-25639: - Assignee: Tathagata Das > Add documentation on foreachBatch, and multiple watermark pol

[jira] [Resolved] (SPARK-25659) Test type inference specification for createDataFrame in PySpark

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25659. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22653 [https://gi

[jira] [Assigned] (SPARK-25659) Test type inference specification for createDataFrame in PySpark

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25659: Assignee: Hyukjin Kwon > Test type inference specification for createDataFrame in PySpark

[jira] [Assigned] (SPARK-25623) LogisticRegressionSuite: multinomial logistic regression with intercept with L1 regularization 1 min 10 sec

2018-10-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25623: - Assignee: shahid > LogisticRegressionSuite: multinomial logistic regression with intercept with

[jira] [Resolved] (SPARK-25623) LogisticRegressionSuite: multinomial logistic regression with intercept with L1 regularization 1 min 10 sec

2018-10-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25623. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22659 [https://github.c

[jira] [Assigned] (SPARK-25624) LogisticRegressionSuite.multinomial logistic regression with intercept with elasticnet regularization 56 seconds

2018-10-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25624: - Assignee: shahid > LogisticRegressionSuite.multinomial logistic regression with intercept with

[jira] [Assigned] (SPARK-25625) LogisticRegressionSuite.binary logistic regression with intercept with ElasticNet regularization - 33 sec

2018-10-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25625: - Assignee: shahid > LogisticRegressionSuite.binary logistic regression with intercept with > El

[jira] [Resolved] (SPARK-25625) LogisticRegressionSuite.binary logistic regression with intercept with ElasticNet regularization - 33 sec

2018-10-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25625. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22659 [https://github.c

[jira] [Resolved] (SPARK-25624) LogisticRegressionSuite.multinomial logistic regression with intercept with elasticnet regularization 56 seconds

2018-10-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25624. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22659 [https://github.c

[jira] [Created] (SPARK-25683) Make AsyncEventQueue.lastReportTimestamp inital value as the currentTime instead of 0

2018-10-08 Thread Devaraj K (JIRA)
Devaraj K created SPARK-25683: - Summary: Make AsyncEventQueue.lastReportTimestamp inital value as the currentTime instead of 0 Key: SPARK-25683 URL: https://issues.apache.org/jira/browse/SPARK-25683 Proje

[jira] [Commented] (SPARK-16707) TransportClientFactory.createClient may throw NPE

2018-10-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642699#comment-16642699 ] John Zhuge commented on SPARK-16707: Did the channel get closed here? [https://gith

[jira] [Assigned] (SPARK-25347) Document image data source in doc site

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25347: Assignee: Apache Spark > Document image data source in doc site > ---

[jira] [Commented] (SPARK-25347) Document image data source in doc site

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642727#comment-16642727 ] Apache Spark commented on SPARK-25347: -- User 'WeichenXu123' has created a pull requ

[jira] [Assigned] (SPARK-25347) Document image data source in doc site

2018-10-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25347: Assignee: (was: Apache Spark) > Document image data source in doc site >

[jira] [Commented] (SPARK-17570) Avoid Hash and Exchange in Sort Merge join if bucketing factor is multiple for tables

2018-10-08 Thread Wang, Gang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642730#comment-16642730 ] Wang, Gang commented on SPARK-17570: Any update? > Avoid Hash and Exchange in Sort

[jira] [Resolved] (SPARK-25669) Check CSV header only when it exists

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25669. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22656 [https://gi

[jira] [Updated] (SPARK-25669) Check CSV header only when it exists

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25669: - Fix Version/s: 3.0.0 > Check CSV header only when it exists > --

[jira] [Assigned] (SPARK-25669) Check CSV header only when it exists

2018-10-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25669: Assignee: Maxim Gekk > Check CSV header only when it exists > ---

[jira] [Commented] (SPARK-25683) Make AsyncEventQueue.lastReportTimestamp inital value as the currentTime instead of 0

2018-10-08 Thread shivusondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642874#comment-16642874 ] shivusondur commented on SPARK-25683: - i am working on it > Make AsyncEventQueue.la