[jira] [Assigned] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25754: Assignee: (was: Apache Spark) > Change CDN for MathJax > --- > >

[jira] [Assigned] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25754: Assignee: Apache Spark > Change CDN for MathJax > --- > >

[jira] [Commented] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653081#comment-16653081 ] Apache Spark commented on SPARK-25754: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-25755) Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec

2018-10-17 Thread caoxuewen (JIRA)
caoxuewen created SPARK-25755: - Summary: Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec Key: SPARK-25755 URL: https://issues.apache.org/jira/browse/SPARK-25755 Project: Spark

[jira] [Assigned] (SPARK-25755) Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25755: Assignee: Apache Spark > Supplementation of non-CodeGen unit tested for BroadcastHashJoin

[jira] [Assigned] (SPARK-25755) Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25755: Assignee: (was: Apache Spark) > Supplementation of non-CodeGen unit tested for Broadc

[jira] [Commented] (SPARK-25755) Supplementation of non-CodeGen unit tested for BroadcastHashJoinExec

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653145#comment-16653145 ] Apache Spark commented on SPARK-25755: -- User 'heary-cao' has created a pull request

[jira] [Resolved] (SPARK-25680) SQL execution listener shouldn't happen on execution thread

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25680. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22674 [https://gith

[jira] [Commented] (SPARK-25731) Spark Structured Streaming Support for Kafka 2.0

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653200#comment-16653200 ] Hyukjin Kwon commented on SPARK-25731: -- duplicate of SPARK-18057 > Spark Structure

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653203#comment-16653203 ] Hyukjin Kwon commented on SPARK-25739: -- So this is fixed in Spark 2.4, right? That

[jira] [Resolved] (SPARK-25742) Is there a way to pass the Azure blob storage credentials to the spark for k8s init-container?

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25742. -- Resolution: Invalid Questions should go to mailing list. Please see https://spark.apache.org/

[jira] [Resolved] (SPARK-25731) Spark Structured Streaming Support for Kafka 2.0

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25731. -- Resolution: Duplicate > Spark Structured Streaming Support for Kafka 2.0 > ---

[jira] [Resolved] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25739. -- Resolution: Duplicate > Double quote coming in as empty value even when emptyValue set as null

[jira] [Resolved] (SPARK-25733) The method toLocalIterator() with dataframe doesn't work

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25733. -- Resolution: Duplicate > The method toLocalIterator() with dataframe doesn't work > ---

[jira] [Commented] (SPARK-25749) Exception thrown while reading avro file with large schema

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653209#comment-16653209 ] Hyukjin Kwon commented on SPARK-25749: -- Please avoid set the priority, Critical+ wh

[jira] [Updated] (SPARK-25749) Exception thrown while reading avro file with large schema

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25749: - Priority: Major (was: Blocker) > Exception thrown while reading avro file with large schema > -

[jira] [Resolved] (SPARK-25749) Exception thrown while reading avro file with large schema

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25749. -- Resolution: Invalid > Exception thrown while reading avro file with large schema > ---

[jira] [Created] (SPARK-25756) pyspark pandas_udf does not respect append outputMode in structured streaming

2018-10-17 Thread Jan Bols (JIRA)
Jan Bols created SPARK-25756: Summary: pyspark pandas_udf does not respect append outputMode in structured streaming Key: SPARK-25756 URL: https://issues.apache.org/jira/browse/SPARK-25756 Project: Spark

[jira] [Resolved] (SPARK-25754) Change CDN for MathJax

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25754. --- Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.4.0 2.

[jira] [Created] (SPARK-25757) Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

2018-10-17 Thread Zhu Lipeng (JIRA)
Zhu Lipeng created SPARK-25757: -- Summary: Upgrade netty-all from 4.1.17.Final to 4.1.30.Final Key: SPARK-25757 URL: https://issues.apache.org/jira/browse/SPARK-25757 Project: Spark Issue Type: D

[jira] [Commented] (SPARK-25757) Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

2018-10-17 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653460#comment-16653460 ] Zhu, Lipeng commented on SPARK-25757: - I am working on this. > Upgrade netty-all fr

[jira] [Updated] (SPARK-25757) Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25757: Affects Version/s: (was: 2.3.2) 3.0.0 > Upgrade netty-all from 4.1.17.F

[jira] [Updated] (SPARK-25757) Upgrade netty-all from 4.1.17.Final to 4.1.30.Final

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25757: Component/s: (was: Deploy) Build > Upgrade netty-all from 4.1.17.Final to 4.1

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Brian Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653595#comment-16653595 ] Brian Jones commented on SPARK-25739: - [~hyukjin.kwon] Correct.  However, we are not

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653599#comment-16653599 ] Hyukjin Kwon commented on SPARK-25739: -- New features are not ported for maintenance

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Brian Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653604#comment-16653604 ] Brian Jones commented on SPARK-25739: - [~hyukjin.kwon] Alright.  But then why is it

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653615#comment-16653615 ] Hyukjin Kwon commented on SPARK-25739: -- Oh you mean it does work at Spark 2.3.0 but

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653618#comment-16653618 ] Hyukjin Kwon commented on SPARK-25739: -- If so we should identify the patch introduc

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Brian Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653617#comment-16653617 ] Brian Jones commented on SPARK-25739: - [~hyukjin.kwon] Correct. The code I gave give

[jira] [Commented] (SPARK-25739) Double quote coming in as empty value even when emptyValue set as null

2018-10-17 Thread Brian Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653623#comment-16653623 ] Brian Jones commented on SPARK-25739: - [~hyukjin.kwon] Yes.  I agree, that is a bett

[jira] [Created] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-25758: --- Summary: Deprecate BisectingKMeans compute cost Key: SPARK-25758 URL: https://issues.apache.org/jira/browse/SPARK-25758 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653641#comment-16653641 ] Marco Gaido commented on SPARK-25758: - cc [~cloud_fan] [~srowen] [~holdenkarau]. Thi

[jira] [Updated] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25758: -- Priority: Minor (was: Major) (Not major). I agree with deprecating it. It does not need to block 2.4.

[jira] [Assigned] (SPARK-25741) Long URLs are not rendered properly in web UI

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25741: - Assignee: Gengliang Wang > Long URLs are not rendered properly in web UI >

[jira] [Resolved] (SPARK-25741) Long URLs are not rendered properly in web UI

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25741. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22744 [https://github.c

[jira] [Assigned] (SPARK-25735) Improve start-thriftserver.sh: print clean usage and exit with code 1

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25735: - Assignee: Gengliang Wang > Improve start-thriftserver.sh: print clean usage and exit with code

[jira] [Resolved] (SPARK-25735) Improve start-thriftserver.sh: print clean usage and exit with code 1

2018-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25735. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22727 [https://github.c

[jira] [Assigned] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25758: Assignee: (was: Apache Spark) > Deprecate BisectingKMeans compute cost >

[jira] [Commented] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653709#comment-16653709 ] Apache Spark commented on SPARK-25758: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-25758) Deprecate BisectingKMeans compute cost

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25758: Assignee: Apache Spark > Deprecate BisectingKMeans compute cost > ---

[jira] [Resolved] (SPARK-21402) Java encoders - switch fields on collectAsList

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21402. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22708 [https://gith

[jira] [Commented] (SPARK-20327) Add CLI support for YARN custom resources, like GPUs

2018-10-17 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653750#comment-16653750 ] Imran Rashid commented on SPARK-20327: -- https://github.com/apache/spark/pull/22751

[jira] [Assigned] (SPARK-21402) Java encoders - switch fields on collectAsList

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21402: --- Assignee: Vladimir Kuriatkov > Java encoders - switch fields on collectAsList > ---

[jira] [Updated] (SPARK-25759) StreamingListenerBus: Listener JavaStreamingListenerWrapper threw an exception

2018-10-17 Thread Parhy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parhy updated SPARK-25759: -- Affects Version/s: (was: 2.2.0) 2.2.1 > StreamingListenerBus: Listener JavaStreamin

[jira] [Created] (SPARK-25759) StreamingListenerBus: Listener JavaStreamingListenerWrapper threw an exception

2018-10-17 Thread Parhy (JIRA)
Parhy created SPARK-25759: - Summary: StreamingListenerBus: Listener JavaStreamingListenerWrapper threw an exception Key: SPARK-25759 URL: https://issues.apache.org/jira/browse/SPARK-25759 Project: Spark

[jira] [Commented] (SPARK-24601) Bump Jackson version to 2.9.6

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653772#comment-16653772 ] Apache Spark commented on SPARK-24601: -- User 'srowen' has created a pull request fo

[jira] [Commented] (SPARK-23015) spark-submit fails when submitting several jobs in parallel

2018-10-17 Thread Bansal, Parvesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654072#comment-16654072 ] Bansal, Parvesh commented on SPARK-23015: - Hi Hugh Zabriskie I was following th

[jira] [Commented] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654168#comment-16654168 ] Apache Spark commented on SPARK-25332: -- User 'sujith71955' has created a pull reque

[jira] [Assigned] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25332: Assignee: Apache Spark > Instead of broadcast hash join ,Sort merge join has selected wh

[jira] [Assigned] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25332: Assignee: (was: Apache Spark) > Instead of broadcast hash join ,Sort merge join has

[jira] [Commented] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654170#comment-16654170 ] Apache Spark commented on SPARK-25332: -- User 'sujith71955' has created a pull reque

[jira] [Commented] (SPARK-25751) Unit Testing for Kerberos Support for Spark on Kubernetes

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654312#comment-16654312 ] Apache Spark commented on SPARK-25751: -- User 'ifilonenko' has created a pull reques

[jira] [Assigned] (SPARK-25751) Unit Testing for Kerberos Support for Spark on Kubernetes

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25751: Assignee: Apache Spark > Unit Testing for Kerberos Support for Spark on Kubernetes >

[jira] [Assigned] (SPARK-25751) Unit Testing for Kerberos Support for Spark on Kubernetes

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25751: Assignee: (was: Apache Spark) > Unit Testing for Kerberos Support for Spark on Kubern

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-17 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654400#comment-16654400 ] Michael Heuer commented on SPARK-25588: --- [~Gengliang.Wang] The unit test provided

[jira] [Comment Edited] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-17 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654400#comment-16654400 ] Michael Heuer edited comment on SPARK-25588 at 10/17/18 11:55 PM:

[jira] [Comment Edited] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-17 Thread Michael Heuer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654400#comment-16654400 ] Michael Heuer edited comment on SPARK-25588 at 10/17/18 11:56 PM:

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-17 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654413#comment-16654413 ] Dongjoon Hyun commented on SPARK-23390: --- [~zsxwing], [~cloud_fan], and [~smilegato

[jira] [Assigned] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23390: --- Assignee: Dongjoon Hyun (was: Wenchen Fan) > Flaky test: FileBasedDataSourceSuite > --

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654417#comment-16654417 ] Xiao Li commented on SPARK-23390: - Thanks! > Flaky test: FileBasedDataSourceSuite > ---

[jira] [Created] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-25760: --- Summary: Set AddJarCommand return empty Key: SPARK-25760 URL: https://issues.apache.org/jira/browse/SPARK-25760 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25760: Description: {noformat} spark-sql> add jar /Users/yumwang/spark/sql/hive/src/test/resources/TestU

[jira] [Commented] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654437#comment-16654437 ] Apache Spark commented on SPARK-25760: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25760: Assignee: (was: Apache Spark) > Set AddJarCommand return empty >

[jira] [Assigned] (SPARK-25760) Set AddJarCommand return empty

2018-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25760: Assignee: Apache Spark > Set AddJarCommand return empty > --

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

2018-10-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654493#comment-16654493 ] Wenchen Fan commented on SPARK-25588: - sounds like the problem is caused by the parq

[jira] [Created] (SPARK-25761) sparksql执行sql语句的时候,sql语句已经执行成功,但是从sparkui上看该语句还是没有执行完成,还是running状态。

2018-10-17 Thread hanrentong (JIRA)
hanrentong created SPARK-25761: -- Summary: sparksql执行sql语句的时候,sql语句已经执行成功,但是从sparkui上看该语句还是没有执行完成,还是running状态。 Key: SPARK-25761 URL: https://issues.apache.org/jira/browse/SPARK-25761 Project: Spark

[jira] [Commented] (SPARK-25733) The method toLocalIterator() with dataframe doesn't work

2018-10-17 Thread Bihui Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654535#comment-16654535 ] Bihui Jin commented on SPARK-25733: --- Hi [~bryanc], This issue isn't a duplicate of SP

[jira] [Reopened] (SPARK-25733) The method toLocalIterator() with dataframe doesn't work

2018-10-17 Thread Bihui Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bihui Jin reopened SPARK-25733: --- This issue isn't a duplicate of SPARK-23961 In SPARK-23961, toLocalIterator() is working but throw an e

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2018-10-17 Thread Foster Langbein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654543#comment-16654543 ] Foster Langbein commented on SPARK-12312: - So I just ran into this issue now try

[jira] [Assigned] (SPARK-25003) Pyspark Does not use Spark Sql Extensions

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25003: Assignee: Russell Spitzer > Pyspark Does not use Spark Sql Extensions > -

[jira] [Resolved] (SPARK-25003) Pyspark Does not use Spark Sql Extensions

2018-10-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25003. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21990 [https://gi

[jira] [Commented] (SPARK-10816) EventTime based sessionization

2018-10-17 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654627#comment-16654627 ] Jungtaek Lim commented on SPARK-10816: -- Just ran another performance test to check

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

2018-10-17 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654627#comment-16654627 ] Jungtaek Lim edited comment on SPARK-10816 at 10/18/18 4:36 AM: --

[jira] [Commented] (SPARK-25761) sparksql执行sql语句的时候,sql语句已经执行成功,但是从sparkui上看该语句还是没有执行完成,还是running状态。

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654635#comment-16654635 ] Yuming Wang commented on SPARK-25761: - Could you translate to English and provide mo

[jira] [Created] (SPARK-25762) Upgrade guava version in spark dependency lists due to CVE issue

2018-10-17 Thread Debojyoti (JIRA)
Debojyoti created SPARK-25762: - Summary: Upgrade guava version in spark dependency lists due to CVE issue Key: SPARK-25762 URL: https://issues.apache.org/jira/browse/SPARK-25762 Project: Spark

[jira] [Updated] (SPARK-25740) Refactor DetermineTableStats to invalidate cache when some configuration changed

2018-10-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25740: Summary: Refactor DetermineTableStats to invalidate cache when some configuration changed (was: S

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK9+

2018-10-17 Thread Adrian Cole (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654705#comment-16654705 ] Adrian Cole commented on SPARK-24417: - yes please skip to 11 as in Zipkin we noticed