[jira] [Commented] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274058#comment-16274058 ] Wenchen Fan commented on SPARK-22472: - sounds good, thanks! > Datasets generate random values for

[jira] [Updated] (SPARK-22653) executorAddress registered in CoarseGrainedSchedulerBackend.executorDataMap is null

[ https://issues.apache.org/jira/browse/SPARK-22653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22653: Fix Version/s: (was: 2.2.1) 2.2.2 > executorAddress registered in

[jira] [Comment Edited] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274042#comment-16274042 ] Felix Cheung edited comment on SPARK-22472 at 12/1/17 7:09 AM: --- I guess

[jira] [Commented] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274042#comment-16274042 ] Felix Cheung commented on SPARK-22472: -- I guess it's too late to add to

[jira] [Assigned] (SPARK-22667) Fix model-specific optimization support for ML tuning: Python API

[ https://issues.apache.org/jira/browse/SPARK-22667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22667: Assignee: (was: Apache Spark) > Fix model-specific optimization support for ML

[jira] [Assigned] (SPARK-22667) Fix model-specific optimization support for ML tuning: Python API

[ https://issues.apache.org/jira/browse/SPARK-22667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22667: Assignee: Apache Spark > Fix model-specific optimization support for ML tuning: Python

[jira] [Commented] (SPARK-22667) Fix model-specific optimization support for ML tuning: Python API

[ https://issues.apache.org/jira/browse/SPARK-22667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274037#comment-16274037 ] Apache Spark commented on SPARK-22667: -- User 'WeichenXu123' has created a pull request for this

[jira] [Created] (SPARK-22667) Fix model-specific optimization support for ML tuning: Python API

Weichen Xu created SPARK-22667: -- Summary: Fix model-specific optimization support for ML tuning: Python API Key: SPARK-22667 URL: https://issues.apache.org/jira/browse/SPARK-22667 Project: Spark

[jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274029#comment-16274029 ] Felix Cheung commented on SPARK-22632: -- interesting re: timezone on macOS

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273985#comment-16273985 ] Saisai Shao commented on SPARK-22393: - Shall we wait for this before 2.2.1 is out? > spark-shell

[jira] [Updated] (SPARK-22653) executorAddress registered in CoarseGrainedSchedulerBackend.executorDataMap is null

[ https://issues.apache.org/jira/browse/SPARK-22653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22653: Fix Version/s: 2.2.1 > executorAddress registered in CoarseGrainedSchedulerBackend.executorDataMap

[jira] [Assigned] (SPARK-22653) executorAddress registered in CoarseGrainedSchedulerBackend.executorDataMap is null

[ https://issues.apache.org/jira/browse/SPARK-22653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22653: --- Assignee: Thomas Graves > executorAddress registered in

[jira] [Resolved] (SPARK-22653) executorAddress registered in CoarseGrainedSchedulerBackend.executorDataMap is null

[ https://issues.apache.org/jira/browse/SPARK-22653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22653. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19850

[jira] [Resolved] (SPARK-22373) Intermittent NullPointerException in org.codehaus.janino.IClass.isAssignableFrom

[ https://issues.apache.org/jira/browse/SPARK-22373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22373. --- Resolution: Fixed Fix Version/s: 2.1.3 2.3.0 2.2.2

[jira] [Assigned] (SPARK-22428) Document spark properties for configuring the ContextCleaner

[ https://issues.apache.org/jira/browse/SPARK-22428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22428: - Assignee: Gabor Somogyi > Document spark properties for configuring the ContextCleaner >

[jira] [Resolved] (SPARK-22428) Document spark properties for configuring the ContextCleaner

[ https://issues.apache.org/jira/browse/SPARK-22428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22428. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19826

[jira] [Commented] (SPARK-22587) Spark job fails if fs.defaultFS and application jar are different url

[ https://issues.apache.org/jira/browse/SPARK-22587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273745#comment-16273745 ] Mingjie Tang commented on SPARK-22587: -- we can update the compareFS by considering the authority.

[jira] [Resolved] (SPARK-22614) Expose range partitioning shuffle

[ https://issues.apache.org/jira/browse/SPARK-22614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22614. - Resolution: Fixed Assignee: Adrian Ionescu Fix Version/s: 2.3.0 > Expose range

[jira] [Updated] (SPARK-22489) Shouldn't change broadcast join buildSide if user clearly specified

[ https://issues.apache.org/jira/browse/SPARK-22489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22489: Labels: release-notes (was: ) > Shouldn't change broadcast join buildSide if user clearly specified >

[jira] [Resolved] (SPARK-22489) Shouldn't change broadcast join buildSide if user clearly specified

[ https://issues.apache.org/jira/browse/SPARK-22489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22489. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > Shouldn't change

[jira] [Commented] (SPARK-21795) Broadcast hint ignored when dataframe is cached

[ https://issues.apache.org/jira/browse/SPARK-21795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273642#comment-16273642 ] Anton commented on SPARK-21795: --- A simple example of when you would like to broadcast a cached dataframe is

[jira] [Assigned] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21417: --- Assignee: Anton Okolnychyi > Detect transitive join conditions via expressions >

[jira] [Resolved] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21417. - Resolution: Fixed Fix Version/s: 2.3.0 > Detect transitive join conditions via expressions >

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273575#comment-16273575 ] Timothy Hunter commented on SPARK-21866: [~josephkb] I have created a separate ticket to continue

[jira] [Created] (SPARK-22666) Spark reader source for image format

Timothy Hunter created SPARK-22666: -- Summary: Spark reader source for image format Key: SPARK-22666 URL: https://issues.apache.org/jira/browse/SPARK-22666 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273254#comment-16273254 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 7:36 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273254#comment-16273254 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 7:35 PM:

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273254#comment-16273254 ] Stavros Kontopoulos commented on SPARK-22657: - [~ste...@apache.org] so you mean create a

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273254#comment-16273254 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 7:35 PM:

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273191#comment-16273191 ] Steve Loughran commented on SPARK-22657: if you look at HADOOP-14138 you can see why we cut s3a

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273182#comment-16273182 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 7:02 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273182#comment-16273182 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 7:00 PM:

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273182#comment-16273182 ] Stavros Kontopoulos commented on SPARK-22657: - [~steve_l I guess it is possible to setup that

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273182#comment-16273182 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 6:59 PM:

[jira] [Assigned] (SPARK-22570) Create a lot of global variables to reuse an object in generated code

[ https://issues.apache.org/jira/browse/SPARK-22570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22570: --- Assignee: Kazuaki Ishizaki > Create a lot of global variables to reuse an object in

[jira] [Resolved] (SPARK-22570) Create a lot of global variables to reuse an object in generated code

[ https://issues.apache.org/jira/browse/SPARK-22570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22570. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19797

[jira] [Resolved] (SPARK-22507) Cannot register inner class with Kryo using SparkConf

[ https://issues.apache.org/jira/browse/SPARK-22507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22507. --- Resolution: Not A Problem > Cannot register inner class with Kryo using SparkConf >

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272974#comment-16272974 ] Steve Loughran commented on SPARK-22657: Hadoop FileSystem service introspection for FS binding

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 5:03 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 5:02 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 5:02 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 5:01 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 5:00 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 4:58 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 4:41 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 4:41 PM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 4:41 PM:

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272906#comment-16272906 ] Stavros Kontopoulos commented on SPARK-22657: - The bug is not about s3n not working. Its

[jira] [Resolved] (SPARK-22635) FileNotFoundException again while reading ORC files containing special characters

[ https://issues.apache.org/jira/browse/SPARK-22635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22635. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19844

[jira] [Assigned] (SPARK-22635) FileNotFoundException again while reading ORC files containing special characters

[ https://issues.apache.org/jira/browse/SPARK-22635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22635: Assignee: Marco Gaido > FileNotFoundException again while reading ORC files containing

[jira] [Resolved] (SPARK-22654) Retry download of Spark from ASF mirror in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-22654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22654. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull

[jira] [Commented] (SPARK-22507) Cannot register inner class with Kryo using SparkConf

[ https://issues.apache.org/jira/browse/SPARK-22507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272847#comment-16272847 ] Yu LIU commented on SPARK-22507: Hi [~gsomogyi], I'm really sorry that I didn't update for this issue. In

[jira] [Commented] (SPARK-22507) Cannot register inner class with Kryo using SparkConf

[ https://issues.apache.org/jira/browse/SPARK-22507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272833#comment-16272833 ] Gabor Somogyi commented on SPARK-22507: --- I would like to solve this ticket. Please notify me if

[jira] [Commented] (SPARK-22665) Dataset API: .repartition() inconsistency / issue

[ https://issues.apache.org/jira/browse/SPARK-22665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272802#comment-16272802 ] Adrian Ionescu commented on SPARK-22665: {code} scala>

[jira] [Created] (SPARK-22665) Dataset API: .repartition() inconsistency / issue

Adrian Ionescu created SPARK-22665: -- Summary: Dataset API: .repartition() inconsistency / issue Key: SPARK-22665 URL: https://issues.apache.org/jira/browse/SPARK-22665 Project: Spark Issue

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272682#comment-16272682 ] Sean Owen commented on SPARK-22657: --- I don't think users would expect to be able to use a custom file

[jira] [Resolved] (SPARK-22663) Spark DataSet to case class mapping mismatches

[ https://issues.apache.org/jira/browse/SPARK-22663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22663. --- Resolution: Not A Problem This is not a bug. The input you're converting to your class doesn't even

[jira] [Updated] (SPARK-22664) The logs about "Connected to Zookeeper" in ReliableKafkaReceiver.scala are in wrong position

[ https://issues.apache.org/jira/browse/SPARK-22664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22664: -- Priority: Trivial (was: Major) Issue Type: Improvement (was: Bug) This isn't a bug, and

[jira] [Updated] (SPARK-22626) Wrong Hive table statistics may trigger OOM if enables CBO

[ https://issues.apache.org/jira/browse/SPARK-22626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22626: Description: How to reproduce: {code} bin/spark-shell --conf spark.sql.cbo.enabled=true {code}

[jira] [Updated] (SPARK-22626) Wrong Hive table statistics may trigger OOM if enables CBO

[ https://issues.apache.org/jira/browse/SPARK-22626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22626: Summary: Wrong Hive table statistics may trigger OOM if enables CBO (was: Wrong Hive table

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272532#comment-16272532 ] Stavros Kontopoulos commented on SPARK-22657: - [~susanxhuynh] [~arand] fyi > Hadoop fs

[jira] [Commented] (SPARK-22664) The logs about "Connected to Zookeeper" in ReliableKafkaReceiver.scala are in wrong position

[ https://issues.apache.org/jira/browse/SPARK-22664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272529#comment-16272529 ] Apache Spark commented on SPARK-22664: -- User 'liu-zhaokun' has created a pull request for this

[jira] [Assigned] (SPARK-22664) The logs about "Connected to Zookeeper" in ReliableKafkaReceiver.scala are in wrong position

[ https://issues.apache.org/jira/browse/SPARK-22664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22664: Assignee: (was: Apache Spark) > The logs about "Connected to Zookeeper" in

[jira] [Assigned] (SPARK-22664) The logs about "Connected to Zookeeper" in ReliableKafkaReceiver.scala are in wrong position

[ https://issues.apache.org/jira/browse/SPARK-22664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22664: Assignee: Apache Spark > The logs about "Connected to Zookeeper" in

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 11:05 AM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 11:05 AM:

[jira] [Created] (SPARK-22664) The logs about "Connected to Zookeeper" in ReliableKafkaReceiver.scala are in wrong position

liuzhaokun created SPARK-22664: -- Summary: The logs about "Connected to Zookeeper" in ReliableKafkaReceiver.scala are in wrong position Key: SPARK-22664 URL: https://issues.apache.org/jira/browse/SPARK-22664

[jira] [Resolved] (SPARK-22643) ColumnarArray should be an immutable view

[ https://issues.apache.org/jira/browse/SPARK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22643. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19842

[jira] [Resolved] (SPARK-22652) remove set methods in ColumnarRow

[ https://issues.apache.org/jira/browse/SPARK-22652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22652. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19847

[jira] [Updated] (SPARK-22663) Spark DataSet to case class mapping mismatches

[ https://issues.apache.org/jira/browse/SPARK-22663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajeev Ramakrishnan updated SPARK-22663: Description: Dear Team, As of now when we create a Dataset from a datasource, we

[jira] [Updated] (SPARK-22663) Spark DataSet to case class mapping mismatches

[ https://issues.apache.org/jira/browse/SPARK-22663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajeev Ramakrishnan updated SPARK-22663: Description: Dear Team, As of now when we create a Dataset from a datasource, we

[jira] [Updated] (SPARK-22663) Spark DataSet to case class mapping mismatches

[ https://issues.apache.org/jira/browse/SPARK-22663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sajeev Ramakrishnan updated SPARK-22663: Description: Dear Team, As of now when we create a Dataset from a datasource, we

[jira] [Created] (SPARK-22663) Spark DataSet to case class mapping mismatches

Sajeev Ramakrishnan created SPARK-22663: --- Summary: Spark DataSet to case class mapping mismatches Key: SPARK-22663 URL: https://issues.apache.org/jira/browse/SPARK-22663 Project: Spark

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 9:53 AM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 9:53 AM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 9:52 AM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 9:51 AM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 9:50 AM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 9:49 AM:

[jira] [Comment Edited] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos edited comment on SPARK-22657 at 11/30/17 9:48 AM:

[jira] [Commented] (SPARK-22657) Hadoop fs implementation classes are not loaded if they are part of the app jar or other jar when --packages flag is used

[ https://issues.apache.org/jira/browse/SPARK-22657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272444#comment-16272444 ] Stavros Kontopoulos commented on SPARK-22657: - [~srowen]This came up in the tests we are

[jira] [Assigned] (SPARK-22662) Failed to prune columns after rewriting predicate subquery

[ https://issues.apache.org/jira/browse/SPARK-22662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22662: Assignee: Apache Spark > Failed to prune columns after rewriting predicate subquery >

[jira] [Commented] (SPARK-22662) Failed to prune columns after rewriting predicate subquery

[ https://issues.apache.org/jira/browse/SPARK-22662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272404#comment-16272404 ] Apache Spark commented on SPARK-22662: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22662) Failed to prune columns after rewriting predicate subquery

[ https://issues.apache.org/jira/browse/SPARK-22662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22662: Assignee: (was: Apache Spark) > Failed to prune columns after rewriting predicate

[jira] [Created] (SPARK-22662) Failed to prune columns after rewriting predicate subquery

Zhenhua Wang created SPARK-22662: Summary: Failed to prune columns after rewriting predicate subquery Key: SPARK-22662 URL: https://issues.apache.org/jira/browse/SPARK-22662 Project: Spark

[jira] [Commented] (SPARK-22660) Compile with scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272389#comment-16272389 ] liyunzhang commented on SPARK-22660: change java.version to 9 in the pom.xml to build , luckily there

[jira] [Commented] (SPARK-22660) Compile with scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272382#comment-16272382 ] Sean Owen commented on SPARK-22660: --- It just means you're cross-compiling for Java 8 using Java 9. I

[jira] [Commented] (SPARK-22660) Compile with scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272368#comment-16272368 ] liyunzhang commented on SPARK-22660: [~srowen]: one thing is very confused, I don't change the

[jira] [Updated] (SPARK-22660) Compile with scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang updated SPARK-22660: --- Description: build with scala-2.12 with following steps 1. change the pom.xml with scala-2.12

[jira] [Commented] (SPARK-22660) Compile with scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272344#comment-16272344 ] liyunzhang commented on SPARK-22660: ok, will put all the modifications about scala-2.12 and

[jira] [Updated] (SPARK-22660) Compile with scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang updated SPARK-22660: --- Description: build with scala-2.12 with following steps 1. change the pom.xml with scala-2.12

[jira] [Updated] (SPARK-22660) Compile with scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang updated SPARK-22660: --- Summary: Compile with scala-2.12 and JDK9 (was: Use position() and limit() to fix ambiguity issue

[jira] [Resolved] (SPARK-22659) remove sun.misc.Cleaner references

[ https://issues.apache.org/jira/browse/SPARK-22659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22659. --- Resolution: Invalid I'm not sure what this is now, as it changed again, but, the change you

[jira] [Commented] (SPARK-22660) Use position() and limit() to fix ambiguity issue in scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272316#comment-16272316 ] Apache Spark commented on SPARK-22660: -- User 'kellyzly' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22660) Use position() and limit() to fix ambiguity issue in scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22660: Assignee: Apache Spark > Use position() and limit() to fix ambiguity issue in scala-2.12

[jira] [Assigned] (SPARK-22660) Use position() and limit() to fix ambiguity issue in scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22660: Assignee: (was: Apache Spark) > Use position() and limit() to fix ambiguity issue in

[jira] [Resolved] (SPARK-22661) Fix the putAll compile error when compiling with scala-2.12 and jdk9

[ https://issues.apache.org/jira/browse/SPARK-22661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22661. --- Resolution: Duplicate Use one JIRA for these 'ambiguous overload' issues. The key type is Object,

[jira] [Updated] (SPARK-22660) Use position() and limit() to fix ambiguity issue in scala-2.12 and JDK9

[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22660: -- Priority: Minor (was: Major) You don't need reflective calls here; typically you just need a cast.

[jira] [Created] (SPARK-22661) Fix the putAll compile error when compiling with scala-2.12 and jdk9

liyunzhang created SPARK-22661: -- Summary: Fix the putAll compile error when compiling with scala-2.12 and jdk9 Key: SPARK-22661 URL: https://issues.apache.org/jira/browse/SPARK-22661 Project: Spark