[jira] [Commented] (SPARK-22676) Avoid iterating all partition paths when spark.sql.hive.verifyPartitionPath=true

2017-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275840#comment-16275840 ] Apache Spark commented on SPARK-22676: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22676) Avoid iterating all partition paths when spark.sql.hive.verifyPartitionPath=true

2017-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22676: Assignee: Apache Spark > Avoid iterating all partition paths when >

[jira] [Assigned] (SPARK-22676) Avoid iterating all partition paths when spark.sql.hive.verifyPartitionPath=true

2017-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22676: Assignee: (was: Apache Spark) > Avoid iterating all partition paths when >

[jira] [Created] (SPARK-22676) Avoid iterating all partition paths when spark.sql.hive.verifyPartitionPath=true

2017-12-02 Thread jin xing (JIRA)
jin xing created SPARK-22676: Summary: Avoid iterating all partition paths when spark.sql.hive.verifyPartitionPath=true Key: SPARK-22676 URL: https://issues.apache.org/jira/browse/SPARK-22676 Project:

[jira] [Comment Edited] (SPARK-22136) Implement stream-stream outer joins in append mode

2017-12-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275839#comment-16275839 ] Dongjoon Hyun edited comment on SPARK-22136 at 12/3/17 6:53 AM: [~tdas].

[jira] [Commented] (SPARK-22136) Implement stream-stream outer joins in append mode

2017-12-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275839#comment-16275839 ] Dongjoon Hyun commented on SPARK-22136: --- Like inner join, I updated `Fixed Version` from 3.0 to 2.3

[jira] [Updated] (SPARK-22136) Implement stream-stream outer joins in append mode

2017-12-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22136: -- Fix Version/s: (was: 3.0.0) 2.3.0 > Implement stream-stream outer joins

[jira] [Commented] (SPARK-22053) Implement stream-stream inner join in Append mode

2017-12-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275838#comment-16275838 ] Dongjoon Hyun commented on SPARK-22053: --- Hi, [~tdas]. I updated `Fixed Version` from 3.0 to 2.3

[jira] [Updated] (SPARK-22053) Implement stream-stream inner join in Append mode

2017-12-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22053: -- Fix Version/s: (was: 3.0.0) 2.3.0 > Implement stream-stream inner join

[jira] [Assigned] (SPARK-22675) Deduplicate PropagateTypes in TypeCoercion

2017-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22675: Assignee: Apache Spark (was: Xiao Li) > Deduplicate PropagateTypes in TypeCoercion >

[jira] [Assigned] (SPARK-22675) Deduplicate PropagateTypes in TypeCoercion

2017-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22675: Assignee: Xiao Li (was: Apache Spark) > Deduplicate PropagateTypes in TypeCoercion >

[jira] [Commented] (SPARK-22675) Deduplicate PropagateTypes in TypeCoercion

2017-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275832#comment-16275832 ] Apache Spark commented on SPARK-22675: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-22675) Deduplicate PropagateTypes in TypeCoercion

2017-12-02 Thread Xiao Li (JIRA)
Xiao Li created SPARK-22675: --- Summary: Deduplicate PropagateTypes in TypeCoercion Key: SPARK-22675 URL: https://issues.apache.org/jira/browse/SPARK-22675 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-22674) PySpark breaks serialization of namedtuple subclasses

2017-12-02 Thread Jonas Amrich (JIRA)
Jonas Amrich created SPARK-22674: Summary: PySpark breaks serialization of namedtuple subclasses Key: SPARK-22674 URL: https://issues.apache.org/jira/browse/SPARK-22674 Project: Spark Issue

[jira] [Commented] (SPARK-8418) Add single- and multi-value support to ML Transformers

2017-12-02 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275723#comment-16275723 ] yuhao yang commented on SPARK-8418: --- second Nick's comments. > Add single- and multi-value support to

[jira] [Resolved] (SPARK-22636) row count not being set correctly (always 0) after Statement.executeUpdate()

2017-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22636. --- Resolution: Not A Problem > row count not being set correctly (always 0) after

[jira] [Assigned] (SPARK-22634) Update Bouncy castle dependency

2017-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22634: - Assignee: Sean Owen > Update Bouncy castle dependency > --- > >

[jira] [Resolved] (SPARK-22634) Update Bouncy castle dependency

2017-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22634. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19859

[jira] [Commented] (SPARK-22629) incorrect handling of calls to random in UDFs

2017-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275553#comment-16275553 ] Sean Owen commented on SPARK-22629: --- That case is a better question and I'm not sure, actually, whether

[jira] [Commented] (SPARK-22373) Intermittent NullPointerException in org.codehaus.janino.IClass.isAssignableFrom

2017-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275526#comment-16275526 ] Apache Spark commented on SPARK-22373: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

2017-12-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22146: - Fix Version/s: (was: 2.2.2) 2.2.1 > FileNotFoundException while reading

[jira] [Updated] (SPARK-22670) Not able to create table in HIve with SparkSession when JavaSparkContext is already initialized.

2017-12-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22670: - Priority: Major (was: Blocker) > Not able to create table in HIve with SparkSession when

[jira] [Updated] (SPARK-22670) Not able to create table in HIve with SparkSession when JavaSparkContext is already initialized.

2017-12-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22670: - Fix Version/s: (was: 2.1.1) > Not able to create table in HIve with SparkSession when

[jira] [Updated] (SPARK-22670) Not able to create table in HIve with SparkSession when JavaSparkContext is already initialized.

2017-12-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22670: - Component/s: (was: Spark Core) SQL > Not able to create table in HIve with

[jira] [Updated] (SPARK-22670) Not able to create table in HIve with SparkSession when JavaSparkContext is already initialized.

2017-12-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22670: - Target Version/s: (was: 2.1.1) > Not able to create table in HIve with SparkSession when

[jira] [Commented] (SPARK-22670) Not able to create table in HIve with SparkSession when JavaSparkContext is already initialized.

2017-12-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275504#comment-16275504 ] Hyukjin Kwon commented on SPARK-22670: -- Don't set blocker, target version and fixed version BTW.

[jira] [Updated] (SPARK-20201) Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSuite

2017-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20201: - Target Version/s: (was: 2.2.1) > Flaky Test: