[jira] [Commented] (SPARK-22337) new pyspark release

2017-10-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216265#comment-16216265 ] Hyukjin Kwon commented on SPARK-22337: -- [~papachoco], I think you can use the newer py4j if

[jira] [Resolved] (SPARK-22337) new pyspark release

2017-10-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22337. -- Resolution: Duplicate > new pyspark release > --- > > Key:

[jira] [Assigned] (SPARK-22313) Mark/print deprecation warnings as DeprecationWarning for deprecated APIs

2017-10-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22313: Assignee: Hyukjin Kwon > Mark/print deprecation warnings as DeprecationWarning for

[jira] [Resolved] (SPARK-22313) Mark/print deprecation warnings as DeprecationWarning for deprecated APIs

2017-10-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22313. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19535

[jira] [Comment Edited] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216248#comment-16216248 ] Liang-Chi Hsieh edited comment on SPARK-22335 at 10/24/17 3:36 AM: ---

[jira] [Commented] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216248#comment-16216248 ] Liang-Chi Hsieh commented on SPARK-22335: - Can't {{unionByName}} solve it? {code] scala>

[jira] [Commented] (SPARK-22337) new pyspark release

2017-10-23 Thread Carlos Sanchez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216231#comment-16216231 ] Carlos Sanchez commented on SPARK-22337: I have some java/python code that was running into

[jira] [Commented] (SPARK-22331) Make MLlib string params case-insensitive

2017-10-23 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216224#comment-16216224 ] Weichen Xu commented on SPARK-22331: OK, it seems not breaking current code in spark, but it is

[jira] [Created] (SPARK-22340) pyspark setJobGroup doesn't match java threads

2017-10-23 Thread Leif Walsh (JIRA)
Leif Walsh created SPARK-22340: -- Summary: pyspark setJobGroup doesn't match java threads Key: SPARK-22340 URL: https://issues.apache.org/jira/browse/SPARK-22340 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-21929) Support `ALTER TABLE table_name ADD COLUMNS(..)` for ORC data source

2017-10-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21929. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 > Support `ALTER TABLE

[jira] [Updated] (SPARK-22324) Upgrade Arrow to version 0.8.0

2017-10-23 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-22324: - Description: Arrow version 0.8.0 is slated for release in early November, but I'd like to start

[jira] [Updated] (SPARK-22339) Push epoch updates to executors on fetch failure to avoid fetch retries for missing executors

2017-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-22339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Rodríguez Hortalá updated SPARK-22339: --- Attachment: push_epoch_update-WIP.diff > Push epoch updates to executors on

[jira] [Created] (SPARK-22339) Push epoch updates to executors on fetch failure to avoid fetch retries for missing executors

2017-10-23 Thread JIRA
Juan Rodríguez Hortalá created SPARK-22339: -- Summary: Push epoch updates to executors on fetch failure to avoid fetch retries for missing executors Key: SPARK-22339 URL:

[jira] [Commented] (SPARK-22323) Design doc for different types of pandas_udf

2017-10-23 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216011#comment-16216011 ] Li Jin commented on SPARK-22323: [~bryanc], this is not meant to be a user doc. I think the user doc

[jira] [Updated] (SPARK-22337) new pyspark release

2017-10-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22337: -- Target Version/s: (was: 2.2.0) Labels: (was: patch) Can you say why that would help?

[jira] [Updated] (SPARK-22338) namedtuple serialization is inefficient

2017-10-23 Thread Joel Croteau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Croteau updated SPARK-22338: - Description: I greatly appreciate the level of hack that PySpark contains in order to make

[jira] [Created] (SPARK-22338) namedtuple serialization is inefficient

2017-10-23 Thread Joel Croteau (JIRA)
Joel Croteau created SPARK-22338: Summary: namedtuple serialization is inefficient Key: SPARK-22338 URL: https://issues.apache.org/jira/browse/SPARK-22338 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-22285) Change implementation of ApproxCountDistinctForIntervals to TypedImperativeAggregate

2017-10-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22285: --- Assignee: Zhenhua Wang > Change implementation of ApproxCountDistinctForIntervals to >

[jira] [Updated] (SPARK-20928) SPIP: Continuous Processing Mode for Structured Streaming

2017-10-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-20928: Attachment: Continuous Processing in Structured Streaming Design Sketch.pdf > SPIP: Continuous

[jira] [Updated] (SPARK-20928) SPIP: Continuous Processing Mode for Structured Streaming

2017-10-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-20928: Attachment: (was: Continuous Processing in Structured Streaming Design Sketch.pdf) > SPIP:

[jira] [Resolved] (SPARK-22285) Change implementation of ApproxCountDistinctForIntervals to TypedImperativeAggregate

2017-10-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22285. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19506

[jira] [Commented] (SPARK-22209) PySpark does not recognize imports from submodules

2017-10-23 Thread Joel Croteau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215922#comment-16215922 ] Joel Croteau commented on SPARK-22209: -- I don't really have time to look for the exact cause, so if

[jira] [Commented] (SPARK-21912) ORC/Parquet table should not create invalid column names

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215896#comment-16215896 ] Apache Spark commented on SPARK-21912: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-22337) new pyspark release

2017-10-23 Thread Carlos Sanchez (JIRA)
Carlos Sanchez created SPARK-22337: -- Summary: new pyspark release Key: SPARK-22337 URL: https://issues.apache.org/jira/browse/SPARK-22337 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-20928) SPIP: Continuous Processing Mode for Structured Streaming

2017-10-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-20928: Summary: SPIP: Continuous Processing Mode for Structured Streaming (was: Continuous Processing

[jira] [Updated] (SPARK-20928) Continuous Processing Mode for Structured Streaming

2017-10-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-20928: Attachment: Continuous Processing in Structured Streaming Design Sketch.pdf > Continuous

[jira] [Resolved] (SPARK-22312) Spark job stuck with no executor due to bug in Executor Allocation Manager

2017-10-23 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22312. Resolution: Duplicate > Spark job stuck with no executor due to bug in Executor Allocation

[jira] [Assigned] (SPARK-22322) Update FutureAction for compatibility with Scala 2.12 future

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22322: Assignee: Sean Owen (was: Apache Spark) > Update FutureAction for compatibility with

[jira] [Commented] (SPARK-22322) Update FutureAction for compatibility with Scala 2.12 future

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215511#comment-16215511 ] Apache Spark commented on SPARK-22322: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22322) Update FutureAction for compatibility with Scala 2.12 future

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22322: Assignee: Apache Spark (was: Sean Owen) > Update FutureAction for compatibility with

[jira] [Commented] (SPARK-22331) Make MLlib string params case-insensitive

2017-10-23 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215489#comment-16215489 ] yuhao yang commented on SPARK-22331: Yes, I don't see the change will break any existing code. >

[jira] [Updated] (SPARK-15348) Hive ACID

2017-10-23 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15348: -- Component/s: SQL > Hive ACID > - > > Key: SPARK-15348 >

[jira] [Updated] (SPARK-15348) Hive ACID

2017-10-23 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15348: -- Affects Version/s: 1.6.3 2.0.2 2.1.2

[jira] [Resolved] (SPARK-22303) [SQL] Getting java.sql.SQLException: Unsupported type 101 for BINARY_DOUBLE

2017-10-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22303. - Resolution: Fixed Assignee: Kohki Nishio Fix Version/s: 2.3.0 > [SQL] Getting

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-22335: -- Description: I see union uses column order for a DF. This to me is "fine" since they

[jira] [Updated] (SPARK-22336) When spark-submit cluster mode is run from a Mesos task, the job fails

2017-10-23 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Susan X. Huynh updated SPARK-22336: --- Description: In Mesos cluster mode, spark-submit passes all local MESOS_xxx env vars to the

[jira] [Created] (SPARK-22336) When spark-submit cluster mode is run from a Mesos task, the job fails

2017-10-23 Thread Susan X. Huynh (JIRA)
Susan X. Huynh created SPARK-22336: -- Summary: When spark-submit cluster mode is run from a Mesos task, the job fails Key: SPARK-22336 URL: https://issues.apache.org/jira/browse/SPARK-22336 Project:

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-22335: -- Priority: Major (was: Minor) > Union for DataSet uses column order instead of types

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-22335: -- Description: I see union uses column order for a DF. This to me is "fine" since they

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-22335: -- Description: I see union uses column order for a DF. This to me is "fine" since they

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-22335: -- Description: I see union uses column order for a DF. This to me is "fine" since they

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-22335: -- Description: I see union uses column order for a DF. This to me is "fine" since they

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-22335: -- Description: I see union uses column order for a DF. This to me is "fine" since they

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-22335: -- Description: I see union uses column order for a DF. This to me is "fine" since they

[jira] [Created] (SPARK-22335) Union for DataSet uses column order instead of types for union

2017-10-23 Thread Carlos Bribiescas (JIRA)
Carlos Bribiescas created SPARK-22335: - Summary: Union for DataSet uses column order instead of types for union Key: SPARK-22335 URL: https://issues.apache.org/jira/browse/SPARK-22335 Project:

[jira] [Issue Comment Deleted] (SPARK-20761) Union uses column order rather than schema

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Bribiescas updated SPARK-20761: -- Comment: was deleted (was: This isn't quite the issue I'm facing, but solving this

[jira] [Comment Edited] (SPARK-20761) Union uses column order rather than schema

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215282#comment-16215282 ] Carlos Bribiescas edited comment on SPARK-20761 at 10/23/17 3:18 PM: -

[jira] [Comment Edited] (SPARK-20761) Union uses column order rather than schema

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215282#comment-16215282 ] Carlos Bribiescas edited comment on SPARK-20761 at 10/23/17 3:18 PM: -

[jira] [Comment Edited] (SPARK-20761) Union uses column order rather than schema

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215282#comment-16215282 ] Carlos Bribiescas edited comment on SPARK-20761 at 10/23/17 3:17 PM: -

[jira] [Comment Edited] (SPARK-20761) Union uses column order rather than schema

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215282#comment-16215282 ] Carlos Bribiescas edited comment on SPARK-20761 at 10/23/17 3:17 PM: -

[jira] [Comment Edited] (SPARK-20761) Union uses column order rather than schema

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215282#comment-16215282 ] Carlos Bribiescas edited comment on SPARK-20761 at 10/23/17 3:16 PM: -

[jira] [Comment Edited] (SPARK-20761) Union uses column order rather than schema

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215282#comment-16215282 ] Carlos Bribiescas edited comment on SPARK-20761 at 10/23/17 3:15 PM: -

[jira] [Commented] (SPARK-20761) Union uses column order rather than schema

2017-10-23 Thread Carlos Bribiescas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215282#comment-16215282 ] Carlos Bribiescas commented on SPARK-20761: --- This isn't quite the issue I'm facing, but solving

[jira] [Commented] (SPARK-22334) Check table size from HDFS in case the size in metastore is wrong.

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215107#comment-16215107 ] Apache Spark commented on SPARK-22334: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22334) Check table size from HDFS in case the size in metastore is wrong.

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22334: Assignee: Apache Spark > Check table size from HDFS in case the size in metastore is

[jira] [Assigned] (SPARK-22334) Check table size from HDFS in case the size in metastore is wrong.

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22334: Assignee: (was: Apache Spark) > Check table size from HDFS in case the size in

[jira] [Updated] (SPARK-22334) Check table size from HDFS in case the size in metastore is wrong.

2017-10-23 Thread jin xing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated SPARK-22334: - Summary: Check table size from HDFS in case the size in metastore is wrong. (was: Check table size from

[jira] [Created] (SPARK-22334) Check table size from Hdfs in case the size in metastore is wrong.

2017-10-23 Thread jin xing (JIRA)
jin xing created SPARK-22334: Summary: Check table size from Hdfs in case the size in metastore is wrong. Key: SPARK-22334 URL: https://issues.apache.org/jira/browse/SPARK-22334 Project: Spark

[jira] [Commented] (SPARK-22333) ColumnReference should get higher priority than timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP)

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214999#comment-16214999 ] Apache Spark commented on SPARK-22333: -- User 'DonnyZone' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22333) ColumnReference should get higher priority than timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP)

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22333: Assignee: Apache Spark > ColumnReference should get higher priority than >

[jira] [Assigned] (SPARK-22333) ColumnReference should get higher priority than timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP)

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22333: Assignee: (was: Apache Spark) > ColumnReference should get higher priority than >

[jira] [Updated] (SPARK-22333) ColumnReference should get higher priority than timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP)

2017-10-23 Thread Feng Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Zhu updated SPARK-22333: - Affects Version/s: (was: 2.0.2) (was: 2.0.1)

[jira] [Created] (SPARK-22333) ColumnReference should get higher priority than timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP)

2017-10-23 Thread Feng Zhu (JIRA)
Feng Zhu created SPARK-22333: Summary: ColumnReference should get higher priority than timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP) Key: SPARK-22333 URL: https://issues.apache.org/jira/browse/SPARK-22333

[jira] [Updated] (SPARK-22332) NaiveBayes unit test occasionly fail

2017-10-23 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-22332: --- Labels: test (was: ) > NaiveBayes unit test occasionly fail >

[jira] [Commented] (SPARK-22332) NaiveBayes unit test occasionly fail

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214959#comment-16214959 ] Apache Spark commented on SPARK-22332: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-22332) NaiveBayes unit test occasionly fail

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22332: Assignee: (was: Apache Spark) > NaiveBayes unit test occasionly fail >

[jira] [Assigned] (SPARK-22332) NaiveBayes unit test occasionly fail

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22332: Assignee: Apache Spark > NaiveBayes unit test occasionly fail >

[jira] [Created] (SPARK-22332) NaiveBayes unit test occasionly fail

2017-10-23 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-22332: -- Summary: NaiveBayes unit test occasionly fail Key: SPARK-22332 URL: https://issues.apache.org/jira/browse/SPARK-22332 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-21136) Misleading error message for typo in SQL

2017-10-23 Thread Vitaly Gerasimov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214909#comment-16214909 ] Vitaly Gerasimov edited comment on SPARK-21136 at 10/23/17 10:17 AM: -

[jira] [Comment Edited] (SPARK-21136) Misleading error message for typo in SQL

2017-10-23 Thread Vitaly Gerasimov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214909#comment-16214909 ] Vitaly Gerasimov edited comment on SPARK-21136 at 10/23/17 10:16 AM: -

[jira] [Comment Edited] (SPARK-21136) Misleading error message for typo in SQL

2017-10-23 Thread Vitaly Gerasimov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214909#comment-16214909 ] Vitaly Gerasimov edited comment on SPARK-21136 at 10/23/17 9:59 AM:

[jira] [Commented] (SPARK-21136) Misleading error message for typo in SQL

2017-10-23 Thread Vitaly Gerasimov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214909#comment-16214909 ] Vitaly Gerasimov commented on SPARK-21136: -- Same problem: {code} sql.sql("select * from test

[jira] [Updated] (SPARK-22331) Make MLlib string params case-insensitive

2017-10-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22331: -- Summary: Make MLlib string params case-insensitive (was: Strength consistency for supporting string

[jira] [Resolved] (SPARK-21439) Cannot use Spark with Python ABCmeta (exception from cloudpickle)

2017-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński resolved SPARK-21439. Resolution: Duplicate Fix Version/s: 2.3.0 > Cannot use Spark with Python ABCmeta

[jira] [Commented] (SPARK-21439) Cannot use Spark with Python ABCmeta (exception from cloudpickle)

2017-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-21439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214830#comment-16214830 ] Maciej Bryński commented on SPARK-21439: Resolved in

[jira] [Commented] (SPARK-19606) Support constraints in spark-dispatcher

2017-10-23 Thread Pascal GILLET (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214817#comment-16214817 ] Pascal GILLET commented on SPARK-19606: --- +1 That escalated quickly :) > Support constraints in

[jira] [Commented] (SPARK-22331) Strength consistency for supporting string params: case-insensitive or not

2017-10-23 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214813#comment-16214813 ] Weichen Xu commented on SPARK-22331: I checked, `ParamValidator.inArray` used in many places, these

[jira] [Comment Edited] (SPARK-22281) Handle R method breaking signature changes

2017-10-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214751#comment-16214751 ] Felix Cheung edited comment on SPARK-22281 at 10/23/17 7:30 AM: ok, I

[jira] [Commented] (SPARK-22281) Handle R method breaking signature changes

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214760#comment-16214760 ] Apache Spark commented on SPARK-22281: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-22281) Handle R method breaking signature changes

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22281: Assignee: Apache Spark > Handle R method breaking signature changes >

[jira] [Assigned] (SPARK-22281) Handle R method breaking signature changes

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22281: Assignee: (was: Apache Spark) > Handle R method breaking signature changes >

[jira] [Assigned] (SPARK-22328) ClosureCleaner misses referenced superclass fields, gives them null values

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22328: Assignee: (was: Apache Spark) > ClosureCleaner misses referenced superclass fields,

[jira] [Commented] (SPARK-22328) ClosureCleaner misses referenced superclass fields, gives them null values

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214755#comment-16214755 ] Apache Spark commented on SPARK-22328: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22328) ClosureCleaner misses referenced superclass fields, gives them null values

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22328: Assignee: Apache Spark > ClosureCleaner misses referenced superclass fields, gives them

[jira] [Assigned] (SPARK-22133) Document Mesos reject offer duration configutations

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22133: Assignee: Apache Spark > Document Mesos reject offer duration configutations >

[jira] [Commented] (SPARK-22133) Document Mesos reject offer duration configutations

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214754#comment-16214754 ] Apache Spark commented on SPARK-22133: -- User 'windkit' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22133) Document Mesos reject offer duration configutations

2017-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22133: Assignee: (was: Apache Spark) > Document Mesos reject offer duration configutations >

[jira] [Comment Edited] (SPARK-22281) Handle R method breaking signature changes

2017-10-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214751#comment-16214751 ] Felix Cheung edited comment on SPARK-22281 at 10/23/17 7:10 AM: ok, I

[jira] [Commented] (SPARK-22281) Handle R method breaking signature changes

2017-10-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214751#comment-16214751 ] Felix Cheung commented on SPARK-22281: -- ok, I have a solution for both. it turns out the fix for glm

[jira] [Commented] (SPARK-22331) Strength consistency for supporting string params: case-insensitive or not

2017-10-23 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214747#comment-16214747 ] Nick Pentreath commented on SPARK-22331: I can't think of any examples offhand where case

[jira] [Updated] (SPARK-22281) Handle R method breaking signature changes

2017-10-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22281: - Description: cAs discussed here

[jira] [Commented] (SPARK-22331) Strength consistency for supporting string params: case-insensitive or not

2017-10-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214742#comment-16214742 ] Sean Owen commented on SPARK-22331: --- Is this about changing case sensitivity? Which ones? Will it break

[jira] [Updated] (SPARK-22319) SparkSubmit calls getFileStatus before calling loginUserFromKeytab

2017-10-23 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-22319: Fix Version/s: 2.2.1 > SparkSubmit calls getFileStatus before calling loginUserFromKeytab >