[jira] [Created] (SPARK-14351) Optimize ImpurityAggregator for decision trees

2016-04-02 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14351: - Summary: Optimize ImpurityAggregator for decision trees Key: SPARK-14351 URL: https://issues.apache.org/jira/browse/SPARK-14351 Project: Spark

[jira] [Updated] (SPARK-14130) [Table related commands] Alter column

2016-04-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14130: - Description: For alter column command, we have the following tokens. TOK_ALTERTABLE_RENAMECOL

[jira] [Updated] (SPARK-13996) Add more not null attributes for Filter codegen

2016-04-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13996: --- Assignee: Liang-Chi Hsieh > Add more not null attributes for Filter codegen >

[jira] [Resolved] (SPARK-13996) Add more not null attributes for Filter codegen

2016-04-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13996. Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 11810

[jira] [Updated] (SPARK-13996) Add more not null attributes for Filter codegen

2016-04-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13996: --- Fix Version/s: (was: 2.1.0) 2.0.0 > Add more not null attributes for Filter

[jira] [Resolved] (SPARK-14056) Add s3 configurations and spark.hadoop.* configurations to hive configuration

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14056. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11876

[jira] [Updated] (SPARK-14056) Add s3 configurations and spark.hadoop.* configurations to hive configuration

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14056: -- Priority: Minor (was: Major) > Add s3 configurations and spark.hadoop.* configurations to hive

[jira] [Updated] (SPARK-14056) Add s3 configurations and spark.hadoop.* configurations to hive configuration

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14056: -- Assignee: Sital Kedia > Add s3 configurations and spark.hadoop.* configurations to hive configuration

[jira] [Created] (SPARK-14350) explain output should be in a single cell rather than one line per cell

2016-04-02 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14350: --- Summary: explain output should be in a single cell rather than one line per cell Key: SPARK-14350 URL: https://issues.apache.org/jira/browse/SPARK-14350 Project: Spark

[jira] [Commented] (SPARK-14350) explain output should be in a single cell rather than one line per cell

2016-04-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223087#comment-15223087 ] Reynold Xin commented on SPARK-14350: - cc [~dongjoon] want to try fix this? > explain output should

[jira] [Resolved] (SPARK-14342) Remove straggler references to Tachyon

2016-04-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14342. - Resolution: Fixed Assignee: Liwei Lin Fix Version/s: 2.0.0 > Remove straggler

[jira] [Closed] (SPARK-13877) Consider removing Kafka modules from Spark / Spark Streaming

2016-04-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-13877. --- Resolution: Won't Fix Target Version/s: (was: 2.0.0) Closing as won't fix since we are

[jira] [Resolved] (SPARK-14338) Improve `SimplifyConditionals` rule to handle `null` in IF/CASEWHEN

2016-04-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14338. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > Improve

[jira] [Comment Edited] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

2016-04-02 Thread Matt Butler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223080#comment-15223080 ] Matt Butler edited comment on SPARK-12675 at 4/3/16 12:32 AM: -- We are

[jira] [Comment Edited] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

2016-04-02 Thread Matt Butler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223080#comment-15223080 ] Matt Butler edited comment on SPARK-12675 at 4/3/16 12:32 AM: -- We are

[jira] [Comment Edited] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

2016-04-02 Thread Matt Butler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223080#comment-15223080 ] Matt Butler edited comment on SPARK-12675 at 4/3/16 12:31 AM: -- We are

[jira] [Issue Comment Deleted] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

2016-04-02 Thread Matt Butler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Butler updated SPARK-12675: Comment: was deleted (was: Tried to recreate, now new problem in heartbeater 2016-04-02

[jira] [Commented] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

2016-04-02 Thread Matt Butler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223082#comment-15223082 ] Matt Butler commented on SPARK-12675: - Tried to recreate, now new problem in heartbeater 2016-04-02

[jira] [Commented] (SPARK-14349) Issue Error Messages for Unsupported Operations in SQL Context.

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223081#comment-15223081 ] Apache Spark commented on SPARK-14349: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14349) Issue Error Messages for Unsupported Operations in SQL Context.

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14349: Assignee: Apache Spark > Issue Error Messages for Unsupported Operations in SQL Context.

[jira] [Assigned] (SPARK-14349) Issue Error Messages for Unsupported Operations in SQL Context.

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14349: Assignee: (was: Apache Spark) > Issue Error Messages for Unsupported Operations in

[jira] [Updated] (SPARK-14349) Issue Error Messages for Unsupported Operations in SQL Context.

2016-04-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14349: Description: Currently, the weird error messages are issued if we use Hive Context-only operations in SQL

[jira] [Created] (SPARK-14349) Issue Error Messages for Unsupported Operations in SQL Context.

2016-04-02 Thread Xiao Li (JIRA)
Xiao Li created SPARK-14349: --- Summary: Issue Error Messages for Unsupported Operations in SQL Context. Key: SPARK-14349 URL: https://issues.apache.org/jira/browse/SPARK-14349 Project: Spark Issue

[jira] [Commented] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

2016-04-02 Thread Matt Butler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223080#comment-15223080 ] Matt Butler commented on SPARK-12675: - We are hitting this as well. Exact same stack trace as Anthony

[jira] [Assigned] (SPARK-14348) Support native execution of SHOW TBLPROPERTIES command

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14348: Assignee: Apache Spark > Support native execution of SHOW TBLPROPERTIES command >

[jira] [Commented] (SPARK-14348) Support native execution of SHOW TBLPROPERTIES command

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223034#comment-15223034 ] Apache Spark commented on SPARK-14348: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-14348) Support native execution of SHOW TBLPROPERTIES command

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14348: Assignee: (was: Apache Spark) > Support native execution of SHOW TBLPROPERTIES

[jira] [Updated] (SPARK-14348) Support native execution of SHOW TBLPROPERTIES command

2016-04-02 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-14348: - Summary: Support native execution of SHOW TBLPROPERTIES command (was: Support native execution

[jira] [Created] (SPARK-14348) Support native execution of SHOW DATABASE command

2016-04-02 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-14348: Summary: Support native execution of SHOW DATABASE command Key: SPARK-14348 URL: https://issues.apache.org/jira/browse/SPARK-14348 Project: Spark Issue

[jira] [Created] (SPARK-14347) Require Java 8 for Spark 2.x

2016-04-02 Thread Sean Owen (JIRA)
Sean Owen created SPARK-14347: - Summary: Require Java 8 for Spark 2.x Key: SPARK-14347 URL: https://issues.apache.org/jira/browse/SPARK-14347 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-14347) Require Java 8 for Spark 2.x

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14347: -- Issue Type: Sub-task (was: Task) Parent: SPARK-11806 > Require Java 8 for Spark 2.x >

[jira] [Commented] (SPARK-14346) SHOW CREATE TABLE command (Native)

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223028#comment-15223028 ] Apache Spark commented on SPARK-14346: -- User 'xwu0226' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14346) SHOW CREATE TABLE command (Native)

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14346: Assignee: (was: Apache Spark) > SHOW CREATE TABLE command (Native) >

[jira] [Assigned] (SPARK-14346) SHOW CREATE TABLE command (Native)

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14346: Assignee: Apache Spark > SHOW CREATE TABLE command (Native) >

[jira] [Updated] (SPARK-14346) SHOW CREATE TABLE command (Native)

2016-04-02 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-14346: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-14118 > SHOW CREATE TABLE command (Native) >

[jira] [Created] (SPARK-14346) SHOW CREATE TABLE command (Native)

2016-04-02 Thread Xin Wu (JIRA)
Xin Wu created SPARK-14346: -- Summary: SHOW CREATE TABLE command (Native) Key: SPARK-14346 URL: https://issues.apache.org/jira/browse/SPARK-14346 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

2016-04-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223010#comment-15223010 ] Josh Rosen edited comment on SPARK-14083 at 4/2/16 7:02 PM: Here's one

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

2016-04-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223010#comment-15223010 ] Josh Rosen commented on SPARK-14083: Here's one example of how we might aim to preserve Java/Scala

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Shubhanshu Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223006#comment-15223006 ] Shubhanshu Mishra edited comment on SPARK-14103 at 4/2/16 6:51 PM: ---

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Shubhanshu Mishra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223006#comment-15223006 ] Shubhanshu Mishra commented on SPARK-14103: --- [~hyukjin.kwon] thanks for pointing this out. I

[jira] [Updated] (SPARK-14130) [Table related commands] Alter column

2016-04-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14130: - Description: For alter column command, we have the following tokens. TOK_ALTERTABLE_RENAMECOL

[jira] [Updated] (SPARK-14130) [Table related commands] Alter column

2016-04-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14130: - Description: For alter column command, we have the following tokens. TOK_ALTERTABLE_RENAMECOL

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222938#comment-15222938 ] Sean Owen commented on SPARK-14103: --- I don't think this case is ambiguous. The second " appears alone

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222931#comment-15222931 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/2/16 4:23 PM: -- After

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222931#comment-15222931 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/2/16 4:22 PM: -- After

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222931#comment-15222931 ] Hyukjin Kwon commented on SPARK-14103: -- After thinking further, I realised that this might be a

[jira] [Updated] (SPARK-14180) Deadlock in CoarseGrainedExecutorBackend Shutdown

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14180: -- Priority: Critical (was: Blocker) Fix Version/s: (was: 2.0.0) > Deadlock in

[jira] [Updated] (SPARK-14231) JSON data source fails to infer floats as decimal when precision is bigger than 38 or scale is bigger than precision.

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14231: -- Fix Version/s: (was: 2.0.0) > JSON data source fails to infer floats as decimal when precision is

[jira] [Updated] (SPARK-14265) When stage is reRubmitted, DAG visualization does not render correctly for this stage

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14265: -- Fix Version/s: (was: 2.0.0) > When stage is reRubmitted, DAG visualization does not render

[jira] [Updated] (SPARK-14237) De-duplicate partition value appending logic in various buildReader() implementations

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14237: -- Fix Version/s: (was: 2.0.0) > De-duplicate partition value appending logic in various

[jira] [Updated] (SPARK-14344) saveAsParquetFile creates _metafile even when disabled

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14344: -- Target Version/s: (was: 1.2.1) Fix Version/s: (was: 1.5.1) (was:

[jira] [Updated] (SPARK-14191) Fix Expand operator constraints

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14191: -- Assignee: Liang-Chi Hsieh > Fix Expand operator constraints > --- > >

[jira] [Updated] (SPARK-14138) Generated SpecificColumnarIterator code can exceed JVM size limit for cached DataFrames

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14138: -- Assignee: Kazuaki Ishizaki > Generated SpecificColumnarIterator code can exceed JVM size limit for

[jira] [Updated] (SPARK-14308) Remove unused mllib tree classes and move private classes to ML

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14308: -- Assignee: Seth Hendrickson > Remove unused mllib tree classes and move private classes to ML >

[jira] [Updated] (SPARK-13995) Extract correct IsNotNull constraints for Expression

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13995: -- Assignee: Liang-Chi Hsieh > Extract correct IsNotNull constraints for Expression >

[jira] [Updated] (SPARK-12864) Fetch failure from AM restart

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12864: -- Assignee: iward > Fetch failure from AM restart > - > >

[jira] [Updated] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11327: -- Assignee: Jo Voordeckers > spark-dispatcher doesn't pass along some spark properties >

[jira] [Updated] (SPARK-12772) Better error message for syntax error in the SQL parser

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12772: -- Assignee: Herman van Hovell > Better error message for syntax error in the SQL parser >

[jira] [Resolved] (SPARK-14178) DAGScheduler should get map output statuses directly, not by MapOutputTrackerMaster.getSerializedMapOutputStatuses.

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14178. --- Resolution: Won't Fix Resolving per comments in PR. It's not clear this is valid. > DAGScheduler

[jira] [Commented] (SPARK-14345) Decouple deserializer expression resolution from ObjectOperator

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222913#comment-15222913 ] Apache Spark commented on SPARK-14345: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14345) Decouple deserializer expression resolution from ObjectOperator

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14345: Assignee: Wenchen Fan (was: Apache Spark) > Decouple deserializer expression resolution

[jira] [Assigned] (SPARK-14345) Decouple deserializer expression resolution from ObjectOperator

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14345: Assignee: Apache Spark (was: Wenchen Fan) > Decouple deserializer expression resolution

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222912#comment-15222912 ] Sean Owen commented on SPARK-14103: --- I've used the Apache parser in the past and it has been fine. I

[jira] [Created] (SPARK-14345) Decouple deserializer expression resolution from ObjectOperator

2016-04-02 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-14345: --- Summary: Decouple deserializer expression resolution from ObjectOperator Key: SPARK-14345 URL: https://issues.apache.org/jira/browse/SPARK-14345 Project: Spark

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222792#comment-15222792 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/2/16 1:51 PM: --

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222879#comment-15222879 ] Hyukjin Kwon commented on SPARK-14103: -- cc [~falaki] [~r...@databricks.com] > Python DataFrame CSV

[jira] [Created] (SPARK-14344) saveAsParquetFile creates _metafile even when disabled

2016-04-02 Thread Kashish Jain (JIRA)
Kashish Jain created SPARK-14344: Summary: saveAsParquetFile creates _metafile even when disabled Key: SPARK-14344 URL: https://issues.apache.org/jira/browse/SPARK-14344 Project: Spark Issue

[jira] [Updated] (SPARK-14342) Remove straggler references to Tachyon

2016-04-02 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-14342: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-11806 > Remove straggler references to

[jira] [Created] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

2016-04-02 Thread Jurriaan Pruis (JIRA)
Jurriaan Pruis created SPARK-14343: -- Summary: Dataframe operations on a partitioned dataset (using partition discovery) return invalid results Key: SPARK-14343 URL:

[jira] [Commented] (SPARK-14207) Transformer for splitting a Vector/Array column into individual columns

2016-04-02 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222798#comment-15222798 ] yuhao yang commented on SPARK-14207: having some problem in transformSchema. Without the actual data,

[jira] [Commented] (SPARK-14342) Remove straggler references to Tachyon

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222795#comment-15222795 ] Apache Spark commented on SPARK-14342: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14342) Remove straggler references to Tachyon

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14342: Assignee: (was: Apache Spark) > Remove straggler references to Tachyon >

[jira] [Assigned] (SPARK-14342) Remove straggler references to Tachyon

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14342: Assignee: Apache Spark > Remove straggler references to Tachyon >

[jira] [Created] (SPARK-14342) Remove straggler references to Tachyon

2016-04-02 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14342: - Summary: Remove straggler references to Tachyon Key: SPARK-14342 URL: https://issues.apache.org/jira/browse/SPARK-14342 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222792#comment-15222792 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/2/16 8:35 AM: --

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222792#comment-15222792 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/2/16 8:34 AM: --

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-02 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222792#comment-15222792 ] Hyukjin Kwon commented on SPARK-14103: -- [~shubhanshumis...@gmail.com] Right, it looks like an issue

[jira] [Commented] (SPARK-14335) Describe function command returns wrong output because some of built-in functions are not in function registry.

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222767#comment-15222767 ] Apache Spark commented on SPARK-14335: -- User 'yongtang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14335) Describe function command returns wrong output because some of built-in functions are not in function registry.

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14335: Assignee: (was: Apache Spark) > Describe function command returns wrong output

[jira] [Assigned] (SPARK-14335) Describe function command returns wrong output because some of built-in functions are not in function registry.

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14335: Assignee: Apache Spark > Describe function command returns wrong output because some of

[jira] [Commented] (SPARK-14335) Describe function command returns wrong output because some of built-in functions are not in function registry.

2016-04-02 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222761#comment-15222761 ] Yong Tang commented on SPARK-14335: --- I can work on this one. Will provide a pull request shortly. >

[jira] [Commented] (SPARK-12981) Dataframe distinct() followed by a filter(udf) in pyspark throws a casting error

2016-04-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222753#comment-15222753 ] Apache Spark commented on SPARK-12981: -- User 'davies' has created a pull request for this issue: