[jira] [Resolved] (SPARK-14554) disable whole stage codegen if there are too many input columns

2016-04-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14554. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12322

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-04-11 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236638#comment-15236638 ] Narine Kokhlikyan commented on SPARK-12922: --- [~sunrui], Thank you very much for the

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-04-11 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236622#comment-15236622 ] Sun Rui commented on SPARK-12922: - [~Narine] DataFrame and Dataset are now converged. DataFrame is a

[jira] [Updated] (SPARK-14554) disable whole stage codegen if there are too many input columns

2016-04-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-14554: Summary: disable whole stage codegen if there are too many input columns (was: Dataset.map may

[jira] [Commented] (SPARK-14546) Scale Wrapper in SparkR

2016-04-11 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236556#comment-15236556 ] Yong Tang commented on SPARK-14546: --- [~aloknsingh] I can work on this one if no one has started yet.

[jira] [Updated] (SPARK-14551) Reduce number of NameNode calls in OrcRelation with FileSourceStrategy mode

2016-04-11 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-14551: - Summary: Reduce number of NameNode calls in OrcRelation with FileSourceStrategy mode

[jira] [Resolved] (SPARK-14132) [Table related commands] Alter partition

2016-04-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14132. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12220

[jira] [Commented] (SPARK-14409) Investigate adding a RankingEvaluator to ML

2016-04-11 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236541#comment-15236541 ] Yong Tang commented on SPARK-14409: --- [~mlnick] [~josephkb] I added a short doc in google driver with

[jira] [Assigned] (SPARK-14554) Dataset.map may generate wrong java code for wide table

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14554: Assignee: Wenchen Fan (was: Apache Spark) > Dataset.map may generate wrong java code for

[jira] [Assigned] (SPARK-14556) Code clean-ups for package o.a.s.sql.execution.streaming.state

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14556: Assignee: Apache Spark > Code clean-ups for package o.a.s.sql.execution.streaming.state >

[jira] [Assigned] (SPARK-14554) Dataset.map may generate wrong java code for wide table

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14554: Assignee: Apache Spark (was: Wenchen Fan) > Dataset.map may generate wrong java code for

[jira] [Commented] (SPARK-14556) Code clean-ups for package o.a.s.sql.execution.streaming.state

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236543#comment-15236543 ] Apache Spark commented on SPARK-14556: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14556) Code clean-ups for package o.a.s.sql.execution.streaming.state

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14556: Assignee: (was: Apache Spark) > Code clean-ups for package

[jira] [Commented] (SPARK-14554) Dataset.map may generate wrong java code for wide table

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236544#comment-15236544 ] Apache Spark commented on SPARK-14554: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-14556) Code clean-ups for package o.a.s.sql.execution.streaming.state

2016-04-11 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14556: - Summary: Code clean-ups for package o.a.s.sql.execution.streaming.state Key: SPARK-14556 URL: https://issues.apache.org/jira/browse/SPARK-14556 Project: Spark

[jira] [Commented] (SPARK-14362) DDL Native Support: Drop View

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236529#comment-15236529 ] Apache Spark commented on SPARK-14362: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-14406) Drop Table

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236530#comment-15236530 ] Apache Spark commented on SPARK-14406: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14555) Python API for methods introduced for Structured Streaming

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14555: Assignee: (was: Apache Spark) > Python API for methods introduced for Structured

[jira] [Assigned] (SPARK-14555) Python API for methods introduced for Structured Streaming

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14555: Assignee: Apache Spark > Python API for methods introduced for Structured Streaming >

[jira] [Commented] (SPARK-14555) Python API for methods introduced for Structured Streaming

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236528#comment-15236528 ] Apache Spark commented on SPARK-14555: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Created] (SPARK-14555) Python API for methods introduced for Structured Streaming

2016-04-11 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-14555: --- Summary: Python API for methods introduced for Structured Streaming Key: SPARK-14555 URL: https://issues.apache.org/jira/browse/SPARK-14555 Project: Spark

[jira] [Created] (SPARK-14554) Dataset.map may generate wrong java code for wide table

2016-04-11 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-14554: --- Summary: Dataset.map may generate wrong java code for wide table Key: SPARK-14554 URL: https://issues.apache.org/jira/browse/SPARK-14554 Project: Spark Issue

[jira] [Commented] (SPARK-11828) DAGScheduler source registered too early with MetricsSystem

2016-04-11 Thread Dubkov Mikhail (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236510#comment-15236510 ] Dubkov Mikhail commented on SPARK-11828: [~vanzin] Could you please look into

[jira] [Commented] (SPARK-14550) OneHotEncoding wrapper in SparkR

2016-04-11 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236497#comment-15236497 ] Alok Singh commented on SPARK-14550: Hi [~mengxr] exposing one hot encoding to the sparkR will

[jira] [Commented] (SPARK-14553) PCA wrapper for SparkR

2016-04-11 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236495#comment-15236495 ] Alok Singh commented on SPARK-14553: Hi [~mengxr] , Since all the ml apis are now expanded in 1.6.

[jira] [Updated] (SPARK-14553) PCA wrapper for SparkR

2016-04-11 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alok Singh updated SPARK-14553: --- Description: Implement the SparkR wrapper for the PCA transformer

[jira] [Created] (SPARK-14553) PCA wrapper for SparkR

2016-04-11 Thread Alok Singh (JIRA)
Alok Singh created SPARK-14553: -- Summary: PCA wrapper for SparkR Key: SPARK-14553 URL: https://issues.apache.org/jira/browse/SPARK-14553 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-14552) ReValue wrapper for SparkR

2016-04-11 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alok Singh updated SPARK-14552: --- Description: Implement the wrapper for VectorIndexer. In R in the dply package one can do the

[jira] [Commented] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236487#comment-15236487 ] Sean Owen commented on SPARK-14548: --- It says these are non-standard though. I can understand supporting

[jira] [Created] (SPARK-14552) ReValue wrapper for SparkR

2016-04-11 Thread Alok Singh (JIRA)
Alok Singh created SPARK-14552: -- Summary: ReValue wrapper for SparkR Key: SPARK-14552 URL: https://issues.apache.org/jira/browse/SPARK-14552 Project: Spark Issue Type: New Feature

[jira] [Comment Edited] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236461#comment-15236461 ] Xiao Li edited comment on SPARK-14548 at 4/12/16 2:42 AM: -- MS SQL Server

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-04-11 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236484#comment-15236484 ] Narine Kokhlikyan commented on SPARK-12922: --- Thanks for the quick response, [~sunrui]. I was

[jira] [Assigned] (SPARK-14551) Reduce number of NN calls in OrcRelation with FileSourceStrategy mode

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14551: Assignee: (was: Apache Spark) > Reduce number of NN calls in OrcRelation with

[jira] [Assigned] (SPARK-14551) Reduce number of NN calls in OrcRelation with FileSourceStrategy mode

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14551: Assignee: Apache Spark > Reduce number of NN calls in OrcRelation with FileSourceStrategy

[jira] [Commented] (SPARK-14551) Reduce number of NN calls in OrcRelation with FileSourceStrategy mode

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236478#comment-15236478 ] Apache Spark commented on SPARK-14551: -- User 'rajeshbalamohan' has created a pull request for this

[jira] [Commented] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236461#comment-15236461 ] Xiao Li commented on SPARK-14548: - https://msdn.microsoft.com/en-us/library/ms188074.aspx > Support !>

[jira] [Assigned] (SPARK-14513) Threads left behind after stopping SparkContext

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14513: Assignee: Apache Spark > Threads left behind after stopping SparkContext >

[jira] [Assigned] (SPARK-14513) Threads left behind after stopping SparkContext

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14513: Assignee: (was: Apache Spark) > Threads left behind after stopping SparkContext >

[jira] [Commented] (SPARK-14513) Threads left behind after stopping SparkContext

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236455#comment-15236455 ] Apache Spark commented on SPARK-14513: -- User 'chtyim' has created a pull request for this issue:

[jira] [Commented] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236449#comment-15236449 ] Sean Owen commented on SPARK-14548: --- I've honestly never heard of these operators in any language. Does

[jira] [Resolved] (SPARK-14520) ClasscastException thrown with spark.sql.parquet.enableVectorizedReader=true

2016-04-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14520. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 >

[jira] [Commented] (SPARK-14549) Copy the Vector and Matrix classes from mllib to ml in mllib-local

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236429#comment-15236429 ] Apache Spark commented on SPARK-14549: -- User 'dbtsai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14549) Copy the Vector and Matrix classes from mllib to ml in mllib-local

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14549: Assignee: DB Tsai (was: Apache Spark) > Copy the Vector and Matrix classes from mllib to

[jira] [Assigned] (SPARK-14549) Copy the Vector and Matrix classes from mllib to ml in mllib-local

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14549: Assignee: Apache Spark (was: DB Tsai) > Copy the Vector and Matrix classes from mllib to

[jira] [Created] (SPARK-14550) OneHotEncoding wrapper in SparkR

2016-04-11 Thread Alok Singh (JIRA)
Alok Singh created SPARK-14550: -- Summary: OneHotEncoding wrapper in SparkR Key: SPARK-14550 URL: https://issues.apache.org/jira/browse/SPARK-14550 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-13352) BlockFetch does not scale well on large block

2016-04-11 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236426#comment-15236426 ] Zhang, Liye commented on SPARK-13352: - [~davies], the last result for 500M should be 7.8 seconds, not

[jira] [Created] (SPARK-14549) Copy the Vector and Matrix classes from mllib to ml in mllib-local

2016-04-11 Thread DB Tsai (JIRA)
DB Tsai created SPARK-14549: --- Summary: Copy the Vector and Matrix classes from mllib to ml in mllib-local Key: SPARK-14549 URL: https://issues.apache.org/jira/browse/SPARK-14549 Project: Spark

[jira] [Commented] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236416#comment-15236416 ] Apache Spark commented on SPARK-14548: -- User 'jliwork' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14548: Assignee: (was: Apache Spark) > Support !> and !< operator in Spark SQL >

[jira] [Assigned] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14548: Assignee: Apache Spark > Support !> and !< operator in Spark SQL >

[jira] [Resolved] (SPARK-14475) Propagate user-defined context from driver to executors

2016-04-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14475. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.0.0 > Propagate

[jira] [Assigned] (SPARK-14547) Avoid DNS resolution for reusing connections

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14547: Assignee: Reynold Xin (was: Apache Spark) > Avoid DNS resolution for reusing connections

[jira] [Assigned] (SPARK-14547) Avoid DNS resolution for reusing connections

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14547: Assignee: Apache Spark (was: Reynold Xin) > Avoid DNS resolution for reusing connections

[jira] [Commented] (SPARK-14547) Avoid DNS resolution for reusing connections

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236402#comment-15236402 ] Apache Spark commented on SPARK-14547: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-11 Thread Jia Li (JIRA)
Jia Li created SPARK-14548: -- Summary: Support !> and !< operator in Spark SQL Key: SPARK-14548 URL: https://issues.apache.org/jira/browse/SPARK-14548 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-14546) Scale Wrapper in SparkR

2016-04-11 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alok Singh updated SPARK-14546: --- Summary: Scale Wrapper in SparkR (was: Scale Wrapper ) > Scale Wrapper in SparkR >

[jira] [Created] (SPARK-14546) Scale Wrapper

2016-04-11 Thread Alok Singh (JIRA)
Alok Singh created SPARK-14546: -- Summary: Scale Wrapper Key: SPARK-14546 URL: https://issues.apache.org/jira/browse/SPARK-14546 Project: Spark Issue Type: New Feature Components: ML,

[jira] [Commented] (SPARK-14441) Consolidate DDL tests

2016-04-11 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236359#comment-15236359 ] Bo Meng commented on SPARK-14441: - I think DDLSuite and DDLCommandSuite can be combined into one, also

[jira] [Commented] (SPARK-14126) [Table related commands] Truncate table

2016-04-11 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236353#comment-15236353 ] Adrian Wang commented on SPARK-14126: - I'm working on this. > [Table related commands] Truncate

[jira] [Commented] (SPARK-14414) Make error messages consistent across DDLs

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236336#comment-15236336 ] Apache Spark commented on SPARK-14414: -- User 'bomeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14414) Make error messages consistent across DDLs

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14414: Assignee: Andrew Or (was: Apache Spark) > Make error messages consistent across DDLs >

[jira] [Assigned] (SPARK-14414) Make error messages consistent across DDLs

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14414: Assignee: Apache Spark (was: Andrew Or) > Make error messages consistent across DDLs >

[jira] [Assigned] (SPARK-14543) SQL/Hive insertInto has unexpected results

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14543: Assignee: (was: Apache Spark) > SQL/Hive insertInto has unexpected results >

[jira] [Assigned] (SPARK-14543) SQL/Hive insertInto has unexpected results

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14543: Assignee: Apache Spark > SQL/Hive insertInto has unexpected results >

[jira] [Commented] (SPARK-14543) SQL/Hive insertInto has unexpected results

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236315#comment-15236315 ] Apache Spark commented on SPARK-14543: -- User 'rdblue' has created a pull request for this issue:

[jira] [Updated] (SPARK-14545) Improve `LikeSimplification` by adding `a%b` rule

2016-04-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14545: -- Description: Current `LikeSimplification` handles the following four rules. - 'a%' =>

[jira] [Assigned] (SPARK-14545) Improve `LikeSimplification` by adding `a%b` rule

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14545: Assignee: (was: Apache Spark) > Improve `LikeSimplification` by adding `a%b` rule >

[jira] [Assigned] (SPARK-14545) Improve `LikeSimplification` by adding `a%b` rule

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14545: Assignee: Apache Spark > Improve `LikeSimplification` by adding `a%b` rule >

[jira] [Commented] (SPARK-14545) Improve `LikeSimplification` by adding `a%b` rule

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236293#comment-15236293 ] Apache Spark commented on SPARK-14545: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-14545) Improve `LikeSimplification` by adding `a%b` rule

2016-04-11 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-14545: - Summary: Improve `LikeSimplification` by adding `a%b` rule Key: SPARK-14545 URL: https://issues.apache.org/jira/browse/SPARK-14545 Project: Spark Issue

[jira] [Assigned] (SPARK-14544) Spark UI is very slow in recent Chrome

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14544: Assignee: Davies Liu (was: Apache Spark) > Spark UI is very slow in recent Chrome >

[jira] [Commented] (SPARK-14544) Spark UI is very slow in recent Chrome

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236211#comment-15236211 ] Apache Spark commented on SPARK-14544: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14544) Spark UI is very slow in recent Chrome

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14544: Assignee: Apache Spark (was: Davies Liu) > Spark UI is very slow in recent Chrome >

[jira] [Updated] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10521: --- Assignee: Luciano Resende > Utilize Docker to test DB2 JDBC Dialect support >

[jira] [Resolved] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10521. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9893

[jira] [Assigned] (SPARK-14401) Switch to stock sbt-pom-reader plugin

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14401: Assignee: Apache Spark > Switch to stock sbt-pom-reader plugin >

[jira] [Assigned] (SPARK-1844) Support maven-style dependency resolution in sbt build

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1844: --- Assignee: Apache Spark (was: Josh Rosen) > Support maven-style dependency resolution in sbt

[jira] [Commented] (SPARK-14401) Switch to stock sbt-pom-reader plugin

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236204#comment-15236204 ] Apache Spark commented on SPARK-14401: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-1844) Support maven-style dependency resolution in sbt build

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1844: --- Assignee: Josh Rosen (was: Apache Spark) > Support maven-style dependency resolution in sbt

[jira] [Assigned] (SPARK-14401) Switch to stock sbt-pom-reader plugin

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14401: Assignee: (was: Apache Spark) > Switch to stock sbt-pom-reader plugin >

[jira] [Commented] (SPARK-1844) Support maven-style dependency resolution in sbt build

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236205#comment-15236205 ] Apache Spark commented on SPARK-1844: - User 'JoshRosen' has created a pull request for this issue:

[jira] [Reopened] (SPARK-1844) Support maven-style dependency resolution in sbt build

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-1844: --- Assignee: Josh Rosen (was: Prashant Sharma) > Support maven-style dependency resolution in sbt

[jira] [Updated] (SPARK-14401) Switch to stock sbt-pom-reader plugin

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14401: --- Summary: Switch to stock sbt-pom-reader plugin (was: Merge our sbt-pom-reader changes upstream) >

[jira] [Created] (SPARK-14544) Spark UI is very slow in recent Chrome

2016-04-11 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14544: -- Summary: Spark UI is very slow in recent Chrome Key: SPARK-14544 URL: https://issues.apache.org/jira/browse/SPARK-14544 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-14298) LDA should support disable checkpoint

2016-04-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14298. --- Resolution: Fixed Fix Version/s: 1.6.2 1.5.3 > LDA should

[jira] [Assigned] (SPARK-14542) PipeRDD should allow configurable buffer size for the stdin writer

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14542: Assignee: (was: Apache Spark) > PipeRDD should allow configurable buffer size for the

[jira] [Assigned] (SPARK-14542) PipeRDD should allow configurable buffer size for the stdin writer

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14542: Assignee: Apache Spark > PipeRDD should allow configurable buffer size for the stdin

[jira] [Commented] (SPARK-14542) PipeRDD should allow configurable buffer size for the stdin writer

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236156#comment-15236156 ] Apache Spark commented on SPARK-14542: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Created] (SPARK-14543) SQL/Hive insertInto has unexpected results

2016-04-11 Thread Ryan Blue (JIRA)
Ryan Blue created SPARK-14543: - Summary: SQL/Hive insertInto has unexpected results Key: SPARK-14543 URL: https://issues.apache.org/jira/browse/SPARK-14543 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14521: --- Priority: Blocker (was: Critical) > StackOverflowError in Kryo when executing TPC-DS Query27 >

[jira] [Updated] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14521: --- Affects Version/s: 2.0.0 > StackOverflowError in Kryo when executing TPC-DS Query27 >

[jira] [Commented] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236094#comment-15236094 ] Josh Rosen commented on SPARK-14521: Downgrading to Kryo 2 is not an option so we'll have to fix

[jira] [Updated] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14521: --- Priority: Critical (was: Major) > StackOverflowError in Kryo when executing TPC-DS Query27 >

[jira] [Commented] (SPARK-13988) Large history files block new applications from showing up in History UI.

2016-04-11 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236082#comment-15236082 ] Parth Brahmbhatt commented on SPARK-13988: -- Pinging again, can one of the committers review? >

[jira] [Assigned] (SPARK-13967) Add binary toggle Param to PySpark CountVectorizer

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13967: Assignee: Apache Spark > Add binary toggle Param to PySpark CountVectorizer >

[jira] [Assigned] (SPARK-13967) Add binary toggle Param to PySpark CountVectorizer

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13967: Assignee: (was: Apache Spark) > Add binary toggle Param to PySpark CountVectorizer >

[jira] [Commented] (SPARK-13967) Add binary toggle Param to PySpark CountVectorizer

2016-04-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236083#comment-15236083 ] Apache Spark commented on SPARK-13967: -- User 'BryanCutler' has created a pull request for this

[jira] [Updated] (SPARK-14542) PipeRDD should allow configurable buffer size for the stdin writer

2016-04-11 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-14542: Description: Currently PipedRDD internally uses PrintWriter to write data to the stdin of the

[jira] [Updated] (SPARK-14542) PipeRDD should allow configurable buffer size for the stdin writer

2016-04-11 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-14542: Description: Currently {code}PipedRDD{code} internally uses PrintWriter to write data to the stdin

[jira] [Created] (SPARK-14542) PipeRDD should allow configurable buffer size for the stdin writer

2016-04-11 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-14542: --- Summary: PipeRDD should allow configurable buffer size for the stdin writer Key: SPARK-14542 URL: https://issues.apache.org/jira/browse/SPARK-14542 Project: Spark

  1   2   3   >