[jira] [Created] (SPARK-13239) Click-Through Rate Prediction

2016-02-08 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-13239: --- Summary: Click-Through Rate Prediction Key: SPARK-13239 URL: https://issues.apache.org/jira/browse/SPARK-13239 Project: Spark Issue Type: Sub-task Co

[jira] [Commented] (SPARK-13239) Click-Through Rate Prediction

2016-02-08 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138490#comment-15138490 ] Yu Ishikawa commented on SPARK-13239: - I'm working on this issue. > Click-Through Ra

[jira] [Assigned] (SPARK-13237) Generate broadcast outer join

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13237: Assignee: Apache Spark (was: Davies Liu) > Generate broadcast outer join > --

[jira] [Commented] (SPARK-13237) Generate broadcast outer join

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138488#comment-15138488 ] Apache Spark commented on SPARK-13237: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-13237) Generate broadcast outer join

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13237: Assignee: Davies Liu (was: Apache Spark) > Generate broadcast outer join > --

[jira] [Reopened] (SPARK-12921) Use SparkHadoopUtil reflection to access TaskAttemptContext in SpecificParquetRecordReaderBase

2016-02-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-12921: Looks like there's still one more spot that I missed, so I'm going to reopen this and will submit a on

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138447#comment-15138447 ] Jakob Odersky commented on SPARK-13172: --- Cool, thanks for the snippet! I agree, the

[jira] [Assigned] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13232: Assignee: (was: Apache Spark) > YARN executor node label expressions > ---

[jira] [Commented] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138438#comment-15138438 ] Apache Spark commented on SPARK-13232: -- User 'AtkinsChang' has created a pull reques

[jira] [Assigned] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13232: Assignee: Apache Spark > YARN executor node label expressions > --

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138423#comment-15138423 ] sachin aggarwal edited comment on SPARK-13172 at 2/9/16 6:49 AM: --

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138423#comment-15138423 ] sachin aggarwal edited comment on SPARK-13172 at 2/9/16 6:35 AM: --

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138423#comment-15138423 ] sachin aggarwal edited comment on SPARK-13172 at 2/9/16 6:33 AM: --

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138423#comment-15138423 ] sachin aggarwal edited comment on SPARK-13172 at 2/9/16 6:33 AM: --

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138423#comment-15138423 ] sachin aggarwal commented on SPARK-13172: - there are two ways we can proceed :- f

[jira] [Resolved] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

2016-02-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12992. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11055 [https://github.

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138404#comment-15138404 ] Xiao Li commented on SPARK-13219: - Sorry, there is a bug in the original PR. You just nee

[jira] [Issue Comment Deleted] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13219: Comment: was deleted (was: Could you wait for me to fix another issue? When I tried your query, I found a

[jira] [Commented] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2016-02-08 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138381#comment-15138381 ] Ashwin Shankar commented on SPARK-12329: Yep, feel free to take it. > spark-sql

[jira] [Commented] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2016-02-08 Thread Rishabh Bhardwaj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138340#comment-15138340 ] Rishabh Bhardwaj commented on SPARK-12329: -- [~ashwinshankar77] Are you working o

[jira] [Commented] (SPARK-13017) Replace example code in mllib-feature-extraction.md using include_example

2016-02-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138310#comment-15138310 ] Xin Ren commented on SPARK-13017: - I'm working on this one, thanks :) > Replace example

[jira] [Commented] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138307#comment-15138307 ] Apache Spark commented on SPARK-13015: -- User 'keypointt' has created a pull request

[jira] [Comment Edited] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138297#comment-15138297 ] Xiao Li edited comment on SPARK-13219 at 2/9/16 3:57 AM: - It shou

[jira] [Assigned] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13015: Assignee: (was: Apache Spark) > Replace example code in mllib-data-types.md using incl

[jira] [Assigned] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13015: Assignee: Apache Spark > Replace example code in mllib-data-types.md using include_example

[jira] [Comment Edited] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138297#comment-15138297 ] Xiao Li edited comment on SPARK-13219 at 2/9/16 3:51 AM: - It shou

[jira] [Comment Edited] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138289#comment-15138289 ] Xiao Li edited comment on SPARK-13219 at 2/9/16 3:50 AM: - Could y

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138297#comment-15138297 ] Xiao Li commented on SPARK-13219: - It should works without Join clauses, as long as these

[jira] [Comment Edited] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138289#comment-15138289 ] Xiao Li edited comment on SPARK-13219 at 2/9/16 3:42 AM: - Could y

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138289#comment-15138289 ] Xiao Li commented on SPARK-13219: - Could you wait for me to fix another issue? When I tri

[jira] [Assigned] (SPARK-13238) Add ganglia dmax parameter

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13238: Assignee: (was: Apache Spark) > Add ganglia dmax parameter > -

[jira] [Commented] (SPARK-13238) Add ganglia dmax parameter

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138275#comment-15138275 ] Apache Spark commented on SPARK-13238: -- User 'ekasitk' has created a pull request fo

[jira] [Assigned] (SPARK-13238) Add ganglia dmax parameter

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13238: Assignee: Apache Spark > Add ganglia dmax parameter > -- > >

[jira] [Created] (SPARK-13238) Add ganglia dmax parameter

2016-02-08 Thread Ekasit Kijsipongse (JIRA)
Ekasit Kijsipongse created SPARK-13238: -- Summary: Add ganglia dmax parameter Key: SPARK-13238 URL: https://issues.apache.org/jira/browse/SPARK-13238 Project: Spark Issue Type: Improvemen

[jira] [Closed] (SPARK-12357) Implement unhandledFilter interface for JDBC

2016-02-08 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende closed SPARK-12357. --- Resolution: Duplicate > Implement unhandledFilter interface for JDBC > --

[jira] [Commented] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-02-08 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138251#comment-15138251 ] Devaraj K commented on SPARK-13117: --- Thanks [~jjordan]. > WebUI should use the local i

[jira] [Commented] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138220#comment-15138220 ] Apache Spark commented on SPARK-13054: -- User 'andrewor14' has created a pull request

[jira] [Issue Comment Deleted] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-02-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13054: -- Comment: was deleted (was: User 'andrewor14' has created a pull request for this issue: https://github.

[jira] [Commented] (SPARK-13036) PySpark ml.feature support export/import

2016-02-08 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138188#comment-15138188 ] Xusen Yin commented on SPARK-13036: --- [~yanboliang] I'd like to take this. Thanks! > Py

[jira] [Resolved] (SPARK-7410) Add option to avoid broadcasting configuration with newAPIHadoopFile

2016-02-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-7410. --- Resolution: Won't Fix > Add option to avoid broadcasting configuration with newAPIHadoopFile > ---

[jira] [Resolved] (SPARK-3682) Add helpful warnings to the UI

2016-02-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-3682. --- Resolution: Won't Fix > Add helpful warnings to the UI > -- > >

[jira] [Updated] (SPARK-5490) KMeans costs can be incorrect if tasks need to be rerun

2016-02-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-5490: -- Assignee: (was: Sandy Ryza) > KMeans costs can be incorrect if tasks need to be rerun >

[jira] [Created] (SPARK-13237) Generate broadcast outer join

2016-02-08 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13237: -- Summary: Generate broadcast outer join Key: SPARK-13237 URL: https://issues.apache.org/jira/browse/SPARK-13237 Project: Spark Issue Type: Improvement C

[jira] [Comment Edited] (SPARK-10383) Sync example code between API doc and user guide

2016-02-08 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138114#comment-15138114 ] Xusen Yin edited comment on SPARK-10383 at 2/9/16 12:30 AM: U

[jira] [Commented] (SPARK-10383) Sync example code between API doc and user guide

2016-02-08 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138114#comment-15138114 ] Xusen Yin commented on SPARK-10383: --- Update offline discussion with [~mengxr] here. Sc

[jira] [Commented] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138037#comment-15138037 ] Xin Ren commented on SPARK-13015: - I'm working on this one, thanks :) > Replace example

[jira] [Commented] (SPARK-13018) Replace example code in mllib-pmml-model-export.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138030#comment-15138030 ] Apache Spark commented on SPARK-13018: -- User 'keypointt' has created a pull request

[jira] [Assigned] (SPARK-13018) Replace example code in mllib-pmml-model-export.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13018: Assignee: Apache Spark > Replace example code in mllib-pmml-model-export.md using include_

[jira] [Assigned] (SPARK-13018) Replace example code in mllib-pmml-model-export.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13018: Assignee: (was: Apache Spark) > Replace example code in mllib-pmml-model-export.md usi

[jira] [Assigned] (SPARK-13011) K-means wrapper in SparkR

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13011: Assignee: Apache Spark (was: Xusen Yin) > K-means wrapper in SparkR > ---

[jira] [Assigned] (SPARK-13011) K-means wrapper in SparkR

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13011: Assignee: Xusen Yin (was: Apache Spark) > K-means wrapper in SparkR > ---

[jira] [Commented] (SPARK-13011) K-means wrapper in SparkR

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138029#comment-15138029 ] Apache Spark commented on SPARK-13011: -- User 'yinxusen' has created a pull request f

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138024#comment-15138024 ] Evan Chan commented on SPARK-13219: --- [~smilegator] does your PR take care of the case

[jira] [Commented] (SPARK-13018) Replace example code in mllib-pmml-model-export.md using include_example

2016-02-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137996#comment-15137996 ] Xin Ren commented on SPARK-13018: - I'm working on this one, thanks :) > Replace example

[jira] [Commented] (SPARK-13236) SQL generation support for union

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137988#comment-15137988 ] Xiao Li commented on SPARK-13236: - After the merge of Spark-13235, I will upload a PR for

[jira] [Assigned] (SPARK-13014) Replace example code in mllib-collaborative-filtering.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13014: Assignee: Apache Spark > Replace example code in mllib-collaborative-filtering.md using in

[jira] [Assigned] (SPARK-13014) Replace example code in mllib-collaborative-filtering.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13014: Assignee: (was: Apache Spark) > Replace example code in mllib-collaborative-filtering.

[jira] [Commented] (SPARK-13014) Replace example code in mllib-collaborative-filtering.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137982#comment-15137982 ] Apache Spark commented on SPARK-13014: -- User 'keypointt' has created a pull request

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-02-08 Thread Amir Gur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137924#comment-15137924 ] Amir Gur commented on SPARK-10528: -- Thanks, confirming it worked on win8.1 64 bit. > s

[jira] [Assigned] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13027: Assignee: Apache Spark > Add API for updateStateByKey to provide batch time as input > ---

[jira] [Commented] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137858#comment-15137858 ] Apache Spark commented on SPARK-13027: -- User 'aramesh117' has created a pull request

[jira] [Assigned] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13027: Assignee: (was: Apache Spark) > Add API for updateStateByKey to provide batch time as

[jira] [Resolved] (SPARK-13095) improve performance of hash join with dimension table

2016-02-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13095. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11065 [https://github.

[jira] [Commented] (SPARK-13216) Spark streaming application not honoring --num-executors in restarting of an application from a checkpoint

2016-02-08 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137797#comment-15137797 ] Hari Shreedharan commented on SPARK-13216: -- I disagree that checkpointing is onl

[jira] [Commented] (SPARK-13171) Update promise & future to Promise and Future as the old ones are deprecated

2016-02-08 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137795#comment-15137795 ] Jakob Odersky commented on SPARK-13171: --- This is very strange, are you sure it has

[jira] [Commented] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2016-02-08 Thread Matt Kapilevich (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137774#comment-15137774 ] Matt Kapilevich commented on SPARK-12194: - I am also looking to capture Spark met

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-02-08 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137771#comment-15137771 ] Mark Grover commented on SPARK-12177: - Hi Rama, This particular PR adds support for t

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Abhinav Chawade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137770#comment-15137770 ] Abhinav Chawade commented on SPARK-13219: - Here is my branch on github if you'd l

[jira] [Created] (SPARK-13236) SQL generation support for union

2016-02-08 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13236: --- Summary: SQL generation support for union Key: SPARK-13236 URL: https://issues.apache.org/jira/browse/SPARK-13236 Project: Spark Issue Type: Sub-task Compone

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137721#comment-15137721 ] Xiao Li commented on SPARK-13219: - Let me try your SQL query in Spark 1.6.1. > Pushdown

[jira] [Commented] (SPARK-13171) Update promise & future to Promise and Future as the old ones are deprecated

2016-02-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137714#comment-15137714 ] holdenk commented on SPARK-13171: - I've been seeing that for intermittently for awhile in

[jira] [Commented] (SPARK-12503) Pushdown a Limit on top of a Union

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137709#comment-15137709 ] Apache Spark commented on SPARK-12503: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137710#comment-15137710 ] Apache Spark commented on SPARK-12505: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Abhinav Chawade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137701#comment-15137701 ] Abhinav Chawade commented on SPARK-13219: - I created a build of Spark 1.4.1 which

[jira] [Commented] (SPARK-13171) Update promise & future to Promise and Future as the old ones are deprecated

2016-02-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137702#comment-15137702 ] Shixiong Zhu commented on SPARK-13171: -- Looks something wrong happened between: [in

[jira] [Updated] (SPARK-13235) Remove an Extra Distinct in Union

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13235: Description: Union Distinct has two Distinct that generate two Aggregation in the plan. {code} sql("select

[jira] [Updated] (SPARK-13235) Remove an Extra Distinct in Union

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13235: Summary: Remove an Extra Distinct in Union (was: Remove an extra Distinct in Union) > Remove an Extra Dis

[jira] [Updated] (SPARK-13235) Remove an extra Distinct in Union

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13235: Summary: Remove an extra Distinct in Union (was: Remove extra Distinct in Union) > Remove an extra Distin

[jira] [Commented] (SPARK-13235) Remove extra Distinct in Union Distinct

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137682#comment-15137682 ] Apache Spark commented on SPARK-13235: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-13235) Remove extra Distinct in Union Distinct

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13235: Assignee: Apache Spark > Remove extra Distinct in Union Distinct > ---

[jira] [Updated] (SPARK-13235) Remove extra Distinct in Union

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13235: Summary: Remove extra Distinct in Union (was: Remove extra Distinct in Union Distinct) > Remove extra Dis

[jira] [Assigned] (SPARK-13235) Remove extra Distinct in Union Distinct

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13235: Assignee: (was: Apache Spark) > Remove extra Distinct in Union Distinct >

[jira] [Commented] (SPARK-13180) Protect against SessionState being null when accessing HiveClientImpl#conf

2016-02-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137674#comment-15137674 ] Ted Yu commented on SPARK-13180: I wonder if we should provide better error message when

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2016-02-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas mad

[jira] [Created] (SPARK-13235) Remove extra Distinct in Union Distinct

2016-02-08 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13235: --- Summary: Remove extra Distinct in Union Distinct Key: SPARK-13235 URL: https://issues.apache.org/jira/browse/SPARK-13235 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10780) Set initialModel in KMeans in Pipelines API

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137607#comment-15137607 ] Apache Spark commented on SPARK-10780: -- User 'yinxusen' has created a pull request f

[jira] [Commented] (SPARK-13210) NPE in Sort

2016-02-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137598#comment-15137598 ] Josh Rosen commented on SPARK-13210: I'm also going to cherry-pick this for 1.6.1. >

[jira] [Resolved] (SPARK-13210) NPE in Sort

2016-02-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13210. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11095 [https://github.

[jira] [Resolved] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

2016-02-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13101. -- Resolution: Fixed Fix Version/s: (was: 1.6.1) 2.0.0 Issue

[jira] [Updated] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

2016-02-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13101: - Fix Version/s: 1.6.1 > Dataset complex types mapping to DataFrame (element nullability)

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137575#comment-15137575 ] Jakob Odersky commented on SPARK-13172: --- I would suggest taking similar approach to

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137575#comment-15137575 ] Jakob Odersky edited comment on SPARK-13172 at 2/8/16 8:03 PM:

[jira] [Updated] (SPARK-13215) Remove fallback in codegen

2016-02-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13215: --- Component/s: SQL > Remove fallback in codegen > -- > > Key: S

[jira] [Updated] (SPARK-12840) Support passing arbitrary objects (not just expressions) into code generated classes

2016-02-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12840: --- Component/s: SQL > Support passing arbitrary objects (not just expressions) into code generated > cl

[jira] [Updated] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

2016-02-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12585: --- Component/s: SQL > The numFields of UnsafeRow should not changed by pointTo() > -

[jira] [Commented] (SPARK-13213) BroadcastNestedLoopJoin is very slow

2016-02-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137551#comment-15137551 ] Davies Liu commented on SPARK-13213: [~sowen] Thanks very much for update these, I tr

[jira] [Resolved] (SPARK-8964) Use Exchange in limit operations (per partition limit -> exchange to one partition -> per partition limit)

2016-02-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8964. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 7334 [https://github.com/

[jira] [Created] (SPARK-13234) Remove duplicated SQL metrics

2016-02-08 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13234: -- Summary: Remove duplicated SQL metrics Key: SPARK-13234 URL: https://issues.apache.org/jira/browse/SPARK-13234 Project: Spark Issue Type: Improvement C

[jira] [Resolved] (SPARK-12986) Fix pydoc warnings in mllib/regression.py

2016-02-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12986. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11025 [https://g

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-02-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15137369#comment-15137369 ] Sean Owen commented on SPARK-6305: -- I've started working on this, and it's as awful a dep

  1   2   >