[jira] [Commented] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Atkins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137222#comment-15137222 ] Atkins commented on SPARK-13232: If spark config "spark.yarn.executor.nodeLabelExpression" present,

[jira] [Updated] (SPARK-13104) Spark Metrics currently does not return executors hostname

2016-02-08 Thread Karthik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik updated SPARK-13104: Description: We been using Spark Metrics and porting the data to InfluxDB using the Graphite sink that is

[jira] [Comment Edited] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Atkins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137222#comment-15137222 ] Atkins edited comment on SPARK-13232 at 2/8/16 4:59 PM: I am telling about yarn

[jira] [Created] (SPARK-13233) Python Dataset

2016-02-08 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-13233: --- Summary: Python Dataset Key: SPARK-13233 URL: https://issues.apache.org/jira/browse/SPARK-13233 Project: Spark Issue Type: New Feature Components:

[jira] [Commented] (SPARK-13233) Python Dataset

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137180#comment-15137180 ] Apache Spark commented on SPARK-13233: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13233) Python Dataset

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13233: Assignee: (was: Apache Spark) > Python Dataset > -- > >

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137136#comment-15137136 ] sachin aggarwal commented on SPARK-13172: - instead of getStackTraceString should I use

[jira] [Comment Edited] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-02-08 Thread Sangeet Chourey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137168#comment-15137168 ] Sangeet Chourey edited comment on SPARK-10528 at 2/8/16 4:26 PM: -

[jira] [Assigned] (SPARK-13233) Python Dataset

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13233: Assignee: Apache Spark > Python Dataset > -- > > Key:

[jira] [Commented] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

2016-02-08 Thread Sangeet Chourey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137201#comment-15137201 ] Sangeet Chourey commented on SPARK-10066: - RESOLVED : Downloaded the correct Winutils version and

[jira] [Updated] (SPARK-13233) Python Dataset

2016-02-08 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-13233: Attachment: DesignDocPythonDataset.pdf > Python Dataset > -- > > Key:

[jira] [Updated] (SPARK-13233) Python Dataset

2016-02-08 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-13233: Description: add Python Dataset w.r.t. the scala version > Python Dataset > -- > >

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-02-08 Thread Sangeet Chourey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137168#comment-15137168 ] Sangeet Chourey commented on SPARK-10528: - RESOLVED : Downloaded the correct Winutils version

[jira] [Commented] (SPARK-11714) Make Spark on Mesos honor port restrictions

2016-02-08 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136747#comment-15136747 ] Stavros Kontopoulos commented on SPARK-11714: - [~andrewor14] Would it be meaningful to move

[jira] [Comment Edited] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Herman Schistad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136757#comment-15136757 ] Herman Schistad edited comment on SPARK-13198 at 2/8/16 9:55 AM: - Hi

[jira] [Assigned] (SPARK-13177) Update ActorWordCount example to not directly use low level linked list as it is deprecated.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13177: Assignee: (was: Apache Spark) > Update ActorWordCount example to not directly use low

[jira] [Assigned] (SPARK-7848) Update SparkStreaming docs to incorporate FAQ and/or bullets w/ "knobs" information.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7848: --- Assignee: Apache Spark > Update SparkStreaming docs to incorporate FAQ and/or bullets w/

[jira] [Assigned] (SPARK-7848) Update SparkStreaming docs to incorporate FAQ and/or bullets w/ "knobs" information.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7848: --- Assignee: (was: Apache Spark) > Update SparkStreaming docs to incorporate FAQ and/or

[jira] [Commented] (SPARK-7848) Update SparkStreaming docs to incorporate FAQ and/or bullets w/ "knobs" information.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136849#comment-15136849 ] Apache Spark commented on SPARK-7848: - User 'nirmannarang' has created a pull request for this issue:

[jira] [Updated] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Herman Schistad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman Schistad updated SPARK-13198: Attachment: Screen Shot 2016-02-08 at 09.30.59.png Screen Shot 2016-02-08

[jira] [Issue Comment Deleted] (SPARK-13156) JDBC using multiple partitions creates additional tasks but only executes on one

2016-02-08 Thread Charles Drotar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Drotar updated SPARK-13156: --- Comment: was deleted (was: Thanks Sean. The driver inhibiting the concurrent connections was

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Herman Schistad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136774#comment-15136774 ] Herman Schistad commented on SPARK-13198: - Digging more into the dumped heap and running a memory

[jira] [Created] (SPARK-13231) Rename Accumulable.countFailedValues to Accumulable.includeValuesOfFailedTasks and make it a user facing API.

2016-02-08 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-13231: --- Summary: Rename Accumulable.countFailedValues to Accumulable.includeValuesOfFailedTasks and make it a user facing API. Key: SPARK-13231 URL:

[jira] [Commented] (SPARK-13156) JDBC using multiple partitions creates additional tasks but only executes on one

2016-02-08 Thread Charles Drotar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136834#comment-15136834 ] Charles Drotar commented on SPARK-13156: Thanks Sean. The driver inhibiting the concurrent

[jira] [Closed] (SPARK-13156) JDBC using multiple partitions creates additional tasks but only executes on one

2016-02-08 Thread Charles Drotar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Drotar closed SPARK-13156. -- Resolution: Not A Problem The driver class was inhibiting concurrent connections. This was

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Herman Schistad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136757#comment-15136757 ] Herman Schistad commented on SPARK-13198: - Hi [~srowen], thanks for your reply. I have indeed

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136773#comment-15136773 ] Sean Owen commented on SPARK-13198: --- I don't think stop() is relevant here. There's not an active

[jira] [Updated] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Herman Schistad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman Schistad updated SPARK-13198: Attachment: Screen Shot 2016-02-08 at 10.03.04.png > sc.stop() does not clean up on

[jira] [Commented] (SPARK-13177) Update ActorWordCount example to not directly use low level linked list as it is deprecated.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136791#comment-15136791 ] Apache Spark commented on SPARK-13177: -- User 'agsachin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13177) Update ActorWordCount example to not directly use low level linked list as it is deprecated.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13177: Assignee: Apache Spark > Update ActorWordCount example to not directly use low level

[jira] [Commented] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-02-08 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138251#comment-15138251 ] Devaraj K commented on SPARK-13117: --- Thanks [~jjordan]. > WebUI should use the local ip not 0.0.0.0 >

[jira] [Comment Edited] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138289#comment-15138289 ] Xiao Li edited comment on SPARK-13219 at 2/9/16 3:50 AM: - Could you wait for me

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138297#comment-15138297 ] Xiao Li commented on SPARK-13219: - It should works without Join clauses, as long as these predicates are

[jira] [Created] (SPARK-13238) Add ganglia dmax parameter

2016-02-08 Thread Ekasit Kijsipongse (JIRA)
Ekasit Kijsipongse created SPARK-13238: -- Summary: Add ganglia dmax parameter Key: SPARK-13238 URL: https://issues.apache.org/jira/browse/SPARK-13238 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13219: Comment: was deleted (was: Could you wait for me to fix another issue? When I tried your query, I found a

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138404#comment-15138404 ] Xiao Li commented on SPARK-13219: - Sorry, there is a bug in the original PR. You just need to change the

[jira] [Resolved] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

2016-02-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12992. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11055

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138423#comment-15138423 ] sachin aggarwal edited comment on SPARK-13172 at 2/9/16 6:49 AM: - There

[jira] [Commented] (SPARK-13017) Replace example code in mllib-feature-extraction.md using include_example

2016-02-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138310#comment-15138310 ] Xin Ren commented on SPARK-13017: - I'm working on this one, thanks :) > Replace example code in

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138423#comment-15138423 ] sachin aggarwal edited comment on SPARK-13172 at 2/9/16 6:33 AM: - there

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138423#comment-15138423 ] sachin aggarwal edited comment on SPARK-13172 at 2/9/16 6:33 AM: - there

[jira] [Comment Edited] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138423#comment-15138423 ] sachin aggarwal edited comment on SPARK-13172 at 2/9/16 6:35 AM: - there

[jira] [Commented] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138220#comment-15138220 ] Apache Spark commented on SPARK-13054: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-02-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13054: -- Comment: was deleted (was: User 'andrewor14' has created a pull request for this issue:

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138423#comment-15138423 ] sachin aggarwal commented on SPARK-13172: - there are two ways we can proceed :- first use

[jira] [Assigned] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13232: Assignee: Apache Spark > YARN executor node label expressions >

[jira] [Created] (SPARK-13239) Click-Through Rate Prediction

2016-02-08 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-13239: --- Summary: Click-Through Rate Prediction Key: SPARK-13239 URL: https://issues.apache.org/jira/browse/SPARK-13239 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-13239) Click-Through Rate Prediction

2016-02-08 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138490#comment-15138490 ] Yu Ishikawa commented on SPARK-13239: - I'm working on this issue. > Click-Through Rate Prediction >

[jira] [Commented] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138307#comment-15138307 ] Apache Spark commented on SPARK-13015: -- User 'keypointt' has created a pull request for this issue:

[jira] [Commented] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2016-02-08 Thread Rishabh Bhardwaj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138340#comment-15138340 ] Rishabh Bhardwaj commented on SPARK-12329: -- [~ashwinshankar77] Are you working on this or can I

[jira] [Commented] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2016-02-08 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138381#comment-15138381 ] Ashwin Shankar commented on SPARK-12329: Yep, feel free to take it. > spark-sql prints out SET

[jira] [Closed] (SPARK-12357) Implement unhandledFilter interface for JDBC

2016-02-08 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende closed SPARK-12357. --- Resolution: Duplicate > Implement unhandledFilter interface for JDBC >

[jira] [Assigned] (SPARK-13238) Add ganglia dmax parameter

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13238: Assignee: (was: Apache Spark) > Add ganglia dmax parameter >

[jira] [Commented] (SPARK-13238) Add ganglia dmax parameter

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138275#comment-15138275 ] Apache Spark commented on SPARK-13238: -- User 'ekasitk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13238) Add ganglia dmax parameter

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13238: Assignee: Apache Spark > Add ganglia dmax parameter > -- > >

[jira] [Comment Edited] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138297#comment-15138297 ] Xiao Li edited comment on SPARK-13219 at 2/9/16 3:57 AM: - It should work without

[jira] [Assigned] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13015: Assignee: (was: Apache Spark) > Replace example code in mllib-data-types.md using

[jira] [Assigned] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13015: Assignee: Apache Spark > Replace example code in mllib-data-types.md using

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-08 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138447#comment-15138447 ] Jakob Odersky commented on SPARK-13172: --- Cool, thanks for the snippet! I agree, the first approach

[jira] [Assigned] (SPARK-13237) Generate broadcast outer join

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13237: Assignee: Apache Spark (was: Davies Liu) > Generate broadcast outer join >

[jira] [Assigned] (SPARK-13237) Generate broadcast outer join

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13237: Assignee: Davies Liu (was: Apache Spark) > Generate broadcast outer join >

[jira] [Commented] (SPARK-13237) Generate broadcast outer join

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138488#comment-15138488 ] Apache Spark commented on SPARK-13237: -- User 'davies' has created a pull request for this issue:

[jira] [Reopened] (SPARK-12921) Use SparkHadoopUtil reflection to access TaskAttemptContext in SpecificParquetRecordReaderBase

2016-02-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-12921: Looks like there's still one more spot that I missed, so I'm going to reopen this and will submit a

[jira] [Comment Edited] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138289#comment-15138289 ] Xiao Li edited comment on SPARK-13219 at 2/9/16 3:42 AM: - Could you wait for me

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138289#comment-15138289 ] Xiao Li commented on SPARK-13219: - Could you wait for me to fix another issue? When I tried your query, I

[jira] [Comment Edited] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138297#comment-15138297 ] Xiao Li edited comment on SPARK-13219 at 2/9/16 3:51 AM: - It should work without

[jira] [Assigned] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13232: Assignee: (was: Apache Spark) > YARN executor node label expressions >

[jira] [Commented] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138438#comment-15138438 ] Apache Spark commented on SPARK-13232: -- User 'AtkinsChang' has created a pull request for this

[jira] [Commented] (SPARK-13013) Replace example code in mllib-clustering.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137004#comment-15137004 ] Apache Spark commented on SPARK-13013: -- User 'keypointt' has created a pull request for this issue:

[jira] [Created] (SPARK-13232) YARN executor node label expressions bug

2016-02-08 Thread Atkins (JIRA)
Atkins created SPARK-13232: -- Summary: YARN executor node label expressions bug Key: SPARK-13232 URL: https://issues.apache.org/jira/browse/SPARK-13232 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-13231) Rename Accumulable.countFailedValues to Accumulable.includeValuesOfFailedTasks and make it a user facing API.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13231: Assignee: (was: Apache Spark) > Rename Accumulable.countFailedValues to >

[jira] [Assigned] (SPARK-13231) Rename Accumulable.countFailedValues to Accumulable.includeValuesOfFailedTasks and make it a user facing API.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13231: Assignee: Apache Spark > Rename Accumulable.countFailedValues to >

[jira] [Commented] (SPARK-13231) Rename Accumulable.countFailedValues to Accumulable.includeValuesOfFailedTasks and make it a user facing API.

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136944#comment-15136944 ] Apache Spark commented on SPARK-13231: -- User 'ScrapCodes' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13013) Replace example code in mllib-clustering.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13013: Assignee: Apache Spark > Replace example code in mllib-clustering.md using

[jira] [Assigned] (SPARK-13013) Replace example code in mllib-clustering.md using include_example

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13013: Assignee: (was: Apache Spark) > Replace example code in mllib-clustering.md using

[jira] [Commented] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

2016-02-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137000#comment-15137000 ] Thomas Graves commented on SPARK-12316: --- you say "endless cycle call" do you mean the application

[jira] [Commented] (SPARK-13014) Replace example code in mllib-collaborative-filtering.md using include_example

2016-02-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137007#comment-15137007 ] Xin Ren commented on SPARK-13014: - I'm working on this one, thanks :) > Replace example code in

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-02-08 Thread Rama Mullapudi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137029#comment-15137029 ] Rama Mullapudi commented on SPARK-12177: Does the update include kerberos support, since 0.9

[jira] [Updated] (SPARK-13232) YARN executor node label expressions

2016-02-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13232: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Summary: YARN executor

[jira] [Updated] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

2016-02-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-12316: -- Assignee: SaintBacchus > Stack overflow with endless call of `Delegation token thread` when >

[jira] [Updated] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13219: Component/s: (was: Spark Core) SQL > Pushdown predicate propagation in SparkSQL with

[jira] [Commented] (SPARK-7889) Jobs progress of apps on complete page of HistoryServer shows uncompleted

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137336#comment-15137336 ] Apache Spark commented on SPARK-7889: - User 'squito' has created a pull request for this issue:

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137333#comment-15137333 ] Xiao Li commented on SPARK-13219: - Welcome > Pushdown predicate propagation in SparkSQL with join >

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-02-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137369#comment-15137369 ] Sean Owen commented on SPARK-6305: -- I've started working on this, and it's as awful a dependency mess as

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Abhinav Chawade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137330#comment-15137330 ] Abhinav Chawade commented on SPARK-13219: - Thanks Xiao. I will pull in the request and see how it

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137282#comment-15137282 ] Xiao Li commented on SPARK-13219: - See this PR: https://github.com/apache/spark/pull/10490. Let me know

[jira] [Commented] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-02-08 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137320#comment-15137320 ] Devaraj K commented on SPARK-13117: --- Thanks [~jjordan] for reporting. I would like to provide PR if you

[jira] [Resolved] (SPARK-12455) Add ExpressionDescription to window functions

2016-02-08 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-12455. --- Resolution: Resolved Fix Version/s: 2.0.0 > Add ExpressionDescription to

[jira] [Commented] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-02-08 Thread Jeremiah Jordan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137353#comment-15137353 ] Jeremiah Jordan commented on SPARK-13117: - go for it. > WebUI should use the local ip not

[jira] [Commented] (SPARK-13016) Replace example code in mllib-dimensionality-reduction.md using include_example

2016-02-08 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137310#comment-15137310 ] Devaraj K commented on SPARK-13016: --- I am working on this, I will provide PR for this. Thanks >

[jira] [Commented] (SPARK-13235) Remove extra Distinct in Union Distinct

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137682#comment-15137682 ] Apache Spark commented on SPARK-13235: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13235) Remove extra Distinct in Union Distinct

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13235: Assignee: Apache Spark > Remove extra Distinct in Union Distinct >

[jira] [Updated] (SPARK-13235) Remove extra Distinct in Union

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13235: Summary: Remove extra Distinct in Union (was: Remove extra Distinct in Union Distinct) > Remove extra

[jira] [Assigned] (SPARK-13235) Remove extra Distinct in Union Distinct

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13235: Assignee: (was: Apache Spark) > Remove extra Distinct in Union Distinct >

[jira] [Commented] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137710#comment-15137710 ] Apache Spark commented on SPARK-12505: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-12503) Pushdown a Limit on top of a Union

2016-02-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137709#comment-15137709 ] Apache Spark commented on SPARK-12503: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137721#comment-15137721 ] Xiao Li commented on SPARK-13219: - Let me try your SQL query in Spark 1.6.1. > Pushdown predicate

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2016-02-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Commented] (SPARK-13180) Protect against SessionState being null when accessing HiveClientImpl#conf

2016-02-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137674#comment-15137674 ] Ted Yu commented on SPARK-13180: I wonder if we should provide better error message when NPE happens -

[jira] [Created] (SPARK-13236) SQL generation support for union

2016-02-08 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13236: --- Summary: SQL generation support for union Key: SPARK-13236 URL: https://issues.apache.org/jira/browse/SPARK-13236 Project: Spark Issue Type: Sub-task

  1   2   >