[jira] [Updated] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3862: --- Target Version/s: 1.6.0 (was: 1.5.0) MultiWayBroadcastInnerHashJoin --

[jira] [Created] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-29 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-9437: --- Summary: SizeEstimator overflows for primitive arrays Key: SPARK-9437 URL: https://issues.apache.org/jira/browse/SPARK-9437 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9437: --- Assignee: Imran Rashid (was: Apache Spark) SizeEstimator overflows for primitive arrays

[jira] [Assigned] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9437: --- Assignee: Apache Spark (was: Imran Rashid) SizeEstimator overflows for primitive arrays

[jira] [Commented] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646342#comment-14646342 ] Apache Spark commented on SPARK-9437: - User 'squito' has created a pull request for

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646376#comment-14646376 ] Reynold Xin commented on SPARK-3862: I don't think that's extreme at all -- very

[jira] [Assigned] (SPARK-9404) UnsafeArrayData

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9404: --- Assignee: Wenchen Fan (was: Apache Spark) UnsafeArrayData ---

[jira] [Commented] (SPARK-9404) UnsafeArrayData

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646444#comment-14646444 ] Apache Spark commented on SPARK-9404: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-9312) The OneVsRest model does not provide confidence factor(not probability) along with the prediction

2015-07-29 Thread Badari Madhav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646277#comment-14646277 ] Badari Madhav commented on SPARK-9312: -- Updated JIRA and PR, please review. The

[jira] [Commented] (SPARK-9416) Yarn logs say that Spark Python job has succeeded even though job has failed in Yarn cluster mode

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646365#comment-14646365 ] Apache Spark commented on SPARK-9416: - User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

2015-07-29 Thread Dmitry Goldenberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646419#comment-14646419 ] Dmitry Goldenberg commented on SPARK-9434: -- Thanks Cody and Sean. I'll take a

[jira] [Resolved] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

2015-07-29 Thread Dmitry Goldenberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Goldenberg resolved SPARK-9434. -- Resolution: Not A Problem Documentation on checkpointing is available in the Spark doc

[jira] [Assigned] (SPARK-9404) UnsafeArrayData

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9404: --- Assignee: Apache Spark (was: Wenchen Fan) UnsafeArrayData ---

[jira] [Created] (SPARK-9438) restarting leader zookeeper causes spark master to die when the spark master election is assigned to zookeeper

2015-07-29 Thread Amir Rad (JIRA)
Amir Rad created SPARK-9438: --- Summary: restarting leader zookeeper causes spark master to die when the spark master election is assigned to zookeeper Key: SPARK-9438 URL:

[jira] [Updated] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

2015-07-29 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-5259: Target Version/s: 1.5.0 Priority: Blocker (was: Major) Fix endless retry stage by add

[jira] [Updated] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-07-29 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-746: --- Assignee: Joseph Batchik Automatically Use Avro Serialization for Avro Objects

[jira] [Commented] (SPARK-5079) Detect failed jobs / batches in Spark Streaming unit tests

2015-07-29 Thread Hunter Morgan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646301#comment-14646301 ] Hunter Morgan commented on SPARK-5079: -- Would it be feasible to restrict test

[jira] [Updated] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

2015-07-29 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-5945: Target Version/s: 1.5.0 Spark should not retry a stage infinitely on a FetchFailedException

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646312#comment-14646312 ] Meihua Wu commented on SPARK-9246: -- Cool. I see. will keep updating about the progress.

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2015-07-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3181: - Shepherd: Xiangrui Meng Add Robust Regression Algorithm with Huber Estimator

[jira] [Resolved] (SPARK-9127) Rand/Randn codegen fails with long seed

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9127. Resolution: Fixed Fix Version/s: 1.5.0 Rand/Randn codegen fails with long seed

[jira] [Updated] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

2015-07-29 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-5945: Priority: Blocker (was: Major) Spark should not retry a stage infinitely on a

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-07-29 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-8029: Target Version/s: 1.5.0 Priority: Blocker (was: Major) ShuffleMapTasks must be robust

[jira] [Commented] (SPARK-5079) Detect failed jobs / batches in Spark Streaming unit tests

2015-07-29 Thread Hunter Morgan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646441#comment-14646441 ] Hunter Morgan commented on SPARK-5079: -- I'm successfully using this pattern to test a

[jira] [Commented] (SPARK-9352) Add tests for standalone scheduling code

2015-07-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646486#comment-14646486 ] Andrew Or commented on SPARK-9352: -- This is actually already fixed. It was reverted at

[jira] [Updated] (SPARK-9441) NoSuchMethodError: Com.typesafe.config.Config.getDuration

2015-07-29 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-9441: --- Description: I recently migrated my spark based rest service from 1.0.2 to 1.3.1 15/07/29 10:31:12

[jira] [Updated] (SPARK-9441) NoSuchMethodError: Com.typesafe.config.Config.getDuration

2015-07-29 Thread nirav patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-9441: --- Description: I recently migrated my spark based rest service from 1.0.2 to 1.3.1 15/07/29 10:31:12

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646535#comment-14646535 ] Joseph K. Bradley commented on SPARK-5133: -- That's my hope... I'll try to send a

[jira] [Created] (SPARK-9441) NoSuchMethodError: Com.typesafe.config.Config.getDuration

2015-07-29 Thread nirav patel (JIRA)
nirav patel created SPARK-9441: -- Summary: NoSuchMethodError: Com.typesafe.config.Config.getDuration Key: SPARK-9441 URL: https://issues.apache.org/jira/browse/SPARK-9441 Project: Spark Issue

[jira] [Commented] (SPARK-8198) date/time function: months_between

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646584#comment-14646584 ] Apache Spark commented on SPARK-8198: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-9133) Add and Subtract should support date/timestamp and interval type

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9133: --- Assignee: Apache Spark (was: Davies Liu) Add and Subtract should support date/timestamp

[jira] [Commented] (SPARK-8187) date/time function: date_sub

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646582#comment-14646582 ] Apache Spark commented on SPARK-8187: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-9444) RemoveEvaluationFromSort reorders sort order

2015-07-29 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-9444: --- Summary: RemoveEvaluationFromSort reorders sort order Key: SPARK-9444 URL: https://issues.apache.org/jira/browse/SPARK-9444 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9446) Clear Active SparkContext in stop() method

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9446: --- Assignee: Apache Spark Clear Active SparkContext in stop() method

[jira] [Assigned] (SPARK-9446) Clear Active SparkContext in stop() method

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9446: --- Assignee: (was: Apache Spark) Clear Active SparkContext in stop() method

[jira] [Commented] (SPARK-9446) Clear Active SparkContext in stop() method

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646728#comment-14646728 ] Apache Spark commented on SPARK-9446: - User 'tedyu' has created a pull request for

[jira] [Created] (SPARK-9446) Clear Active SparkContext in stop() method

2015-07-29 Thread Ted Yu (JIRA)
Ted Yu created SPARK-9446: - Summary: Clear Active SparkContext in stop() method Key: SPARK-9446 URL: https://issues.apache.org/jira/browse/SPARK-9446 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-9436) Simplify Pregel by merging joins

2015-07-29 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reassigned SPARK-9436: - Assignee: Ankur Dave Simplify Pregel by merging joins

[jira] [Assigned] (SPARK-9425) Support DecimalType in UnsafeRow

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9425: --- Assignee: Davies Liu (was: Apache Spark) Support DecimalType in UnsafeRow

[jira] [Resolved] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-29 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov resolved SPARK-9380. - Resolution: Fixed Pregel example fix in graphx-programming-guide

[jira] [Updated] (SPARK-9446) Clear Active SparkContext in stop() method

2015-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9446: - Affects Version/s: 1.4.1 Priority: Minor (was: Major) Component/s: Spark Core

[jira] [Updated] (SPARK-9436) Simplify Pregel by merging joins

2015-07-29 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-9436: -- Assignee: Alexander Ulanov (was: Ankur Dave) Simplify Pregel by merging joins

[jira] [Resolved] (SPARK-9436) Simplify Pregel by merging joins

2015-07-29 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-9436. --- Resolution: Fixed Fix Version/s: (was: 1.4.0) 1.5.0 Issue resolved by

[jira] [Commented] (SPARK-9440) LocalLDAModel should save docConcentration, topicConcentration, and gammaShap

2015-07-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646812#comment-14646812 ] Feynman Liang commented on SPARK-9440: -- PR at

[jira] [Commented] (SPARK-9425) Support DecimalType in UnsafeRow

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646827#comment-14646827 ] Apache Spark commented on SPARK-9425: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-9448) GenerateUnsafeProjection should not share expressions across instances

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9448: --- Assignee: Reynold Xin (was: Apache Spark) GenerateUnsafeProjection should not share

[jira] [Commented] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-29 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646841#comment-14646841 ] Neelesh Srinivas Salian commented on SPARK-9380: Seems to be corrected.

[jira] [Commented] (SPARK-9448) GenerateUnsafeProjection should not share expressions across instances

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646839#comment-14646839 ] Apache Spark commented on SPARK-9448: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-5754) Spark AM not launching on Windows

2015-07-29 Thread Carsten Blank (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646733#comment-14646733 ] Carsten Blank commented on SPARK-5754: -- And in 1.5.0. Actually I have quickly hacked

[jira] [Assigned] (SPARK-9448) GenerateUnsafeProjection should not share expressions across instances

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9448: --- Assignee: Apache Spark (was: Reynold Xin) GenerateUnsafeProjection should not share

[jira] [Assigned] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9380: --- Assignee: (was: Apache Spark) Pregel example fix in graphx-programming-guide

[jira] [Commented] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646845#comment-14646845 ] Apache Spark commented on SPARK-9380: - User 'avulanov' has created a pull request for

[jira] [Assigned] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9380: --- Assignee: Apache Spark Pregel example fix in graphx-programming-guide

[jira] [Resolved] (SPARK-9430) Rename IntervalType to CalendarInterval

2015-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9430. Resolution: Fixed Fix Version/s: 1.5.0 Rename IntervalType to CalendarInterval

[jira] [Created] (SPARK-9448) GenerateUnsafeProjection should not share expressions across instances

2015-07-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9448: -- Summary: GenerateUnsafeProjection should not share expressions across instances Key: SPARK-9448 URL: https://issues.apache.org/jira/browse/SPARK-9448 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-29 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-9380: Comment: was deleted (was: It seems that I did not name the PR correctly. I renamed it and

[jira] [Commented] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-29 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646854#comment-14646854 ] Alexander Ulanov commented on SPARK-9380: - It seems that I did not name the PR

[jira] [Created] (SPARK-9447) Update python API to include RandomForest as classifier changes.

2015-07-29 Thread holdenk (JIRA)
holdenk created SPARK-9447: -- Summary: Update python API to include RandomForest as classifier changes. Key: SPARK-9447 URL: https://issues.apache.org/jira/browse/SPARK-9447 Project: Spark Issue

[jira] [Commented] (SPARK-9447) Update python API to include RandomForest as classifier changes.

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646759#comment-14646759 ] Joseph K. Bradley commented on SPARK-9447: -- Upgrading to Major priority since

[jira] [Updated] (SPARK-9447) Update python API to include RandomForest as classifier changes.

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9447: - Shepherd: Joseph K. Bradley Update python API to include RandomForest as classifier

[jira] [Updated] (SPARK-9447) Update python API to include RandomForest as classifier changes.

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9447: - Priority: Major (was: Minor) Update python API to include RandomForest as classifier

[jira] [Commented] (SPARK-5754) Spark AM not launching on Windows

2015-07-29 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646768#comment-14646768 ] Inigo Goiri commented on SPARK-5754: Thank you [~cbvoxel]] for looking into this. I

[jira] [Assigned] (SPARK-9425) Support DecimalType in UnsafeRow

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9425: --- Assignee: Apache Spark (was: Davies Liu) Support DecimalType in UnsafeRow

[jira] [Commented] (SPARK-9380) Pregel example fix in graphx-programming-guide

2015-07-29 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646853#comment-14646853 ] Alexander Ulanov commented on SPARK-9380: - It seems that I did not name the PR

[jira] [Commented] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

2015-07-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646487#comment-14646487 ] Andrew Or commented on SPARK-8414: -- Oops, you're right. I always mix them up... Ensure

[jira] [Created] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread DB Tsai (JIRA)
DB Tsai created SPARK-9442: -- Summary: java.lang.ArithmeticException: / by zero when reading Parquet Key: SPARK-9442 URL: https://issues.apache.org/jira/browse/SPARK-9442 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7157) Add approximate stratified sampling to DataFrame

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646610#comment-14646610 ] Apache Spark commented on SPARK-7157: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646708#comment-14646708 ] DB Tsai commented on SPARK-9442: I will try to turn on the logging at the info level.

[jira] [Commented] (SPARK-9440) LocalLDAModel should save docConcentration, topicConcentration, and gammaShap

2015-07-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646491#comment-14646491 ] Feynman Liang commented on SPARK-9440: -- Working on this LocalLDAModel should save

[jira] [Created] (SPARK-9440) LocalLDAModel should save docConcentration, topicConcentration, and gammaShap

2015-07-29 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9440: Summary: LocalLDAModel should save docConcentration, topicConcentration, and gammaShap Key: SPARK-9440 URL: https://issues.apache.org/jira/browse/SPARK-9440 Project:

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646570#comment-14646570 ] Meihua Wu commented on SPARK-9246: -- Got it. Thanks! DistributedLDAModel predict top

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646571#comment-14646571 ] Meihua Wu commented on SPARK-9246: -- Got it. Thanks! DistributedLDAModel predict top

[jira] [Closed] (SPARK-9445) Adding custom SerDe when creating Hive tables

2015-07-29 Thread Yashwanth Rao Dannamaneni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yashwanth Rao Dannamaneni closed SPARK-9445. Resolution: Duplicate Adding custom SerDe when creating Hive tables

[jira] [Commented] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646692#comment-14646692 ] François Garillot commented on SPARK-9442: -- This may not be a Spark issue, but

[jira] [Comment Edited] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646705#comment-14646705 ] DB Tsai edited comment on SPARK-9442 at 7/29/15 8:28 PM: - Another

[jira] [Commented] (SPARK-6884) Random forest: predict class probabilities

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646546#comment-14646546 ] Joseph K. Bradley commented on SPARK-6884: -- That's a shame! I hope you're able

[jira] [Commented] (SPARK-9441) NoSuchMethodError: Com.typesafe.config.Config.getDuration

2015-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646578#comment-14646578 ] Sean Owen commented on SPARK-9441: -- Spark uses Akka which uses typesafe config 1.2.1,

[jira] [Updated] (SPARK-7016) Refactor dev/run-tests(-jenkins) from Bash to Python

2015-07-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7016: -- Target Version/s: 1.6.0 (was: 1.5.0) Refactor dev/run-tests(-jenkins) from Bash to Python

[jira] [Updated] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-9442: --- Description: I am counting how many records in my nested parquet file with this schema, {code} scala

[jira] [Updated] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-9442: --- Description: I am counting how many records in my nested parquet file with this schema, {code} scala

[jira] [Commented] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646705#comment-14646705 ] DB Tsai commented on SPARK-9442: Another note: By explicitly looping through the data to

[jira] [Commented] (SPARK-9440) LocalLDAModel should save docConcentration, topicConcentration, and gammaShap

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646565#comment-14646565 ] Joseph K. Bradley commented on SPARK-9440: -- This JIRA is marked as a blocker

[jira] [Updated] (SPARK-9440) LocalLDAModel should save docConcentration, topicConcentration, and gammaShap

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9440: - Priority: Critical (was: Blocker) LocalLDAModel should save docConcentration,

[jira] [Comment Edited] (SPARK-9440) LocalLDAModel should save docConcentration, topicConcentration, and gammaShap

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646565#comment-14646565 ] Joseph K. Bradley edited comment on SPARK-9440 at 7/29/15 6:28 PM:

[jira] [Updated] (SPARK-9440) LocalLDAModel should save docConcentration, topicConcentration, and gammaShap

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9440: - Shepherd: Joseph K. Bradley LocalLDAModel should save docConcentration,

[jira] [Commented] (SPARK-6152) Spark does not support Java 8 compiled Scala classes

2015-07-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646699#comment-14646699 ] Steve Loughran commented on SPARK-6152: --- Chill and Kryo need to be in sync; there's

[jira] [Updated] (SPARK-9352) Add tests for standalone scheduling code

2015-07-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9352: - Labels: (was: backport-needed) Add tests for standalone scheduling code

[jira] [Closed] (SPARK-9352) Add tests for standalone scheduling code

2015-07-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9352. Resolution: Fixed Fix Version/s: 1.4.2 Add tests for standalone scheduling code

[jira] [Updated] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-9442: --- Description: I am counting how many records in my nested parquet file with this schema, {code} scala

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646554#comment-14646554 ] Joseph K. Bradley commented on SPARK-9246: -- If it's much easier or faster

[jira] [Updated] (SPARK-9442) java.lang.ArithmeticException: / by zero when reading Parquet

2015-07-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-9442: --- Description: I am counting how many records in my nested parquet file with this schema, {code} scala

[jira] [Created] (SPARK-9445) Adding custom SerDe when creating Hive tables

2015-07-29 Thread Yashwanth Rao Dannamaneni (JIRA)
Yashwanth Rao Dannamaneni created SPARK-9445: Summary: Adding custom SerDe when creating Hive tables Key: SPARK-9445 URL: https://issues.apache.org/jira/browse/SPARK-9445 Project: Spark

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-29 Thread Parv Oberoi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646493#comment-14646493 ] Parv Oberoi commented on SPARK-5133: [~josephkb]: is the plan to still include this in

[jira] [Assigned] (SPARK-9104) expose network layer memory usage in shuffle part

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9104: --- Assignee: Apache Spark expose network layer memory usage in shuffle part

[jira] [Assigned] (SPARK-9104) expose network layer memory usage in shuffle part

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9104: --- Assignee: (was: Apache Spark) expose network layer memory usage in shuffle part

[jira] [Commented] (SPARK-9104) expose network layer memory usage in shuffle part

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646496#comment-14646496 ] Apache Spark commented on SPARK-9104: - User 'liyezhang556520' has created a pull

[jira] [Commented] (SPARK-8194) date/time function: add_months

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646583#comment-14646583 ] Apache Spark commented on SPARK-8194: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-9133) Add and Subtract should support date/timestamp and interval type

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9133: --- Assignee: Davies Liu (was: Apache Spark) Add and Subtract should support date/timestamp

[jira] [Commented] (SPARK-9133) Add and Subtract should support date/timestamp and interval type

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646585#comment-14646585 ] Apache Spark commented on SPARK-9133: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-8186) date/time function: date_add

2015-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646581#comment-14646581 ] Apache Spark commented on SPARK-8186: - User 'davies' has created a pull request for

  1   2   3   4   >