[jira] [Commented] (SPARK-786) Clean up old work directories in standalone worker

[ https://issues.apache.org/jira/browse/SPARK-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049671#comment-14049671 ] anurag tangri commented on SPARK-786: - Hi, We are also facing this issue. Could somebo

[jira] [Closed] (SPARK-1525) TaskSchedulerImpl should decrease availableCpus by spark.task.cpus not 1

[ https://issues.apache.org/jira/browse/SPARK-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YanTang Zhai closed SPARK-1525. --- Resolution: Fixed > TaskSchedulerImpl should decrease availableCpus by spark.task.cpus not 1 > --

[jira] [Commented] (SPARK-1547) Add gradient boosting algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049659#comment-14049659 ] Hector Yee commented on SPARK-1547: --- Just generic log loss with L1 regularization should

[jira] [Commented] (SPARK-1547) Add gradient boosting algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049644#comment-14049644 ] Manish Amde commented on SPARK-1547: Yes, the loss function and the solver should idea

[jira] [Commented] (SPARK-2306) BoundedPriorityQueue is private and not registered with Kryo

[ https://issues.apache.org/jira/browse/SPARK-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049634#comment-14049634 ] ankit bhardwaj commented on SPARK-2306: --- Please assign this issue to me .I am workin

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049578#comment-14049578 ] Jonathan Kelly commented on SPARK-1981: --- Awesome, thanks! I was at the summit as we

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049560#comment-14049560 ] Patrick Wendell commented on SPARK-1981: Assigned! > Add AWS Kinesis streaming su

[jira] [Updated] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1981: --- Assignee: Chris Fregly > Add AWS Kinesis streaming support >

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049484#comment-14049484 ] Chris Fregly commented on SPARK-1981: - hey jonathan! i was just talking to the databr

[jira] [Resolved] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2003. Resolution: Won't Fix > SparkContext(SparkConf) doesn't work in pyspark > -

[jira] [Commented] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049456#comment-14049456 ] Patrick Wendell commented on SPARK-2003: If I understand correctly, [~dcarr...@clo

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049442#comment-14049442 ] Jonathan Kelly commented on SPARK-1981: --- Chris, Has there been any more progress on

[jira] [Updated] (SPARK-2340) Resolve paths properly for event logging / history server

[ https://issues.apache.org/jira/browse/SPARK-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2340: - Summary: Resolve paths properly for event logging / history server (was: Resolve paths properly for Hist

[jira] [Commented] (SPARK-2047) Use less memory in AppendOnlyMap.destructiveSortedIterator

[ https://issues.apache.org/jira/browse/SPARK-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049435#comment-14049435 ] Arun Ramakrishnan commented on SPARK-2047: -- I can work on this. [~matei] Can you

[jira] [Updated] (SPARK-2340) Resolve paths properly for History Server

[ https://issues.apache.org/jira/browse/SPARK-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2340: - Description: We resolved paths for --jars and --files for spark submit when releasing Spark 1.0. The path

[jira] [Created] (SPARK-2340) Resolve paths properly for History Server

Andrew Or created SPARK-2340: Summary: Resolve paths properly for History Server Key: SPARK-2340 URL: https://issues.apache.org/jira/browse/SPARK-2340 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-1547) Add gradient boosting algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049394#comment-14049394 ] Hector Yee commented on SPARK-1547: --- Honestly trees are most useful when the feature vec

[jira] [Commented] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049376#comment-14049376 ] Ryan Fishel commented on SPARK-1010: Is this issue still unresolved? > Update all uni

[jira] [Updated] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

[ https://issues.apache.org/jira/browse/SPARK-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2339: Affects Version/s: 1.0.0 > SQL parser in sql-core is case sensitive, but a table alias is converted to > l

[jira] [Created] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

Yin Huai created SPARK-2339: --- Summary: SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery Key: SPARK-2339 URL: https://issues.apache.org/jira/browse/SPARK-2339

[jira] [Commented] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049243#comment-14049243 ] Matthew Farrellee commented on SPARK-2003: -- good catch! i misspoke, you need setM

[jira] [Updated] (SPARK-2338) Jenkins Spark-Master-Maven-with-YARN builds failing due to test misconfiguration

[ https://issues.apache.org/jira/browse/SPARK-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete MacKinnon updated SPARK-2338: -- Description: https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/hadoop.ver

[jira] [Updated] (SPARK-2338) Jenkins Spark-Master-Maven-with-YARN builds failing due to test misconfiguration

[ https://issues.apache.org/jira/browse/SPARK-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete MacKinnon updated SPARK-2338: -- Description: {noformat} https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN

[jira] [Created] (SPARK-2338) Jenkins Spark-Master-Maven-with-YARN builds failing due to test misconfiguration

Pete MacKinnon created SPARK-2338: - Summary: Jenkins Spark-Master-Maven-with-YARN builds failing due to test misconfiguration Key: SPARK-2338 URL: https://issues.apache.org/jira/browse/SPARK-2338 Proj

[jira] [Created] (SPARK-2337) String Interpolation for SparkSQL queries

Ahir Reddy created SPARK-2337: - Summary: String Interpolation for SparkSQL queries Key: SPARK-2337 URL: https://issues.apache.org/jira/browse/SPARK-2337 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049156#comment-14049156 ] Brian Gawalt commented on SPARK-2335: - (This is my first issue here, so let me know if

[jira] [Created] (SPARK-2336) Approximate k-NN Models for MLLib

Brian Gawalt created SPARK-2336: --- Summary: Approximate k-NN Models for MLLib Key: SPARK-2336 URL: https://issues.apache.org/jira/browse/SPARK-2336 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

Brian Gawalt created SPARK-2335: --- Summary: k-Nearest Neighbor classification and regression for MLLib Key: SPARK-2335 URL: https://issues.apache.org/jira/browse/SPARK-2335 Project: Spark Issue

[jira] [Commented] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049084#comment-14049084 ] Diana Carroll commented on SPARK-2003: -- Actually you can't create a SparkContext in t

[jira] [Commented] (SPARK-2167) spark-submit should return exit code based on failure/success

[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049033#comment-14049033 ] Guoqiang Li commented on SPARK-2167: [~tgraves] I have some work related to the questi

[jira] [Commented] (SPARK-1525) TaskSchedulerImpl should decrease availableCpus by spark.task.cpus not 1

[ https://issues.apache.org/jira/browse/SPARK-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049054#comment-14049054 ] Nan Zhu commented on SPARK-1525: this is fixed by https://github.com/apache/spark/commit/

[jira] [Commented] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049047#comment-14049047 ] Matthew Farrellee commented on SPARK-2003: -- [~dcarr...@cloudera.com] - it does l

[jira] [Reopened] (SPARK-2003) SparkContext(SparkConf) doesn't work in pyspark

[ https://issues.apache.org/jira/browse/SPARK-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Diana Carroll reopened SPARK-2003: -- > SparkContext(SparkConf) doesn't work in pyspark > ---

[jira] [Created] (SPARK-2334) Attribute Error calling PipelinedRDD.id() in pyspark

Diana Carroll created SPARK-2334: Summary: Attribute Error calling PipelinedRDD.id() in pyspark Key: SPARK-2334 URL: https://issues.apache.org/jira/browse/SPARK-2334 Project: Spark Issue Type

[jira] [Commented] (SPARK-2167) spark-submit should return exit code based on failure/success

[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048890#comment-14048890 ] Thomas Graves commented on SPARK-2167: -- There might be multiple issues. I know there

[jira] [Comment Edited] (SPARK-2331) SparkContext.emptyRDD has wrong return type

[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048884#comment-14048884 ] Ian Hummel edited comment on SPARK-2331 at 7/1/14 1:46 PM: --- Hi S

[jira] [Commented] (SPARK-2331) SparkContext.emptyRDD has wrong return type

[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048884#comment-14048884 ] Ian Hummel commented on SPARK-2331: --- Hi Sean, The code I was testing was actually equiv

[jira] [Commented] (SPARK-1764) EOF reached before Python server acknowledged

[ https://issues.apache.org/jira/browse/SPARK-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048808#comment-14048808 ] nigel commented on SPARK-1764: -- I have seen this issue in a cut of the main branch take on fr

[jira] [Commented] (SPARK-2324) SparkContext should not exit directly when spark.local.dir is a list of multiple paths and one of them has error

[ https://issues.apache.org/jira/browse/SPARK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048745#comment-14048745 ] YanTang Zhai commented on SPARK-2324: - I've created PR: https://github.com/apache/spar

[jira] [Resolved] (SPARK-2185) Scheduler should print warning when tasks are larger than the recommended size

[ https://issues.apache.org/jira/browse/SPARK-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2185. Resolution: Fixed Fix Version/s: 1.1.0 > Scheduler should print warning when tasks are large

[jira] [Resolved] (SPARK-2332) add exclusion for old servlet-api on hadoop-client in core

[ https://issues.apache.org/jira/browse/SPARK-2332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2332. Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Pete MacKinnon > add exclusion for

[jira] [Comment Edited] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048653#comment-14048653 ] Raymond Liu edited comment on SPARK-1097 at 7/1/14 8:48 AM: Su

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048653#comment-14048653 ] Raymond Liu commented on SPARK-1097: Summit another PR to actually(hopes) fix this pro