[jira] [Commented] (SPARK-10469) Document tungsten-sort

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733375#comment-14733375 ] Apache Spark commented on SPARK-10469: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10469) Document tungsten-sort

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10469: Assignee: Apache Spark > Document tungsten-sort > -- > >

[jira] [Resolved] (SPARK-1159) Add Shortest-path computations to graphx.lib

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1159. -- Resolution: Duplicate > Add Shortest-path computations to graphx.lib >

[jira] [Created] (SPARK-10472) UserDefinedType.typeName gives wrong result

2015-09-07 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10472: -- Summary: UserDefinedType.typeName gives wrong result Key: SPARK-10472 URL: https://issues.apache.org/jira/browse/SPARK-10472 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-10470) ml.IsotonicRegressionModel.copy did not set parent

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10470: Assignee: Apache Spark > ml.IsotonicRegressionModel.copy did not set parent >

[jira] [Commented] (SPARK-10470) ml.IsotonicRegressionModel.copy did not set parent

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733343#comment-14733343 ] Apache Spark commented on SPARK-10470: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10470) ml.IsotonicRegressionModel.copy did not set parent

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10470: Assignee: (was: Apache Spark) > ml.IsotonicRegressionModel.copy did not set parent >

[jira] [Closed] (SPARK-10362) Cannot create DataFrame from large pandas.DataFrame

2015-09-07 Thread Hsueh-Min Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hsueh-Min Chen closed SPARK-10362. -- Resolution: Won't Fix > Cannot create DataFrame from large pandas.DataFrame >

[jira] [Assigned] (SPARK-10471) Mesos Scheduler should reject offers not matching constraints for longer period of time

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10471: Assignee: (was: Apache Spark) > Mesos Scheduler should reject offers not matching

[jira] [Commented] (SPARK-10471) Mesos Scheduler should reject offers not matching constraints for longer period of time

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733390#comment-14733390 ] Apache Spark commented on SPARK-10471: -- User 'felixb' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10469) Document tungsten-sort

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10469: Assignee: (was: Apache Spark) > Document tungsten-sort > -- > >

[jira] [Commented] (SPARK-10462) spark-ec2 not creating ephemeral volumes

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733388#comment-14733388 ] Sean Owen commented on SPARK-10462: --- Have a look at https://github.com/amplab/spark-ec2 -- the question

[jira] [Commented] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733384#comment-14733384 ] Sean Owen commented on SPARK-3369: -- Yeah you can just use {{IteratorIterable}} too without Java 8 or

[jira] [Created] (SPARK-10470) ml.IsotonicRegressionModel.copy did not set parent

2015-09-07 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-10470: --- Summary: ml.IsotonicRegressionModel.copy did not set parent Key: SPARK-10470 URL: https://issues.apache.org/jira/browse/SPARK-10470 Project: Spark Issue Type:

[jira] [Created] (SPARK-10471) Mesos Scheduler should reject offers not matching constraints for longer period of time

2015-09-07 Thread Felix Bechstein (JIRA)
Felix Bechstein created SPARK-10471: --- Summary: Mesos Scheduler should reject offers not matching constraints for longer period of time Key: SPARK-10471 URL: https://issues.apache.org/jira/browse/SPARK-10471

[jira] [Assigned] (SPARK-10471) Mesos Scheduler should reject offers not matching constraints for longer period of time

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10471: Assignee: Apache Spark > Mesos Scheduler should reject offers not matching constraints

[jira] [Updated] (SPARK-10148) Display active and inactive receiver numbers in Streaming page

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10148: -- Assignee: Shixiong Zhu Priority: Minor (was: Major) > Display active and inactive receiver

[jira] [Assigned] (SPARK-10472) UserDefinedType.typeName gives wrong result

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10472: Assignee: Cheng Lian (was: Apache Spark) > UserDefinedType.typeName gives wrong result >

[jira] [Assigned] (SPARK-10472) UserDefinedType.typeName gives wrong result

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10472: Assignee: Apache Spark (was: Cheng Lian) > UserDefinedType.typeName gives wrong result >

[jira] [Commented] (SPARK-10472) UserDefinedType.typeName gives wrong result

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733488#comment-14733488 ] Apache Spark commented on SPARK-10472: -- User 'liancheng' has created a pull request for this issue:

[jira] [Updated] (SPARK-10469) Document tungsten-sort

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10469: -- Priority: Minor (was: Major) Component/s: Documentation > Document tungsten-sort >

[jira] [Resolved] (SPARK-10405) Support takeOrdered and topK values per key

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10405. --- Resolution: Won't Fix > Support takeOrdered and topK values per key >

[jira] [Created] (SPARK-10473) EventLog will loss message in the long-running security application

2015-09-07 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-10473: Summary: EventLog will loss message in the long-running security application Key: SPARK-10473 URL: https://issues.apache.org/jira/browse/SPARK-10473 Project: Spark

[jira] [Commented] (SPARK-10460) fieldIndex method missing on spark.sql.Row

2015-09-07 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733620#comment-14733620 ] somil deshmukh commented on SPARK-10460: I think u need to import "import

[jira] [Assigned] (SPARK-8467) Add LDAModel.describeTopics() in Python

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8467: --- Assignee: Apache Spark > Add LDAModel.describeTopics() in Python >

[jira] [Assigned] (SPARK-8467) Add LDAModel.describeTopics() in Python

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8467: --- Assignee: (was: Apache Spark) > Add LDAModel.describeTopics() in Python >

[jira] [Commented] (SPARK-8467) Add LDAModel.describeTopics() in Python

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733728#comment-14733728 ] Apache Spark commented on SPARK-8467: - User 'yu-iskw' has created a pull request for this issue:

[jira] [Updated] (SPARK-10474) Aggregation failed with unable to acquire memory

2015-09-07 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou updated SPARK-10474: Description: In aggregation case, a Lost task happened with below error. I am not sure if the root cause

[jira] [Created] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

2015-09-07 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-10477: --- Summary: using DSL in ColumnPruningSuite to improve readablity Key: SPARK-10477 URL: https://issues.apache.org/jira/browse/SPARK-10477 Project: Spark Issue

[jira] [Created] (SPARK-10476) Add common RDD API methods to standard Scala collections

2015-09-07 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-10476: --- Summary: Add common RDD API methods to standard Scala collections Key: SPARK-10476 URL: https://issues.apache.org/jira/browse/SPARK-10476 Project: Spark

[jira] [Assigned] (SPARK-10475) improve column prunning for Project on Sort

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10475: Assignee: (was: Apache Spark) > improve column prunning for Project on Sort >

[jira] [Commented] (SPARK-10475) improve column prunning for Project on Sort

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733870#comment-14733870 ] Apache Spark commented on SPARK-10475: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10475) improve column prunning for Project on Sort

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10475: Assignee: Apache Spark > improve column prunning for Project on Sort >

[jira] [Created] (SPARK-10474) Aggregation failed with unable to acquire memory

2015-09-07 Thread Yi Zhou (JIRA)
Yi Zhou created SPARK-10474: --- Summary: Aggregation failed with unable to acquire memory Key: SPARK-10474 URL: https://issues.apache.org/jira/browse/SPARK-10474 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10474) Aggregation failed with unable to acquire memory

2015-09-07 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou updated SPARK-10474: Description: In aggregation case, a Lost task happened with below error. java.io.IOException: Could not

[jira] [Created] (SPARK-10475) improve column prunning for Project on Sort

2015-09-07 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-10475: --- Summary: improve column prunning for Project on Sort Key: SPARK-10475 URL: https://issues.apache.org/jira/browse/SPARK-10475 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8632) Poor Python UDF performance because of RDD caching

2015-09-07 Thread Justin Uang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733867#comment-14733867 ] Justin Uang commented on SPARK-8632: Yea, I think that's the best solution for udfs, since the number

[jira] [Updated] (SPARK-10476) Add common RDD operations on standard Scala collections

2015-09-07 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-10476: Summary: Add common RDD operations on standard Scala collections (was: Add common RDD API

[jira] [Updated] (SPARK-10476) Enable common RDD operations on standard Scala collections

2015-09-07 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-10476: Summary: Enable common RDD operations on standard Scala collections (was: Add common RDD

[jira] [Updated] (SPARK-10186) Add support for more postgres column types

2015-09-07 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-10186: Description: The specific observations below are based on Postgres 9.4 tables accessed via

[jira] [Assigned] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10477: Assignee: (was: Apache Spark) > using DSL in ColumnPruningSuite to improve readablity

[jira] [Commented] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733881#comment-14733881 ] Apache Spark commented on SPARK-10477: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10477: Assignee: Apache Spark > using DSL in ColumnPruningSuite to improve readablity >

[jira] [Commented] (SPARK-8467) Add LDAModel.describeTopics() in Python

2015-09-07 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733729#comment-14733729 ] Yu Ishikawa commented on SPARK-8467: Sorry for the delay of my reply. I just sent a PR about this

[jira] [Commented] (SPARK-9996) Create local nested loop join operator

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733684#comment-14733684 ] Apache Spark commented on SPARK-9996: - User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9997) Create local Expand operator

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9997: --- Assignee: Apache Spark > Create local Expand operator > > >

[jira] [Assigned] (SPARK-9997) Create local Expand operator

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9997: --- Assignee: (was: Apache Spark) > Create local Expand operator >

[jira] [Commented] (SPARK-9997) Create local Expand operator

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733685#comment-14733685 ] Apache Spark commented on SPARK-9997: - User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9996) Create local nested loop join operator

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9996: --- Assignee: (was: Apache Spark) > Create local nested loop join operator >

[jira] [Assigned] (SPARK-9996) Create local nested loop join operator

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9996: --- Assignee: Apache Spark > Create local nested loop join operator >

[jira] [Updated] (SPARK-10474) Aggregation failed with unable to acquire memory

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10474: -- Target Version/s: (was: 1.5.0) @Yi zhou please don't set Target Version. Review

[jira] [Comment Edited] (SPARK-10460) fieldIndex method missing on spark.sql.Row

2015-09-07 Thread FELIPE Q B ALMEIDA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733918#comment-14733918 ] FELIPE Q B ALMEIDA edited comment on SPARK-10460 at 9/7/15 5:00 PM: I

[jira] [Commented] (SPARK-10460) fieldIndex method missing on spark.sql.Row

2015-09-07 Thread FELIPE Q B ALMEIDA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733918#comment-14733918 ] FELIPE Q B ALMEIDA commented on SPARK-10460: I am. These are the imports I'm using:

[jira] [Commented] (SPARK-10476) Enable common RDD operations on standard Scala collections

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733910#comment-14733910 ] Sean Owen commented on SPARK-10476: --- I am personally not sure how valuable this is, as the abstraction

[jira] [Commented] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-09-07 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734070#comment-14734070 ] Gayathri Murali commented on SPARK-7425: Has this been fixed? If not, I am starting out and would

[jira] [Commented] (SPARK-10482) Add Python interface for CountVectorizer

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734142#comment-14734142 ] Apache Spark commented on SPARK-10482: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Created] (SPARK-10482) Add Python interface for CountVectorizer

2015-09-07 Thread yuhao yang (JIRA)
yuhao yang created SPARK-10482: -- Summary: Add Python interface for CountVectorizer Key: SPARK-10482 URL: https://issues.apache.org/jira/browse/SPARK-10482 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-10482) Add Python interface for CountVectorizer

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10482: Assignee: (was: Apache Spark) > Add Python interface for CountVectorizer >

[jira] [Assigned] (SPARK-10482) Add Python interface for CountVectorizer

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10482: Assignee: Apache Spark > Add Python interface for CountVectorizer >

[jira] [Commented] (SPARK-10479) LogisticRegression copy should copy model summary if available

2015-09-07 Thread Lokesh Ravindranathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734110#comment-14734110 ] Lokesh Ravindranathan commented on SPARK-10479: --- Hi, I would like to work on this. Should I

[jira] [Created] (SPARK-10479) LogisticRegression copy should copy model summary if available

2015-09-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-10479: - Summary: LogisticRegression copy should copy model summary if available Key: SPARK-10479 URL: https://issues.apache.org/jira/browse/SPARK-10479 Project: Spark

[jira] [Commented] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

2015-09-07 Thread Ryan Schmitt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734047#comment-14734047 ] Ryan Schmitt commented on SPARK-3369: - You know what type of change is guaranteed not to break

[jira] [Updated] (SPARK-10479) LogisticRegression copy should copy model summary if available

2015-09-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10479: -- Description: SPARK-9112 adds LogisticRegressionSummary but [does not copy the model summary

[jira] [Commented] (SPARK-4131) Support "Writing data into the filesystem from queries"

2015-09-07 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734112#comment-14734112 ] Raju Bairishetti commented on SPARK-4131: - I have taken this patch and tested as I want to use

[jira] [Assigned] (SPARK-10480) ML.LinearRegressionModel.copy() can not use argument "extra"

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10480: Assignee: (was: Apache Spark) > ML.LinearRegressionModel.copy() can not use argument

[jira] [Assigned] (SPARK-10480) ML.LinearRegressionModel.copy() can not use argument "extra"

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10480: Assignee: Apache Spark > ML.LinearRegressionModel.copy() can not use argument "extra" >

[jira] [Commented] (SPARK-10480) ML.LinearRegressionModel.copy() can not use argument "extra"

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734128#comment-14734128 ] Apache Spark commented on SPARK-10480: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-9834) Normal equation solver for ordinary least squares

2015-09-07 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734170#comment-14734170 ] Debasish Das commented on SPARK-9834: - If you are open to use breeze.proximal.QuadraticMinimizer we

[jira] [Commented] (SPARK-10441) Cannot write timestamp to JSON

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734242#comment-14734242 ] Apache Spark commented on SPARK-10441: -- User 'yhuai' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-4131) Support "Writing data into the filesystem from queries"

2015-09-07 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734112#comment-14734112 ] Raju Bairishetti edited comment on SPARK-4131 at 9/8/15 1:39 AM: - I have

[jira] [Created] (SPARK-10480) ML.LinearRegressionModel.copy() can not use argument "extra"

2015-09-07 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-10480: --- Summary: ML.LinearRegressionModel.copy() can not use argument "extra" Key: SPARK-10480 URL: https://issues.apache.org/jira/browse/SPARK-10480 Project: Spark

[jira] [Assigned] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10481: Assignee: Apache Spark > SPARK_PREPEND_CLASSES make spark-yarn related jar could not be

[jira] [Assigned] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10481: Assignee: (was: Apache Spark) > SPARK_PREPEND_CLASSES make spark-yarn related jar

[jira] [Commented] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734139#comment-14734139 ] Apache Spark commented on SPARK-10481: -- User 'zjffdu' has created a pull request for this issue:

[jira] [Updated] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-09-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-10481: --- Description: It happens when SPARK_PREPEND_CLASSES is set and run spark on yarn. If

[jira] [Created] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-09-07 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-10481: -- Summary: SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found Key: SPARK-10481 URL: https://issues.apache.org/jira/browse/SPARK-10481 Project: Spark

[jira] [Assigned] (SPARK-10478) Improve spark.ml.ann implementations for MLP

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10478: Assignee: (was: Apache Spark) > Improve spark.ml.ann implementations for MLP >

[jira] [Commented] (SPARK-10478) Improve spark.ml.ann implementations for MLP

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734045#comment-14734045 ] Apache Spark commented on SPARK-10478: -- User 'feynmanliang' has created a pull request for this

[jira] [Assigned] (SPARK-10478) Improve spark.ml.ann implementations for MLP

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10478: Assignee: Apache Spark > Improve spark.ml.ann implementations for MLP >

[jira] [Updated] (SPARK-10474) Aggregation failed with unable to acquire memory

2015-09-07 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou updated SPARK-10474: Description: In aggregation case, a Lost task happened with below error. java.io.IOException: Could not

[jira] [Commented] (SPARK-10078) Vector-free L-BFGS

2015-09-07 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734130#comment-14734130 ] Debasish Das commented on SPARK-10078: -- [~mengxr] will it be Breeze LBFGS modification or part of

[jira] [Commented] (SPARK-10479) LogisticRegression copy should copy model summary if available

2015-09-07 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734146#comment-14734146 ] Feynman Liang commented on SPARK-10479: --- Thanks for your help! Please go head and work on it; your

[jira] [Updated] (SPARK-10419) Add JDBC dialect for Microsoft SQL Server

2015-09-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10419: Summary: Add JDBC dialect for Microsoft SQL Server (was: Add SQLServer JdbcDialect support for

[jira] [Updated] (SPARK-10419) Add SQLServer JdbcDialect support for datetimeoffset types

2015-09-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10419: Description: Running JDBC connections against Microsoft SQL Server database tables, when a table

[jira] [Commented] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-09-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734134#comment-14734134 ] Jeff Zhang commented on SPARK-10481: Working on it (Try to throw a more readable exception) >

[jira] [Updated] (SPARK-10481) SPARK_PREPEND_CLASSES make spark-yarn related jar could not be found

2015-09-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-10481: --- Description: It happens when SPARK_PREPEND_CLASSES is set and run spark on yarn. If

[jira] [Commented] (SPARK-8632) Poor Python UDF performance because of RDD caching

2015-09-07 Thread Justin Uang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734160#comment-14734160 ] Justin Uang commented on SPARK-8632: I have a solution working on my computer. I'm going to clean it

[jira] [Commented] (SPARK-10288) Add a rest client for Spark on Yarn

2015-09-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734161#comment-14734161 ] Saisai Shao commented on SPARK-10288: - Hi Marcelo, Yes I agree with you that rest client is not only

[jira] [Created] (SPARK-10478) Improve spark.ml.ann implementations for MLP

2015-09-07 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-10478: - Summary: Improve spark.ml.ann implementations for MLP Key: SPARK-10478 URL: https://issues.apache.org/jira/browse/SPARK-10478 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

2015-09-07 Thread Ryan Schmitt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734025#comment-14734025 ] Ryan Schmitt commented on SPARK-3369: - Right, and that's why the type signature in the Java API is

[jira] [Assigned] (SPARK-10380) Confusing examples in pyspark SQL docs

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10380: Assignee: (was: Apache Spark) > Confusing examples in pyspark SQL docs >

[jira] [Commented] (SPARK-10380) Confusing examples in pyspark SQL docs

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734026#comment-14734026 ] Apache Spark commented on SPARK-10380: -- User 'GayathriMurali' has created a pull request for this

[jira] [Assigned] (SPARK-10380) Confusing examples in pyspark SQL docs

2015-09-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10380: Assignee: Apache Spark > Confusing examples in pyspark SQL docs >

[jira] [Commented] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734030#comment-14734030 ] Sean Owen commented on SPARK-3369: -- Yes, that's explained above -- it's an error. The problem is you

[jira] [Resolved] (SPARK-9767) Remove ConnectionManager

2015-09-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9767. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.6.0 > Remove

[jira] [Updated] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-10392: --- Description: I have following problem. I created table. {code} CREATE TABLE `spark_test` (

[jira] [Updated] (SPARK-10392) Pyspark - Wrong DateType support on JDBC connection

2015-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-10392: --- Description: I have following problem. I created table. {code} CREATE TABLE `spark_test` (

[jira] [Commented] (SPARK-8632) Poor Python UDF performance because of RDD caching

2015-09-07 Thread Justin Uang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734000#comment-14734000 ] Justin Uang commented on SPARK-8632: I have started working on this. I hope to get a draft out soon.

[jira] [Updated] (SPARK-10380) Confusing examples in pyspark SQL docs

2015-09-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10380: -- Target Version/s: (was: 1.5.0) Priority: Minor (was: Major) Component/s:

[jira] [Commented] (SPARK-10476) Enable common RDD operations on standard Scala collections

2015-09-07 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733988#comment-14733988 ] Simeon Simeonov commented on SPARK-10476: - No need for the abstraction to leak as all

  1   2   >