[jira] [Created] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-04-04 Thread Ankur Chauhan (JIRA)
Ankur Chauhan created SPARK-6707: Summary: Mesos Scheduler should allow the user to specify constraints based on slave attributes Key: SPARK-6707 URL: https://issues.apache.org/jira/browse/SPARK-6707

[jira] [Commented] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395599#comment-14395599 ] Sean Owen commented on SPARK-3625: -- Why would this change be necessary in order to use

[jira] [Commented] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395598#comment-14395598 ] Sean Owen commented on SPARK-6706: -- Hey Xi, I don't think this makes for a good JIRA as

[jira] [Resolved] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

2015-04-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6646. Resolution: Later Alright -- given the size of the task, I am not sure if I have enough cycle to

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395614#comment-14395614 ] Sean Owen commented on SPARK-6646: -- I feel like people aren't taking this seriously. What

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

2015-04-04 Thread Harut Martirosyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395645#comment-14395645 ] Harut Martirosyan commented on SPARK-3928: -- This stopped working after

[jira] [Updated] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-04-04 Thread Ankur Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Chauhan updated SPARK-6707: - Description: Currently, the mesos scheduler only looks at the `cpu` and `mem` resources when

[jira] [Updated] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-04-04 Thread Ankur Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Chauhan updated SPARK-6707: - Description: Currently, the mesos scheduler only looks at the 'cpu' and 'mem' resources when

[jira] [Assigned] (SPARK-5242) ec2/spark_ec2.py lauch does not work with VPC if no public DNS or IP is available

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5242: --- Assignee: (was: Apache Spark) ec2/spark_ec2.py lauch does not work with VPC if no

[jira] [Assigned] (SPARK-5242) ec2/spark_ec2.py lauch does not work with VPC if no public DNS or IP is available

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5242: --- Assignee: Apache Spark ec2/spark_ec2.py lauch does not work with VPC if no public DNS or IP

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395609#comment-14395609 ] Sean Owen commented on SPARK-6435: -- I feel like it's worth fixing, cryptic or not. Try

[jira] [Resolved] (SPARK-6242) Support replace (drop) column for parquet table

2015-04-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6242. --- Resolution: Duplicate Support replace (drop) column for parquet table

[jira] [Updated] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

2015-04-04 Thread Xi Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Shen updated SPARK-6706: --- Description: When doing k-means cluster with the kmeans|| algorithm which is the default one. The algorithm

[jira] [Updated] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-04-04 Thread Ankur Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Chauhan updated SPARK-6707: - Description: Currently, the mesos scheduler only looks at the `cpu` and `mem` resources when

[jira] [Commented] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

2015-04-04 Thread Xi Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395622#comment-14395622 ] Xi Shen commented on SPARK-6706: I know it is more like a user report than a technical

[jira] [Commented] (SPARK-6548) Adding stddev to DataFrame functions

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395625#comment-14395625 ] Apache Spark commented on SPARK-6548: - User 'dreamquster' has created a pull request

[jira] [Commented] (SPARK-6489) Optimize lateral view with explode to not read unnecessary columns

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395643#comment-14395643 ] Apache Spark commented on SPARK-6489: - User 'dreamquster' has created a pull request

[jira] [Commented] (SPARK-3625) In some cases, the RDD.checkpoint does not work

2015-04-04 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395613#comment-14395613 ] Guoqiang Li commented on SPARK-3625: Sometimes, when calling the RDD.checkpoint ,

[jira] [Commented] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395639#comment-14395639 ] Sean Owen commented on SPARK-6706: -- I tried your code locally vs master with k=1000 (you

[jira] [Issue Comment Deleted] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

2015-04-04 Thread Xi Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Shen updated SPARK-6706: --- Comment: was deleted (was: Yes, the {{collect()}} jobs finished, then hangs at the driver. Your words are

[jira] [Commented] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

2015-04-04 Thread Xi Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395641#comment-14395641 ] Xi Shen commented on SPARK-6706: Yes, the {{collect()}} jobs finished, then hangs at the

[jira] [Commented] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

2015-04-04 Thread Xi Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395642#comment-14395642 ] Xi Shen commented on SPARK-6706: Yes, the {{collect()}} jobs finished, then hangs at the

[jira] [Updated] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-04-04 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated SPARK-4036: -- Attachment: CRF_design.1.pdf Add Conditional Random Fields (CRF) algorithm to Spark MLlib

[jira] [Commented] (SPARK-6262) Python MLlib API missing items: Statistics

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395721#comment-14395721 ] Apache Spark commented on SPARK-6262: - User 'Lewuathe' has created a pull request for

[jira] [Assigned] (SPARK-6262) Python MLlib API missing items: Statistics

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6262: --- Assignee: Kai Sasaki (was: Apache Spark) Python MLlib API missing items: Statistics

[jira] [Assigned] (SPARK-6262) Python MLlib API missing items: Statistics

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6262: --- Assignee: Apache Spark (was: Kai Sasaki) Python MLlib API missing items: Statistics

[jira] [Updated] (SPARK-6704) integrate SparkR docs build tool into Spark doc build

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6704: - Component/s: SparkR (I went ahead and made a SparkR component in JIRA.) integrate SparkR docs build

[jira] [Updated] (SPARK-5654) Integrate SparkR into Apache Spark

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5654: - Component/s: (was: Project Infra) SparkR Integrate SparkR into Apache Spark

[jira] [Resolved] (SPARK-4830) Spark Streaming Java Application : java.lang.ClassNotFoundException

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4830. -- Resolution: Duplicate Yes, I strongly suspect this was resolved by SPARK-4660, since it would correct

[jira] [Updated] (SPARK-2698) RDD pages shows negative bytes remaining for some executors

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2698: - Priority: Minor (was: Major) This might have been fixed at some point since 1.0 though I don't see an

[jira] [Issue Comment Deleted] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

2015-04-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6587: -- Comment: was deleted (was: JSON needs this kind of schema inference because JSON is weakly typed. The

[jira] [Commented] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

2015-04-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395765#comment-14395765 ] Cheng Lian commented on SPARK-6587: --- JSON needs this kind of schema inference because

[jira] [Commented] (SPARK-6695) Add an external iterator: a hadoop-like output collector

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395773#comment-14395773 ] Sean Owen commented on SPARK-6695: -- The problem with this in the general case raises

[jira] [Commented] (SPARK-6569) Kafka directInputStream logs what appear to be incorrect warnings

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395763#comment-14395763 ] Sean Owen commented on SPARK-6569: -- Let's make it info level then. Kafka

[jira] [Updated] (SPARK-3276) Provide a API to specify MIN_REMEMBER_DURATION for files to consider as input in streaming

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3276: - Summary: Provide a API to specify MIN_REMEMBER_DURATION for files to consider as input in streaming

[jira] [Resolved] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4900. -- Resolution: Fixed Given lack of follow-up I think this is as resolved as we're going to make it.

[jira] [Updated] (SPARK-4900) MLlib SingularValueDecomposition ARPACK IllegalStateException

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4900: - Description: java.lang.reflect.InvocationTargetException ... Caused by:

[jira] [Resolved] (SPARK-6607) Aggregation attribute name including special chars '(' and ')' should be replaced before generating Parquet schema

2015-04-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6607. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5263

[jira] [Commented] (SPARK-6399) Code compiled against 1.3.0 may not run against older Spark versions

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395780#comment-14395780 ] Sean Owen commented on SPARK-6399: -- Hey Marcelo where would you like to document this,

[jira] [Resolved] (SPARK-6061) File source dstream can not include the old file which timestamp is before the system time

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6061. -- Resolution: Duplicate This reduces to the same underlying issue as in SPARK-3276, which is to

[jira] [Resolved] (SPARK-5033) Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5033. -- Resolution: Duplicate Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows

[jira] [Resolved] (SPARK-5261) In some cases ,The value of word's vector representation is too big

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5261. -- Resolution: Duplicate In some cases ,The value of word's vector representation is too big

[jira] [Created] (SPARK-6708) Using Hive UDTF may throw ClassNotFoundException

2015-04-04 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-6708: - Summary: Using Hive UDTF may throw ClassNotFoundException Key: SPARK-6708 URL: https://issues.apache.org/jira/browse/SPARK-6708 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

2015-04-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395766#comment-14395766 ] Cheng Lian commented on SPARK-6587: --- JSON needs this kind of schema inference because

[jira] [Updated] (SPARK-6622) Spark SQL cannot communicate with Hive meta store

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6622: - Component/s: (was: Spark Submit) SQL Spark SQL cannot communicate with Hive meta

[jira] [Resolved] (SPARK-3413) Spark Blocked due to Executor lost in FIFO MODE

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3413. -- Resolution: Cannot Reproduce Spark Blocked due to Executor lost in FIFO MODE

[jira] [Created] (SPARK-6709) SparkSQL cannot parse sql correctly when the table contains count column.

2015-04-04 Thread Patrick Liu (JIRA)
Patrick Liu created SPARK-6709: -- Summary: SparkSQL cannot parse sql correctly when the table contains count column. Key: SPARK-6709 URL: https://issues.apache.org/jira/browse/SPARK-6709 Project: Spark

[jira] [Commented] (SPARK-3553) Spark Streaming app streams files that have already been streamed in an endless loop

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395793#comment-14395793 ] Sean Owen commented on SPARK-3553: -- Checking through old issues -- I know this logic has

[jira] [Updated] (SPARK-6703) Provide a way to discover existing SparkContext's

2015-04-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6703: - Affects Version/s: 1.3.0 Provide a way to discover existing SparkContext's

[jira] [Updated] (SPARK-6703) Provide a way to discover existing SparkContext's

2015-04-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6703: - Target Version/s: 1.4.0 Provide a way to discover existing SparkContext's

[jira] [Commented] (SPARK-6699) PySpark Acess Denied error in windows seen only in ver 1.3

2015-04-04 Thread RoCm (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14396040#comment-14396040 ] RoCm commented on SPARK-6699: - I dont think this is a problem caused by missing numpy module.

[jira] [Created] (SPARK-6711) Support parallelized online matrix factorization for Collaborative Filtering

2015-04-04 Thread Chunnan Yao (JIRA)
Chunnan Yao created SPARK-6711: -- Summary: Support parallelized online matrix factorization for Collaborative Filtering Key: SPARK-6711 URL: https://issues.apache.org/jira/browse/SPARK-6711 Project:

[jira] [Reopened] (SPARK-5261) In some cases ,The value of word's vector representation is too big

2015-04-04 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li reopened SPARK-5261: [~srowen] SPARK-5261 andSPARK-4846 are not the same problem. This is a algorithm error. The

[jira] [Created] (SPARK-6712) Allow lower the log level in YARN client while keeping AM tracking URL printed

2015-04-04 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created SPARK-6712: Summary: Allow lower the log level in YARN client while keeping AM tracking URL printed Key: SPARK-6712 URL: https://issues.apache.org/jira/browse/SPARK-6712

[jira] [Assigned] (SPARK-6712) Allow lower the log level in YARN client while keeping AM tracking URL printed

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6712: --- Assignee: Apache Spark Allow lower the log level in YARN client while keeping AM tracking

[jira] [Commented] (SPARK-6712) Allow lower the log level in YARN client while keeping AM tracking URL printed

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14396094#comment-14396094 ] Apache Spark commented on SPARK-6712: - User 'piaozhexiu' has created a pull request

[jira] [Assigned] (SPARK-6712) Allow lower the log level in YARN client while keeping AM tracking URL printed

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6712: --- Assignee: (was: Apache Spark) Allow lower the log level in YARN client while keeping AM

[jira] [Created] (SPARK-6710) Wrong initial bias in GraphX SVDPlusPlus

2015-04-04 Thread Michael Malak (JIRA)
Michael Malak created SPARK-6710: Summary: Wrong initial bias in GraphX SVDPlusPlus Key: SPARK-6710 URL: https://issues.apache.org/jira/browse/SPARK-6710 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3580) Add Consistent Method To Get Number of RDD Partitions Across Different Languages

2015-04-04 Thread Harsh Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395888#comment-14395888 ] Harsh Gupta commented on SPARK-3580: Hi. Can I take it up ? Add Consistent Method To

[jira] [Commented] (SPARK-6548) Adding stddev to DataFrame functions

2015-04-04 Thread Harsh Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395876#comment-14395876 ] Harsh Gupta commented on SPARK-6548: Is this available to be worked upon ? The

[jira] [Assigned] (SPARK-975) Spark Replay Debugger

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-975: -- Assignee: (was: Apache Spark) Spark Replay Debugger -

[jira] [Assigned] (SPARK-975) Spark Replay Debugger

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-975: -- Assignee: Apache Spark Spark Replay Debugger - Key:

[jira] [Assigned] (SPARK-6661) Python type errors should print type, not object

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6661: --- Assignee: (was: Apache Spark) Python type errors should print type, not object

[jira] [Assigned] (SPARK-6661) Python type errors should print type, not object

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6661: --- Assignee: Apache Spark Python type errors should print type, not object

[jira] [Commented] (SPARK-6661) Python type errors should print type, not object

2015-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395930#comment-14395930 ] Apache Spark commented on SPARK-6661: - User '31z4' has created a pull request for this

[jira] [Updated] (SPARK-6703) Provide a way to discover existing SparkContext's

2015-04-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6703: --- Description: Right now it is difficult to write a Spark application in a way that can be run

[jira] [Commented] (SPARK-6676) Add hadoop 2.4+ for profiles in POM.xml

2015-04-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395932#comment-14395932 ] Patrick Wendell commented on SPARK-6676: [~srowen] This is such a common source of

[jira] [Commented] (SPARK-6676) Add hadoop 2.4+ for profiles in POM.xml

2015-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395948#comment-14395948 ] Sean Owen commented on SPARK-6676: -- I'd prefer to start by just improving the