[jira] [Created] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-25 Thread Ankit Sarraf (JIRA)
Ankit Sarraf created SPARK-10840: Summary: SparkSQL doesn't work well with JSON Key: SPARK-10840 URL: https://issues.apache.org/jira/browse/SPARK-10840 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-25 Thread Ankit Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Sarraf updated SPARK-10840: - Description: Well formed JSON doesn't work with the 1.5.1 version while using

[jira] [Updated] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-25 Thread Ankit Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Sarraf updated SPARK-10840: - Description: Well formed JSON doesn't work with the 1.5.1 version while using

[jira] [Updated] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-09-25 Thread Ankit Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Sarraf updated SPARK-10840: - Description: Well formed JSON doesn't work with the 1.5.1 version while using

[jira] [Commented] (SPARK-10808) LDA user guide: discuss running time of LDA

2015-09-25 Thread Mohamed Baddar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908198#comment-14908198 ] Mohamed Baddar commented on SPARK-10808: Thanks [~josephkb] , working on it > LDA user guide:

[jira] [Commented] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907913#comment-14907913 ] Zoltán Zvara commented on SPARK-10390: -- Problem still exists. To reproduce, simply clone the latest

[jira] [Comment Edited] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907913#comment-14907913 ] Zoltán Zvara edited comment on SPARK-10390 at 9/25/15 10:59 AM: Problem

[jira] [Comment Edited] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907913#comment-14907913 ] Zoltán Zvara edited comment on SPARK-10390 at 9/25/15 11:05 AM: Problem

[jira] [Commented] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907935#comment-14907935 ] Sean Owen commented on SPARK-10390: --- Yes, but as I say, it appears to work with the build of reference.

[jira] [Commented] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907948#comment-14907948 ] Zoltán Zvara commented on SPARK-10390: -- What could be the problem that causes SBT to pack a wrong

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907949#comment-14907949 ] Ondřej Smola commented on SPARK-8734: - I think parameters can be supported as comma separated

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread Chris Heller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907952#comment-14907952 ] Chris Heller commented on SPARK-8734: - Responsibilities have sort of pulled me away from focusing on

[jira] [Commented] (SPARK-9103) Tracking spark's memory usage

2015-09-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908309#comment-14908309 ] Imran Rashid commented on SPARK-9103: - Hi [~liyezhang556520], thanks for posting the design doc.

[jira] [Created] (SPARK-10835) Change Output of NGram to Array(String, True)

2015-09-25 Thread Sumit Chawla (JIRA)
Sumit Chawla created SPARK-10835: Summary: Change Output of NGram to Array(String, True) Key: SPARK-10835 URL: https://issues.apache.org/jira/browse/SPARK-10835 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908651#comment-14908651 ] Ondřej Smola commented on SPARK-8734: - No it wont as spark config is internally stored in hashmap - i

[jira] [Commented] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

2015-09-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908705#comment-14908705 ] Imran Rashid commented on SPARK-5928: - [~ariskk] The workaround is to increase the number of

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908647#comment-14908647 ] Alan Braithwaite commented on SPARK-8734: - Will this work with multiple instances of the same

[jira] [Comment Edited] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908651#comment-14908651 ] Ondřej Smola edited comment on SPARK-8734 at 9/25/15 9:01 PM: -- No it wont as

[jira] [Commented] (SPARK-9103) Tracking spark's memory usage

2015-09-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908644#comment-14908644 ] Imran Rashid commented on SPARK-9103: - ah, of course, sorry I made a big mistake. I was thinking that

[jira] [Commented] (SPARK-10824) DataFrame show method - show(df) should show first N number of rows, similar to R

2015-09-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908380#comment-14908380 ] Shivaram Venkataraman commented on SPARK-10824: --- [~Narine] We discussed this in

[jira] [Commented] (SPARK-10791) Optimize MLlib LDA topic distribution query performance

2015-09-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908448#comment-14908448 ] Joseph K. Bradley commented on SPARK-10791: --- Oh, OK, I'll comment there as needed. Thanks >

[jira] [Resolved] (SPARK-10760) SparkR glm: the documentation in examples - family argument is missing

2015-09-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10760. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10760) SparkR glm: the documentation in examples - family argument is missing

2015-09-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10760: -- Assignee: Narine Kokhlikyan > SparkR glm: the documentation in examples -

[jira] [Commented] (SPARK-9883) Distance to each cluster given a point

2015-09-25 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908598#comment-14908598 ] Bertrand Dechoux commented on SPARK-9883: - The patch is now ready for MLlib and is waiting for a

[jira] [Commented] (SPARK-6649) DataFrame created through SQLContext.jdbc() failed if columns table must be quoted

2015-09-25 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908609#comment-14908609 ] Rick Hillegas commented on SPARK-6649: -- Hi Fred, The backtick syntax seems to be a feature of HiveQL

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-09-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Created] (SPARK-10834) SPARK SQL doesn't support INSERT INTO ... VALUES

2015-09-25 Thread Antonio Piccolboni (JIRA)
Antonio Piccolboni created SPARK-10834: -- Summary: SPARK SQL doesn't support INSERT INTO ... VALUES Key: SPARK-10834 URL: https://issues.apache.org/jira/browse/SPARK-10834 Project: Spark

[jira] [Commented] (SPARK-10804) "LOCAL" in LOAD DATA LOCAL INPATH means "remote"

2015-09-25 Thread Antonio Piccolboni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908296#comment-14908296 ] Antonio Piccolboni commented on SPARK-10804: Good suggestion SPARK-10834 > "LOCAL" in LOAD

[jira] [Commented] (SPARK-9103) Tracking spark's memory usage

2015-09-25 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908404#comment-14908404 ] Zhang, Liye commented on SPARK-9103: Hi @Imran Rashid, thanks for reviewing the doc. {quote} 1) Will

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-09-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908389#comment-14908389 ] Shivaram Venkataraman commented on SPARK-7736: -- [~ztoth] Could you open a new JIRA for the

[jira] [Commented] (SPARK-7129) Add generic boosting algorithm to spark.ml

2015-09-25 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908395#comment-14908395 ] Meihua Wu commented on SPARK-7129: -- [~josephkb] [~sethah] I have compile a doc for AdaBoost.

[jira] [Commented] (SPARK-10828) Can we use the accumulo data RDD created from JAVA in spark, in sparkR?Is there any other way to proceed with it to create RRDD from a source RDD other than text RDD?O

2015-09-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908399#comment-14908399 ] Shivaram Venkataraman commented on SPARK-10828: --- I don't think we want to support new ways

[jira] [Commented] (SPARK-7129) Add generic boosting algorithm to spark.ml

2015-09-25 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908455#comment-14908455 ] Seth Hendrickson commented on SPARK-7129: - A couple of quick comments I have: * The design doc

[jira] [Commented] (SPARK-6281) Support incremental updates for Graph

2015-09-25 Thread Rohit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908349#comment-14908349 ] Rohit commented on SPARK-6281: -- Hi I see the issue as resolved and the resolution as wont fix! I am currently

[jira] [Updated] (SPARK-10835) Change Output of NGram to Array(String, True)

2015-09-25 Thread Sumit Chawla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Chawla updated SPARK-10835: - Description: Currently output type of NGram is Array(String, false), which is not compatible

[jira] [Comment Edited] (SPARK-9103) Tracking spark's memory usage

2015-09-25 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908404#comment-14908404 ] Zhang, Liye edited comment on SPARK-9103 at 9/25/15 5:56 PM: - Hi [~irashid],

[jira] [Commented] (SPARK-10824) DataFrame show method - show(df) should show first N number of rows, similar to R

2015-09-25 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908431#comment-14908431 ] Narine Kokhlikyan commented on SPARK-10824: --- Thanks Shivaram, I see! I'll look at it and watch

[jira] [Commented] (SPARK-9883) Distance to each cluster given a point

2015-09-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908884#comment-14908884 ] Joseph K. Bradley commented on SPARK-9883: -- OK! I'll be traveling next week, but I'll try to

[jira] [Commented] (SPARK-10635) pyspark - running on a different host

2015-09-25 Thread Ben Duffield (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908738#comment-14908738 ] Ben Duffield commented on SPARK-10635: -- Ok good flag that there are other places this'd need to be

[jira] [Updated] (SPARK-10821) RandomForest serialization OOM during findBestSplits

2015-09-25 Thread Jay Luan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Luan updated SPARK-10821: - Description: I am getting OOM during serialization for a relatively small dataset for a RandomForest.

[jira] [Assigned] (SPARK-10836) Add SparkR sort function to dataframe

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10836: Assignee: Apache Spark > Add SparkR sort function to dataframe >

[jira] [Assigned] (SPARK-10836) Add SparkR sort function to dataframe

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10836: Assignee: (was: Apache Spark) > Add SparkR sort function to dataframe >

[jira] [Created] (SPARK-10837) TimeStamp could not work on sparksql very well

2015-09-25 Thread Yun Zhao (JIRA)
Yun Zhao created SPARK-10837: Summary: TimeStamp could not work on sparksql very well Key: SPARK-10837 URL: https://issues.apache.org/jira/browse/SPARK-10837 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-10839) SPARK_DAEMON_MEMORY has effect on heap size of thriftserver

2015-09-25 Thread Yun Zhao (JIRA)
Yun Zhao created SPARK-10839: Summary: SPARK_DAEMON_MEMORY has effect on heap size of thriftserver Key: SPARK-10839 URL: https://issues.apache.org/jira/browse/SPARK-10839 Project: Spark Issue

[jira] [Created] (SPARK-10836) Add SparkR sort function to dataframe

2015-09-25 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-10836: - Summary: Add SparkR sort function to dataframe Key: SPARK-10836 URL: https://issues.apache.org/jira/browse/SPARK-10836 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10836) Add SparkR sort function to dataframe

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908907#comment-14908907 ] Apache Spark commented on SPARK-10836: -- User 'NarineK' has created a pull request for this issue:

[jira] [Updated] (SPARK-10838) Repeat to join one DataFrame twice,there will be AnalysisException.

2015-09-25 Thread Yun Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Zhao updated SPARK-10838: - Description: The detail of exception is: {quote} Exception in thread "main"

[jira] [Created] (SPARK-10838) Repeat to join one DataFrame twice,there will be AnalysisException.

2015-09-25 Thread Yun Zhao (JIRA)
Yun Zhao created SPARK-10838: Summary: Repeat to join one DataFrame twice,there will be AnalysisException. Key: SPARK-10838 URL: https://issues.apache.org/jira/browse/SPARK-10838 Project: Spark

[jira] [Commented] (SPARK-10839) SPARK_DAEMON_MEMORY has effect on heap size of thriftserver

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908998#comment-14908998 ] Apache Spark commented on SPARK-10839: -- User 'xiaowen147' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10839) SPARK_DAEMON_MEMORY has effect on heap size of thriftserver

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10839: Assignee: Apache Spark > SPARK_DAEMON_MEMORY has effect on heap size of thriftserver >

[jira] [Assigned] (SPARK-10839) SPARK_DAEMON_MEMORY has effect on heap size of thriftserver

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10839: Assignee: (was: Apache Spark) > SPARK_DAEMON_MEMORY has effect on heap size of

[jira] [Updated] (SPARK-10836) SparkR: Add sort function to dataframe

2015-09-25 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-10836: -- Summary: SparkR: Add sort function to dataframe (was: Add SparkR sort function to

[jira] [Assigned] (SPARK-10829) Scan DataSource with predicate expression combine partition key and attributes doesn't work

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10829: Assignee: Apache Spark > Scan DataSource with predicate expression combine partition key

[jira] [Commented] (SPARK-10829) Scan DataSource with predicate expression combine partition key and attributes doesn't work

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907646#comment-14907646 ] Apache Spark commented on SPARK-10829: -- User 'chenghao-intel' has created a pull request for this

[jira] [Assigned] (SPARK-10829) Scan DataSource with predicate expression combine partition key and attributes doesn't work

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10829: Assignee: (was: Apache Spark) > Scan DataSource with predicate expression combine

[jira] [Updated] (SPARK-10802) Let ALS recommend for subset of data

2015-09-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10802: -- Priority: Minor (was: Major) > Let ALS recommend for subset of data >

[jira] [Resolved] (SPARK-10828) Can we use the accumulo data RDD created from JAVA in spark, in sparkR?Is there any other way to proceed with it to create RRDD from a source RDD other than text RDD?Or

2015-09-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10828. --- Resolution: Invalid If you would please, ask questions on u...@spark.apache.org See

[jira] [Commented] (SPARK-10828) Can we use the accumulo data RDD created from JAVA in spark, in sparkR?Is there any other way to proceed with it to create RRDD from a source RDD other than text RDD?O

2015-09-25 Thread madhvi gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907725#comment-14907725 ] madhvi gupta commented on SPARK-10828: -- hey I have post this question on the spark amiling list

[jira] [Commented] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-09-25 Thread Sebastian YEPES FERNANDEZ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907747#comment-14907747 ] Sebastian YEPES FERNANDEZ commented on SPARK-10309: --- Is there currently any workaround

[jira] [Resolved] (SPARK-9681) Support R feature interactions in RFormula

2015-09-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9681. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8830

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907817#comment-14907817 ] Ondřej Smola commented on SPARK-8734: - I am going to work on this - i need at least ability to set

[jira] [Comment Edited] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907817#comment-14907817 ] Ondřej Smola edited comment on SPARK-8734 at 9/25/15 8:53 AM: -- I am going to

[jira] [Created] (SPARK-10830) Install unittest-xml-reporting on Jenkins

2015-09-25 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10830: - Summary: Install unittest-xml-reporting on Jenkins Key: SPARK-10830 URL: https://issues.apache.org/jira/browse/SPARK-10830 Project: Spark Issue Type: New

[jira] [Created] (SPARK-10831) Spark SQL Configuration missing in the doc

2015-09-25 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-10831: - Summary: Spark SQL Configuration missing in the doc Key: SPARK-10831 URL: https://issues.apache.org/jira/browse/SPARK-10831 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10797) RDD's coalesce should not write out the temporary key

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltán Zvara updated SPARK-10797: - Description: It seems that {{RDD.coalesce}} will unnecessarily write out (to shuffle files)

[jira] [Assigned] (SPARK-10831) Spark SQL Configuration missing in the doc

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10831: Assignee: (was: Apache Spark) > Spark SQL Configuration missing in the doc >

[jira] [Commented] (SPARK-10831) Spark SQL Configuration missing in the doc

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907796#comment-14907796 ] Apache Spark commented on SPARK-10831: -- User 'chenghao-intel' has created a pull request for this

[jira] [Assigned] (SPARK-10831) Spark SQL Configuration missing in the doc

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10831: Assignee: Apache Spark > Spark SQL Configuration missing in the doc >

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907963#comment-14907963 ] Ondřej Smola commented on SPARK-8734: - +1 spark.mesos.executor.docker.parameter. > Expose all

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Attachment: 1.jpg > sometimes No event logs found for application using same JavaSparkSQL example >

[jira] [Commented] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907984#comment-14907984 ] Ricky Yang commented on SPARK-10832: 15/09/25 19:00:09 INFO Master: Registering app JavaSparkSQL

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-09-25 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908001#comment-14908001 ] Zsolt Tóth commented on SPARK-7736: --- As I see, this is also a problem for SparkR applications in

[jira] [Commented] (SPARK-10791) Optimize MLlib LDA topic distribution query performance

2015-09-25 Thread Marko Asplund (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907975#comment-14907975 ] Marko Asplund commented on SPARK-10791: --- This performance issue was actually discussed on the spark

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Attachment: screenshot-1.png > sometimes No event logs found for application using same JavaSparkSQL

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Attachment: (was: 1.jpg) > sometimes No event logs found for application using same JavaSparkSQL

[jira] [Commented] (SPARK-10390) Py4JJavaError java.lang.NoSuchMethodError: com.google.common.base.Stopwatch.elapsedMillis()J

2015-09-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907986#comment-14907986 ] Sean Owen commented on SPARK-10390: --- My guess is it ends up building in a different Guava dependency

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread Martin Tapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907966#comment-14907966 ] Martin Tapp commented on SPARK-8734: Same here, spark.mesos.executor.docker.parameter. is fined by

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Created] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
Ricky Yang created SPARK-10832: -- Summary: sometimes No event logs found for application using same JavaSparkSQL example Key: SPARK-10832 URL: https://issues.apache.org/jira/browse/SPARK-10832 Project:

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Attachment: screenshot-2.png > sometimes No event logs found for application using same JavaSparkSQL

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Attachment: screenshot-1-1.png > sometimes No event logs found for application using same

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Updated] (SPARK-10832) sometimes No event logs found for application using same JavaSparkSQL example

2015-09-25 Thread Ricky Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Yang updated SPARK-10832: --- Description: hi all, when using JavaSparkSQL example,the code was submit many times as

[jira] [Commented] (SPARK-10802) Let ALS recommend for subset of data

2015-09-25 Thread Tomasz Bartczak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907669#comment-14907669 ] Tomasz Bartczak commented on SPARK-10802: - hmm you are probably referring to method

[jira] [Created] (SPARK-10833) Inline, organize BSD/MIT licenses in LICENSE

2015-09-25 Thread Sean Owen (JIRA)
Sean Owen created SPARK-10833: - Summary: Inline, organize BSD/MIT licenses in LICENSE Key: SPARK-10833 URL: https://issues.apache.org/jira/browse/SPARK-10833 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-10833) Inline, organize BSD/MIT licenses in LICENSE

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10833: Assignee: Apache Spark (was: Sean Owen) > Inline, organize BSD/MIT licenses in LICENSE >

[jira] [Commented] (SPARK-10833) Inline, organize BSD/MIT licenses in LICENSE

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908038#comment-14908038 ] Apache Spark commented on SPARK-10833: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-8734) Expose all Mesos DockerInfo options to Spark

2015-09-25 Thread Chris Heller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908050#comment-14908050 ] Chris Heller commented on SPARK-8734: - I pushed up to my branch some code for the parameters. Though

[jira] [Commented] (SPARK-9941) Try ML pipeline API on Kaggle competitions

2015-09-25 Thread Kristina Plazonic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908036#comment-14908036 ] Kristina Plazonic commented on SPARK-9941: -- I would love to do Avito Context Ad Clicks -

[jira] [Assigned] (SPARK-10833) Inline, organize BSD/MIT licenses in LICENSE

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10833: Assignee: Sean Owen (was: Apache Spark) > Inline, organize BSD/MIT licenses in LICENSE >

[jira] [Assigned] (SPARK-10766) Add some configurations for the client process in yarn-cluster mode.

2015-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10766: Assignee: Apache Spark > Add some configurations for the client process in yarn-cluster

  1   2   >