[jira] [Commented] (SPARK-5501) Write support for the data source API

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303760#comment-14303760 ] Yin Huai commented on SPARK-5501: - h3. End user APIs added to DataFrame h4. Save a

[jira] [Updated] (SPARK-5570) No docs stating that `new SparkConf().set(spark.driver.memory, ...) will not work

2015-02-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-5570: - Component/s: Documentation No docs stating that `new SparkConf().set(spark.driver.memory, ...)

[jira] [Created] (SPARK-5566) Tokenizer for mllib package

2015-02-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5566: Summary: Tokenizer for mllib package Key: SPARK-5566 URL: https://issues.apache.org/jira/browse/SPARK-5566 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-5420) Cross-langauge load/store functions for creating and saving DataFrames

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5420: Fix Version/s: 1.3.0 Cross-langauge load/store functions for creating and saving DataFrames

[jira] [Created] (SPARK-5568) Python API for the write support of the data source API

2015-02-03 Thread Yin Huai (JIRA)
Yin Huai created SPARK-5568: --- Summary: Python API for the write support of the data source API Key: SPARK-5568 URL: https://issues.apache.org/jira/browse/SPARK-5568 Project: Spark Issue Type:

[jira] [Created] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-02-03 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-5569: -- Summary: Checkpoints cannot reference classes defined outside of Spark's assembly Key: SPARK-5569 URL: https://issues.apache.org/jira/browse/SPARK-5569 Project:

[jira] [Commented] (SPARK-5153) flaky test of Reliable Kafka input stream with multiple topics

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303797#comment-14303797 ] Apache Spark commented on SPARK-5153: - User 'tdas' has created a pull request for this

[jira] [Commented] (SPARK-5153) flaky test of Reliable Kafka input stream with multiple topics

2015-02-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303821#comment-14303821 ] Tathagata Das commented on SPARK-5153: -- I increased timeout to reduce flakiness. If

[jira] [Comment Edited] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

2015-02-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303702#comment-14303702 ] Marcelo Vanzin edited comment on SPARK-5388 at 2/3/15 7:48 PM:

[jira] [Commented] (SPARK-4905) Flaky FlumeStreamSuite test: org.apache.spark.streaming.flume.FlumeStreamSuite.flume input stream

2015-02-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303747#comment-14303747 ] Tathagata Das commented on SPARK-4905: -- Can you please take care of this. This must

[jira] [Created] (SPARK-5567) Add prediction methods to LDA

2015-02-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5567: Summary: Add prediction methods to LDA Key: SPARK-5567 URL: https://issues.apache.org/jira/browse/SPARK-5567 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4905) Flaky FlumeStreamSuite test: org.apache.spark.streaming.flume.FlumeStreamSuite.flume input stream

2015-02-03 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303766#comment-14303766 ] Hari Shreedharan commented on SPARK-4905: - Is there a recent instance of failure?

[jira] [Commented] (SPARK-5153) flaky test of Reliable Kafka input stream with multiple topics

2015-02-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303790#comment-14303790 ] Tathagata Das commented on SPARK-5153: -- [~jerryshao] Any elegant solution for this?

[jira] [Comment Edited] (SPARK-5501) Write support for the data source API

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303722#comment-14303722 ] Yin Huai edited comment on SPARK-5501 at 2/3/15 7:15 PM: - h3.

[jira] [Created] (SPARK-5570) No docs stating that `new SparkConf().set(spark.driver.memory, ...) will not work

2015-02-03 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-5570: Summary: No docs stating that `new SparkConf().set(spark.driver.memory, ...) will not work Key: SPARK-5570 URL: https://issues.apache.org/jira/browse/SPARK-5570

[jira] [Updated] (SPARK-5426) SQL Java API helper methods

2015-02-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5426: Priority: Blocker (was: Minor) SQL Java API helper methods ---

[jira] [Updated] (SPARK-5426) SQL Java API helper methods

2015-02-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5426: Target Version/s: 1.3.0 SQL Java API helper methods ---

[jira] [Commented] (SPARK-5576) saveAsTable into Hive fails due to duplicate columns

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304229#comment-14304229 ] Apache Spark commented on SPARK-5576: - User 'danosipov' has created a pull request for

[jira] [Resolved] (SPARK-4986) Graceful shutdown for Spark Streaming does not work in Standalone cluster mode

2015-02-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4986. -- Resolution: Fixed Fix Version/s: 1.2.2 Graceful shutdown for Spark Streaming does not

[jira] [Commented] (SPARK-5574) Utils.createDirectory ignores namePrefix

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304190#comment-14304190 ] Apache Spark commented on SPARK-5574: - User 'squito' has created a pull request for

[jira] [Created] (SPARK-5576) saveAsTable into Hive fails due to duplicate columns

2015-02-03 Thread Dan Osipov (JIRA)
Dan Osipov created SPARK-5576: - Summary: saveAsTable into Hive fails due to duplicate columns Key: SPARK-5576 URL: https://issues.apache.org/jira/browse/SPARK-5576 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5574) Utils.createDirectory ignores namePrefix

2015-02-03 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-5574: --- Summary: Utils.createDirectory ignores namePrefix Key: SPARK-5574 URL: https://issues.apache.org/jira/browse/SPARK-5574 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5575) Artificial neural networks for MLlib deep learning

2015-02-03 Thread Alexander Ulanov (JIRA)
Alexander Ulanov created SPARK-5575: --- Summary: Artificial neural networks for MLlib deep learning Key: SPARK-5575 URL: https://issues.apache.org/jira/browse/SPARK-5575 Project: Spark Issue

[jira] [Commented] (SPARK-5557) spark-shell failed to start

2015-02-03 Thread Ben Mabey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304252#comment-14304252 ] Ben Mabey commented on SPARK-5557: -- I ran a git bisect and this is the first bad commit:

[jira] [Commented] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2015-02-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304298#comment-14304298 ] Joseph K. Bradley commented on SPARK-5021: -- That BLAS implementation is actually

[jira] [Comment Edited] (SPARK-5280) Import RDF graphs into GraphX

2015-02-03 Thread lukovnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304070#comment-14304070 ] lukovnikov edited comment on SPARK-5280 at 2/3/15 11:27 PM:

[jira] [Comment Edited] (SPARK-5280) Import RDF graphs into GraphX

2015-02-03 Thread lukovnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304070#comment-14304070 ] lukovnikov edited comment on SPARK-5280 at 2/3/15 11:28 PM:

[jira] [Resolved] (SPARK-5550) Custom UDF is case sensitive for HiveContext

2015-02-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5550. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4326

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303913#comment-14303913 ] Josh Rosen commented on SPARK-5548: --- Maybe this fails non-deterministically? Or maybe

[jira] [Created] (SPARK-5572) LDA improvement listing

2015-02-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5572: Summary: LDA improvement listing Key: SPARK-5572 URL: https://issues.apache.org/jira/browse/SPARK-5572 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-02-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303918#comment-14303918 ] Joseph K. Bradley commented on SPARK-1405: -- Thanks everyone for all of your

[jira] [Updated] (SPARK-5260) Expose JsonRDD.allKeysWithValueTypes() in a utility class

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5260: --- Assignee: Corey J. Nolet Expose JsonRDD.allKeysWithValueTypes() in a utility class

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-03 Thread Anand Mohan Tumuluri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303924#comment-14303924 ] Anand Mohan Tumuluri commented on SPARK-5472: - [~tmyklebu] Many thanks for

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303934#comment-14303934 ] Reynold Xin commented on SPARK-5472: What if we expand the JDBC data source to support

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303953#comment-14303953 ] Jacek Lewandowski commented on SPARK-5548: -- You are absolutely right

[jira] [Resolved] (SPARK-4768) Add Support For Impala Encoded Timestamp (INT96)

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-4768. - Resolution: Duplicate SPARK-4987 has resolved the issues. I am resolving this one. Add Support For

[jira] [Comment Edited] (SPARK-4768) Add Support For Impala Encoded Timestamp (INT96)

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303960#comment-14303960 ] Yin Huai edited comment on SPARK-4768 at 2/3/15 8:51 PM: -

[jira] [Updated] (SPARK-4768) Add Support For Impala Encoded Timestamp (INT96)

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-4768: Fix Version/s: 1.3.0 Add Support For Impala Encoded Timestamp (INT96)

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-03 Thread Tor Myklebust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303961#comment-14303961 ] Tor Myklebust commented on SPARK-5472: -- It probably does not handle SQL ARRAY types

[jira] [Commented] (SPARK-5420) Cross-langauge load/store functions for creating and saving DataFrames

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303967#comment-14303967 ] Yin Huai commented on SPARK-5420: - I am copying the summary of write related interfaces

[jira] [Updated] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5548: -- Labels: flaky-test (was: ) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on -

[jira] [Commented] (SPARK-5260) Expose JsonRDD.allKeysWithValueTypes() in a utility class

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303927#comment-14303927 ] Reynold Xin commented on SPARK-5260: BTW I've also added you to the contributor list.

[jira] [Comment Edited] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303933#comment-14303933 ] Reynold Xin edited comment on SPARK-5472 at 2/3/15 8:39 PM:

[jira] [Issue Comment Deleted] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5472: --- Comment: was deleted (was: What if we expand the JDBC data source to support arbitrary queries? )

[jira] [Resolved] (SPARK-4709) Spark SQL support error reading Parquet with timestamp type field

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-4709. - Resolution: Duplicate Target Version/s: (was: 1.1.0) Seems it duplicates SPARK-4987. I am

[jira] [Resolved] (SPARK-5383) support alias for udfs with multi output columns

2015-02-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5383. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4186

[jira] [Resolved] (SPARK-4508) Native Date type for SQL92 Date

2015-02-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4508. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4325

[jira] [Created] (SPARK-5571) LDA should handle text as well

2015-02-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5571: Summary: LDA should handle text as well Key: SPARK-5571 URL: https://issues.apache.org/jira/browse/SPARK-5571 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-02-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303918#comment-14303918 ] Joseph K. Bradley edited comment on SPARK-1405 at 2/3/15 8:29 PM:

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303921#comment-14303921 ] Jacek Lewandowski commented on SPARK-5548: -- I'll definitely check it. However I

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303933#comment-14303933 ] Reynold Xin commented on SPARK-5472: What if we expand the JDBC data source to support

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-03 Thread Tor Myklebust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303949#comment-14303949 ] Tor Myklebust commented on SPARK-5472: -- This is good feedback. Thanks. You don't

[jira] [Updated] (SPARK-4987) Parquet support for timestamp type

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-4987: Target Version/s: 1.3.0 Parquet support for timestamp type --

[jira] [Resolved] (SPARK-4987) Parquet support for timestamp type

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-4987. - Resolution: Fixed Fix Version/s: 1.3.0 Thank you [~adrian-wang]! Parquet support for timestamp

[jira] [Comment Edited] (SPARK-5420) Cross-langauge load/store functions for creating and saving DataFrames

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303771#comment-14303771 ] Yin Huai edited comment on SPARK-5420 at 2/3/15 8:54 PM: - This

[jira] [Comment Edited] (SPARK-5501) Write support for the data source API

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303760#comment-14303760 ] Yin Huai edited comment on SPARK-5501 at 2/3/15 8:55 PM: - h3. End

[jira] [Commented] (SPARK-5420) Cross-langauge load/store functions for creating and saving DataFrames

2015-02-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303982#comment-14303982 ] Yin Huai commented on SPARK-5420: - h3. End user APIs added to SQLContext (load related)

[jira] [Commented] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303992#comment-14303992 ] Apache Spark commented on SPARK-5548: - User 'jacek-lewandowski' has created a pull

[jira] [Commented] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

2015-02-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302999#comment-14302999 ] Patrick Wendell commented on SPARK-4550: The doc alludes to having to (at some

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303074#comment-14303074 ] Sean Owen commented on SPARK-5556: -- To clarify, since I had to double-check too, the LDA

[jira] [Commented] (SPARK-5552) Automated data science AMI creation and data science cluster deployment on EC2

2015-02-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303080#comment-14303080 ] Sean Owen commented on SPARK-5552: -- It sounds fine, but not something that lives within

[jira] [Commented] (SPARK-2945) Allow specifying num of executors in the context configuration

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303088#comment-14303088 ] Apache Spark commented on SPARK-2945: - User 'WangTaoTheTonic' has created a pull

[jira] [Created] (SPARK-5557) spark-shell failed to start

2015-02-03 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-5557: -- Summary: spark-shell failed to start Key: SPARK-5557 URL: https://issues.apache.org/jira/browse/SPARK-5557 Project: Spark Issue Type: Bug Reporter:

[jira] [Commented] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-03 Thread Twinkle Sachdeva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303039#comment-14303039 ] Twinkle Sachdeva commented on SPARK-4705: - Hi [~bcwalrus], ( please ignore above

[jira] [Created] (SPARK-5578) Provide a convenient way for Scala users to use UDFs

2015-02-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5578: -- Summary: Provide a convenient way for Scala users to use UDFs Key: SPARK-5578 URL: https://issues.apache.org/jira/browse/SPARK-5578 Project: Spark Issue Type:

[jira] [Created] (SPARK-5577) Create a convenient way for Python users to register SQL UDFs

2015-02-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5577: -- Summary: Create a convenient way for Python users to register SQL UDFs Key: SPARK-5577 URL: https://issues.apache.org/jira/browse/SPARK-5577 Project: Spark

[jira] [Commented] (SPARK-5578) Provide a convenient way for Scala users to use UDFs

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304349#comment-14304349 ] Apache Spark commented on SPARK-5578: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-5460) RandomForest should catch exceptions when removing checkpoint files

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304352#comment-14304352 ] Apache Spark commented on SPARK-5460: - User 'x1-' has created a pull request for this

[jira] [Resolved] (SPARK-5554) Add more tests and docs for DataFrame Python API

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5554. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Davies Liu Add more tests and

[jira] [Updated] (SPARK-5554) Add more tests and docs for DataFrame Python API

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5554: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-5166 Add more tests and docs for

[jira] [Created] (SPARK-5579) Provide support for project using SQL expression

2015-02-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5579: -- Summary: Provide support for project using SQL expression Key: SPARK-5579 URL: https://issues.apache.org/jira/browse/SPARK-5579 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5579) Provide support for project using SQL expression

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304378#comment-14304378 ] Apache Spark commented on SPARK-5579: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-02-03 Thread Anand Mohan Tumuluri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304383#comment-14304383 ] Anand Mohan Tumuluri commented on SPARK-5472: - Thanks again [~rxin] and

[jira] [Commented] (SPARK-5552) Automated data science AMI creation and data science cluster deployment on EC2

2015-02-03 Thread Florian Verhein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304412#comment-14304412 ] Florian Verhein commented on SPARK-5552: Thanks [~sowen]. So it wouldn't fit in

[jira] [Updated] (SPARK-5574) Utils.createDirectory ignores namePrefix

2015-02-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5574: --- Assignee: Imran Rashid Utils.createDirectory ignores namePrefix

[jira] [Commented] (SPARK-5153) flaky test of Reliable Kafka input stream with multiple topics

2015-02-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304423#comment-14304423 ] Saisai Shao commented on SPARK-5153: Hi TD, thanks a lot for your PR, currently I've

[jira] [Resolved] (SPARK-5520) Make FP-Growth implementation take generic item types

2015-02-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5520. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4340

[jira] [Created] (SPARK-5555) Enable UISeleniumSuite tests

2015-02-03 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-: - Summary: Enable UISeleniumSuite tests Key: SPARK- URL: https://issues.apache.org/jira/browse/SPARK- Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-5555) Enable UISeleniumSuite tests

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303023#comment-14303023 ] Apache Spark commented on SPARK-: - User 'JoshRosen' has created a pull request for

[jira] [Created] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-02-03 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-5556: -- Summary: Latent Dirichlet Allocation (LDA) using Gibbs sampler Key: SPARK-5556 URL: https://issues.apache.org/jira/browse/SPARK-5556 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

2015-02-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304010#comment-14304010 ] Patrick Wendell commented on SPARK-5388: The intention for this is really just to

[jira] [Commented] (SPARK-5280) Import RDF graphs into GraphX

2015-02-03 Thread lukovnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304070#comment-14304070 ] lukovnikov commented on SPARK-5280: --- started working on it:

[jira] [Resolved] (SPARK-5153) flaky test of Reliable Kafka input stream with multiple topics

2015-02-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-5153. -- Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 flaky test of Reliable

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

2015-02-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304052#comment-14304052 ] Marcelo Vanzin commented on SPARK-5388: --- Hi Patrick, Most of my questions are

[jira] [Commented] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-03 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304433#comment-14304433 ] Hong Shen commented on SPARK-5529: -- Executor will lost when a akka throw a

[jira] [Commented] (SPARK-2945) Allow specifying num of executors in the context configuration

2015-02-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304446#comment-14304446 ] Apache Spark commented on SPARK-2945: - User 'WangTaoTheTonic' has created a pull

<    1   2