[jira] [Updated] (SPARK-2924) Remove use of default arguments where disallowed by 2.11

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2924: --- Priority: Blocker (was: Major) Target Version/s: 1.1.0 > Remove use of default a

[jira] [Created] (SPARK-2924) Remove use of default arguments where disallowed by 2.11

2014-08-07 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2924: -- Summary: Remove use of default arguments where disallowed by 2.11 Key: SPARK-2924 URL: https://issues.apache.org/jira/browse/SPARK-2924 Project: Spark Is

[jira] [Commented] (SPARK-2911) provide rdd.parent[T](j) to obtain jth parent of rdd

2014-08-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090397#comment-14090397 ] Reynold Xin commented on SPARK-2911: Would you like to change the usage of dependencie

[jira] [Commented] (SPARK-2878) Inconsistent Kryo serialisation with custom Kryo Registrator

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090354#comment-14090354 ] Apache Spark commented on SPARK-2878: - User 'ash211' has created a pull request for th

[jira] [Commented] (SPARK-2923) Implement some basic linalg operations in MLlib

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090352#comment-14090352 ] Apache Spark commented on SPARK-2923: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-2923) Implement some basic linalg operations in MLlib

2014-08-07 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-2923: Summary: Implement some basic linalg operations in MLlib Key: SPARK-2923 URL: https://issues.apache.org/jira/browse/SPARK-2923 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-2919) Basic support for analyze command in HiveQl

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090296#comment-14090296 ] Apache Spark commented on SPARK-2919: - User 'yhuai' has created a pull request for thi

[jira] [Updated] (SPARK-2919) Basic support for analyze command in HiveQl

2014-08-07 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2919: Summary: Basic support for analyze command in HiveQl (was: Basic support for analyze command in SQL) >

[jira] [Closed] (SPARK-2922) spark web ui: Internal Error: Missing Template ERR_DNS_FAIL

2014-08-07 Thread hanyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hanyu closed SPARK-2922. Resolution: Fixed > spark web ui: Internal Error: Missing Template ERR_DNS_FAIL > -

[jira] [Commented] (SPARK-2906) FileLogger throws a invocation target exception.

2014-08-07 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090263#comment-14090263 ] Guoqiang Li commented on SPARK-2906: [~srowen] The reason seems to be the user code ca

[jira] [Created] (SPARK-2922) spark web ui: Internal Error: Missing Template ERR_DNS_FAIL

2014-08-07 Thread hanyu (JIRA)
hanyu created SPARK-2922: Summary: spark web ui: Internal Error: Missing Template ERR_DNS_FAIL Key: SPARK-2922 URL: https://issues.apache.org/jira/browse/SPARK-2922 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090237#comment-14090237 ] Andrew Or commented on SPARK-2914: -- https://github.com/apache/spark/pull/1845 > spark.*.

[jira] [Updated] (SPARK-2906) FileLogger throws a invocation target exception.

2014-08-07 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2906: --- Description: {noformat} 4/08/07 23:57:02 ERROR scheduler.LiveListenerBus: Listener EventLoggingListe

[jira] [Commented] (SPARK-2918) EXPLAIN doens't support the native command

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090235#comment-14090235 ] Apache Spark commented on SPARK-2918: - User 'chenghao-intel' has created a pull reques

[jira] [Created] (SPARK-2921) Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)

2014-08-07 Thread Andrew Or (JIRA)
Andrew Or created SPARK-2921: Summary: Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things) Key: SPARK-2921 URL: https://issues.apache.org/jira/browse/SPARK-2921 Project: Sp

[jira] [Comment Edited] (SPARK-2918) EXPLAIN doens't support the native command

2014-08-07 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090226#comment-14090226 ] Cheng Hao edited comment on SPARK-2918 at 8/8/14 2:44 AM: -- Usuall

[jira] [Commented] (SPARK-2918) EXPLAIN doens't support the native command

2014-08-07 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090226#comment-14090226 ] Cheng Hao commented on SPARK-2918: -- Usually shouldn't be a problem in a normal SQL query,

[jira] [Created] (SPARK-2920) TorrentBroadcast does not support broadcast compression

2014-08-07 Thread Joseph Su (JIRA)
Joseph Su created SPARK-2920: Summary: TorrentBroadcast does not support broadcast compression Key: SPARK-2920 URL: https://issues.apache.org/jira/browse/SPARK-2920 Project: Spark Issue Type: Bu

[jira] [Created] (SPARK-2919) Basic support for analyze command in SQL

2014-08-07 Thread Yin Huai (JIRA)
Yin Huai created SPARK-2919: --- Summary: Basic support for analyze command in SQL Key: SPARK-2919 URL: https://issues.apache.org/jira/browse/SPARK-2919 Project: Spark Issue Type: Bug Compo

[jira] [Created] (SPARK-2918) EXPLAIN doens't support the native command

2014-08-07 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-2918: Summary: EXPLAIN doens't support the native command Key: SPARK-2918 URL: https://issues.apache.org/jira/browse/SPARK-2918 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2917) Avoid CTAS creates table in logical plan analyzing.

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090208#comment-14090208 ] Apache Spark commented on SPARK-2917: - User 'chenghao-intel' has created a pull reques

[jira] [Created] (SPARK-2917) Avoid CTAS creates table in logical plan analyzing.

2014-08-07 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-2917: Summary: Avoid CTAS creates table in logical plan analyzing. Key: SPARK-2917 URL: https://issues.apache.org/jira/browse/SPARK-2917 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2849) bin/spark-submit should respect spark.driver.* for client mode

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090194#comment-14090194 ] Apache Spark commented on SPARK-2849: - User 'andrewor14' has created a pull request fo

[jira] [Updated] (SPARK-2916) [MLlib] While running regression tests with dense vectors of length greater than 1000, the treeAggregate blows up after several iterations

2014-08-07 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-2916: --- Description: While running any of the regression algorithms with gradient descent, the treeAggregate

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2914: - Description: If we pass the following to spark.executor.extraJavaOptions, {code} -Dthem.quotes="the \"bes

[jira] [Created] (SPARK-2916) While running regression tests with dense vectors of length greater than 1000, the treeAggregate blows up after several iterations

2014-08-07 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-2916: -- Summary: While running regression tests with dense vectors of length greater than 1000, the treeAggregate blows up after several iterations Key: SPARK-2916 URL: https://issues.apache.

[jira] [Updated] (SPARK-2904) Remove non-used local variable in SparkSubmitArguments

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2904: --- Assignee: Kousuke Saruta > Remove non-used local variable in SparkSubmitArguments > -

[jira] [Resolved] (SPARK-2904) Remove non-used local variable in SparkSubmitArguments

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2904. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1834 [https://

[jira] [Updated] (SPARK-2916) [MLlib] While running regression tests with dense vectors of length greater than 1000, the treeAggregate blows up after several iterations

2014-08-07 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-2916: --- Summary: [MLlib] While running regression tests with dense vectors of length greater than 1000, the t

[jira] [Created] (SPARK-2915) Storage summary table UI glitch when using sparkSQL

2014-08-07 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-2915: - Summary: Storage summary table UI glitch when using sparkSQL Key: SPARK-2915 URL: https://issues.apache.org/jira/browse/SPARK-2915 Project: Spark Issue Typ

[jira] [Updated] (SPARK-2590) Add config property to disable incremental collection used in Thrift server

2014-08-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2590: Priority: Blocker (was: Minor) > Add config property to disable incremental collection use

[jira] [Updated] (SPARK-2590) Add config property to disable incremental collection used in Thrift server

2014-08-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2590: Target Version/s: 1.1.0 Assignee: Cheng Lian > Add config property to disable i

[jira] [Updated] (SPARK-2565) Update ShuffleReadMetrics as blocks are fetched

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2565: --- Assignee: Sandy Ryza > Update ShuffleReadMetrics as blocks are fetched >

[jira] [Resolved] (SPARK-2565) Update ShuffleReadMetrics as blocks are fetched

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2565. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1507 [https://

[jira] [Resolved] (SPARK-2787) Make sort-based shuffle write files directly when there is no sorting / aggregation and # of partitions is small

2014-08-07 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-2787. -- Resolution: Fixed Fix Version/s: 1.1.0 > Make sort-based shuffle write files directly wh

[jira] [Resolved] (SPARK-2847) SPARK SQL Hive misses "SHOW CREATE TABLE" command

2014-08-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2847. - Resolution: Duplicate > SPARK SQL Hive misses "SHOW CREATE TABLE" command > -

[jira] [Commented] (SPARK-2913) Spark's log4j.properties should always appear ahead of Hadoop's on classpath

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090089#comment-14090089 ] Apache Spark commented on SPARK-2913: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-2913) Spark's log4j.properties should always appear ahead of Hadoop's on classpath

2014-08-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090087#comment-14090087 ] Josh Rosen commented on SPARK-2913: --- Posted some workarounds on a StackOverflow question

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2914: - Summary: spark.*.extraJavaOptions are evaluated too many times (was: spark.*.extraJavaOptions are escape

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are escaped too many times

2014-08-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2914: - Description: If we pass the following to spark.executor.extraJavaOptions, {code} -Dthem.quotes="the \"bes

[jira] [Created] (SPARK-2914) spark.*.extraJavaOptions are escaped too many times

2014-08-07 Thread Andrew Or (JIRA)
Andrew Or created SPARK-2914: Summary: spark.*.extraJavaOptions are escaped too many times Key: SPARK-2914 URL: https://issues.apache.org/jira/browse/SPARK-2914 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2913) Spark's log4j.properties should always appear ahead of Hadoop's on classpath

2014-08-07 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-2913: - Summary: Spark's log4j.properties should always appear ahead of Hadoop's on classpath Key: SPARK-2913 URL: https://issues.apache.org/jira/browse/SPARK-2913 Project: Spark

[jira] [Commented] (SPARK-2889) Spark creates Hadoop Configuration objects inconsistently

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090040#comment-14090040 ] Apache Spark commented on SPARK-2889: - User 'vanzin' has created a pull request for th

[jira] [Created] (SPARK-2912) Jenkins should include the commit hash in his messages

2014-08-07 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-2912: --- Summary: Jenkins should include the commit hash in his messages Key: SPARK-2912 URL: https://issues.apache.org/jira/browse/SPARK-2912 Project: Spark Is

[jira] [Resolved] (SPARK-2899) Doc generation is not working in new SBT Build

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2899. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1830 [https://

[jira] [Updated] (SPARK-2894) spark-shell doesn't accept flags

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2894: --- Target Version/s: 1.1.0 > spark-shell doesn't accept flags >

[jira] [Updated] (SPARK-2894) spark-shell doesn't accept flags

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2894: --- Priority: Blocker (was: Critical) > spark-shell doesn't accept flags > -

[jira] [Updated] (SPARK-2869) Potential leak of Jdbc Connection and PreparedStatement in case of error in JdbcRDD

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2869: --- Target Version/s: 1.1.0 (was: 1.2.0) > Potential leak of Jdbc Connection and PreparedStateme

[jira] [Updated] (SPARK-2869) Potential leak of Jdbc Connection and PreparedStatement in case of error in JdbcRDD

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2869: --- Fix Version/s: (was: 1.2.0) > Potential leak of Jdbc Connection and PreparedStatement in

[jira] [Updated] (SPARK-2865) Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2865: --- Target Version/s: 1.1.0 (was: 1.1.0, 1.2.0) > Potential deadlock: tasks could hang forever w

[jira] [Updated] (SPARK-2167) spark-submit should return exit code based on failure/success

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2167: --- Issue Type: New Feature (was: Bug) > spark-submit should return exit code based on failure/s

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090012#comment-14090012 ] Patrick Wendell commented on SPARK-2881: What about using the existing spark local

[jira] [Resolved] (SPARK-2901) it's a test

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2901. Resolution: Invalid > it's a test > --- > > Key: SPARK-2901 >

[jira] [Updated] (SPARK-2678) `Spark-submit` overrides user application options

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2678: --- Fix Version/s: 1.0.3 > `Spark-submit` overrides user application options > --

[jira] [Resolved] (SPARK-2678) `Spark-submit` overrides user application options

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2678. Resolution: Fixed > `Spark-submit` overrides user application options > ---

[jira] [Comment Edited] (SPARK-2880) spark-submit processes app cmdline options

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090002#comment-14090002 ] Patrick Wendell edited comment on SPARK-2880 at 8/7/14 11:01 PM: ---

[jira] [Commented] (SPARK-2678) `Spark-submit` overrides user application options

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090005#comment-14090005 ] Patrick Wendell commented on SPARK-2678: Fixed in 1.0.3 via: https://github.com/ap

[jira] [Resolved] (SPARK-2880) spark-submit processes app cmdline options

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2880. Resolution: Duplicate I believe this is a dup of SPARK-2687. Feel free to re-open it if it'

[jira] [Updated] (SPARK-2905) spark-sql shows 'sbin' instead of 'bin' in the 'usage' string

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2905: --- Assignee: Oleg Danilov > spark-sql shows 'sbin' instead of 'bin' in the 'usage' string >

[jira] [Resolved] (SPARK-2905) spark-sql shows 'sbin' instead of 'bin' in the 'usage' string

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2905. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1835 [https://

[jira] [Reopened] (SPARK-2851) Check API consistency for decision tree

2014-08-07 Thread Doris Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Xin reopened SPARK-2851: -- Shouldn't have been auto-closed with the PR. > Check API consistency for decision tree > -

[jira] [Commented] (SPARK-2898) Failed to connect to daemon

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089915#comment-14089915 ] Apache Spark commented on SPARK-2898: - User 'davies' has created a pull request for th

[jira] [Closed] (SPARK-2903) Spark SQL tests fail to compile due to dependency structure, misplaced test class

2014-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-2903. Resolution: Not a Problem Agh, you know what, there are other problems of this form once the build reaches

[jira] [Commented] (SPARK-2628) Mesos backend throwing unable to find LoginModule

2014-08-07 Thread Martin Weindel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089864#comment-14089864 ] Martin Weindel commented on SPARK-2628: --- My guess is, that this happens with Hadoop

[jira] [Commented] (SPARK-2911) provide rdd.parent[T](j) to obtain jth parent of rdd

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089865#comment-14089865 ] Apache Spark commented on SPARK-2911: - User 'erikerlandson' has created a pull request

[jira] [Created] (SPARK-2911) provide rdd.parent[T](j) to obtain jth parent of rdd

2014-08-07 Thread Erik Erlandson (JIRA)
Erik Erlandson created SPARK-2911: - Summary: provide rdd.parent[T](j) to obtain jth parent of rdd Key: SPARK-2911 URL: https://issues.apache.org/jira/browse/SPARK-2911 Project: Spark Issue Ty

[jira] [Created] (SPARK-2910) Test with Python 2.6 on Jenkins

2014-08-07 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-2910: - Summary: Test with Python 2.6 on Jenkins Key: SPARK-2910 URL: https://issues.apache.org/jira/browse/SPARK-2910 Project: Spark Issue Type: Improvement Com

[jira] [Updated] (SPARK-2110) Misleading help displayed for interactive mode pyspark --help

2014-08-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2110: -- Component/s: PySpark Documentation Priority: Blocker (was: Ma

[jira] [Updated] (SPARK-2909) Indexing for SparseVector in pyspark

2014-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-2909: - Description: SparseVector in pyspark does not currently support indexing, except by exami

[jira] [Updated] (SPARK-2909) Indexing for SparseVector in pyspark

2014-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-2909: - Summary: Indexing for SparseVector in pyspark (was: Indexing for vectors in pyspark) >

[jira] [Updated] (SPARK-2909) Indexing for vectors in pyspark

2014-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-2909: - Summary: Indexing for vectors in pyspark (was: Indexing for vectors in MLlib) > Indexin

[jira] [Updated] (SPARK-2909) Indexing for vectors in pyspark

2014-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-2909: - Description: Vectors (DenseVector and SparseVector) in pyspark do not currently support i

[jira] [Updated] (SPARK-2909) Indexing for vectors in pyspark

2014-08-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-2909: - Component/s: PySpark > Indexing for vectors in pyspark > ---

[jira] [Updated] (SPARK-2903) Spark SQL tests fail to compile due to dependency structure, misplaced test class

2014-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2903: - Priority: Minor (was: Critical) See discussion in PR. I don't think this is nearly as blocking as it see

[jira] [Commented] (SPARK-2908) JsonRDD.nullTypeToStringType does not convert all NullType to StringType

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089837#comment-14089837 ] Apache Spark commented on SPARK-2908: - User 'yhuai' has created a pull request for thi

[jira] [Created] (SPARK-2909) Indexing for vectors in MLlib

2014-08-07 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-2909: Summary: Indexing for vectors in MLlib Key: SPARK-2909 URL: https://issues.apache.org/jira/browse/SPARK-2909 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-2898) Failed to connect to daemon

2014-08-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-2898: -- Description: There is a deadlock in handle_sigchld() because of logging -

[jira] [Created] (SPARK-2908) JsonRDD.nullTypeToStringType does not convert all NullType to StringType

2014-08-07 Thread Yin Huai (JIRA)
Yin Huai created SPARK-2908: --- Summary: JsonRDD.nullTypeToStringType does not convert all NullType to StringType Key: SPARK-2908 URL: https://issues.apache.org/jira/browse/SPARK-2908 Project: Spark

[jira] [Assigned] (SPARK-2101) Python unit tests fail on Python 2.6 because of lack of unittest.skipIf()

2014-08-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-2101: - Assignee: Josh Rosen > Python unit tests fail on Python 2.6 because of lack of unittest.skipIf()

[jira] [Commented] (SPARK-2878) Inconsistent Kryo serialisation with custom Kryo Registrator

2014-08-07 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089632#comment-14089632 ] Andrew Ash commented on SPARK-2878: --- I think I'm seeing this too in Spark 1.0.1, stacktr

[jira] [Updated] (SPARK-2898) Failed to connect to daemon

2014-08-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-2898: -- Description: Java options: -Dspark

[jira] [Updated] (SPARK-2898) Failed to connect to daemon

2014-08-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-2898: -- Component/s: PySpark > Failed to connect to daemon > --- > > Ke

[jira] [Updated] (SPARK-2898) Failed to connect to daemon

2014-08-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-2898: -- Description: Java options: -Dspark

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089568#comment-14089568 ] Ted Yu commented on SPARK-1297: --- bq. the HBase Hadoop 2 deps can be copied into the various

[jira] [Commented] (SPARK-2865) Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish

2014-08-07 Thread Zongheng Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089541#comment-14089541 ] Zongheng Yang commented on SPARK-2865: -- This might be related to the fact that the de

[jira] [Created] (SPARK-2907) Use mutable.HashMap to represent Model in Word2Vec

2014-08-07 Thread Liquan Pei (JIRA)
Liquan Pei created SPARK-2907: - Summary: Use mutable.HashMap to represent Model in Word2Vec Key: SPARK-2907 URL: https://issues.apache.org/jira/browse/SPARK-2907 Project: Spark Issue Type: Improv

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089499#comment-14089499 ] Sean Owen commented on SPARK-1297: -- Yes, the problem though is that at least one of the p

[jira] [Commented] (SPARK-2906) FileLogger throws a invocation target exception.

2014-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089488#comment-14089488 ] Sean Owen commented on SPARK-2906: -- Did this occur during shutdown? It may be mostly harm

[jira] [Commented] (SPARK-2315) drop, dropRight and dropWhile which take RDD input and return RDD

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089411#comment-14089411 ] Apache Spark commented on SPARK-2315: - User 'erikerlandson' has created a pull request

[jira] [Created] (SPARK-2906) FileLogger throws a invocation target exception.

2014-08-07 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-2906: -- Summary: FileLogger throws a invocation target exception. Key: SPARK-2906 URL: https://issues.apache.org/jira/browse/SPARK-2906 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-08-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089331#comment-14089331 ] Ted Yu commented on SPARK-1297: --- We can add two profiles for 0.98: hbase-hadoop1 and hbase-h

[jira] [Commented] (SPARK-2897) org.apache.spark.broadcast.TorrentBroadcast does use the serializer class specified in the spark option "spark.serializer"

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089217#comment-14089217 ] Apache Spark commented on SPARK-2897: - User 'witgo' has created a pull request for thi

[jira] [Commented] (SPARK-2905) spark-sql shows 'sbin' instead of 'bin' in the 'usage' string

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089192#comment-14089192 ] Apache Spark commented on SPARK-2905: - User 'dosoft' has created a pull request for th

[jira] [Created] (SPARK-2905) spark-sql shows 'sbin' instead of 'bin' in the 'usage' string

2014-08-07 Thread Oleg Danilov (JIRA)
Oleg Danilov created SPARK-2905: --- Summary: spark-sql shows 'sbin' instead of 'bin' in the 'usage' string Key: SPARK-2905 URL: https://issues.apache.org/jira/browse/SPARK-2905 Project: Spark Is

[jira] [Commented] (SPARK-2904) Remove non-used local variable in SparkSubmitArguments

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089107#comment-14089107 ] Apache Spark commented on SPARK-2904: - User 'sarutak' has created a pull request for t

[jira] [Created] (SPARK-2904) Remove non-used local variable in SparkSubmitArguments

2014-08-07 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-2904: - Summary: Remove non-used local variable in SparkSubmitArguments Key: SPARK-2904 URL: https://issues.apache.org/jira/browse/SPARK-2904 Project: Spark Issue

[jira] [Commented] (SPARK-2432) Apriori algorithm for frequent itemset mining

2014-08-07 Thread lukovnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089052#comment-14089052 ] lukovnikov commented on SPARK-2432: --- Thanks, didn't find it while looking for FIM on Spa

[jira] [Commented] (SPARK-2903) Spark SQL tests fail to compile due to dependency structure, misplaced test class

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089018#comment-14089018 ] Apache Spark commented on SPARK-2903: - User 'srowen' has created a pull request for th

[jira] [Created] (SPARK-2903) Spark SQL tests fail to compile due to dependency structure, misplaced test class

2014-08-07 Thread Sean Owen (JIRA)
Sean Owen created SPARK-2903: Summary: Spark SQL tests fail to compile due to dependency structure, misplaced test class Key: SPARK-2903 URL: https://issues.apache.org/jira/browse/SPARK-2903 Project: Spar

[jira] [Commented] (SPARK-2902) Enable compression for in-memory columnar storage by default

2014-08-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088973#comment-14088973 ] Apache Spark commented on SPARK-2902: - User 'liancheng' has created a pull request for

  1   2   >