[jira] [Commented] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051151#comment-14051151 ] Xiangrui Meng commented on SPARK-2341: -- [~srowen] Instead of taking string labels

[jira] [Created] (SPARK-2353) ArrayIndexOutOfBoundsException in scheduler

Mridul Muralidharan created SPARK-2353: -- Summary: ArrayIndexOutOfBoundsException in scheduler Key: SPARK-2353 URL: https://issues.apache.org/jira/browse/SPARK-2353 Project: Spark Issue

[jira] [Commented] (SPARK-2341) loadLibSVMFile doesn't handle regression datasets

[ https://issues.apache.org/jira/browse/SPARK-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051194#comment-14051194 ] Sean Owen commented on SPARK-2341: -- [~mengxr] For regression, rather than further

[jira] [Commented] (SPARK-2330) Spark shell has weird scala semantics

[ https://issues.apache.org/jira/browse/SPARK-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051280#comment-14051280 ] Andrea Ferretti commented on SPARK-2330: I have tried this by pulling from git and

[jira] [Commented] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051282#comment-14051282 ] Andrea Ferretti commented on SPARK-1199: More examples on

[jira] [Commented] (SPARK-2330) Spark shell has weird scala semantics

[ https://issues.apache.org/jira/browse/SPARK-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051298#comment-14051298 ] Sean Owen commented on SPARK-2330: -- Hm. Yes I have the same error now. I don't know why I

[jira] [Comment Edited] (SPARK-2339) SQL parser in sql-core is case sensitive, but a table alias is converted to lower case when we create Subquery

[ https://issues.apache.org/jira/browse/SPARK-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050721#comment-14050721 ] Yin Huai edited comment on SPARK-2339 at 7/3/14 1:46 PM: - Also,

[jira] [Commented] (SPARK-2277) Make TaskScheduler track whether there's host on a rack

[ https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051575#comment-14051575 ] Mridul Muralidharan commented on SPARK-2277: I have not rechecked that the

[jira] [Updated] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex updated SPARK-2344: Description: I would like to add a FCM (Fuzzy C-Means) algorithm to MLlib. FCM is very similar to K - Means

[jira] [Created] (SPARK-2354) BitSet Range Expanded when creating new one

Yijie Shen created SPARK-2354: - Summary: BitSet Range Expanded when creating new one Key: SPARK-2354 URL: https://issues.apache.org/jira/browse/SPARK-2354 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2355) Check for the number of clusters to avoid ArrayIndexOutOfBoundsException

Liang-Chi Hsieh created SPARK-2355: -- Summary: Check for the number of clusters to avoid ArrayIndexOutOfBoundsException Key: SPARK-2355 URL: https://issues.apache.org/jira/browse/SPARK-2355 Project:

[jira] [Resolved] (SPARK-2324) SparkContext should not exit directly when spark.local.dir is a list of multiple paths and one of them has error

[ https://issues.apache.org/jira/browse/SPARK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-2324. --- Resolution: Fixed Resolved by https://github.com/apache/spark/pull/1274 SparkContext

[jira] [Created] (SPARK-2356) Exaption: Could not locate executable null\bin\winutils.exe in the Hadoop

Kostiantyn Kudriavtsev created SPARK-2356: - Summary: Exaption: Could not locate executable null\bin\winutils.exe in the Hadoop Key: SPARK-2356 URL: https://issues.apache.org/jira/browse/SPARK-2356

[jira] [Updated] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostiantyn Kudriavtsev updated SPARK-2356: -- Summary: Exception: Could not locate executable null\bin\winutils.exe in the

[jira] [Resolved] (SPARK-2330) Spark shell has weird scala semantics

[ https://issues.apache.org/jira/browse/SPARK-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2330. - Resolution: Duplicate Going to close this as a duplicate. We should have a fix for the

[jira] [Resolved] (SPARK-2355) Check for the number of clusters to avoid ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2355. -- Resolution: Duplicate Check for the number of clusters to avoid

[jira] [Resolved] (SPARK-1675) Make clear whether computePrincipalComponents requires centered data

[ https://issues.apache.org/jira/browse/SPARK-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1675. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1171

[jira] [Created] (SPARK-2357) HashFilteredJoin doesn't match some equi-join query

Zongheng Yang created SPARK-2357: Summary: HashFilteredJoin doesn't match some equi-join query Key: SPARK-2357 URL: https://issues.apache.org/jira/browse/SPARK-2357 Project: Spark Issue

[jira] [Commented] (SPARK-1997) Update breeze to version 0.8.1

[ https://issues.apache.org/jira/browse/SPARK-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051882#comment-14051882 ] Xiangrui Meng commented on SPARK-1997: -- [~gq] Could you help test the following? 1)

[jira] [Resolved] (SPARK-2342) Evaluation helper's output type doesn't conform to input type

[ https://issues.apache.org/jira/browse/SPARK-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2342. - Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Evaluation

[jira] [Resolved] (SPARK-2357) HashFilteredJoin doesn't match some equi-join query

[ https://issues.apache.org/jira/browse/SPARK-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang resolved SPARK-2357. -- Resolution: Not a Problem HashFilteredJoin doesn't match some equi-join query

[jira] [Updated] (SPARK-2358) Add an option to include native BLAS/LAPACK loader in the build

[ https://issues.apache.org/jira/browse/SPARK-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2358: - Summary: Add an option to include native BLAS/LAPACK loader in the build (was: Add an option to

[jira] [Created] (SPARK-2358) Add an option to include native BLAS/LAPACK libraries in the build

Xiangrui Meng created SPARK-2358: Summary: Add an option to include native BLAS/LAPACK libraries in the build Key: SPARK-2358 URL: https://issues.apache.org/jira/browse/SPARK-2358 Project: Spark

[jira] [Updated] (SPARK-2353) ArrayIndexOutOfBoundsException in scheduler

[ https://issues.apache.org/jira/browse/SPARK-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-2353: --- Description: I suspect the recent changes from SPARK-1937 to compute valid locality

[jira] [Assigned] (SPARK-2358) Add an option to include native BLAS/LAPACK loader in the build

[ https://issues.apache.org/jira/browse/SPARK-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-2358: Assignee: Xiangrui Meng Add an option to include native BLAS/LAPACK loader in the build

[jira] [Commented] (SPARK-2308) Add KMeans MiniBatch clustering algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051946#comment-14051946 ] Xiangrui Meng commented on SPARK-2308: -- Is there a reference paper/work about using

[jira] [Updated] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mubarak Seyed updated SPARK-1853: - Attachment: Screen Shot 2014-07-03 at 2.54.05 PM.png Show Streaming application code context

[jira] [Resolved] (SPARK-2109) Setting SPARK_MEM for bin/pyspark does not work.

[ https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2109. Resolution: Fixed Fixed in master and 1.0 via

[jira] [Commented] (SPARK-1516) Yarn Client should not call System.exit, should throw exception instead.

[ https://issues.apache.org/jira/browse/SPARK-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051975#comment-14051975 ] Xiangrui Meng commented on SPARK-1516: -- PR for branch-0.9:

[jira] [Updated] (SPARK-1516) Yarn Client should not call System.exit, should throw exception instead.

[ https://issues.apache.org/jira/browse/SPARK-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1516: - Fix Version/s: 0.9.2 Yarn Client should not call System.exit, should throw exception instead.

[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051977#comment-14051977 ] Reynold Xin commented on SPARK-2017: It is definitely browser specific (but for all

[jira] [Updated] (SPARK-2359) Spark Stats package: supporting common statistical estimators for Big Data

[ https://issues.apache.org/jira/browse/SPARK-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2359: --- Assignee: Doris Xin Spark Stats package: supporting common statistical estimators for Big Data

[jira] [Updated] (SPARK-2359) Spark Stats package: supporting common statistical estimators for Big Data

[ https://issues.apache.org/jira/browse/SPARK-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2359: - Component/s: MLlib Spark Stats package: supporting common statistical estimators for Big Data

[jira] [Created] (SPARK-2359) Spark Stats package: supporting common statistical estimators for Big Data

Reynold Xin created SPARK-2359: -- Summary: Spark Stats package: supporting common statistical estimators for Big Data Key: SPARK-2359 URL: https://issues.apache.org/jira/browse/SPARK-2359 Project: Spark

[jira] [Updated] (SPARK-2359) Supporting common statistical estimators in MLlib

[ https://issues.apache.org/jira/browse/SPARK-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2359: - Summary: Supporting common statistical estimators in MLlib (was: Spark Stats package:

[jira] [Updated] (SPARK-2359) Supporting common statistical functions in MLlib

[ https://issues.apache.org/jira/browse/SPARK-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Xin updated SPARK-2359: - Summary: Supporting common statistical functions in MLlib (was: Supporting common statistical

[jira] [Resolved] (SPARK-2349) Fix NPE in ExternalAppendOnlyMap

[ https://issues.apache.org/jira/browse/SPARK-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-2349. --- Resolution: Fixed https://github.com/apache/spark/pull/1288 Fix NPE in

[jira] [Updated] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1853: - Assignee: Mubarak Seyed Show Streaming application code context (file, line number) in Spark

[jira] [Commented] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051998#comment-14051998 ] Tathagata Das commented on SPARK-1853: -- If you look at what is shown in any spark

[jira] [Commented] (SPARK-2346) Error parsing table names that starts with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052002#comment-14052002 ] Michael Armbrust commented on SPARK-2346: - I think this is actually a bug in the

[jira] [Commented] (SPARK-2346) Error parsing table names that starts with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052004#comment-14052004 ] Michael Armbrust commented on SPARK-2346: - Here is more info:

[jira] [Updated] (SPARK-2346) Error parsing table names that starts with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2346: Priority: Minor (was: Major) Error parsing table names that starts with numbers

[jira] [Updated] (SPARK-2346) Error parsing table names that starts with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2346: Labels: starter (was: Parser SQL) Error parsing table names that starts with numbers

[jira] [Updated] (SPARK-2346) Error parsing table names that starts with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2346: Fix Version/s: 1.1.0 Error parsing table names that starts with numbers

[jira] [Updated] (SPARK-2346) Register as table should not accept table names that start with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2346: Summary: Register as table should not accept table names that start with numbers (was:

[jira] [Commented] (SPARK-2346) Register as table should not accept table names that start with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052018#comment-14052018 ] Alexander Albul commented on SPARK-2346: Well, it depends actually. The link that

[jira] [Commented] (SPARK-2346) Register as table should not accept table names that start with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052020#comment-14052020 ] Michael Armbrust commented on SPARK-2346: - The goal of the SQL method is to

[jira] [Comment Edited] (SPARK-2346) Register as table should not accept table names that start with numbers

[ https://issues.apache.org/jira/browse/SPARK-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052020#comment-14052020 ] Michael Armbrust edited comment on SPARK-2346 at 7/4/14 12:03 AM:

[jira] [Commented] (SPARK-2358) Add an option to include native BLAS/LAPACK loader in the build

[ https://issues.apache.org/jira/browse/SPARK-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052030#comment-14052030 ] Xiangrui Meng commented on SPARK-2358: -- PR: https://github.com/apache/spark/pull/1295

[jira] [Commented] (SPARK-2010) Support for nested data in PySpark SQL

[ https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052035#comment-14052035 ] Michael Armbrust commented on SPARK-2010: - I think probably the right thing to do

[jira] [Commented] (SPARK-2010) Support for nested data in PySpark SQL

[ https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052068#comment-14052068 ] Kan Zhang commented on SPARK-2010: -- Sounds reasonable. Named tuple is a better fit than

[jira] [Created] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

Tathagata Das created SPARK-2362: Summary: newFilesOnly = true FileInputDStream processes existing files in a directory Key: SPARK-2362 URL: https://issues.apache.org/jira/browse/SPARK-2362 Project:

[jira] [Commented] (SPARK-2325) Utils.getLocalDir had better check the directory and choose a good one instead of choosing the first one directly

[ https://issues.apache.org/jira/browse/SPARK-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052075#comment-14052075 ] YanTang Zhai commented on SPARK-2325: - I've created PR:

[jira] [Commented] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

[ https://issues.apache.org/jira/browse/SPARK-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052076#comment-14052076 ] Tathagata Das commented on SPARK-2362: -- https://github.com/apache/spark/pull/1077

[jira] [Updated] (SPARK-2354) BitSet Range Expanded when creating new one

[ https://issues.apache.org/jira/browse/SPARK-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijie Shen updated SPARK-2354: -- Affects Version/s: 1.0.0 BitSet Range Expanded when creating new one

[jira] [Commented] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

[ https://issues.apache.org/jira/browse/SPARK-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052080#comment-14052080 ] Mukul Jain commented on SPARK-1378: --- This seems like still an issue: Downloading:

[jira] [Created] (SPARK-2363) Clean MLlib's sample data files

Xiangrui Meng created SPARK-2363: Summary: Clean MLlib's sample data files Key: SPARK-2363 URL: https://issues.apache.org/jira/browse/SPARK-2363 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-2364) ShuffledDStream run tasks only when dstream has partition items

guowei created SPARK-2364: - Summary: ShuffledDStream run tasks only when dstream has partition items Key: SPARK-2364 URL: https://issues.apache.org/jira/browse/SPARK-2364 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2277) Make TaskScheduler track whether there's host on a rack

[ https://issues.apache.org/jira/browse/SPARK-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052103#comment-14052103 ] Rui Li commented on SPARK-2277: --- With [PR #892|https://github.com/apache/spark/pull/892],

[jira] [Created] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

Ankur Dave created SPARK-2365: - Summary: Add IndexedRDD, an efficient updatable key-value store Key: SPARK-2365 URL: https://issues.apache.org/jira/browse/SPARK-2365 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052127#comment-14052127 ] Ankur Dave commented on SPARK-2365: --- Proposed implementation:

[jira] [Updated] (SPARK-2349) Fix NPE in ExternalAppendOnlyMap

[ https://issues.apache.org/jira/browse/SPARK-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2349: - Fix Version/s: 1.1.0 Fix NPE in ExternalAppendOnlyMap

[jira] [Updated] (SPARK-2349) Fix NPE in ExternalAppendOnlyMap

[ https://issues.apache.org/jira/browse/SPARK-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2349: - Fix Version/s: 1.0.1 Fix NPE in ExternalAppendOnlyMap

[jira] [Resolved] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2350. Resolution: Fixed Fix Version/s: 1.0.1 Issue resolved by pull request 1289

[jira] [Updated] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2350: --- Assignee: Aaron Davidson Master throws NPE - Key:

[jira] [Commented] (SPARK-2307) SparkUI Storage page cached statuses incorrect

[ https://issues.apache.org/jira/browse/SPARK-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052183#comment-14052183 ] Patrick Wendell commented on SPARK-2307: There was a follow up patch: