[jira] [Commented] (SPARK-2398) Trouble running Spark 1.0 on Yarn

[ https://issues.apache.org/jira/browse/SPARK-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055931#comment-14055931 ] Guoqiang Li commented on SPARK-2398: The root cause is java process beyond the memory

[jira] [Commented] (SPARK-2054) Code Generation for Expression Evaluation

[ https://issues.apache.org/jira/browse/SPARK-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055939#comment-14055939 ] Michael Armbrust commented on SPARK-2054: - https://github.com/apache/spark/pull/99

[jira] [Created] (SPARK-2415) RowWriteSupport should handle empty ArrayType correctly.

Takuya Ueshin created SPARK-2415: Summary: RowWriteSupport should handle empty ArrayType correctly. Key: SPARK-2415 URL: https://issues.apache.org/jira/browse/SPARK-2415 Project: Spark Issue

[jira] [Commented] (SPARK-2415) RowWriteSupport should handle empty ArrayType correctly.

[ https://issues.apache.org/jira/browse/SPARK-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055983#comment-14055983 ] Takuya Ueshin commented on SPARK-2415: -- PRed: https://github.com/apache/spark/pull/13

[jira] [Updated] (SPARK-2348) In Windows having a enviorinment variable named 'classpath' gives error

[ https://issues.apache.org/jira/browse/SPARK-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2348: --- Assignee: Chirag Todarka > In Windows having a enviorinment variable named 'classpath' gives

[jira] [Updated] (SPARK-2379) stopReceive in dead loop, cause stackoverflow exception

[ https://issues.apache.org/jira/browse/SPARK-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2379: --- Component/s: Streaming > stopReceive in dead loop, cause stackoverflow exception > --

[jira] [Updated] (SPARK-2409) Make SQLConf thread safe

[ https://issues.apache.org/jira/browse/SPARK-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2409: --- Component/s: SQL > Make SQLConf thread safe > > > Ke

[jira] [Updated] (SPARK-2201) Improve FlumeInputDStream's stability and make it scalable

[ https://issues.apache.org/jira/browse/SPARK-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2201: --- Component/s: Streaming > Improve FlumeInputDStream's stability and make it scalable > ---

[jira] [Updated] (SPARK-2414) Remove jquery

[ https://issues.apache.org/jira/browse/SPARK-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2414: --- Component/s: Web UI > Remove jquery > - > > Key: SPARK-2414 >

[jira] [Updated] (SPARK-2381) streaming receiver crashed,but seems nothing happened

[ https://issues.apache.org/jira/browse/SPARK-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2381: --- Component/s: Streaming > streaming receiver crashed,but seems nothing happened >

[jira] [Updated] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2017: --- Component/s: Web UI > web ui stage page becomes unresponsive when the number of tasks is larg

[jira] [Updated] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2345: --- Component/s: Streaming > ForEachDStream should have an option of running the foreachfunc on S

[jira] [Resolved] (SPARK-2338) Jenkins Spark-Master-Maven-with-YARN builds failing due to test misconfiguration

[ https://issues.apache.org/jira/browse/SPARK-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2338. Resolution: Fixed Assignee: Pete MacKinnon Thanks a ton for getting to the bottom of

[jira] [Created] (SPARK-2416) Allow richer reporting of unit test results

Patrick Wendell created SPARK-2416: -- Summary: Allow richer reporting of unit test results Key: SPARK-2416 URL: https://issues.apache.org/jira/browse/SPARK-2416 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-1945) Add full Java examples in MLlib docs

[ https://issues.apache.org/jira/browse/SPARK-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056151#comment-14056151 ] Michael Yannakopoulos commented on SPARK-1945: -- Thanks Xiangrui, I have alre

[jira] [Updated] (SPARK-2152) the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2152: --- Assignee: Jon Sondag > the error of comput rightNodeAgg about Decision tree algorithm in Sp

[jira] [Commented] (SPARK-2152) the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056157#comment-14056157 ] Patrick Wendell commented on SPARK-2152: FYI this caused some new test failures, I

[jira] [Created] (SPARK-2417) Decision tree tests fail in maven build

Patrick Wendell created SPARK-2417: -- Summary: Decision tree tests fail in maven build Key: SPARK-2417 URL: https://issues.apache.org/jira/browse/SPARK-2417 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2417) Decision tree tests are failing

[ https://issues.apache.org/jira/browse/SPARK-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2417: --- Summary: Decision tree tests are failing (was: Decision tree tests fail in maven build) > D

[jira] [Commented] (SPARK-2417) Decision tree tests are failing

[ https://issues.apache.org/jira/browse/SPARK-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056234#comment-14056234 ] Jon Sondag commented on SPARK-2417: --- PR fix here: https://github.com/apache/spark/pull/1

[jira] [Commented] (SPARK-2152) the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056239#comment-14056239 ] Jon Sondag commented on SPARK-2152: --- Submitted a PR to fix those tests. On Wed, Jul 9,

[jira] [Comment Edited] (SPARK-546) Support full outer join and multiple join in a single shuffle

[ https://issues.apache.org/jira/browse/SPARK-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056355#comment-14056355 ] sam edited comment on SPARK-546 at 7/9/14 3:41 PM: --- We use a pimp-my-libr

[jira] [Commented] (SPARK-546) Support full outer join and multiple join in a single shuffle

[ https://issues.apache.org/jira/browse/SPARK-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056355#comment-14056355 ] sam commented on SPARK-546: --- We use a pimp-my-library pattern to add this functionality. Basicall

[jira] [Created] (SPARK-2418) Custom checkpointing with an external function as parameter

András Barják created SPARK-2418: Summary: Custom checkpointing with an external function as parameter Key: SPARK-2418 URL: https://issues.apache.org/jira/browse/SPARK-2418 Project: Spark Is

[jira] [Commented] (SPARK-2338) Jenkins Spark-Master-Maven-with-YARN builds failing due to test misconfiguration

[ https://issues.apache.org/jira/browse/SPARK-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056447#comment-14056447 ] Pete MacKinnon commented on SPARK-2338: --- Patrick, it appears https://github.com/apac

[jira] [Updated] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

[ https://issues.apache.org/jira/browse/SPARK-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2362: - Fix Version/s: 0.9.2 > newFilesOnly = true FileInputDStream processes existing files in a directo

[jira] [Updated] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

[ https://issues.apache.org/jira/browse/SPARK-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2362: - Fix Version/s: 1.1.0 > newFilesOnly = true FileInputDStream processes existing files in a directo

[jira] [Commented] (SPARK-2343) QueueInputDStream with oneAtATime=false does not dequeue items

[ https://issues.apache.org/jira/browse/SPARK-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056519#comment-14056519 ] Tathagata Das commented on SPARK-2343: -- https://github.com/apache/spark/pull/1285 >

[jira] [Updated] (SPARK-2343) QueueInputDStream with oneAtATime=false does not dequeue items

[ https://issues.apache.org/jira/browse/SPARK-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2343: - Fix Version/s: 1.0.2 1.1.0 0.9.2 > QueueInputDStream with o

[jira] [Updated] (SPARK-2343) QueueInputDStream with oneAtATime=false does not dequeue items

[ https://issues.apache.org/jira/browse/SPARK-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2343: - Fix Version/s: (was: 0.9.2) > QueueInputDStream with oneAtATime=false does not dequeue items

[jira] [Closed] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1975. Resolution: Not a Problem > Spark streaming with kafka source stuck at runJob at ReceiverTracker.sc

[jira] [Commented] (SPARK-2115) Stage kill link is too close to stage details link

[ https://issues.apache.org/jira/browse/SPARK-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056533#comment-14056533 ] Masayoshi TSUZUKI commented on SPARK-2115: -- I agree with [~daniel.siegmann.velos]

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056536#comment-14056536 ] Tathagata Das commented on SPARK-1975: -- The ReceiverTracker stage actually starts the

[jira] [Updated] (SPARK-2417) Decision tree tests are failing

[ https://issues.apache.org/jira/browse/SPARK-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2417: - Assignee: (was: Xiangrui Meng) > Decision tree tests are failing > --

[jira] [Updated] (SPARK-2417) Decision tree tests are failing

[ https://issues.apache.org/jira/browse/SPARK-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2417: - Assignee: Jon Sondag > Decision tree tests are failing > --- > >

[jira] [Resolved] (SPARK-2417) Decision tree tests are failing

[ https://issues.apache.org/jira/browse/SPARK-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2417. -- Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by pull r

[jira] [Commented] (SPARK-1089) ADD_JARS regression in Spark 0.9.0

[ https://issues.apache.org/jira/browse/SPARK-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056551#comment-14056551 ] Nicholas Chammas commented on SPARK-1089: - So going forward, is the correct proced

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056563#comment-14056563 ] Issac Buenrostro commented on SPARK-1975: - Just wondering, will each stream occupy

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056569#comment-14056569 ] Tathagata Das commented on SPARK-1975: -- Well, technically a "slot" in the executor is

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056573#comment-14056573 ] Issac Buenrostro commented on SPARK-1975: - Ok, we'll try this, thanks! > Spark st

[jira] [Updated] (SPARK-2415) RowWriteSupport should handle empty ArrayType correctly.

[ https://issues.apache.org/jira/browse/SPARK-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2415: Target Version/s: 1.1.0 > RowWriteSupport should handle empty ArrayType correctly. > --

[jira] [Updated] (SPARK-2415) RowWriteSupport should handle empty ArrayType correctly.

[ https://issues.apache.org/jira/browse/SPARK-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2415: Assignee: Takuya Ueshin > RowWriteSupport should handle empty ArrayType correctly. > --

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056621#comment-14056621 ] Arup Malakar commented on SPARK-1975: - [~tdas] does it make sense to add this in the d

[jira] [Resolved] (SPARK-1782) svd for sparse matrix using ARPACK

[ https://issues.apache.org/jira/browse/SPARK-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1782. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 964 [https://githu

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056653#comment-14056653 ] Tathagata Das commented on SPARK-1975: -- Good idea. I created a new JIRA to track this

[jira] [Assigned] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-2419: Assignee: Tathagata Das > Misc updates to streaming programming guide > ---

[jira] [Created] (SPARK-2419) Misc updates to streaming programming guide

Tathagata Das created SPARK-2419: Summary: Misc updates to streaming programming guide Key: SPARK-2419 URL: https://issues.apache.org/jira/browse/SPARK-2419 Project: Spark Issue Type: Improve

[jira] [Created] (SPARK-2420) Change Spark build to minimize library conflicts

Xuefu Zhang created SPARK-2420: -- Summary: Change Spark build to minimize library conflicts Key: SPARK-2420 URL: https://issues.apache.org/jira/browse/SPARK-2420 Project: Spark Issue Type: Wish

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056657#comment-14056657 ] Xuefu Zhang commented on SPARK-2420: CC [~rxin], [~hshreedharan] > Change Spark build

[jira] [Updated] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated SPARK-2420: --- Attachment: spark_1.0.0.patch > Change Spark build to minimize library conflicts > --

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056669#comment-14056669 ] Sean Owen commented on SPARK-2420: -- In general, Spark already has to harmonize versions w

[jira] [Created] (SPARK-2421) Spark should treat writable as serializable for keys

Xuefu Zhang created SPARK-2421: -- Summary: Spark should treat writable as serializable for keys Key: SPARK-2421 URL: https://issues.apache.org/jira/browse/SPARK-2421 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-2421) Spark should treat writable as serializable for keys

[ https://issues.apache.org/jira/browse/SPARK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056677#comment-14056677 ] Xuefu Zhang commented on SPARK-2421: CC [~rxin], [~hshreedharan] > Spark should treat

[jira] [Created] (SPARK-2422) Spark SQL migration guide for Shark users

Cheng Lian created SPARK-2422: - Summary: Spark SQL migration guide for Shark users Key: SPARK-2422 URL: https://issues.apache.org/jira/browse/SPARK-2422 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056721#comment-14056721 ] Xuefu Zhang commented on SPARK-2420: Thanks for your comments, [~sowen]. For protobuf,

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056723#comment-14056723 ] Reynold Xin commented on SPARK-2420: Perhaps we should bump Guava dependency in Hive i

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056724#comment-14056724 ] Sean Owen commented on SPARK-2420: -- Servlet 3.0 is a strict superset of 2.5. It works, I

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056738#comment-14056738 ] Sean Owen commented on SPARK-2420: -- Heh yes +1 to upgrading Guava in Hadoop. I don't know

[jira] [Resolved] (SPARK-1318) Alignment of the Spark Shell with Spark Submit.

[ https://issues.apache.org/jira/browse/SPARK-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-1318. -- Resolution: Fixed Fix Version/s: 1.0.0 Fixed in https://github.com/apache/spark/pull/116 > Alig

[jira] [Comment Edited] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056738#comment-14056738 ] Reynold Xin edited comment on SPARK-2420 at 7/9/14 8:50 PM: He

[jira] [Commented] (SPARK-2408) RDD.map(func) dependencies issue after checkpoint & count

[ https://issues.apache.org/jira/browse/SPARK-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056739#comment-14056739 ] Daniel Fry commented on SPARK-2408: --- I think this is a Spark issue, perhaps with the Clo

[jira] [Created] (SPARK-2423) Clean up SparkSubmit for readability

Andrew Or created SPARK-2423: Summary: Clean up SparkSubmit for readability Key: SPARK-2423 URL: https://issues.apache.org/jira/browse/SPARK-2423 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056751#comment-14056751 ] Xuefu Zhang commented on SPARK-2420: [~rxin] upgrading guava to 14 is no problem to Hi

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056756#comment-14056756 ] Sean Owen commented on SPARK-2420: -- Yes, you don't want two versions of the servlet API l

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056800#comment-14056800 ] Arup Malakar commented on SPARK-1975: - [~tdas] Thanks. (I am thinking aloud here) Gi

[jira] [Updated] (SPARK-2422) Spark SQL migration guide for Shark users

[ https://issues.apache.org/jira/browse/SPARK-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2422: Target Version/s: 1.1.0 > Spark SQL migration guide for Shark users > -

[jira] [Updated] (SPARK-2422) Spark SQL migration guide for Shark users

[ https://issues.apache.org/jira/browse/SPARK-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2422: Priority: Blocker (was: Major) > Spark SQL migration guide for Shark users > -

[jira] [Commented] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056823#comment-14056823 ] Tathagata Das commented on SPARK-1853: -- [~mubarak.seyed] Any update on this? > Show

[jira] [Commented] (SPARK-2379) stopReceive in dead loop, cause stackoverflow exception

[ https://issues.apache.org/jira/browse/SPARK-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056834#comment-14056834 ] Tathagata Das commented on SPARK-2379: -- Can you give us logs and a way to reproduce t

[jira] [Commented] (SPARK-2381) streaming receiver crashed,but seems nothing happened

[ https://issues.apache.org/jira/browse/SPARK-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056836#comment-14056836 ] Tathagata Das commented on SPARK-2381: -- This is a little tricky to due to the asynchr

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056843#comment-14056843 ] Tathagata Das commented on SPARK-2345: -- Doesnt the following solve the problem

[jira] [Commented] (SPARK-1785) Streaming requires receivers to be serializable

[ https://issues.apache.org/jira/browse/SPARK-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056857#comment-14056857 ] Tathagata Das commented on SPARK-1785: -- Yeah, this will be good to document. This can

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Description: This JIRA collects together a number of small issues that should be added to the st

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056862#comment-14056862 ] Tathagata Das commented on SPARK-1642: -- Ted, is this ready, now that 1478 is getting

[jira] [Commented] (SPARK-2398) Trouble running Spark 1.0 on Yarn

[ https://issues.apache.org/jira/browse/SPARK-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056858#comment-14056858 ] Nishkam Ravi commented on SPARK-2398: - A bit unclear on the root cause. Q1. Are the s

[jira] [Resolved] (SPARK-2343) QueueInputDStream with oneAtATime=false does not dequeue items

[ https://issues.apache.org/jira/browse/SPARK-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2343. -- Resolution: Fixed > QueueInputDStream with oneAtATime=false does not dequeue items > --

[jira] [Created] (SPARK-2424) ApplicationState.MAX_NUM_RETRY should be configurable

Mark Hamstra created SPARK-2424: --- Summary: ApplicationState.MAX_NUM_RETRY should be configurable Key: SPARK-2424 URL: https://issues.apache.org/jira/browse/SPARK-2424 Project: Spark Issue Type:

[jira] [Reopened] (SPARK-1458) Add programmatic way to determine Spark version

[ https://issues.apache.org/jira/browse/SPARK-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-1458: - Reopening this ticket. It seems that, while the Scala shell exposes the Spark version via

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056913#comment-14056913 ] Hari Shreedharan commented on SPARK-2345: - Actually my concern was slightly differ

[jira] [Created] (SPARK-2425) Standalone Master is too aggressive in removing Applications

Mark Hamstra created SPARK-2425: --- Summary: Standalone Master is too aggressive in removing Applications Key: SPARK-2425 URL: https://issues.apache.org/jira/browse/SPARK-2425 Project: Spark Iss

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056916#comment-14056916 ] Xuefu Zhang commented on SPARK-2420: Yeah. I understand servlet is an API. Hive and ma

[jira] [Created] (SPARK-2426) Quadratic Minimization for MLlib ALS

Debasish Das created SPARK-2426: --- Summary: Quadratic Minimization for MLlib ALS Key: SPARK-2426 URL: https://issues.apache.org/jira/browse/SPARK-2426 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056967#comment-14056967 ] Matthew Farrellee commented on SPARK-2360: -- what is the interface you're proposin

[jira] [Updated] (SPARK-2426) Quadratic Minimization for MLlib ALS

[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2426: - Fix Version/s: (was: 1.1.0) > Quadratic Minimization for MLlib ALS >

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056989#comment-14056989 ] Xiangrui Meng commented on SPARK-2156: -- Oh, I see. We are waiting for 0.9.2. > When

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056987#comment-14056987 ] Xiangrui Meng commented on SPARK-2156: -- Is it solved? > When the size of serialized

[jira] [Updated] (SPARK-1856) Standardize MLlib interfaces

[ https://issues.apache.org/jira/browse/SPARK-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1856: - Priority: Blocker (was: Critical) > Standardize MLlib interfaces >

[jira] [Resolved] (SPARK-1871) Improve MLlib guide for v1.0

[ https://issues.apache.org/jira/browse/SPARK-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1871. -- Resolution: Done Assignee: Xiangrui Meng > Improve MLlib guide for v1.0 > ---

[jira] [Resolved] (SPARK-1485) Implement AllReduce

[ https://issues.apache.org/jira/browse/SPARK-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1485. -- Resolution: Won't Fix Fix Version/s: (was: 1.1.0) Close this in favor of SPARK-2174.

[jira] [Updated] (SPARK-1536) Add multiclass classification tree support to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1536: - Affects Version/s: (was: 0.9.0) > Add multiclass classification tree support to MLlib > -

[jira] [Updated] (SPARK-1536) Add multiclass classification tree support to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1536: - Priority: Critical (was: Major) > Add multiclass classification tree support to MLlib >

[jira] [Updated] (SPARK-1536) Add multiclass classification tree support to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-1536: - Summary: Add multiclass classification tree support to MLlib (was: Add multiclass classification

[jira] [Commented] (SPARK-2115) Stage kill link is too close to stage details link

[ https://issues.apache.org/jira/browse/SPARK-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056999#comment-14056999 ] Masayoshi TSUZUKI commented on SPARK-2115: -- PR: https://github.com/apache/spark/p

[jira] [Closed] (SPARK-2281) Simplify the duplicate code in Gradient.scala

[ https://issues.apache.org/jira/browse/SPARK-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai closed SPARK-2281. -- Resolution: Not a Problem > Simplify the duplicate code in Gradient.scala > ---

[jira] [Resolved] (SPARK-2200) breeze DenseVector not serializable with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2200. -- Resolution: Later Close this JIRA since this is caused by a non-default kryo setting. > breeze

[jira] [Commented] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057015#comment-14057015 ] Hossein Falaki commented on SPARK-2360: --- Hi Matthew, I have not fully read RFC 4180

[jira] [Commented] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057024#comment-14057024 ] Matthew Farrellee commented on SPARK-2360: -- it's a short rfc actually, i just ski

[jira] [Commented] (SPARK-2308) Add KMeans MiniBatch clustering algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057038#comment-14057038 ] Xiangrui Meng commented on SPARK-2308: -- There were some work on finding a coreset for

[jira] [Commented] (SPARK-2396) Spark EC2 scripts fail when trying to log in to EC2 instances

[ https://issues.apache.org/jira/browse/SPARK-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057045#comment-14057045 ] Stephen M. Hopper commented on SPARK-2396: -- Update: I attempted this again except

[jira] [Comment Edited] (SPARK-2396) Spark EC2 scripts fail when trying to log in to EC2 instances

[ https://issues.apache.org/jira/browse/SPARK-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057045#comment-14057045 ] Stephen M. Hopper edited comment on SPARK-2396 at 7/10/14 2:15 AM: -

  1   2   >