[jira] [Commented] (SPARK-1911) Warn users that jars should be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14013142#comment-14013142 ] Tathagata Das commented on SPARK-1911: -- As far as I think, it is because Java 7 uses

[jira] [Comment Edited] (SPARK-1911) Warn users that jars should be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14013142#comment-14013142 ] Tathagata Das edited comment on SPARK-1911 at 5/30/14 12:31 AM:

[jira] [Commented] (SPARK-1341) Ability to control the data rate in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016044#comment-14016044 ] Tathagata Das commented on SPARK-1341: -- Great! Happy to help you out in doing so.

[jira] [Comment Edited] (SPARK-1341) Ability to control the data rate in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016044#comment-14016044 ] Tathagata Das edited comment on SPARK-1341 at 6/2/14 11:34 PM:

[jira] [Created] (SPARK-2002) Race condition in accessing cache locations in DAGScheduler

Tathagata Das created SPARK-2002: Summary: Race condition in accessing cache locations in DAGScheduler Key: SPARK-2002 URL: https://issues.apache.org/jira/browse/SPARK-2002 Project: Spark

[jira] [Comment Edited] (SPARK-1940) Enable rolling of executor logs (stdout / stderr)

[ https://issues.apache.org/jira/browse/SPARK-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010413#comment-14010413 ] Tathagata Das edited comment on SPARK-1940 at 6/4/14 1:50 AM: --

[jira] [Updated] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1853: - Assignee: Mubarak Seyed Show Streaming application code context (file, line number) in Spark

[jira] [Commented] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051998#comment-14051998 ] Tathagata Das commented on SPARK-1853: -- If you look at what is shown in any spark

[jira] [Created] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

Tathagata Das created SPARK-2362: Summary: newFilesOnly = true FileInputDStream processes existing files in a directory Key: SPARK-2362 URL: https://issues.apache.org/jira/browse/SPARK-2362 Project:

[jira] [Commented] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

[ https://issues.apache.org/jira/browse/SPARK-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052076#comment-14052076 ] Tathagata Das commented on SPARK-2362: -- https://github.com/apache/spark/pull/1077

[jira] [Commented] (SPARK-2377) Create a Python API for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055460#comment-14055460 ] Tathagata Das commented on SPARK-2377: -- Thanks for making this JIRA. There has been

[jira] [Updated] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

[ https://issues.apache.org/jira/browse/SPARK-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2362: - Affects Version/s: 0.9.0 0.9.1 newFilesOnly = true FileInputDStream

[jira] [Updated] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

[ https://issues.apache.org/jira/browse/SPARK-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2362: - Fix Version/s: 1.0.2 newFilesOnly = true FileInputDStream processes existing files in a

[jira] [Resolved] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

[ https://issues.apache.org/jira/browse/SPARK-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2362. -- Resolution: Fixed newFilesOnly = true FileInputDStream processes existing files in a

[jira] [Updated] (SPARK-2362) newFilesOnly = true FileInputDStream processes existing files in a directory

[ https://issues.apache.org/jira/browse/SPARK-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2362: - Fix Version/s: 0.9.2 newFilesOnly = true FileInputDStream processes existing files in a

[jira] [Updated] (SPARK-2343) QueueInputDStream with oneAtATime=false does not dequeue items

[ https://issues.apache.org/jira/browse/SPARK-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2343: - Fix Version/s: (was: 0.9.2) QueueInputDStream with oneAtATime=false does not dequeue items

[jira] [Closed] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1975. Resolution: Not a Problem Spark streaming with kafka source stuck at runJob at

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056536#comment-14056536 ] Tathagata Das commented on SPARK-1975: -- The ReceiverTracker stage actually starts the

[jira] [Commented] (SPARK-1975) Spark streaming with kafka source stuck at runJob at ReceiverTracker.scala:275

[ https://issues.apache.org/jira/browse/SPARK-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056569#comment-14056569 ] Tathagata Das commented on SPARK-1975: -- Well, technically a slot in the executor is

[jira] [Assigned] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-2419: Assignee: Tathagata Das Misc updates to streaming programming guide

[jira] [Created] (SPARK-2419) Misc updates to streaming programming guide

Tathagata Das created SPARK-2419: Summary: Misc updates to streaming programming guide Key: SPARK-2419 URL: https://issues.apache.org/jira/browse/SPARK-2419 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056823#comment-14056823 ] Tathagata Das commented on SPARK-1853: -- [~mubarak.seyed] Any update on this? Show

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056843#comment-14056843 ] Tathagata Das commented on SPARK-2345: -- Doesnt the following solve the problem

[jira] [Commented] (SPARK-1785) Streaming requires receivers to be serializable

[ https://issues.apache.org/jira/browse/SPARK-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056857#comment-14056857 ] Tathagata Das commented on SPARK-1785: -- Yeah, this will be good to document. This can

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056862#comment-14056862 ] Tathagata Das commented on SPARK-1642: -- Ted, is this ready, now that 1478 is getting

[jira] [Resolved] (SPARK-2343) QueueInputDStream with oneAtATime=false does not dequeue items

[ https://issues.apache.org/jira/browse/SPARK-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2343. -- Resolution: Fixed QueueInputDStream with oneAtATime=false does not dequeue items

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057824#comment-14057824 ] Tathagata Das commented on SPARK-2345: -- I must be missing something. If you want to

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057894#comment-14057894 ] Tathagata Das commented on SPARK-1642: -- 1478 is merged. Do you have this ready?

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057897#comment-14057897 ] Tathagata Das commented on SPARK-1478: -- After much hoops, this was the PR that merged

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Description: This JIRA collects together a number of small issues that should be added to the

[jira] [Closed] (SPARK-1785) Streaming requires receivers to be serializable

[ https://issues.apache.org/jira/browse/SPARK-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1785. Resolution: Fixed Streaming requires receivers to be serializable

[jira] [Updated] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-944: Assignee: Ted Malaska (was: Tathagata Das) Give example of writing to HBase from Spark Streaming

[jira] [Commented] (SPARK-1341) Ability to control the data rate in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058091#comment-14058091 ] Tathagata Das commented on SPARK-1341: -- Thanks Isaac. This has been merged, as is

[jira] [Comment Edited] (SPARK-1341) Ability to control the data rate in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058091#comment-14058091 ] Tathagata Das edited comment on SPARK-1341 at 7/10/14 11:05 PM:

[jira] [Commented] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058159#comment-14058159 ] Tathagata Das commented on SPARK-1853: -- I dont think it is a bug in that. This is an

[jira] [Comment Edited] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057824#comment-14057824 ] Tathagata Das edited comment on SPARK-2345 at 7/11/14 12:39 AM:

[jira] [Comment Edited] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058165#comment-14058165 ] Tathagata Das edited comment on SPARK-2345 at 7/11/14 12:44 AM:

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058165#comment-14058165 ] Tathagata Das commented on SPARK-2345: -- Then what I suggested earlier makes sense,

[jira] [Comment Edited] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058165#comment-14058165 ] Tathagata Das edited comment on SPARK-2345 at 7/11/14 12:45 AM:

[jira] [Created] (SPARK-2464) Twitter Receiver does not stop correctly when streamingContext.stop is called

Tathagata Das created SPARK-2464: Summary: Twitter Receiver does not stop correctly when streamingContext.stop is called Key: SPARK-2464 URL: https://issues.apache.org/jira/browse/SPARK-2464 Project:

[jira] [Created] (SPARK-2475) Check whether #cores #receivers in local mode

Tathagata Das created SPARK-2475: Summary: Check whether #cores #receivers in local mode Key: SPARK-2475 URL: https://issues.apache.org/jira/browse/SPARK-2475 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Description: This JIRA collects together a number of small issues that should be added to the

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Description: This JIRA collects together a number of small issues that should be added to the

[jira] [Updated] (SPARK-2464) Twitter Receiver does not stop correctly when streamingContext.stop is called

[ https://issues.apache.org/jira/browse/SPARK-2464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2464: - Fix Version/s: 1.0.2 1.1.0 Twitter Receiver does not stop correctly when

[jira] [Updated] (SPARK-2377) Create a Python API for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2377: - Fix Version/s: 1.1.0 Create a Python API for Spark Streaming

[jira] [Updated] (SPARK-2377) Create a Python API for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2377: - Affects Version/s: (was: 1.0.0) Create a Python API for Spark Streaming

[jira] [Commented] (SPARK-2463) Creating multiple StreamingContexts from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062441#comment-14062441 ] Tathagata Das commented on SPARK-2463: -- [~andrewor14] Any insights on how much work

[jira] [Commented] (SPARK-2463) Creating multiple StreamingContexts from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062439#comment-14062439 ] Tathagata Das commented on SPARK-2463: -- I knew this issue. Its not a trivial change

[jira] [Updated] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1645: - Fix Version/s: (was: 1.1.0) Improve Spark Streaming compatibility with Flume

[jira] [Updated] (SPARK-2463) Creating multiple StreamingContexts from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2463: - Priority: Major (was: Trivial) Creating multiple StreamingContexts from shell generates

[jira] [Updated] (SPARK-2492) KafkaReceiver minor changes to align with Kafka 0.8

[ https://issues.apache.org/jira/browse/SPARK-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2492: - Assignee: Saisai Shao KafkaReceiver minor changes to align with Kafka 0.8

[jira] [Commented] (SPARK-2492) KafkaReceiver minor changes to align with Kafka 0.8

[ https://issues.apache.org/jira/browse/SPARK-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063011#comment-14063011 ] Tathagata Das commented on SPARK-2492: -- Can you elaborate on the existing behavior,

[jira] [Commented] (SPARK-2463) Creating multiple StreamingContexts from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064474#comment-14064474 ] Tathagata Das commented on SPARK-2463: -- Yeah, as a first step, we should detect that

[jira] [Commented] (SPARK-2463) Creating multiple StreamingContexts from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064486#comment-14064486 ] Tathagata Das commented on SPARK-2463: -- No no, you can stop one StreamingContext

[jira] [Updated] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2447: - Assignee: Ted Malaska Add common solution for sending upsert actions to HBase (put, deletes,

[jira] [Updated] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1642: - Fix Version/s: (was: 1.1.0) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[jira] [Updated] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1645: - Issue Type: Improvement (was: Bug) Improve Spark Streaming compatibility with Flume

[jira] [Updated] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1645: - Target Version/s: 1.1.0 Improve Spark Streaming compatibility with Flume

[jira] [Updated] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1642: - Target Version/s: 1.1.0 Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[jira] [Updated] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1853: - Target Version/s: 1.1.0 Show Streaming application code context (file, line number) in Spark

[jira] [Updated] (SPARK-2464) Twitter Receiver does not stop correctly when streamingContext.stop is called

[ https://issues.apache.org/jira/browse/SPARK-2464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2464: - Target Version/s: 1.1.0, 1.0.2 Twitter Receiver does not stop correctly when

[jira] [Updated] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2345: - Issue Type: Wish (was: Bug) ForEachDStream should have an option of running the foreachfunc on

[jira] [Updated] (SPARK-1854) Add a version of StreamingContext.fileStream that take hadoop conf object

[ https://issues.apache.org/jira/browse/SPARK-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1854: - Fix Version/s: (was: 1.1.0) Add a version of StreamingContext.fileStream that take hadoop

[jira] [Updated] (SPARK-2464) Twitter Receiver does not stop correctly when streamingContext.stop is called

[ https://issues.apache.org/jira/browse/SPARK-2464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2464: - Fix Version/s: (was: 1.0.2) (was: 1.1.0) Twitter Receiver does not

[jira] [Commented] (SPARK-2379) stopReceive in dead loop, cause stackoverflow exception

[ https://issues.apache.org/jira/browse/SPARK-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070915#comment-14070915 ] Tathagata Das commented on SPARK-2379: -- Any information on this? If we have no way to

[jira] [Updated] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2447: - Target Version/s: 1.1.0 Add common solution for sending upsert actions to HBase (put, deletes,

[jira] [Updated] (SPARK-2377) Create a Python API for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2377: - Target Version/s: 1.1.0 Create a Python API for Spark Streaming

[jira] [Updated] (SPARK-2377) Create a Python API for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2377: - Fix Version/s: (was: 1.1.0) Create a Python API for Spark Streaming

[jira] [Assigned] (SPARK-2377) Create a Python API for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-2377: Assignee: Tathagata Das Create a Python API for Spark Streaming

[jira] [Updated] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2447: - Component/s: Streaming Spark Core Add common solution for sending upsert

[jira] [Updated] (SPARK-1729) Make Flume pull data from source, rather than the current push model

[ https://issues.apache.org/jira/browse/SPARK-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1729: - Assignee: Hari Shreedharan (was: Tathagata Das) Make Flume pull data from source, rather than

[jira] [Updated] (SPARK-1730) Make receiver store data reliably to avoid data-loss on executor failures

[ https://issues.apache.org/jira/browse/SPARK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1730: - Assignee: Hari Shreedharan Make receiver store data reliably to avoid data-loss on executor

[jira] [Updated] (SPARK-2438) Streaming + MLLib

[ https://issues.apache.org/jira/browse/SPARK-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2438: - Target Version/s: 1.1.0 Streaming + MLLib - Key: SPARK-2438

[jira] [Updated] (SPARK-2438) Streaming + MLLib

[ https://issues.apache.org/jira/browse/SPARK-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2438: - Component/s: Streaming Streaming + MLLib - Key: SPARK-2438

[jira] [Updated] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1645: - Issue Type: Improvement (was: New Feature) Improve Spark Streaming compatibility with Flume

[jira] [Updated] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1645: - Issue Type: New Feature (was: Improvement) Improve Spark Streaming compatibility with Flume

[jira] [Updated] (SPARK-2438) Streaming + MLLib

[ https://issues.apache.org/jira/browse/SPARK-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2438: - Issue Type: New Feature (was: Improvement) Streaming + MLLib -

[jira] [Updated] (SPARK-1730) Make receiver store data reliably to avoid data-loss on executor failures

[ https://issues.apache.org/jira/browse/SPARK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1730: - Target Version/s: 1.1.0 Fix Version/s: (was: 1.1.0) Make receiver store data

[jira] [Updated] (SPARK-2548) JavaRecoverableWordCount is missing

[ https://issues.apache.org/jira/browse/SPARK-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2548: - Target Version/s: 1.1.0, 1.0.2, 0.9.3 (was: 1.1.0, 0.9.3) JavaRecoverableWordCount is missing

[jira] [Created] (SPARK-2629) Improve performance of DStream.updateStateByKey using IndexRDD

Tathagata Das created SPARK-2629: Summary: Improve performance of DStream.updateStateByKey using IndexRDD Key: SPARK-2629 URL: https://issues.apache.org/jira/browse/SPARK-2629 Project: Spark

[jira] [Commented] (SPARK-2629) Improve performance of DStream.updateStateByKey using IndexRDD

[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070939#comment-14070939 ] Tathagata Das commented on SPARK-2629: -- Index RDD is necessary for this improvement

[jira] [Updated] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1853: - Assignee: Mubarak Seyed (was: Tathagata Das) Show Streaming application code context (file,

[jira] [Resolved] (SPARK-2464) Twitter Receiver does not stop correctly when streamingContext.stop is called

[ https://issues.apache.org/jira/browse/SPARK-2464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2464. -- Resolution: Fixed Twitter Receiver does not stop correctly when streamingContext.stop is

[jira] [Updated] (SPARK-2529) Clean the closure in foreach and foreachPartition

[ https://issues.apache.org/jira/browse/SPARK-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2529: - Target Version/s: 1.1.0, 1.0.3 (was: 1.1.0, 1.0.2) Clean the closure in foreach and

[jira] [Updated] (SPARK-2531) Make BroadcastNestedLoopJoin take into account a BuildSide

[ https://issues.apache.org/jira/browse/SPARK-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2531: - Target Version/s: 1.1.0, 1.0.3 (was: 1.1.0, 1.0.2) Make BroadcastNestedLoopJoin take into

[jira] [Updated] (SPARK-2548) JavaRecoverableWordCount is missing

[ https://issues.apache.org/jira/browse/SPARK-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2548: - Target Version/s: 1.1.0, 0.9.3, 1.0.3 (was: 1.1.0, 1.0.2, 0.9.3) JavaRecoverableWordCount is

[jira] [Updated] (SPARK-2506) In yarn-cluster mode, ApplicationMaster does not clean up correctly at the end of the job if users call sc.stop manually

[ https://issues.apache.org/jira/browse/SPARK-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2506: - Target Version/s: 1.0.3 (was: 1.0.2) In yarn-cluster mode, ApplicationMaster does not clean up

[jira] [Updated] (SPARK-1667) Jobs never finish successfully once bucket file missing occurred

[ https://issues.apache.org/jira/browse/SPARK-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1667: - Target Version/s: 1.1.0, 1.0.3 (was: 1.1.0, 1.0.2) Jobs never finish successfully once bucket

[jira] [Updated] (SPARK-2558) Mention --queue argument in YARN documentation

[ https://issues.apache.org/jira/browse/SPARK-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2558: - Target Version/s: 1.1.0, 1.0.3 (was: 1.1.0, 1.0.2) Mention --queue argument in YARN

[jira] [Updated] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2576: - Target Version/s: 1.1.0, 1.0.3 (was: 1.1.0, 1.0.2) slave node throws NoClassDefFoundError

[jira] [Updated] (SPARK-2425) Standalone Master is too aggressive in removing Applications

[ https://issues.apache.org/jira/browse/SPARK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2425: - Target Version/s: 1.0.3 (was: 1.0.2) Standalone Master is too aggressive in removing

[jira] [Updated] (SPARK-2541) Standalone mode can't access secure HDFS anymore

[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2541: - Target Version/s: 1.1.0, 1.0.3 (was: 1.1.0, 1.0.2) Standalone mode can't access secure HDFS

[jira] [Updated] (SPARK-2529) Clean the closure in foreach and foreachPartition

[ https://issues.apache.org/jira/browse/SPARK-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2529: - Target Version/s: 1.1.0, 1.0.2 (was: 1.1.0, 1.0.3) Clean the closure in foreach and

[jira] [Created] (SPARK-2719) Add Mima binary checks to Flume-Sink

Tathagata Das created SPARK-2719: Summary: Add Mima binary checks to Flume-Sink Key: SPARK-2719 URL: https://issues.apache.org/jira/browse/SPARK-2719 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-1729) Make Flume pull data from source, rather than the current push model

[ https://issues.apache.org/jira/browse/SPARK-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1729: - Target Version/s: 1.1.0 Make Flume pull data from source, rather than the current push model

[jira] [Resolved] (SPARK-1729) Make Flume pull data from source, rather than the current push model

[ https://issues.apache.org/jira/browse/SPARK-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1729. -- Resolution: Fixed Make Flume pull data from source, rather than the current push model

[jira] [Updated] (SPARK-2377) Create a Python API for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2377: - Target Version/s: 1.2.0 (was: 1.1.0) Create a Python API for Spark Streaming

[jira] [Updated] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2447: - Assignee: Ted Malaska (was: Tathagata Das) Add common solution for sending upsert actions to

[jira] [Created] (SPARK-2745) Add Java friendly methods to Duration class

Tathagata Das created SPARK-2745: Summary: Add Java friendly methods to Duration class Key: SPARK-2745 URL: https://issues.apache.org/jira/browse/SPARK-2745 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2103) Java + Kafka + Spark Streaming NoSuchMethodError in java.lang.Object.init

[ https://issues.apache.org/jira/browse/SPARK-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2103: - Target Version/s: 1.1.0 Java + Kafka + Spark Streaming NoSuchMethodError in

<    1   2   3   4   5   6   7   8   9   10   >