[jira] [Updated] (SPARK-1386) Spark Streaming UI

[ https://issues.apache.org/jira/browse/SPARK-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1386: - Priority: Blocker (was: Major) Spark Streaming UI -- Key:

[jira] [Created] (SPARK-1386) Spark Streaming UI

Tathagata Das created SPARK-1386: Summary: Spark Streaming UI Key: SPARK-1386 URL: https://issues.apache.org/jira/browse/SPARK-1386 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-1386) Spark Streaming UI

[ https://issues.apache.org/jira/browse/SPARK-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1386: - Affects Version/s: 0.9.0 Spark Streaming UI -- Key:

[jira] [Updated] (SPARK-1332) Improve Spark Streaming's Network Receiver and InputDStream API for future stability

[ https://issues.apache.org/jira/browse/SPARK-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1332: - Priority: Blocker (was: Critical) Improve Spark Streaming's Network Receiver and InputDStream

[jira] [Created] (SPARK-1400) Spark Streaming's received data is not cleaned up from BlockManagers when not needed any more

Tathagata Das created SPARK-1400: Summary: Spark Streaming's received data is not cleaned up from BlockManagers when not needed any more Key: SPARK-1400 URL: https://issues.apache.org/jira/browse/SPARK-1400

[jira] [Commented] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963367#comment-13963367 ] Tathagata Das commented on SPARK-1049: -- [~tgraves] Wasnt this resolved, in master as

[jira] [Updated] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1049: - Fix Version/s: 0.9.1 1.0.0 spark on yarn - yarn-client mode doesn't always

[jira] [Updated] (SPARK-1049) spark on yarn - yarn-client mode doesn't always exit properly

[ https://issues.apache.org/jira/browse/SPARK-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1049: - Affects Version/s: 0.9.0 spark on yarn - yarn-client mode doesn't always exit properly

[jira] [Created] (SPARK-1505) Add 0.9 to 1.0 migration guide for streaming receiver

Tathagata Das created SPARK-1505: Summary: Add 0.9 to 1.0 migration guide for streaming receiver Key: SPARK-1505 URL: https://issues.apache.org/jira/browse/SPARK-1505 Project: Spark Issue

[jira] [Commented] (SPARK-1530) Streaming UI test can hang indefinitely

[ https://issues.apache.org/jira/browse/SPARK-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973737#comment-13973737 ] Tathagata Das commented on SPARK-1530: -- I wonder what about Jenkins environment is

[jira] [Created] (SPARK-1558) [streaming] Update receiver information to match it with code

Tathagata Das created SPARK-1558: Summary: [streaming] Update receiver information to match it with code Key: SPARK-1558 URL: https://issues.apache.org/jira/browse/SPARK-1558 Project: Spark

[jira] [Updated] (SPARK-1505) [streaming] Add 0.9 to 1.0 migration guide for streaming receiver

[ https://issues.apache.org/jira/browse/SPARK-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1505: - Component/s: Streaming [streaming] Add 0.9 to 1.0 migration guide for streaming receiver

[jira] [Updated] (SPARK-1558) [streaming] Update receiver information to match it with code

[ https://issues.apache.org/jira/browse/SPARK-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1558: - Component/s: Documentation [streaming] Update receiver information to match it with code

[jira] [Updated] (SPARK-1504) [streaming] Add deployment subsection to streaming

[ https://issues.apache.org/jira/browse/SPARK-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1504: - Component/s: Streaming [streaming] Add deployment subsection to streaming

[jira] [Assigned] (SPARK-1505) [streaming] Add 0.9 to 1.0 migration guide for streaming receiver

[ https://issues.apache.org/jira/browse/SPARK-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-1505: Assignee: Tathagata Das [streaming] Add 0.9 to 1.0 migration guide for streaming receiver

[jira] [Created] (SPARK-1578) Do not require setting of cleaner TTL when creating StreamingContext

Tathagata Das created SPARK-1578: Summary: Do not require setting of cleaner TTL when creating StreamingContext Key: SPARK-1578 URL: https://issues.apache.org/jira/browse/SPARK-1578 Project: Spark

[jira] [Updated] (SPARK-1578) Do not require setting of cleaner TTL when creating StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1578: - Description: Since shuffles and RDDs that are out of context are automatically cleaned by Spark

[jira] [Created] (SPARK-1592) Streaming input blocks were never removed from the BlockManagers

Tathagata Das created SPARK-1592: Summary: Streaming input blocks were never removed from the BlockManagers Key: SPARK-1592 URL: https://issues.apache.org/jira/browse/SPARK-1592 Project: Spark

[jira] [Updated] (SPARK-1592) Old streaming input blocks not removed automatically from the BlockManagers

[ https://issues.apache.org/jira/browse/SPARK-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1592: - Summary: Old streaming input blocks not removed automatically from the BlockManagers (was:

[jira] [Created] (SPARK-1618) Socket receiver not restarting properly when connection is refused

Tathagata Das created SPARK-1618: Summary: Socket receiver not restarting properly when connection is refused Key: SPARK-1618 URL: https://issues.apache.org/jira/browse/SPARK-1618 Project: Spark

[jira] [Commented] (SPARK-1340) Some Spark Streaming receivers are not restarted when worker fails

[ https://issues.apache.org/jira/browse/SPARK-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980595#comment-13980595 ] Tathagata Das commented on SPARK-1340: -- I havent explicitly tested this, but this

[jira] [Comment Edited] (SPARK-1340) Some Spark Streaming receivers are not restarted when worker fails

[ https://issues.apache.org/jira/browse/SPARK-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980595#comment-13980595 ] Tathagata Das edited comment on SPARK-1340 at 4/25/14 1:34 AM:

[jira] [Commented] (SPARK-1617) Exposing receiver state and errors in the streaming UI

[ https://issues.apache.org/jira/browse/SPARK-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980681#comment-13980681 ] Tathagata Das commented on SPARK-1617: -- https://github.com/apache/spark/pull/540/

[jira] [Resolved] (SPARK-1618) Socket receiver not restarting properly when connection is refused

[ https://issues.apache.org/jira/browse/SPARK-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1618. -- Resolution: Fixed Socket receiver not restarting properly when connection is refused

[jira] [Updated] (SPARK-1618) Socket receiver not restarting properly when connection is refused

[ https://issues.apache.org/jira/browse/SPARK-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1618: - Fix Version/s: 1.0.0 Socket receiver not restarting properly when connection is refused

[jira] [Resolved] (SPARK-1617) Exposing receiver state and errors in the streaming UI

[ https://issues.apache.org/jira/browse/SPARK-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1617. -- Resolution: Fixed Exposing receiver state and errors in the streaming UI

[jira] [Updated] (SPARK-1592) Old streaming input blocks not removed automatically from the BlockManagers

[ https://issues.apache.org/jira/browse/SPARK-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1592: - Fix Version/s: 1.0.0 Old streaming input blocks not removed automatically from the

[jira] [Resolved] (SPARK-1510) Add Spark Streaming metrics source for metrics system

[ https://issues.apache.org/jira/browse/SPARK-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1510. -- Resolution: Fixed Fix Version/s: 1.0.0 https://github.com/apache/spark/pull/545 Add

[jira] [Resolved] (SPARK-1592) Old streaming input blocks not removed automatically from the BlockManagers

[ https://issues.apache.org/jira/browse/SPARK-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1592. -- Resolution: Fixed https://github.com/apache/spark/pull/512 Old streaming input blocks not

[jira] [Created] (SPARK-1633) Various examples for Scala and Java custom receiver, etc.

Tathagata Das created SPARK-1633: Summary: Various examples for Scala and Java custom receiver, etc. Key: SPARK-1633 URL: https://issues.apache.org/jira/browse/SPARK-1633 Project: Spark

[jira] [Commented] (SPARK-1600) flaky test case in streaming.CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981552#comment-13981552 ] Tathagata Das commented on SPARK-1600: -- Will try to address this post 1.0 release

[jira] [Commented] (SPARK-1409) Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite

[ https://issues.apache.org/jira/browse/SPARK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981555#comment-13981555 ] Tathagata Das commented on SPARK-1409: -- The test seems to run fine when launched from

[jira] [Closed] (SPARK-1400) Spark Streaming's received data is not cleaned up from BlockManagers when not needed any more

[ https://issues.apache.org/jira/browse/SPARK-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1400. Resolution: Duplicate Duplicate https://issues.apache.org/jira/browse/SPARK-1592 Spark

[jira] [Closed] (SPARK-703) KafkaWordCount example crashes with java.lang.ArrayIndexOutOfBoundsException in CheckpointRDD.scala

[ https://issues.apache.org/jira/browse/SPARK-703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-703. --- Resolution: Not a Problem KafkaWordCount example crashes with

[jira] [Commented] (SPARK-703) KafkaWordCount example crashes with java.lang.ArrayIndexOutOfBoundsException in CheckpointRDD.scala

[ https://issues.apache.org/jira/browse/SPARK-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981581#comment-13981581 ] Tathagata Das commented on SPARK-703: - Yes, that observation is correct. This is

[jira] [Closed] (SPARK-711) Spark Streaming 0.7.0: ArrayIndexOutOfBoundsException in KafkaWordCount Example

[ https://issues.apache.org/jira/browse/SPARK-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-711. --- Resolution: Duplicate Duplicate issue: https://issues.apache.org/jira/browse/SPARK-703 Spark

[jira] [Commented] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981693#comment-13981693 ] Tathagata Das commented on SPARK-944: - Do you have a working example now, that you

[jira] [Comment Edited] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981693#comment-13981693 ] Tathagata Das edited comment on SPARK-944 at 4/25/14 10:10 PM:

[jira] [Resolved] (SPARK-1356) [STREAMING] Annotate developer and experimental API's

[ https://issues.apache.org/jira/browse/SPARK-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1356. -- Resolution: Fixed Assignee: Tathagata Das [STREAMING] Annotate developer and

[jira] [Closed] (SPARK-1558) [streaming] Update receiver information to match it with code

[ https://issues.apache.org/jira/browse/SPARK-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1558. Resolution: Invalid Irrelevant after underlying code changes. [streaming] Update receiver

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981856#comment-13981856 ] Tathagata Das commented on SPARK-1478: -- Haha, yeah, lazy vals are super useful in

[jira] [Commented] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983721#comment-13983721 ] Tathagata Das commented on SPARK-944: - Would be great if you can submit an example

[jira] [Commented] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984768#comment-13984768 ] Tathagata Das commented on SPARK-1645: -- Let me understand this. Is this sink going to

[jira] [Commented] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984927#comment-13984927 ] Tathagata Das commented on SPARK-1645: -- Ah, I think get it now. So instead of the

[jira] [Commented] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986220#comment-13986220 ] Tathagata Das commented on SPARK-1645: -- This makes sense from the integration point

[jira] [Commented] (SPARK-1645) Improve Spark Streaming compatibility with Flume

[ https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986312#comment-13986312 ] Tathagata Das commented on SPARK-1645: -- I agree. New receiver for the new API is the

[jira] [Reopened] (SPARK-1558) [streaming] Update receiver information to match it with code

[ https://issues.apache.org/jira/browse/SPARK-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reopened SPARK-1558: -- [streaming] Update receiver information to match it with code

[jira] [Resolved] (SPARK-1504) [streaming] Add deployment subsection to streaming

[ https://issues.apache.org/jira/browse/SPARK-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1504. -- Resolution: Fixed [streaming] Add deployment subsection to streaming

[jira] [Resolved] (SPARK-1558) [streaming] Update custom receiver information with new API

[ https://issues.apache.org/jira/browse/SPARK-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1558. -- Resolution: Fixed [streaming] Update custom receiver information with new API

[jira] [Updated] (SPARK-1558) [streaming] Update custom receiver guide with new Receiver API

[ https://issues.apache.org/jira/browse/SPARK-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1558: - Summary: [streaming] Update custom receiver guide with new Receiver API (was: [streaming]

[jira] [Resolved] (SPARK-1505) [streaming] Add 0.9 to 1.0 migration guide for streaming receiver

[ https://issues.apache.org/jira/browse/SPARK-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1505. -- Resolution: Fixed [streaming] Add 0.9 to 1.0 migration guide for streaming receiver

[jira] [Created] (SPARK-1729) Make Flume pull data from source, rather than the current push model

Tathagata Das created SPARK-1729: Summary: Make Flume pull data from source, rather than the current push model Key: SPARK-1729 URL: https://issues.apache.org/jira/browse/SPARK-1729 Project: Spark

[jira] [Commented] (SPARK-1729) Make Flume pull data from source, rather than the current push model

[ https://issues.apache.org/jira/browse/SPARK-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990099#comment-13990099 ] Tathagata Das commented on SPARK-1729: -- [~hshreedharan] I assigned this to you as per

[jira] [Created] (SPARK-1730) Make receiver store data reliably to avoid data-loss on executor failure

Tathagata Das created SPARK-1730: Summary: Make receiver store data reliably to avoid data-loss on executor failure Key: SPARK-1730 URL: https://issues.apache.org/jira/browse/SPARK-1730 Project:

[jira] [Updated] (SPARK-1730) Make receiver store data reliably to avoid data-loss on executor failure

[ https://issues.apache.org/jira/browse/SPARK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1730: - Assignee: (was: Tathagata Das) Make receiver store data reliably to avoid data-loss on

[jira] [Commented] (SPARK-1730) Make receiver store data reliably to avoid data-loss on executor failures

[ https://issues.apache.org/jira/browse/SPARK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990124#comment-13990124 ] Tathagata Das commented on SPARK-1730: -- [~hshreedharan] This could also be something

[jira] [Updated] (SPARK-1730) Make receiver store data reliably to avoid data-loss on executor failures

[ https://issues.apache.org/jira/browse/SPARK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1730: - Summary: Make receiver store data reliably to avoid data-loss on executor failures (was: Make

[jira] [Commented] (SPARK-1603) flaky test case in StreamingContextSuite

[ https://issues.apache.org/jira/browse/SPARK-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990213#comment-13990213 ] Tathagata Das commented on SPARK-1603: -- I think I made a temporary fix for now for

[jira] [Updated] (SPARK-1647) Prevent data loss when Streaming driver goes down

[ https://issues.apache.org/jira/browse/SPARK-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1647: - Fix Version/s: 1.1.0 Prevent data loss when Streaming driver goes down

[jira] [Created] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

Tathagata Das created SPARK-1853: Summary: Show Streaming application code context (file, line number) in Spark Stages UI Key: SPARK-1853 URL: https://issues.apache.org/jira/browse/SPARK-1853

[jira] [Resolved] (SPARK-1633) Various examples for Scala and Java custom receiver, etc.

[ https://issues.apache.org/jira/browse/SPARK-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1633. -- Resolution: Fixed Fix Version/s: 1.0.0 Various examples for Scala and Java custom

[jira] [Commented] (SPARK-1603) flaky test case in StreamingContextSuite

[ https://issues.apache.org/jira/browse/SPARK-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13999241#comment-13999241 ] Tathagata Das commented on SPARK-1603: -- I think we havent seen the flakiness since

[jira] [Commented] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13999226#comment-13999226 ] Tathagata Das commented on SPARK-944: - Hi Kanwal, the usual process of the contributing

[jira] [Resolved] (SPARK-1603) flaky test case in StreamingContextSuite

[ https://issues.apache.org/jira/browse/SPARK-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1603. -- Resolution: Fixed flaky test case in StreamingContextSuite

[jira] [Updated] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1478: - Fix Version/s: 1.1.0 Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[jira] [Updated] (SPARK-1730) Make receiver store data reliably to avoid data-loss on executor failures

[ https://issues.apache.org/jira/browse/SPARK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1730: - Fix Version/s: 1.1.0 Make receiver store data reliably to avoid data-loss on executor failures

[jira] [Created] (SPARK-1854) Add a version of StreamingContext.fileStream that take hadoop conf object

Tathagata Das created SPARK-1854: Summary: Add a version of StreamingContext.fileStream that take hadoop conf object Key: SPARK-1854 URL: https://issues.apache.org/jira/browse/SPARK-1854 Project:

[jira] [Updated] (SPARK-1729) Make Flume pull data from source, rather than the current push model

[ https://issues.apache.org/jira/browse/SPARK-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1729: - Fix Version/s: 1.1.0 Make Flume pull data from source, rather than the current push model

[jira] [Updated] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1853: - Fix Version/s: 1.1.0 Show Streaming application code context (file, line number) in Spark

[jira] [Updated] (SPARK-1600) flaky test case in streaming.CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1600: - Fix Version/s: 1.1.0 flaky test case in streaming.CheckpointSuite

[jira] [Resolved] (SPARK-1340) Some Spark Streaming receivers are not restarted when worker fails

[ https://issues.apache.org/jira/browse/SPARK-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1340. -- Resolution: Fixed Resolved with https://issues.apache.org/jira/browse/SPARK-1332 Some Spark

[jira] [Closed] (SPARK-1876) Update Windows scripts to deal with latest distribution layout changes

[ https://issues.apache.org/jira/browse/SPARK-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1876. Resolution: Fixed Update Windows scripts to deal with latest distribution layout changes

[jira] [Closed] (SPARK-1878) Incorrect initialization order in JavaStreamingContext

[ https://issues.apache.org/jira/browse/SPARK-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1878. Resolution: Fixed Fix Version/s: 1.0.0 Incorrect initialization order in

[jira] [Reopened] (SPARK-1878) Incorrect initialization order in JavaStreamingContext

[ https://issues.apache.org/jira/browse/SPARK-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reopened SPARK-1878: -- Incorrect initialization order in JavaStreamingContext

[jira] [Resolved] (SPARK-1878) Incorrect initialization order in JavaStreamingContext

[ https://issues.apache.org/jira/browse/SPARK-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1878. -- Resolution: Fixed Incorrect initialization order in JavaStreamingContext

[jira] [Reopened] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

[ https://issues.apache.org/jira/browse/SPARK-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reopened SPARK-1879: -- Default PermGen size too small when using Hadoop2 and Hive

[jira] [Resolved] (SPARK-1879) Default PermGen size too small when using Hadoop2 and Hive

[ https://issues.apache.org/jira/browse/SPARK-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1879. -- Resolution: Fixed Default PermGen size too small when using Hadoop2 and Hive

[jira] [Resolved] (SPARK-1689) AppClient does not respond correctly to RemoveApplication

[ https://issues.apache.org/jira/browse/SPARK-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1689. -- Resolution: Fixed AppClient does not respond correctly to RemoveApplication

[jira] [Resolved] (SPARK-1874) Clean up MLlib sample data

[ https://issues.apache.org/jira/browse/SPARK-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1874. -- Resolution: Fixed Clean up MLlib sample data --

[jira] [Comment Edited] (SPARK-1898) In deploy.yarn.Client, use YarnClient rather than YarnClientImpl

[ https://issues.apache.org/jira/browse/SPARK-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14005578#comment-14005578 ] Tathagata Das edited comment on SPARK-1898 at 5/22/14 3:34 AM:

[jira] [Updated] (SPARK-1870) Jars specified via --jars in spark-submit are not added to executor classpath for YARN

[ https://issues.apache.org/jira/browse/SPARK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1870: - Affects Version/s: (was: 1.0.0) Jars specified via --jars in spark-submit are not added to

[jira] [Resolved] (SPARK-1870) Jars specified via --jars in spark-submit are not added to executor classpath for YARN

[ https://issues.apache.org/jira/browse/SPARK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1870. -- Resolution: Fixed Fix Version/s: 1.0.0 Fixed in

[jira] [Commented] (SPARK-1904) ZooKeeper URI in spark-env.sh no longer working w/ bin/pyspark

[ https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14006514#comment-14006514 ] Tathagata Das commented on SPARK-1904: -- This seems to be a regression. Since we are

[jira] [Updated] (SPARK-1900) Fix running PySpark files on YARN

[ https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1900: - Component/s: Deploy Fix running PySpark files on YARN --

[jira] [Updated] (SPARK-1904) ZooKeeper URI in spark-env.sh no longer working w/ bin/pyspark

[ https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1904: - Assignee: Andrew Or (was: Tathagata Das) ZooKeeper URI in spark-env.sh no longer working w/

[jira] [Assigned] (SPARK-1904) ZooKeeper URI in spark-env.sh no longer working w/ bin/pyspark

[ https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-1904: Assignee: Tathagata Das ZooKeeper URI in spark-env.sh no longer working w/ bin/pyspark

[jira] [Resolved] (SPARK-1897) Spark shell --jars (or spark.jars) doesn't work

[ https://issues.apache.org/jira/browse/SPARK-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1897. -- Resolution: Fixed Fix Version/s: 1.0.0 https://github.com/apache/spark/pull/849 Spark

[jira] [Resolved] (SPARK-1896) MASTER masks spark.master in spark-shell

[ https://issues.apache.org/jira/browse/SPARK-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1896. -- Resolution: Fixed Fix Version/s: 1.0.0 https://github.com/apache/spark/pull/846/

[jira] [Updated] (SPARK-1911) Warn users that jars hould be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1911: - Description: Jars created by J This is especially a big problem especially for PySpark.

[jira] [Updated] (SPARK-1911) Warn users that jars should be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1911: - Description: Jars created by Java 7 o This is especially a big problem especially for PySpark.

[jira] [Updated] (SPARK-1911) Warn users that jars hould be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1911: - Summary: Warn users that jars hould be built with Java 6 for PySpark to work on YARN (was:

[jira] [Updated] (SPARK-1911) Warn users that jars should be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1911: - Summary: Warn users that jars should be built with Java 6 for PySpark to work on YARN (was:

[jira] [Updated] (SPARK-1911) Warn users that jars should be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1911: - Affects Version/s: (was: 1.0.0) Warn users that jars should be built with Java 6 for

[jira] [Resolved] (SPARK-1911) Warn users that jars should be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1911. -- Resolution: Fixed Fix Version/s: (was: 1.0.1) 1.0.0

[jira] [Comment Edited] (SPARK-1911) Warn users that jars should be built with Java 6 for PySpark to work on YARN

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008260#comment-14008260 ] Tathagata Das edited comment on SPARK-1911 at 5/25/14 1:43 AM:

[jira] [Created] (SPARK-1920) Spark JAR compiled with Java 7 leads to PySpark not work in YARN

Tathagata Das created SPARK-1920: Summary: Spark JAR compiled with Java 7 leads to PySpark not work in YARN Key: SPARK-1920 URL: https://issues.apache.org/jira/browse/SPARK-1920 Project: Spark

[jira] [Updated] (SPARK-1900) Fix running PySpark files on YARN

[ https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1900: - Affects Version/s: (was: 1.0.0) Fix running PySpark files on YARN

[jira] [Created] (SPARK-1940) Enable rolling of executor logs (stdout / stderr)

Tathagata Das created SPARK-1940: Summary: Enable rolling of executor logs (stdout / stderr) Key: SPARK-1940 URL: https://issues.apache.org/jira/browse/SPARK-1940 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-1940) Enable rolling of executor logs (stdout / stderr)

[ https://issues.apache.org/jira/browse/SPARK-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-1940: Assignee: Tathagata Das Enable rolling of executor logs (stdout / stderr)

[jira] [Commented] (SPARK-1940) Enable rolling of executor logs (stdout / stderr)

[ https://issues.apache.org/jira/browse/SPARK-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010413#comment-14010413 ] Tathagata Das commented on SPARK-1940: -- This is solved in

  1   2   3   4   5   6   7   8   9   10   >