[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-07-09 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-120189769 Okay. I hope you get time in future. TD On Thu, Jul 9, 2015 at 5:16 PM, industrial-sloth wrote: > Closed #3858

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-07-09 Thread industrial-sloth
Github user industrial-sloth closed the pull request at: https://github.com/apache/spark/pull/3858 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featu

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-07-09 Thread industrial-sloth
Github user industrial-sloth commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-120179506 Ha, that was an old throwaway account. Anyway, as I was saying, no updates, and no reasonable chance of progress in the near future either. Fine by me to close

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-07-09 Thread SlothPetro
Github user SlothPetro commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-120179245 Hi @tdas - Unfortunately no, and it doesn't look likely that this will be changing any time in the near future, either. I'd be fine with just closing out the PR and J

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-07-09 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-120148480 @industrial-sloth Hey any updates on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-06-22 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-114140106 @industrial-sloth I think most of work to add a new type of DStream includes: 1. Convert parameters from Python types to Java types 2. Convert DStream[T] fro

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-113695466 Could you also update the JIRA and title to make it more specific to the problem? E.g. Python API for ZeroMQ? On Fri, Jun 19, 2015 at 3:05 PM, industrial-sloth

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-06-19 Thread industrial-sloth
Github user industrial-sloth commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-113656363 Sounds good @tdas. I'll try to take a look and get this updated sometime over the next week or so. Will ping you with a comment here when there's something wort

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-113648094 That gives me some context. We are adding more stuff to the python API for parity with Scala and Java. We have added full Kafka Python API, Flume is being added, and

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-06-19 Thread industrial-sloth
Github user industrial-sloth commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-113631381 Sure thing @tdas. First a caveat: I haven't been keeping up with the spark community since ~March 2015, so the issues I originally hit might no longer exist w/

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-06-19 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-113590414 The idea is interesting. But I am not clear what sort of concrete situations does it improve. @industrial-sloth could you provide us an example? --- If your project is set

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-06-18 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-113321838 @tdas is this something we want? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-04-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-96769900 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-5037][STREAMING] dynamically loaded DSt...

2015-03-11 Thread industrial-sloth
Github user industrial-sloth commented on the pull request: https://github.com/apache/spark/pull/3858#issuecomment-78387422 @sryza No problem, done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not