Any updates on how can I use ManualClock other than editing the Spark
source code?
On Wed, Mar 1, 2017 at 10:19 AM, Hemalatha A <
hemalatha.amru...@googlemail.com> wrote:
> It is certainly possible through a hack.
> I was referring to below post where TD says it is possible th
Is there a way to easily hack this property to use Manual clock.
--
Regards
Hemalatha
Hello,
Can anyone please answer the below question and help me understand the
windowing operations.
On Sun, Sep 4, 2016 at 4:42 PM, Hemalatha A <
hemalatha.amru...@googlemail.com> wrote:
> Hello,
>
> I have a set of Dstreams on which I'm performing some computation on each
&
or base it on StreamB since it has a higher and same sliding
interval. Which would be a better choice?
Or is it the same as window on Base stream? How does it basically work?
--
Regards
Hemalatha
:346)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:254)
at
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
--
Regards
Hemalatha
Another usecase why I need to do this is, If Exception A is caught I should
just print it and ignore, but ifException B occurs, I have to end the
batch, fail it and stop processing the batch.
Is it possible to achieve this?? Any hints on this please.
On Wed, Jul 27, 2016 at 10:42 AM, Hemalatha
Hello,
I have a uescase where in, I have to fail certain batches in my streaming
batches, based on my application specific business rules.
Ex: If in a batch of 2 seconds, I don't receive 100 message, I should fail
the batch and move on.
How to achieve this behavior?
--
Regards
Hemalatha
Hemalatha
Can anyone help me in debugging this issue please.
On Thu, Apr 14, 2016 at 12:24 PM, Hemalatha A <
hemalatha.amru...@googlemail.com> wrote:
> Hi,
>
> I am facing a problem in Spark streaming.
>
Time
Spark streaming display? Also, when
there is scheduling delay of say 8 hours, what time does Spark display-
current rime or hours behind?
--
Regards
Hemalatha
Hello,
I want to know on doing spark-submit, how is the Application jar copied to
worker machines? Who does the copying of Jars?
Similarly who copies DAG from driver to executors?
--
Regards
Hemalatha
Regards
Hemalatha
ani.animalAge+=1
ani
})
Is it advisable to use var in this case? Or can I do ani.copy(animalAge=2)
which will reallocate the memory altogether for the animal. Please advice
which is the best way to handle such cases.
Regards
Hemalatha
13 matches
Mail list logo