bump
On Fri, Mar 6, 2015 at 3:07 PM, Raphael Hsieh wrote:
> Hi. I've been noticing in my graphs that every so often I'm receiving
> some anomalous spikes in data that contain almost twice the amount of
> data that I'm expecting. I believe this has something to do with m
This supposedly guarantees
exactly once processing.
I am using DynamoDB as an external datastore.
Does anybody have any suggestions on how I can go about debugging this ?
Thanks
--
Raphael Hsieh
bump
On Tue, Jan 20, 2015 at 5:17 PM, Raphael Hsieh wrote:
> Is it possible to split a stream and have one stream be prioritized over
> another? So that if one of the streams/bolts fails, it does not blow up and
> take down the entire system?
> Currently, if one part of my syst
Is it possible to split a stream and have one stream be prioritized over
another? So that if one of the streams/bolts fails, it does not blow up and
take down the entire system?
Currently, if one part of my system starts to become latent, the entire
thing suffers.
Thanks!
--
Raphael Hsieh
:
> Trident typically processes just a few batches per second. Actually you'll
> get much better db performance through Trident than you typically would
> manually *because* of the batching (instead of lots of individual round
> trips).
>
> On Thu, Jan 8, 2015 at 2:12 PM,
storm aggregations in a way
that external services might be able to access this data ?
--
Raphael Hsieh
How do I get the transaction if of a particular batch in Trident?
I have a persistent aggregate that is able to automagically get that, but
if I just want a filter to get that value, how would I do that?
--
Raphael Hsieh
Can someone explain to me what might be wrong with my request?
I've pretty much followed the tutorial to the letter, inputting my hosts
and available port.
--
Raphael Hsieh
d_mbox/incubator-storm-user/201408.mbox/%3cbc4c3d35-93b6-45fa-960d-47325ccaf...@gmail.com%3e>
> He has asked to configure one more property in the map.
>
> Regards,
> Richards Peter.
>
--
Raphael Hsieh
master/storm-core/src/jvm/backtype/storm/generated/Nimbus.java#L295>
> or
> storm command line.
>
> Thanks
> Parth
> On Oct 6, 2014, at 2:27 PM, Raphael Hsieh wrote:
>
> Worst case scenario, I could create a cron job that queries the UI and
> parses the tables to m
r the rebalance button.
But this seems super hacky and gross.
Thanks
--
Raphael Hsieh
but in my StormConfig, I can set my
max batch size as well.
if I do:
tridentKafkaConfig.fetchSizeBytes = 1024;
then later do
config.put(RichSpoutBatchExecutor.MAX_BATCH_SIZE_CONF, 1024*1024*10)
doesn't that mean that my maximum batch size will be 1024 regardless ?
--
Raphael Hsieh
metrics generated elsewhere in the
topology?
If I were to create a metric that purely counts the number of tuples in a
batch, how would that differ from creating a new bolt that aggregates the
number of tuples in a batch and then outputs it to a log file ?
Thanks
--
Raphael Hsieh
metrics generated elsewhere in the
topology?
If I were to create a metric that purely counts the number of tuples in a
batch, how would that differ from creating a new bolt that aggregates the
number of tuples in a batch and then outputs it to a log file ?
Thanks
--
Raphael Hsieh
Actually nevermind, I think I figured it out. I was calling the same
function twice haha.
Thanks
On Mon, Sep 29, 2014 at 1:19 PM, Raphael Hsieh wrote:
> Thank you Yuval and Yair, this has been extremely helpful.
> I am now running in to a problem where Storm thinks that the metric has
>
unctions, override
>> prepare(), which gives you a TridentOperationContext. In aggregators, use
>> the IMetricsContext you get in makeState().
>> --
>> Yuval Oren
>> *N3TWORK*
>>
>> On Sep 26, 2014, at 4:21 PM, Raphael Hsieh wrote:
>>
>> I've
16 matches
Mail list logo
