Hi Naveen, in you previous mail you mention that
> Yeah, I did route the ³count² bolt output to a file and I see the output.
> I can see the Storm and Flink output matching.
How did you do this? Modifying the "count bolt" code? Or did you use
some other bolt that consumes the "count bolt" output?
One more thought: how much data do you have and did you terminate you
program before looking into the result file? I am asking because
BoltFileSink uses a BufferedOutputWriter internally -- if you have only
a few records in your result and do not terminate, the data might still
be buffered. I would get flushed to disc if you terminate the program.
Otherwise, I could not spot any issue with your code. And as Max
mentioned that the console output worked for him using you program I am
little puzzled what might go wrong in your setup. The program seems to
be correct.
-Matthias
On 12/04/2015 08:55 PM, Madhire, Naveen wrote:
> Hi Max,
>
> I forgot to include flink-storm-examples dependency in the application to
> use BoltFileSink.
>
> However, the file created by the BoltFileSink is empty. Is there any other
> stuff which I need to do to write it into a file by using BoltFileSink?
>
> I am using the same code what you mentioned,
>
> builder.setBolt("file", new BoltFileSink("/tmp/storm", new
> OutputFormatter() {
> @Override
> public String format(Tuple tuple) {
> return tuple.toString();
> }
> }), 1).shuffleGrouping("count");
>
>
>
>
> Thanks,
> Naveen
>
>
>
>
>>
>> On 12/4/15, 5:36 AM, "Maximilian Michels" <m...@apache.org> wrote:
>>
>>> Hi Naveen,
>>>
>>> Were you using Maven before? The syncing of changes in the master
>>> always takes a while for Maven. The documentation happened to be
>>> updated before Maven synchronized. Building and installing manually
>>> (what you did) solves the problem.
>>>
>>> Strangely, when I run your code on my machine with the latest
>>> 1.0-SNAPSHOT I see a lot of output on my console.
>>>
>>> Here's the output: https://gist.github.com/mxm/98cd927866b193ce0f89
>>>
>>> Could you add bolt which writes the Storm tuples to a file? Is that
>>> file also empty?
>>>
>>> builder.setBolt("file", new BoltFileSink("/tmp/storm", new
>>> OutputFormatter() {
>>> @Override
>>> public String format(Tuple tuple) {
>>> return tuple.toString();
>>> }
>>> }), 1).shuffleGrouping("count");
>>>
>>>
>>> Thanks,
>>> Max
>>
>> ________________________________________________________
>>
>> The information contained in this e-mail is confidential and/or
>> proprietary to Capital One and/or its affiliates and may only be used
>> solely in performance of work or services for Capital One. The
>> information transmitted herewith is intended only for use by the
>> individual or entity to which it is addressed. If the reader of this
>> message is not the intended recipient, you are hereby notified that any
>> review, retransmission, dissemination, distribution, copying or other use
>> of, or taking of any action in reliance upon this information is strictly
>> prohibited. If you have received this communication in error, please
>> contact the sender and delete the material from your computer.
>>
>
> ________________________________________________________
>
> The information contained in this e-mail is confidential and/or proprietary
> to Capital One and/or its affiliates and may only be used solely in
> performance of work or services for Capital One. The information transmitted
> herewith is intended only for use by the individual or entity to which it is
> addressed. If the reader of this message is not the intended recipient, you
> are hereby notified that any review, retransmission, dissemination,
> distribution, copying or other use of, or taking of any action in reliance
> upon this information is strictly prohibited. If you have received this
> communication in error, please contact the sender and delete the material
> from your computer.
>
signature.asc
Description: OpenPGP digital signature
