Great, passing partition number as a partition key is enough for my
needs. Many thanks, Tommy!
On 04/07/2015 02:46 PM, Tommy Becker wrote:
If you want to send to a specific partition number, you can just pass
that number as the partition key. This works because the default
partitioner is via hashcode, and the hash of integers is the value
itself.
On 04/07/2015 07:40 AM, Vladimir Lebedev wrote:
Hey,
I can not find clear explanation of this in the documentation or in
hello-samza: how to tell collector to send my output data to a
particular partition of the output stream?
My understanding is that in my process() method I have to create
OutgoingMessageEnvelope object passing not only my deserialized data,
but also my partition key, like this:
[...]
try {
collector.send(new OutgoingMessageEnvelope(new
SystemStream("kafka", "output"), my_partition_key, null, my_data));
} catch (Exception e) {
System.err.println("Unable to parse line: " + event);
}
[...]
The question is: who is responsible for computing the partition number
based on my_partition_key? How, for example, I can establish some kind
of consistent hashing mechanism for computing the partition number
based on the key? Is it configurable somehow via task properties, like
I may do it in Kafka via partitioner.class property?
Many thanks in advance,
Vladimir
--
Vladimir Lebedev
http://linkedin.com/in/vlebedev
--
Tommy Becker
Senior Software Engineer
Digitalsmiths
A TiVo Company
www.digitalsmiths.com<http://www.digitalsmiths.com>
tobec...@tivo.com<mailto:tobec...@tivo.com>
________________________________
This email and any attachments may contain confidential and privileged
material for the sole use of the intended recipient. Any review,
copying, or distribution of this email (or any attachments) by others
is prohibited. If you are not the intended recipient, please contact
the sender immediately and permanently delete this email and any
attachments. No employee or agent of TiVo Inc. is authorized to
conclude any binding agreement on behalf of TiVo Inc. by email.
Binding agreements with TiVo Inc. may only be made by a signed written
agreement.
