be an issue.
Planning to give this more thought :)
Gwen
On Fri, May 1, 2015 at 7:56 PM, Jonathan Hodges hodg...@gmail.com wrote:
Hi Gwen,
As you said I see Bottled Water and Sqoop managing slightly different use
cases so I don't see this feature as a Sqoop killer. However I did have
Hi Gwen,
As you said I see Bottled Water and Sqoop managing slightly different use
cases so I don't see this feature as a Sqoop killer. However I did have a
question on your comment that the transaction log or CDC approach will have
problems with very large, very active databases.
I get that
Yes you are right on the oplog per partition as well as that mapping well
to the Kafka partitions. I think we are making this harder than it is
based on previous attempts and trying to leverage something like Databus
for propagating log changes from MongoDB and Cassandra since it requires a
scn.
.
That does mean that all data from all tables is in a single topic. I will
probably have a consumer that will read that all tables topic, and split
the data out into separate topics, for consumers who just want a subset of
the data.
-James
On Mar 4, 2015, at 9:28 AM, Jonathan Hodges hodg
picked
up
by
the
remaining ones. You can use partition id and the offset of each
message
as
its UUID if needed.
Thanks,
Jun
On Wed, Jun 4, 2014 at 10:56 AM, Jonathan Hodges
hodg...@gmail.com
wrote:
Sorry
Hi Neha,
Thanks so much to you and the Kafka team for putting together the meetup.
It was very nice and gave people from out of town like us the ability to
join in person.
We are the guys from Pearson Education and we talked a little about
supplying some details on some of our use cases with
Sorry didn't realize the mailing list wasn't copied...
-- Forwarded message --
From: Jonathan Hodges hodg...@gmail.com
Date: Wed, Jun 4, 2014 at 10:56 AM
Subject: Re: Hadoop Summit Meetups
To: Neha Narkhede neha.narkh...@gmail.com
We have a number of customer facing online
We are also using straight Java. I am not sure if Spring/Camel supports
past 0.8 beta.
On Mon, Apr 14, 2014 at 9:39 PM, Otis Gospodnetic
otis.gospodne...@gmail.com wrote:
In our case it's straight Java.
Otis
--
Performance Monitoring * Log Analytics * Search Analytics
Solr
With the Hadoop Summit in San Jose 6/3 - 6/5 I wondered if any of the
LinkedIn geniuses were thinking of putting together a meet-up on any of the
associated technologies like Kafka, Samza, Databus, etc. For us poor souls
that don't live on the West Coast it was a great experience attending the
Thanks so much, Neha!
On Fri, Apr 11, 2014 at 10:31 AM, Neha Narkhede neha.narkh...@gmail.comwrote:
Yes, that's a great idea. I can help organize the meetup at LinkedIn.
Thanks,
Neha
On Fri, Apr 11, 2014 at 8:44 AM, Saurabh Agarwal (BLOOMBERG/ 731 LEXIN)
sagarwal...@bloomberg.net
+1 for security branch
We are willing to assist with the merge.
On Wed, Apr 2, 2014 at 8:32 AM, Joe Stein joe.st...@stealth.ly wrote:
Hi Raja, do you have an ICLA https://www.apache.org/licenses/icla.txt on
file with Apache?
One thought would be to branch a security branch at the commit
Hi,
While searching the user group messages I found the following thread -
http://grokbase.com/t/kafka/users/138vqq1x07/getting-leadernotavailableexception-in-console-producer-after-increasing-partitions-from-4-to-16.
It shows the following stack trace with 0.8.
[2013-08-27 08:29:30,372] INFO
wrote:
Hi Jonathan
We forked kafka to add SSL feature. It not part of kafka official release
Sent from my iPhone
On Nov 15, 2013, at 12:32 PM, Jonathan Hodges hodg...@gmail.com wrote:
Hi,
While searching the user group messages I found the following thread -
http
Hi LinkedIn Guys and Girls,
Out of curiosity do you guys use any other messaging systems within
LinkedIn besides Kafka? For instance, are there any more complex messaging
use cases requiring something like JMS or AMQ?
We recently replaced a JMS solution in favor of Kafka for a particular use
Hi Florin,
I work with Yogesh so it is interesting you mention the
'metadata.broker.list' property as this was the first error message we saw.
Consider the following producer code.
Properties props = new Properties();
props.put(broker.list, x.x.x.x:9092, x.x.x.x :9092, x.x.x.x :9092,
x.x.x.x
day will work for me. I am waiting for you to decide on time so
that
I
can book my ticket accordingly!
Regards,
Vaibhav
On Tue, May 21, 2013 at 4:47 AM, Jonathan Hodges hodg...@gmail.com
wrote:
Tuesday or Thursday works the best for me as I plan
,
Jun
On Thu, Jun 20, 2013 at 4:41 AM, Jonathan Hodges hodg...@gmail.com
wrote:
Hi Neha,
Any update on the Thursday evening meeting venue?
Thanks,
Jonathan
On Tue, May 28, 2013 at 6:29 PM, Neha Narkhede neha.narkh...@gmail.com
wrote:
Vaibhav,
You can plan
Looking at Jun’s ApacheCon slides (
http://www.slideshare.net/junrao/kafka-replication-apachecon2013) slide 21
titled, ‘Data Flow in Replication’ there are three possible durability
configurations which tradeoff latency for greater persistence guarantees.
The third row is the ‘no data loss’
, Jonathan Hodges hodg...@gmail.com
wrote:
Hi Tim,
While your comments regarding durability are accurate for 0.7 version of
Kafka, it is a bit greyer with 0.8. In 0.8 you have the ability to
configure Kafka to have the durability you need. This is what I was
referring to with the link
On Sat, Jun 8, 2013 at 2:09 AM, Jonathan Hodges hodg...@gmail.com wrote:
Thanks so much for your replies. This has been a great help understanding
Rabbit better with having very little experience with it. I have a few
follow up comments below.
Happy to help!
I'm afraid I don't follow your
a new consumer and/or partition appears, can messages in the
broker get moved from one partition to another?
On Sat, Jun 8, 2013 at 12:53 PM, Jonathan Hodges hodg...@gmail.com
wrote:
On Sat, Jun 8, 2013 at 2:09 AM, Jonathan Hodges hodg...@gmail.com
wrote:
Thanks so much for your replies
to manage the beast as it grows will allow me to get to
sleep way more easily.
On Thu, Jun 6, 2013 at 3:28 PM, Jonathan Hodges hodg...@gmail.com
wrote:
We just went through a similar exercise with RabbitMQ at our company
with
streaming activity data from our various web properties. Our
if you wanted to share the same stream of messages across
multiple consumers.
On Fri, Jun 7, 2013 at 12:03 PM, Jonathan Hodges hodg...@gmail.com wrote:
Hi Alexis,
I appreciate your reply and clarifications to my misconception about
Rabbit, particularly on the copying of the message payloads
:
Jonathan,
On Fri, Jun 7, 2013 at 7:03 PM, Jonathan Hodges hodg...@gmail.com wrote:
Hi Alexis,
I appreciate your reply and clarifications to my misconception about
Rabbit, particularly on the copying of the message payloads per consumer.
Thank-you!
It sounds like it only copies
Awesome right up Jason! Very helpful as we are also looking to build a
Kafka environment in AWS. I am curious, are you using Kafka 0.7.2 or 0.8
in your tests? Did you have just one EBS volume per broker instance or
RAID 10 across EBS volumes per broker?
Thanks again for the great info!
Great idea Vaibhav! I would also be interested in this as I live in Denver
and don't get to the Bay area too often.
-Jonathan
On Mon, May 20, 2013 at 2:35 PM, Vaibhav Puranik vpura...@gmail.com wrote:
Jun and Neha,
Is there any plan for Kafka Users group meeting around Hadoop Summit?
It
this information.
Thanks,
Jun
On Wed, Mar 27, 2013 at 2:41 PM, Jonathan Hodges hodg...@gmail.com
wrote:
I know this is a really old thread, but it looked like the only pertinent
one that came up when searching for ‘exactly once’ in the archives. I
just
want to confirm my understanding
Many thanks for contributing! The docs are very helpful. I found a couple
small possible typos. The partitioning code example looks like it repeats
at the bottom with duplicate import and class definition statements. Also
the create topic command-line appears to have an extra '-' for the
28 matches
Mail list logo
