Re: Possibly very minor typo in documentation.html

2016-06-22 Thread Guozhang Wang
Thanks for reporting this Tyler, we will fix the docs. Guozhang On Wed, Jun 22, 2016 at 10:56 AM, Tyler wrote: > Note: Please CC me if needed, I am not subscribed to this list. > > 0.9 changes say: “Java 1.6 is no longer supported” > > However, the CWD in this example at > http://kafka.apache.o

Re: Kafka HDFS Connector

2016-06-22 Thread Pariksheet Barapatre
Many Thanks Dave and Dustin for your inputs. I will check code and try to implement proposed solution. Cheers Pari On 22 June 2016 at 23:25, Dustin Cote wrote: > Yes, I believe what you're looking for is what Dave described. Here's the > source of that interface > > https://github.com/confluen

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

2016-06-22 Thread Eric Wasserman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345618#comment-15345618 ] Eric Wasserman commented on KAFKA-1981: --- [~ijuma] do you think you have a chance to

[jira] [Commented] (KAFKA-3879) KafkaConsumer with auto commit enabled gets stuck when killed after broker is dead

2016-06-22 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345609#comment-15345609 ] Ashish K Singh commented on KAFKA-3879: --- [~hachikuji] yeah KAFKA-3822 is pointing to

Jenkins build is back to normal : kafka-0.10.0-jdk7 #133

2016-06-22 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk7 #1387

2016-06-22 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3863: System tests covering connector/task failure and restart -- [...truncated 6639 lines...] kafka.network.SocketServerTest > testSessionPrincipal PASSED kafka.networ

Possibly very minor typo in documentation.html

2016-06-22 Thread Tyler
Note: Please CC me if needed, I am not subscribed to this list. 0.9 changes say: “Java 1.6 is no longer supported” However, the CWD in this example at http://kafka.apache.org/documentation.html#quickstart_multibroker says: "No

RE: Kafka HDFS Connector

2016-06-22 Thread Tauzell, Dave
I don't see any built-in support for this but I think that you can write a class that implements io.confluent.connect.hdfs.Format public interface Format { RecordWriterProvider getRecordWriterProvider(); SchemaFileReader getSchemaFileReader(AvroData avroData); HiveUtil getHiveUtil(HdfsSinkC

[jira] [Commented] (KAFKA-3879) KafkaConsumer with auto commit enabled gets stuck when killed after broker is dead

2016-06-22 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345485#comment-15345485 ] Jason Gustafson commented on KAFKA-3879: [~singhashish] This is a duplicate of KAF

Build failed in Jenkins: kafka-trunk-jdk8 #718

2016-06-22 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3863: System tests covering connector/task failure and restart -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-6

[jira] [Resolved] (KAFKA-3863) Add system test for connector failure/restart

2016-06-22 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-3863. -- Resolution: Fixed Fix Version/s: 0.10.0.1 0.10.1.0 Iss

[jira] [Commented] (KAFKA-3863) Add system test for connector failure/restart

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345452#comment-15345452 ] ASF GitHub Bot commented on KAFKA-3863: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1519: KAFKA-3863: System tests covering connector/task f...

2016-06-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1519 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345444#comment-15345444 ] Jason Gustafson commented on KAFKA-3892: [~iamnoah] Can you reliably reproduce the

Re: [DISCUSS] KIP-54 Sticky Partition Assignment Strategy

2016-06-22 Thread Jason Gustafson
Hey Vahid, Thanks for the updates. I think the lack of comments on this KIP suggests that the motivation might need a little work. Here are the two main benefits of this assignor as I see them: 1. It can give a more balanced assignment when subscriptions do not match in a group (this is the same

[jira] [Commented] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread Noah Sloan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345400#comment-15345400 ] Noah Sloan commented on KAFKA-3892: --- I can say that all producers and consumers ended up

[jira] [Commented] (KAFKA-3890) Kafka Streams: task assignment is not maintained on cluster restart or rolling restart

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345367#comment-15345367 ] ASF GitHub Bot commented on KAFKA-3890: --- GitHub user HenryCaiHaiying opened a pull r

[GitHub] kafka pull request #1543: KAFKA-3890 Kafka Streams: task assignment is not m...

2016-06-22 Thread HenryCaiHaiying
GitHub user HenryCaiHaiying opened a pull request: https://github.com/apache/kafka/pull/1543 KAFKA-3890 Kafka Streams: task assignment is not maintained on cluster restart or rolling restart Current task assignment in TaskAssignor is not deterministic. During cluster restar

[jira] [Commented] (KAFKA-3890) Kafka Streams: task assignment is not maintained on cluster restart or rolling restart

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345365#comment-15345365 ] ASF GitHub Bot commented on KAFKA-3890: --- Github user HenryCaiHaiying closed the pull

[jira] [Commented] (KAFKA-3890) Kafka Streams: task assignment is not maintained on cluster restart or rolling restart

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345362#comment-15345362 ] ASF GitHub Bot commented on KAFKA-3890: --- GitHub user HenryCaiHaiying reopened a pull

[GitHub] kafka pull request #1538: KAFKA-3890 Kafka Streams: task assignment is not m...

2016-06-22 Thread HenryCaiHaiying
Github user HenryCaiHaiying closed the pull request at: https://github.com/apache/kafka/pull/1538 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

Build failed in Jenkins: kafka-trunk-jdk8 #717

2016-06-22 Thread Apache Jenkins Server
See Changes: [harsha] MINOR: Verify acls for group resource on all servers of test cluster. -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubun

[jira] [Commented] (KAFKA-3890) Kafka Streams: task assignment is not maintained on cluster restart or rolling restart

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345361#comment-15345361 ] ASF GitHub Bot commented on KAFKA-3890: --- Github user HenryCaiHaiying closed the pull

[GitHub] kafka pull request #1538: KAFKA-3890 Kafka Streams: task assignment is not m...

2016-06-22 Thread HenryCaiHaiying
Github user HenryCaiHaiying closed the pull request at: https://github.com/apache/kafka/pull/1538 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] kafka pull request #1538: KAFKA-3890 Kafka Streams: task assignment is not m...

2016-06-22 Thread HenryCaiHaiying
GitHub user HenryCaiHaiying reopened a pull request: https://github.com/apache/kafka/pull/1538 KAFKA-3890 Kafka Streams: task assignment is not maintained on cluster restart or rolling restart Current task assignment in TaskAssignor is not deterministic. During cluster rest

Build failed in Jenkins: kafka-trunk-jdk7 #1386

2016-06-22 Thread Apache Jenkins Server
See Changes: [harsha] MINOR: Verify acls for group resource on all servers of test cluster. -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubu

[jira] [Created] (KAFKA-3894) Log Cleaner thread crashes and never restarts

2016-06-22 Thread Tim Carey-Smith (JIRA)
Tim Carey-Smith created KAFKA-3894: -- Summary: Log Cleaner thread crashes and never restarts Key: KAFKA-3894 URL: https://issues.apache.org/jira/browse/KAFKA-3894 Project: Kafka Issue Type: B

[jira] [Comment Edited] (KAFKA-3893) Kafka Borker ID disappears from /borkers/ids

2016-06-22 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345288#comment-15345288 ] Sriharsha Chintalapani edited comment on KAFKA-3893 at 6/22/16 10:30 PM: ---

[jira] [Commented] (KAFKA-3893) Kafka Borker ID disappears from /borkers/ids

2016-06-22 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345288#comment-15345288 ] Sriharsha Chintalapani commented on KAFKA-3893: --- [~chaithrar...@gmail.com] i

[GitHub] kafka pull request #1540: MINOR: Verify acls for group resource on all serve...

2016-06-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1540 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3893) Kafka Borker ID disappears from /borkers/ids

2016-06-22 Thread chaitra (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaitra updated KAFKA-3893: --- Description: Kafka version used : 0.8.2.1 Zookeeper version: 3.4.6 We have scenario where kafka 's broker in

[jira] [Updated] (KAFKA-3893) Kafka Borker ID disappears from /borkers/ids

2016-06-22 Thread chaitra (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaitra updated KAFKA-3893: --- Summary: Kafka Borker ID disappears from /borkers/ids (was: Kafka not trying re-register back in Zookeeper)

[jira] [Commented] (KAFKA-3663) Proposal for a kafka broker command - kafka-brokers.sh

2016-06-22 Thread Jayesh Thakrar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345240#comment-15345240 ] Jayesh Thakrar commented on KAFKA-3663: --- I think I need some pointers/help here. App

[jira] [Commented] (KAFKA-3893) Kafka not trying re-register back in Zookeeper

2016-06-22 Thread chaitra (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345201#comment-15345201 ] chaitra commented on KAFKA-3893: Kafka busy spitting below logs {noformat} [2016-06-21 21:

[jira] [Updated] (KAFKA-3893) Kafka not trying re-register back in Zookeeper

2016-06-22 Thread chaitra (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaitra updated KAFKA-3893: --- Description: Kafka version used : 0.8.2.1 Zookeeper version: 3.4.6 We have scenario where kafka is not tryin

[jira] [Updated] (KAFKA-3893) Kafka not trying re-register back in Zookeeper

2016-06-22 Thread chaitra (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaitra updated KAFKA-3893: --- Priority: Critical (was: Major) > Kafka not trying re-register back in Zookeeper > --

[jira] [Updated] (KAFKA-3893) Kafka not trying re-register back in Zookeeper

2016-06-22 Thread chaitra (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaitra updated KAFKA-3893: --- Summary: Kafka not trying re-register back in Zookeeper (was: Kafka not disconnecting zookeeper connection ev

[jira] [Updated] (KAFKA-3893) Kafka not disconnecting zookeeper connection even after time configured for timeout has crossed

2016-06-22 Thread chaitra (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaitra updated KAFKA-3893: --- Description: Kafka version used : 0.8.2.1 Zookeeper version: 3.4.6 We have scenario where kafka > Kafka no

[jira] [Created] (KAFKA-3893) Kafka not disconnecting zookeeper connection even after time configured for timeout has crossed

2016-06-22 Thread chaitra (JIRA)
chaitra created KAFKA-3893: -- Summary: Kafka not disconnecting zookeeper connection even after time configured for timeout has crossed Key: KAFKA-3893 URL: https://issues.apache.org/jira/browse/KAFKA-3893 Pro

[jira] [Commented] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345164#comment-15345164 ] ASF GitHub Bot commented on KAFKA-3892: --- GitHub user iamnoah opened a pull request:

[GitHub] kafka pull request #1542: KAFKA-3892 prune metadata response to subscribed t...

2016-06-22 Thread iamnoah
GitHub user iamnoah opened a pull request: https://github.com/apache/kafka/pull/1542 KAFKA-3892 prune metadata response to subscribed topics Rebased from PR #1541 You can merge this pull request into a Git repository by running: $ git pull https://github.com/spredfast/kafka-1 r

[jira] [Commented] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345140#comment-15345140 ] ASF GitHub Bot commented on KAFKA-3892: --- Github user iamnoah closed the pull request

[GitHub] kafka pull request #1541: KAFKA-3892 prune metadata response to subscribed t...

2016-06-22 Thread iamnoah
Github user iamnoah closed the pull request at: https://github.com/apache/kafka/pull/1541 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[jira] [Commented] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345120#comment-15345120 ] Ismael Juma commented on KAFKA-3892: I was explaining a known cause of it happening. :

[jira] [Commented] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread Noah Sloan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345103#comment-15345103 ] Noah Sloan commented on KAFKA-3892: --- I believe the ultimate cause is that the either a r

[GitHub] kafka pull request #1541: KAFKA-3892 prune metadata response to subscribed t...

2016-06-22 Thread iamnoah
GitHub user iamnoah opened a pull request: https://github.com/apache/kafka/pull/1541 KAFKA-3892 prune metadata response to subscribed topics I believe this will cause clients to defensively prune their cluster metadata in all cases. It doesn't address why a client without a Pattern

[jira] [Commented] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345095#comment-15345095 ] ASF GitHub Bot commented on KAFKA-3892: --- GitHub user iamnoah opened a pull request:

[GitHub] kafka pull request #1540: MINOR: Verify acls for group resource on all serve...

2016-06-22 Thread SinghAsDev
GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/1540 MINOR: Verify acls for group resource on all servers of test cluster. You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka MinorA

[jira] [Commented] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345082#comment-15345082 ] Ismael Juma commented on KAFKA-3892: One of the issues is that if your producer or con

[jira] [Created] (KAFKA-3892) Clients retain metadata for non-subscribed topics

2016-06-22 Thread Noah Sloan (JIRA)
Noah Sloan created KAFKA-3892: - Summary: Clients retain metadata for non-subscribed topics Key: KAFKA-3892 URL: https://issues.apache.org/jira/browse/KAFKA-3892 Project: Kafka Issue Type: Bug

Re: Kafka HDFS Connector

2016-06-22 Thread Dustin Cote
Yes, I believe what you're looking for is what Dave described. Here's the source of that interface https://github.com/confluentinc/kafka-connect-hdfs/blob/master/src/main/java/io/confluent/connect/hdfs/Format.java There already exists a StringConverter that should handle the conversion in and out

Re: Kafka HDFS Connector

2016-06-22 Thread Pariksheet Barapatre
Hi Dustin, I am looking for option 1. Looking at Kafka Connect code, I guess we need to write converter code if not available. Thanks in advance. Regards Pari On 22 June 2016 at 18:50, Dustin Cote wrote: > Hi Pari, > > Can you clarify which scenario you are looking to implement? > 1) plain

[jira] [Comment Edited] (KAFKA-3824) Docs indicate auto.commit breaks at least once delivery but that is incorrect

2016-06-22 Thread kambiz shahri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15344676#comment-15344676 ] kambiz shahri edited comment on KAFKA-3824 at 6/22/16 4:30 PM: -

[jira] [Commented] (KAFKA-3824) Docs indicate auto.commit breaks at least once delivery but that is incorrect

2016-06-22 Thread kambiz shahri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15344676#comment-15344676 ] kambiz shahri commented on KAFKA-3824: -- Fair enough. > Docs indicate auto.commit bre

[jira] [Commented] (KAFKA-3824) Docs indicate auto.commit breaks at least once delivery but that is incorrect

2016-06-22 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15344548#comment-15344548 ] Jay Kreps commented on KAFKA-3824: -- [~beez] Sorry for not following up sooner. I think th

[jira] [Commented] (KAFKA-3663) Proposal for a kafka broker command - kafka-brokers.sh

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15344469#comment-15344469 ] ASF GitHub Bot commented on KAFKA-3663: --- GitHub user JThakrar opened a pull request:

[GitHub] kafka pull request #1539: KAFKA-3663

2016-06-22 Thread JThakrar
GitHub user JThakrar opened a pull request: https://github.com/apache/kafka/pull/1539 KAFKA-3663 This implements KIP-59: Proposal for a kafka broker command. See https://cwiki.apache.org/confluence/display/KAFKA/KIP-59%3A+Proposal+for+a+kafka+broker+command for details and samp

RE: Kafka HDFS Connector

2016-06-22 Thread Lohith Samaga M
Hi, You can use Storm also, Here you have the option of rotating the file. You can also write to Hive directly. Best regards / Mit freundlichen Grüßen / Sincères salutations M. Lohith Samaga -Original Message- From: Mudit Kumar [mailto:mudit.ku...@askme.in] Sent: Wednesday, J

Re: Kafka HDFS Connector

2016-06-22 Thread Mudit Kumar
I think you can use flume also. Thanks, Mudit On 6/22/16, 12:29 PM, "Pariksheet Barapatre" wrote: >Anybody have any idea on this? > >Thanks >Pari > >On 20 June 2016 at 14:36, Pariksheet Barapatre >wrote: > >> Hello All, >> >> I have data coming from sensors into kafka cluster in text format

Re: Kafka HDFS Connector

2016-06-22 Thread Dustin Cote
Hi Pari, Can you clarify which scenario you are looking to implement? 1) plaintext Kafka data --> plaintext HDFS data readable by hive 2) plaintext Kafka data --> avro/parquet HDFS data readable by hive Regards, On Wed, Jun 22, 2016 at 6:02 AM, Pariksheet Barapatre < pari.data...@gmail.com> wr

[jira] [Resolved] (KAFKA-3891) A KTable with Long values with a numeric filter apparently may retain null values

2016-06-22 Thread Phil Derome (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Derome resolved KAFKA-3891. Resolution: Invalid My mistake. > A KTable with Long values with a numeric filter apparently may re

[jira] [Updated] (KAFKA-3891) A KTable with Long values with a numeric filter apparently may retain null values

2016-06-22 Thread Phil Derome (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Derome updated KAFKA-3891: --- Please reject, my mistake. > A KTable with Long values with a numeric filter apparently may retain null

[jira] [Created] (KAFKA-3891) A KTable with Long values with a numeric filter apparently may retain null values

2016-06-22 Thread Phil Derome (JIRA)
Phil Derome created KAFKA-3891: -- Summary: A KTable with Long values with a numeric filter apparently may retain null values Key: KAFKA-3891 URL: https://issues.apache.org/jira/browse/KAFKA-3891 Project:

Re: Kafka HDFS Connector

2016-06-22 Thread Pariksheet Barapatre
Thanks for your suggestions. I think if kafka connect provides the same functionality as flume and storm, why should we go for another infrastructure investment. Kafka Connect effectively copies data from Kafka topic to HDFS through connector. It supports avro as well as parquet, I am looking if

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-22 Thread Rajini Sivaram
Ismael, Jun, Thank you both for the feedback. Have updated the KIP to add dynamic default quotas for client-id with deprecation of existing static default properties. On Wed, Jun 22, 2016 at 12:50 AM, Jun Rao wrote: > Yes, for consistency, perhaps we can allow client-id quota to be configured

Build failed in Jenkins: kafka-trunk-jdk8 #716

2016-06-22 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: KAFKA-3176 follow-up to fix minor issues -- [...truncated 531 lines...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[0] STARTED kafka.log.BrokerCompre

[GitHub] kafka pull request #1536: MINOR: KAFKA-3176 follow-up to fix minor issues

2016-06-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1536 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3176) Allow console consumer to consume from particular partitions when new consumer is used.

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15343897#comment-15343897 ] ASF GitHub Bot commented on KAFKA-3176: --- Github user asfgit closed the pull request

[jira] [Comment Edited] (KAFKA-3824) Docs indicate auto.commit breaks at least once delivery but that is incorrect

2016-06-22 Thread kambiz shahri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15343864#comment-15343864 ] kambiz shahri edited comment on KAFKA-3824 at 6/22/16 7:50 AM: -

[jira] [Comment Edited] (KAFKA-3824) Docs indicate auto.commit breaks at least once delivery but that is incorrect

2016-06-22 Thread kambiz shahri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15343864#comment-15343864 ] kambiz shahri edited comment on KAFKA-3824 at 6/22/16 7:49 AM: -

[jira] [Comment Edited] (KAFKA-3824) Docs indicate auto.commit breaks at least once delivery but that is incorrect

2016-06-22 Thread kambiz shahri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15343864#comment-15343864 ] kambiz shahri edited comment on KAFKA-3824 at 6/22/16 7:49 AM: -

[jira] [Commented] (KAFKA-3824) Docs indicate auto.commit breaks at least once delivery but that is incorrect

2016-06-22 Thread kambiz shahri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15343864#comment-15343864 ] kambiz shahri commented on KAFKA-3824: -- My gripe is 3 fold: 1. The report of the issu

Re: Kafka HDFS Connector

2016-06-22 Thread Pariksheet Barapatre
Anybody have any idea on this? Thanks Pari On 20 June 2016 at 14:36, Pariksheet Barapatre wrote: > Hello All, > > I have data coming from sensors into kafka cluster in text format > delimited by comma. > > How to offload this data to Hive periodically from Kafka. I guess, Kafka > Connect should