[GitHub] kafka pull request #4064: MINOR: add unit test for StateStoreSerdes

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4064 ---

[GitHub] kafka pull request #4071: MINOR: a few web doc and javadoc fixes

2017-10-12 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/4071 MINOR: a few web doc and javadoc fixes You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka KMinor-javadoc-gaps

[GitHub] kafka pull request #4070: MINOR: update comments in config/producer.properti...

2017-10-12 Thread omkreddy
GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/4070 MINOR: update comments in config/producer.properties You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka prodcuer.config

Build failed in Jenkins: kafka-trunk-jdk8 #2135

2017-10-12 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Bump the request timeout for the transactional message copier -- [...truncated 3.28 MB...]

Build failed in Jenkins: kafka-trunk-jdk7 #2888

2017-10-12 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Bump the request timeout for the transactional message copier -- [...truncated 1.82 MB...]

[jira] [Created] (KAFKA-6059) Kafka cant delete old log files on windows

2017-10-12 Thread rico (JIRA)
rico created KAFKA-6059: --- Summary: Kafka cant delete old log files on windows Key: KAFKA-6059 URL: https://issues.apache.org/jira/browse/KAFKA-6059 Project: Kafka Issue Type: Bug Components:

Build failed in Jenkins: kafka-1.0-jdk7 #33

2017-10-12 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Bump the request timeout for the transactional message copier -- [...truncated 368.84 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

[jira] [Resolved] (KAFKA-5734) Heap (Old generation space) gradually increase

2017-10-12 Thread jang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jang resolved KAFKA-5734. - Resolution: Resolved I used producer not intended. > Heap (Old generation space) gradually increase >

[GitHub] kafka pull request #4039: MINOR: Bump the request timeout for the transactio...

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4039 ---

Re: [VOTE] 1.0.0 RC0

2017-10-12 Thread Ismael Juma
The only public classes are the ones in the javadoc. SecurityProtocol was not public, but it now is. Ismael On 13 Oct 2017 12:16 am, "Ted Yu" wrote: > Thanks for the explanation. > > SecurityProtocol was declared public in previous releases, hence I didn't > notice that it

Re: [VOTE] 1.0.0 RC0

2017-10-12 Thread Ted Yu
Thanks for the explanation. SecurityProtocol was declared public in previous releases, hence I didn't notice that it is internal. On Thu, Oct 12, 2017 at 4:07 PM, Guozhang Wang wrote: > For internal classes that are designed to be abstracted away from normal > users, I

Re: [VOTE] 1.0.0 RC0

2017-10-12 Thread Guozhang Wang
For internal classes that are designed to be abstracted away from normal users, I think it is OK to not mention it in the upgrade guides. For developers rather than users of Kafka, they are assumed to be familiar with the codebase and not only rely on upgrade guide docs for such information.

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-10-12 Thread Matthias J. Sax
Jorge, thanks for the update. I would suggest to not reuse `ConsumerGroupCommand` and re implement what we need in `StreamsResetter` directly. Even if we need to keep `StreamsResetter` in `core` for now, I think we should not introduce new dependencies. Currently, we still use old

[jira] [Created] (KAFKA-6058) Add "describe consumer group" to KafkaAdminClient

2017-10-12 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-6058: -- Summary: Add "describe consumer group" to KafkaAdminClient Key: KAFKA-6058 URL: https://issues.apache.org/jira/browse/KAFKA-6058 Project: Kafka Issue

Jenkins build is back to normal : kafka-trunk-jdk7 #2887

2017-10-12 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #4069: KAFKA-6057: Users forget `--execute` in the offset...

2017-10-12 Thread gilles-degols
GitHub user gilles-degols opened a pull request: https://github.com/apache/kafka/pull/4069 KAFKA-6057: Users forget `--execute` in the offset reset tool You can merge this pull request into a Git repository by running: $ git pull https://github.com/gilles-degols/kafka

Re: [VOTE] 1.0.0 RC0

2017-10-12 Thread Ted Yu
bq. Internal classes which had previously been located in this package have been moved elsewhere It would be clearer to Kafka users if the relocation of org.apache.kafka.common.protocol.SecurityProtocol is mentioned explicitly. Otherwise they need to dig into the code to find out. Just my two

Re: [VOTE] 1.0.0 RC0

2017-10-12 Thread Guozhang Wang
Ted, I can found that we do have a corresponding doc change for this renaming: https://github.com/apache/kafka/pull/3863/files#diff-8100f2416b657c1e1e4238dabf8a15e0 And from the web docs: http://home.apache.org/~guozhang/kafka-1.0.0-rc0/kafka_2.11-1.0.0-site-docs.tgz I can indeed find it in

[GitHub] kafka pull request #4068: MINOR: Update JavaDoc to use new API

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4068 ---

[GitHub] kafka-site pull request #97: Port changes from PR4017 and PR3862 to 0110

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/97 ---

Re: [VOTE] 1.0.0 RC0

2017-10-12 Thread Guozhang Wang
Thanks Ted, I'm looking into this for possible doc changes now. Guozhang On Wed, Oct 11, 2017 at 3:23 PM, Ted Yu wrote: > Looks like the following change is needed for some downstream project to > compile their code (which was using 0.11.0.1): > > -import

Build failed in Jenkins: kafka-trunk-jdk7 #2886

2017-10-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Don't register signal handlers if running on Windows [damian.guy] MINOR: improve Store parameter checks -- [...truncated 366.73 KB...]

Jenkins build is back to normal : kafka-trunk-jdk8 #2132

2017-10-12 Thread Apache Jenkins Server
See

[GitHub] kafka-site pull request #97: Port changes from PR4017 and PR3862 to 0110

2017-10-12 Thread joel-hamill
GitHub user joel-hamill opened a pull request: https://github.com/apache/kafka-site/pull/97 Port changes from PR4017 and PR3862 to 0110 Port changes from https://github.com/apache/kafka/pull/4017 and https://github.com/apache/kafka/pull/3862 to 0110. @guozhangwang You

Build failed in Jenkins: kafka-trunk-jdk7 #2885

2017-10-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Update `config/consumer.properties` to have new consumer -- [...truncated 1.82 MB...] org.apache.kafka.streams.KafkaStreamsTest >

Jenkins build is back to normal : kafka-1.0-jdk7 #30

2017-10-12 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-6057) Users forget `--execute` in the offset reset tool

2017-10-12 Thread Yeva Byzek (JIRA)
Yeva Byzek created KAFKA-6057: - Summary: Users forget `--execute` in the offset reset tool Key: KAFKA-6057 URL: https://issues.apache.org/jira/browse/KAFKA-6057 Project: Kafka Issue Type:

[GitHub] kafka pull request #4063: MINOR: improve Store parameter checks

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4063 ---

[GitHub] kafka pull request #4068: MINOR: Update JavaDoc to use new API

2017-10-12 Thread bbejeck
GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/4068 MINOR: Update JavaDoc to use new API You can merge this pull request into a Git repository by running: $ git pull https://github.com/bbejeck/kafka MINOR_fix_java_doc_example_for_1_0_API

[GitHub] kafka pull request #4066: MINOR: Don't register signal handlers if running o...

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4066 ---

[GitHub] kafka pull request #4067: MINOR: Merge script improvements

2017-10-12 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4067 MINOR: Merge script improvements - Remove "list commits" since we never use it - Fix release branch detection to just look for branches that start with digits - Make script executable You

Build failed in Jenkins: kafka-1.0-jdk7 #29

2017-10-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Use port 0 in ResetIntegrationWithSslTest -- [...truncated 1.81 MB...] org.apache.kafka.streams.integration.KTableKTableJoinIntegrationTest >

Build failed in Jenkins: kafka-trunk-jdk7 #2884

2017-10-12 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Use port 0 in ResetIntegrationWithSslTest -- [...truncated 369.96 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

[GitHub] kafka pull request #4055: MINOR: Update `config/consumer.properties` to have...

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4055 ---

[GitHub] kafka pull request #4065: MINOR: Use OS-assigned port, in case 9092 is alrea...

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4065 ---

[GitHub] kafka pull request #4052: KAFKA-6046 DeleteRecordsRequest to a non-leader sh...

2017-10-12 Thread tedyu
Github user tedyu closed the pull request at: https://github.com/apache/kafka/pull/4052 ---

Re: [VOTE] 1.0.0 RC0

2017-10-12 Thread Ismael Juma
See inline. On Thu, Oct 12, 2017 at 6:43 AM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > > > [2017-10-11 21:45:11,642] FATAL (kafka.Kafka$) > java.lang.IllegalArgumentException: Unknown signal: HUP > at sun.misc.Signal.(Unknown Source) > at

[GitHub] kafka pull request #4066: MINOR: Don't register signal handlers if running o...

2017-10-12 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4066 MINOR: Don't register signal handlers if running on Windows Also remove stray printStackTrace in test. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request #4065: MINOR: Use OS-assigned port, in case 9092 is alrea...

2017-10-12 Thread tombentley
GitHub user tombentley opened a pull request: https://github.com/apache/kafka/pull/4065 MINOR: Use OS-assigned port, in case 9092 is already bound I found this by running the tests while I happened to have a kafka broker running. @mjsax please could you review? You can

Jenkins build is back to normal : kafka-trunk-jdk8 #2130

2017-10-12 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-trunk-jdk7 #2882

2017-10-12 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-6053) NoSuchMethodError when creating ProducerRecord in upgrade system tests

2017-10-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6053. Resolution: Fixed Fix Version/s: 1.1.0 1.0.0 > NoSuchMethodError when

[GitHub] kafka pull request #4058: MINOR: Fixed format string

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4058 ---

[GitHub] kafka pull request #4062: KAFKA-6055: Fix a typo in JVM configuration of Win...

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4062 ---

Re: [VOTE] KIP-201: Rationalising policy interfaces

2017-10-12 Thread Edoardo Comar
Thanks Tom with the last additions (changes to the protocol) it now supersedes KIP-170 +1 non-binding -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Tom Bentley To: dev@kafka.apache.org

[GitHub] kafka pull request #4057: KAFKA-6053: Fix NoSuchMethodError when creating Pr...

2017-10-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4057 ---

Re: [VOTE] KIP-201: Rationalising policy interfaces

2017-10-12 Thread Mickael Maison
Thanks for driving this! +1 (non binding) On Wed, Oct 11, 2017 at 9:21 AM, Tom Bentley wrote: > I would like to start a vote on KIP-201, which proposes to replace the > existing policy interfaces with a single new policy interface that also > extends policy support to

Kafka Connect Source questions

2017-10-12 Thread Stephane Maarek
Hi, I had a look at the Connect Source Worker code and have two questions: When a Source Task commits offsets, does it perform compaction / optimisation before sending off? E.g.  I read from 1 source partition, and I read 1000 messages. Will the offset flush send 1000 messages to the offset