date:20181008

[jira] [Resolved] (KAFKA-7215) Improve LogCleaner behavior on error

2018-10-08 Thread Jun Rao (JIRA)



 [ 
https://issues.apache.org/jira/browse/KAFKA-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jun Rao resolved KAFKA-7215.

   Resolution: Fixed
Fix Version/s: 2.1.0

Merged to 2.1 and trunk.

> Improve LogCleaner behavior on error
> 
>
> Key: KAFKA-7215
> URL: https://issues.apache.org/jira/browse/KAFKA-7215
> Project: Kafka
>  Issue Type: Improvement
>Reporter: Stanislav Kozlovski
>Assignee: Stanislav Kozlovski
>Priority: Minor
> Fix For: 2.1.0
>
>
> For more detailed information see 
> [KIP-346|https://cwiki.apache.org/confluence/display/KAFKA/KIP-346+-+Improve+LogCleaner+behavior+on+error]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: kafka-trunk-jdk8 #3087

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3578, done.
remote: Counting objects:   0% (1/3578)   remote: Counting objects:   
1% (36/3578)   remote: Counting objects:   2% (72/3578)   
remote: Counting objects:   3% (108/3578)   remote: Counting objects:   
4% (144/3578)   remote: Counting objects:   5% (179/3578)   
remote: Counting objects:   6% (215/3578)   remote: Counting objects:   
7% (251/3578)   remote: Counting objects:   8% (287/3578)   
remote: Counting objects:   9% (323/3578)   remote: Counting objects:  
10% (358/3578)   remote: Counting objects:  11% (394/3578)   
remote: Counting objects:  12% (430/3578)   remote: Counting objects:  
13% (466/3578)   remote: Counting objects:  14% (501/3578)   
remote: Counting objects:  15% (537/3578)   remote: Counting objects:  
16% (573/3578)   remote: Counting objects:  17% (609/3578)   
remote: Counting objects:  18% (645/3578)   remote: Counting objects:  
19% (680/3578)   remote: Counting objects:  20% (716/3578)   
remote: Counting objects:  21% (752/3578)   remote: Counting objects:  
22% (788/3578)   remote: Counting objects:  23% (823/3578)   
remote: Counting objects:  24% (859/3578)   remote: Counting objects:  
25% (895/3578)   remote: Counting objects:  26% (931/3578)   
remote: Counting objects:  27% (967/3578)   remote: Counting objects:  
28% (1002/3578)   remote: Counting objects:  29% (1038/3578)   
remote: Counting objects:  30% (1074/3578)   remote: Counting objects:  
31% (1110/3578)   remote: Counting objects:  32% (1145/3578)   
remote: Counting objects:  33% (1181/3578)   remote: Counting objects:  
34% (1217/3578)   remote: Counting objects:  35% (1253/3578)   
remote: Counting objects:  36% (1289/3578)   remote: Counting objects:  
37% (1324/3578)   remote: Counting objects:  38% (1360/3578)   
remote: Counting objects:  39% (1396/3578)   remote: Counting objects:  
40% (1432/3578)   remote: Counting objects:  41% (1467/3578)   
remote: Counting objects:  42% (1503/3578)   remote: Counting objects:  
43% (1539/3578)   remote: Counting objects:  44% (1575/3578)   
remote: Counting objects:  45% (1611/3578)   remote: Counting objects:  
46% (1646/3578)   remote: Counting objects:  47% (1682/3578)   
remote: Counting objects:  48% (1718/3578)   remote: Counting objects:  
49% (1754/3578)   remote: Counting objects:  50% (1789/3578)   
remote: Counting objects:  51% (1825/3578)   remote: Counting objects:  
52% (1861/3578)   remote: Counting objects:  53% (1897/3578)   
remote: Counting objects:  54% (1933/3578)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #607

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 42f07849917fadb444802add590e7bb9ca4f6ba2
error: Could not read a9692ff66fccc96ccf95526682136cddb5af0627
remote: Enumerating objects: 3599, done.
remote: Counting objects:   0% (1/3599)   remote: Counting objects:   
1% (36/3599)   remote: Counting objects:   2% (72/3599)   
remote: Counting objects:   3% (108/3599)   remote: Counting objects:   
4% (144/3599)   remote: Counting objects:   5% (180/3599)   
remote: Counting objects:   6% (216/3599)   remote: Counting objects:   
7% (252/3599)   remote: Counting objects:   8% (288/3599)   
remote: Counting objects:   9% (324/3599)   remote: Counting objects:  
10% (360/3599)   remote: Counting objects:  11% (396/3599)   
remote: Counting objects:  12% (432/3599)   remote: Counting objects:  
13% (468/3599)   remote: Counting objects:  14% (504/3599)   
remote: Counting objects:  15% (540/3599)   remote: Counting objects:  
16% (576/3599)   remote: Counting objects:  17% (612/3599)   
remote: Counting objects:  18% (648/3599)   remote: Counting objects:  
19% (684/3599)   remote: Counting objects:  20% (720/3599)   
remote: Counting objects:  21% (756/3599)   remote: Counting objects:  
22% (792/3599)   remote: Counting objects:  23% (828/3599)   
remote: Counting objects:  24% (864/3599)   remote: Counting objects:  
25% (900/3599)   remote: Counting objects:  26% (936/3599)   
remote: Counting objects:  27% (972/3599)   remote: Counting objects:  
28% (1008/3599)   remote: Counting objects:  29% (1044/3599)   
remote: Counting objects:  30% (1080/3599)   remote: Counting objects:  
31% (1116/3599)   remote: Counting objects:  32% (1152/3599)   
remote: Counting objects:  33% (1188/3599)   remote: Counting objects:  
34% (1224/3599)   remote: Counting objects:  35% (1260/3599)   
remote: Counting objects:  36% (1296/3599)   remote: Counting objects:  
37% (1332/3599)   remote: Counting objects:  38% (1368/3599)   
remote: Counting objects:  39% (1404/3599)   remote: Counting objects:  
40% (1440/3599)   remote: Counting objects:  41% (1476/3599)   
remote: Counting objects:  42% (1512/3599)   remote: Counting objects:  
43% (1548/3599)   remote: Counting objects:  44% (1584/3599)   
remote: Counting objects:  45% (1620/3599)   remote: Counting objects:  
46% (1656/3599)   remote: Counting objects:  47% (1692/3599)   
remote: Counting objects:  48% (1728/3599)   remote: Counting objects:  
49% (1764/3599)   remote: Counting objects:  50% (1800/3599)   
remote: Counting objects:  51% (1836/3599)   remote: Counting objects:  
52% (1872/3599)   remote: Counting objects:  53% (1908/3599)   
remote: Counting objects:  54% (1944/3599)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk8 #3086

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H32 (ubuntu xenial) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 379211134740268b570fc8edd59ae78df0dffee9
remote: Enumerating objects: 4574, done.
remote: Counting objects:   0% (1/4574)   remote: Counting objects:   
1% (46/4574)   remote: Counting objects:   2% (92/4574)   
remote: Counting objects:   3% (138/4574)   remote: Counting objects:   
4% (183/4574)   remote: Counting objects:   5% (229/4574)   
remote: Counting objects:   6% (275/4574)   remote: Counting objects:   
7% (321/4574)   remote: Counting objects:   8% (366/4574)   
remote: Counting objects:   9% (412/4574)   remote: Counting objects:  
10% (458/4574)   remote: Counting objects:  11% (504/4574)   
remote: Counting objects:  12% (549/4574)   remote: Counting objects:  
13% (595/4574)   remote: Counting objects:  14% (641/4574)   
remote: Counting objects:  15% (687/4574)   remote: Counting objects:  
16% (732/4574)   remote: Counting objects:  17% (778/4574)   
remote: Counting objects:  18% (824/4574)   remote: Counting objects:  
19% (870/4574)   remote: Counting objects:  20% (915/4574)   
remote: Counting objects:  21% (961/4574)   remote: Counting objects:  
22% (1007/4574)   remote: Counting objects:  23% (1053/4574)   
remote: Counting objects:  24% (1098/4574)   remote: Counting objects:  
25% (1144/4574)   remote: Counting objects:  26% (1190/4574)   
remote: Counting objects:  27% (1235/4574)   remote: Counting objects:  
28% (1281/4574)   remote: Counting objects:  29% (1327/4574)   
remote: Counting objects:  30% (1373/4574)   remote: Counting objects:  
31% (1418/4574)   remote: Counting objects:  32% (1464/4574)   
remote: Counting objects:  33% (1510/4574)   remote: Counting objects:  
34% (1556/4574)   remote: Counting objects:  35% (1601/4574)   
remote: Counting objects:  36% (1647/4574)   remote: Counting objects:  
37% (1693/4574)   remote: Counting objects:  38% (1739/4574)   
remote: Counting objects:  39% (1784/4574)   remote: Counting objects:  
40% (1830/4574)   remote: Counting objects:  41% (1876/4574)   
remote: Counting objects:  42% (1922/4574)   remote: Counting objects:  
43% (1967/4574)   remote: Counting objects:  44% (2013/4574)   
remote: Counting objects:  45% (2059/4574)   remote: Counting objects:  
46% (2105/4574)   remote: Counting objects:  47% (2150/4574)   
remote: Counting objects:  48% (2196/4574)   remote: Counting objects:  
49% (2242/4574)   remote: Counting objects:  50% (2287/4574)   
remote: Counting objects:  51% (2333/4574)   remote: Counting objects:  
52% (2379/4574)   remote: Counting objects:  53% (2425/4574)   
remote: Counting objects:  54% (2470/4574)   remote: Counting objects:  
55% (2516/4574)   remote: Counting objects:  56%

Build failed in Jenkins: kafka-trunk-jdk10 #606

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H31 (ubuntu xenial) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 4866c33ac309ba5cc098a02948253f55a83666a3
error: Could not read 379211134740268b570fc8edd59ae78df0dffee9
error: Could not read c7eee92ca0fe618da749d636179aacf9bc5b58a2
error: Could not read b74e7e407c0b065adf68bc45042063def922aa10
error: Could not read f26377352d14af38af5d6cf42531b940fafe7236
remote: Enumerating objects: 3498, done.
remote: Counting objects:   0% (1/3498)   remote: Counting objects:   
1% (35/3498)   remote: Counting objects:   2% (70/3498)   
remote: Counting objects:   3% (105/3498)   remote: Counting objects:   
4% (140/3498)   remote: Counting objects:   5% (175/3498)   
remote: Counting objects:   6% (210/3498)   remote: Counting objects:   
7% (245/3498)   remote: Counting objects:   8% (280/3498)   
remote: Counting objects:   9% (315/3498)   remote: Counting objects:  
10% (350/3498)   remote: Counting objects:  11% (385/3498)   
remote: Counting objects:  12% (420/3498)   remote: Counting objects:  
13% (455/3498)   remote: Counting objects:  14% (490/3498)   
remote: Counting objects:  15% (525/3498)   remote: Counting objects:  
16% (560/3498)   remote: Counting objects:  17% (595/3498)   
remote: Counting objects:  18% (630/3498)   remote: Counting objects:  
19% (665/3498)   remote: Counting objects:  20% (700/3498)   
remote: Counting objects:  21% (735/3498)   remote: Counting objects:  
22% (770/3498)   remote: Counting objects:  23% (805/3498)   
remote: Counting objects:  24% (840/3498)   remote: Counting objects:  
25% (875/3498)   remote: Counting objects:  26% (910/3498)   
remote: Counting objects:  27% (945/3498)   remote: Counting objects:  
28% (980/3498)   remote: Counting objects:  29% (1015/3498)   
remote: Counting objects:  30% (1050/3498)   remote: Counting objects:  
31% (1085/3498)   remote: Counting objects:  32% (1120/3498)   
remote: Counting objects:  33% (1155/3498)   remote: Counting objects:  
34% (1190/3498)   remote: Counting objects:  35% (1225/3498)   
remote: Counting objects:  36% (1260/3498)   remote: Counting objects:  
37% (1295/3498)   remote: Counting objects:  38% (1330/3498)   
remote: Counting objects:  39% (1365/3498)   remote: Counting objects:  
40% (1400/3498)   remote: Counting objects:  41% (1435/3498)   
remote: Counting objects:  42% (1470/3498)   remote: Counting objects:  
43% (1505/3498)   remote: Counting objects:  44% (1540/3498)   
remote: Counting objects:  45% (1575/3498)   remote: Counting objects:  
46% (1610/3498)   remote: Counting objects:  47% (1645/3498)   
remote: Counting objects:  48% (1680/3498)   remote: Counting objects:  
49% (1715/3498)   remote: Counting objects:  50% (1749/3498)   
remote: Counting objects:  51% (1784/3498)

[jira] [Created] (KAFKA-7492) Explain `null` handling for reduce and aggregate

2018-10-08 Thread Matthias J. Sax (JIRA)

Matthias J. Sax created KAFKA-7492:
--

 Summary: Explain `null` handling for reduce and aggregate
 Key: KAFKA-7492
 URL: https://issues.apache.org/jira/browse/KAFKA-7492
 Project: Kafka
  Issue Type: Improvement
  Components: documentation, streams
Reporter: Matthias J. Sax


We currently don't explain how records with `null` value are handled in reduce 
and aggregate. In particular, what happens when the users' aggregation/reduce 
`apply()` implementation returns `null`.

We should update the JavaDocs accordingly and maybe also update the docs on the 
web page.

Cf. 
https://stackoverflow.com/questions/52692202/what-happens-if-the-aggregator-of-a-kgroupedstream-returns-null



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: kafka-trunk-jdk8 #3085

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H32 (ubuntu xenial) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 379211134740268b570fc8edd59ae78df0dffee9
remote: Enumerating objects: 4574, done.
remote: Counting objects:   0% (1/4574)   remote: Counting objects:   
1% (46/4574)   remote: Counting objects:   2% (92/4574)   
remote: Counting objects:   3% (138/4574)   remote: Counting objects:   
4% (183/4574)   remote: Counting objects:   5% (229/4574)   
remote: Counting objects:   6% (275/4574)   remote: Counting objects:   
7% (321/4574)   remote: Counting objects:   8% (366/4574)   
remote: Counting objects:   9% (412/4574)   remote: Counting objects:  
10% (458/4574)   remote: Counting objects:  11% (504/4574)   
remote: Counting objects:  12% (549/4574)   remote: Counting objects:  
13% (595/4574)   remote: Counting objects:  14% (641/4574)   
remote: Counting objects:  15% (687/4574)   remote: Counting objects:  
16% (732/4574)   remote: Counting objects:  17% (778/4574)   
remote: Counting objects:  18% (824/4574)   remote: Counting objects:  
19% (870/4574)   remote: Counting objects:  20% (915/4574)   
remote: Counting objects:  21% (961/4574)   remote: Counting objects:  
22% (1007/4574)   remote: Counting objects:  23% (1053/4574)   
remote: Counting objects:  24% (1098/4574)   remote: Counting objects:  
25% (1144/4574)   remote: Counting objects:  26% (1190/4574)   
remote: Counting objects:  27% (1235/4574)   remote: Counting objects:  
28% (1281/4574)   remote: Counting objects:  29% (1327/4574)   
remote: Counting objects:  30% (1373/4574)   remote: Counting objects:  
31% (1418/4574)   remote: Counting objects:  32% (1464/4574)   
remote: Counting objects:  33% (1510/4574)   remote: Counting objects:  
34% (1556/4574)   remote: Counting objects:  35% (1601/4574)   
remote: Counting objects:  36% (1647/4574)   remote: Counting objects:  
37% (1693/4574)   remote: Counting objects:  38% (1739/4574)   
remote: Counting objects:  39% (1784/4574)   remote: Counting objects:  
40% (1830/4574)   remote: Counting objects:  41% (1876/4574)   
remote: Counting objects:  42% (1922/4574)   remote: Counting objects:  
43% (1967/4574)   remote: Counting objects:  44% (2013/4574)   
remote: Counting objects:  45% (2059/4574)   remote: Counting objects:  
46% (2105/4574)   remote: Counting objects:  47% (2150/4574)   
remote: Counting objects:  48% (2196/4574)   remote: Counting objects:  
49% (2242/4574)   remote: Counting objects:  50% (2287/4574)   
remote: Counting objects:  51% (2333/4574)   remote: Counting objects:  
52% (2379/4574)   remote: Counting objects:  53% (2425/4574)   
remote: Counting objects:  54% (2470/4574)   remote: Counting objects:  
55% (2516/4574)   remote: Counting objects:  56%

Re: [VOTE] KIP-291: Have separate queues for control requests and data requests

2018-10-08 Thread Jun Rao

Hi, Lucas,

Yes, the new names sound good to me.

Thanks,

Jun

On Fri, Oct 5, 2018 at 1:12 PM, Lucas Wang  wrote:

> Thanks for the suggestion, Ismael. I like it.
>
> Jun,
> I'm excited to get the +1, thanks a lot!
> Meanwhile what do you feel about renaming the metrics and config to
>
> ControlPlaneRequestQueueSize
>
> ControlPlaneNetworkProcessorIdlePercent
>
> ControlPlaneRequestHandlerIdlePercent
>
> control.plane.listener.name
>
> ?
>
>
> Thanks,
>
> Lucas
>
> On Thu, Oct 4, 2018 at 11:38 AM Ismael Juma  wrote:
>
> > Have we considered control plane if we think control by itself is
> > ambiguous? I agree with the original concern that "controller" may be
> > confusing for something that affects all brokers.
> >
> > Ismael
> >
> >
> > On 4 Oct 2018 11:08 am, "Lucas Wang"  wrote:
> >
> > Thanks Jun. I've changed the KIP with the suggested 2 step upgrade.
> > Please take a look again when you have time.
> >
> > Regards,
> > Lucas
> >
> >
> > On Thu, Oct 4, 2018 at 10:06 AM Jun Rao  wrote:
> >
> > > Hi, Lucas,
> > >
> > > 200. That's a valid concern. So, we can probably just keep the current
> > > name.
> > >
> > > 201. I am thinking that you would upgrade in the same way as changing
> > > inter.broker.listener.name. This requires 2 rounds of rolling restart.
> > In
> > > the first round, we add the controller endpoint to the listeners w/o
> > > setting controller.listener.name. In the second round, every broker
> sets
> > > controller.listener.name. At that point, the controller listener is
> > ready
> > > in every broker.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > > On Tue, Oct 2, 2018 at 10:38 AM, Lucas Wang 
> > wrote:
> > >
> > > > Thanks for the further comments, Jun.
> > > >
> > > > 200. Currently in the code base, we have the term of "ControlBatch"
> > > related
> > > > to
> > > > idempotent/transactional producing. Do you think it's a concern for
> > > reusing
> > > > the term "control"?
> > > >
> > > > 201. It's not clear to me how it would work by following the same
> > > strategy
> > > > for "controller.listener.name".
> > > > Say the new controller has its "controller.listener.name" set to the
> > > value
> > > > "CONTROLLER", and broker 1
> > > > has picked up this KIP by announcing
> > > > "endpoints": [
> > > > "CONTROLLER://broker1.example.com:9091",
> > > > "INTERNAL://broker1.example.com:9092",
> > > > "EXTERNAL://host1.example.com:9093"
> > > > ],
> > > >
> > > > while broker2 has not picked up the change, and is announcing
> > > > "endpoints": [
> > > > "INTERNAL://broker2.example.com:9092",
> > > > "EXTERNAL://host2.example.com:9093"
> > > > ],
> > > > to support both broker 1 for the new behavior and broker 2 for the
> old
> > > > behavior, it seems the controller must
> > > > check their published endpoints. Am I missing something?
> > > >
> > > > Thanks!
> > > > Lucas
> > > >
> > > > On Mon, Oct 1, 2018 at 6:29 PM Jun Rao  wrote:
> > > >
> > > > > Hi, Lucas,
> > > > >
> > > > > Sorry for the delay. The updated wiki looks good to me overall.
> Just
> > a
> > > > > couple more minor comments.
> > > > >
> > > > > 200.
> > kafka.network:name=ControllerRequestQueueSize,type=RequestChannel:
> > > > The
> > > > > name ControllerRequestQueueSize gives the impression that it's only
> > for
> > > > the
> > > > > controller broker. Perhaps we can just rename all metrics and
> configs
> > > > from
> > > > > controller to control. This indicates that the threads and the
> queues
> > > are
> > > > > for the control requests (as oppose to data requests).
> > > > >
> > > > > 201. ": In this scenario, the
> controller
> > > will
> > > > > have the "controller.listener.name" config set to a value like
> > > > > "CONTROLLER", however the broker's exposed endpoints do not have an
> > > entry
> > > > > corresponding to the new listener name. Hence the controller should
> > > > > preserve the existing behavior by determining the endpoint using
> > > > > *inter-broker-listener-name *value. The end result should be the
> same
> > > > > behavior as today." Currently, the controller makes connections
> based
> > > on
> > > > > its local inter.broker.listener.name config without checking the
> > > target
> > > > > broker's ZK registration. For consistency, perhaps we can just
> follow
> > > the
> > > > > same strategy for controller.listener.name. This existing behavior
> > > seems
> > > > > simpler to understand and has the benefit of catching inconsistent
> > > > configs
> > > > > across brokers.
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Jun
> > > > >
> > > > > On Mon, Oct 1, 2018 at 8:43 AM, Lucas Wang 
> > > > wrote:
> > > > >
> > > > > > Hi Jun,
> > > > > >
> > > > > > Sorry to bother you again. Can you please take a look at the wiki
> > > again
> > > > > > when you have time?
> > > > > >
> > > > > > Thanks a lot!
> > > > > > Lucas
> > > > > >
> > > > > > On Wed, Sep 19, 2018 at 3:57 PM Lucas Wang <
> lucasatu...@gmail.com>
> > > > > wrote:
> >

Build failed in Jenkins: kafka-trunk-jdk10 #605

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H30 (ubuntu xenial) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 379211134740268b570fc8edd59ae78df0dffee9
error: Could not read 57d7f11e38e41892191f6fe87faae8f23aa0362e
remote: Enumerating objects: 4596, done.
remote: Counting objects:   0% (1/4596)   remote: Counting objects:   
1% (46/4596)   remote: Counting objects:   2% (92/4596)   
remote: Counting objects:   3% (138/4596)   remote: Counting objects:   
4% (184/4596)   remote: Counting objects:   5% (230/4596)   
remote: Counting objects:   6% (276/4596)   remote: Counting objects:   
7% (322/4596)   remote: Counting objects:   8% (368/4596)   
remote: Counting objects:   9% (414/4596)   remote: Counting objects:  
10% (460/4596)   remote: Counting objects:  11% (506/4596)   
remote: Counting objects:  12% (552/4596)   remote: Counting objects:  
13% (598/4596)   remote: Counting objects:  14% (644/4596)   
remote: Counting objects:  15% (690/4596)   remote: Counting objects:  
16% (736/4596)   remote: Counting objects:  17% (782/4596)   
remote: Counting objects:  18% (828/4596)   remote: Counting objects:  
19% (874/4596)   remote: Counting objects:  20% (920/4596)   
remote: Counting objects:  21% (966/4596)   remote: Counting objects:  
22% (1012/4596)   remote: Counting objects:  23% (1058/4596)   
remote: Counting objects:  24% (1104/4596)   remote: Counting objects:  
25% (1149/4596)   remote: Counting objects:  26% (1195/4596)   
remote: Counting objects:  27% (1241/4596)   remote: Counting objects:  
28% (1287/4596)   remote: Counting objects:  29% (1333/4596)   
remote: Counting objects:  30% (1379/4596)   remote: Counting objects:  
31% (1425/4596)   remote: Counting objects:  32% (1471/4596)   
remote: Counting objects:  33% (1517/4596)   remote: Counting objects:  
34% (1563/4596)   remote: Counting objects:  35% (1609/4596)   
remote: Counting objects:  36% (1655/4596)   remote: Counting objects:  
37% (1701/4596)   remote: Counting objects:  38% (1747/4596)   
remote: Counting objects:  39% (1793/4596)   remote: Counting objects:  
40% (1839/4596)   remote: Counting objects:  41% (1885/4596)   
remote: Counting objects:  42% (1931/4596)   remote: Counting objects:  
43% (1977/4596)   remote: Counting objects:  44% (2023/4596)   
remote: Counting objects:  45% (2069/4596)   remote: Counting objects:  
46% (2115/4596)   remote: Counting objects:  47% (2161/4596)   
remote: Counting objects:  48% (2207/4596)   remote: Counting objects:  
49% (2253/4596)   remote: Counting objects:  50% (2298/4596)   
remote: Counting objects:  51% (2344/4596)   remote: Counting objects:  
52% (2390/4596)   remote: Counting objects:  53% (2436/4596)   
remote: Counting objects:  54% (2482/4596)   remote: Counting objects:

Re: [DISCUSS] KIP-378: Enable Dependency Injection for Kafka Streams handlers

2018-10-08 Thread Guozhang Wang

John, thanks for the explanation, now it makes much more sense to me.

As for the concrete approach, to me it seems the first option requires less
changes than the second (ConfiguredStreamsFactory based) approach, whereas
the second one requires an additional interface that is overlapping with
the AbstractConfig.

I'm aware that in KafkaProducer / KafkaConsumer we do not have public
constructors for taking a ProducerConfig or ConsumerConfig directly, and
anyone using Spring can share how you've worked around it by far? If it is
very awkward I'm not against just adding the XXXConfigs to the constructors
directly.

Guozhang

On Fri, Oct 5, 2018 at 1:48 PM, John Roesler  wrote:

> Hi Wladimir,
>
> Thanks for the KIP!
>
> As I mentioned in the PR discussion, I personally prefer not to recommend
> overriding StreamsConfig for this purpose.
>
> It seems like a person wishing to create a DI shim would have to acquire
> quite a deep understanding of the class and its usage to figure out what
> exactly to override to accomplish their goals without breaking everything.
> I'm honestly impressed with the method you came up with to create your
> Spring/Streams shim.
>
> I think we can make to path for the next person smoother by going with
> something more akin to the ConfiguredStreamsFactory. This is a constrained
> interface that tells you exactly what you have to implement to create such
> a shim.
>
> A few thoughts:
> 1. it seems like we can keep all the deprecated constructors still
> deprecated
>
> 2. we could add just one additional constructor to each of KafkaStreams and
> TopologyTestDriver to still take a Properties, but also your new
> ConfiguredStreamsFactory
>
> 3. I don't know if I'm sold on the name ConfiguredStreamsFactory, since it
> does not produce configured streams. Instead, it produces configured
> instances... How about ConfiguredInstanceFactory?
>
> 4. if I understand the usage correctly, it's actually a pretty small number
> of classes that we actually make via getConfiguredInstance. Offhand, I can
> think of the key/value Serdes, the deserialization exception handler, and
> the production exception handler.
> Perhaps, instead of maintaining a generic "class instantiator", we could
> explore a factory interface that just has methods for creating exactly the
> kinds of things we need to create. In fact, we already have something like
> this: org.apache.kafka.streams.KafkaClientSupplier . Do you think we could
> just add some more methods to that interface (and maybe rename it) instead?
>
> Thanks,
> -John
>
> On Fri, Oct 5, 2018 at 3:31 PM John Roesler  wrote:
>
> > Hi Guozhang,
> >
> > I'm going to drop in a little extra context from the preliminary PR
> > discussion (https://github.com/apache/kafka/pull/5344).
> >
> > The issue isn't that it's impossible to use Streams within a Spring app,
> > just that the interplay between our style of construction/configuration
> and
> > Spring's is somewhat awkward compared to the normal experience with
> > dependency injection.
> >
> > I'm guessing users of dependency injection would not like the approach
> you
> > offered. I believe it's commonly considered an antipattern when using DI
> > frameworks to pass the injector directly into the class being
> constructed.
> > Wladimir has also offered an alternative usage within the current
> framework
> > of injecting pre-constructed dependencies into the Properties, and then
> > retrieving and casting them inside the configured class.
> >
> > It seems like this KIP is more about offering a more elegant interface to
> > DI users.
> >
> > One of the points that Wladimir raised on his PR discussion was the
> desire
> > to configure the classes in a typesafe way in the constructor (thus
> > allowing the use of immutable classes).
> >
> > With this KIP, it would be possible for a DI user to:
> > 1. register a Streams-Spring or Streams-Guice (etc) "plugin" (via either
> > of the mechanisms he proposed)
> > 2. simply make the Serdes, exception handlers, etc, available on the
> class
> > path with the DI annotations
> > 3. start the app
> >
> > There's no need to mess with passing dependencies (or the injector)
> > through the properties.
> >
> > Sorry for "injecting" myself into your discussion, but it took me a while
> > in the PR discussion to get to the bottom of the issue, and I wanted to
> > spare you the same.
> >
> > I'll respond separately with my feedback on the KIP.
> >
> > Thanks,
> > -John
> >
> > On Sun, Sep 30, 2018 at 2:31 PM Guozhang Wang 
> wrote:
> >
> >> Hello Wladimir,
> >>
> >> Thanks for proposing the KIP. I think the injection can currently be
> done
> >> by passing in the key/value pair directly into the properties which can
> >> then be accessed from the `ProcessorContext#appConfigs` or
> >> `#appConfigsWithPrefix`. For example, when constructing the properties
> you
> >> can:
> >>
> >> ```
> >> props.put(myProp1, myValue1);
> >> props.put(myProp2, myValue1);
> >>

Build failed in Jenkins: kafka-trunk-jdk8 #3084

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3578, done.
remote: Counting objects:   0% (1/3578)   remote: Counting objects:   
1% (36/3578)   remote: Counting objects:   2% (72/3578)   
remote: Counting objects:   3% (108/3578)   remote: Counting objects:   
4% (144/3578)   remote: Counting objects:   5% (179/3578)   
remote: Counting objects:   6% (215/3578)   remote: Counting objects:   
7% (251/3578)   remote: Counting objects:   8% (287/3578)   
remote: Counting objects:   9% (323/3578)   remote: Counting objects:  
10% (358/3578)   remote: Counting objects:  11% (394/3578)   
remote: Counting objects:  12% (430/3578)   remote: Counting objects:  
13% (466/3578)   remote: Counting objects:  14% (501/3578)   
remote: Counting objects:  15% (537/3578)   remote: Counting objects:  
16% (573/3578)   remote: Counting objects:  17% (609/3578)   
remote: Counting objects:  18% (645/3578)   remote: Counting objects:  
19% (680/3578)   remote: Counting objects:  20% (716/3578)   
remote: Counting objects:  21% (752/3578)   remote: Counting objects:  
22% (788/3578)   remote: Counting objects:  23% (823/3578)   
remote: Counting objects:  24% (859/3578)   remote: Counting objects:  
25% (895/3578)   remote: Counting objects:  26% (931/3578)   
remote: Counting objects:  27% (967/3578)   remote: Counting objects:  
28% (1002/3578)   remote: Counting objects:  29% (1038/3578)   
remote: Counting objects:  30% (1074/3578)   remote: Counting objects:  
31% (1110/3578)   remote: Counting objects:  32% (1145/3578)   
remote: Counting objects:  33% (1181/3578)   remote: Counting objects:  
34% (1217/3578)   remote: Counting objects:  35% (1253/3578)   
remote: Counting objects:  36% (1289/3578)   remote: Counting objects:  
37% (1324/3578)   remote: Counting objects:  38% (1360/3578)   
remote: Counting objects:  39% (1396/3578)   remote: Counting objects:  
40% (1432/3578)   remote: Counting objects:  41% (1467/3578)   
remote: Counting objects:  42% (1503/3578)   remote: Counting objects:  
43% (1539/3578)   remote: Counting objects:  44% (1575/3578)   
remote: Counting objects:  45% (1611/3578)   remote: Counting objects:  
46% (1646/3578)   remote: Counting objects:  47% (1682/3578)   
remote: Counting objects:  48% (1718/3578)   remote: Counting objects:  
49% (1754/3578)   remote: Counting objects:  50% (1789/3578)   
remote: Counting objects:  51% (1825/3578)   remote: Counting objects:  
52% (1861/3578)   remote: Counting objects:  53% (1897/3578)   
remote: Counting objects:  54% (1933/3578)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #604

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 42f07849917fadb444802add590e7bb9ca4f6ba2
error: Could not read a9692ff66fccc96ccf95526682136cddb5af0627
remote: Enumerating objects: 3599, done.
remote: Counting objects:   0% (1/3599)   remote: Counting objects:   
1% (36/3599)   remote: Counting objects:   2% (72/3599)   
remote: Counting objects:   3% (108/3599)   remote: Counting objects:   
4% (144/3599)   remote: Counting objects:   5% (180/3599)   
remote: Counting objects:   6% (216/3599)   remote: Counting objects:   
7% (252/3599)   remote: Counting objects:   8% (288/3599)   
remote: Counting objects:   9% (324/3599)   remote: Counting objects:  
10% (360/3599)   remote: Counting objects:  11% (396/3599)   
remote: Counting objects:  12% (432/3599)   remote: Counting objects:  
13% (468/3599)   remote: Counting objects:  14% (504/3599)   
remote: Counting objects:  15% (540/3599)   remote: Counting objects:  
16% (576/3599)   remote: Counting objects:  17% (612/3599)   
remote: Counting objects:  18% (648/3599)   remote: Counting objects:  
19% (684/3599)   remote: Counting objects:  20% (720/3599)   
remote: Counting objects:  21% (756/3599)   remote: Counting objects:  
22% (792/3599)   remote: Counting objects:  23% (828/3599)   
remote: Counting objects:  24% (864/3599)   remote: Counting objects:  
25% (900/3599)   remote: Counting objects:  26% (936/3599)   
remote: Counting objects:  27% (972/3599)   remote: Counting objects:  
28% (1008/3599)   remote: Counting objects:  29% (1044/3599)   
remote: Counting objects:  30% (1080/3599)   remote: Counting objects:  
31% (1116/3599)   remote: Counting objects:  32% (1152/3599)   
remote: Counting objects:  33% (1188/3599)   remote: Counting objects:  
34% (1224/3599)   remote: Counting objects:  35% (1260/3599)   
remote: Counting objects:  36% (1296/3599)   remote: Counting objects:  
37% (1332/3599)   remote: Counting objects:  38% (1368/3599)   
remote: Counting objects:  39% (1404/3599)   remote: Counting objects:  
40% (1440/3599)   remote: Counting objects:  41% (1476/3599)   
remote: Counting objects:  42% (1512/3599)   remote: Counting objects:  
43% (1548/3599)   remote: Counting objects:  44% (1584/3599)   
remote: Counting objects:  45% (1620/3599)   remote: Counting objects:  
46% (1656/3599)   remote: Counting objects:  47% (1692/3599)   
remote: Counting objects:  48% (1728/3599)   remote: Counting objects:  
49% (1764/3599)   remote: Counting objects:  50% (1800/3599)   
remote: Counting objects:  51% (1836/3599)   remote: Counting objects:  
52% (1872/3599)   remote: Counting objects:  53% (1908/3599)   
remote: Counting objects:  54% (1944/3599)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk8 #3083

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3578, done.
remote: Counting objects:   0% (1/3578)   remote: Counting objects:   
1% (36/3578)   remote: Counting objects:   2% (72/3578)   
remote: Counting objects:   3% (108/3578)   remote: Counting objects:   
4% (144/3578)   remote: Counting objects:   5% (179/3578)   
remote: Counting objects:   6% (215/3578)   remote: Counting objects:   
7% (251/3578)   remote: Counting objects:   8% (287/3578)   
remote: Counting objects:   9% (323/3578)   remote: Counting objects:  
10% (358/3578)   remote: Counting objects:  11% (394/3578)   
remote: Counting objects:  12% (430/3578)   remote: Counting objects:  
13% (466/3578)   remote: Counting objects:  14% (501/3578)   
remote: Counting objects:  15% (537/3578)   remote: Counting objects:  
16% (573/3578)   remote: Counting objects:  17% (609/3578)   
remote: Counting objects:  18% (645/3578)   remote: Counting objects:  
19% (680/3578)   remote: Counting objects:  20% (716/3578)   
remote: Counting objects:  21% (752/3578)   remote: Counting objects:  
22% (788/3578)   remote: Counting objects:  23% (823/3578)   
remote: Counting objects:  24% (859/3578)   remote: Counting objects:  
25% (895/3578)   remote: Counting objects:  26% (931/3578)   
remote: Counting objects:  27% (967/3578)   remote: Counting objects:  
28% (1002/3578)   remote: Counting objects:  29% (1038/3578)   
remote: Counting objects:  30% (1074/3578)   remote: Counting objects:  
31% (1110/3578)   remote: Counting objects:  32% (1145/3578)   
remote: Counting objects:  33% (1181/3578)   remote: Counting objects:  
34% (1217/3578)   remote: Counting objects:  35% (1253/3578)   
remote: Counting objects:  36% (1289/3578)   remote: Counting objects:  
37% (1324/3578)   remote: Counting objects:  38% (1360/3578)   
remote: Counting objects:  39% (1396/3578)   remote: Counting objects:  
40% (1432/3578)   remote: Counting objects:  41% (1467/3578)   
remote: Counting objects:  42% (1503/3578)   remote: Counting objects:  
43% (1539/3578)   remote: Counting objects:  44% (1575/3578)   
remote: Counting objects:  45% (1611/3578)   remote: Counting objects:  
46% (1646/3578)   remote: Counting objects:  47% (1682/3578)   
remote: Counting objects:  48% (1718/3578)   remote: Counting objects:  
49% (1754/3578)   remote: Counting objects:  50% (1789/3578)   
remote: Counting objects:  51% (1825/3578)   remote: Counting objects:  
52% (1861/3578)   remote: Counting objects:  53% (1897/3578)   
remote: Counting objects:  54% (1933/3578)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #603

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 42f07849917fadb444802add590e7bb9ca4f6ba2
error: Could not read a9692ff66fccc96ccf95526682136cddb5af0627
remote: Enumerating objects: 3599, done.
remote: Counting objects:   0% (1/3599)   remote: Counting objects:   
1% (36/3599)   remote: Counting objects:   2% (72/3599)   
remote: Counting objects:   3% (108/3599)   remote: Counting objects:   
4% (144/3599)   remote: Counting objects:   5% (180/3599)   
remote: Counting objects:   6% (216/3599)   remote: Counting objects:   
7% (252/3599)   remote: Counting objects:   8% (288/3599)   
remote: Counting objects:   9% (324/3599)   remote: Counting objects:  
10% (360/3599)   remote: Counting objects:  11% (396/3599)   
remote: Counting objects:  12% (432/3599)   remote: Counting objects:  
13% (468/3599)   remote: Counting objects:  14% (504/3599)   
remote: Counting objects:  15% (540/3599)   remote: Counting objects:  
16% (576/3599)   remote: Counting objects:  17% (612/3599)   
remote: Counting objects:  18% (648/3599)   remote: Counting objects:  
19% (684/3599)   remote: Counting objects:  20% (720/3599)   
remote: Counting objects:  21% (756/3599)   remote: Counting objects:  
22% (792/3599)   remote: Counting objects:  23% (828/3599)   
remote: Counting objects:  24% (864/3599)   remote: Counting objects:  
25% (900/3599)   remote: Counting objects:  26% (936/3599)   
remote: Counting objects:  27% (972/3599)   remote: Counting objects:  
28% (1008/3599)   remote: Counting objects:  29% (1044/3599)   
remote: Counting objects:  30% (1080/3599)   remote: Counting objects:  
31% (1116/3599)   remote: Counting objects:  32% (1152/3599)   
remote: Counting objects:  33% (1188/3599)   remote: Counting objects:  
34% (1224/3599)   remote: Counting objects:  35% (1260/3599)   
remote: Counting objects:  36% (1296/3599)   remote: Counting objects:  
37% (1332/3599)   remote: Counting objects:  38% (1368/3599)   
remote: Counting objects:  39% (1404/3599)   remote: Counting objects:  
40% (1440/3599)   remote: Counting objects:  41% (1476/3599)   
remote: Counting objects:  42% (1512/3599)   remote: Counting objects:  
43% (1548/3599)   remote: Counting objects:  44% (1584/3599)   
remote: Counting objects:  45% (1620/3599)   remote: Counting objects:  
46% (1656/3599)   remote: Counting objects:  47% (1692/3599)   
remote: Counting objects:  48% (1728/3599)   remote: Counting objects:  
49% (1764/3599)   remote: Counting objects:  50% (1800/3599)   
remote: Counting objects:  51% (1836/3599)   remote: Counting objects:  
52% (1872/3599)   remote: Counting objects:  53% (1908/3599)   
remote: Counting objects:  54% (1944/3599)   remote: Counting objects:

Re: [DISCUSSION] KIP-376: Implement AutoClosable on appropriate classes that has close()

2018-10-08 Thread Yishun Guan

Hi All,

I started a vote on this KIP on another email thread, but it didn't
generate responses. So I decided to start a vote on this thread. Thanks!
Link: https://www.zhihu.com/question/21491539

Best
Yishun

On Thu, Oct 4, 2018 at 11:37 PM Chia-Ping Tsai  wrote:

> > However, it's a good hint, that `AutoClosable#close()` declares `throws
> > Exception` and thus, it seems to be a backward incompatible change.
> > Hence, I am not sure if we can actually move forward easily with this
> KIP.
>
> It is legal to remove declaration of "throwing Exception" from a class
> which extend AutoClosable, so method signature won't be changed. Hence it
> should be fine to backward compatibility.
>
> On 2018/09/30 20:19:57, "Matthias J. Sax"  wrote:
> > Closeable is part of `java.io` while AutoClosable is part of
> > `java.lang`. Thus, the second one is more generic. Also, JavaDoc points
> > out that `Closable#close()` must be idempotent while
> > `AutoClosable#close()` can have side effects.
> >
> > Thus, I am not sure atm which one suits better.
> >
> > However, it's a good hint, that `AutoClosable#close()` declares `throws
> > Exception` and thus, it seems to be a backward incompatible change.
> > Hence, I am not sure if we can actually move forward easily with this
> KIP.
> >
> > Nit: `RecordCollectorImpl` is an internal class that implements
> > `RecordCollector` -- should `RecordCollector extends AutoCloseable`?
> >
> >
> > -Matthias
> >
> >
> > On 9/27/18 7:46 PM, Chia-Ping Tsai wrote:
> > >> (Although I am not quite sure
> > >> when one is more desirable than the other)
> > >
> > > Most kafka's classes implementing Closeable/AutoCloseable doesn't
> throw checked exception in close() method. Perhaps we should have a
> "KafkaCloseable" interface which has a close() method without throwing any
> checked exception...
> > >
> > > On 2018/09/27 19:11:20, Yishun Guan  wrote:
> > >> Hi All,
> > >>
> > >> Chia-Ping, I agree, similar to VarifiableConsumer, VarifiableProducer
> > >> should be implementing Closeable as well (Although I am not quite sure
> > >> when one is more desirable than the other), also I just looked through
> > >> your list - these are some great additions, I will add them to the
> > >> list.
> > >>
> > >> Thanks,
> > >> Yishun
> > >> On Thu, Sep 27, 2018 at 3:26 AM Dongjin Lee 
> wrote:
> > >>>
> > >>> Hi Yishun,
> > >>>
> > >>> Thank you for your great KIP. In fact, I have also encountered the
> cases
> > >>> where Autoclosable is so desired several times! Let me inspect more
> > >>> candidate classes as well.
> > >>>
> > >>> +1. I also refined your KIP a little bit.
> > >>>
> > >>> Best,
> > >>> Dongjin
> > >>>
> > >>> On Thu, Sep 27, 2018 at 12:21 PM Chia-Ping Tsai 
> wrote:
> > >>>
> >  hi Yishun
> > 
> >  Thanks for nice KIP!
> > 
> >  Q1)
> >  Why VerifiableProducer extend Closeable rather than AutoCloseable?
> > 
> >  Q2)
> >  I grep project and then noticed there are other close methods but
> do not
> >  implement AutoCloseable.
> >  For example:
> >  1) WorkerConnector
> >  2) MemoryRecordsBuilder
> >  3) MetricsReporter
> >  4) ExpiringCredentialRefreshingLogin
> >  5) KafkaChannel
> >  6) ConsumerInterceptor
> >  7) SelectorMetrics
> >  8) HeartbeatThread
> > 
> >  Cheers,
> >  Chia-Ping
> > 
> > 
> >  On 2018/09/26 23:44:31, Yishun Guan  wrote:
> > > Hi All,
> > >
> > > Here is a trivial KIP:
> > >
> > 
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=93325308
> > >
> > > Suggestions are welcome.
> > >
> > > Thanks,
> > > Yishun
> > >
> > 
> > >>>
> > >>>
> > >>> --
> > >>> *Dongjin Lee*
> > >>>
> > >>> *A hitchhiker in the mathematical world.*
> > >>>
> > >>> *github:  github.com/dongjinleekr
> > >>> linkedin:
> kr.linkedin.com/in/dongjinleekr
> > >>> slideshare:
> > >>> www.slideshare.net/dongjinleekr
> > >>> *
> > >>
> >
> >
>

Build failed in Jenkins: kafka-trunk-jdk8 #3082

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3559, done.
remote: Counting objects:   0% (1/3559)   remote: Counting objects:   
1% (36/3559)   remote: Counting objects:   2% (72/3559)   
remote: Counting objects:   3% (107/3559)   remote: Counting objects:   
4% (143/3559)   remote: Counting objects:   5% (178/3559)   
remote: Counting objects:   6% (214/3559)   remote: Counting objects:   
7% (250/3559)   remote: Counting objects:   8% (285/3559)   
remote: Counting objects:   9% (321/3559)   remote: Counting objects:  
10% (356/3559)   remote: Counting objects:  11% (392/3559)   
remote: Counting objects:  12% (428/3559)   remote: Counting objects:  
13% (463/3559)   remote: Counting objects:  14% (499/3559)   
remote: Counting objects:  15% (534/3559)   remote: Counting objects:  
16% (570/3559)   remote: Counting objects:  17% (606/3559)   
remote: Counting objects:  18% (641/3559)   remote: Counting objects:  
19% (677/3559)   remote: Counting objects:  20% (712/3559)   
remote: Counting objects:  21% (748/3559)   remote: Counting objects:  
22% (783/3559)   remote: Counting objects:  23% (819/3559)   
remote: Counting objects:  24% (855/3559)   remote: Counting objects:  
25% (890/3559)   remote: Counting objects:  26% (926/3559)   
remote: Counting objects:  27% (961/3559)   remote: Counting objects:  
28% (997/3559)   remote: Counting objects:  29% (1033/3559)   
remote: Counting objects:  30% (1068/3559)   remote: Counting objects:  
31% (1104/3559)   remote: Counting objects:  32% (1139/3559)   
remote: Counting objects:  33% (1175/3559)   remote: Counting objects:  
34% (1211/3559)   remote: Counting objects:  35% (1246/3559)   
remote: Counting objects:  36% (1282/3559)   remote: Counting objects:  
37% (1317/3559)   remote: Counting objects:  38% (1353/3559)   
remote: Counting objects:  39% (1389/3559)   remote: Counting objects:  
40% (1424/3559)   remote: Counting objects:  41% (1460/3559)   
remote: Counting objects:  42% (1495/3559)   remote: Counting objects:  
43% (1531/3559)   remote: Counting objects:  44% (1566/3559)   
remote: Counting objects:  45% (1602/3559)   remote: Counting objects:  
46% (1638/3559)   remote: Counting objects:  47% (1673/3559)   
remote: Counting objects:  48% (1709/3559)   remote: Counting objects:  
49% (1744/3559)   remote: Counting objects:  50% (1780/3559)   
remote: Counting objects:  51% (1816/3559)   remote: Counting objects:  
52% (1851/3559)   remote: Counting objects:  53% (1887/3559)   
remote: Counting objects:  54% (1922/3559)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #602

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 42f07849917fadb444802add590e7bb9ca4f6ba2
error: Could not read a9692ff66fccc96ccf95526682136cddb5af0627
remote: Enumerating objects: 3580, done.
remote: Counting objects:   0% (1/3580)   remote: Counting objects:   
1% (36/3580)   remote: Counting objects:   2% (72/3580)   
remote: Counting objects:   3% (108/3580)   remote: Counting objects:   
4% (144/3580)   remote: Counting objects:   5% (179/3580)   
remote: Counting objects:   6% (215/3580)   remote: Counting objects:   
7% (251/3580)   remote: Counting objects:   8% (287/3580)   
remote: Counting objects:   9% (323/3580)   remote: Counting objects:  
10% (358/3580)   remote: Counting objects:  11% (394/3580)   
remote: Counting objects:  12% (430/3580)   remote: Counting objects:  
13% (466/3580)   remote: Counting objects:  14% (502/3580)   
remote: Counting objects:  15% (537/3580)   remote: Counting objects:  
16% (573/3580)   remote: Counting objects:  17% (609/3580)   
remote: Counting objects:  18% (645/3580)   remote: Counting objects:  
19% (681/3580)   remote: Counting objects:  20% (716/3580)   
remote: Counting objects:  21% (752/3580)   remote: Counting objects:  
22% (788/3580)   remote: Counting objects:  23% (824/3580)   
remote: Counting objects:  24% (860/3580)   remote: Counting objects:  
25% (895/3580)   remote: Counting objects:  26% (931/3580)   
remote: Counting objects:  27% (967/3580)   remote: Counting objects:  
28% (1003/3580)   remote: Counting objects:  29% (1039/3580)   
remote: Counting objects:  30% (1074/3580)   remote: Counting objects:  
31% (1110/3580)   remote: Counting objects:  32% (1146/3580)   
remote: Counting objects:  33% (1182/3580)   remote: Counting objects:  
34% (1218/3580)   remote: Counting objects:  35% (1253/3580)   
remote: Counting objects:  36% (1289/3580)   remote: Counting objects:  
37% (1325/3580)   remote: Counting objects:  38% (1361/3580)   
remote: Counting objects:  39% (1397/3580)   remote: Counting objects:  
40% (1432/3580)   remote: Counting objects:  41% (1468/3580)   
remote: Counting objects:  42% (1504/3580)   remote: Counting objects:  
43% (1540/3580)   remote: Counting objects:  44% (1576/3580)   
remote: Counting objects:  45% (1611/3580)   remote: Counting objects:  
46% (1647/3580)   remote: Counting objects:  47% (1683/3580)   
remote: Counting objects:  48% (1719/3580)   remote: Counting objects:  
49% (1755/3580)   remote: Counting objects:  50% (1790/3580)   
remote: Counting objects:  51% (1826/3580)   remote: Counting objects:  
52% (1862/3580)   remote: Counting objects:  53% (1898/3580)   
remote: Counting objects:  54% (1934/3580)   remote: Counting objects:

[jira] [Resolved] (KAFKA-7478) Reduce OAuthBearerLoginModule verbosity

2018-10-08 Thread Rajini Sivaram (JIRA)



 [ 
https://issues.apache.org/jira/browse/KAFKA-7478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajini Sivaram resolved KAFKA-7478.
---
   Resolution: Fixed
Fix Version/s: 2.2.0

> Reduce OAuthBearerLoginModule verbosity
> ---
>
> Key: KAFKA-7478
> URL: https://issues.apache.org/jira/browse/KAFKA-7478
> Project: Kafka
>  Issue Type: Improvement
>Reporter: Stanislav Kozlovski
>Assignee: Stanislav Kozlovski
>Priority: Minor
> Fix For: 2.2.0
>
>
> The OAuthBearerLoginModule is pretty verbose by default and this fills logs 
> in with too much information. It would be nice if we could reduce the 
> verbosity by default and let the user opt in to inspect these debug-friendly 
> messages
> {code:java}
> [INFO] 2018-10-03 16:58:11,986 [qtp1137078855-1798] 
> org.apache.kafka.common.security.oauthbearer.OAuthBearerLoginModule login - 
> Login succeeded; invoke commit() to commit it; current committed token 
> count=0 
> [INFO] 2018-10-03 16:58:11,986 [qtp1137078855-1798] 
> org.apache.kafka.common.security.oauthbearer.OAuthBearerLoginModule commit - 
> Committing my token; current committed token count = 0 
> [INFO] 2018-10-03 16:58:11,986 [qtp1137078855-1798] 
> org.apache.kafka.common.security.oauthbearer.OAuthBearerLoginModule commit - 
> Done committing my token; committed token count is now 1
> [INFO] 2018-10-03 16:58:11,986 [qtp1137078855-1798] 
> org.apache.kafka.common.security.oauthbearer.internals.expiring.ExpiringCredentialRefreshingLogin
>  login - Successfully logged in.
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: kafka-trunk-jdk8 #3081

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3529, done.
remote: Counting objects:   0% (1/3529)   remote: Counting objects:   
1% (36/3529)   remote: Counting objects:   2% (71/3529)   
remote: Counting objects:   3% (106/3529)   remote: Counting objects:   
4% (142/3529)   remote: Counting objects:   5% (177/3529)   
remote: Counting objects:   6% (212/3529)   remote: Counting objects:   
7% (248/3529)   remote: Counting objects:   8% (283/3529)   
remote: Counting objects:   9% (318/3529)   remote: Counting objects:  
10% (353/3529)   remote: Counting objects:  11% (389/3529)   
remote: Counting objects:  12% (424/3529)   remote: Counting objects:  
13% (459/3529)   remote: Counting objects:  14% (495/3529)   
remote: Counting objects:  15% (530/3529)   remote: Counting objects:  
16% (565/3529)   remote: Counting objects:  17% (600/3529)   
remote: Counting objects:  18% (636/3529)   remote: Counting objects:  
19% (671/3529)   remote: Counting objects:  20% (706/3529)   
remote: Counting objects:  21% (742/3529)   remote: Counting objects:  
22% (777/3529)   remote: Counting objects:  23% (812/3529)   
remote: Counting objects:  24% (847/3529)   remote: Counting objects:  
25% (883/3529)   remote: Counting objects:  26% (918/3529)   
remote: Counting objects:  27% (953/3529)   remote: Counting objects:  
28% (989/3529)   remote: Counting objects:  29% (1024/3529)   
remote: Counting objects:  30% (1059/3529)   remote: Counting objects:  
31% (1094/3529)   remote: Counting objects:  32% (1130/3529)   
remote: Counting objects:  33% (1165/3529)   remote: Counting objects:  
34% (1200/3529)   remote: Counting objects:  35% (1236/3529)   
remote: Counting objects:  36% (1271/3529)   remote: Counting objects:  
37% (1306/3529)   remote: Counting objects:  38% (1342/3529)   
remote: Counting objects:  39% (1377/3529)   remote: Counting objects:  
40% (1412/3529)   remote: Counting objects:  41% (1447/3529)   
remote: Counting objects:  42% (1483/3529)   remote: Counting objects:  
43% (1518/3529)   remote: Counting objects:  44% (1553/3529)   
remote: Counting objects:  45% (1589/3529)   remote: Counting objects:  
46% (1624/3529)   remote: Counting objects:  47% (1659/3529)   
remote: Counting objects:  48% (1694/3529)   remote: Counting objects:  
49% (1730/3529)   remote: Counting objects:  50% (1765/3529)   
remote: Counting objects:  51% (1800/3529)   remote: Counting objects:  
52% (1836/3529)   remote: Counting objects:  53% (1871/3529)   
remote: Counting objects:  54% (1906/3529)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #601

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 42f07849917fadb444802add590e7bb9ca4f6ba2
error: Could not read a9692ff66fccc96ccf95526682136cddb5af0627
remote: Enumerating objects: 3538, done.
remote: Counting objects:   0% (1/3538)   remote: Counting objects:   
1% (36/3538)   remote: Counting objects:   2% (71/3538)   
remote: Counting objects:   3% (107/3538)   remote: Counting objects:   
4% (142/3538)   remote: Counting objects:   5% (177/3538)   
remote: Counting objects:   6% (213/3538)   remote: Counting objects:   
7% (248/3538)   remote: Counting objects:   8% (284/3538)   
remote: Counting objects:   9% (319/3538)   remote: Counting objects:  
10% (354/3538)   remote: Counting objects:  11% (390/3538)   
remote: Counting objects:  12% (425/3538)   remote: Counting objects:  
13% (460/3538)   remote: Counting objects:  14% (496/3538)   
remote: Counting objects:  15% (531/3538)   remote: Counting objects:  
16% (567/3538)   remote: Counting objects:  17% (602/3538)   
remote: Counting objects:  18% (637/3538)   remote: Counting objects:  
19% (673/3538)   remote: Counting objects:  20% (708/3538)   
remote: Counting objects:  21% (743/3538)   remote: Counting objects:  
22% (779/3538)   remote: Counting objects:  23% (814/3538)   
remote: Counting objects:  24% (850/3538)   remote: Counting objects:  
25% (885/3538)   remote: Counting objects:  26% (920/3538)   
remote: Counting objects:  27% (956/3538)   remote: Counting objects:  
28% (991/3538)   remote: Counting objects:  29% (1027/3538)   
remote: Counting objects:  30% (1062/3538)   remote: Counting objects:  
31% (1097/3538)   remote: Counting objects:  32% (1133/3538)   
remote: Counting objects:  33% (1168/3538)   remote: Counting objects:  
34% (1203/3538)   remote: Counting objects:  35% (1239/3538)   
remote: Counting objects:  36% (1274/3538)   remote: Counting objects:  
37% (1310/3538)   remote: Counting objects:  38% (1345/3538)   
remote: Counting objects:  39% (1380/3538)   remote: Counting objects:  
40% (1416/3538)   remote: Counting objects:  41% (1451/3538)   
remote: Counting objects:  42% (1486/3538)   remote: Counting objects:  
43% (1522/3538)   remote: Counting objects:  44% (1557/3538)   
remote: Counting objects:  45% (1593/3538)   remote: Counting objects:  
46% (1628/3538)   remote: Counting objects:  47% (1663/3538)   
remote: Counting objects:  48% (1699/3538)   remote: Counting objects:  
49% (1734/3538)   remote: Counting objects:  50% (1769/3538)   
remote: Counting objects:  51% (1805/3538)   remote: Counting objects:  
52% (1840/3538)   remote: Counting objects:  53% (1876/3538)   
remote: Counting objects:  54% (1911/3538)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk8 #3080

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H32 (ubuntu xenial) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 379211134740268b570fc8edd59ae78df0dffee9
remote: Enumerating objects: 4515, done.
remote: Counting objects:   0% (1/4515)   remote: Counting objects:   
1% (46/4515)   remote: Counting objects:   2% (91/4515)   
remote: Counting objects:   3% (136/4515)   remote: Counting objects:   
4% (181/4515)   remote: Counting objects:   5% (226/4515)   
remote: Counting objects:   6% (271/4515)   remote: Counting objects:   
7% (317/4515)   remote: Counting objects:   8% (362/4515)   
remote: Counting objects:   9% (407/4515)   remote: Counting objects:  
10% (452/4515)   remote: Counting objects:  11% (497/4515)   
remote: Counting objects:  12% (542/4515)   remote: Counting objects:  
13% (587/4515)   remote: Counting objects:  14% (633/4515)   
remote: Counting objects:  15% (678/4515)   remote: Counting objects:  
16% (723/4515)   remote: Counting objects:  17% (768/4515)   
remote: Counting objects:  18% (813/4515)   remote: Counting objects:  
19% (858/4515)   remote: Counting objects:  20% (903/4515)   
remote: Counting objects:  21% (949/4515)   remote: Counting objects:  
22% (994/4515)   remote: Counting objects:  23% (1039/4515)   
remote: Counting objects:  24% (1084/4515)   remote: Counting objects:  
25% (1129/4515)   remote: Counting objects:  26% (1174/4515)   
remote: Counting objects:  27% (1220/4515)   remote: Counting objects:  
28% (1265/4515)   remote: Counting objects:  29% (1310/4515)   
remote: Counting objects:  30% (1355/4515)   remote: Counting objects:  
31% (1400/4515)   remote: Counting objects:  32% (1445/4515)   
remote: Counting objects:  33% (1490/4515)   remote: Counting objects:  
34% (1536/4515)   remote: Counting objects:  35% (1581/4515)   
remote: Counting objects:  36% (1626/4515)   remote: Counting objects:  
37% (1671/4515)   remote: Counting objects:  38% (1716/4515)   
remote: Counting objects:  39% (1761/4515)   remote: Counting objects:  
40% (1806/4515)   remote: Counting objects:  41% (1852/4515)   
remote: Counting objects:  42% (1897/4515)   remote: Counting objects:  
43% (1942/4515)   remote: Counting objects:  44% (1987/4515)   
remote: Counting objects:  45% (2032/4515)   remote: Counting objects:  
46% (2077/4515)   remote: Counting objects:  47% (2123/4515)   
remote: Counting objects:  48% (2168/4515)   remote: Counting objects:  
49% (2213/4515)   remote: Counting objects:  50% (2258/4515)   
remote: Counting objects:  51% (2303/4515)   remote: Counting objects:  
52% (2348/4515)   remote: Counting objects:  53% (2393/4515)   
remote: Counting objects:  54% (2439/4515)   remote: Counting objects:  
55% (2484/4515)   remote: Counting objects:  56%

Build failed in Jenkins: kafka-trunk-jdk10 #600

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H30 (ubuntu xenial) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 379211134740268b570fc8edd59ae78df0dffee9
error: Could not read 57d7f11e38e41892191f6fe87faae8f23aa0362e
remote: Enumerating objects: 4537, done.
remote: Counting objects:   0% (1/4537)   remote: Counting objects:   
1% (46/4537)   remote: Counting objects:   2% (91/4537)   
remote: Counting objects:   3% (137/4537)   remote: Counting objects:   
4% (182/4537)   remote: Counting objects:   5% (227/4537)   
remote: Counting objects:   6% (273/4537)   remote: Counting objects:   
7% (318/4537)   remote: Counting objects:   8% (363/4537)   
remote: Counting objects:   9% (409/4537)   remote: Counting objects:  
10% (454/4537)   remote: Counting objects:  11% (500/4537)   
remote: Counting objects:  12% (545/4537)   remote: Counting objects:  
13% (590/4537)   remote: Counting objects:  14% (636/4537)   
remote: Counting objects:  15% (681/4537)   remote: Counting objects:  
16% (726/4537)   remote: Counting objects:  17% (772/4537)   
remote: Counting objects:  18% (817/4537)   remote: Counting objects:  
19% (863/4537)   remote: Counting objects:  20% (908/4537)   
remote: Counting objects:  21% (953/4537)   remote: Counting objects:  
22% (999/4537)   remote: Counting objects:  23% (1044/4537)   
remote: Counting objects:  24% (1089/4537)   remote: Counting objects:  
25% (1135/4537)   remote: Counting objects:  26% (1180/4537)   
remote: Counting objects:  27% (1225/4537)   remote: Counting objects:  
28% (1271/4537)   remote: Counting objects:  29% (1316/4537)   
remote: Counting objects:  30% (1362/4537)   remote: Counting objects:  
31% (1407/4537)   remote: Counting objects:  32% (1452/4537)   
remote: Counting objects:  33% (1498/4537)   remote: Counting objects:  
34% (1543/4537)   remote: Counting objects:  35% (1588/4537)   
remote: Counting objects:  36% (1634/4537)   remote: Counting objects:  
37% (1679/4537)   remote: Counting objects:  38% (1725/4537)   
remote: Counting objects:  39% (1770/4537)   remote: Counting objects:  
40% (1815/4537)   remote: Counting objects:  41% (1861/4537)   
remote: Counting objects:  42% (1906/4537)   remote: Counting objects:  
43% (1951/4537)   remote: Counting objects:  44% (1997/4537)   
remote: Counting objects:  45% (2042/4537)   remote: Counting objects:  
46% (2088/4537)   remote: Counting objects:  47% (2133/4537)   
remote: Counting objects:  48% (2178/4537)   remote: Counting objects:  
49% (2224/4537)   remote: Counting objects:  50% (2269/4537)   
remote: Counting objects:  51% (2314/4537)   remote: Counting objects:  
52% (2360/4537)   remote: Counting objects:  53% (2405/4537)   
remote: Counting objects:  54% (2450/4537)   remote: Counting objects:

Re: [VOTE] KIP-349 Priorities for Source Topics

2018-10-08 Thread Thomas Becker

Well my (perhaps flawed) understanding of topic priorities is that lower 
priority topics are not consumed as long as higher priority ones have 
unconsumed messages (which means our position < HW). So if I'm doing this 
manually, I have to make some determination as to whether my high priority 
topic partitions are at the HW before I can decide if I want to poll the lower 
priority ones. Right?

On Fri, 2018-10-05 at 11:34 -0700, Colin McCabe wrote:

On Fri, Oct 5, 2018, at 10:58, Thomas Becker wrote:

Colin,

Would you mind sharing your vision for how this looks with multiple

consumers? I'm still getting my bearings with the new consumer but it's

not immediately obvious to me how this would work.


Hi Thomas,


I was just responding to the general idea that you would have some kind of 
control topic that you wanted to read with very low latency, and some kind of 
set of data topics where the latency requirements are less strict.  In that 
case, you can just have two consumers: one for the low-latency topic, and one 
for the less low-latency topics.


There's a lot of things in this picture that are unclear.  Does the data in one 
set of topics have any relation to the data in the other?  Why do we want a 
control channel distinct from the data channel?  That's why I asked for 
clarification on the use-case.


In particular, it doesn't seem particularly easy to know when you are at the 
high

watermark of a topic.


KafkaConsumer#committed will return the last committed offset for a partition.  
However, I'm not sure I understand why you want this information in this case-- 
can you expand a bit on this?


best,

Colin




-Tommy


On Mon, 2018-10-01 at 13:43 -0700, Colin McCabe wrote:


Hi all,



I feel like the DISCUSS thread didn't really come to a conclusion, so a

vote would be premature here.



In particular, I still don't really understand the use-case for this

feature.  Can someone give a concrete scenario where you would need

this?  The control plane / data plane example that is listed in the KIP

doesn't require this feature.  You can just have one consumer for the

control plane, and one for the data plane, and do priority that way.

The discussion feels kind of unfocused since we haven't identified even

one concrete use-case that needs this feature.



Unfortunately, this is a feature which consumes server-side memory.  We

have to store the priorities somehow when doing incremental fetch

requests.  If we go with an int as suggested, then this is at least 4

bytes per partition per incremental fetch request.  It also makes it

more complex and potentially slower to maintain the linked list of

partitions in the fetch requests.  Before we think about this, I'd like

to have a concrete use-case in mind, so that we can evaluate the costs

versus benefits.



best,


Colin




On Mon, Oct 1, 2018, at 07:47, Dongjin Lee wrote:


Great. +1 (non-binding)



On Mon, Oct 1, 2018 at 4:23 AM Matthias J. Sax

mailto:matth...@confluent.io>>>


wrote:



+1 (binding)



As Dongjin pointed out, the community is working on upcoming 2.1


release, and thus it might take some time until people find time to


follow up on this an vote.




-Matthias



On 9/30/18 11:11 AM, 
n...@afshartous.com>
 wrote:



On Sep 30, 2018, at 5:16 AM, Dongjin Lee

mailto:dong...@apache.org>>>
 wrote:



1. Your KIP document


<


https://cwiki.apache.org/confluence/display/KAFKA/KIP-349%3A+Priorities+for+Source+Topics


<


https://cwiki.apache.org/confluence/display/KAFKA/KIP-349%3A+Priorities+for+Source+Topics



lacks hyperlink to the discussion thread. And I couldn`t find the


discussion thread from the mailing archive.




Hi Dongjin,



There has been a discussion thread.  I added this link as a reference



  https://lists.apache.org/list.html?dev@kafka.apache.org:lte=1M:kip-349






to the KIP-349 page




https://cwiki.apache.org/confluence/display/KAFKA/KIP-349%3A+Priorities+for+Source+Topics


<


https://cwiki.apache.org/confluence/display/KAFKA/KIP-349:+Priorities+for+Source+Topics




Best,


--


  Nick







--


*Dongjin Lee*



*A hitchhiker in the mathematical world.*



*github:  github.com/dongjinleekr


linkedin: kr.linkedin.com/in/dongjinleekr


slideshare:


www.slideshare.net/dongjinleekr>


*





This email and any attachments may contain confidential and privileged

material for the sole use of the intended recipient. Any review,

copying, or

Jenkins build is back to normal : kafka-trunk-jdk8 #3079

2018-10-08 Thread Apache Jenkins Server

See

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2018-10-08 Thread John Roesler

Hi Vito,

I'm glad to hear you're well again!

I didn't follow the addition of a new method to the QueryableStoreType
interface. Can you elaborate why this is necessary to support the new
exception types?

Also, looking over your KIP again, it seems valuable to introduce
"retriable store exception" and "fatal store exception" marker interfaces
that the various exceptions can mix in. It would be nice from a usability
perspective to be able to just log and retry on any "retriable" exception
and log and shutdown on any fatal exception.

Thanks,
-John

On Fri, Oct 5, 2018 at 11:47 AM Guozhang Wang  wrote:

> Thanks for the explanation, that makes sense.
>
>
> Guozhang
>
>
> On Mon, Jun 25, 2018 at 2:28 PM, Matthias J. Sax 
> wrote:
>
> > The scenario I had I mind was, that KS is started in one thread while a
> > second thread has a reference to the object to issue queries.
> >
> > If a query is issue before the "main thread" started KS, and the "query
> > thread" knows that it will eventually get started, it can retry. On the
> > other hand, if KS is in state PENDING_SHUTDOWN or DEAD, it is impossible
> > to issue any query against it now or in the future and thus the error is
> > not retryable.
> >
> >
> > -Matthias
> >
> > On 6/25/18 10:15 AM, Guozhang Wang wrote:
> > > I'm wondering if StreamThreadNotStarted could be merged into
> > > StreamThreadNotRunning, because I think users' handling logic for the
> > third
> > > case would be likely the same as the second. Do you have some scenarios
> > > where users may want to handle them differently?
> > >
> > > Guozhang
> > >
> > > On Sun, Jun 24, 2018 at 5:25 PM, Matthias J. Sax <
> matth...@confluent.io>
> > > wrote:
> > >
> > >> Sorry to hear! Get well soon!
> > >>
> > >> It's not a big deal if the KIP stalls a little bit. Feel free to pick
> it
> > >> up again when you find time.
> > >>
> > > Is `StreamThreadNotRunningException` really an retryable error?
> > 
> >  When KafkaStream state is REBALANCING, I think it is a retryable
> > error.
> > 
> >  StreamThreadStateStoreProvider#stores() will throw
> >  StreamThreadNotRunningException when StreamThread state is not
> > >> RUNNING. The
> >  user can retry until KafkaStream state is RUNNING.
> > >>
> > >> I see. If this is the intention, than I would suggest to have two (or
> > >> maybe three) different exceptions:
> > >>
> > >>  - StreamThreadRebalancingException (retryable)
> > >>  - StreamThreadNotRunning (not retryable -- thrown if in state
> > >> PENDING_SHUTDOWN or DEAD
> > >>  - maybe StreamThreadNotStarted (for state CREATED)
> > >>
> > >> The last one is tricky and could also be merged into one of the first
> > >> two, depending if you want to argue that it's retryable or not. (Just
> > >> food for though -- not sure what others think.)
> > >>
> > >>
> > >>
> > >> -Matthias
> > >>
> > >> On 6/22/18 8:06 AM, vito jeng wrote:
> > >>> Matthias,
> > >>>
> > >>> Thank you for your assistance.
> > >>>
> >  what is the status of this KIP?
> > >>>
> > >>> Unfortunately, there is no further progress.
> > >>> About seven weeks ago, I was injured in sports. I had a broken wrist
> on
> > >>> my left wrist.
> > >>> Many jobs are affected, including this KIP and implementation.
> > >>>
> > >>>
> >  I just re-read it, and have a couple of follow up comments. Why do
> we
> >  discuss the internal exceptions you want to add? Also, do we really
> > need
> >  them? Can't we just throw the correct exception directly instead of
> >  wrapping it later?
> > >>>
> > >>> I think you may be right. As I say in the previous:
> > >>> "The original idea is that we can distinguish different state store
> > >>> exception for different handling. But to be honest, I am not quite
> sure
> > >>> this is necessary. Maybe have some change during implementation."
> > >>>
> > >>> During the implementation, I also feel we maybe not need wrapper it.
> > >>> We can just throw the correctly directly.
> > >>>
> > >>>
> >  Is `StreamThreadNotRunningException` really an retryable error?
> > >>>
> > >>> When KafkaStream state is REBALANCING, I think it is a retryable
> error.
> > >>>
> > >>> StreamThreadStateStoreProvider#stores() will throw
> > >>> StreamThreadNotRunningException when StreamThread state is not
> > RUNNING.
> > >> The
> > >>> user can retry until KafkaStream state is RUNNING.
> > >>>
> > >>>
> >  When would we throw an `StateStoreEmptyException`? The semantics is
> > >>> unclear to me atm.
> > >>>
> >  When the state is RUNNING, is `StateStoreClosedException` a
> retryable
> > >>> error?
> > >>>
> > >>> These two comments will be answered in another mail.
> > >>>
> > >>>
> > >>>
> > >>> ---
> > >>> Vito
> > >>>
> > >>> On Mon, Jun 11, 2018 at 8:12 AM, Matthias J. Sax <
> > matth...@confluent.io>
> > >>> wrote:
> > >>>
> >  Vito,
> > 
> >  what is the status of this KIP?
> > 
> >  I just re-read it, and have a couple of follow up comments. Why do
> we
>

[Reviw Request][Doc] KAFKA-7413: Replace slave terminology

2018-10-08 Thread Sayat Satybaldiyev

Dear all,

I've made a small PR to Kafka documentation to replace a slave terminology.
Thanks to John Roesler he already reviewed it. Could anyone from
maintainers take a look at it and give a feedback?

https://github.com/apache/kafka/pull/5653/

Best,
Sayat

Build failed in Jenkins: kafka-trunk-jdk10 #599

2018-10-08 Thread Apache Jenkins Server

See 


Changes:

[github] KAFKA-7462: Make token optional for OAuthBearerLoginModule (#5733)

--
[...truncated 2.26 MB...]

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldFeedStoreFromGlobalKTable[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldFeedStoreFromGlobalKTable[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldCleanUpPersistentStateStoresOnClose[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldCleanUpPersistentStateStoresOnClose[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldThrowPatternNotValidForTopicNameException[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldThrowPatternNotValidForTopicNameException[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldPunctuateIfEvenTimeAdvances[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldPunctuateIfEvenTimeAdvances[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > shouldInitProcessor[Eos 
enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > shouldInitProcessor[Eos 
enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldThrowForUnknownTopic[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldThrowForUnknownTopic[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldPunctuateOnStreamsTime[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldPunctuateOnStreamsTime[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldProcessFromSourcesThatMatchMultiplePattern[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldProcessFromSourcesThatMatchMultiplePattern[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > shouldPopulateGlobalStore[Eos 
enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > shouldPopulateGlobalStore[Eos 
enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldUseSourceSpecificDeserializers[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldUseSourceSpecificDeserializers[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > shouldReturnAllStores[Eos 
enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > shouldReturnAllStores[Eos 
enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldSendRecordViaCorrectSourceTopic[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldSendRecordViaCorrectSourceTopic[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldReturnAllStoresNames[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldReturnAllStoresNames[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldProcessConsumerRecordList[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldProcessConsumerRecordList[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldUseSinkSpecificSerializers[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldUseSinkSpecificSerializers[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldFlushStoreForFirstInput[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldFlushStoreForFirstInput[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldProcessFromSourceThatMatchPattern[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldProcessFromSourceThatMatchPattern[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldUpdateStoreForNewKey[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldUpdateStoreForNewKey[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldPunctuateOnWallClockTime[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldPunctuateOnWallClockTime[Eos enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > shouldSetRecordMetadata[Eos 
enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > shouldSetRecordMetadata[Eos 
enabled = false] PASSED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldNotUpdateStoreForLargerValue[Eos enabled = false] STARTED

org.apache.kafka.streams.TopologyTestDriverTest > 
shouldNotUpdateStoreForLargerValue[Eos enabled = false] PASSED

Jenkins build is back to normal : kafka-2.1-jdk8 #7

2018-10-08 Thread Apache Jenkins Server

See

Re: [Review] - Pull request #5681 review

2018-10-08 Thread Sönke Liebau

Hi Srinivas,

thanks for your interest in contributing and the work you put into the PR!
I've looked it over and left a small comment.

In general you will probably need to be a bit patient with reviews. Kafka
is a project which a lot of people are interested in and a fairly small
group of committers, so it is hard for them to keep up with pull requests.

That being said, you did exactly the right thing in waiting a little while
and then bumping on the mailing list, just trying to manage expectations
here ;)

Best regards,
Sönke

On Mon, Oct 8, 2018 at 8:03 AM Srinivas Reddy 
wrote:

> Hi,
>
> After working on Kafka for sometime, I got motivated to start contribute to
> Kafka. As this is my first commit here thought of refactored some unit
> tests with minimal changes after going through contribution guidelines.
>
> I worked over weekend for code changes and local testing before raising the
> PR. But suprisingly no review comments on it.
>
> Here is the link my initial attempt:
> https://github.com/apache/kafka/pull/5681
>
> Please let me know if there is anything needs to be done from my side to
> get it reviewed.
>
> Thank you in advance.
>
> -
> Srinivas
>
> - Typed on tiny keys. pls ignore typos.{mobile app}
>


-- 
Sönke Liebau
Partner
Tel. +49 179 7940878
OpenCore GmbH & Co. KG - Thomas-Mann-Straße 8 - 22880 Wedel - Germany

Build failed in Jenkins: kafka-trunk-jdk8 #3078

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3516, done.
remote: Counting objects:   0% (1/3516)   remote: Counting objects:   
1% (36/3516)   remote: Counting objects:   2% (71/3516)   
remote: Counting objects:   3% (106/3516)   remote: Counting objects:   
4% (141/3516)   remote: Counting objects:   5% (176/3516)   
remote: Counting objects:   6% (211/3516)   remote: Counting objects:   
7% (247/3516)   remote: Counting objects:   8% (282/3516)   
remote: Counting objects:   9% (317/3516)   remote: Counting objects:  
10% (352/3516)   remote: Counting objects:  11% (387/3516)   
remote: Counting objects:  12% (422/3516)   remote: Counting objects:  
13% (458/3516)   remote: Counting objects:  14% (493/3516)   
remote: Counting objects:  15% (528/3516)   remote: Counting objects:  
16% (563/3516)   remote: Counting objects:  17% (598/3516)   
remote: Counting objects:  18% (633/3516)   remote: Counting objects:  
19% (669/3516)   remote: Counting objects:  20% (704/3516)   
remote: Counting objects:  21% (739/3516)   remote: Counting objects:  
22% (774/3516)   remote: Counting objects:  23% (809/3516)   
remote: Counting objects:  24% (844/3516)   remote: Counting objects:  
25% (879/3516)   remote: Counting objects:  26% (915/3516)   
remote: Counting objects:  27% (950/3516)   remote: Counting objects:  
28% (985/3516)   remote: Counting objects:  29% (1020/3516)   
remote: Counting objects:  30% (1055/3516)   remote: Counting objects:  
31% (1090/3516)   remote: Counting objects:  32% (1126/3516)   
remote: Counting objects:  33% (1161/3516)   remote: Counting objects:  
34% (1196/3516)   remote: Counting objects:  35% (1231/3516)   
remote: Counting objects:  36% (1266/3516)   remote: Counting objects:  
37% (1301/3516)   remote: Counting objects:  38% (1337/3516)   
remote: Counting objects:  39% (1372/3516)   remote: Counting objects:  
40% (1407/3516)   remote: Counting objects:  41% (1442/3516)   
remote: Counting objects:  42% (1477/3516)   remote: Counting objects:  
43% (1512/3516)   remote: Counting objects:  44% (1548/3516)   
remote: Counting objects:  45% (1583/3516)   remote: Counting objects:  
46% (1618/3516)   remote: Counting objects:  47% (1653/3516)   
remote: Counting objects:  48% (1688/3516)   remote: Counting objects:  
49% (1723/3516)   remote: Counting objects:  50% (1758/3516)   
remote: Counting objects:  51% (1794/3516)   remote: Counting objects:  
52% (1829/3516)   remote: Counting objects:  53% (1864/3516)   
remote: Counting objects:  54% (1899/3516)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #598

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on H30 (ubuntu xenial) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 379211134740268b570fc8edd59ae78df0dffee9
error: Could not read 57d7f11e38e41892191f6fe87faae8f23aa0362e
remote: Enumerating objects: 4536, done.
remote: Counting objects:   0% (1/4536)   remote: Counting objects:   
1% (46/4536)   remote: Counting objects:   2% (91/4536)   
remote: Counting objects:   3% (137/4536)   remote: Counting objects:   
4% (182/4536)   remote: Counting objects:   5% (227/4536)   
remote: Counting objects:   6% (273/4536)   remote: Counting objects:   
7% (318/4536)   remote: Counting objects:   8% (363/4536)   
remote: Counting objects:   9% (409/4536)   remote: Counting objects:  
10% (454/4536)   remote: Counting objects:  11% (499/4536)   
remote: Counting objects:  12% (545/4536)   remote: Counting objects:  
13% (590/4536)   remote: Counting objects:  14% (636/4536)   
remote: Counting objects:  15% (681/4536)   remote: Counting objects:  
16% (726/4536)   remote: Counting objects:  17% (772/4536)   
remote: Counting objects:  18% (817/4536)   remote: Counting objects:  
19% (862/4536)   remote: Counting objects:  20% (908/4536)   
remote: Counting objects:  21% (953/4536)   remote: Counting objects:  
22% (998/4536)   remote: Counting objects:  23% (1044/4536)   
remote: Counting objects:  24% (1089/4536)   remote: Counting objects:  
25% (1134/4536)   remote: Counting objects:  26% (1180/4536)   
remote: Counting objects:  27% (1225/4536)   remote: Counting objects:  
28% (1271/4536)   remote: Counting objects:  29% (1316/4536)   
remote: Counting objects:  30% (1361/4536)   remote: Counting objects:  
31% (1407/4536)   remote: Counting objects:  32% (1452/4536)   
remote: Counting objects:  33% (1497/4536)   remote: Counting objects:  
34% (1543/4536)   remote: Counting objects:  35% (1588/4536)   
remote: Counting objects:  36% (1633/4536)   remote: Counting objects:  
37% (1679/4536)   remote: Counting objects:  38% (1724/4536)   
remote: Counting objects:  39% (1770/4536)   remote: Counting objects:  
40% (1815/4536)   remote: Counting objects:  41% (1860/4536)   
remote: Counting objects:  42% (1906/4536)   remote: Counting objects:  
43% (1951/4536)   remote: Counting objects:  44% (1996/4536)   
remote: Counting objects:  45% (2042/4536)   remote: Counting objects:  
46% (2087/4536)   remote: Counting objects:  47% (2132/4536)   
remote: Counting objects:  48% (2178/4536)   remote: Counting objects:  
49% (2223/4536)   remote: Counting objects:  50% (2268/4536)   
remote: Counting objects:  51% (2314/4536)   remote: Counting objects:  
52% (2359/4536)   remote: Counting objects:  53% (2405/4536)   
remote: Counting objects:  54% (2450/4536)   remote: Counting objects:

[jira] [Created] (KAFKA-7491) Kafka streams and Kafka streams test utils have split packages

2018-10-08 Thread Robin Van Praet (JIRA)

Robin Van Praet created KAFKA-7491:
--

 Summary: Kafka streams and Kafka streams test utils have split 
packages
 Key: KAFKA-7491
 URL: https://issues.apache.org/jira/browse/KAFKA-7491
 Project: Kafka
  Issue Type: Improvement
Reporter: Robin Van Praet


When trying to test a Kafka Streams application using JDK 9+, using the module 
path, (test) compilation errors occur.

The TopologyTestDriver cannot be located in kafka-streams-test-utils because 
package 'org.apache.kafka.streams' is already provided by module kafka-streams.

Please make sure that packages are not re-used between production libraries and 
test util libraries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KAFKA-7490) Kafka libraries should have a valid module name

2018-10-08 Thread Robin Van Praet (JIRA)

Robin Van Praet created KAFKA-7490:
--

 Summary: Kafka libraries should have a valid module name
 Key: KAFKA-7490
 URL: https://issues.apache.org/jira/browse/KAFKA-7490
 Project: Kafka
  Issue Type: Improvement
Reporter: Robin Van Praet


Currently when running an application on Java's module path it is impossible to 
have kafka as an automatic module.

For example:
{code:java}

   org.apache.kafka
   kafka_2.12
   2.0.0

{code}
Will result in file kafka_2.12-2.0.0.jar 

The rules for Automatic module naming are:
 * use 'Automatic-Module-Name' value in the Manifest file as value when present
 * convert the jar filename to a module name by stripping the version and 
converting some characters to a dot.

There is no 'Automatic-Module-Name' value in the Manifest so the jar filename 
is used. However it will be converted to kafka.2.12 as module name which is not 
a valid module name.

 

Please provide a 'Automatic-Module-Name' value in the Manifest file for all 
deliverables



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: kafka-trunk-jdk8 #3077

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3516, done.
remote: Counting objects:   0% (1/3516)   remote: Counting objects:   
1% (36/3516)   remote: Counting objects:   2% (71/3516)   
remote: Counting objects:   3% (106/3516)   remote: Counting objects:   
4% (141/3516)   remote: Counting objects:   5% (176/3516)   
remote: Counting objects:   6% (211/3516)   remote: Counting objects:   
7% (247/3516)   remote: Counting objects:   8% (282/3516)   
remote: Counting objects:   9% (317/3516)   remote: Counting objects:  
10% (352/3516)   remote: Counting objects:  11% (387/3516)   
remote: Counting objects:  12% (422/3516)   remote: Counting objects:  
13% (458/3516)   remote: Counting objects:  14% (493/3516)   
remote: Counting objects:  15% (528/3516)   remote: Counting objects:  
16% (563/3516)   remote: Counting objects:  17% (598/3516)   
remote: Counting objects:  18% (633/3516)   remote: Counting objects:  
19% (669/3516)   remote: Counting objects:  20% (704/3516)   
remote: Counting objects:  21% (739/3516)   remote: Counting objects:  
22% (774/3516)   remote: Counting objects:  23% (809/3516)   
remote: Counting objects:  24% (844/3516)   remote: Counting objects:  
25% (879/3516)   remote: Counting objects:  26% (915/3516)   
remote: Counting objects:  27% (950/3516)   remote: Counting objects:  
28% (985/3516)   remote: Counting objects:  29% (1020/3516)   
remote: Counting objects:  30% (1055/3516)   remote: Counting objects:  
31% (1090/3516)   remote: Counting objects:  32% (1126/3516)   
remote: Counting objects:  33% (1161/3516)   remote: Counting objects:  
34% (1196/3516)   remote: Counting objects:  35% (1231/3516)   
remote: Counting objects:  36% (1266/3516)   remote: Counting objects:  
37% (1301/3516)   remote: Counting objects:  38% (1337/3516)   
remote: Counting objects:  39% (1372/3516)   remote: Counting objects:  
40% (1407/3516)   remote: Counting objects:  41% (1442/3516)   
remote: Counting objects:  42% (1477/3516)   remote: Counting objects:  
43% (1512/3516)   remote: Counting objects:  44% (1548/3516)   
remote: Counting objects:  45% (1583/3516)   remote: Counting objects:  
46% (1618/3516)   remote: Counting objects:  47% (1653/3516)   
remote: Counting objects:  48% (1688/3516)   remote: Counting objects:  
49% (1723/3516)   remote: Counting objects:  50% (1758/3516)   
remote: Counting objects:  51% (1794/3516)   remote: Counting objects:  
52% (1829/3516)   remote: Counting objects:  53% (1864/3516)   
remote: Counting objects:  54% (1899/3516)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #597

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 42f07849917fadb444802add590e7bb9ca4f6ba2
error: Could not read a9692ff66fccc96ccf95526682136cddb5af0627
remote: Enumerating objects: 3537, done.
remote: Counting objects:   0% (1/3537)   remote: Counting objects:   
1% (36/3537)   remote: Counting objects:   2% (71/3537)   
remote: Counting objects:   3% (107/3537)   remote: Counting objects:   
4% (142/3537)   remote: Counting objects:   5% (177/3537)   
remote: Counting objects:   6% (213/3537)   remote: Counting objects:   
7% (248/3537)   remote: Counting objects:   8% (283/3537)   
remote: Counting objects:   9% (319/3537)   remote: Counting objects:  
10% (354/3537)   remote: Counting objects:  11% (390/3537)   
remote: Counting objects:  12% (425/3537)   remote: Counting objects:  
13% (460/3537)   remote: Counting objects:  14% (496/3537)   
remote: Counting objects:  15% (531/3537)   remote: Counting objects:  
16% (566/3537)   remote: Counting objects:  17% (602/3537)   
remote: Counting objects:  18% (637/3537)   remote: Counting objects:  
19% (673/3537)   remote: Counting objects:  20% (708/3537)   
remote: Counting objects:  21% (743/3537)   remote: Counting objects:  
22% (779/3537)   remote: Counting objects:  23% (814/3537)   
remote: Counting objects:  24% (849/3537)   remote: Counting objects:  
25% (885/3537)   remote: Counting objects:  26% (920/3537)   
remote: Counting objects:  27% (955/3537)   remote: Counting objects:  
28% (991/3537)   remote: Counting objects:  29% (1026/3537)   
remote: Counting objects:  30% (1062/3537)   remote: Counting objects:  
31% (1097/3537)   remote: Counting objects:  32% (1132/3537)   
remote: Counting objects:  33% (1168/3537)   remote: Counting objects:  
34% (1203/3537)   remote: Counting objects:  35% (1238/3537)   
remote: Counting objects:  36% (1274/3537)   remote: Counting objects:  
37% (1309/3537)   remote: Counting objects:  38% (1345/3537)   
remote: Counting objects:  39% (1380/3537)   remote: Counting objects:  
40% (1415/3537)   remote: Counting objects:  41% (1451/3537)   
remote: Counting objects:  42% (1486/3537)   remote: Counting objects:  
43% (1521/3537)   remote: Counting objects:  44% (1557/3537)   
remote: Counting objects:  45% (1592/3537)   remote: Counting objects:  
46% (1628/3537)   remote: Counting objects:  47% (1663/3537)   
remote: Counting objects:  48% (1698/3537)   remote: Counting objects:  
49% (1734/3537)   remote: Counting objects:  50% (1769/3537)   
remote: Counting objects:  51% (1804/3537)   remote: Counting objects:  
52% (1840/3537)   remote: Counting objects:  53% (1875/3537)   
remote: Counting objects:  54% (1910/3537)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk8 #3076

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3516, done.
remote: Counting objects:   0% (1/3516)   remote: Counting objects:   
1% (36/3516)   remote: Counting objects:   2% (71/3516)   
remote: Counting objects:   3% (106/3516)   remote: Counting objects:   
4% (141/3516)   remote: Counting objects:   5% (176/3516)   
remote: Counting objects:   6% (211/3516)   remote: Counting objects:   
7% (247/3516)   remote: Counting objects:   8% (282/3516)   
remote: Counting objects:   9% (317/3516)   remote: Counting objects:  
10% (352/3516)   remote: Counting objects:  11% (387/3516)   
remote: Counting objects:  12% (422/3516)   remote: Counting objects:  
13% (458/3516)   remote: Counting objects:  14% (493/3516)   
remote: Counting objects:  15% (528/3516)   remote: Counting objects:  
16% (563/3516)   remote: Counting objects:  17% (598/3516)   
remote: Counting objects:  18% (633/3516)   remote: Counting objects:  
19% (669/3516)   remote: Counting objects:  20% (704/3516)   
remote: Counting objects:  21% (739/3516)   remote: Counting objects:  
22% (774/3516)   remote: Counting objects:  23% (809/3516)   
remote: Counting objects:  24% (844/3516)   remote: Counting objects:  
25% (879/3516)   remote: Counting objects:  26% (915/3516)   
remote: Counting objects:  27% (950/3516)   remote: Counting objects:  
28% (985/3516)   remote: Counting objects:  29% (1020/3516)   
remote: Counting objects:  30% (1055/3516)   remote: Counting objects:  
31% (1090/3516)   remote: Counting objects:  32% (1126/3516)   
remote: Counting objects:  33% (1161/3516)   remote: Counting objects:  
34% (1196/3516)   remote: Counting objects:  35% (1231/3516)   
remote: Counting objects:  36% (1266/3516)   remote: Counting objects:  
37% (1301/3516)   remote: Counting objects:  38% (1337/3516)   
remote: Counting objects:  39% (1372/3516)   remote: Counting objects:  
40% (1407/3516)   remote: Counting objects:  41% (1442/3516)   
remote: Counting objects:  42% (1477/3516)   remote: Counting objects:  
43% (1512/3516)   remote: Counting objects:  44% (1548/3516)   
remote: Counting objects:  45% (1583/3516)   remote: Counting objects:  
46% (1618/3516)   remote: Counting objects:  47% (1653/3516)   
remote: Counting objects:  48% (1688/3516)   remote: Counting objects:  
49% (1723/3516)   remote: Counting objects:  50% (1758/3516)   
remote: Counting objects:  51% (1794/3516)   remote: Counting objects:  
52% (1829/3516)   remote: Counting objects:  53% (1864/3516)   
remote: Counting objects:  54% (1899/3516)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #596

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 42f07849917fadb444802add590e7bb9ca4f6ba2
error: Could not read a9692ff66fccc96ccf95526682136cddb5af0627
remote: Enumerating objects: 3537, done.
remote: Counting objects:   0% (1/3537)   remote: Counting objects:   
1% (36/3537)   remote: Counting objects:   2% (71/3537)   
remote: Counting objects:   3% (107/3537)   remote: Counting objects:   
4% (142/3537)   remote: Counting objects:   5% (177/3537)   
remote: Counting objects:   6% (213/3537)   remote: Counting objects:   
7% (248/3537)   remote: Counting objects:   8% (283/3537)   
remote: Counting objects:   9% (319/3537)   remote: Counting objects:  
10% (354/3537)   remote: Counting objects:  11% (390/3537)   
remote: Counting objects:  12% (425/3537)   remote: Counting objects:  
13% (460/3537)   remote: Counting objects:  14% (496/3537)   
remote: Counting objects:  15% (531/3537)   remote: Counting objects:  
16% (566/3537)   remote: Counting objects:  17% (602/3537)   
remote: Counting objects:  18% (637/3537)   remote: Counting objects:  
19% (673/3537)   remote: Counting objects:  20% (708/3537)   
remote: Counting objects:  21% (743/3537)   remote: Counting objects:  
22% (779/3537)   remote: Counting objects:  23% (814/3537)   
remote: Counting objects:  24% (849/3537)   remote: Counting objects:  
25% (885/3537)   remote: Counting objects:  26% (920/3537)   
remote: Counting objects:  27% (955/3537)   remote: Counting objects:  
28% (991/3537)   remote: Counting objects:  29% (1026/3537)   
remote: Counting objects:  30% (1062/3537)   remote: Counting objects:  
31% (1097/3537)   remote: Counting objects:  32% (1132/3537)   
remote: Counting objects:  33% (1168/3537)   remote: Counting objects:  
34% (1203/3537)   remote: Counting objects:  35% (1238/3537)   
remote: Counting objects:  36% (1274/3537)   remote: Counting objects:  
37% (1309/3537)   remote: Counting objects:  38% (1345/3537)   
remote: Counting objects:  39% (1380/3537)   remote: Counting objects:  
40% (1415/3537)   remote: Counting objects:  41% (1451/3537)   
remote: Counting objects:  42% (1486/3537)   remote: Counting objects:  
43% (1521/3537)   remote: Counting objects:  44% (1557/3537)   
remote: Counting objects:  45% (1592/3537)   remote: Counting objects:  
46% (1628/3537)   remote: Counting objects:  47% (1663/3537)   
remote: Counting objects:  48% (1698/3537)   remote: Counting objects:  
49% (1734/3537)   remote: Counting objects:  50% (1769/3537)   
remote: Counting objects:  51% (1804/3537)   remote: Counting objects:  
52% (1840/3537)   remote: Counting objects:  53% (1875/3537)   
remote: Counting objects:  54% (1910/3537)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk8 #3075

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 6e79e5da0308783ba646378efc44f018cb4f39ac
error: Could not read bb745c0f9142717ddf68dc83bbd940dfe0c59b9a
remote: Enumerating objects: 3516, done.
remote: Counting objects:   0% (1/3516)   remote: Counting objects:   
1% (36/3516)   remote: Counting objects:   2% (71/3516)   
remote: Counting objects:   3% (106/3516)   remote: Counting objects:   
4% (141/3516)   remote: Counting objects:   5% (176/3516)   
remote: Counting objects:   6% (211/3516)   remote: Counting objects:   
7% (247/3516)   remote: Counting objects:   8% (282/3516)   
remote: Counting objects:   9% (317/3516)   remote: Counting objects:  
10% (352/3516)   remote: Counting objects:  11% (387/3516)   
remote: Counting objects:  12% (422/3516)   remote: Counting objects:  
13% (458/3516)   remote: Counting objects:  14% (493/3516)   
remote: Counting objects:  15% (528/3516)   remote: Counting objects:  
16% (563/3516)   remote: Counting objects:  17% (598/3516)   
remote: Counting objects:  18% (633/3516)   remote: Counting objects:  
19% (669/3516)   remote: Counting objects:  20% (704/3516)   
remote: Counting objects:  21% (739/3516)   remote: Counting objects:  
22% (774/3516)   remote: Counting objects:  23% (809/3516)   
remote: Counting objects:  24% (844/3516)   remote: Counting objects:  
25% (879/3516)   remote: Counting objects:  26% (915/3516)   
remote: Counting objects:  27% (950/3516)   remote: Counting objects:  
28% (985/3516)   remote: Counting objects:  29% (1020/3516)   
remote: Counting objects:  30% (1055/3516)   remote: Counting objects:  
31% (1090/3516)   remote: Counting objects:  32% (1126/3516)   
remote: Counting objects:  33% (1161/3516)   remote: Counting objects:  
34% (1196/3516)   remote: Counting objects:  35% (1231/3516)   
remote: Counting objects:  36% (1266/3516)   remote: Counting objects:  
37% (1301/3516)   remote: Counting objects:  38% (1337/3516)   
remote: Counting objects:  39% (1372/3516)   remote: Counting objects:  
40% (1407/3516)   remote: Counting objects:  41% (1442/3516)   
remote: Counting objects:  42% (1477/3516)   remote: Counting objects:  
43% (1512/3516)   remote: Counting objects:  44% (1548/3516)   
remote: Counting objects:  45% (1583/3516)   remote: Counting objects:  
46% (1618/3516)   remote: Counting objects:  47% (1653/3516)   
remote: Counting objects:  48% (1688/3516)   remote: Counting objects:  
49% (1723/3516)   remote: Counting objects:  50% (1758/3516)   
remote: Counting objects:  51% (1794/3516)   remote: Counting objects:  
52% (1829/3516)   remote: Counting objects:  53% (1864/3516)   
remote: Counting objects:  54% (1899/3516)   remote: Counting objects:

Build failed in Jenkins: kafka-trunk-jdk10 #595

2018-10-08 Thread Apache Jenkins Server

See 

--
Started by an SCM change
[EnvInject] - Loading node environment variables.
Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10
Fetching upstream changes from https://github.com/apache/kafka.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/kafka.git 
 > +refs/heads/*:refs/remotes/origin/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/kafka.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
at hudson.scm.SCM.checkout(SCM.java:504)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
at hudson.model.Run.execute(Run.java:1794)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/kafka.git 
+refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout: 
stderr: error: Could not read 42f07849917fadb444802add590e7bb9ca4f6ba2
error: Could not read a9692ff66fccc96ccf95526682136cddb5af0627
remote: Enumerating objects: 3537, done.
remote: Counting objects:   0% (1/3537)   remote: Counting objects:   
1% (36/3537)   remote: Counting objects:   2% (71/3537)   
remote: Counting objects:   3% (107/3537)   remote: Counting objects:   
4% (142/3537)   remote: Counting objects:   5% (177/3537)   
remote: Counting objects:   6% (213/3537)   remote: Counting objects:   
7% (248/3537)   remote: Counting objects:   8% (283/3537)   
remote: Counting objects:   9% (319/3537)   remote: Counting objects:  
10% (354/3537)   remote: Counting objects:  11% (390/3537)   
remote: Counting objects:  12% (425/3537)   remote: Counting objects:  
13% (460/3537)   remote: Counting objects:  14% (496/3537)   
remote: Counting objects:  15% (531/3537)   remote: Counting objects:  
16% (566/3537)   remote: Counting objects:  17% (602/3537)   
remote: Counting objects:  18% (637/3537)   remote: Counting objects:  
19% (673/3537)   remote: Counting objects:  20% (708/3537)   
remote: Counting objects:  21% (743/3537)   remote: Counting objects:  
22% (779/3537)   remote: Counting objects:  23% (814/3537)   
remote: Counting objects:  24% (849/3537)   remote: Counting objects:  
25% (885/3537)   remote: Counting objects:  26% (920/3537)   
remote: Counting objects:  27% (955/3537)   remote: Counting objects:  
28% (991/3537)   remote: Counting objects:  29% (1026/3537)   
remote: Counting objects:  30% (1062/3537)   remote: Counting objects:  
31% (1097/3537)   remote: Counting objects:  32% (1132/3537)   
remote: Counting objects:  33% (1168/3537)   remote: Counting objects:  
34% (1203/3537)   remote: Counting objects:  35% (1238/3537)   
remote: Counting objects:  36% (1274/3537)   remote: Counting objects:  
37% (1309/3537)   remote: Counting objects:  38% (1345/3537)   
remote: Counting objects:  39% (1380/3537)   remote: Counting objects:  
40% (1415/3537)   remote: Counting objects:  41% (1451/3537)   
remote: Counting objects:  42% (1486/3537)   remote: Counting objects:  
43% (1521/3537)   remote: Counting objects:  44% (1557/3537)   
remote: Counting objects:  45% (1592/3537)   remote: Counting objects:  
46% (1628/3537)   remote: Counting objects:  47% (1663/3537)   
remote: Counting objects:  48% (1698/3537)   remote: Counting objects:  
49% (1734/3537)   remote: Counting objects:  50% (1769/3537)   
remote: Counting objects:  51% (1804/3537)   remote: Counting objects:  
52% (1840/3537)   remote: Counting objects:  53% (1875/3537)   
remote: Counting objects:  54% (1910/3537)   remote: Counting objects:

[jira] [Resolved] (KAFKA-7462) Kafka brokers cannot provide OAuth without a token

2018-10-08 Thread Rajini Sivaram (JIRA)



 [ 
https://issues.apache.org/jira/browse/KAFKA-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajini Sivaram resolved KAFKA-7462.
---
   Resolution: Fixed
Fix Version/s: (was: 2.2.0)
   2.1.0

> Kafka brokers cannot provide OAuth without a token
> --
>
> Key: KAFKA-7462
> URL: https://issues.apache.org/jira/browse/KAFKA-7462
> Project: Kafka
>  Issue Type: Bug
>  Components: security
>Affects Versions: 2.0.0
>Reporter: Rajini Sivaram
>Assignee: Rajini Sivaram
>Priority: Major
> Fix For: 2.1.0
>
>
> Like with all other SASL mechanisms, OAUTHBEARER uses the same LoginModule 
> class on both  server-side and the client-side. But unlike PLAIN or SCRAM 
> where client credentials are optional, OAUTHBEARER requires always requires a 
> token. So while with PLAIN/SCRAM, broker only needs to specify client 
> credentials if the mechanism is used for inter-broker communication, with 
> OAuth, broker requires client credentials even if OAuth is not used for 
> inter-broker communication. This is an issue with the default 
> `OAuthBearerUnsecuredLoginCallbackHandler` used on both client-side and 
> server-side. But more critically, it is an issue with 
> `OAuthBearerLoginModule` which doesn't commit if token == null (commit() 
> returns false).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KAFKA-7489) ConnectDistributedTest is always running broker with dev version

2018-10-08 Thread Andras Katona (JIRA)

Andras Katona created KAFKA-7489:


 Summary: ConnectDistributedTest is always running broker with dev 
version
 Key: KAFKA-7489
 URL: https://issues.apache.org/jira/browse/KAFKA-7489
 Project: Kafka
  Issue Type: Test
  Components: KafkaConnect, system tests
Reporter: Andras Katona


h2. Test class
kafkatest.tests.connect.connect_distributed_test.ConnectDistributedTest

h2. Details
_test_broker_compatibility_ is +parametrized+ with different types of brokers, 
yet it is passed as string to _setup_services_ and this way KafkaService is 
initialised with DEV version in the end.

This is easy to fix, just wrap the _broker_version_ with KafkaVersion
{panel}
self.setup_services(broker_version={color:#FF}KafkaVersion{color}(broker_version),
 auto_create_topics=auto_create_topics, security_protocol=security_protocol)
{panel}

But test is failing with the parameter LATEST_0_9 with the following error 
message
{noformat}
Kafka Connect failed to start on node: ducker@ducker02 in condition mode: LISTEN
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[Review] - Pull request #5681 review

2018-10-08 Thread Srinivas Reddy

Hi,

After working on Kafka for sometime, I got motivated to start contribute to
Kafka. As this is my first commit here thought of refactored some unit
tests with minimal changes after going through contribution guidelines.

I worked over weekend for code changes and local testing before raising the
PR. But suprisingly no review comments on it.

Here is the link my initial attempt:
https://github.com/apache/kafka/pull/5681

Please let me know if there is anything needs to be done from my side to
get it reviewed.

Thank you in advance.

-
Srinivas

- Typed on tiny keys. pls ignore typos.{mobile app}

42 matches

Mail list logo