I see. So presumably some unit test breaks and causes others to fail due to port reuse. Probably we still have some transient unit test failures.
On Tue, Jun 3, 2014 at 12:56 PM, Jun Rao <jun...@gmail.com> wrote: > I have seen those port reusing issues before. So, this is unrelated to the > followup patch in KAFKA-924, which only fixes system tests. I was trying to > wait until unit tests get more stable before fixing the port reuse issue. > > Thanks, > > Jun > > > On Tue, Jun 3, 2014 at 11:23 AM, Neha Narkhede <neha.narkh...@gmail.com> > wrote: > >> Jun, >> >> Why do we have test failures post KAFKA-924? >> >> Thanks, >> Neha >> >> >> On Tue, Jun 3, 2014 at 11:12 AM, Apache Jenkins Server < >> jenk...@builds.apache.org> wrote: >> >>> See <https://builds.apache.org/job/Kafka-trunk/197/changes> >>> >>> Changes: >>> >>> [junrao] kafka-924 (follow-up); Specify console consumer properties via >>> a single --property command line parameter;; patched by Sriharsha >>> Chintalapani; reviewed by Jun Rao >>> >>> ------------------------------------------ >>> [...truncated 1648 lines...] >>> at >>> kafka.integration.KafkaServerTestHarness$class.setUp(KafkaServerTestHarness.scala:35) >>> at >>> kafka.server.DynamicConfigChangeTest.setUp(DynamicConfigChangeTest.scala:28) >>> >>> kafka.server.DynamicConfigChangeTest > >>> testConfigChangeOnNonExistingTopic FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at >>> kafka.server.DynamicConfigChangeTest.kafka$integration$KafkaServerTestHarness$$super$setUp(DynamicConfigChangeTest.scala:28) >>> at >>> kafka.integration.KafkaServerTestHarness$class.setUp(KafkaServerTestHarness.scala:35) >>> at >>> kafka.server.DynamicConfigChangeTest.setUp(DynamicConfigChangeTest.scala:28) >>> >>> kafka.server.ReplicaManagerTest > testHighWaterMarkDirectoryMapping >>> PASSED >>> >>> kafka.server.ReplicaManagerTest > >>> testHighwaterMarkRelativeDirectoryMapping PASSED >>> >>> kafka.server.LeaderElectionTest > testLeaderElectionAndEpoch FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at >>> kafka.server.LeaderElectionTest.setUp(LeaderElectionTest.scala:44) >>> >>> kafka.server.LeaderElectionTest > >>> testLeaderElectionWithStaleControllerEpoch FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at >>> kafka.server.LeaderElectionTest.setUp(LeaderElectionTest.scala:44) >>> >>> kafka.server.ServerShutdownTest > testCleanShutdown FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at >>> kafka.server.ServerShutdownTest.setUp(ServerShutdownTest.scala:34) >>> >>> kafka.server.ServerShutdownTest > >>> testCleanShutdownWithDeleteTopicEnabled FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at >>> kafka.server.ServerShutdownTest.setUp(ServerShutdownTest.scala:34) >>> >>> kafka.server.KafkaConfigTest > testLogRetentionTimeHoursProvided PASSED >>> >>> kafka.server.KafkaConfigTest > testLogRetentionTimeMinutesProvided PASSED >>> >>> kafka.server.KafkaConfigTest > testLogRetentionTimeNoConfigProvided >>> PASSED >>> >>> kafka.server.KafkaConfigTest > >>> testLogRetentionTimeBothMinutesAndHoursProvided PASSED >>> >>> kafka.server.KafkaConfigTest > testAdvertiseDefaults PASSED >>> >>> kafka.server.KafkaConfigTest > testAdvertiseConfigured PASSED >>> >>> kafka.server.KafkaConfigTest > testUncleanLeaderElectionDefault PASSED >>> >>> kafka.server.KafkaConfigTest > testUncleanElectionDisabled PASSED >>> >>> kafka.server.KafkaConfigTest > testUncleanElectionEnabled PASSED >>> >>> kafka.server.KafkaConfigTest > testUncleanElectionInvalid PASSED >>> >>> kafka.server.RequestPurgatoryTest > testRequestSatisfaction PASSED >>> >>> kafka.server.RequestPurgatoryTest > testRequestExpiry PASSED >>> >>> kafka.server.AdvertiseBrokerTest > testBrokerAdvertiseToZK FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at >>> kafka.server.AdvertiseBrokerTest.setUp(AdvertiseBrokerTest.scala:32) >>> >>> kafka.server.LogOffsetTest > testGetOffsetsForUnknownTopic FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogOffsetTest.setUp(LogOffsetTest.scala:48) >>> >>> kafka.server.LogOffsetTest > testGetOffsetsBeforeLatestTime FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogOffsetTest.setUp(LogOffsetTest.scala:48) >>> >>> kafka.server.LogOffsetTest > testEmptyLogsGetOffsets FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogOffsetTest.setUp(LogOffsetTest.scala:48) >>> >>> kafka.server.LogOffsetTest > testGetOffsetsBeforeNow FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogOffsetTest.setUp(LogOffsetTest.scala:48) >>> >>> kafka.server.LogOffsetTest > testGetOffsetsBeforeEarliestTime FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogOffsetTest.setUp(LogOffsetTest.scala:48) >>> >>> kafka.server.LogRecoveryTest > >>> testHWCheckpointNoFailuresSingleLogSegment FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogRecoveryTest.setUp(LogRecoveryTest.scala:57) >>> >>> kafka.server.LogRecoveryTest > >>> testHWCheckpointWithFailuresSingleLogSegment FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogRecoveryTest.setUp(LogRecoveryTest.scala:57) >>> >>> kafka.server.LogRecoveryTest > >>> testHWCheckpointNoFailuresMultipleLogSegments FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogRecoveryTest.setUp(LogRecoveryTest.scala:57) >>> >>> kafka.server.LogRecoveryTest > >>> testHWCheckpointWithFailuresMultipleLogSegments FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.LogRecoveryTest.setUp(LogRecoveryTest.scala:57) >>> >>> kafka.server.ReplicaFetchTest > testReplicaFetcherThread FAILED >>> java.net.BindException: Address already in use >>> at sun.nio.ch.Net.bind(Native Method) >>> at >>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:124) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >>> at >>> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >>> at >>> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:125) >>> at kafka.zk.EmbeddedZookeeper.<init>(EmbeddedZookeeper.scala:32) >>> at >>> kafka.zk.ZooKeeperTestHarness$class.setUp(ZooKeeperTestHarness.scala:33) >>> at kafka.server.ReplicaFetchTest.setUp(ReplicaFetchTest.scala:37) >>> >>> kafka.server.SimpleFetchTest > testNonReplicaSeesHwWhenFetching PASSED >>> >>> kafka.server.SimpleFetchTest > testReplicaSeesLeoWhenFetching PASSED >>> >>> kafka.server.HighwatermarkPersistenceTest > >>> testHighWatermarkPersistenceSinglePartition PASSED >>> >>> kafka.server.HighwatermarkPersistenceTest > >>> testHighWatermarkPersistenceMultiplePartitions PASSED >>> >>> 257 tests completed, 64 failed >>> :core:test FAILED >>> >>> FAILURE: Build failed with an exception. >>> >>> * What went wrong: >>> Execution failed for task ':core:test'. >>> > There were failing tests. See the report at: file://< >>> https://builds.apache.org/job/Kafka-trunk/ws/core/build/reports/tests/index.html >>> > >>> >>> * Try: >>> Run with --stacktrace option to get the stack trace. Run with --info or >>> --debug option to get more log output. >>> >>> BUILD FAILED >>> >>> Total time: 10 mins 46.086 secs >>> Build step 'Execute shell' marked build as failure >>> >> >> >
