[
https://issues.apache.org/jira/browse/KAFKA-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugen Feller updated KAFKA-6990:
--------------------------------
Description:
We are seeing a lot of CommitFailedExceptions on one of our Kafka stream apps.
Running Kafka Streams 0.10.2.1 and Kafka Broker 0.10.2.1. Full error message:
{code:java}
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] INFO
org.apache.kafka.streams.KafkaStreams - stream-client
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d] State transition from REBALANCING
to RUNNING.
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_0] Failed
offset commits {sightings_sighting_byclientmac_0-0=OffsetAndMetadata{offset=11,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-0=OffsetAndMetadata{offset=26,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_0 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_1 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_1] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-1=OffsetAndMetadata{offset=38,
metadata=''}, sightings_sighting_byclientmac_0-1=OffsetAndMetadata{offset=1,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_2] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-2=OffsetAndMetadata{offset=8,
metadata=''}, sightings_sighting_byclientmac_0-2=OffsetAndMetadata{offset=24,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_2 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_3] Failed
offset commits {sightings_sighting_byclientmac_0-3=OffsetAndMetadata{offset=21,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-3=OffsetAndMetadata{offset=102,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_3 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_4] Failed
offset commits {sightings_sighting_byclientmac_0-4=OffsetAndMetadata{offset=5,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-4=OffsetAndMetadata{offset=20,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_4 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_5] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-5=OffsetAndMetadata{offset=26,
metadata=''}, sightings_sighting_byclientmac_0-5=OffsetAndMetadata{offset=16,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_5 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_6] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-6=OffsetAndMetadata{offset=22,
metadata=''}, sightings_sighting_byclientmac_0-6=OffsetAndMetadata{offset=3,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_6 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_7] Failed
offset commits {sightings_sighting_byclientmac_0-7=OffsetAndMetadata{offset=3,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-7=OffsetAndMetadata{offset=5,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_7 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_8 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_8] Failed
offset commits {sightings_sighting_byclientmac_0-8=OffsetAndMetadata{offset=1,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-8=OffsetAndMetadata{offset=3,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_9] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-9=OffsetAndMetadata{offset=115,
metadata=''}, sightings_sighting_byclientmac_0-9=OffsetAndMetadata{offset=1,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_9 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_10] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-10=OffsetAndMetadata{offset=22,
metadata=''}, sightings_sighting_byclientmac_0-10=OffsetAndMetadata{offset=2,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_10 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_11 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_11] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-11=OffsetAndMetadata{offset=20,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_12] Failed
offset commits {sightings_sighting_byclientmac_0-12=OffsetAndMetadata{offset=1,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-12=OffsetAndMetadata{offset=38,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_12 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_13] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-13=OffsetAndMetadata{offset=17,
metadata=''}, sightings_sighting_byclientmac_0-13=OffsetAndMetadata{offset=13,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_13 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_14] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-14=OffsetAndMetadata{offset=2,
metadata=''}, sightings_sighting_byclientmac_0-14=OffsetAndMetadata{offset=1,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_14 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_15] Failed
offset commits
{sightings_sighting_byclientmac_0-15=OffsetAndMetadata{offset=14, metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-15=OffsetAndMetadata{offset=69,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_15 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
{code}
Any idea what could be going on? This service is only running with 2 instances
(each one stream thread).
was:
We are seeing a lot of CommitFailedExceptions on one of our Kafka clusters.
Running Kafka Streams 0.10.2.1 and Kafka Broker 0.10.2.1. Full error message:
{code:java}
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] INFO
org.apache.kafka.streams.KafkaStreams - stream-client
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d] State transition from REBALANCING
to RUNNING.
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_0] Failed
offset commits {sightings_sighting_byclientmac_0-0=OffsetAndMetadata{offset=11,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-0=OffsetAndMetadata{offset=26,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_0 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_1 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_1] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-1=OffsetAndMetadata{offset=38,
metadata=''}, sightings_sighting_byclientmac_0-1=OffsetAndMetadata{offset=1,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_2] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-2=OffsetAndMetadata{offset=8,
metadata=''}, sightings_sighting_byclientmac_0-2=OffsetAndMetadata{offset=24,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_2 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_3] Failed
offset commits {sightings_sighting_byclientmac_0-3=OffsetAndMetadata{offset=21,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-3=OffsetAndMetadata{offset=102,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_3 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_4] Failed
offset commits {sightings_sighting_byclientmac_0-4=OffsetAndMetadata{offset=5,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-4=OffsetAndMetadata{offset=20,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_4 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_5] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-5=OffsetAndMetadata{offset=26,
metadata=''}, sightings_sighting_byclientmac_0-5=OffsetAndMetadata{offset=16,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_5 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_6] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-6=OffsetAndMetadata{offset=22,
metadata=''}, sightings_sighting_byclientmac_0-6=OffsetAndMetadata{offset=3,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_6 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_7] Failed
offset commits {sightings_sighting_byclientmac_0-7=OffsetAndMetadata{offset=3,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-7=OffsetAndMetadata{offset=5,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_7 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_8 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_8] Failed
offset commits {sightings_sighting_byclientmac_0-8=OffsetAndMetadata{offset=1,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-8=OffsetAndMetadata{offset=3,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_9] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-9=OffsetAndMetadata{offset=115,
metadata=''}, sightings_sighting_byclientmac_0-9=OffsetAndMetadata{offset=1,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_9 during commit state due to CommitFailedException; this task may
be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_10] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-10=OffsetAndMetadata{offset=22,
metadata=''}, sightings_sighting_byclientmac_0-10=OffsetAndMetadata{offset=2,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_10 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_11 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_11] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-11=OffsetAndMetadata{offset=20,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_12] Failed
offset commits {sightings_sighting_byclientmac_0-12=OffsetAndMetadata{offset=1,
metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-12=OffsetAndMetadata{offset=38,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_12 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_13] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-13=OffsetAndMetadata{offset=17,
metadata=''}, sightings_sighting_byclientmac_0-13=OffsetAndMetadata{offset=13,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_13 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_14] Failed
offset commits
{mactocontactmappings_contactmapping_byclientmac_0-14=OffsetAndMetadata{offset=2,
metadata=''}, sightings_sighting_byclientmac_0-14=OffsetAndMetadata{offset=1,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_14 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.StreamTask - task [0_15] Failed
offset commits
{sightings_sighting_byclientmac_0-15=OffsetAndMetadata{offset=14, metadata=''},
mactocontactmappings_contactmapping_byclientmac_0-15=OffsetAndMetadata{offset=69,
metadata=''}} due to CommitFailedException
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
[visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
stream task 0_15 during commit state due to CommitFailedException; this task
may be no longer owned by the thread
{code}
Any idea what could be going on? This service is only running with 2 instances
(each one stream thread).
> CommitFailedException; this task may be no longer owned by the thread
> ---------------------------------------------------------------------
>
> Key: KAFKA-6990
> URL: https://issues.apache.org/jira/browse/KAFKA-6990
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 0.10.2.1
> Reporter: Eugen Feller
> Priority: Blocker
>
> We are seeing a lot of CommitFailedExceptions on one of our Kafka stream
> apps. Running Kafka Streams 0.10.2.1 and Kafka Broker 0.10.2.1. Full error
> message:
> {code:java}
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] INFO
> org.apache.kafka.streams.KafkaStreams - stream-client
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d] State transition from
> REBALANCING to RUNNING.
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_0] Failed
> offset commits
> {sightings_sighting_byclientmac_0-0=OffsetAndMetadata{offset=11,
> metadata=''},
> mactocontactmappings_contactmapping_byclientmac_0-0=OffsetAndMetadata{offset=26,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_0 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_1 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_1] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-1=OffsetAndMetadata{offset=38,
> metadata=''}, sightings_sighting_byclientmac_0-1=OffsetAndMetadata{offset=1,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_2] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-2=OffsetAndMetadata{offset=8,
> metadata=''},
> sightings_sighting_byclientmac_0-2=OffsetAndMetadata{offset=24, metadata=''}}
> due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_2 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_3] Failed
> offset commits
> {sightings_sighting_byclientmac_0-3=OffsetAndMetadata{offset=21,
> metadata=''},
> mactocontactmappings_contactmapping_byclientmac_0-3=OffsetAndMetadata{offset=102,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_3 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_4] Failed
> offset commits
> {sightings_sighting_byclientmac_0-4=OffsetAndMetadata{offset=5, metadata=''},
> mactocontactmappings_contactmapping_byclientmac_0-4=OffsetAndMetadata{offset=20,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_4 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_5] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-5=OffsetAndMetadata{offset=26,
> metadata=''},
> sightings_sighting_byclientmac_0-5=OffsetAndMetadata{offset=16, metadata=''}}
> due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_5 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_6] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-6=OffsetAndMetadata{offset=22,
> metadata=''}, sightings_sighting_byclientmac_0-6=OffsetAndMetadata{offset=3,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_6 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_7] Failed
> offset commits
> {sightings_sighting_byclientmac_0-7=OffsetAndMetadata{offset=3, metadata=''},
> mactocontactmappings_contactmapping_byclientmac_0-7=OffsetAndMetadata{offset=5,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_7 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_8 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_8] Failed
> offset commits
> {sightings_sighting_byclientmac_0-8=OffsetAndMetadata{offset=1, metadata=''},
> mactocontactmappings_contactmapping_byclientmac_0-8=OffsetAndMetadata{offset=3,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_9] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-9=OffsetAndMetadata{offset=115,
> metadata=''}, sightings_sighting_byclientmac_0-9=OffsetAndMetadata{offset=1,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_9 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_10] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-10=OffsetAndMetadata{offset=22,
> metadata=''},
> sightings_sighting_byclientmac_0-10=OffsetAndMetadata{offset=2, metadata=''}}
> due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_10 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_11 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_11] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-11=OffsetAndMetadata{offset=20,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_12] Failed
> offset commits
> {sightings_sighting_byclientmac_0-12=OffsetAndMetadata{offset=1,
> metadata=''},
> mactocontactmappings_contactmapping_byclientmac_0-12=OffsetAndMetadata{offset=38,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_12 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_13] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-13=OffsetAndMetadata{offset=17,
> metadata=''},
> sightings_sighting_byclientmac_0-13=OffsetAndMetadata{offset=13,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_13 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_14] Failed
> offset commits
> {mactocontactmappings_contactmapping_byclientmac_0-14=OffsetAndMetadata{offset=2,
> metadata=''},
> sightings_sighting_byclientmac_0-14=OffsetAndMetadata{offset=1, metadata=''}}
> due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_14 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.StreamTask - task [0_15] Failed
> offset commits
> {sightings_sighting_byclientmac_0-15=OffsetAndMetadata{offset=14,
> metadata=''},
> mactocontactmappings_contactmapping_byclientmac_0-15=OffsetAndMetadata{offset=69,
> metadata=''}} due to CommitFailedException
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] WARN
> org.apache.kafka.streams.processor.internals.AssignedTasks - stream-thread
> [visits-bdb209f1-c9dd-404b-9233-064f2fb4227d-StreamThread-1] Failed to commit
> stream task 0_15 during commit state due to CommitFailedException; this task
> may be no longer owned by the thread
> {code}
> Any idea what could be going on? This service is only running with 2
> instances (each one stream thread).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
