[
https://issues.apache.org/jira/browse/SAMZA-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149942#comment-15149942
]
Yi Pan (Data Infrastructure) commented on SAMZA-864:
----------------------------------------------------
Thanks, [~boryas]. I applied the patch and it has the following unit test
failure:
{code}
:samza-kafka_2.10:test
testFailOnTopicValidation FAILED
java.lang.AssertionError: Expected a KafkaUtilException for invalid number
of partitions in the topic.
at org.junit.Assert.fail(Assert.java:91)
at
org.apache.samza.checkpoint.kafka.TestKafkaCheckpointManager.testFailOnTopicValidation(TestKafkaCheckpointManager.scala:216)
{code}
Could you check again?
Thanks!
> allow job not to fail in case of incorrect number of partitions on checkpoint
> topic
> -----------------------------------------------------------------------------------
>
> Key: SAMZA-864
> URL: https://issues.apache.org/jira/browse/SAMZA-864
> Project: Samza
> Issue Type: Bug
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Attachments: patch, rb43053.patch
>
>
> Today, if there is an incorrect number of partitions on the job's checkpoint
> topic, the job will fail right away. The topic should have 1 partition.
> Unfortunately, there is no easy solution for this problem, since the number
> of partitions on the topic cannot be decreased (or topic cannot be deleted).
> We should add a config that will allow just to issue a warning in this case
> and keep going. We also need to make sure the checkpoints are written to
> partition 0 only.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
