[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-07 Thread Magnus Reftel (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040485#comment-16040485 ] Magnus Reftel commented on KAFKA-5390: -- Will do. Thanks! > First records in batch rejected but

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-07 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040468#comment-16040468 ] Ismael Juma commented on KAFKA-5390: [~magnus.reftel], I am not sure I understand. By using `flush`,

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-07 Thread Magnus Reftel (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040449#comment-16040449 ] Magnus Reftel commented on KAFKA-5390: -- Our records are typically small, but potentially huge. Doing

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038969#comment-16038969 ] Ismael Juma commented on KAFKA-5390: If you want to do manual batching, you can simply increase

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-06 Thread Magnus Reftel (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038950#comment-16038950 ] Magnus Reftel commented on KAFKA-5390: -- Yes and no =) It's good to know that batches either succeed

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038927#comment-16038927 ] Ismael Juma commented on KAFKA-5390: `Log` has the following code: {code} // check messages set size

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-06 Thread Magnus Reftel (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038879#comment-16038879 ] Magnus Reftel commented on KAFKA-5390: -- No, the server does not reject the batch - it rejects /some/

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038844#comment-16038844 ] Ismael Juma commented on KAFKA-5390: The errors show what the issue is. The segment size is too small

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-06 Thread Magnus Reftel (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038832#comment-16038832 ] Magnus Reftel commented on KAFKA-5390: -- Thanks for the quick reply! I tried switching

[jira] [Commented] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

2017-06-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038779#comment-16038779 ] Ismael Juma commented on KAFKA-5390: Thanks for the report. Pasting the code so that it's easier to