[jira] [Updated] (KAFKA-1486) Move all request/responses to use schema-utils
[ https://issues.apache.org/jira/browse/KAFKA-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1486: - Assignee: (was: Raul Castro Fernandez) > Move all request/responses to use schema-utils > -- > > Key: KAFKA-1486 > URL: https://issues.apache.org/jira/browse/KAFKA-1486 > Project: Kafka > Issue Type: Improvement >Reporter: Joel Koshy > Labels: newbie > Original Estimate: 72h > Remaining Estimate: 72h > > We started doing this for the new producer. > We should do the same on the server-side as well. It will make it a more > convenient to evolve the wire-protocol over time. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1486) Move all request/responses to use schema-utils
[ https://issues.apache.org/jira/browse/KAFKA-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106264#comment-14106264 ] Raul Castro Fernandez commented on KAFKA-1486: -- Please do! > Move all request/responses to use schema-utils > -- > > Key: KAFKA-1486 > URL: https://issues.apache.org/jira/browse/KAFKA-1486 > Project: Kafka > Issue Type: Improvement >Reporter: Joel Koshy > Labels: newbie > Original Estimate: 72h > Remaining Estimate: 72h > > We started doing this for the new producer. > We should do the same on the server-side as well. It will make it a more > convenient to evolve the wire-protocol over time. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: KAFKA-1524_2014-08-20_09:14:59.patch > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch, KAFKA-1524.patch, > KAFKA-1524_2014-08-18_09:39:34.patch, KAFKA-1524_2014-08-20_09:14:59.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104085#comment-14104085 ] Raul Castro Fernandez commented on KAFKA-1524: -- Updated reviewboard https://reviews.apache.org/r/24411/diff/ against branch origin/transactional_messaging > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch, KAFKA-1524.patch, > KAFKA-1524_2014-08-18_09:39:34.patch, KAFKA-1524_2014-08-20_09:14:59.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1565) Transaction manager failover handling
[ https://issues.apache.org/jira/browse/KAFKA-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103205#comment-14103205 ] Raul Castro Fernandez commented on KAFKA-1565: -- If this patch is not necessary/applicable anymore, can we just remove it? > Transaction manager failover handling > - > > Key: KAFKA-1565 > URL: https://issues.apache.org/jira/browse/KAFKA-1565 > Project: Kafka > Issue Type: New Feature >Reporter: Dong Lin >Assignee: Dong Lin > Labels: transactions > Attachments: KAFKA-1565.patch > > > Transaction manager should guarantee that, once a pre-commit/pre-abort > request is acknowledged, commit/abort request will be delivered to partitions > involved in the transaction. > In particular, we handle the following failover scenarios: > 1) Transaction manager or its followers fail before txRequest is duplicated > on local log and followers. > Solution: Transaction manager responds to request with error status if it is > alive. The producer keeps trying commit. > 2) The txPartition’s leader is not available. > Solution: Put txRequest on unSentTxRequestQueue. When metadataCache is > updated, check and re-send txRequest from unSentTxRequestQueue if possible. > 3) The txPartition’s leader fails when txRequest is in channel manager. > Solution: Retrieve all txRequests queued for transmission to this broker and > put them on unSentTxRequestQueue. > 4) Transaction manage does not receive success response from txPartition’s > leaders within timeout period. > Solution: Transaction manager expires the txRequest and re-send it. > 5) Transaction manager fails. > Solution: The new transaction manager reads transactionHW from zookeeper, and > sends txRequest starting from the transactionHW. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1527) SimpleConsumer should be transaction-aware
[ https://issues.apache.org/jira/browse/KAFKA-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1527: - Attachment: KAFKA-1527_2014-08-19_18:22:26.patch > SimpleConsumer should be transaction-aware > -- > > Key: KAFKA-1527 > URL: https://issues.apache.org/jira/browse/KAFKA-1527 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1527.patch, KAFKA-1527_2014-08-19_10:39:53.patch, > KAFKA-1527_2014-08-19_18:22:26.patch > > > This will help in further integration testing of the transactional producer. > This could be implemented in the consumer-iterator level or at a higher level. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1569) Tool for performance and correctness of transactions end-to-end
[ https://issues.apache.org/jira/browse/KAFKA-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1569: - Summary: Tool for performance and correctness of transactions end-to-end (was: Tooling for performance and corectness of transactions end-to-end) > Tool for performance and correctness of transactions end-to-end > --- > > Key: KAFKA-1569 > URL: https://issues.apache.org/jira/browse/KAFKA-1569 > Project: Kafka > Issue Type: New Feature >Reporter: Raul Castro Fernandez >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1569.patch, KAFKA-1569.patch > > > A producer tool that creates an input file, reads it and sends it to the > brokers according to some transaction configuration. And a consumer tool that > read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1527) SimpleConsumer should be transaction-aware
[ https://issues.apache.org/jira/browse/KAFKA-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103195#comment-14103195 ] Raul Castro Fernandez commented on KAFKA-1527: -- Updated reviewboard https://reviews.apache.org/r/23906/diff/ against branch origin/transactional_messaging > SimpleConsumer should be transaction-aware > -- > > Key: KAFKA-1527 > URL: https://issues.apache.org/jira/browse/KAFKA-1527 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1527.patch, KAFKA-1527_2014-08-19_10:39:53.patch, > KAFKA-1527_2014-08-19_18:22:26.patch > > > This will help in further integration testing of the transactional producer. > This could be implemented in the consumer-iterator level or at a higher level. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1526) Producer performance tool should have an option to enable transactions
[ https://issues.apache.org/jira/browse/KAFKA-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102543#comment-14102543 ] Raul Castro Fernandez commented on KAFKA-1526: -- Updated reviewboard https://reviews.apache.org/r/23647/diff/ against branch origin/transactional_messaging > Producer performance tool should have an option to enable transactions > -- > > Key: KAFKA-1526 > URL: https://issues.apache.org/jira/browse/KAFKA-1526 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1526.patch, KAFKA-1526_2014-08-19_10:54:51.patch > > > If this flag is enabled the producer could start/commit/abort transactions > randomly - we could add more configs/parameters for more control on > transaction boundaries. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1526) Producer performance tool should have an option to enable transactions
[ https://issues.apache.org/jira/browse/KAFKA-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1526: - Attachment: KAFKA-1526_2014-08-19_10:54:51.patch > Producer performance tool should have an option to enable transactions > -- > > Key: KAFKA-1526 > URL: https://issues.apache.org/jira/browse/KAFKA-1526 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1526.patch, KAFKA-1526_2014-08-19_10:54:51.patch > > > If this flag is enabled the producer could start/commit/abort transactions > randomly - we could add more configs/parameters for more control on > transaction boundaries. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1527) SimpleConsumer should be transaction-aware
[ https://issues.apache.org/jira/browse/KAFKA-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1527: - Attachment: KAFKA-1527_2014-08-19_10:39:53.patch > SimpleConsumer should be transaction-aware > -- > > Key: KAFKA-1527 > URL: https://issues.apache.org/jira/browse/KAFKA-1527 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1527.patch, KAFKA-1527_2014-08-19_10:39:53.patch > > > This will help in further integration testing of the transactional producer. > This could be implemented in the consumer-iterator level or at a higher level. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1527) SimpleConsumer should be transaction-aware
[ https://issues.apache.org/jira/browse/KAFKA-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102513#comment-14102513 ] Raul Castro Fernandez commented on KAFKA-1527: -- Updated reviewboard https://reviews.apache.org/r/23906/diff/ against branch origin/transactional_messaging > SimpleConsumer should be transaction-aware > -- > > Key: KAFKA-1527 > URL: https://issues.apache.org/jira/browse/KAFKA-1527 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1527.patch, KAFKA-1527_2014-08-19_10:39:53.patch > > > This will help in further integration testing of the transactional producer. > This could be implemented in the consumer-iterator level or at a higher level. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: KAFKA-1524_2014-08-18_09:39:34.patch > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch, KAFKA-1524.patch, > KAFKA-1524_2014-08-18_09:39:34.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14100825#comment-14100825 ] Raul Castro Fernandez commented on KAFKA-1524: -- Updated reviewboard https://reviews.apache.org/r/24411/diff/ against branch origin/transactional_messaging > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch, KAFKA-1524.patch, > KAFKA-1524_2014-08-18_09:39:34.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1569) Tooling for performance and corectness of transactions end-to-end
[ https://issues.apache.org/jira/browse/KAFKA-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1569: - Summary: Tooling for performance and corectness of transactions end-to-end (was: Create tool to test correctness of transactions end-to-end) > Tooling for performance and corectness of transactions end-to-end > - > > Key: KAFKA-1569 > URL: https://issues.apache.org/jira/browse/KAFKA-1569 > Project: Kafka > Issue Type: New Feature >Reporter: Raul Castro Fernandez >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1569.patch, KAFKA-1569.patch > > > A producer tool that creates an input file, reads it and sends it to the > brokers according to some transaction configuration. And a consumer tool that > read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (KAFKA-1579) End-to-End tool to measure performance and correctness test
Raul Castro Fernandez created KAFKA-1579: Summary: End-to-End tool to measure performance and correctness test Key: KAFKA-1579 URL: https://issues.apache.org/jira/browse/KAFKA-1579 Project: Kafka Issue Type: New Feature Reporter: Raul Castro Fernandez Assignee: Raul Castro Fernandez Producer and Consumer tool that can: - measure performance (throughput and RTT) - test for atomic writes (AW) correctness - test for read isolation/partition (RI/partition) correctness -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: KAFKA-1541.patch > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch, KAFKA-1541.patch, KAFKA-1541.patch, > KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088142#comment-14088142 ] Raul Castro Fernandez commented on KAFKA-1541: -- Created reviewboard https://reviews.apache.org/r/24417/diff/ against branch origin/transactional_messaging > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch, KAFKA-1541.patch, KAFKA-1541.patch, > KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088133#comment-14088133 ] Raul Castro Fernandez commented on KAFKA-1524: -- Created reviewboard https://reviews.apache.org/r/24411/diff/ against branch origin/transactional_messaging > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch, KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: KAFKA-1524.patch > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch, KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: (was: KAFKA-1524.patch) > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1569) Create tool to test correctness of transactions end-to-end
[ https://issues.apache.org/jira/browse/KAFKA-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1569: - Attachment: KAFKA-1569.patch > Create tool to test correctness of transactions end-to-end > -- > > Key: KAFKA-1569 > URL: https://issues.apache.org/jira/browse/KAFKA-1569 > Project: Kafka > Issue Type: New Feature >Reporter: Raul Castro Fernandez >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1569.patch, KAFKA-1569.patch > > > A producer tool that creates an input file, reads it and sends it to the > brokers according to some transaction configuration. And a consumer tool that > read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1569) Create tool to test correctness of transactions end-to-end
[ https://issues.apache.org/jira/browse/KAFKA-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085385#comment-14085385 ] Raul Castro Fernandez commented on KAFKA-1569: -- Created reviewboard https://reviews.apache.org/r/24268/diff/ against branch origin/transactional_messaging > Create tool to test correctness of transactions end-to-end > -- > > Key: KAFKA-1569 > URL: https://issues.apache.org/jira/browse/KAFKA-1569 > Project: Kafka > Issue Type: New Feature >Reporter: Raul Castro Fernandez >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1569.patch, KAFKA-1569.patch > > > A producer tool that creates an input file, reads it and sends it to the > brokers according to some transaction configuration. And a consumer tool that > read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085369#comment-14085369 ] Raul Castro Fernandez commented on KAFKA-1541: -- Created reviewboard https://reviews.apache.org/r/24267/diff/ against branch origin/transactional_messaging > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch, KAFKA-1541.patch, KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: KAFKA-1541.patch > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch, KAFKA-1541.patch, KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085352#comment-14085352 ] Raul Castro Fernandez commented on KAFKA-1524: -- Created reviewboard https://reviews.apache.org/r/24265/diff/ against branch origin/transactional_messaging > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch, KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: KAFKA-1524.patch > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch, KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1569) Create tool to test correctness of transactions end-to-end
[ https://issues.apache.org/jira/browse/KAFKA-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085193#comment-14085193 ] Raul Castro Fernandez commented on KAFKA-1569: -- Created reviewboard https://reviews.apache.org/r/24255/diff/ against branch origin/transactional_messaging > Create tool to test correctness of transactions end-to-end > -- > > Key: KAFKA-1569 > URL: https://issues.apache.org/jira/browse/KAFKA-1569 > Project: Kafka > Issue Type: New Feature >Reporter: Raul Castro Fernandez >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1569.patch > > > A producer tool that creates an input file, reads it and sends it to the > brokers according to some transaction configuration. And a consumer tool that > read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1569) Create tool to test correctness of transactions end-to-end
[ https://issues.apache.org/jira/browse/KAFKA-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1569: - Attachment: KAFKA-1569.patch > Create tool to test correctness of transactions end-to-end > -- > > Key: KAFKA-1569 > URL: https://issues.apache.org/jira/browse/KAFKA-1569 > Project: Kafka > Issue Type: New Feature >Reporter: Raul Castro Fernandez >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1569.patch > > > A producer tool that creates an input file, reads it and sends it to the > brokers according to some transaction configuration. And a consumer tool that > read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1569) Create tool to test correctness of transactions end-to-end
[ https://issues.apache.org/jira/browse/KAFKA-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1569: - Summary: Create tool to test correctness of transactions end-to-end (was: Create tool to test end-to-end correctness when using transactions) > Create tool to test correctness of transactions end-to-end > -- > > Key: KAFKA-1569 > URL: https://issues.apache.org/jira/browse/KAFKA-1569 > Project: Kafka > Issue Type: New Feature >Reporter: Raul Castro Fernandez >Assignee: Raul Castro Fernandez > Labels: transactions > > A producer tool that creates an input file, reads it and sends it to the > brokers according to some transaction configuration. And a consumer tool that > read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1569) Create tool to test end-to-end correctness when using transactions
[ https://issues.apache.org/jira/browse/KAFKA-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1569: - Summary: Create tool to test end-to-end correctness when using transactions (was: Creat tool to test end-to-end correctness in transactional mode) > Create tool to test end-to-end correctness when using transactions > -- > > Key: KAFKA-1569 > URL: https://issues.apache.org/jira/browse/KAFKA-1569 > Project: Kafka > Issue Type: New Feature >Reporter: Raul Castro Fernandez >Assignee: Raul Castro Fernandez > Labels: transactions > > A producer tool that creates an input file, reads it and sends it to the > brokers according to some transaction configuration. And a consumer tool that > read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085171#comment-14085171 ] Raul Castro Fernandez commented on KAFKA-1541: -- Created reviewboard https://reviews.apache.org/r/24253/diff/ against branch origin/transactional_messaging > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch, KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: KAFKA-1541.patch > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch, KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: KAFKA-1524.patch > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085063#comment-14085063 ] Raul Castro Fernandez commented on KAFKA-1524: -- Created reviewboard https://reviews.apache.org/r/24245/diff/ against branch origin/transactional_messaging > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch, KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (KAFKA-1569) Creat tool to test end-to-end correctness in transactional mode
Raul Castro Fernandez created KAFKA-1569: Summary: Creat tool to test end-to-end correctness in transactional mode Key: KAFKA-1569 URL: https://issues.apache.org/jira/browse/KAFKA-1569 Project: Kafka Issue Type: New Feature Reporter: Raul Castro Fernandez Assignee: Raul Castro Fernandez A producer tool that creates an input file, reads it and sends it to the brokers according to some transaction configuration. And a consumer tool that read data from brokers with transaction boundaries and writes it to a file. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1527) SimpleConsumer should be transaction-aware
[ https://issues.apache.org/jira/browse/KAFKA-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1527: - Attachment: KAFKA-1527.patch > SimpleConsumer should be transaction-aware > -- > > Key: KAFKA-1527 > URL: https://issues.apache.org/jira/browse/KAFKA-1527 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1527.patch > > > This will help in further integration testing of the transactional producer. > This could be implemented in the consumer-iterator level or at a higher level. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1527) SimpleConsumer should be transaction-aware
[ https://issues.apache.org/jira/browse/KAFKA-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073830#comment-14073830 ] Raul Castro Fernandez commented on KAFKA-1527: -- Created reviewboard https://reviews.apache.org/r/23906/diff/ against branch origin/transactional_messaging > SimpleConsumer should be transaction-aware > -- > > Key: KAFKA-1527 > URL: https://issues.apache.org/jira/browse/KAFKA-1527 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1527.patch > > > This will help in further integration testing of the transactional producer. > This could be implemented in the consumer-iterator level or at a higher level. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065194#comment-14065194 ] Raul Castro Fernandez commented on KAFKA-1524: -- Created reviewboard https://reviews.apache.org/r/23648/diff/ against branch origin/transactional_messaging > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1526) Producer performance tool should have an option to enable transactions
[ https://issues.apache.org/jira/browse/KAFKA-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1526: - Attachment: (was: KAFKA-1526.patch) > Producer performance tool should have an option to enable transactions > -- > > Key: KAFKA-1526 > URL: https://issues.apache.org/jira/browse/KAFKA-1526 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1526.patch > > > If this flag is enabled the producer could start/commit/abort transactions > randomly - we could add more configs/parameters for more control on > transaction boundaries. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: KAFKA-1524.patch > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: (was: KAFKA-1524.patch) > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1526) Producer performance tool should have an option to enable transactions
[ https://issues.apache.org/jira/browse/KAFKA-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065192#comment-14065192 ] Raul Castro Fernandez commented on KAFKA-1526: -- Created reviewboard https://reviews.apache.org/r/23647/diff/ against branch origin/transactional_messaging > Producer performance tool should have an option to enable transactions > -- > > Key: KAFKA-1526 > URL: https://issues.apache.org/jira/browse/KAFKA-1526 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1526.patch, KAFKA-1526.patch > > > If this flag is enabled the producer could start/commit/abort transactions > randomly - we could add more configs/parameters for more control on > transaction boundaries. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1526) Producer performance tool should have an option to enable transactions
[ https://issues.apache.org/jira/browse/KAFKA-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1526: - Attachment: KAFKA-1526.patch > Producer performance tool should have an option to enable transactions > -- > > Key: KAFKA-1526 > URL: https://issues.apache.org/jira/browse/KAFKA-1526 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1526.patch, KAFKA-1526.patch > > > If this flag is enabled the producer could start/commit/abort transactions > randomly - we could add more configs/parameters for more control on > transaction boundaries. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: (was: KAFKA-1541.patch) > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065171#comment-14065171 ] Raul Castro Fernandez commented on KAFKA-1541: -- Created reviewboard https://reviews.apache.org/r/23646/diff/ against branch origin/transactional_messaging > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch, KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: KAFKA-1541.patch > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch, KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: KAFKA-1541.patch > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: (was: KAFKA-1541.patch) > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: KAFKA-1541.patch > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: (was: KAFKA-1541.patch) > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1524) Implement transactional producer
[ https://issues.apache.org/jira/browse/KAFKA-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1524: - Attachment: KAFKA-1524.patch > Implement transactional producer > > > Key: KAFKA-1524 > URL: https://issues.apache.org/jira/browse/KAFKA-1524 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1524.patch > > > Implement the basic transactional producer functionality as outlined in > https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka > The scope of this jira is basic functionality (i.e., to be able to begin and > commit or abort a transaction) without the failure scenarios. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1526) Producer performance tool should have an option to enable transactions
[ https://issues.apache.org/jira/browse/KAFKA-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1526: - Attachment: KAFKA-1526.patch > Producer performance tool should have an option to enable transactions > -- > > Key: KAFKA-1526 > URL: https://issues.apache.org/jira/browse/KAFKA-1526 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1526.patch > > > If this flag is enabled the producer could start/commit/abort transactions > randomly - we could add more configs/parameters for more control on > transaction boundaries. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1541) Add transactional request definitions to clients package
[ https://issues.apache.org/jira/browse/KAFKA-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1541: - Attachment: KAFKA-1541.patch > Add transactional request definitions to clients package > - > > Key: KAFKA-1541 > URL: https://issues.apache.org/jira/browse/KAFKA-1541 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Raul Castro Fernandez > Labels: transactions > Attachments: KAFKA-1541.patch > > > Separate jira for this since KAFKA-1522 only adds definitions to the core > package. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (KAFKA-1525) DumpLogSegments should print transaction IDs
[ https://issues.apache.org/jira/browse/KAFKA-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1525: - Assignee: Dong Lin (was: Raul Castro Fernandez) > DumpLogSegments should print transaction IDs > > > Key: KAFKA-1525 > URL: https://issues.apache.org/jira/browse/KAFKA-1525 > Project: Kafka > Issue Type: New Feature >Reporter: Joel Koshy >Assignee: Dong Lin > Labels: transactions > > This will help in some very basic integration testing of the transactional > producer and brokers (i.e., until we have a transactional simple consumer). > We only need to print the txid's. There is no need to do transactional > buffering. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-179) Log files always touched when broker is bounced
[ https://issues.apache.org/jira/browse/KAFKA-179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14029711#comment-14029711 ] Raul Castro Fernandez commented on KAFKA-179: - Just tried it. It seems that it is already fixed. After creating a couple of topics and reinitialising the brokers a couple of times, the mtime of the log and index files does not change. > Log files always touched when broker is bounced > --- > > Key: KAFKA-179 > URL: https://issues.apache.org/jira/browse/KAFKA-179 > Project: Kafka > Issue Type: Bug > Components: core >Reporter: Joel Koshy >Priority: Minor > Labels: newbie > Fix For: 0.8.2 > > > It looks like the latest log segment is always touched when the broker upon > start-up regardless of whether it has corrupt data or not, which fudges the > segment's mtime. Minor issue, but I found it a bit misleading when trying to > verify a log cleanup setting in production. I think it should be as simple as > adding a guard in FileMessageSet's recover method to skip truncate if > validUpTo == the length of the segment. Will test this later. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-179) Log files always touched when broker is bounced
[ https://issues.apache.org/jira/browse/KAFKA-179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14029712#comment-14029712 ] Raul Castro Fernandez commented on KAFKA-179: - Should I mark it as solved? > Log files always touched when broker is bounced > --- > > Key: KAFKA-179 > URL: https://issues.apache.org/jira/browse/KAFKA-179 > Project: Kafka > Issue Type: Bug > Components: core >Reporter: Joel Koshy >Priority: Minor > Labels: newbie > Fix For: 0.8.2 > > > It looks like the latest log segment is always touched when the broker upon > start-up regardless of whether it has corrupt data or not, which fudges the > segment's mtime. Minor issue, but I found it a bit misleading when trying to > verify a log cleanup setting in production. I think it should be as simple as > adding a guard in FileMessageSet's recover method to skip truncate if > validUpTo == the length of the segment. Will test this later. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-179) Log files always touched when broker is bounced
[ https://issues.apache.org/jira/browse/KAFKA-179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028219#comment-14028219 ] Raul Castro Fernandez commented on KAFKA-179: - The function recoverLog() in Log.scala checks whether the log has the CleanShutdownMarker. If it exists, then it returns without touching any MessageSet (lines 173-176). Does the description of the JIRA refers to this function? > Log files always touched when broker is bounced > --- > > Key: KAFKA-179 > URL: https://issues.apache.org/jira/browse/KAFKA-179 > Project: Kafka > Issue Type: Bug > Components: core >Reporter: Joel Koshy >Priority: Minor > Labels: newbie > Fix For: 0.8.2 > > > It looks like the latest log segment is always touched when the broker upon > start-up regardless of whether it has corrupt data or not, which fudges the > segment's mtime. Minor issue, but I found it a bit misleading when trying to > verify a log cleanup setting in production. I think it should be as simple as > adding a guard in FileMessageSet's recover method to skip truncate if > validUpTo == the length of the segment. Will test this later. -- This message was sent by Atlassian JIRA (v6.2#6252)
