[ https://issues.apache.org/jira/browse/BEAM-3819?focusedWorklogId=81879&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-81879 ]
ASF GitHub Bot logged work on BEAM-3819: ---------------------------------------- Author: ASF GitHub Bot Created on: 19/Mar/18 15:22 Start Date: 19/Mar/18 15:22 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #4851: [BEAM-3819] Add withLimit() option to KinesisIO URL: https://github.com/apache/beam/pull/4851#issuecomment-373664555 @jbonofre Potentially, we can collect some statistics of how many records were read and what is total data size. Then, we can calculate the average size of record and set this `limit` accordingly. From time to time we have to recalculate the average size and adjust new `limit` value if this size has been changed significantly. But in this case, we need to close old jira and open new one and create new PR because originally, if I understand correctly, the idea was to allow user to configure this parameter by itself. WDYT? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 81879) Time Spent: 1.5h (was: 1h 20m) > Add withLimit() option to KinesisIO > ----------------------------------- > > Key: BEAM-3819 > URL: https://issues.apache.org/jira/browse/BEAM-3819 > Project: Beam > Issue Type: Improvement > Components: io-java-kinesis > Reporter: Jean-Baptiste Onofré > Assignee: Alexey Romanenko > Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > > In some cases, the user might need to set the {{limit}} on the > {{SimplifiedKinesisClient}}, especially for performance reason, depending of > the number of records. -- This message was sent by Atlassian JIRA (v7.6.3#76005)