[
https://issues.apache.org/jira/browse/FLUME-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436744#comment-15436744
]
YoungWook KIM commented on FLUME-2437:
--------------------------------------
Hi, guys
I tested this patch file and found one problem.
S3 source couldn't fetch 50th file and occurred connection pool error then
didn't proceed any more.
So, I add one line source at S3ObjectEventReader.java line 256 as below.
S3Object object = s3Client.getObject(bucketName, objSummary.getKey());
S3ObjectInputStream is = object.getObjectContent();
String key = objSummary.getKey();
try {
+ object.close();
// roll the meta file, if needed
PositionTracker tracker = backingStore.getPositionTracker(key);
and then applied my flume and working well.
If someone have same problem, please refer it.
thanks.
> S3 Source
> ---------
>
> Key: FLUME-2437
> URL: https://issues.apache.org/jira/browse/FLUME-2437
> Project: Flume
> Issue Type: New Feature
> Reporter: Jonathan Natkins
> Assignee: Johny Rufus
> Fix For: v2.0.0
>
> Attachments: FLUME-2437-2.patch, FLUME-2437.patch
>
>
> There have been multiple requests on the mailing list for an S3 source
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
