[GitHub] [hadoop] steveloughran commented on pull request #2497: HADOOP-17338. Intermittent S3AInputStream failures: Premature end of …

2021-01-05 Thread GitBox
steveloughran commented on pull request #2497: URL: https://github.com/apache/hadoop/pull/2497#issuecomment-754614490 yes, use unbuffer if you can. It frees up the HTTPS connection. And while AWS S3 won't have problems, its probably good for other S3 stores as it will reduce the #of open

[GitHub] [hadoop] steveloughran commented on pull request #2497: HADOOP-17338. Intermittent S3AInputStream failures: Premature end of …

2021-01-04 Thread GitBox
steveloughran commented on pull request #2497: URL: https://github.com/apache/hadoop/pull/2497#issuecomment-753976842 > Great, thanks so much @steveloughran ! thank you for finding/fixing an obscure bug. Incidentally, if you are hanging on to streams for a long time. the

[GitHub] [hadoop] steveloughran commented on pull request #2497: HADOOP-17338. Intermittent S3AInputStream failures: Premature end of …

2020-12-18 Thread GitBox
steveloughran commented on pull request #2497: URL: https://github.com/apache/hadoop/pull/2497#issuecomment-748271861 ok. merged to trunk & just doing the 3.3 branch now This is an automated message from the Apache Git

[GitHub] [hadoop] steveloughran commented on pull request #2497: HADOOP-17338. Intermittent S3AInputStream failures: Premature end of …

2020-12-12 Thread GitBox
steveloughran commented on pull request #2497: URL: https://github.com/apache/hadoop/pull/2497#issuecomment-743760498 thanks, I'll try and look @ this week. First I'll have to look at the previous one to remember where we had got to on that...I don't want to suddenly be inconsistent with

[GitHub] [hadoop] steveloughran commented on pull request #2497: HADOOP-17338. Intermittent S3AInputStream failures: Premature end of …

2020-12-12 Thread GitBox
steveloughran commented on pull request #2497: URL: https://github.com/apache/hadoop/pull/2497#issuecomment-743759137 if your test setup doesn' t have session credentials, don't worry about it. What are you testing against? AWS or something internal?