steveloughran commented on pull request #2497:
URL: https://github.com/apache/hadoop/pull/2497#issuecomment-754614490
yes, use unbuffer if you can. It frees up the HTTPS connection. And while
AWS S3 won't have problems, its probably good for other S3 stores as it will
reduce the #of open
steveloughran commented on pull request #2497:
URL: https://github.com/apache/hadoop/pull/2497#issuecomment-753976842
> Great, thanks so much @steveloughran !
thank you for finding/fixing an obscure bug.
Incidentally, if you are hanging on to streams for a long time. the
steveloughran commented on pull request #2497:
URL: https://github.com/apache/hadoop/pull/2497#issuecomment-748271861
ok. merged to trunk & just doing the 3.3 branch now
This is an automated message from the Apache Git
steveloughran commented on pull request #2497:
URL: https://github.com/apache/hadoop/pull/2497#issuecomment-743760498
thanks, I'll try and look @ this week. First I'll have to look at the
previous one to remember where we had got to on that...I don't want to suddenly
be inconsistent with
steveloughran commented on pull request #2497:
URL: https://github.com/apache/hadoop/pull/2497#issuecomment-743759137
if your test setup doesn' t have session credentials, don't worry about it.
What are you testing against? AWS or something internal?