David Ribeiro Alves has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/8921 )
Change subject: KUDU-2249 Avoid sharing the client between the InputFormat and RecordReader ...................................................................... KUDU-2249 Avoid sharing the client between the InputFormat and RecordReader This commit prevents a possible race condition between getSplits() method and TableRecordReader in the KuduTableInputFormat, when both try to access and shutdown the KuduClient. Both are sharing the same client and shut it down after use. In some scenarios the client might still be accessed after that and throwing an error. So the TableRecordReader gets its own client with this commit. This increases the number of opened Kudu clients by a MR application at most by one (The one that was shared by getSplits() with a TableRecordReader) Also clarified the behaviour of MR applications and how many open Kudu clients one might have to expect in total. Change-Id: I24f45ee9253790c5348cabd0afe6c6a4b6d3f3d4 Reviewed-on: http://gerrit.cloudera.org:8080/8921 Tested-by: Kudu Jenkins Reviewed-by: David Ribeiro Alves <davidral...@gmail.com> --- M java/kudu-mapreduce/src/main/java/org/apache/kudu/mapreduce/KuduTableInputFormat.java 1 file changed, 45 insertions(+), 21 deletions(-) Approvals: Kudu Jenkins: Verified David Ribeiro Alves: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/8921 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I24f45ee9253790c5348cabd0afe6c6a4b6d3f3d4 Gerrit-Change-Number: 8921 Gerrit-PatchSet: 6 Gerrit-Owner: Clemens Valiente <clemens.valie...@gmail.com> Gerrit-Reviewer: Clemens Valiente <clemens.valie...@gmail.com> Gerrit-Reviewer: David Ribeiro Alves <davidral...@gmail.com> Gerrit-Reviewer: Kudu Jenkins
