Repository: zeppelin Updated Branches: refs/heads/branch-0.8 cb3b0f4b3 -> ea861f456
ZEPPELIN-3745. Disable CRC check of hadoop FileSystem ### What is this PR for? Trivial PR to disable CRC check of hadoop FileSystem, otherwise we may get error if we manually change the file content of interpreter-setting.json ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-3745 ### How should this be tested? * CI pass ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #3162 from zjffdu/ZEPPELIN-3745 and squashes the following commits: 67dc70df2 [Jeff Zhang] ZEPPELIN-3745. Disable CRC check of hadoop FileSystem (cherry picked from commit 26b554d64123490ceee1b05c77e3ea51dbff6412) Signed-off-by: Jeff Zhang <zjf...@apache.org> Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://git-wip-us.apache.org/repos/asf/zeppelin/commit/ea861f45 Tree: http://git-wip-us.apache.org/repos/asf/zeppelin/tree/ea861f45 Diff: http://git-wip-us.apache.org/repos/asf/zeppelin/diff/ea861f45 Branch: refs/heads/branch-0.8 Commit: ea861f4563196908301cb4c3aed6eda893a6d862 Parents: cb3b0f4 Author: Jeff Zhang <zjf...@apache.org> Authored: Fri Aug 24 10:08:08 2018 +0800 Committer: Jeff Zhang <zjf...@apache.org> Committed: Thu Aug 30 11:23:39 2018 +0800 ---------------------------------------------------------------------- .../main/java/org/apache/zeppelin/notebook/FileSystemStorage.java | 2 ++ 1 file changed, 2 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/zeppelin/blob/ea861f45/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java ---------------------------------------------------------------------- diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java index 4670e20..ebec118 100644 --- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java +++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java @@ -62,6 +62,8 @@ public class FileSystemStorage { this.hadoopConf = new Configuration(); // disable checksum for local file system. because interpreter.json may be updated by // non-hadoop filesystem api + // disable caching for file:// scheme to avoid getting LocalFS which does CRC checks + this.hadoopConf.setBoolean("fs.file.impl.disable.cache", true); this.hadoopConf.set("fs.file.impl", RawLocalFileSystem.class.getName()); this.isSecurityEnabled = UserGroupInformation.isSecurityEnabled();
