[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=580965&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-580965 ]
ASF GitHub Bot logged work on HADOOP-17536: ------------------------------------------- Author: ASF GitHub Bot Created on: 12/Apr/21 13:02 Start Date: 12/Apr/21 13:02 Worklog Time Spent: 10m Work Description: hadoop-yetus removed a comment on pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#issuecomment-810443755 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |:----:|----------:|--------:|:--------:|:-------:| | +0 :ok: | reexec | 0m 59s | | Docker mode activated. | |||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. | | +0 :ok: | codespell | 0m 1s | | codespell was not available. | | +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 5 new or modified test files. | |||| _ trunk Compile Tests _ | | +1 :green_heart: | mvninstall | 32m 57s | | trunk passed | | +1 :green_heart: | compile | 0m 38s | | trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 | | +1 :green_heart: | compile | 0m 30s | | trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 | | +1 :green_heart: | checkstyle | 0m 26s | | trunk passed | | +1 :green_heart: | mvnsite | 0m 40s | | trunk passed | | +1 :green_heart: | javadoc | 0m 31s | | trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 | | +1 :green_heart: | javadoc | 0m 30s | | trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 | | +1 :green_heart: | spotbugs | 1m 0s | | trunk passed | | +1 :green_heart: | shadedclient | 14m 48s | | branch has no errors when building and testing our client artifacts. | | -0 :warning: | patch | 15m 5s | | Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary. | |||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 0m 30s | | the patch passed | | +1 :green_heart: | compile | 0m 28s | | the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 | | +1 :green_heart: | javac | 0m 28s | | the patch passed | | +1 :green_heart: | compile | 0m 27s | | the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 | | +1 :green_heart: | javac | 0m 27s | | the patch passed | | +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. | | -0 :warning: | checkstyle | 0m 17s | [/results-checkstyle-hadoop-tools_hadoop-azure.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2707/8/artifact/out/results-checkstyle-hadoop-tools_hadoop-azure.txt) | hadoop-tools/hadoop-azure: The patch generated 4 new + 9 unchanged - 0 fixed = 13 total (was 9) | | +1 :green_heart: | mvnsite | 0m 28s | | the patch passed | | +1 :green_heart: | xml | 0m 1s | | The patch has no ill-formed XML file. | | +1 :green_heart: | javadoc | 0m 22s | | the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 | | +1 :green_heart: | javadoc | 0m 21s | | the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 | | -1 :x: | spotbugs | 1m 6s | [/new-spotbugs-hadoop-tools_hadoop-azure.html](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2707/8/artifact/out/new-spotbugs-hadoop-tools_hadoop-azure.html) | hadoop-tools/hadoop-azure generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0) | | +1 :green_heart: | shadedclient | 14m 18s | | patch has no errors when building and testing our client artifacts. | |||| _ Other Tests _ | | +1 :green_heart: | unit | 2m 5s | | hadoop-azure in the patch passed. | | +1 :green_heart: | asflicense | 0m 31s | | The patch does not generate ASF License warnings. | | | | 75m 11s | | | | Reason | Tests | |-------:|:------| | SpotBugs | module:hadoop-tools/hadoop-azure | | | Questionable use of non-short-circuit logic in org.apache.hadoop.fs.azurebfs.services.AbfsIoUtils.dumpHeadersToDebugLog(String, List) At AbfsIoUtils.java:in org.apache.hadoop.fs.azurebfs.services.AbfsIoUtils.dumpHeadersToDebugLog(String, List) At AbfsIoUtils.java:[line 75] | | | httpOperation could be null and is guaranteed to be dereferenced in org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.executeHttpOperation(int) Dereferenced at AbfsRestOperation.java:is guaranteed to be dereferenced in org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.executeHttpOperation(int) Dereferenced at AbfsRestOperation.java:[line 291] | | | httpOperation could be null and is guaranteed to be dereferenced in org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.executeHttpOperation(int) Dereferenced at AbfsRestOperation.java:is guaranteed to be dereferenced in org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.executeHttpOperation(int) Dereferenced at AbfsRestOperation.java:[line 291] | | | httpOperation is null guaranteed to be dereferenced in org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.executeHttpOperation(int) on exception path Dereferenced at AbfsRestOperation.java:be dereferenced in org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.executeHttpOperation(int) on exception path Dereferenced at AbfsRestOperation.java:[line 291] | | Subsystem | Report/Notes | |----------:|:-------------| | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2707/8/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hadoop/pull/2707 | | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml | | uname | Linux c27a14dc41c6 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/bin/hadoop.sh | | git revision | trunk / 0c04e502c510afb56cb094b39d2c3649b0e93dba | | Default Java | Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 | | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 | | Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2707/8/testReport/ | | Max. process+thread count | 668 (vs. ulimit of 5500) | | modules | C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure | | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2707/8/console | | versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 | | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 580965) Time Spent: 9h 10m (was: 9h) > ABFS: Suport for customer provided encrption key > ------------------------------------------------ > > Key: HADOOP-17536 > URL: https://issues.apache.org/jira/browse/HADOOP-17536 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/azure > Affects Versions: 3.4.0 > Reporter: Bilahari T H > Assignee: Bilahari T H > Priority: Minor > Labels: pull-request-available > Time Spent: 9h 10m > Remaining Estimate: 0h > > The data for a particular customer needs to be encrypted on account level. At > server side the APIs will start accepting the encryption key as part of > request headers. The data will be encrypted/decrypted with the given key at > the server. > Since the ABFS FileSystem APIs are implementations for Hadoop FileSystem APIs > there is no direct way with which customer can pass the key to ABFS driver. > In this case driver should have the following capabilities so that it can > accept and pass the encryption key as one of the request headers. > # There should be a way to configure the encryption key for different > accounts. > # If there is a key specified for a particular account, the same needs to be > sent along with the request headers. > *Config changes* > They key for an account can be specified in the core-site as follows. > fs.azure.account.client-provided-encryption-key.{account > name}.dfs.core.windows.net -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org