AmeerAssi opened a new pull request #127:
URL: https://github.com/apache/atlas/pull/127


   objectPrefix attribute in aws_s3_v2_directory is a required field, in 
addition its isUnique property is true.
   
   based on the test here: (see verifyS3V2PseudoDir)
   
https://github.com/apache/atlas/blob/d27790dfdde09a58db15064bbdaf77d224f61ecc/common/src/test/java/org/apache/atlas/utils/AtlasPathExtractorUtilTest.java
   
   if we have 2 AWS S3 files from different buckets:
   1. s3://aws_my_bucket1/1234567890/test.csv
   2. s3://aws_my_bucket2/1234567890/test.csv
   
   as you see there is 2 different directories from different buckets, but 
having same objectPrefix, and different qualified name.
   
   object 1:
   aws_s3_v2_directory: qualifiedName: "s3://aws_my_bucket1/1234567890/"
   objectPrefix: "/1234567890/"
   
   object 2:
   aws_s3_v2_directory:
   qualifiedName: "s3://aws_my_bucket2/1234567890/"
   objectPrefix: "/1234567890/"  
    
   which making the objectPrefix isUnique property conflicting with qualified 
name property.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to