steveloughran opened a new pull request, #6515:
URL: https://github.com/apache/hadoop/pull/6515

   Moves to new test file/bucket
   
   s3a://nyc-tlc/trip data/fhvhv_tripdata_2019-02.parquet
   
   this is actually quite an interesting path as it has a space in and breaks 
s3guard tool uri parsing. fix: those tests just take the root schema/host and 
not the rest
   
   Rename all methods about ExternalFile rather than CSV file, as we no longer 
expect it to be CSV.
   
   Leaves the test key name alone: fs.s3a.scale.test.csvfile
   
   ### How was this patch tested?
   
   Indentification of all test suites using the file, running through the IDE.
   One Failure: ITestS3AAWSCredentialsProvider.testAnonymousProvider(); the 
store doesn't take anonymous credentials.
   
   Full test ongoing.
   
   Because of the failure and the way the space in the path breaks the 
ITestS3GuardTool test, I'm not sure this is the right dataset. I'd prefer data 
in a bucket which supports anonymous access.
   
   
   ### For code changes:
   
   - [X] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the 
endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, 
`NOTICE-binary` files?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to