[
https://issues.apache.org/jira/browse/HADOOP-18184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17840473#comment-17840473
]
ASF GitHub Bot commented on HADOOP-18184:
-----------------------------------------
steveloughran commented on PR #5832:
URL: https://github.com/apache/hadoop/pull/5832#issuecomment-2075157859
There's some race condition with the list add/evict causing intermittent
failures of one of the tests. Looks like the failure condition is
* block has just been evicted
* read() says block is in cache
* read is attempted
* read fails with FNFE.
Suspect there's some kind of list update issue.
Improved logging but not yet fixed this.
```
2024-04-24 15:57:22,711 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initializeClass(5724)) - Initialize S3A class
2024-04-24 15:57:22,734 [setup] DEBUG s3a.S3ATestUtils
(S3ATestUtils.java:removeBucketOverrides(914)) - Removing option
fs.s3a.bucket.stevel-london.directory.marker.retention; was keep
2024-04-24 15:57:22,757 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initializeClass(5724)) - Initialize S3A class
2024-04-24 15:57:22,771 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(549)) - Initializing S3AFileSystem for
stevel-london
2024-04-24 15:57:22,774 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1103)) - Propagating entries under
fs.s3a.bucket.stevel-london.
2024-04-24 15:57:22,777 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating fs.s3a.versioned.store
from [core-site.xml]
2024-04-24 15:57:22,777 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating
fs.s3a.encryption.algorithm from [core-site.xml]
2024-04-24 15:57:22,777 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating fs.s3a.endpoint from
[core-site.xml]
2024-04-24 15:57:22,777 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating fs.s3a.encryption.key
from [core-site.xml]
2024-04-24 15:57:22,777 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating
fs.s3a.change.detection.source from [core-site.xml]
2024-04-24 15:57:22,778 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:maybeIsolateClassloader(1708)) - Configuration classloader set
to S3AFileSystem classloader: sun.misc.Launcher$AppClassLoader@18b4aac2
2024-04-24 15:57:22,783 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:buildEncryptionSecrets(1477)) - Using SSE-KMS with key of length
75 ending with 3
2024-04-24 15:57:22,784 [setup] DEBUG s3a.S3ARetryPolicy
(S3ARetryPolicy.java:<init>(145)) - Retrying on recoverable AWS failures 3
times with an initial interval of 500ms
2024-04-24 15:57:22,911 [setup] DEBUG s3a.S3AInstrumentation
(S3AInstrumentation.java:getMetricsSystem(254)) - Metrics system inited
org.apache.hadoop.metrics2.impl.MetricsSystemImpl@6425ab69
2024-04-24 15:57:22,917 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(605)) - Client Side Encryption enabled: false
2024-04-24 15:57:22,917 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.paging.maximum is 5000
2024-04-24 15:57:22,917 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.block.size is 33554432
2024-04-24 15:57:22,918 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.prefetch.block.size is
131072
2024-04-24 15:57:22,918 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.prefetch.block.count is 8
2024-04-24 15:57:22,918 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.max.total.tasks is 32
2024-04-24 15:57:22,920 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.threads.keepalivetime = PT1M
2024-04-24 15:57:22,920 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.executor.capacity is 16
2024-04-24 15:57:22,937 [setup] DEBUG auth.SignerManager
(SignerManager.java:initCustomSigners(68)) - No custom signers specified
2024-04-24 15:57:22,940 [setup] DEBUG audit.AuditIntegration
(AuditIntegration.java:createAndInitAuditor(109)) - Auditor class is class
org.apache.hadoop.fs.s3a.audit.impl.LoggingAuditor
2024-04-24 15:57:22,943 [setup] DEBUG impl.ActiveAuditManagerS3A
(ActiveAuditManagerS3A.java:serviceInit(199)) - Audit manager initialized with
audit service LoggingAuditor{ID='0d643328-91f6-4da7-acae-86fd72161299',
headerEnabled=true, rejectOutOfSpan=true, isMultipartUploadEnabled=true}
2024-04-24 15:57:22,943 [setup] DEBUG impl.ActiveAuditManagerS3A
(ActiveAuditManagerS3A.java:serviceStart(212)) - Started audit service
LoggingAuditor{ID='0d643328-91f6-4da7-acae-86fd72161299', headerEnabled=true,
rejectOutOfSpan=true, isMultipartUploadEnabled=true}
2024-04-24 15:57:22,943 [setup] DEBUG audit.AuditIntegration
(AuditIntegration.java:createAndStartAuditManager(76)) - Started Audit Manager
Service ActiveAuditManagerS3A in state ActiveAuditManagerS3A: STARTED,
auditor=LoggingAuditor{ID='0d643328-91f6-4da7-acae-86fd72161299',
headerEnabled=true, rejectOutOfSpan=true, isMultipartUploadEnabled=true}}
2024-04-24 15:57:22,944 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longOption(930)) - Value of
fs.s3a.internal.upload.part.count.limit is 10000
2024-04-24 15:57:22,944 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:createRequestFactory(1202)) - Unset storage class property
fs.s3a.create.storage.class; falling back to default storage class
2024-04-24 15:57:22,949 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSV2CredentialProvider(306)) -
Credential provider class is
org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
2024-04-24 15:57:22,949 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSV2CredentialProvider(306)) -
Credential provider class is
org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
2024-04-24 15:57:22,950 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSCredentialProviderList(151)) - For
URI s3a://stevel-london/, using credentials AWSCredentialProviderList name=;
refcount= 1; size=2: [TemporaryAWSCredentialsProvider,
SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}]
2024-04-24 15:57:22,950 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:bindAWSClient(1047)) - Using credential provider
AWSCredentialProviderList name=; refcount= 1; size=2:
[TemporaryAWSCredentialsProvider,
SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}]
2024-04-24 15:57:22,952 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.connection.maximum is 512
2024-04-24 15:57:22,952 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.acquisition.timeout = PT1M
2024-04-24 15:57:22,952 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of fs.s3a.connection.ttl
= PT5M
2024-04-24 15:57:22,952 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.establish.timeout = PT30S
2024-04-24 15:57:22,952 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.idle.time = PT1M
2024-04-24 15:57:22,952 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.timeout = PT25S
2024-04-24 15:57:23,085 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:getS3RegionFromEndpoint(397)) - Endpoint
s3.eu-west-2.amazonaws.com is not the default; parsing
2024-04-24 15:57:23,090 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(326)) - Setting
endpoint to https://s3.eu-west-2.amazonaws.com
2024-04-24 15:57:23,091 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(353)) - Setting region
to eu-west-2 from endpoint
2024-04-24 15:57:23,091 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:maybeApplyS3AccessGrantsConfigurations(419)) - S3
Access Grants plugin is not enabled.
2024-04-24 15:57:23,095 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.request.timeout = PT1M
2024-04-24 15:57:23,097 [setup] DEBUG impl.AWSClientConfig
(AWSClientConfig.java:initUserAgent(375)) - Using User-Agent: Hadoop
3.5.0-SNAPSHOT
2024-04-24 15:57:23,105 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.attempts.maximum is 2
2024-04-24 15:57:23,407 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.connection.maximum is 512
2024-04-24 15:57:23,407 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.acquisition.timeout = PT1M
2024-04-24 15:57:23,408 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of fs.s3a.connection.ttl
= PT5M
2024-04-24 15:57:23,408 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.establish.timeout = PT30S
2024-04-24 15:57:23,408 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.idle.time = PT1M
2024-04-24 15:57:23,408 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.timeout = PT25S
2024-04-24 15:57:23,430 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:getS3RegionFromEndpoint(397)) - Endpoint
s3.eu-west-2.amazonaws.com is not the default; parsing
2024-04-24 15:57:23,430 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(326)) - Setting
endpoint to https://s3.eu-west-2.amazonaws.com
2024-04-24 15:57:23,430 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(353)) - Setting region
to eu-west-2 from endpoint
2024-04-24 15:57:23,430 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:maybeApplyS3AccessGrantsConfigurations(419)) - S3
Access Grants plugin is not enabled.
2024-04-24 15:57:23,430 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.request.timeout = PT1M
2024-04-24 15:57:23,430 [setup] DEBUG impl.AWSClientConfig
(AWSClientConfig.java:initUserAgent(375)) - Using User-Agent: Hadoop
3.5.0-SNAPSHOT
2024-04-24 15:57:23,431 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.attempts.maximum is 2
2024-04-24 15:57:23,512 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:doBucketProbing(831)) - skipping check for bucket existence
2024-04-24 15:57:23,513 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(696)) - Input fadvise policy = default
2024-04-24 15:57:23,514 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(698)) - Change detection policy =
VersionIdChangeDetectionPolicy mode=Server
2024-04-24 15:57:23,514 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(702)) - Filesystem support for magic committers
is enabled
2024-04-24 15:57:23,516 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.fast.upload.active.blocks is 4
2024-04-24 15:57:23,517 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(721)) - Using S3ABlockOutputStream with buffer =
disk; block=67108864; queue limit=4; multipart=true
2024-04-24 15:57:23,517 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(731)) - fs.s3a.create.performance = false
2024-04-24 15:57:23,518 [setup] DEBUG impl.DirectoryPolicyImpl
(DirectoryPolicyImpl.java:getDirectoryPolicy(189)) - Directory markers will be
kept
2024-04-24 15:57:23,518 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(737)) - Directory marker retention policy is
DirectoryMarkerRetention{policy='keep'}
2024-04-24 15:57:23,518 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.bulk.delete.page.size is 250
2024-04-24 15:57:23,519 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.readahead.range is 32768
2024-04-24 15:57:23,519 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of io.file.buffer.size is 4194304
2024-04-24 15:57:23,519 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.input.async.drain.threshold is 1024
2024-04-24 15:57:23,519 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.vectored.active.ranged.reads
is 4
2024-04-24 15:57:23,519 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.vectored.read.min.seek.size is 4096
2024-04-24 15:57:23,519 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.vectored.read.max.merged.size is 1048576
2024-04-24 15:57:23,520 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(763)) - Using optimized copyFromLocal
implementation: true
2024-04-24 15:57:23,529 [setup] INFO contract.AbstractFSContractTestBase
(AbstractFSContractTestBase.java:setup(196)) - Test filesystem =
s3a://stevel-london implemented by S3AFileSystem{uri=s3a://stevel-london,
workingDir=s3a://stevel-london/user/stevel, partSize=67108864,
enableMultiObjectsDelete=true, maxKeys=5000,
OpenFileSupport{changePolicy=VersionIdChangeDetectionPolicy mode=Server,
defaultReadAhead=32768, defaultBufferSize=4194304,
defaultAsyncDrainThreshold=1024, defaultInputPolicy=default},
blockSize=33554432, multiPartThreshold=134217728,
s3EncryptionAlgorithm='SSE_KMS',
blockFactory=org.apache.hadoop.fs.s3a.S3ADataBlocks$DiskBlockFactory@1fea9f7c,
auditManager=Service ActiveAuditManagerS3A in state ActiveAuditManagerS3A:
STARTED, auditor=LoggingAuditor{ID='0d643328-91f6-4da7-acae-86fd72161299',
headerEnabled=true, rejectOutOfSpan=true, isMultipartUploadEnabled=true}},
authoritativePath=[], useListV1=false, magicCommitter=true,
boundedExecutor=BlockingThreadPoolExecutorService{SemaphoredDelegatingExecutor{permitCount=200,
available=200, waiting=0}, activeCount=0},
unboundedExecutor=java.util.concurrent.ThreadPoolExecutor@78d0d3c0[Running,
pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0],
credentials=AWSCredentialProviderList name=; refcount= 1; size=2:
[TemporaryAWSCredentialsProvider,
SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}],
delegation tokens=disabled, DirectoryMarkerRetention{policy='keep'},
instrumentation
{S3AInstrumentation{instanceIOStatistics=counters=((op_get_delegation_token.failures=0)
(committer_commits_completed=0) (stream_read_bytes_discarded_in_close=0)
(stream_write_queue_duration.failures=0) (stream_read_vectored_operations=0)
(delegation_tokens_issued=0) (stream_read_total_bytes=0)
(store_exists_probe.failures=0) (stream_write_exceptions_completing_upload=0)
(stream_read_seek_operations=0) (op_mkdirs=0) (committer_commits_created=0)
(object_put_request_completed=0) (directories_created=0) (op_hflush=0)
(stream_write_block_uploads_aborted=0) (op_get_file_status.failures=0)
(object_multipart_initiated=0) (committer_magic_marker_put.failures=0)
(op_exists=0) (stream_read_seek_forward_operations=0)
(committer_commits_aborted=0) (object_continue_list_request=0)
(op_is_directory=0) (audit_access_check_failure=0)
(committer_commits.failures=0) (op_xattr_list.failures=0)
(multipart_upload_completed=0) (object_put_bytes=0)
(object_multipart_aborted.failures=0) (action_executor_acquired=0)
(stream_write_total_data=0) (action_http_get_request.failures=0)
(op_xattr_get_named=0) (stream_aborted=0) (files_copied_bytes=0)
(multipart_upload_list=0) (stream_read_closed=0)
(multipart_upload_list.failures=0) (object_copy_requests=0)
(committer_materialize_file.failures=0) (op_is_file=0) (files_copied=0)
(op_open=0) (op_access.failures=0) (directories_deleted=0)
(stream_read_operations=0) (action_executor_acquired.failures=0)
(store_io_throttled=0) (op_rename.failures=0) (committer_jobs_failed=0)
(committer_tasks_completed=0) (op_is_directory.failures=0) (op_createfile=0)
(stream_read_bytes_discarded_in_abort=0) (files_deleted=0)
(stream_read_block_acquire_read=0) (object_delete_request.failures=0)
(object_multipart_initiated.failures=0) (op_list_files.failures=0)
(fake_directories_deleted=0) (stream_read_seek_bytes_skipped=0) (op_delete=0)
(object_delete_objects=0) (op_create.failures=0) (object_metadata_request=0)
(op_xattr_get_named_map.failures=0) (stream_read_close_operations=0)
(op_access=0) (op_copy_from_local_file=0) (op_rename=0)
(committer_stage_file_upload.failures=0) (multipart_upload_part_put_bytes=0)
(multipart_upload_part_put=0) (stream_write_exceptions=0)
(stream_read_unbuffered=0) (stream_evict_blocks_from_cache=0)
(committer_tasks_failed=0) (op_get_content_summary.failures=0)
(object_put_request.failures=0) (stream_read_operations_incomplete=0)
(fake_directories_created=0) (stream_write_total_time=0)
(op_get_file_checksum=0) (committer_commits_reverted=0)
(op_xattr_get_map.failures=0) (action_http_head_request.failures=0)
(op_abort=0) (audit_span_creation=1) (op_delete.failures=0)
(action_file_opened.failures=0) (committer_load_single_pending_file=0)
(store_io_request=0) (stream_read_version_mismatches=0)
(op_get_content_summary=0) (stream_file_cache_eviction=0)
(object_multipart_list.failures=0) (committer_bytes_uploaded=0)
(committer_load_single_pending_file.failures=0)
(stream_read_remote_stream_drain.failures=0) (op_xattr_list=0)
(committer_materialize_file=0) (stream_write_bytes=0)
(stream_read_block_fetch_operations.failures=0) (stream_read_opened=0)
(object_put_request=0) (store_io_retry=0)
(stream_read_bytes_backwards_on_seek=0) (object_multipart_list=0)
(op_xattr_get_named.failures=0) (op_get_delegation_token=0)
(stream_read_seek_backward_operations=0) (op_get_file_status=0)
(stream_read_remote_stream_aborted.failures=0) (op_openfile=0) (op_create=0)
(stream_file_cache_eviction.failures=0) (op_xattr_get_named_map=0)
(op_mkdirs.failures=0) (op_create_non_recursive=0) (files_delete_rejected=0)
(committer_commit_job=0) (ignored_errors=0) (audit_request_execution=0)
(stream_read_seek_policy_changed=0) (stream_read_seek_bytes_discarded=0)
(op_is_file.failures=0) (multipart_upload_started=0) (store_exists_probe=0)
(op_exists.failures=0) (op_get_file_checksum.failures=0) (op_list_files=0)
(op_abort.failures=0) (committer_stage_file_upload=0)
(stream_read_vectored_combined_ranges=0)
(object_bulk_delete_request.failures=0) (stream_write_block_uploads=0)
(audit_failure=0) (committer_magic_files_created=0) (op_hsync=0)
(action_http_get_request=0) (stream_read_bytes=0)
(op_copy_from_local_file.failures=0)
(multipart_upload_abort_under_path_invoked=0) (op_list_located_status=0)
(op_glob_status.failures=0) (object_continue_list_request.failures=0)
(object_multipart_aborted=0) (op_list_status=0)
(stream_write_block_uploads_committed=0) (object_bulk_delete_request=0)
(stream_write_queue_duration=0) (stream_read_fully_operations=0)
(stream_read_block_fetch_operations=0)
(stream_read_block_acquire_read.failures=0) (action_file_opened=0)
(op_xattr_get_map=0) (committer_magic_marker_put=0)
(stream_read_remote_stream_drain=0) (multipart_instantiated=0)
(stream_read_remote_stream_aborted=0) (object_delete_request=0)
(delegation_tokens_issued.failures=0) (op_list_status.failures=0)
(multipart_upload_aborted=0) (files_created=0) (object_list_request.failures=0)
(committer_jobs_completed=0) (committer_bytes_committed=0)
(committer_commit_job.failures=0) (op_glob_status=0)
(stream_read_vectored_read_bytes_discarded=0) (action_http_head_request=0)
(stream_read_exceptions=0) (op_createfile.failures=0)
(stream_read_vectored_incoming_ranges=0) (object_list_request=0));
gauges=((stream_read_block_prefetch_enabled=0) (object_put_request_active=0)
(stream_read_block_fetch_operations=0) (stream_read_block_cache_enabled=0)
(stream_read_blocks_in_cache=0) (stream_write_block_uploads_active=0)
(client_side_encryption_enabled=0) (stream_read_block_prefetch_limit=0)
(stream_read_active_memory_in_use=0) (stream_write_block_uploads_pending=0)
(stream_write_block_uploads_data_pending=0) (object_put_bytes_pending=0)
(stream_read_block_size=0) (stream_read_active_prefetch_operations=0));
minimums=((op_create.failures.min=-1)
(object_continue_list_request.failures.min=-1)
(object_continue_list_request.min=-1) (object_delete_request.min=-1)
(op_is_directory.min=-1) (stream_read_remote_stream_drain.failures.min=-1)
(op_xattr_get_named.failures.min=-1) (store_exists_probe.failures.min=-1)
(stream_file_cache_eviction.min=-1)
(committer_materialize_file.failures.min=-1)
(committer_load_single_pending_file.failures.min=-1)
(op_xattr_get_named.min=-1) (object_multipart_aborted.failures.min=-1)
(op_delete.min=-1) (op_get_delegation_token.min=-1)
(op_get_file_checksum.min=-1) (object_list_request.failures.min=-1)
(object_bulk_delete_request.failures.min=-1) (op_list_status.failures.min=-1)
(op_access.failures.min=-1) (action_http_head_request.min=-1)
(object_multipart_list.min=-1) (op_get_file_status.min=-1)
(action_http_get_request.failures.min=-1)
(stream_write_queue_duration.failures.min=-1)
(committer_magic_marker_put.min=-1) (store_exists_probe.min=-1)
(stream_read_remote_stream_aborted.failures.min=-1)
(op_glob_status.failures.min=-1) (op_list_status.min=-1)
(object_multipart_list.failures.min=-1) (op_delete.failures.min=-1)
(committer_commit_job.failures.min=-1)
(delegation_tokens_issued.failures.min=-1) (op_rename.min=-1)
(object_delete_request.failures.min=-1) (op_glob_status.min=-1)
(op_abort.failures.min=-1) (object_multipart_initiated.min=-1)
(committer_magic_marker_put.failures.min=-1) (op_createfile.min=-1)
(op_exists.min=-1) (op_copy_from_local_file.min=-1) (op_exists.failures.min=-1)
(op_mkdirs.min=-1) (action_http_get_request.min=-1)
(multipart_upload_list.failures.min=-1) (committer_commit_job.min=-1)
(op_get_file_checksum.failures.min=-1) (op_list_files.failures.min=-1)
(object_list_request.min=-1)
(stream_read_block_fetch_operations.failures.min=-1)
(op_xattr_get_named_map.min=-1) (op_get_content_summary.failures.min=-1)
(stream_read_remote_stream_aborted.min=-1) (committer_stage_file_upload.min=-1)
(object_bulk_delete_request.min=-1) (op_get_content_summary.min=-1)
(op_get_file_status.failures.min=-1) (multipart_upload_list.min=-1)
(op_xattr_get_map.min=-1) (op_copy_from_local_file.failures.min=-1)
(action_executor_acquired.min=-1) (stream_read_block_fetch_operations.min=-1)
(op_xattr_list.min=-1) (stream_file_cache_eviction.failures.min=-1)
(object_put_request.failures.min=-1) (op_abort.min=-1) (op_create.min=-1)
(delegation_tokens_issued.min=-1) (action_http_head_request.failures.min=-1)
(committer_load_single_pending_file.min=-1) (op_is_file.failures.min=-1)
(op_xattr_get_map.failures.min=-1) (object_multipart_aborted.min=-1)
(op_createfile.failures.min=-1) (stream_read_remote_stream_drain.min=-1)
(op_xattr_list.failures.min=-1)
(stream_read_block_acquire_read.failures.min=-1)
(committer_materialize_file.min=-1) (op_access.min=-1)
(action_file_opened.failures.min=-1) (op_is_file.min=-1)
(object_put_request.min=-1) (op_list_files.min=-1) (op_rename.failures.min=-1)
(op_xattr_get_named_map.failures.min=-1) (stream_write_queue_duration.min=-1)
(stream_read_block_acquire_read.min=-1)
(object_multipart_initiated.failures.min=-1)
(committer_stage_file_upload.failures.min=-1) (op_is_directory.failures.min=-1)
(op_mkdirs.failures.min=-1) (op_get_delegation_token.failures.min=-1)
(action_executor_acquired.failures.min=-1) (action_file_opened.min=-1));
maximums=((action_http_get_request.max=-1)
(object_delete_request.failures.max=-1)
(action_executor_acquired.failures.max=-1) (op_xattr_get_named.max=-1)
(op_xattr_get_named_map.max=-1) (object_continue_list_request.failures.max=-1)
(committer_magic_marker_put.failures.max=-1)
(object_multipart_initiated.max=-1) (committer_commit_job.failures.max=-1)
(stream_file_cache_eviction.failures.max=-1) (op_glob_status.failures.max=-1)
(op_delete.failures.max=-1)
(stream_read_block_fetch_operations.failures.max=-1)
(object_bulk_delete_request.failures.max=-1)
(store_exists_probe.failures.max=-1) (op_delete.max=-1)
(object_multipart_list.failures.max=-1)
(stream_write_queue_duration.failures.max=-1)
(object_multipart_aborted.failures.max=-1) (op_xattr_get_named.failures.max=-1)
(op_mkdirs.failures.max=-1) (op_xattr_get_map.max=-1)
(object_continue_list_request.max=-1) (op_abort.max=-1)
(op_get_file_checksum.max=-1)
(stream_read_remote_stream_aborted.failures.max=-1)
(object_multipart_list.max=-1) (op_create.max=-1)
(object_list_request.failures.max=-1) (action_http_get_request.failures.max=-1)
(op_get_content_summary.max=-1) (op_get_file_status.failures.max=-1)
(stream_write_queue_duration.max=-1) (action_http_head_request.failures.max=-1)
(op_get_delegation_token.max=-1) (op_copy_from_local_file.max=-1)
(op_exists.failures.max=-1) (action_http_head_request.max=-1)
(op_is_directory.failures.max=-1) (committer_materialize_file.failures.max=-1)
(op_access.failures.max=-1) (op_createfile.max=-1)
(object_bulk_delete_request.max=-1) (object_multipart_aborted.max=-1)
(op_copy_from_local_file.failures.max=-1) (object_list_request.max=-1)
(op_xattr_list.max=-1) (stream_read_remote_stream_aborted.max=-1)
(op_list_files.max=-1) (multipart_upload_list.max=-1)
(op_get_file_status.max=-1) (op_access.max=-1)
(op_get_content_summary.failures.max=-1) (committer_commit_job.max=-1)
(op_get_delegation_token.failures.max=-1) (committer_materialize_file.max=-1)
(multipart_upload_list.failures.max=-1) (op_xattr_get_map.failures.max=-1)
(action_file_opened.max=-1) (stream_read_remote_stream_drain.max=-1)
(object_multipart_initiated.failures.max=-1) (op_createfile.failures.max=-1)
(op_xattr_list.failures.max=-1) (delegation_tokens_issued.failures.max=-1)
(object_put_request.failures.max=-1) (op_create.failures.max=-1)
(delegation_tokens_issued.max=-1) (op_glob_status.max=-1)
(action_executor_acquired.max=-1)
(stream_read_block_acquire_read.failures.max=-1)
(action_file_opened.failures.max=-1) (op_xattr_get_named_map.failures.max=-1)
(stream_read_remote_stream_drain.failures.max=-1) (store_exists_probe.max=-1)
(object_delete_request.max=-1) (committer_load_single_pending_file.max=-1)
(op_list_status.max=-1) (stream_file_cache_eviction.max=-1)
(committer_stage_file_upload.failures.max=-1) (op_is_directory.max=-1)
(op_rename.failures.max=-1) (committer_magic_marker_put.max=-1)
(op_mkdirs.max=-1) (op_rename.max=-1) (op_exists.max=-1)
(committer_load_single_pending_file.failures.max=-1)
(stream_read_block_fetch_operations.max=-1) (op_is_file.max=-1)
(op_list_files.failures.max=-1) (object_put_request.max=-1)
(op_abort.failures.max=-1) (committer_stage_file_upload.max=-1)
(stream_read_block_acquire_read.max=-1) (op_list_status.failures.max=-1)
(op_get_file_checksum.failures.max=-1) (op_is_file.failures.max=-1));
means=((delegation_tokens_issued.failures.mean=(samples=0, sum=0,
mean=0.0000)) (op_access.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_get_content_summary.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_stage_file_upload.mean=(samples=0, sum=0, mean=0.0000))
(op_list_status.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_named_map.mean=(samples=0, sum=0, mean=0.0000))
(committer_magic_marker_put.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_is_file.mean=(samples=0, sum=0, mean=0.0000))
(op_glob_status.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_aborted.mean=(samples=0, sum=0, mean=0.0000))
(delegation_tokens_issued.mean=(samples=0, sum=0, mean=0.0000))
(object_delete_request.mean=(samples=0, sum=0, mean=0.0000))
(op_delete.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_abort.mean=(samples=0, sum=0, mean=0.0000))
(committer_magic_marker_put.mean=(samples=0, sum=0, mean=0.0000))
(action_executor_acquired.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_file_opened.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_copy_from_local_file.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_put_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_continue_list_request.mean=(samples=0, sum=0, mean=0.0000))
(op_is_directory.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_copy_from_local_file.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_block_acquire_read.mean=(samples=0, sum=0, mean=0.0000))
(op_glob_status.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_executor_acquired.mean=(samples=0, sum=0, mean=0.0000))
(op_create.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_list.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_aborted.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_materialize_file.mean=(samples=0, sum=0, mean=0.0000))
(action_http_get_request.mean=(samples=0, sum=0, mean=0.0000))
(object_delete_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_get_file_checksum.mean=(samples=0, sum=0, mean=0.0000))
(op_delete.mean=(samples=0, sum=0, mean=0.0000))
(action_file_opened.mean=(samples=0, sum=0, mean=0.0000))
(op_exists.mean=(samples=0, sum=0, mean=0.0000))
(op_abort.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_access.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_named_map.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_list_status.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_http_head_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_load_single_pending_file.failures.mean=(samples=0, sum=0,
mean=0.0000)) (op_mkdirs.mean=(samples=0, sum=0, mean=0.0000))
(op_get_delegation_token.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_write_queue_duration.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_createfile.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_named.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_http_get_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_map.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_file_cache_eviction.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_commit_job.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_initiated.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_list_files.mean=(samples=0, sum=0, mean=0.0000))
(op_createfile.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_block_fetch_operations.failures.mean=(samples=0, sum=0,
mean=0.0000)) (object_multipart_list.mean=(samples=0, sum=0, mean=0.0000))
(store_exists_probe.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_stage_file_upload.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_is_file.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_http_head_request.mean=(samples=0, sum=0, mean=0.0000))
(object_continue_list_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_get_file_status.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_get_file_checksum.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_is_directory.mean=(samples=0, sum=0, mean=0.0000))
(op_list_files.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_commit_job.mean=(samples=0, sum=0, mean=0.0000))
(op_rename.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_remote_stream_aborted.failures.mean=(samples=0, sum=0,
mean=0.0000)) (object_multipart_initiated.mean=(samples=0, sum=0, mean=0.0000))
(object_bulk_delete_request.mean=(samples=0, sum=0, mean=0.0000))
(op_rename.mean=(samples=0, sum=0, mean=0.0000))
(store_exists_probe.mean=(samples=0, sum=0, mean=0.0000))
(stream_write_queue_duration.mean=(samples=0, sum=0, mean=0.0000))
(op_exists.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_block_fetch_operations.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_remote_stream_aborted.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_block_acquire_read.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_list.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_remote_stream_drain.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_create.mean=(samples=0, sum=0, mean=0.0000))
(object_list_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_bulk_delete_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_materialize_file.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_remote_stream_drain.mean=(samples=0, sum=0, mean=0.0000))
(stream_file_cache_eviction.mean=(samples=0, sum=0, mean=0.0000))
(object_list_request.mean=(samples=0, sum=0, mean=0.0000))
(op_get_content_summary.mean=(samples=0, sum=0, mean=0.0000))
(multipart_upload_list.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_map.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_named.mean=(samples=0, sum=0, mean=0.0000))
(op_mkdirs.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_get_file_status.mean=(samples=0, sum=0, mean=0.0000))
(op_get_delegation_token.mean=(samples=0, sum=0, mean=0.0000))
(object_put_request.mean=(samples=0, sum=0, mean=0.0000))
(committer_load_single_pending_file.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_list.failures.mean=(samples=0, sum=0, mean=0.0000))
(multipart_upload_list.mean=(samples=0, sum=0, mean=0.0000)));
}}, ClientSideEncryption=false}
2024-04-24 15:57:23,534 [setup] DEBUG impl.MkdirOperation
(MkdirOperation.java:execute(94)) - Making directory: s3a://stevel-london/test
2024-04-24 15:57:23,535 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:innerGetFileStatus(3950)) - Getting path status for
s3a://stevel-london/test (test); needEmptyDirectory=false
2024-04-24 15:57:23,535 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:s3GetFileStatus(4009)) - S3GetFileStatus
s3a://stevel-london/test
2024-04-24 15:57:23,541 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:listObjects(2965)) - LIST List stevel-london:/test/
delimiter=/ keys=2 requester pays=null
2024-04-24 15:57:23,541 [setup] DEBUG s3a.S3AFileSystem
(DurationInfo.java:<init>(80)) - Starting: LIST
2024-04-24 15:57:23,574 [setup] DEBUG s3a.Invoker
(DurationInfo.java:<init>(80)) - Starting: create credentials
2024-04-24 15:57:23,577 [setup] DEBUG s3a.Invoker
(DurationInfo.java:close(101)) - create credentials: duration 0:00.003s
2024-04-24 15:57:23,577 [setup] DEBUG s3a.AWSCredentialProviderList
(AWSCredentialProviderList.java:resolveCredentials(195)) - No credentials from
TemporaryAWSCredentialsProvider:
org.apache.hadoop.fs.s3a.auth.NoAwsCredentialsException: Session credentials in
Hadoop configuration: No AWS Credentials
2024-04-24 15:57:23,577 [setup] DEBUG s3a.AWSCredentialProviderList
(AWSCredentialProviderList.java:resolveCredentials(182)) - Using credentials
from SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}
2024-04-24 15:57:23,599 [setup] DEBUG impl.LoggingAuditor
(LoggingAuditor.java:modifyHttpRequest(400)) - [11]
0d643328-91f6-4da7-acae-86fd72161299-00000005 Executing op_mkdirs with
{object_list_request 'test/' size=2, mutating=false};
https://audit.example.org/hadoop/1/op_mkdirs/0d643328-91f6-4da7-acae-86fd72161299-00000005/?op=op_mkdirs&p1=test&pr=stevel&ps=d8c4e4fc-c0aa-48d0-9605-2bf9ed7b08b2&id=0d643328-91f6-4da7-acae-86fd72161299-00000005&t0=11&fs=0d643328-91f6-4da7-acae-86fd72161299&t1=11&ts=1713970643534
2024-04-24 15:57:24,224 [setup] DEBUG s3a.S3AFileSystem
(DurationInfo.java:close(101)) - LIST: duration 0:00.682s
2024-04-24 15:57:24,224 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:s3GetFileStatus(4100)) - Not Found: s3a://stevel-london/test
2024-04-24 15:57:24,224 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:innerGetFileStatus(3950)) - Getting path status for
s3a://stevel-london/test (test); needEmptyDirectory=false
2024-04-24 15:57:24,224 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:s3GetFileStatus(4009)) - S3GetFileStatus
s3a://stevel-london/test
2024-04-24 15:57:24,230 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:lambda$getObjectMetadata$10(2903)) - HEAD test with change
tracker null
2024-04-24 15:57:24,233 [setup] DEBUG impl.LoggingAuditor
(LoggingAuditor.java:modifyHttpRequest(400)) - [11]
0d643328-91f6-4da7-acae-86fd72161299-00000005 Executing op_mkdirs with
{action_http_head_request 'test' size=0, mutating=false};
https://audit.example.org/hadoop/1/op_mkdirs/0d643328-91f6-4da7-acae-86fd72161299-00000005/?op=op_mkdirs&p1=test&pr=stevel&ps=d8c4e4fc-c0aa-48d0-9605-2bf9ed7b08b2&id=0d643328-91f6-4da7-acae-86fd72161299-00000005&t0=11&fs=0d643328-91f6-4da7-acae-86fd72161299&t1=11&ts=1713970643534
2024-04-24 15:57:24,276 [setup] DEBUG s3a.Invoker
(Invoker.java:retryUntranslated(474)) - GET test ;
software.amazon.awssdk.services.s3.model.NoSuchKeyException: null (Service: S3,
Status Code: 404, Request ID: YM4CDP856RPCKP8R, Extended Request ID:
JbbjhNCFZf+5Hrj/WlnzH54455UAuBPn08CVH1vUqgpVm9J9Z7r6zpwxTeoaudWLrPYAzNKN0N/VmQL1yyv2LQ==)
(Service: S3, Status Code: 404, Request ID: YM4CDP856RPCKP8R),
2024-04-24 15:57:24,277 [setup] DEBUG s3a.S3ARetryPolicy
(S3ARetryPolicy.java:shouldRetry(308)) - Retry probe for FileNotFoundException
with 0 retries and 0 failovers, idempotent=true, due to
java.io.FileNotFoundException: GET test on /:
software.amazon.awssdk.services.s3.model.NoSuchKeyException: null (Service: S3,
Status Code: 404, Request ID: YM4CDP856RPCKP8R, Extended Request ID:
JbbjhNCFZf+5Hrj/WlnzH54455UAuBPn08CVH1vUqgpVm9J9Z7r6zpwxTeoaudWLrPYAzNKN0N/VmQL1yyv2LQ==)
(Service: S3, Status Code: 404, Request ID: YM4CDP856RPCKP8R):NoSuchKey
java.io.FileNotFoundException: GET test on /:
software.amazon.awssdk.services.s3.model.NoSuchKeyException: null (Service: S3,
Status Code: 404, Request ID: YM4CDP856RPCKP8R, Extended Request ID:
JbbjhNCFZf+5Hrj/WlnzH54455UAuBPn08CVH1vUqgpVm9J9Z7r6zpwxTeoaudWLrPYAzNKN0N/VmQL1yyv2LQ==)
(Service: S3, Status Code: 404, Request ID: YM4CDP856RPCKP8R):NoSuchKey
at
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:278)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:481)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:431)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:2895)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:2875)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:4024)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:3952)
at
org.apache.hadoop.fs.s3a.S3AFileSystem$MkdirOperationCallbacksImpl.probePathStatus(S3AFileSystem.java:3809)
at
org.apache.hadoop.fs.s3a.impl.MkdirOperation.probePathStatusOrNull(MkdirOperation.java:173)
at
org.apache.hadoop.fs.s3a.impl.MkdirOperation.getPathStatusExpectingDir(MkdirOperation.java:197)
at
org.apache.hadoop.fs.s3a.impl.MkdirOperation.execute(MkdirOperation.java:108)
at
org.apache.hadoop.fs.s3a.impl.MkdirOperation.execute(MkdirOperation.java:57)
at
org.apache.hadoop.fs.s3a.impl.ExecutingStoreOperation.apply(ExecutingStoreOperation.java:76)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.invokeTrackingDuration(IOStatisticsBinding.java:556)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:537)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.trackDuration(IOStatisticsBinding.java:458)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.trackDurationAndSpan(S3AFileSystem.java:2722)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.trackDurationAndSpan(S3AFileSystem.java:2741)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:3781)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:2494)
at
org.apache.hadoop.fs.contract.AbstractFSContractTestBase.mkdirs(AbstractFSContractTestBase.java:363)
at
org.apache.hadoop.fs.contract.AbstractFSContractTestBase.setup(AbstractFSContractTestBase.java:205)
at
org.apache.hadoop.fs.s3a.AbstractS3ATestBase.setup(AbstractS3ATestBase.java:111)
at
org.apache.hadoop.fs.s3a.performance.AbstractS3ACostTest.setup(AbstractS3ACostTest.java:129)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
Caused by: software.amazon.awssdk.services.s3.model.NoSuchKeyException: null
(Service: S3, Status Code: 404, Request ID: YM4CDP856RPCKP8R, Extended Request
ID:
JbbjhNCFZf+5Hrj/WlnzH54455UAuBPn08CVH1vUqgpVm9J9Z7r6zpwxTeoaudWLrPYAzNKN0N/VmQL1yyv2LQ==)
(Service: S3, Status Code: 404, Request ID: YM4CDP856RPCKP8R)
at
software.amazon.awssdk.services.s3.model.NoSuchKeyException$BuilderImpl.build(NoSuchKeyException.java:126)
at
software.amazon.awssdk.services.s3.model.NoSuchKeyException$BuilderImpl.build(NoSuchKeyException.java:80)
at
software.amazon.awssdk.services.s3.internal.handlers.ExceptionTranslationInterceptor.modifyException(ExceptionTranslationInterceptor.java:63)
at
software.amazon.awssdk.core.interceptor.ExecutionInterceptorChain.modifyException(ExecutionInterceptorChain.java:181)
at
software.amazon.awssdk.core.internal.http.pipeline.stages.utils.ExceptionReportingUtils.runModifyException(ExceptionReportingUtils.java:54)
at
software.amazon.awssdk.core.internal.http.pipeline.stages.utils.ExceptionReportingUtils.reportFailureToInterceptors(ExceptionReportingUtils.java:38)
at
software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:39)
at
software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26)
at
software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:224)
at
software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:103)
at
software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.doExecute(BaseSyncClientHandler.java:173)
at
software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:80)
at
software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:182)
at
software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:74)
at
software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45)
at
software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:53)
at
software.amazon.awssdk.services.s3.DefaultS3Client.headObject(DefaultS3Client.java:6319)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$getObjectMetadata$10(S3AFileSystem.java:2907)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:468)
... 37 more
2024-04-24 15:57:24,278 [setup] DEBUG s3a.S3ARetryPolicy
(S3ARetryPolicy.java:shouldRetry(313)) - Retry action is
RetryAction(action=FAIL, delayMillis=0, reason=try once and fail.)
2024-04-24 15:57:24,279 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:s3GetFileStatus(4100)) - Not Found: s3a://stevel-london/test
2024-04-24 15:57:24,280 [setup] DEBUG s3a.Invoker
(DurationInfo.java:<init>(80)) - Starting: PUT 0-byte object
2024-04-24 15:57:24,286 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:putObjectDirect(3267)) - PUT 0 bytes to test/
2024-04-24 15:57:24,286 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:incrementPutStartStatistics(3341)) - PUT start 0 bytes
2024-04-24 15:57:24,292 [setup] DEBUG impl.LoggingAuditor
(LoggingAuditor.java:modifyHttpRequest(400)) - [11]
0d643328-91f6-4da7-acae-86fd72161299-00000005 Executing op_mkdirs with
{object_put_request 'test/' size=0, mutating=true};
https://audit.example.org/hadoop/1/op_mkdirs/0d643328-91f6-4da7-acae-86fd72161299-00000005/?op=op_mkdirs&p1=test&pr=stevel&ps=d8c4e4fc-c0aa-48d0-9605-2bf9ed7b08b2&id=0d643328-91f6-4da7-acae-86fd72161299-00000005&t0=11&fs=0d643328-91f6-4da7-acae-86fd72161299&t1=11&ts=1713970643534
2024-04-24 15:57:24,376 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:incrementPutCompletedStatistics(3357)) - PUT completed
success=true; 0 bytes
2024-04-24 15:57:24,376 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:finishedWrite(4690)) - Finished write to test/, len 0. etag
"879c68e18e6aa75a0edcab0e0a361786", version JOVjFhK1ZAGKfaJV39PLzFeh0gEF9JCJ
2024-04-24 15:57:24,376 [setup] DEBUG s3a.Invoker
(DurationInfo.java:close(101)) - PUT 0-byte object : duration 0:00.096s
2024-04-24 15:57:24,376 [setup] DEBUG S3AFileSystem.Progress
(S3AFileSystem.java:incrementPutProgressStatistics(3374)) - PUT test: 0 bytes
2024-04-24 15:57:24,428 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initializeClass(5724)) - Initialize S3A class
2024-04-24 15:57:24,435 [setup] DEBUG s3a.S3ATestUtils
(S3ATestUtils.java:removeBucketOverrides(914)) - Removing option
fs.s3a.bucket.stevel-london.directory.marker.retention; was keep
2024-04-24 15:57:24,436 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initializeClass(5724)) - Initialize S3A class
2024-04-24 15:57:24,436 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(549)) - Initializing S3AFileSystem for
stevel-london
2024-04-24 15:57:24,436 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1103)) - Propagating entries under
fs.s3a.bucket.stevel-london.
2024-04-24 15:57:24,437 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating fs.s3a.versioned.store
from [core-site.xml]
2024-04-24 15:57:24,437 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating
fs.s3a.encryption.algorithm from [core-site.xml]
2024-04-24 15:57:24,437 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating fs.s3a.endpoint from
[core-site.xml]
2024-04-24 15:57:24,437 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating fs.s3a.encryption.key
from [core-site.xml]
2024-04-24 15:57:24,437 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating
fs.s3a.change.detection.source from [core-site.xml]
2024-04-24 15:57:24,437 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:maybeIsolateClassloader(1708)) - Configuration classloader set
to S3AFileSystem classloader: sun.misc.Launcher$AppClassLoader@18b4aac2
2024-04-24 15:57:24,437 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:buildEncryptionSecrets(1477)) - Using SSE-KMS with key of length
75 ending with 3
2024-04-24 15:57:24,437 [setup] DEBUG s3a.S3ARetryPolicy
(S3ARetryPolicy.java:<init>(145)) - Retrying on recoverable AWS failures 3
times with an initial interval of 500ms
2024-04-24 15:57:24,440 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(605)) - Client Side Encryption enabled: false
2024-04-24 15:57:24,440 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.paging.maximum is 5000
2024-04-24 15:57:24,440 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.block.size is 33554432
2024-04-24 15:57:24,440 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.prefetch.block.size is
131072
2024-04-24 15:57:24,440 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.prefetch.block.count is 8
2024-04-24 15:57:24,441 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.max.total.tasks is 32
2024-04-24 15:57:24,441 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.threads.keepalivetime = PT1M
2024-04-24 15:57:24,441 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.executor.capacity is 16
2024-04-24 15:57:24,442 [setup] DEBUG auth.SignerManager
(SignerManager.java:initCustomSigners(68)) - No custom signers specified
2024-04-24 15:57:24,442 [setup] DEBUG audit.AuditIntegration
(AuditIntegration.java:createAndInitAuditor(109)) - Auditor class is class
org.apache.hadoop.fs.s3a.audit.impl.LoggingAuditor
2024-04-24 15:57:24,442 [setup] DEBUG impl.ActiveAuditManagerS3A
(ActiveAuditManagerS3A.java:serviceInit(199)) - Audit manager initialized with
audit service LoggingAuditor{ID='e40ad9fb-842f-43ee-8784-912d440e2355',
headerEnabled=true, rejectOutOfSpan=true, isMultipartUploadEnabled=true}
2024-04-24 15:57:24,442 [setup] DEBUG impl.ActiveAuditManagerS3A
(ActiveAuditManagerS3A.java:serviceStart(212)) - Started audit service
LoggingAuditor{ID='e40ad9fb-842f-43ee-8784-912d440e2355', headerEnabled=true,
rejectOutOfSpan=true, isMultipartUploadEnabled=true}
2024-04-24 15:57:24,442 [setup] DEBUG audit.AuditIntegration
(AuditIntegration.java:createAndStartAuditManager(76)) - Started Audit Manager
Service ActiveAuditManagerS3A in state ActiveAuditManagerS3A: STARTED,
auditor=LoggingAuditor{ID='e40ad9fb-842f-43ee-8784-912d440e2355',
headerEnabled=true, rejectOutOfSpan=true, isMultipartUploadEnabled=true}}
2024-04-24 15:57:24,442 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longOption(930)) - Value of
fs.s3a.internal.upload.part.count.limit is 10000
2024-04-24 15:57:24,442 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:createRequestFactory(1202)) - Unset storage class property
fs.s3a.create.storage.class; falling back to default storage class
2024-04-24 15:57:24,443 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSV2CredentialProvider(306)) -
Credential provider class is
org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
2024-04-24 15:57:24,443 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSV2CredentialProvider(306)) -
Credential provider class is
org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
2024-04-24 15:57:24,443 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSCredentialProviderList(151)) - For
URI s3a://stevel-london/, using credentials AWSCredentialProviderList name=;
refcount= 1; size=2: [TemporaryAWSCredentialsProvider,
SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}]
2024-04-24 15:57:24,443 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:bindAWSClient(1047)) - Using credential provider
AWSCredentialProviderList name=; refcount= 1; size=2:
[TemporaryAWSCredentialsProvider,
SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}]
2024-04-24 15:57:24,443 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.connection.maximum is 512
2024-04-24 15:57:24,443 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.acquisition.timeout = PT1M
2024-04-24 15:57:24,443 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of fs.s3a.connection.ttl
= PT5M
2024-04-24 15:57:24,443 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.establish.timeout = PT30S
2024-04-24 15:57:24,443 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.idle.time = PT1M
2024-04-24 15:57:24,443 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.timeout = PT25S
2024-04-24 15:57:24,443 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:getS3RegionFromEndpoint(397)) - Endpoint
s3.eu-west-2.amazonaws.com is not the default; parsing
2024-04-24 15:57:24,443 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(326)) - Setting
endpoint to https://s3.eu-west-2.amazonaws.com
2024-04-24 15:57:24,443 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(353)) - Setting region
to eu-west-2 from endpoint
2024-04-24 15:57:24,443 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:maybeApplyS3AccessGrantsConfigurations(419)) - S3
Access Grants plugin is not enabled.
2024-04-24 15:57:24,443 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.request.timeout = PT1M
2024-04-24 15:57:24,444 [setup] DEBUG impl.AWSClientConfig
(AWSClientConfig.java:initUserAgent(375)) - Using User-Agent: Hadoop
3.5.0-SNAPSHOT
2024-04-24 15:57:24,444 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.attempts.maximum is 2
2024-04-24 15:57:24,447 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.connection.maximum is 512
2024-04-24 15:57:24,447 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.acquisition.timeout = PT1M
2024-04-24 15:57:24,447 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of fs.s3a.connection.ttl
= PT5M
2024-04-24 15:57:24,447 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.establish.timeout = PT30S
2024-04-24 15:57:24,447 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.idle.time = PT1M
2024-04-24 15:57:24,447 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.timeout = PT25S
2024-04-24 15:57:24,447 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:getS3RegionFromEndpoint(397)) - Endpoint
s3.eu-west-2.amazonaws.com is not the default; parsing
2024-04-24 15:57:24,447 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(326)) - Setting
endpoint to https://s3.eu-west-2.amazonaws.com
2024-04-24 15:57:24,447 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(353)) - Setting region
to eu-west-2 from endpoint
2024-04-24 15:57:24,447 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:maybeApplyS3AccessGrantsConfigurations(419)) - S3
Access Grants plugin is not enabled.
2024-04-24 15:57:24,448 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.request.timeout = PT1M
2024-04-24 15:57:24,448 [setup] DEBUG impl.AWSClientConfig
(AWSClientConfig.java:initUserAgent(375)) - Using User-Agent: Hadoop
3.5.0-SNAPSHOT
2024-04-24 15:57:24,448 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.attempts.maximum is 2
2024-04-24 15:57:24,450 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:doBucketProbing(831)) - skipping check for bucket existence
2024-04-24 15:57:24,450 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(696)) - Input fadvise policy = default
2024-04-24 15:57:24,450 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(698)) - Change detection policy =
VersionIdChangeDetectionPolicy mode=Server
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(702)) - Filesystem support for magic committers
is enabled
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.fast.upload.active.blocks is 4
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(721)) - Using S3ABlockOutputStream with buffer =
disk; block=67108864; queue limit=4; multipart=true
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(731)) - fs.s3a.create.performance = false
2024-04-24 15:57:24,451 [setup] DEBUG impl.DirectoryPolicyImpl
(DirectoryPolicyImpl.java:getDirectoryPolicy(189)) - Directory markers will be
kept
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(737)) - Directory marker retention policy is
DirectoryMarkerRetention{policy='keep'}
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.bulk.delete.page.size is 250
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.readahead.range is 32768
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of io.file.buffer.size is 4194304
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.input.async.drain.threshold is 1024
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.vectored.active.ranged.reads
is 4
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.vectored.read.min.seek.size is 4096
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.vectored.read.max.merged.size is 1048576
2024-04-24 15:57:24,451 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(763)) - Using optimized copyFromLocal
implementation: true
2024-04-24 15:57:24,454 [setup] INFO contract.AbstractFSContractTestBase
(AbstractFSContractTestBase.java:setup(196)) - Test filesystem =
s3a://stevel-london implemented by S3AFileSystem{uri=s3a://stevel-london,
workingDir=s3a://stevel-london/user/stevel, partSize=67108864,
enableMultiObjectsDelete=true, maxKeys=5000,
OpenFileSupport{changePolicy=VersionIdChangeDetectionPolicy mode=Server,
defaultReadAhead=32768, defaultBufferSize=4194304,
defaultAsyncDrainThreshold=1024, defaultInputPolicy=default},
blockSize=33554432, multiPartThreshold=134217728,
s3EncryptionAlgorithm='SSE_KMS',
blockFactory=org.apache.hadoop.fs.s3a.S3ADataBlocks$DiskBlockFactory@fbacef6,
auditManager=Service ActiveAuditManagerS3A in state ActiveAuditManagerS3A:
STARTED, auditor=LoggingAuditor{ID='e40ad9fb-842f-43ee-8784-912d440e2355',
headerEnabled=true, rejectOutOfSpan=true, isMultipartUploadEnabled=true}},
authoritativePath=[], useListV1=false, magicCommitter=true,
boundedExecutor=BlockingThreadPoolExecutorService{SemaphoredDelegatingExecutor{permitCount=200,
available=200, waiting=0}, activeCount=0},
unboundedExecutor=java.util.concurrent.ThreadPoolExecutor@6e3a3097[Running,
pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0],
credentials=AWSCredentialProviderList name=; refcount= 1; size=2:
[TemporaryAWSCredentialsProvider,
SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}],
delegation tokens=disabled, DirectoryMarkerRetention{policy='keep'},
instrumentation
{S3AInstrumentation{instanceIOStatistics=counters=((stream_file_cache_eviction=0)
(audit_failure=0) (committer_load_single_pending_file=0)
(fake_directories_deleted=0) (store_io_request=0)
(stream_read_block_acquire_read.failures=0) (multipart_upload_part_put=0)
(stream_read_seek_backward_operations=0) (committer_commits_created=0)
(stream_write_queue_duration.failures=0) (files_copied=0) (op_is_file=0)
(op_createfile=0) (action_http_get_request.failures=0) (op_get_file_status=0)
(object_continue_list_request.failures=0)
(stream_read_vectored_incoming_ranges=0) (op_xattr_get_map=0)
(committer_bytes_uploaded=0) (multipart_upload_abort_under_path_invoked=0)
(stream_read_vectored_read_bytes_discarded=0) (op_rename=0)
(multipart_upload_list.failures=0) (committer_magic_files_created=0)
(store_exists_probe=0) (stream_read_block_fetch_operations.failures=0)
(action_executor_acquired=0) (action_file_opened=0)
(committer_commits_completed=0) (object_multipart_initiated=0)
(op_copy_from_local_file.failures=0) (object_put_bytes=0)
(op_mkdirs.failures=0) (committer_jobs_completed=0)
(object_multipart_initiated.failures=0) (stream_read_operations=0)
(object_delete_objects=0) (op_get_content_summary.failures=0)
(stream_read_close_operations=0) (action_http_head_request.failures=0)
(stream_read_closed=0) (audit_request_execution=0)
(op_get_file_status.failures=0) (op_get_file_checksum=0)
(stream_write_total_data=0) (stream_read_seek_bytes_skipped=0)
(committer_materialize_file.failures=0) (op_list_status.failures=0)
(stream_read_seek_forward_operations=0) (multipart_upload_completed=0)
(store_io_throttled=0) (files_created=0) (stream_read_bytes=0)
(directories_deleted=0) (committer_jobs_failed=0)
(stream_read_operations_incomplete=0) (committer_materialize_file=0)
(op_list_status=0) (op_xattr_get_named_map=0) (object_copy_requests=0)
(committer_bytes_committed=0) (stream_read_vectored_combined_ranges=0)
(stream_read_remote_stream_drain=0) (op_is_directory.failures=0)
(op_get_content_summary=0) (object_multipart_aborted=0) (op_delete.failures=0)
(op_list_files.failures=0) (op_access=0) (store_io_retry=0) (op_exists=0)
(stream_read_total_bytes=0) (op_createfile.failures=0) (op_exists.failures=0)
(stream_read_opened=0) (object_metadata_request=0)
(object_put_request_completed=0) (op_create.failures=0) (object_put_request=0)
(op_open=0) (op_glob_status.failures=0) (multipart_upload_started=0)
(committer_tasks_failed=0) (stream_read_version_mismatches=0)
(object_multipart_list=0) (fake_directories_created=0) (op_abort=0)
(object_delete_request.failures=0) (committer_commits.failures=0)
(stream_read_exceptions=0) (stream_read_seek_bytes_discarded=0)
(committer_stage_file_upload=0) (object_bulk_delete_request=0)
(object_continue_list_request=0) (object_multipart_aborted.failures=0)
(op_hsync=0) (stream_write_exceptions=0) (op_rename.failures=0)
(directories_created=0) (object_delete_request=0)
(stream_write_block_uploads=0) (stream_read_fully_operations=0)
(stream_write_queue_duration=0) (op_copy_from_local_file=0)
(object_bulk_delete_request.failures=0) (stream_read_vectored_operations=0)
(op_xattr_get_map.failures=0) (stream_write_block_uploads_aborted=0)
(delegation_tokens_issued.failures=0) (committer_commits_aborted=0)
(committer_load_single_pending_file.failures=0) (stream_write_total_time=0)
(stream_read_seek_operations=0) (stream_read_remote_stream_aborted.failures=0)
(object_put_request.failures=0) (action_executor_acquired.failures=0)
(op_create=0) (op_get_delegation_token=0) (op_xattr_get_named=0)
(committer_stage_file_upload.failures=0) (op_get_delegation_token.failures=0)
(stream_read_bytes_discarded_in_abort=0)
(committer_magic_marker_put.failures=0) (op_get_file_checksum.failures=0)
(object_list_request.failures=0) (op_xattr_list.failures=0)
(op_access.failures=0) (files_copied_bytes=0) (committer_magic_marker_put=0)
(multipart_upload_aborted=0) (op_xattr_get_named_map.failures=0)
(multipart_instantiated=0) (op_delete=0) (stream_read_unbuffered=0)
(op_is_file.failures=0) (op_xattr_list=0) (delegation_tokens_issued=0)
(op_list_located_status=0) (action_http_get_request=0)
(stream_file_cache_eviction.failures=0) (multipart_upload_part_put_bytes=0)
(object_list_request=0) (op_abort.failures=0) (op_list_files=0)
(committer_tasks_completed=0) (stream_read_seek_policy_changed=0)
(files_deleted=0) (op_xattr_get_named.failures=0)
(stream_read_bytes_backwards_on_seek=0) (object_multipart_list.failures=0)
(committer_commit_job.failures=0) (stream_read_remote_stream_drain.failures=0)
(audit_access_check_failure=0) (op_mkdirs=0) (op_hflush=0)
(multipart_upload_list=0) (stream_read_block_fetch_operations=0)
(stream_write_block_uploads_committed=0)
(stream_read_bytes_discarded_in_close=0) (op_openfile=0)
(action_http_head_request=0) (stream_read_remote_stream_aborted=0)
(files_delete_rejected=0) (audit_span_creation=1)
(stream_read_block_acquire_read=0) (op_is_directory=0) (ignored_errors=0)
(stream_evict_blocks_from_cache=0) (op_create_non_recursive=0)
(stream_write_exceptions_completing_upload=0) (committer_commit_job=0)
(committer_commits_reverted=0) (store_exists_probe.failures=0)
(stream_aborted=0) (op_glob_status=0) (action_file_opened.failures=0)
(stream_write_bytes=0));
gauges=((stream_write_block_uploads_active=0)
(stream_read_blocks_in_cache=0) (stream_read_block_cache_enabled=0)
(object_put_request_active=0) (stream_read_active_memory_in_use=0)
(stream_read_block_fetch_operations=0) (stream_read_block_prefetch_enabled=0)
(stream_read_active_prefetch_operations=0)
(stream_write_block_uploads_data_pending=0) (client_side_encryption_enabled=0)
(object_put_bytes_pending=0) (stream_read_block_size=0)
(stream_write_block_uploads_pending=0) (stream_read_block_prefetch_limit=0));
minimums=((op_exists.failures.min=-1) (op_create.failures.min=-1)
(op_is_directory.min=-1) (multipart_upload_list.failures.min=-1)
(object_multipart_aborted.failures.min=-1)
(stream_write_queue_duration.failures.min=-1)
(stream_file_cache_eviction.min=-1) (object_multipart_list.failures.min=-1)
(op_glob_status.failures.min=-1) (stream_read_remote_stream_aborted.min=-1)
(action_http_get_request.failures.min=-1)
(stream_read_block_acquire_read.failures.min=-1)
(object_delete_request.failures.min=-1) (op_xattr_list.failures.min=-1)
(action_executor_acquired.min=-1) (op_abort.failures.min=-1)
(delegation_tokens_issued.min=-1) (stream_file_cache_eviction.failures.min=-1)
(op_list_status.failures.min=-1) (op_xattr_list.min=-1)
(op_get_content_summary.failures.min=-1) (object_multipart_initiated.min=-1)
(op_abort.min=-1) (op_get_file_status.failures.min=-1) (op_create.min=-1)
(op_createfile.min=-1) (committer_materialize_file.failures.min=-1)
(op_createfile.failures.min=-1) (op_xattr_get_named_map.failures.min=-1)
(action_http_head_request.min=-1) (action_file_opened.failures.min=-1)
(object_list_request.min=-1) (op_get_file_checksum.failures.min=-1)
(op_mkdirs.failures.min=-1) (op_list_files.failures.min=-1)
(committer_stage_file_upload.failures.min=-1)
(stream_read_block_acquire_read.min=-1) (committer_magic_marker_put.min=-1)
(object_put_request.failures.min=-1)
(stream_read_remote_stream_aborted.failures.min=-1)
(action_http_get_request.min=-1) (object_continue_list_request.failures.min=-1)
(object_multipart_aborted.min=-1) (op_get_file_status.min=-1)
(store_exists_probe.failures.min=-1) (action_http_head_request.failures.min=-1)
(committer_stage_file_upload.min=-1) (op_mkdirs.min=-1) (op_rename.min=-1)
(delegation_tokens_issued.failures.min=-1) (op_is_directory.failures.min=-1)
(object_put_request.min=-1) (op_access.min=-1) (object_delete_request.min=-1)
(op_xattr_get_named.min=-1) (committer_commit_job.min=-1)
(object_bulk_delete_request.failures.min=-1) (multipart_upload_list.min=-1)
(op_list_status.min=-1) (stream_read_block_fetch_operations.failures.min=-1)
(stream_read_remote_stream_drain.min=-1)
(stream_read_block_fetch_operations.min=-1)
(committer_load_single_pending_file.failures.min=-1)
(stream_read_remote_stream_drain.failures.min=-1)
(object_continue_list_request.min=-1) (op_get_content_summary.min=-1)
(op_get_delegation_token.min=-1) (op_is_file.min=-1) (op_xattr_get_map.min=-1)
(op_is_file.failures.min=-1) (stream_write_queue_duration.min=-1)
(committer_materialize_file.min=-1) (op_rename.failures.min=-1)
(op_list_files.min=-1) (op_xattr_get_named_map.min=-1) (op_glob_status.min=-1)
(op_get_delegation_token.failures.min=-1)
(op_copy_from_local_file.failures.min=-1) (op_xattr_get_map.failures.min=-1)
(object_multipart_list.min=-1) (op_access.failures.min=-1) (op_exists.min=-1)
(object_multipart_initiated.failures.min=-1) (op_delete.failures.min=-1)
(committer_magic_marker_put.failures.min=-1) (op_get_file_checksum.min=-1)
(op_delete.min=-1) (object_bulk_delete_request.min=-1)
(object_list_request.failures.min=-1) (committer_commit_job.failures.min=-1)
(op_xattr_get_named.failures.min=-1) (action_file_opened.min=-1)
(committer_load_single_pending_file.min=-1) (op_copy_from_local_file.min=-1)
(action_executor_acquired.failures.min=-1) (store_exists_probe.min=-1));
maximums=((object_delete_request.max=-1) (op_is_file.max=-1)
(object_multipart_initiated.failures.max=-1)
(action_http_get_request.failures.max=-1) (op_xattr_get_named_map.max=-1)
(op_mkdirs.failures.max=-1) (action_http_head_request.max=-1)
(op_createfile.max=-1) (action_executor_acquired.max=-1)
(op_list_files.failures.max=-1) (stream_read_remote_stream_aborted.max=-1)
(stream_read_remote_stream_drain.max=-1) (op_abort.failures.max=-1)
(stream_write_queue_duration.failures.max=-1) (op_get_content_summary.max=-1)
(object_continue_list_request.failures.max=-1) (op_get_delegation_token.max=-1)
(op_xattr_get_map.max=-1) (object_continue_list_request.max=-1)
(committer_materialize_file.max=-1) (action_http_head_request.failures.max=-1)
(delegation_tokens_issued.max=-1) (op_rename.max=-1)
(object_bulk_delete_request.failures.max=-1)
(store_exists_probe.failures.max=-1) (op_create.max=-1)
(stream_read_block_fetch_operations.max=-1)
(op_get_file_status.failures.max=-1) (op_is_directory.failures.max=-1)
(object_multipart_aborted.failures.max=-1) (op_create.failures.max=-1)
(op_copy_from_local_file.max=-1) (stream_read_block_acquire_read.max=-1)
(op_xattr_list.failures.max=-1) (op_xattr_get_named_map.failures.max=-1)
(op_get_content_summary.failures.max=-1) (object_multipart_list.max=-1)
(op_glob_status.failures.max=-1) (op_get_file_status.max=-1)
(op_exists.failures.max=-1) (op_access.max=-1) (object_list_request.max=-1)
(committer_commit_job.failures.max=-1)
(stream_read_block_fetch_operations.failures.max=-1)
(op_delete.failures.max=-1) (op_mkdirs.max=-1)
(op_get_delegation_token.failures.max=-1) (op_rename.failures.max=-1)
(committer_load_single_pending_file.max=-1) (op_list_status.failures.max=-1)
(stream_file_cache_eviction.max=-1) (op_is_file.failures.max=-1)
(committer_magic_marker_put.max=-1) (op_exists.max=-1)
(multipart_upload_list.max=-1) (op_xattr_get_named.max=-1)
(store_exists_probe.max=-1) (op_list_status.max=-1)
(action_http_get_request.max=-1) (action_file_opened.max=-1)
(committer_magic_marker_put.failures.max=-1)
(action_executor_acquired.failures.max=-1) (op_createfile.failures.max=-1)
(object_put_request.failures.max=-1) (committer_stage_file_upload.max=-1)
(action_file_opened.failures.max=-1)
(stream_read_remote_stream_drain.failures.max=-1)
(op_copy_from_local_file.failures.max=-1) (op_access.failures.max=-1)
(op_delete.max=-1) (object_put_request.max=-1)
(stream_read_remote_stream_aborted.failures.max=-1) (op_is_directory.max=-1)
(committer_load_single_pending_file.failures.max=-1)
(object_multipart_list.failures.max=-1) (object_bulk_delete_request.max=-1)
(stream_read_block_acquire_read.failures.max=-1) (op_abort.max=-1)
(object_list_request.failures.max=-1) (op_get_file_checksum.failures.max=-1)
(object_multipart_initiated.max=-1)
(committer_stage_file_upload.failures.max=-1) (op_list_files.max=-1)
(op_xattr_get_named.failures.max=-1) (multipart_upload_list.failures.max=-1)
(object_multipart_aborted.max=-1) (op_get_file_checksum.max=-1)
(delegation_tokens_issued.failures.max=-1) (stream_write_queue_duration.max=-1)
(op_xattr_list.max=-1) (committer_commit_job.max=-1)
(stream_file_cache_eviction.failures.max=-1) (op_xattr_get_map.failures.max=-1)
(object_delete_request.failures.max=-1)
(committer_materialize_file.failures.max=-1) (op_glob_status.max=-1));
means=((op_access.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_remote_stream_aborted.failures.mean=(samples=0, sum=0,
mean=0.0000)) (stream_write_queue_duration.mean=(samples=0, sum=0,
mean=0.0000)) (op_get_delegation_token.failures.mean=(samples=0, sum=0,
mean=0.0000)) (stream_file_cache_eviction.mean=(samples=0, sum=0, mean=0.0000))
(op_is_directory.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_named_map.mean=(samples=0, sum=0, mean=0.0000))
(committer_magic_marker_put.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_get_delegation_token.mean=(samples=0, sum=0, mean=0.0000))
(action_executor_acquired.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_http_head_request.mean=(samples=0, sum=0, mean=0.0000))
(delegation_tokens_issued.mean=(samples=0, sum=0, mean=0.0000))
(op_glob_status.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_is_file.mean=(samples=0, sum=0, mean=0.0000))
(committer_load_single_pending_file.failures.mean=(samples=0, sum=0,
mean=0.0000)) (object_put_request.mean=(samples=0, sum=0, mean=0.0000))
(object_delete_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_is_file.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_file_opened.mean=(samples=0, sum=0, mean=0.0000))
(committer_load_single_pending_file.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_initiated.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_block_fetch_operations.failures.mean=(samples=0, sum=0,
mean=0.0000)) (op_get_file_checksum.failures.mean=(samples=0, sum=0,
mean=0.0000)) (committer_stage_file_upload.mean=(samples=0, sum=0,
mean=0.0000)) (op_get_file_status.failures.mean=(samples=0, sum=0,
mean=0.0000)) (stream_read_remote_stream_drain.mean=(samples=0, sum=0,
mean=0.0000)) (op_xattr_get_map.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_list_request.mean=(samples=0, sum=0, mean=0.0000))
(op_glob_status.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_initiated.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_create.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_continue_list_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_bulk_delete_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_copy_from_local_file.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_executor_acquired.mean=(samples=0, sum=0, mean=0.0000))
(committer_stage_file_upload.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_copy_from_local_file.mean=(samples=0, sum=0, mean=0.0000))
(action_file_opened.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_list_files.mean=(samples=0, sum=0, mean=0.0000)) (op_abort.mean=(samples=0,
sum=0, mean=0.0000)) (op_createfile.failures.mean=(samples=0, sum=0,
mean=0.0000)) (stream_file_cache_eviction.failures.mean=(samples=0, sum=0,
mean=0.0000)) (op_get_file_status.mean=(samples=0, sum=0, mean=0.0000))
(multipart_upload_list.mean=(samples=0, sum=0, mean=0.0000))
(object_list_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_list.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_list_status.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_map.mean=(samples=0, sum=0, mean=0.0000))
(store_exists_probe.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_commit_job.mean=(samples=0, sum=0, mean=0.0000))
(op_delete.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_named.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_remote_stream_drain.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_rename.mean=(samples=0, sum=0, mean=0.0000))
(op_get_file_checksum.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_remote_stream_aborted.mean=(samples=0, sum=0, mean=0.0000))
(store_exists_probe.mean=(samples=0, sum=0, mean=0.0000))
(op_mkdirs.mean=(samples=0, sum=0, mean=0.0000)) (op_create.mean=(samples=0,
sum=0, mean=0.0000)) (committer_materialize_file.mean=(samples=0, sum=0,
mean=0.0000)) (op_get_content_summary.mean=(samples=0, sum=0, mean=0.0000))
(op_list_files.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_block_acquire_read.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_abort.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_delete.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_list.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_is_directory.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_named_map.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_write_queue_duration.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_delete_request.mean=(samples=0, sum=0, mean=0.0000))
(object_continue_list_request.mean=(samples=0, sum=0, mean=0.0000))
(op_get_content_summary.failures.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_block_fetch_operations.mean=(samples=0, sum=0, mean=0.0000))
(object_put_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_bulk_delete_request.mean=(samples=0, sum=0, mean=0.0000))
(stream_read_block_acquire_read.mean=(samples=0, sum=0, mean=0.0000))
(delegation_tokens_issued.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_rename.failures.mean=(samples=0, sum=0, mean=0.0000))
(committer_commit_job.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_http_head_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_list.mean=(samples=0, sum=0, mean=0.0000))
(committer_magic_marker_put.mean=(samples=0, sum=0, mean=0.0000))
(op_exists.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_list_status.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_access.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_aborted.mean=(samples=0, sum=0, mean=0.0000))
(action_http_get_request.mean=(samples=0, sum=0, mean=0.0000))
(op_exists.mean=(samples=0, sum=0, mean=0.0000))
(op_xattr_get_named.failures.mean=(samples=0, sum=0, mean=0.0000))
(action_http_get_request.failures.mean=(samples=0, sum=0, mean=0.0000))
(multipart_upload_list.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_aborted.failures.mean=(samples=0, sum=0, mean=0.0000))
(op_createfile.mean=(samples=0, sum=0, mean=0.0000))
(op_mkdirs.failures.mean=(samples=0, sum=0, mean=0.0000))
(object_multipart_list.mean=(samples=0, sum=0, mean=0.0000))
(committer_materialize_file.failures.mean=(samples=0, sum=0, mean=0.0000)));
}}, ClientSideEncryption=false}
2024-04-24 15:57:24,455 [setup] DEBUG impl.MkdirOperation
(MkdirOperation.java:execute(94)) - Making directory: s3a://stevel-london/test
2024-04-24 15:57:24,455 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:innerGetFileStatus(3950)) - Getting path status for
s3a://stevel-london/test (test); needEmptyDirectory=false
2024-04-24 15:57:24,455 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:s3GetFileStatus(4009)) - S3GetFileStatus
s3a://stevel-london/test
2024-04-24 15:57:24,455 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:listObjects(2965)) - LIST List stevel-london:/test/
delimiter=/ keys=2 requester pays=null
2024-04-24 15:57:24,455 [setup] DEBUG s3a.S3AFileSystem
(DurationInfo.java:<init>(80)) - Starting: LIST
2024-04-24 15:57:24,456 [setup] DEBUG s3a.Invoker
(DurationInfo.java:<init>(80)) - Starting: create credentials
2024-04-24 15:57:24,456 [setup] DEBUG s3a.Invoker
(DurationInfo.java:close(101)) - create credentials: duration 0:00.000s
2024-04-24 15:57:24,456 [setup] DEBUG s3a.AWSCredentialProviderList
(AWSCredentialProviderList.java:resolveCredentials(195)) - No credentials from
TemporaryAWSCredentialsProvider:
org.apache.hadoop.fs.s3a.auth.NoAwsCredentialsException: Session credentials in
Hadoop configuration: No AWS Credentials
2024-04-24 15:57:24,456 [setup] DEBUG s3a.AWSCredentialProviderList
(AWSCredentialProviderList.java:resolveCredentials(182)) - Using credentials
from SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}
2024-04-24 15:57:24,457 [setup] DEBUG impl.LoggingAuditor
(LoggingAuditor.java:modifyHttpRequest(400)) - [11]
e40ad9fb-842f-43ee-8784-912d440e2355-00000008 Executing op_mkdirs with
{object_list_request 'test/' size=2, mutating=false};
https://audit.example.org/hadoop/1/op_mkdirs/e40ad9fb-842f-43ee-8784-912d440e2355-00000008/?op=op_mkdirs&p1=test&pr=stevel&ps=d8c4e4fc-c0aa-48d0-9605-2bf9ed7b08b2&id=e40ad9fb-842f-43ee-8784-912d440e2355-00000008&t0=11&fs=e40ad9fb-842f-43ee-8784-912d440e2355&t1=11&ts=1713970644455
2024-04-24 15:57:24,848 [setup] DEBUG s3a.S3AFileSystem
(DurationInfo.java:close(101)) - LIST: duration 0:00.393s
2024-04-24 15:57:24,849 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:s3GetFileStatus(4073)) - Found path as directory (with /)
2024-04-24 15:57:24,849 [setup] DEBUG s3a.S3AFileSystem
(S3ListResult.java:logAtDebug(146)) - Prefix count = 0; object count=1
2024-04-24 15:57:24,849 [setup] DEBUG s3a.S3AFileSystem
(S3ListResult.java:logAtDebug(149)) - Summary: test/ 0
2024-04-24 15:57:24,862 [setup] DEBUG s3a.S3ATestUtils
(S3ATestUtils.java:removeBucketOverrides(914)) - Removing option
fs.s3a.bucket.stevel-london.directory.marker.retention; was keep
2024-04-24 15:57:24,863 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(549)) - Initializing S3AFileSystem for
noaa-cors-pds
2024-04-24 15:57:24,863 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1103)) - Propagating entries under
fs.s3a.bucket.noaa-cors-pds.
2024-04-24 15:57:24,865 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:propagateBucketOptions(1124)) - Updating fs.s3a.endpoint.region
from [core-site.xml]
2024-04-24 15:57:24,865 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:maybeIsolateClassloader(1708)) - Configuration classloader set
to S3AFileSystem classloader: sun.misc.Launcher$AppClassLoader@18b4aac2
2024-04-24 15:57:24,865 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:buildEncryptionSecrets(1493)) - Data is unencrypted
2024-04-24 15:57:24,865 [setup] DEBUG s3a.S3ARetryPolicy
(S3ARetryPolicy.java:<init>(145)) - Retrying on recoverable AWS failures 3
times with an initial interval of 500ms
2024-04-24 15:57:24,868 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(605)) - Client Side Encryption enabled: false
2024-04-24 15:57:24,868 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.paging.maximum is 5000
2024-04-24 15:57:24,868 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.block.size is 33554432
2024-04-24 15:57:24,868 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.prefetch.block.size is
131072
2024-04-24 15:57:24,868 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.prefetch.block.count is 8
2024-04-24 15:57:24,868 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.max.total.tasks is 32
2024-04-24 15:57:24,868 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.threads.keepalivetime = PT1M
2024-04-24 15:57:24,868 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.executor.capacity is 16
2024-04-24 15:57:24,869 [setup] DEBUG auth.SignerManager
(SignerManager.java:initCustomSigners(68)) - No custom signers specified
2024-04-24 15:57:24,869 [setup] DEBUG audit.AuditIntegration
(AuditIntegration.java:createAndInitAuditor(109)) - Auditor class is class
org.apache.hadoop.fs.s3a.audit.impl.LoggingAuditor
2024-04-24 15:57:24,869 [setup] DEBUG impl.ActiveAuditManagerS3A
(ActiveAuditManagerS3A.java:serviceInit(199)) - Audit manager initialized with
audit service LoggingAuditor{ID='8ccb4ca6-435a-4ba8-b138-ac7140a2c673',
headerEnabled=true, rejectOutOfSpan=true, isMultipartUploadEnabled=true}
2024-04-24 15:57:24,869 [setup] DEBUG impl.ActiveAuditManagerS3A
(ActiveAuditManagerS3A.java:serviceStart(212)) - Started audit service
LoggingAuditor{ID='8ccb4ca6-435a-4ba8-b138-ac7140a2c673', headerEnabled=true,
rejectOutOfSpan=true, isMultipartUploadEnabled=true}
2024-04-24 15:57:24,869 [setup] DEBUG audit.AuditIntegration
(AuditIntegration.java:createAndStartAuditManager(76)) - Started Audit Manager
Service ActiveAuditManagerS3A in state ActiveAuditManagerS3A: STARTED,
auditor=LoggingAuditor{ID='8ccb4ca6-435a-4ba8-b138-ac7140a2c673',
headerEnabled=true, rejectOutOfSpan=true, isMultipartUploadEnabled=true}}
2024-04-24 15:57:24,869 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longOption(930)) - Value of
fs.s3a.internal.upload.part.count.limit is 10000
2024-04-24 15:57:24,870 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:createRequestFactory(1202)) - Unset storage class property
fs.s3a.create.storage.class; falling back to default storage class
2024-04-24 15:57:24,870 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSV2CredentialProvider(306)) -
Credential provider class is
org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
2024-04-24 15:57:24,870 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSV2CredentialProvider(306)) -
Credential provider class is
org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider
2024-04-24 15:57:24,870 [setup] DEBUG auth.CredentialProviderListFactory
(CredentialProviderListFactory.java:createAWSCredentialProviderList(151)) - For
URI s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz, using credentials
AWSCredentialProviderList name=; refcount= 1; size=2:
[TemporaryAWSCredentialsProvider,
SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}]
2024-04-24 15:57:24,870 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:bindAWSClient(1047)) - Using credential provider
AWSCredentialProviderList name=; refcount= 1; size=2:
[TemporaryAWSCredentialsProvider,
SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}]
2024-04-24 15:57:24,870 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.connection.maximum is 512
2024-04-24 15:57:24,870 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.acquisition.timeout = PT1M
2024-04-24 15:57:24,870 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of fs.s3a.connection.ttl
= PT5M
2024-04-24 15:57:24,870 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.establish.timeout = PT30S
2024-04-24 15:57:24,870 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.idle.time = PT1M
2024-04-24 15:57:24,870 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.timeout = PT25S
2024-04-24 15:57:24,871 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(353)) - Setting region
to us-east-1 from fs.s3a.endpoint.region
2024-04-24 15:57:24,871 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:maybeApplyS3AccessGrantsConfigurations(419)) - S3
Access Grants plugin is not enabled.
2024-04-24 15:57:24,871 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.request.timeout = PT1M
2024-04-24 15:57:24,871 [setup] DEBUG impl.AWSClientConfig
(AWSClientConfig.java:initUserAgent(375)) - Using User-Agent: Hadoop
3.5.0-SNAPSHOT
2024-04-24 15:57:24,871 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.attempts.maximum is 2
2024-04-24 15:57:24,876 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.connection.maximum is 512
2024-04-24 15:57:24,877 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.acquisition.timeout = PT1M
2024-04-24 15:57:24,877 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of fs.s3a.connection.ttl
= PT5M
2024-04-24 15:57:24,877 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.establish.timeout = PT30S
2024-04-24 15:57:24,877 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.idle.time = PT1M
2024-04-24 15:57:24,877 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.timeout = PT25S
2024-04-24 15:57:24,877 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:configureEndpointAndRegion(353)) - Setting region
to us-east-1 from fs.s3a.endpoint.region
2024-04-24 15:57:24,877 [setup] DEBUG s3a.DefaultS3ClientFactory
(DefaultS3ClientFactory.java:maybeApplyS3AccessGrantsConfigurations(419)) - S3
Access Grants plugin is not enabled.
2024-04-24 15:57:24,877 [setup] DEBUG impl.ConfigurationHelper
(ConfigurationHelper.java:getDuration(80)) - Duration of
fs.s3a.connection.request.timeout = PT1M
2024-04-24 15:57:24,877 [setup] DEBUG impl.AWSClientConfig
(AWSClientConfig.java:initUserAgent(375)) - Using User-Agent: Hadoop
3.5.0-SNAPSHOT
2024-04-24 15:57:24,877 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.attempts.maximum is 2
2024-04-24 15:57:24,880 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:doBucketProbing(831)) - skipping check for bucket existence
2024-04-24 15:57:24,880 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(696)) - Input fadvise policy = default
2024-04-24 15:57:24,880 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(698)) - Change detection policy =
ETagChangeDetectionPolicy mode=Server
2024-04-24 15:57:24,880 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(702)) - Filesystem support for magic committers
is enabled
2024-04-24 15:57:24,880 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.fast.upload.active.blocks is 4
2024-04-24 15:57:24,880 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(721)) - Using S3ABlockOutputStream with buffer =
disk; block=67108864; queue limit=4; multipart=true
2024-04-24 15:57:24,880 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(731)) - fs.s3a.create.performance = false
2024-04-24 15:57:24,881 [setup] DEBUG impl.DirectoryPolicyImpl
(DirectoryPolicyImpl.java:getDirectoryPolicy(189)) - Directory markers will be
kept
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(737)) - Directory marker retention policy is
DirectoryMarkerRetention{policy='keep'}
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.bulk.delete.page.size is 250
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of fs.s3a.readahead.range is 32768
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of io.file.buffer.size is 4194304
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.input.async.drain.threshold is 1024
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:intOption(909)) - Value of fs.s3a.vectored.active.ranged.reads
is 4
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.vectored.read.min.seek.size is 4096
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AUtils
(S3AUtils.java:longBytesOption(952)) - Value of
fs.s3a.vectored.read.max.merged.size is 1048576
2024-04-24 15:57:24,881 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:initialize(763)) - Using optimized copyFromLocal
implementation: true
2024-04-24 15:57:24,881 [setup] INFO contract.AbstractFSContractTestBase
(AbstractFSContractTestBase.java:describe(280)) - Verify that FS cache files
exist on local FS
2024-04-24 15:57:24,885 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:innerGetFileStatus(3950)) - Getting path status for
s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz
(raw/2023/017/ohfh/OHFH017d.23_.gz); needEmptyDirectory=false
2024-04-24 15:57:24,885 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:s3GetFileStatus(4009)) - S3GetFileStatus
s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz
2024-04-24 15:57:24,885 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:lambda$getObjectMetadata$10(2903)) - HEAD
raw/2023/017/ohfh/OHFH017d.23_.gz with change tracker null
2024-04-24 15:57:24,886 [setup] DEBUG s3a.Invoker
(DurationInfo.java:<init>(80)) - Starting: create credentials
2024-04-24 15:57:24,886 [setup] DEBUG s3a.Invoker
(DurationInfo.java:close(101)) - create credentials: duration 0:00.000s
2024-04-24 15:57:24,886 [setup] DEBUG s3a.AWSCredentialProviderList
(AWSCredentialProviderList.java:resolveCredentials(195)) - No credentials from
TemporaryAWSCredentialsProvider:
org.apache.hadoop.fs.s3a.auth.NoAwsCredentialsException: Session credentials in
Hadoop configuration: No AWS Credentials
2024-04-24 15:57:24,886 [setup] DEBUG s3a.AWSCredentialProviderList
(AWSCredentialProviderList.java:resolveCredentials(182)) - Using credentials
from SimpleAWSCredentialsProvider{accessKey.empty=false, secretKey.empty=false}
2024-04-24 15:57:24,887 [setup] DEBUG impl.LoggingAuditor
(LoggingAuditor.java:modifyHttpRequest(400)) - [11]
8ccb4ca6-435a-4ba8-b138-ac7140a2c673-00000011 Executing op_open with
{action_http_head_request 'raw/2023/017/ohfh/OHFH017d.23_.gz' size=0,
mutating=false};
https://audit.example.org/hadoop/1/op_open/8ccb4ca6-435a-4ba8-b138-ac7140a2c673-00000011/?op=op_open&p1=raw/2023/017/ohfh/OHFH017d.23_.gz&pr=stevel&ps=d8c4e4fc-c0aa-48d0-9605-2bf9ed7b08b2&id=8ccb4ca6-435a-4ba8-b138-ac7140a2c673-00000011&t0=11&fs=8ccb4ca6-435a-4ba8-b138-ac7140a2c673&t1=11&ts=1713970644885
2024-04-24 15:57:25,279 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:s3GetFileStatus(4025)) - Found exact file: normal file
raw/2023/017/ohfh/OHFH017d.23_.gz
2024-04-24 15:57:25,283 [setup] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:executeOpen(1764)) - Opening
'S3AReadOpContext{path=s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz,
inputPolicy=default, readahead=32768,
changeDetectionPolicy=ETagChangeDetectionPolicy mode=Server}'
2024-04-24 15:57:25,291 [setup] DEBUG prefetch.S3APrefetchingInputStream
(S3APrefetchingInputStream.java:<init>(118)) - Creating caching input stream
for s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz
2024-04-24 15:57:25,293 [setup] DEBUG impl.ChangeTracker
(ChangeTracker.java:<init>(98)) - Tracker ETagChangeDetectionPolicy mode=Server
has revision ID for object at
s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz:
"3825f3178ed5c22fd7bbadbdddb65509-3"
2024-04-24 15:57:25,296 [setup] DEBUG prefetch.S3ACachingInputStream
(S3ACachingInputStream.java:demandCreateBlockManager(109)) -
s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz: creating block manager
2024-04-24 15:57:25,306 [setup] DEBUG prefetch.S3ACachingInputStream
(S3ACachingInputStream.java:<init>(96)) - Created caching input stream for
s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz (size = 21511174)
2024-04-24 15:57:25,307 [setup] DEBUG prefetch.CachingBlockManager
(CachingBlockManager.java:requestPrefetch(278)) -
s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz: Requesting prefetch for
block 1
2024-04-24 15:57:25,307 [setup] DEBUG prefetch.CachingBlockManager
(CachingBlockManager.java:requestPrefetch(284)) -
s3a://noaa-cors-pds/raw/2023/017/ohfh/OHFH017d.23_.gz: acquired [001] id:
994329416, State: EMPTY: buffer: (id = 304436027, pos = 0, lim = 131072),
checksum: 0, future: (none)
2024-04-24 15:57:25,308 [setup] INFO prefetch.BlockOperations
(BlockOperations.java:add(162)) - -
> s3a prefetching stream to support unbuffer()
> --------------------------------------------
>
> Key: HADOOP-18184
> URL: https://issues.apache.org/jira/browse/HADOOP-18184
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Labels: pull-request-available
>
> Apache Impala uses unbuffer() to free up all client side resources held by a
> stream, so allowing it to have a map of available (path -> stream) objects,
> retained across queries.
> This saves on having to reopen the files, with the cost of HEAD checks etc.
> S3AInputStream just closes its http connection. here there is a lot more
> state to discard, but all memory and file storage must be freed.
> until this done, ITestS3AContractUnbuffer must skip when the prefetch stream
> is used.
> its notable that the other tests don't fail, even though the stream doesn't
> implement the interface; the graceful degradation handles that. it should
> fail if the test xml resource says the stream does it, but that the stream
> capabilities say it doesn't.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
