Hello Ivan, Hello Chris, Would it be possible this issue is related to having object lock configured in this bucket?
- The Content-MD5 header is required for any request to upload an object with a retention period configured using Amazon S3 Object Lock. For more information about Amazon S3 Object Lock, see Amazon S3 Object Lock Overview <https://docs.aws.amazon.com/AmazonS3/latest/dev/object-lock-overview.html> in the *Amazon S3 User Guide*. It is possible this happens when Bacula tries to reuse a volume before its retention period set by using amazon s3 object lock. Do you think this can be the case? Maybe if you have object lock configured in the bucket, you may set the VolumeRetention = 999 years, Recycle = No and AutoPrune = No. This should avoid volumes to get recycled. If this is not the case, which Bacula version are you using? Does it happen with all part files or only some of them? Best regards, Ana On Fri, Jan 6, 2023 at 12:46 PM Chris Wilkinson <winstonia...@gmail.com> wrote: > I posted a similar question to the group late last year but I had no > response. The issue for me is intermittent and I've found no resolution to > it. I just rerun the failed jobs and delete them when it occurs. That often > leaves some orphaned volumes on S3 or the cache that I have to clean up > manually with a couple of bash scripts. > > Regards > Chris Wilkinson > > On Fri, 6 Jan 2023, 10:30 am Ivan Villalba via Bacula-users, < > bacula-users@lists.sourceforge.net> wrote: > >> Hi there, >> >> I'm getting errors on the jobs configured with cloud s3: >> >> 06-Jan 09:03 mainbackupserver-sd JobId 4030: Error: >> serverJob-CopyToS3-0781/part.16 state=error retry=1/10 size=2.064 MB >> duration=0s msg= S3_put_object ERR=Content-MD5 OR x-amz-checksum- HTTP >> header is required for Put Object requests with Object Lock parameters CURL >> Effective URL: https://xxxxxx.s3.eu-west-1.amazonaws.com/xxxxxxx/part.16 >> CURL Effective URL: >> https://xxxxxxx.s3.eu-west-1.amazonaws.com/xxxxxxx/part.16 RequestId : >> KPQE1MJPVAK3XK6F HostId : >> m8sQYlY4qJLDDThwKeDxnOWyksMR7bR1HJiukDmqf29ahPC6yc4x0LT0VWpmBfhObotCdX4T36M= >> >> I have the same error on all the jobs that uploads to s3 cloud. >> >> The thing is that it worked eventually, at least I have some uploaeds on >> the s3 bucket from the earlier tests jobs, but it's not working anymore, >> even I've not modified the configurations since then. >> >> What am I doing wrong? >> >> thanks in advance. >> >> >> Configurations (sensitive data hidden): >> SD: >> Device { >> Name = "backupserver-backups" >> Device Type = "Cloud" >> Cloud = "S3-cloud-eu-west-1" >> Maximum Part Size = 2M >> Maximum File Size = 2M >> Media Type = Cloud >> Archive Device = /backup/bacula-storage >> LabelMedia = yes >> Random Access = yes >> AutomaticMount = yes >> RemovableMedia = no >> AlwaysOpen = no >> } >> >> s3: >> Cloud { >> Name = "S3-cloud-eu-west-1" >> Driver = "S3" >> HostName = "s3.eu-west-1.amazonaws.com" >> BucketName = "xxxx" >> AccessKey = "xxxx" >> SecretKey = "xxxx" >> Protocol = HTTPS >> UriStyle = "VirtualHost" >> Truncate Cache = "AfterUpload" >> Upload = "EachPart" >> Region = "eu-west-1" >> MaximumUploadBandwidth = 10MB/s >> } >> >> Dir's storage: >> >> #CopyToS3 >> Storage { >> Name = "CloudStorageS3" >> Address = "xxxx" >> SDPort = 9103 >> Password = "xxxx" >> Device = "backupserver-backups" >> Media Type = Cloud >> Maximum Concurrent Jobs = 5 >> Heartbeat Interval = 10 >> } >> >> >> -- >> Ivan Villalba >> SysOps >> >> <https://www.marfeel.com/> >> >> <https://www.marfeel.com/> >> [image: Inline images 4] >> <https://atenea.marfeel.com/atn/marfeel-business/what-it-means-to-be-a-google-certified-publishing-partner> >> [image: Inline images 3] >> <https://atenea.marfeel.com/atn/marfeel-business/what-it-means-to-be-a-facebook-instant-articles-partner> >> >> >> Avda. Josep Tarradellas 20-30, 4th Floor >> >> 08029 Barcelona, Spain >> >> ES: (34) 93 178 59 50 >> <%2834%29%2093%20178%2059%2050%20%C2%A0ext.%20107> >> US: (1) 917-341-2540 <%281%29%20917-341-2540%20ext.%20107> >> _______________________________________________ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users >> > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users >
_______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users