I didn't see anyone address the original problem here much, so here are some details about this.
There is the dmarc address that Google itself uses, dmarc-nore...@google.com, it sometimes has the same rejections. I haven't checked recently, but wouldn't surprise me. Indeed, the problem occurs at midnight in the most popular time zones, more in the various US ones than in Europe. Jittering your sends to not be on the hour is a good idea for everyone sending dmarc reports. For non-Google dmarc report addresses hosted at Gmail/Workspace, it would be wise for the owners of those accounts to see the limits: https://support.google.com/a/answer/1366776?hl=en&ref_topic=28609 the main one being that Gmail accounts only accept about 1 message/second because they are not designed to be dumping grounds for automated mail. An internal FAQ stated that email is not a logging service, and it's a very poor alerting destination as well. The limits are implemented with allowances for bursts, and the distributed nature of the system means the limits are not perfectly enforced. It also has the classic problems of trying to impose a limit on a multi-hop system, so the name of the game is flow control... but that does lead to blocking messages that we could queue internally and deliver later. It also pushes back on the servers sending to the accounts... which sometimes is problematic (some servers will delay the entire queue to the domain or domains at the IP) but has other benefits as well... not to mention, less chances of bouncing, since I'm sure anyone sending us 20qps of mail wouldn't really want us to send them 20qps of bounces delayed by 3 days. At ~1qps, we return a 4xx response to messages over the limit... and we'll return a 5xx response at higher rates (I think it was 20qps, but I don't recall the exact number). There is some other minor stuff in there trying to understand various kinds of malicious too much mail DoS attacks that may result in 5xx responses. Gmail accounts mail have lower limits than Workspace accounts. The workaround for Workspace customers is that if the email address doesn't point to a Gmail account, we allow a higher qps. The admin can use email routing rules to route the address to a non-Gmail destination. Note that routing rules are complicated, you may need to explicitly not have a Gmail account with the email address to trigger the higher qps limit. For anyone who cares about their dmarc reports, I'd highly recommend using a third party service for analyzing them, they will be better set up to handle the load. Brandon On Fri, Dec 17, 2021 at 4:33 AM Alessandro Vesely via mailop < mailop@mailop.org> wrote: > Hi all, > > it seems lots of report generators trigger just around midnight. The > following log shows CET time, UTC+0100. I only tried to send 2 messages, > which resulted in 8 attempts, 2 bounces in less than one hour. > > > Dec 17 02:42:50 zaggregate[7788]: external rcpt dm...@mailinblue.com > authorize domain cloudwm.com > Dec 17 02:42:50 courierd: > started,id=00000000005DC1B9.0000000061BBEB1A.00002839,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 02:42:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 02:42:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 prevents additional messages > from being delivered. Please resend your > Dec 17 02:42:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 message at a later time. If the > user is able to receive mail at that > Dec 17 02:42:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 time, your message will be > delivered. For more information, please > Dec 17 02:42:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 visit > Dec 17 02:42:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450 4.2.1 > https://support.google.com/mail/?p=ReceivingRate f21si4230909edv.517 - > gsmtp > Dec 17 02:42:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: deferred > Dec 17 02:42:54 zaggregate[7788]: external rcpt dm...@mailinblue.com > authorize domain email.arsvalue.com > Dec 17 02:42:54 courierd: > started,id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 02:42:54 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 02:42:54 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 prevents additional messages > from being delivered. Please resend your > Dec 17 02:42:54 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 message at a later time. If the > user is able to receive mail at that > Dec 17 02:42:54 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 time, your message will be > delivered. For more information, please > Dec 17 02:42:54 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 visit > Dec 17 02:42:54 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450 4.2.1 > https://support.google.com/mail/?p=ReceivingRate f21si4230909edv.517 - > gsmtp > Dec 17 02:42:54 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: deferred > Dec 17 02:47:50 courierd: > started,id=00000000005DC1B9.0000000061BBEB1A.00002839,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 02:47:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 02:47:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 prevents additional messages > from being delivered. Please resend your > Dec 17 02:47:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 message at a later time. If the > user is able to receive mail at that > Dec 17 02:47:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 time, your message will be > delivered. For more information, please > Dec 17 02:47:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 visit > Dec 17 02:47:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450 4.2.1 > https://support.google.com/mail/?p=ReceivingRate cw22si5476954ejc.46 - > gsmtp > Dec 17 02:47:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: deferred > Dec 17 02:47:55 courierd: > started,id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 02:47:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 02:47:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 prevents additional messages > from being delivered. Please resend your > Dec 17 02:47:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 message at a later time. If the > user is able to receive mail at that > Dec 17 02:47:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 time, your message will be > delivered. For more information, please > Dec 17 02:47:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 visit > Dec 17 02:47:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450 4.2.1 > https://support.google.com/mail/?p=ReceivingRate cw22si5476954ejc.46 - > gsmtp > Dec 17 02:47:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: deferred > Dec 17 02:52:50 courierd: > started,id=00000000005DC1B9.0000000061BBEB1A.00002839,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 02:52:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 02:52:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 prevents additional messages > from being delivered. Please resend your > Dec 17 02:52:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 message at a later time. If the > user is able to receive mail at that > Dec 17 02:52:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 time, your message will be > delivered. For more information, please > Dec 17 02:52:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 visit > Dec 17 02:52:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450 4.2.1 > https://support.google.com/mail/?p=ReceivingRate l12si5542161edb.559 - > gsmtp > Dec 17 02:52:50 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: deferred > Dec 17 02:52:55 courierd: > started,id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 02:52:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 02:52:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 prevents additional messages > from being delivered. Please resend your > Dec 17 02:52:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 message at a later time. If the > user is able to receive mail at that > Dec 17 02:52:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 time, your message will be > delivered. For more information, please > Dec 17 02:52:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 visit > Dec 17 02:52:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450 4.2.1 > https://support.google.com/mail/?p=ReceivingRate l12si5542161edb.559 - > gsmtp > Dec 17 02:52:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: deferred > Dec 17 03:22:51 courierd: > started,id=00000000005DC1B9.0000000061BBEB1A.00002839,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 03:22:52 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 03:22:52 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 prevents additional messages > from being delivered. Please resend your > Dec 17 03:22:52 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 message at a later time. If the > user is able to receive mail at that > Dec 17 03:22:52 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 time, your message will be > delivered. For more information, please > Dec 17 03:22:52 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 visit > Dec 17 03:22:52 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450 4.2.1 > https://support.google.com/mail/?p=ReceivingRate e26si4954720edr.306 - > gsmtp > Dec 17 03:22:52 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: deferred > Dec 17 03:22:55 courierd: > started,id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 03:22:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 550-5.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 03:22:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 550-5.2.1 prevents additional messages > from being delivered. For more > Dec 17 03:22:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 550-5.2.1 information, please visit > Dec 17 03:22:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 550 5.2.1 > https://support.google.com/mail/?p=ReceivingRatePerm e26si4954720edr.306 > - gsmtp > Dec 17 03:22:55 courieresmtp: > id=00000000005DC1BC.0000000061BBEB1E.000029B4,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: failure > Dec 17 03:27:52 courierd: > started,id=00000000005DC1B9.0000000061BBEB1A.00002839,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 03:27:53 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 03:27:53 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 prevents additional messages > from being delivered. Please resend your > Dec 17 03:27:53 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 message at a later time. If the > user is able to receive mail at that > Dec 17 03:27:53 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 time, your message will be > delivered. For more information, please > Dec 17 03:27:53 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450-4.2.1 visit > Dec 17 03:27:53 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 450 4.2.1 > https://support.google.com/mail/?p=ReceivingRate ho31si2752830ejc.5 - > gsmtp > Dec 17 03:27:53 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: deferred > Dec 17 03:32:53 courierd: > started,id=00000000005DC1B9.0000000061BBEB1A.00002839,from=< > dmarc-bou...@tana.it>,module=esmtp,host=mailinblue.com,addr=< > dm...@mailinblue.com> > Dec 17 03:32:54 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 550-5.2.1 The user you are trying to > contact is receiving mail at a rate that > Dec 17 03:32:54 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 550-5.2.1 prevents additional messages > from being delivered. For more > Dec 17 03:32:54 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 550-5.2.1 information, please visit > Dec 17 03:32:54 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>: 550 5.2.1 > https://support.google.com/mail/?p=ReceivingRatePerm q17si4029627eds.411 > - gsmtp > Dec 17 03:32:54 courieresmtp: > id=00000000005DC1B9.0000000061BBEB1A.00002839,from=<dmarc-bou...@tana.it > >,addr=<dm...@mailinblue.com>,status: failure > _______________________________________________ > mailop mailing list > mailop@mailop.org > https://list.mailop.org/listinfo/mailop >
_______________________________________________ mailop mailing list mailop@mailop.org https://list.mailop.org/listinfo/mailop
