Re: [mailop] Connection failures to Hotmail domains
Okay, the External Facing messaging is along the lines of: Skinny: Issue resolved. ☺ “Yer Bug Is Fixed!” Some references were made to Han Solo on the intercom when they were trying to rescue the Princess, but were removed. Can’t really say more, but they tell me the Root Cause has been addressed, and stuff is in place to see that it doesn’t happen again. Huge Thanks to all who raised the alarm. The lack of an alarm here is also being looked into, as that issue should never have slipped thru the cracks, but it did. “ Inconceivable! “ You keep using that word… Have a most excellent rest of the week, and a glorious Memorial Day Weekend for the USA folks. … who are not On Call. Aloha, Michael. -- Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been Processed." | Got the Junk Mail Reporting Tool<http://www.microsoft.com/en-us/download/details.aspx?id=18275> ? From: frnk...@iname.com [mailto:frnk...@iname.com] Sent: Wednesday, May 25, 2016 3:08 PM To: 'Jaren Angerbauer' ; Michael Wise Cc: mailop Subject: RE: [mailop] Connection failures to Hotmail domains Finally has a chance to look at my logs … looking at error count over time (all U.S. Central) I see the following: Server 1: 1 25 12:3 1 25 12:4 4 25 13:1 22 25 13:2 22 25 13:3 24 25 13:4 31 25 13:5 18 25 14:0 8 25 14:1 16 25 14:2 5 25 14:3 19 25 14:4 15 25 14:5 18 25 15:0 7 25 15:1 6 25 15:2 4 25 15:3 11 25 15:4 2 25 15:5 8 25 16:0 9 25 16:1 6 25 16:2 7 25 16:3 9 25 16:4 6 25 16:5 4 25 17:0 Server 2: 2 25 12:4 1 25 13:0 14 25 13:1 10 25 13:2 24 25 13:3 20 25 13:4 11 25 13:5 11 25 14:0 19 25 14:1 11 25 14:2 9 25 14:3 12 25 14:4 14 25 14:5 7 25 15:0 8 25 15:1 16 25 15:2 8 25 15:3 17 25 15:4 17 25 15:5 7 25 16:0 12 25 16:1 12 25 16:2 27 25 16:3 13 25 16:4 18 25 16:5 4 25 17:0 So it’s off its peak, but not resolved. Frank From: mailop [mailto:mailop-boun...@mailop.org] On Behalf Of Jaren Angerbauer Sent: Wednesday, May 25, 2016 3:50 PM To: Michael Wise mailto:michael.w...@microsoft.com>> Cc: mailop mailto:mailop@mailop.org>> Subject: Re: [mailop] Connection failures to Hotmail domains Thanks Mike. If you can, any update you receive (and can disclose) would be greatly appreciated. --Jaren On Wed, May 25, 2016 at 2:29 PM, Michael Wise via mailop mailto:mailop@mailop.org>> wrote: Oh yeah, we're aware. Hearing some reports that the issue may have been mitigated, but until I hear anything from Inside the House, can't really comment except to say ... PRI:0, being worked on as I type. But not by me, as I have no insight into the inner workings. Aloha, Michael. -- Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been Processed." | Got the Junk Mail Reporting Tool ? -Original Message- From: mailop [mailto:mailop-boun...@mailop.org<mailto:mailop-boun...@mailop.org>] On Behalf Of Al Iverson Sent: Wednesday, May 25, 2016 1:19 PM To: mailop mailto:mailop@mailop.org>> Subject: Re: [mailop] Connection failures to Hotmail domains You're not alone. It's quite widespread. Multiple folks have talked to Microsoft people about the issue, they are aware. Regards, Al -- Al Iverson https://na01.safelinks.protection.outlook.com/?url=www.aliverson.com&data=01%7c01%7cmichael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=aAsiNeE1mgSCmbWOUv3P%2b9YXhGHv2v45p1LBMnD%2bdJs%3d (312)725-0130 On Wed, May 25, 2016 at 3:08 PM, Keenan Tims mailto:kt...@stargate.ca>> wrote: > I'm seeing 90+% of our connection attempts to the MXes for > 'hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fhotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=WcnB99sJ8QXnYKT9JfwX%2b4nIHrMbewnqgzRveNclMgE%3d>' > and other Hotmail domains > (mx[1-4].hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fhotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=WcnB99sJ8QXnYKT9JfwX%2b4nIHrMbewnqgzRveNclMgE%3d>) > are > either timing out (30s) or getting connection refused since ~11:00am > PDT. Anyone else seeing this? I've tested from a few off-net points > and am seeing the same. Mail is starting to pile up in our queues in > quantity. Given the scale of what this appears to be I assume the team > is already hard at work on it, but the lack of mention here concerns > me, so sorry for the noise if this is too o
Re: [mailop] Connection failures to Hotmail domains
Finally has a chance to look at my logs … looking at error count over time (all U.S. Central) I see the following: Server 1: 1 25 12:3 1 25 12:4 4 25 13:1 22 25 13:2 22 25 13:3 24 25 13:4 31 25 13:5 18 25 14:0 8 25 14:1 16 25 14:2 5 25 14:3 19 25 14:4 15 25 14:5 18 25 15:0 7 25 15:1 6 25 15:2 4 25 15:3 11 25 15:4 2 25 15:5 8 25 16:0 9 25 16:1 6 25 16:2 7 25 16:3 9 25 16:4 6 25 16:5 4 25 17:0 Server 2: 2 25 12:4 1 25 13:0 14 25 13:1 10 25 13:2 24 25 13:3 20 25 13:4 11 25 13:5 11 25 14:0 19 25 14:1 11 25 14:2 9 25 14:3 12 25 14:4 14 25 14:5 7 25 15:0 8 25 15:1 16 25 15:2 8 25 15:3 17 25 15:4 17 25 15:5 7 25 16:0 12 25 16:1 12 25 16:2 27 25 16:3 13 25 16:4 18 25 16:5 4 25 17:0 So it’s off its peak, but not resolved. Frank From: mailop [mailto:mailop-boun...@mailop.org] On Behalf Of Jaren Angerbauer Sent: Wednesday, May 25, 2016 3:50 PM To: Michael Wise Cc: mailop Subject: Re: [mailop] Connection failures to Hotmail domains Thanks Mike. If you can, any update you receive (and can disclose) would be greatly appreciated. --Jaren On Wed, May 25, 2016 at 2:29 PM, Michael Wise via mailop mailto:mailop@mailop.org> > wrote: Oh yeah, we're aware. Hearing some reports that the issue may have been mitigated, but until I hear anything from Inside the House, can't really comment except to say ... PRI:0, being worked on as I type. But not by me, as I have no insight into the inner workings. Aloha, Michael. -- Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been Processed." | Got the Junk Mail Reporting Tool ? -Original Message- From: mailop [mailto:mailop-boun...@mailop.org <mailto:mailop-boun...@mailop.org> ] On Behalf Of Al Iverson Sent: Wednesday, May 25, 2016 1:19 PM To: mailop mailto:mailop@mailop.org> > Subject: Re: [mailop] Connection failures to Hotmail domains You're not alone. It's quite widespread. Multiple folks have talked to Microsoft people about the issue, they are aware. Regards, Al -- Al Iverson https://na01.safelinks.protection.outlook.com/?url=www.aliverson.com <https://na01.safelinks.protection.outlook.com/?url=www.aliverson.com&data=01%7c01%7cmichael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=aAsiNeE1mgSCmbWOUv3P%2b9YXhGHv2v45p1LBMnD%2bdJs%3d> &data=01%7c01%7cmichael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=aAsiNeE1mgSCmbWOUv3P%2b9YXhGHv2v45p1LBMnD%2bdJs%3d (312)725-0130 On Wed, May 25, 2016 at 3:08 PM, Keenan Tims mailto:kt...@stargate.ca> > wrote: > I'm seeing 90+% of our connection attempts to the MXes for > 'hotmail.com <http://hotmail.com> ' and other Hotmail domains > (mx[1-4].hotmail.com <http://hotmail.com> ) are > either timing out (30s) or getting connection refused since ~11:00am > PDT. Anyone else seeing this? I've tested from a few off-net points > and am seeing the same. Mail is starting to pile up in our queues in > quantity. Given the scale of what this appears to be I assume the team > is already hard at work on it, but the lack of mention here concerns > me, so sorry for the noise if this is too obvious for the list ;-). > > Our primary outbound relays are within 64.253.128.0/19 > <http://64.253.128.0/19> > > Here are a couple representative logs: > > 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com <http://mx1.hotmail.com> [65.55.37.104]:25: Connection timed > out > 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com <http://mx1.hotmail.com> [207.46.8.167]:25: Connection timed > out > 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to > mx2.hotmail.com <http://mx2.hotmail.com> [65.55.33.119]:25: Connection refused > 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com <http://mx1.hotmail.com> [134.170.2.199]:25: Connection timed > out > 2016-05-25T12:56:49.583216-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com <http://mx1.hotmail.com> [65.54.188.110]:25: Connection timed > out > 2016-05-25T12:56:49.585566-07:00 skaro postfix/smtp[6486]: 3F2D5FFC9B: > to=mailto:indra_...@hotmail.com> >, relay=none, > delay=120, > delays=0.17/0/120/0, dsn=4.4.1, status=deferred (connect to mx1.hotmail.com > <http://mx1.hotmail.com> [65.54.188.110]:25: &g
Re: [mailop] Connection failures to Hotmail domains
Thanks Mike. If you can, any update you receive (and can disclose) would be greatly appreciated. --Jaren On Wed, May 25, 2016 at 2:29 PM, Michael Wise via mailop wrote: > > Oh yeah, we're aware. > Hearing some reports that the issue may have been mitigated, but until I > hear anything from Inside the House, can't really comment except to say ... > PRI:0, being worked on as I type. But not by me, as I have no insight into > the inner workings. > > Aloha, > Michael. > -- > Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been > Processed." | Got the Junk Mail Reporting Tool ? > > -Original Message- > From: mailop [mailto:mailop-boun...@mailop.org] On Behalf Of Al Iverson > Sent: Wednesday, May 25, 2016 1:19 PM > To: mailop > Subject: Re: [mailop] Connection failures to Hotmail domains > > You're not alone. It's quite widespread. Multiple folks have talked to > Microsoft people about the issue, they are aware. > > Regards, > Al > > -- > Al Iverson > > https://na01.safelinks.protection.outlook.com/?url=www.aliverson.com&data=01%7c01%7cmichael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=aAsiNeE1mgSCmbWOUv3P%2b9YXhGHv2v45p1LBMnD%2bdJs%3d > (312)725-0130 > > > On Wed, May 25, 2016 at 3:08 PM, Keenan Tims wrote: > > I'm seeing 90+% of our connection attempts to the MXes for > > 'hotmail.com' and other Hotmail domains (mx[1-4].hotmail.com) are > > either timing out (30s) or getting connection refused since ~11:00am > > PDT. Anyone else seeing this? I've tested from a few off-net points > > and am seeing the same. Mail is starting to pile up in our queues in > > quantity. Given the scale of what this appears to be I assume the team > > is already hard at work on it, but the lack of mention here concerns > > me, so sorry for the noise if this is too obvious for the list ;-). > > > > Our primary outbound relays are within 64.253.128.0/19 > > > > Here are a couple representative logs: > > > > 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to > > mx1.hotmail.com[65.55.37.104]:25: Connection timed out > > 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to > > mx1.hotmail.com[207.46.8.167]:25: Connection timed out > > 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to > > mx2.hotmail.com[65.55.33.119]:25: Connection refused > > 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to > > mx1.hotmail.com[134.170.2.199]:25: Connection timed out > > 2016-05-25T12:56:49.583216-07:00 skaro postfix/smtp[6486]: connect to > > mx1.hotmail.com[65.54.188.110]:25: Connection timed out > > 2016-05-25T12:56:49.585566-07:00 skaro postfix/smtp[6486]: 3F2D5FFC9B: > > to=, relay=none, delay=120, > > delays=0.17/0/120/0, dsn=4.4.1, status=deferred (connect to > mx1.hotmail.com[65.54.188.110]:25: > > Connection timed out) > > > > 2016-05-25T12:59:32.971606-07:00 skaro postfix/smtp[5033]: connect to > > mx3.hotmail.com[65.55.37.72]:25: Connection timed out > > 2016-05-25T12:59:32.995152-07:00 skaro postfix/smtp[5033]: connect to > > mx4.hotmail.com[65.54.188.126]:25: Connection refused > > 2016-05-25T13:00:03.033047-07:00 skaro postfix/smtp[5033]: connect to > > mx2.hotmail.com[207.46.8.167]:25: Connection timed out > > 2016-05-25T13:00:33.066589-07:00 skaro postfix/smtp[5033]: connect to > > mx4.hotmail.com[207.46.8.199]:25: Connection timed out > > 2016-05-25T13:00:33.076153-07:00 skaro postfix/smtp[5033]: connect to > > mx2.hotmail.com[65.55.33.119]:25: Connection refused > > 2016-05-25T13:00:33.080762-07:00 skaro postfix/smtp[5033]: 25B4FFFC00: > > to=, relay=none, delay=91, > > delays=0.78/0/90/0, dsn=4.4.1, status=deferred (connect to > > mx2.hotmail.com[65.55.33.119]:25: Connection refused) > > > > 2016-05-25T13:02:08.167728-07:00 skaro postfix/smtp[7967]: connect to > > mx4.hotmail.com[65.55.37.88]:25: Connection timed out > > 2016-05-25T13:02:08.177325-07:00 skaro postfix/smtp[7967]: connect to > > mx4.hotmail.com[65.55.37.120]:25: Connection refused > > 2016-05-25T13:02:38.208945-07:00 skaro postfix/smtp[7967]: connect to > > mx1.hotmail.com[65.54.188.72]:25: Connection timed out > > 2016-05-25T13:03:08.242467-07:00 skaro postfix/smtp[7967]: connect to > > mx1.hotmail.com[207.46.8.167]:25: Connection timed out > > 2016-05-25T13:03:38.275974-07:00 skaro postfix/smtp[7967]: connect to > > mx3.hotmail.com[207.46.8.199]:25: Connection timed out > > 2016-05-25T13:03:38.278894-07:00 skaro postfix/smt
Re: [mailop] Connection failures to Hotmail domains
As soon as I have something external-facing-worthy, I will let y’all know. Aloha, Michael. -- Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been Processed." | Got the Junk Mail Reporting Tool<http://www.microsoft.com/en-us/download/details.aspx?id=18275> ? From: Jaren Angerbauer [mailto:jarenangerba...@gmail.com] Sent: Wednesday, May 25, 2016 1:50 PM To: Michael Wise Cc: mailop Subject: Re: [mailop] Connection failures to Hotmail domains Thanks Mike. If you can, any update you receive (and can disclose) would be greatly appreciated. --Jaren On Wed, May 25, 2016 at 2:29 PM, Michael Wise via mailop mailto:mailop@mailop.org>> wrote: Oh yeah, we're aware. Hearing some reports that the issue may have been mitigated, but until I hear anything from Inside the House, can't really comment except to say ... PRI:0, being worked on as I type. But not by me, as I have no insight into the inner workings. Aloha, Michael. -- Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been Processed." | Got the Junk Mail Reporting Tool ? -Original Message- From: mailop [mailto:mailop-boun...@mailop.org<mailto:mailop-boun...@mailop.org>] On Behalf Of Al Iverson Sent: Wednesday, May 25, 2016 1:19 PM To: mailop mailto:mailop@mailop.org>> Subject: Re: [mailop] Connection failures to Hotmail domains You're not alone. It's quite widespread. Multiple folks have talked to Microsoft people about the issue, they are aware. Regards, Al -- Al Iverson https://na01.safelinks.protection.outlook.com/?url=www.aliverson.com&data=01%7c01%7cmichael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=aAsiNeE1mgSCmbWOUv3P%2b9YXhGHv2v45p1LBMnD%2bdJs%3d (312)725-0130 On Wed, May 25, 2016 at 3:08 PM, Keenan Tims mailto:kt...@stargate.ca>> wrote: > I'm seeing 90+% of our connection attempts to the MXes for > 'hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fhotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c93ddac7bbf0b443b9afe08d384de38aa%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=y%2f518o%2bKQgyQUWhcBGLfKotRfQnfrQaWBKrNT2ccZRE%3d>' > and other Hotmail domains > (mx[1-4].hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fhotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c93ddac7bbf0b443b9afe08d384de38aa%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=y%2f518o%2bKQgyQUWhcBGLfKotRfQnfrQaWBKrNT2ccZRE%3d>) > are > either timing out (30s) or getting connection refused since ~11:00am > PDT. Anyone else seeing this? I've tested from a few off-net points > and am seeing the same. Mail is starting to pile up in our queues in > quantity. Given the scale of what this appears to be I assume the team > is already hard at work on it, but the lack of mention here concerns > me, so sorry for the noise if this is too obvious for the list ;-). > > Our primary outbound relays are within > 64.253.128.0/19<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2f64.253.128.0%2f19&data=01%7c01%7cMichael.Wise%40microsoft.com%7c93ddac7bbf0b443b9afe08d384de38aa%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=WN7UuoRqCC%2bjOf6wZy9tTDWOTmrbFUpjdMj8D8rKcvw%3d> > > Here are a couple representative logs: > > 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c93ddac7bbf0b443b9afe08d384de38aa%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=pVFWvLEFCgWpNZQegrvoBOndPbJ7SthKW2q83emF6kE%3d>[65.55.37.104]:25: > Connection timed out > 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c93ddac7bbf0b443b9afe08d384de38aa%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=pVFWvLEFCgWpNZQegrvoBOndPbJ7SthKW2q83emF6kE%3d>[207.46.8.167]:25: > Connection timed out > 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to > mx2.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx2.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c93ddac7bbf0b443b9afe08d384de38aa%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=mjAFtsw8GdGXAnHSaoL74X23RKpm0%2fcGrfGMJY3cwOI%3d>[65.55.33.119]:25: > Connection refused > 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c93ddac7bbf0b443b9afe08d384de38aa%7c72f988bf86f141af91ab2d7cd011db47%7c1&a
Re: [mailop] Connection failures to Hotmail domains
We saw the same thing too, just too busy dealing with the fallout of a lightning strike. Frank -Original Message- From: mailop [mailto:mailop-boun...@mailop.org] On Behalf Of Keenan Tims Sent: Wednesday, May 25, 2016 3:09 PM To: mailop@mailop.org Subject: [mailop] Connection failures to Hotmail domains I'm seeing 90+% of our connection attempts to the MXes for 'hotmail.com' and other Hotmail domains (mx[1-4].hotmail.com) are either timing out (30s) or getting connection refused since ~11:00am PDT. Anyone else seeing this? I've tested from a few off-net points and am seeing the same. Mail is starting to pile up in our queues in quantity. Given the scale of what this appears to be I assume the team is already hard at work on it, but the lack of mention here concerns me, so sorry for the noise if this is too obvious for the list ;-). Our primary outbound relays are within 64.253.128.0/19 Here are a couple representative logs: 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[65.55.37.104]:25: Connection timed out 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[134.170.2.199]:25: Connection timed out 2016-05-25T12:56:49.583216-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[65.54.188.110]:25: Connection timed out 2016-05-25T12:56:49.585566-07:00 skaro postfix/smtp[6486]: 3F2D5FFC9B: to=, relay=none, delay=120, delays=0.17/0/120/0, dsn=4.4.1, status=deferred (connect to mx1.hotmail.com[65.54.188.110]:25: Connection timed out) 2016-05-25T12:59:32.971606-07:00 skaro postfix/smtp[5033]: connect to mx3.hotmail.com[65.55.37.72]:25: Connection timed out 2016-05-25T12:59:32.995152-07:00 skaro postfix/smtp[5033]: connect to mx4.hotmail.com[65.54.188.126]:25: Connection refused 2016-05-25T13:00:03.033047-07:00 skaro postfix/smtp[5033]: connect to mx2.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T13:00:33.066589-07:00 skaro postfix/smtp[5033]: connect to mx4.hotmail.com[207.46.8.199]:25: Connection timed out 2016-05-25T13:00:33.076153-07:00 skaro postfix/smtp[5033]: connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused 2016-05-25T13:00:33.080762-07:00 skaro postfix/smtp[5033]: 25B4FFFC00: to=, relay=none, delay=91, delays=0.78/0/90/0, dsn=4.4.1, status=deferred (connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused) 2016-05-25T13:02:08.167728-07:00 skaro postfix/smtp[7967]: connect to mx4.hotmail.com[65.55.37.88]:25: Connection timed out 2016-05-25T13:02:08.177325-07:00 skaro postfix/smtp[7967]: connect to mx4.hotmail.com[65.55.37.120]:25: Connection refused 2016-05-25T13:02:38.208945-07:00 skaro postfix/smtp[7967]: connect to mx1.hotmail.com[65.54.188.72]:25: Connection timed out 2016-05-25T13:03:08.242467-07:00 skaro postfix/smtp[7967]: connect to mx1.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T13:03:38.275974-07:00 skaro postfix/smtp[7967]: connect to mx3.hotmail.com[207.46.8.199]:25: Connection timed out 2016-05-25T13:03:38.278894-07:00 skaro postfix/smtp[7967]: 7DA71FFC4D: to=, relay=none, delay=3265, delays=3145/0/120/0, dsn=4.4.1, status=deferred (connect to mx3.hotmail.com[207.46.8.199]:25: Connection timed out) Keenan Stargate Connections AS19171 ___ mailop mailing list mailop@mailop.org https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop ___ mailop mailing list mailop@mailop.org https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop
Re: [mailop] Connection failures to Hotmail domains
Oh yeah, we're aware. Hearing some reports that the issue may have been mitigated, but until I hear anything from Inside the House, can't really comment except to say ... PRI:0, being worked on as I type. But not by me, as I have no insight into the inner workings. Aloha, Michael. -- Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been Processed." | Got the Junk Mail Reporting Tool ? -Original Message- From: mailop [mailto:mailop-boun...@mailop.org] On Behalf Of Al Iverson Sent: Wednesday, May 25, 2016 1:19 PM To: mailop Subject: Re: [mailop] Connection failures to Hotmail domains You're not alone. It's quite widespread. Multiple folks have talked to Microsoft people about the issue, they are aware. Regards, Al -- Al Iverson https://na01.safelinks.protection.outlook.com/?url=www.aliverson.com&data=01%7c01%7cmichael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=aAsiNeE1mgSCmbWOUv3P%2b9YXhGHv2v45p1LBMnD%2bdJs%3d (312)725-0130 On Wed, May 25, 2016 at 3:08 PM, Keenan Tims wrote: > I'm seeing 90+% of our connection attempts to the MXes for > 'hotmail.com' and other Hotmail domains (mx[1-4].hotmail.com) are > either timing out (30s) or getting connection refused since ~11:00am > PDT. Anyone else seeing this? I've tested from a few off-net points > and am seeing the same. Mail is starting to pile up in our queues in > quantity. Given the scale of what this appears to be I assume the team > is already hard at work on it, but the lack of mention here concerns > me, so sorry for the noise if this is too obvious for the list ;-). > > Our primary outbound relays are within 64.253.128.0/19 > > Here are a couple representative logs: > > 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com[65.55.37.104]:25: Connection timed out > 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com[207.46.8.167]:25: Connection timed out > 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to > mx2.hotmail.com[65.55.33.119]:25: Connection refused > 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com[134.170.2.199]:25: Connection timed out > 2016-05-25T12:56:49.583216-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com[65.54.188.110]:25: Connection timed out > 2016-05-25T12:56:49.585566-07:00 skaro postfix/smtp[6486]: 3F2D5FFC9B: > to=, relay=none, delay=120, > delays=0.17/0/120/0, dsn=4.4.1, status=deferred (connect to > mx1.hotmail.com[65.54.188.110]:25: > Connection timed out) > > 2016-05-25T12:59:32.971606-07:00 skaro postfix/smtp[5033]: connect to > mx3.hotmail.com[65.55.37.72]:25: Connection timed out > 2016-05-25T12:59:32.995152-07:00 skaro postfix/smtp[5033]: connect to > mx4.hotmail.com[65.54.188.126]:25: Connection refused > 2016-05-25T13:00:03.033047-07:00 skaro postfix/smtp[5033]: connect to > mx2.hotmail.com[207.46.8.167]:25: Connection timed out > 2016-05-25T13:00:33.066589-07:00 skaro postfix/smtp[5033]: connect to > mx4.hotmail.com[207.46.8.199]:25: Connection timed out > 2016-05-25T13:00:33.076153-07:00 skaro postfix/smtp[5033]: connect to > mx2.hotmail.com[65.55.33.119]:25: Connection refused > 2016-05-25T13:00:33.080762-07:00 skaro postfix/smtp[5033]: 25B4FFFC00: > to=, relay=none, delay=91, > delays=0.78/0/90/0, dsn=4.4.1, status=deferred (connect to > mx2.hotmail.com[65.55.33.119]:25: Connection refused) > > 2016-05-25T13:02:08.167728-07:00 skaro postfix/smtp[7967]: connect to > mx4.hotmail.com[65.55.37.88]:25: Connection timed out > 2016-05-25T13:02:08.177325-07:00 skaro postfix/smtp[7967]: connect to > mx4.hotmail.com[65.55.37.120]:25: Connection refused > 2016-05-25T13:02:38.208945-07:00 skaro postfix/smtp[7967]: connect to > mx1.hotmail.com[65.54.188.72]:25: Connection timed out > 2016-05-25T13:03:08.242467-07:00 skaro postfix/smtp[7967]: connect to > mx1.hotmail.com[207.46.8.167]:25: Connection timed out > 2016-05-25T13:03:38.275974-07:00 skaro postfix/smtp[7967]: connect to > mx3.hotmail.com[207.46.8.199]:25: Connection timed out > 2016-05-25T13:03:38.278894-07:00 skaro postfix/smtp[7967]: 7DA71FFC4D: > to=, relay=none, delay=3265, > delays=3145/0/120/0, dsn=4.4.1, status=deferred (connect to > mx3.hotmail.com[207.46.8.199]:25: > Connection timed out) > > Keenan > > Stargate Connections AS19171 > > > ___ > mailop mailing list > mailop@mailop.org > https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fchill > i.nosignal.org%2fcgi-bin%2fmailman%2flistinfo%2fmailop&data=01%7c01%7c > michael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72
Re: [mailop] Connection failures to Hotmail domains
On 5/25/2016 3:08 PM, Keenan Tims wrote: I'm seeing 90+% of our connection attempts to the MXes for 'hotmail.com' and other Hotmail domains (mx[1-4].hotmail.com) are either timing out (30s) or getting connection refused since ~11:00am PDT. Anyone else seeing this? I've tested from a few off-net points and am seeing the same. Mail is starting to pile up in our queues in quantity. Given the scale of what this appears to be I assume the team is already hard at work on it, but the lack of mention here concerns me, so sorry for the noise if this is too obvious for the list ;-). Our primary outbound relays are within 64.253.128.0/19 Here are a couple representative logs: 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[65.55.37.104]:25: Connection timed out 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[134.170.2.199]:25: Connection timed out 2016-05-25T12:56:49.583216-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[65.54.188.110]:25: Connection timed out 2016-05-25T12:56:49.585566-07:00 skaro postfix/smtp[6486]: 3F2D5FFC9B: to=, relay=none, delay=120, delays=0.17/0/120/0, dsn=4.4.1, status=deferred (connect to mx1.hotmail.com[65.54.188.110]:25: Connection timed out) 2016-05-25T12:59:32.971606-07:00 skaro postfix/smtp[5033]: connect to mx3.hotmail.com[65.55.37.72]:25: Connection timed out 2016-05-25T12:59:32.995152-07:00 skaro postfix/smtp[5033]: connect to mx4.hotmail.com[65.54.188.126]:25: Connection refused 2016-05-25T13:00:03.033047-07:00 skaro postfix/smtp[5033]: connect to mx2.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T13:00:33.066589-07:00 skaro postfix/smtp[5033]: connect to mx4.hotmail.com[207.46.8.199]:25: Connection timed out 2016-05-25T13:00:33.076153-07:00 skaro postfix/smtp[5033]: connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused 2016-05-25T13:00:33.080762-07:00 skaro postfix/smtp[5033]: 25B4FFFC00: to=, relay=none, delay=91, delays=0.78/0/90/0, dsn=4.4.1, status=deferred (connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused) 2016-05-25T13:02:08.167728-07:00 skaro postfix/smtp[7967]: connect to mx4.hotmail.com[65.55.37.88]:25: Connection timed out 2016-05-25T13:02:08.177325-07:00 skaro postfix/smtp[7967]: connect to mx4.hotmail.com[65.55.37.120]:25: Connection refused 2016-05-25T13:02:38.208945-07:00 skaro postfix/smtp[7967]: connect to mx1.hotmail.com[65.54.188.72]:25: Connection timed out 2016-05-25T13:03:08.242467-07:00 skaro postfix/smtp[7967]: connect to mx1.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T13:03:38.275974-07:00 skaro postfix/smtp[7967]: connect to mx3.hotmail.com[207.46.8.199]:25: Connection timed out 2016-05-25T13:03:38.278894-07:00 skaro postfix/smtp[7967]: 7DA71FFC4D: to=, relay=none, delay=3265, delays=3145/0/120/0, dsn=4.4.1, status=deferred (connect to mx3.hotmail.com[207.46.8.199]:25: Connection timed out) Keenan Stargate Connections AS19171 ___ mailop mailing list mailop@mailop.org https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop We started seeing the same thing at ~ 1:40 p.m. Central time. All connections to their MXs are timing out. Steve ___ mailop mailing list mailop@mailop.org https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop
Re: [mailop] Connection failures to Hotmail domains
On 25/05/16 21:08, Keenan Tims wrote: > I'm seeing 90+% of our connection attempts to the MXes for 'hotmail.com' > and other Hotmail domains (mx[1-4].hotmail.com) are either timing out > (30s) or getting connection refused since ~11:00am PDT. Anyone else > seeing this? Yup. -- Jeremy ___ mailop mailing list mailop@mailop.org https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop
Re: [mailop] Connection failures to Hotmail domains
You're not alone. It's quite widespread. Multiple folks have talked to Microsoft people about the issue, they are aware. Regards, Al -- Al Iverson www.aliverson.com (312)725-0130 On Wed, May 25, 2016 at 3:08 PM, Keenan Tims wrote: > I'm seeing 90+% of our connection attempts to the MXes for 'hotmail.com' and > other Hotmail domains (mx[1-4].hotmail.com) are either timing out (30s) or > getting connection refused since ~11:00am PDT. Anyone else seeing this? I've > tested from a few off-net points and am seeing the same. Mail is starting to > pile up in our queues in quantity. Given the scale of what this appears to > be I assume the team is already hard at work on it, but the lack of mention > here concerns me, so sorry for the noise if this is too obvious for the list > ;-). > > Our primary outbound relays are within 64.253.128.0/19 > > Here are a couple representative logs: > > 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com[65.55.37.104]:25: Connection timed out > 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com[207.46.8.167]:25: Connection timed out > 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to > mx2.hotmail.com[65.55.33.119]:25: Connection refused > 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com[134.170.2.199]:25: Connection timed out > 2016-05-25T12:56:49.583216-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com[65.54.188.110]:25: Connection timed out > 2016-05-25T12:56:49.585566-07:00 skaro postfix/smtp[6486]: 3F2D5FFC9B: > to=, relay=none, delay=120, delays=0.17/0/120/0, > dsn=4.4.1, status=deferred (connect to mx1.hotmail.com[65.54.188.110]:25: > Connection timed out) > > 2016-05-25T12:59:32.971606-07:00 skaro postfix/smtp[5033]: connect to > mx3.hotmail.com[65.55.37.72]:25: Connection timed out > 2016-05-25T12:59:32.995152-07:00 skaro postfix/smtp[5033]: connect to > mx4.hotmail.com[65.54.188.126]:25: Connection refused > 2016-05-25T13:00:03.033047-07:00 skaro postfix/smtp[5033]: connect to > mx2.hotmail.com[207.46.8.167]:25: Connection timed out > 2016-05-25T13:00:33.066589-07:00 skaro postfix/smtp[5033]: connect to > mx4.hotmail.com[207.46.8.199]:25: Connection timed out > 2016-05-25T13:00:33.076153-07:00 skaro postfix/smtp[5033]: connect to > mx2.hotmail.com[65.55.33.119]:25: Connection refused > 2016-05-25T13:00:33.080762-07:00 skaro postfix/smtp[5033]: 25B4FFFC00: > to=, relay=none, delay=91, > delays=0.78/0/90/0, dsn=4.4.1, status=deferred (connect to > mx2.hotmail.com[65.55.33.119]:25: Connection refused) > > 2016-05-25T13:02:08.167728-07:00 skaro postfix/smtp[7967]: connect to > mx4.hotmail.com[65.55.37.88]:25: Connection timed out > 2016-05-25T13:02:08.177325-07:00 skaro postfix/smtp[7967]: connect to > mx4.hotmail.com[65.55.37.120]:25: Connection refused > 2016-05-25T13:02:38.208945-07:00 skaro postfix/smtp[7967]: connect to > mx1.hotmail.com[65.54.188.72]:25: Connection timed out > 2016-05-25T13:03:08.242467-07:00 skaro postfix/smtp[7967]: connect to > mx1.hotmail.com[207.46.8.167]:25: Connection timed out > 2016-05-25T13:03:38.275974-07:00 skaro postfix/smtp[7967]: connect to > mx3.hotmail.com[207.46.8.199]:25: Connection timed out > 2016-05-25T13:03:38.278894-07:00 skaro postfix/smtp[7967]: 7DA71FFC4D: > to=, relay=none, delay=3265, delays=3145/0/120/0, > dsn=4.4.1, status=deferred (connect to mx3.hotmail.com[207.46.8.199]:25: > Connection timed out) > > Keenan > > Stargate Connections AS19171 > > > ___ > mailop mailing list > mailop@mailop.org > https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop ___ mailop mailing list mailop@mailop.org https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop
[mailop] Connection failures to Hotmail domains
I'm seeing 90+% of our connection attempts to the MXes for 'hotmail.com' and other Hotmail domains (mx[1-4].hotmail.com) are either timing out (30s) or getting connection refused since ~11:00am PDT. Anyone else seeing this? I've tested from a few off-net points and am seeing the same. Mail is starting to pile up in our queues in quantity. Given the scale of what this appears to be I assume the team is already hard at work on it, but the lack of mention here concerns me, so sorry for the noise if this is too obvious for the list ;-). Our primary outbound relays are within 64.253.128.0/19 Here are a couple representative logs: 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[65.55.37.104]:25: Connection timed out 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[134.170.2.199]:25: Connection timed out 2016-05-25T12:56:49.583216-07:00 skaro postfix/smtp[6486]: connect to mx1.hotmail.com[65.54.188.110]:25: Connection timed out 2016-05-25T12:56:49.585566-07:00 skaro postfix/smtp[6486]: 3F2D5FFC9B: to=, relay=none, delay=120, delays=0.17/0/120/0, dsn=4.4.1, status=deferred (connect to mx1.hotmail.com[65.54.188.110]:25: Connection timed out) 2016-05-25T12:59:32.971606-07:00 skaro postfix/smtp[5033]: connect to mx3.hotmail.com[65.55.37.72]:25: Connection timed out 2016-05-25T12:59:32.995152-07:00 skaro postfix/smtp[5033]: connect to mx4.hotmail.com[65.54.188.126]:25: Connection refused 2016-05-25T13:00:03.033047-07:00 skaro postfix/smtp[5033]: connect to mx2.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T13:00:33.066589-07:00 skaro postfix/smtp[5033]: connect to mx4.hotmail.com[207.46.8.199]:25: Connection timed out 2016-05-25T13:00:33.076153-07:00 skaro postfix/smtp[5033]: connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused 2016-05-25T13:00:33.080762-07:00 skaro postfix/smtp[5033]: 25B4FFFC00: to=, relay=none, delay=91, delays=0.78/0/90/0, dsn=4.4.1, status=deferred (connect to mx2.hotmail.com[65.55.33.119]:25: Connection refused) 2016-05-25T13:02:08.167728-07:00 skaro postfix/smtp[7967]: connect to mx4.hotmail.com[65.55.37.88]:25: Connection timed out 2016-05-25T13:02:08.177325-07:00 skaro postfix/smtp[7967]: connect to mx4.hotmail.com[65.55.37.120]:25: Connection refused 2016-05-25T13:02:38.208945-07:00 skaro postfix/smtp[7967]: connect to mx1.hotmail.com[65.54.188.72]:25: Connection timed out 2016-05-25T13:03:08.242467-07:00 skaro postfix/smtp[7967]: connect to mx1.hotmail.com[207.46.8.167]:25: Connection timed out 2016-05-25T13:03:38.275974-07:00 skaro postfix/smtp[7967]: connect to mx3.hotmail.com[207.46.8.199]:25: Connection timed out 2016-05-25T13:03:38.278894-07:00 skaro postfix/smtp[7967]: 7DA71FFC4D: to=, relay=none, delay=3265, delays=3145/0/120/0, dsn=4.4.1, status=deferred (connect to mx3.hotmail.com[207.46.8.199]:25: Connection timed out) Keenan Stargate Connections AS19171 ___ mailop mailing list mailop@mailop.org https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop
