Resolved

Opening a new alert for further updates

Avatar for Jaime Cantalupo
Jaime Cantalupo
Updated

Update from Microsoft:

"Current status: Our investigation has found that a process on the affected servers responsible for establishing secure connections becomes overwhelmed, causing the servers to stop processing requests. We're preparing a configuration change to address this behavior that can be applied across all affected servers, and we're validating it on a subset of servers before applying it more broadly alongside restarts of the affected infrastructure. In parallel, we've begun reverting a recent network configuration change that correlates with the start of impact and are monitoring to determine whether this contributes to recovery. The temporary traffic limitations we previously described are now in effect in specific locations. We're monitoring the affected servers in those locations to confirm whether they remain stable while handling a narrower set of connections, after which we'll gradually reintroduce additional traffic."

Avatar for Jaime Cantalupo
Jaime Cantalupo
Updated

Update from Microsoft:

"Current status: We’re continuing to pursue all available pathways to restore service, as our actions taken thus far have not provided the anticipated relief. Our investigation has found that a core process on the affected servers is becoming overwhelmed, which causes the servers to stop responding and contributes to the capacity loss.

To validate a potential recovery approach, we're fully isolating a portion of our service infrastructure, restarting the affected components, and gradually reintroducing traffic to confirm our services remain stable before applying this approach more broadly. We're also analyzing traffic patterns across our entire service infrastructure and evaluating whether isolating traffic within each region may allow affected regions to recover independently."

Avatar for Jaime Cantalupo
Jaime Cantalupo
Updated

Update from Microsoft:

"Current status: We're aggressively pursuing all pathways to reduce impact. As a precaution, we've paused all deployments and configuration changes while we review recent changes for any correlation to this event. We've determined that the elevated load isn't driven by an overall increase in traffic, but by a large number of servers being unexpectedly unavailable, which is shifting load onto the remaining infrastructure. We're investigating what's causing these servers to become unavailable while we work to safely return them to service."

Avatar for Jaime Cantalupo
Jaime Cantalupo
Updated

Microsoft's latest update:

"Current status: We're aggressively pursuing all pathways to reduce impact. As a precaution, we've paused all deployments and configuration changes while we review recent changes for any correlation to this event. We've also moved traffic for some services off the affected infrastructure to further reduce load, with additional traffic moves in progress. "

Avatar for Jaime Cantalupo
Jaime Cantalupo
Investigating

Users may be unable to connect to their mailboxes in Exchange Online through multiple connection methods

User impact: Users may be unable to connect to their mailboxes in Exchange Online through multiple connection methods.

We will share more information as Microsoft shares their updates.

Thanks you

Avatar for Jaime Cantalupo
Jaime Cantalupo
Began at:

Affected components
  • Microsoft Online
    • Office 365 Email Services