Coinbase says 'low-risk' config change behind 50-minute July 14 outage impacting trading, card transactions

Coinbase posted a concise post-mortem on Tuesday explaining the cause behind an approximately 50-minute, platform-wide outage that occurred last week.

The disruption, running from 12:37 PM ET to about 1:25 PM ET on July 14, knocked out retail and institutional trading, deposits and withdrawals, Coinbase Card debit transactions, onchain swaps on Coinbase’s Base and Solana DEX integrations, as well as some other Prime services, according to the post.

"Coinbase experienced a service disruption that affected transfers, card transactions, and onchain services across our retail, institutional, and developer platforms," the company wrote, noting the issue "was caused by an unintended misconfiguration of an important network component as a result of a routine configuration update."

More specifically, Coinbase planned for a routine and “low-risk” configuration change to a shared production Kubernetes cluster as part of a migration to a new service deployment model. However, there was a resource name collision that “was not detected by our pre-production checks” that caused a system-wide blockage, according to the post.

"This loss of network access impacted nearly all internal asynchronous workflows," Coinbase wrote. "Workflows are how Coinbase moves money: trades settle, transfers complete, and card transactions are authorized through them. When infrastructure services became unreachable, those workflows paused platform-wide."

Coinbase noted that at no point were user funds at risk. User transactions that were stuck “in-flight” were completed once service was restored.

COIN is up over 11% at publication time, to $178.74, according to The Block's price page. 

Outages

This is not the first time Coinbase has suffered an outage, not even the first time this year. In the crypto niche, the exchange's litany of historic performance issues has become something of a joke, with a new punchline being CEO Brian Armstrong’s claim that the exchange is increasingly reliant on AI coding.

While explainable to some extent, Coinbase’s most recent outage comes amid a period of expansion for the largest U.S. crypto exchange. Not only is Coinbase beefing up its institutional prime services, but it is also attempting to compete directly with the likes of Robinhood on stock trading and become an “Everything Exchange” for users’ entire financial lives.

This isn’t to suggest that traditional exchanges like the New York Stock Exchange, Nasdaq, or the London Stock Exchange do not suffer outages and technical glitches, though they are comparatively rarer. NYSE reportedly paid the Securities and Exchange Commission $9 million after an outage in 2023.

On Tuesday, Coinbase’s status page is showing that "some users may be experiencing delayed Deposits and Withdrawals via SEPA."

"Our goal is always zero downtime," Coinbase wrote. "We are actively redesigning our infrastructure to ensure that, in the highly unlikely event of another failure like this one, we can swiftly revert and recover. We regret the disruption experienced by our users and apologize for any inconvenience this may have caused."

Of note, the Coinbase-incubated Base blockchain suffered two consecutive outages in late June.