Solana network restarts after outage that lasted five hours

Quick Take

  • The Layer 1 network Solana restarted after five hours of going dark. 

The Layer 1 network Solana has restarted after going dark around five hours earlier. 

"Block production on Solana mainnet beta resumed at 14:57 UTC (9:47  a.m. ET), following a successful upgrade to v1.17.20 and a restart of the cluster by validator operators. Engineers will continue to monitor performance as network operations are restored," the network wrote in an incident report.

"The outage began at approximately 09:53 UTC, lasting 5 hours. Core contributors are working on a root cause report, which will be made available once complete," the report continued. 

Matthew Sigel, Head of digital assets research at VanEck, wrote on X that the "Berkley Packet Filter” mechanism to deploy upgrade and execute programs on Solana seemed to be responsible for the failure.
 
"This seems to relate to a previous SMID (Solana Improvement Proposal) that altered some of the features including the adding a blocker to stop metadata from being used in the BPF because it was no longer needed," he wrote.

The outage

At 10:22 UTC (5:22 a.m. ET), Solana wrote in a network status notice that "engineers from across the ecosystem are investigating an outage on mainnet-beta." 

The disruption caused block progression to halt, meaning transactions couldn't go through, The Block previously reported

After around two hours of attempting to fix the matter, Solana Status, a page run by the Solana Foundation, said on the social media platform X that "engineers from across the ecosystem are readying a new validator software release, which includes a patch to address an issue which caused the cluster to halt. Validator operators should prepare for an upgrade and restart of the network."

The last time Solana experienced a "Major Outage" was in February 2023, when the blockchain was down for a few hours. After two restart attempts, the network came back online. 


Disclaimer: The Block is an independent media outlet that delivers news, research, and data. As of November 2023, Foresight Ventures is a majority investor of The Block. Foresight Ventures invests in other companies in the crypto space. Crypto exchange Bitget is an anchor LP for Foresight Ventures. The Block continues to operate independently to deliver objective, impactful, and timely information about the crypto industry. Here are our current financial disclosures.

© 2024 The Block. All Rights Reserved. This article is provided for informational purposes only. It is not offered or intended to be used as legal, tax, investment, financial, or other advice.

About Author

MK Manoylov has been a reporter for The Block since 2020 — joining just before bitcoin surpassed $20,000 for the first time. Since then, MK has written nearly 1,000 articles for the publication, covering any and all crypto news but with a penchant toward NFT, metaverse, web3 gaming, funding, crime, hack and crypto ecosystem stories. MK holds a graduate degree from New York University's Science, Health and Environmental Reporting Program (SHERP) and has also covered health topics for WebMD and Insider. You can follow MK on X @MManoylov and on LinkedIn.

Editor

To contact the editor of this story:
Nathan Crooks at
[email protected]