Dicode

Dicode’s Ceph cluster started running into out-of-space errors and recovery processes that stalled. As a result, the storage backend of its virtualization platform could no longer recover on its own.
Dicode’s websites and applications run on this platform, so a healthy storage environment is essential. The team needed to resolve the underlying issues and bring the cluster back to a fully redundant state.
A series of OSD failures affected the cluster’s redundancy. Only a single replica of the data remained available, which left the environment vulnerable and sharply increased the risk of data loss.
The situation was complex and called for experienced Ceph knowledge. As a small team, Dicode needed specialists who could step in quickly and restore stability to the environment.
Dicode engaged 42on for Emergency Assistance and Consultancy. 42on’s Ceph experts focused on recovering the data and restoring the cluster’s health. The cluster was successfully recovered, all data was restored, and the replicas were brought back into sync, which re-established multi-replica redundancy.
The engagement was also a chance to refine the cluster’s setup. Dicode moved from two OSDs per NVMe to a single OSD per NVMe and made several minor adjustments. These changes improved the configuration and help keep the Ceph environment healthy going forward.
Dicode’s Ceph cluster returned to a healthy state, with all data restored and multi-replica redundancy back in sync. The immediate storage issues were fully resolved.
With stability restored, Dicode can keep using Ceph as the foundation of its virtualization platform and hosting infrastructure, supporting its clients’ online operations.
The move to a single OSD per NVMe and other minor adjustments refined the cluster’s setup and help keep the Ceph environment healthy.
Beyond a healthy cluster, Dicode now has the reassurance that experienced Ceph specialists are available whenever they are needed.
42on supports Ceph teams with the complete operation of Ceph clusters by providing Consultancy, Training, Emergency Assistance, and Managed Services.
Why choose 42on as your partner for your open source infrastructure?
42on's passion for open source, particularly Ceph, is not just a statement but a core ethos. Actively engaged in the Ceph and related open source communities, our contributions to GitHub, tech blogs and events showcase our enthusiastic involvement
We avoid vendor lock-in and work together with clients that use open source or subscribed Ceph. This vendor-agnostic approach ensures clients have the freedom to choose their preferred vendor while benefiting from 42on's expert support and guidance.
We understand that every business has unique needs. Therefore, we provide a range of services that allow you to customize your level of control. You can choose to maintain complete control or delegate tasks as you see fit.