javascript —

Yelp Migrates Cassandra to EKS by Moving EBS Volumes

A blog post by the site reliability team details a migration.

Yelp Migrates Cassandra to EKS by Moving EBS Volumes

It covered about 90 production clusters. There was zero downtime for customers and no data loss.

The largest cluster, a 54-pod user-data store, took about 12 hours end to end. Yelp had already moved its stateless workloads to EKS through its PaaSTA deployment layer, but Cassandra stayed behind.

Kubernetes has no built-in way to migrate StatefulSets and their persistent volumes across clusters. The usual approach is to add nodes to the new cluster and shut down the old ones.

This would temporarily double compute capacity but also lead to data transfer costs. For the largest clusters, streaming alone could have taken weeks. Yelp also considered a regional failover and rebuild, and a new Cassandra datacenter in EKS, but rated both as less transparent to customers.

Earlier coverage

Reported by infoq.com.

javascriptcloud

Related coverage

Elsewhere in this edition