Snapshots through PVC
This guide provides step-by-step instructions for setting up Dragonfly with snapshots through PVC. Dragonfly already supports snapshots, which allows
you to create a snapshot of your database at any point in time and restore it later. With this PVC integration, you can now store your snapshots in persistent volumes
and get them automatically restored when your Dragonfly pods get restarted or rescheduled across nodes. This is possible as a specific PVC is attached to each Dragonfly statefulset
and the snapshot is stored in that PVC.
The persistent volume can be backed by any storage provider that Kubernetes supports.
While this feature can help you recover from failures, It is not a replacement for Replication. You should still use replication if you want to maintain high availability.
Prerequisites
- A Kubernetes cluster with Dragonfly installed.
- Relevant storage provider installed and available in the cluster.
Deploying Dragonfly with Snapshots through PVC
Apply a Dragonfly manifest with PVC enabled on the default storage class:
kubectl apply -f - <<EOF
apiVersion: dragonflydb.io/v1alpha1
kind: Dragonfly
metadata:
name: dragonfly-pvc
spec:
replicas: 1
snapshot:
cron: "*/5 * * * *"
persistentVolumeClaimSpec:
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 2Gi
EOF
This will create a Dragonfly statefulset with the given PVC spec. The persistentVolumeClaimSpec
field is the same as the one used in Kubernetes PVC
and can be used to configure the PVC as per your requirements.
Wait for the Dragonfly instance to be ready:
kubectl describe dragonflies.dragonflydb.io dragonfly-pvc
Testing
Connect to the Dragonfly instance and add some data:
kubectl run -it --rm --restart=Never redis-cli --image=redis:7.0.10 -- redis-cli -h dragonfly-pvc.default SET foo bar
If you don't see a command prompt, try pressing enter.
pod "redis-cli" deleted
Delete the Dragonfly pod:
kubectl delete pod dragonfly-pvc-0
Wait for the pod to be recreated:
kubectl get pods -w
Connect to the Dragonfly instance, and check if the data is still there:
kubectl run -it --rm --restart=Never redis-cli --image=redis:7.0.10 -- redis-cli -h dragonfly-pvc.default GET foo
"bar"
pod "redis-cli" deleted
You should see the value bar
for the key foo
. This means that the data was restored from the snapshot that was stored in the PVC.
Managing Disk Space for Continuous Snapshots
Snapshots are not automatically pruned by Dragonfly, and they may fill up your disk. If you do not specify a snapshot name, pruning is something you need to manage yourself. Specifying a static snapshot name would avoid this problem by only ever having one snapshot.
kubectl apply -f - <<EOF
apiVersion: dragonflydb.io/v1alpha1
kind: Dragonfly
metadata:
name: dragonfly-pvc
spec:
replicas: 1
args: ["--dbfilename=mySnapshotName"]
snapshot:
...
...
EOF