Replacing a dead node in a single-architecture cluster
Steps for replacing nodes in single-token architecture clusters, not vnodes.
Steps for replacing nodes in single-token architecture clusters, not vnodes.
Procedure
-
Confirm that the node is dead using nodetool
ring on any live node in the cluster.
A Down status indicates the dead node:
- Install Cassandra on the replacement node.
-
Remove any pre-existing Cassandra data on the replacement node:
sudo rm -rf /var/lib/cassandra/*
-
Set
auto_bootstrap: true
. -
Set the
initial_token
in the cassandra.yaml file to the value of the dead node's token -1.initial_token: 28356863910078205288614550619314017620
- Configure any non-default settings in the node's cassandra.yaml to match your existing cluster.
- Start the new node.
-
After the new node has finished bootstrapping, check that it is up using
nodetool ring
. -
Run nodetool repair on each keyspace to
ensure the node is fully consistent:
nodetool repair -h 10.46.123.12 keyspace_name
-
Remove the dead node.
The location of the cassandra.yaml file depends on the type of installation:
Cassandra package installations /etc/cassandra/cassandra.yaml Cassandra tarball installations install_location/cassandra/conf/cassandra.yaml