The ALTER INDEX statement moves the placement of an existing index or replica among different GSI nodes.
Purpose
You can use the ALTER INDEX
statement to change the placement of an existing index or replica among different GSI nodes, to increase or decrease the number of replicas, or to drop a specified index replica temporarily.
You can also use it to perform the same alterations to a partitioned index and any replica partitions.
You may use this statement when you encounter any of the following situations:
-
An imbalance occurs due to a particular index growing faster than expected and is needed on a different node.
-
An imbalance occurs due to a cluster of indexes being dropped on a single node.
-
A machine is scheduled for removal, so its indexes need to move off its current node.
-
The automated process of rebalancing does not give the expected results.
-
Other types of scaling up or scaling down are needed.
For example, if a node fails, you can use the ALTER INDEX
statement to move an index to another node.
See Examples below.
The ALTER INDEX move operation is asynchronous. As soon as the move alter index command is executed, the command returns. If there is no error in the input, the move operation can be tracked through the console UI and any error can be found in the Console logs and Indexer logs. |
If a node goes down while an ALTER INDEX operation is in progress, then the index would rollback to its original node (not affecting queries) and a notification would appear.
It is not possible to move an index or index replica and change the number of index replicas at the same time. |
Prerequisites
Only users with the RBAC role of Administrator
are allowed to run the ALTER INDEX
directive.
This directive is applicable only for Standard GSI (Plasma) and MOI Indexes; and hence supported only for Enterprise Edition nodes. (Not applicable for Forest DB.)
This statement is only supported only in Couchbase Server 5.5 and later; if the cluster is a mix of Couchbase Server 5.5 and previous versions, then this statement will not work.
In addition, altering the number of replicas or deleting an index replica is only supported in Couchbase Server 6.5 and later; if the cluster is a mix of Couchbase Server 6.5 and previous versions, then these operations will not work.
Syntax
alter-index ::= 'ALTER' 'INDEX' ( index-path '.' index-name | index-name 'ON' keyspace-ref )
index-using? index-with
The ALTER INDEX statement provides two possible syntaxes for specifying the index and the keyspace where the index is located.
- index-name
-
(Required) A unique name that identifies the index.
- index-path
-
(Optional) One possible syntax for specifying the keyspace. Refer to Index Path below.
- keyspace-ref
-
(Optional) The other possible syntax for specifying the keyspace. Refer to Index Name ON Keyspace Reference below.
- index-using
-
(Optional) Specifies the index type. Refer to USING Clause below.
- index-with
-
(Required) Specifies options for the index. Refer to WITH Clause below.
Index Path
index-path ::= keyspace-full | keyspace-prefix | keyspace-partial
You can use a dotted notation to specify the index and the keyspace on which the index is built. This syntax provides compatibility with legacy versions of Couchbase Server. The index path may be a full keyspace path, a keyspace prefix, or a keyspace partial.
If there is a hyphen (-) inside the index name or any part of the index path, you must wrap the index name or that part of the index path in backticks (` `). Refer to the examples below. |
Index Path: Full Keyspace
keyspace-full ::= namespace ':' bucket '.' scope '.' collection
If the index is built on a named collection, the index path may be a full keyspace path, including namespace, bucket, scope, and collection, followed by the index name. In this case, the query context is ignored.
- namespace
-
(Required) An identifier that refers to the namespace of the keyspace. Currently, only the
default
namespace is available. - bucket
-
(Required) An identifier that refers to the bucket name of the keyspace.
- scope
-
(Required) An identifier that refers to the scope name of the keyspace.
- collection
-
(Required) An identifier that refers to the collection name of the keyspace.
For example, default:`travel-sample`.inventory.airline.`idx-name`
indicates the idx-name
index on the airline
collection in the inventory
scope in the default:`travel-sample`
bucket.
Index Path: Keyspace Prefix
keyspace-prefix ::= ( namespace ':' )? bucket
If the index is built on the default collection in the default scope within a bucket, the index path may be just an optional namespace and the bucket name, followed by the index name. In this case, the query context should not be set.
- namespace
-
(Optional) An identifier that refers to the namespace of the keyspace. Currently, only the
default
namespace is available. If the namespace name is omitted, the default namespace in the current session is used. - bucket
-
(Required) An identifier that refers to the bucket name of the keyspace.
For example, default:`travel-sample`.def_type
indicates the def_type
index on the default collection in the default scope in the default:`travel-sample`
bucket.
Index Path: Keyspace Partial
keyspace-partial ::= collection
Alternatively, if the keyspace is a named collection, the index path may be just the collection name, followed by the index name. In this case, you must set the query context to indicate the required namespace, bucket, and scope.
- collection
-
(Required) An identifier that refers to the collection name of the keyspace.
For example, airline.`idx-name`
indicates the idx-name
index on the airline
collection, assuming that the query context is set.
Index Name ON Keyspace Reference
keyspace-ref ::= keyspace-path | keyspace-partial
In Couchbase Server 7.0 and later, you can use the index name with the ON
keyword and a keyspace reference to specify the keyspace on which the index is built.
The keyspace reference may be a keyspace path or a keyspace partial.
If there is a hyphen (-) inside the index name or any part of the keyspace reference, you must wrap the index name or that part of the keyspace reference in backticks (` `). Refer to the examples below. |
Keyspace Reference: Keyspace Path
keyspace-path ::= ( namespace ':' )? bucket ( '.' scope '.' collection )?
If the keyspace is a named collection, or the default collection in the default scope within a bucket, the keyspace reference may be a keyspace path. In this case, the query context should not be set.
- namespace
-
(Optional) An identifier that refers to the namespace of the keyspace. Currently, only the
default
namespace is available. If the namespace name is omitted, the default namespace in the current session is used. - bucket
-
(Required) An identifier that refers to the bucket name of the keyspace.
- scope
-
(Optional) An identifier that refers to the scope name of the keyspace. If omitted, the bucket’s default scope is used.
- collection
-
(Optional) An identifier that refers to the collection name of the keyspace. If omitted, the default collection in the bucket’s default scope is used.
For example, def_type ON default:`travel-sample`
indicates the def_type
index on the default collection in the default scope in the default:`travel-sample`
bucket.
Similarly, `idx-name` ON default:`travel-sample`.inventory.airline
indicates the idx-name
index on the airline
collection in the inventory
scope in the default:`travel-sample`
bucket.
Keyspace Reference: Keyspace Partial
keyspace-partial ::= collection
Alternatively, if the keyspace is a named collection, the keyspace reference may be just the collection name. In this case, you must set the query context to indicate the required namespace, bucket, and scope.
- collection
-
(Required) An identifier that refers to the collection name of the keyspace.
For example, `idx-name` ON airline
indicates the idx-name
index on the airline
collection, assuming the query context is set.
USING Clause
index-using ::= 'USING' 'GSI'
In Couchbase Server 6.5 and later, the index type for a secondary index must be Global Secondary Index (GSI).
The USING GSI
keywords are optional and may be omitted.
WITH Clause
index-with ::= 'WITH' expr
Use the WITH
clause to specify additional options.
- expr
-
An object with the following properties:
- action
-
[Required] A string denoting the operation to be performed. The possible values are:
- move
-
Moves an index (or its replicas) to a different node while not making any changes to the index topology — for example, the number of replicas remains the same. You must use the
nodes
property to specify the target node or nodes. - replica_count
-
Alters the number of replicas. You must use the
num_replica
property to specify the required number of replicas. You can use thenodes
property to restrict the placement of index replicas to the specified nodes. The planner decides where to place any new index replicas on the available index nodes, based on the server load. - drop_replica
-
Drops a specified replica temporarily; for example, to repair a replica. You must use the
replicaId
property to specify the replica to drop.
- num_replica
-
[Required if
action
is set toreplica_count
] An integer specifying the number of replicas of the index. The index service will automatically distribute these indexes amongst the index nodes in the cluster for load balancing and high availability purposes. The index service attempts to distribute the replicas based on the server groups in use in the cluster where possible. (You can restrict the number of index nodes available for index and index replica placement using thenodes
property, described below.) - nodes
-
[Required if
action
is set tomove
; optional ifaction
is set toreplica_count
] An array of strings, specifying a list of nodes. Ifaction
is set tomove
, the node list determines the new destination nodes for the index and its replicas. Ifaction
is set toreplica_count
and you are increasing the number of replicas, the node list restricts the set of nodes available for placement of the index and its replicas. However, ifaction
is set toreplica_count
and you are decreasing the number of replicas, thenodes
property is ignored. - replicaId
-
[Required if
action
is set todrop_replica
] An integer, specifying a replica ID.
Usage
If you attempt to alter an index which is still scheduled for background creation, the request fails.
ALTER INDEX
will not work while the cluster is undergoing a rebalance.
Moving an Index or Index Replicas
When moving an index or index replicas, the number of destination nodes must be the same as the number of nodes on which the index and any replicas are currently placed. You must specify the full node list, even if only one replica needs to be moved.
Likewise, when moving a partitioned index, the number of destination nodes must be the same as the number of nodes on which the index partitions and any replicas are currently placed. You cannot use this statement to repartition an index across a different number of nodes.
The source and destination node ranges may overlap, for example you may move a partitioned index from ["192.168.0.15:9000", "27.0.0.1:9001"]
to ["192.168.0.15:9000", "127.0.0.1:9002"]
.
Changing the Replica Count
When changing the number of replicas, the specified number of replicas must be less than the number of index nodes available for placement. If the specified number of replicas is greater than or equal to the number of index nodes available for placement, then the operation will fail.
If you specify a node list when changing the number of replicas, the specified nodes must include all of the nodes on which the index or index partitions and any index replicas are currently placed.
When increasing the number of replicas, whether you specify a node list or not, no single index node will host more than one replica of the same index, or the same partition of the same index. Replicas are distributed across the available server groups.
When reducing the number of replicas, the index service will first drop unhealthy replicas, where an unhealthy replica is a replica with missing partitions. After all unhealthy replicas are dropped, the index service will if necessary drop replicas with the highest replica ID. An unhealthy replica may not have the highest replica ID, so after an index reduction there may be "gaps" in the sequence of replica IDs — for example, 1, 2, 4, where replica ID 3 was dropped.
Dropping a Specific Replica
When dropping a replica, the index topology does not change. The indexing service remembers the number of partitions and replicas specified for this index. Given sufficient capacity, the dropped replica is rebuilt after the next rebalance — although it may be placed on a different index node, depending on the resource usage statistics of the available nodes.
To find the ID of an index replica and see which node it is placed on, you can use the Indexes screen in the Couchbase Web Console or query the system:indexes catalog.
When dropping a replica, it is possible to leave a server group with no replica. For a partitioned index, run a rebalance to move a replica into the vacant server group.
Return Value
If the ALTER INDEX
succeeds, then:
-
The query returns an empty array.
-
The index progress is visible in the Query Workbench.
-
After the movement is complete, the new indexes begin to service query scans.
-
The command line displays the new index nodes.
If the ALTER INDEX
fails, then:
-
The original indexes continue to service query scans.
-
The UI Log and Query Workbench has the appropriate error message.
-
Some common errors include:
Error Message Possible Cause GSI index xxxxxxxx not found
-
Mistyped an index name
Missing Node Information For Move Index
-
Mistyped
"node"
instead of"nodes"
-
Mistyped punctuation or other item
No Index Movement Required for Specified Destination List
-
Entered the current node instead of the target node
syntax error - at \",\"
-
Missed a double-quote mark (
"
)
Unable to find Index service for destination xxx.xxx.xxx.xxx:8091 or destination is not part of the cluster
-
Address doesn’t exist or was mistyped
-
Node isn’t running
-
Node not properly added to the cluster
Unsupported action value
-
Mistyped the
"action"
-
Examples
When using the below examples, make sure that an up-to-date version of Couchbase Server Enterprise Edition is already running on the named nodes.
To try the examples in this section, set the query context to the inventory
scope in the travel sample dataset.
For more information, see Query Context.
def_inventory_airport_faa
index from one node to anotherCreate a cluster of 3 nodes and then go to travel-sample
bucket.
The indexes are then installed in a round-robin fashion and distributed over the 3 nodes.
Then move the def_inventory_airport_faa
index from its original node (192.168.10.10 in this example) to a new node (192.168.10.11 in this example).
ALTER INDEX def_inventory_airport_faa ON airport
WITH {"action": "move", "nodes": ["192.168.10.11:8091"]};
You should see:
{
"results": []
}
Create an index on node 192.168.10.10 with a replica on node 192.168.10.11, then move its replica from node 192.168.10.11 to 192.168.10.12.
CREATE INDEX country_idx ON airport(country, city)
USING GSI
WITH {"nodes": ["192.168.10.10:8091", "192.168.10.11:8091"]};
ALTER INDEX country_idx ON airport
WITH {"action": "move", "nodes": ["192.168.10.10:8091", "192.168.10.12:8091"]};
Create an index on node 192.168.10.10 with replicas on nodes 192.168.10.11 and 192.168.10.12, then move the replicas to nodes 192.168.10.13 and 192.168.10.14.
CREATE INDEX country_idx ON airport(country, city)
WITH {"nodes": ["192.168.10.10:8091", "192.168.10.11:8091", "192.168.10.12:8091"]};
ALTER INDEX country_idx ON airport
WITH {"action": "move",
"nodes": ["192.168.10.10:8091", "192.168.10.13:8091", "192.168.10.14:8091"]};
Create an index on node 192.168.10.10 with replicas on nodes 192.168.10.11 and 192.168.10.12, then increase the number of replicas to 4 and specify that new replicas may be placed on any available index nodes in the cluster.
CREATE INDEX country_idx ON airport(country, city)
WITH {"nodes": ["192.168.10.10:8091", "192.168.10.11:8091", "192.168.10.12:8091"]};
ALTER INDEX country_idx ON airport
WITH {"action": "replica_count", "num_replica": 4};
Create an index on node 192.168.10.10 with replicas on nodes 192.168.10.11 and 192.168.10.12, then increase the number of replicas to 4, and specify that replicas may now also be placed on nodes 192.168.10.13 and 192.168.10.14.
CREATE INDEX country_idx ON airport(country, city)
WITH {"nodes": ["192.168.10.10:8091", "192.168.10.11:8091", "192.168.10.12:8091"]};
ALTER INDEX country_idx ON airport
WITH {"action": "replica_count",
"num_replica": 4,
"nodes": ["192.168.10.10:8091",
"192.168.10.11:8091",
"192.168.10.12:8091",
"192.168.10.13:8091",
"192.168.10.14:8091"]};
Create an index on node 192.168.10.10 with replicas on nodes 192.168.10.11 and 192.168.10.12, then decrease the number of replicas to 1.
CREATE INDEX country_idx ON airport(country, city)
WITH {"nodes": ["192.168.10.10:8091", "192.168.10.11:8091", "192.168.10.12:8091"]};
ALTER INDEX country_idx ON airport
WITH {"action": "replica_count", "num_replica": 1};
Create an index with two replicas, and specify that nodes 192.168.10.10, 192.168.10.11, 192.168.10.12, and 192.168.10.13 should be available for index and replica placement. Then delete replica 2.
CREATE INDEX country_idx ON airport(country, city)
USING GSI
WITH {"num_replica": 2,
"nodes": ["192.168.10.10:8091",
"192.168.10.11:8091",
"192.168.10.12:8091",
"192.168.10.13:8091"]};
ALTER INDEX country_idx ON airport
WITH {"action": "drop_replica", "replicaId": 2};
Related Links
Using the ALTER INDEX command to move one index at a time may be cumbersome if there are a lot of indexes to be moved. In Couchbase Server 7.0 and later, the index redistribution setting enables you to specify how Couchbase Server redistributes indexes automatically on rebalance. Refer to Rebalance for more information.