Indexing your Data
Introduction
Querying documents using a pre-existing database index is much faster because an index narrows down the set of documents to examine — see: the Query Troubleshooting topic.
When planning the indexes you need for your database, remember that while indexes make queries faster, they may also:
-
Make writes slightly slower, because each index must be updated whenever a document is updated
-
Make your Couchbase Lite database slightly larger.
Too many indexes may hurt performance. Optimal performance depends on designing and creating the right indexes to go along with your queries.
Constraints
Couchbase Lite for android does not currently support partial value indexes; indexes with non-property expressions.
You should only index with properties that you plan to use in the query.
|
Creating a new index
You can use SQL++ or QueryBuilder syntaxes to create an index
Example 2 creates a new index for the type
and name
properties, shown in this data model:
json{
"_id": "hotel123",
"type": "hotel",
"name": "The Michigander",
"overview": "Ideally situated for exploration of the Motor City and the wider state of Michigan. Tripadvisor rated the hotel ...",
"state": "Michigan"
}
QueryBuilder
See the QueryBuilder topic to learn more about QueryBuilder. |
The code to create the index will look something like this:
-
Kotlin
-
Java
Partial Index
Couchbase Lite 3.2.2 introduces support for Partial Index - Partial Value and Partial Full-Text Indexes.
The Partial Index can create a smaller index, potentially improving index and query performance.
You can use Partial Index to specify a WHERE
clause in your index configuration.
If a where clause is specified, the database will index a document only when the where clause condition is met.
Couchbase’s query optimizer uses SQLite’s Partial Index rules about queries using Partial Indexes to determine whether to use partial index in the query or not.
In general, Couchbase Lite follows the two rules, with a modification to the second rule.
Below is a summary of the two rules where:
-
X
- The expression in theWHERE
clause of a given Partial Index. -
W
- The expression in theWHERE
clause of a given query.
A query can use the Partial Index if the following two rules are satisfied:
-
If
W
is AND-connected terms, andX
is OR-connected terms and if any terms ofW
appears as a term ofX
, the partial index is allowed to be used. -
If a term in
X
is of the form"z IS NOT MISSING"
and if a term inW
is a comparison operator onz
other than"IS"
, the partial index is allowed to be used. The operators include=
,==
,<
,>
,<=
,>=
,<>
,IN
,LIKE
, andBETWEEN
.
If X is in the form of "z is NOT NULL" or "z is VALUED" , the first rule must be satisfied.
|
For example, let the partial index be c IS NOT NULL
when creating a partial index on collection named col1
in the default scope.
Then any query that uses operators =
, <
, >
, <=
, >=
, <>
, IN
, LIKE
, or BETWEEN
on column c
would be usable with the partial index, because those comparison operators are only true if c
is not NULL.
The following query could use the partial index:
sql++SELECT * FROM col1 WHERE b=456 AND c<>0; -- uses partial index
Whereas the next query can not use the partial index:
sql++SELECT * FROM col1 WHERE b=456; -- cannot use partial index
Partial Value Index
Partial Value Index is a form of Partial Index in which a value is used in the WHERE
clause and the query is selected by the query optimizer.
Partial Full-Text Index
A key difference between a Partial Value Index and a Partial Full-Text Index is that a Partial Full-Text Index is not selected by SQLite’s query optimizer.
Instead, it’s explicitly selected by the SQL++ match(indexName, terms)
function, which runs a Full-Text Search query using the indexed properties.
This means that a Partial Full-Text Index will always be used when the match()
function is invoked, regardless of other predicates in the WHERE clause.
For details, see Using Full-Text Search — Working with Queries.
-
Java
-
Kotlin
Array Indexing
Couchbase Lite 3.2.1 introduces functionality to optimize querying arrays.
Array UNNEST
to unpack arrays within a document to allow joins with the parent object, and array indexes for indexing unnested array’s values to allow more efficient queries with UNNEST
.
The Array Index
An array index is a new type of the index for indexing nested array’s properties to allow querying with the UNNEST
more efficiently.
Below is an example array index configuration:
Array Index Syntax
The syntax for array index configuration is shown below:
Name | Is Optional? | Description |
---|---|---|
|
Path to the array to be indexed.
Use |
|
|
An optional array of strings where each string represents values within the array to be indexed. In N1QL/SQL++ syntax, these expressions are separated by commas. In JSON syntax, as supported by Couchbase Lite for C, the expressions are represented as a JSON array. If the array specified by the path contains scalar values, the expressions should be left unset or set to null. |
Using Array Indexes with UNNEST
For the following examples, you can assume we are querying results from the following document, shown below:
JSON{
"Name":"Sam",
"contacts":[
{
"type":"primary",
"address":{"street":"1 St","city":"San Pedro","state":"CA"},
"phones":[
{"type":"home","number":"310-123-4567"},
{"type":"mobile","number":"310-123-6789"}
]
},
{
"type":"secondary",
"address":{"street":"5 St","city":"Seattle","state":"WA"},
"phones":[
{"type":"home","number":"206-123-4567"},
{"type":"mobile","number":"206-123-6789"}
]
}
],
"likes":["soccer","travel"]
}
Using the document above you can perform queries on a single nested array like so:
sql++SELECT name, interest FROM _ UNNEST likes as interest WHERE interest = "travel"
The query above produces the following output from the document:
JSON{"name": "Sam", "like": "travel"}
You can also perform the same operation using array indexes like so:
You can perform similar operations on nested arrays:
sql++SELECT name, contact.type, phone.number
FROM profiles
UNNEST contacts as contact
UNNEST contact.phones as phone
WHERE phone.type = "mobile"
The query produces the following output:
JSON{"name": "Sam", "type": "primary", "number": "310-123-6789"}
{"name": "Sam", "type": "secondary", "number": "206-123-6789"}
The output demonstrates retrieval of both primary and secondary contact numbers listed as type "mobile"
.
Here’s an example of creating an array index on a nested array containing dictionary values:
The above snippet creates an array index to allow you to iterate through contacts[].phones[].type
in the document, namely "home"
and "mobile"
.
Array literals are not supported in CBL 3.2.1. Attempting to create a query with array literals will return an error. |