About Operational Insights Enterprise
- concept
Operational Insights Enterprise is a self-managed, JSON-native NoSQL analytical database that unifies data from diverse sources for complex analytical queries and timely insights.
Operational Insights integrates seamlessly with both Couchbase Server and the Couchbase Capella cloud platform, enabling the creation of real-time, adaptive applications.
Traditionally, analyzing JSON data in NoSQL databases requires complex transformations, like flattening, to prepare it for analytics, causing delays and hindering real-time insights. Operational Insights eliminates these ETL complexities by using a unifying JSON data model with schema flexibility. This allows data to fluidly evolve at its source without requiring manual schema or transformation management. This facilitates a Zero ETL environment, leading to faster time to insight, reduced costs, and increased agility.
Supported Platforms and Infrastructure
You deploy and manage Operational Insights on premises or in your own cloud environment.
Operating Systems
-
Red Hat Enterprise Linux (RHEL) 10.x, 9.x, and 8.x
-
Ubuntu 24.04 Long Term Support (LTS) and 22.x LTS (x86 and ARM64)
-
Debian 12.x
Object Storage
-
Amazon S3
-
Azure Blob Storage
-
Google Cloud Storage (GCS)
-
Any S3-compatible storage
For details, see Supported Object Storage Solutions.
System Resources
Resource requirements depend on the size and resource demands of your deployment.
- Processors
-
Supports x86 on all platforms, and ARM64 on Ubuntu.
- Hardware and sizing
-
Compute and memory scale based on your data volume and workload demands. For minimum and recommended node specifications, see System Resource Requirements.
- Storage and network
-
Requires adequate disk throughput for temporary query spilling and open ports for intra-cluster communication.
Key Features
Operational Insights offers the following features:
- Column-oriented storage
-
A storage engine delivers scalable analytic performance and capacity for self-managed, on-premises or cloud deployments, by reading only the columns a query needs.
- Independent scaling of compute and storage
-
A shared-nothing compute and shared-object storage architecture lets you scale compute resources independently of storage.
- Massively parallel query processing
-
An MPP-based query engine runs analytical queries across all nodes in parallel, for scalable, real-time results.
- Cost-based query optimization
-
A cost-based optimizer chooses efficient query plans using statistics gathered by
ANALYZE COLLECTION. - Zero ETL and real-time ingestion
-
Stream data in real time from Couchbase Server, Couchbase Capella, and nearly any other database or application through Kafka. Analyze incoming data in its native JSON form, with no flattening or transformation pipelines, and optionally modify the target JSON structure while data is in transit.
- Data Lakehouse queries
-
Query data directly in supported object storage, in JSON, Parquet, Avro, CSV, TSV, Delta table, and Apache Iceberg formats, with Iceberg tables accessed through Iceberg catalogs. A single query can combine external data with data already in Operational Insights.
- Write-back to the operational database
-
Use SQL++ to write query results back to the Couchbase operational data service, to support adaptive applications.
- BI tool support
-
Tabular views give Tableau, Power BI, and Apache Superset native SQL-based access, for building business reports, visualizations, and dashboards.
- Vector search
-
Create a vector index for approximate nearest neighbor (ANN) search over embeddings, and use the
CLUSTER BYclause to group embeddings by similarity. - Python UDFs
-
Extend SQL with Python functions running in an isolated sandbox, to bring a trained ML model into a query or implement logic that's hard to express in SQL.
- Query plan caching
-
Operational Insights reuses a cached execution plan for a repeated query, skipping the optimization step to start executing faster.
Data Sources and Connections
Operational Insights brings in data from operational databases, streaming platforms, and object storage. You query and visualize that data with SQL++, SDKs, and BI tools.
Data Sources
-
Couchbase Server and Couchbase Capella operational databases.
-
Kafka, to stream data from other databases or applications.
-
Files in supported object storage, in JSON, Parquet, Avro, CSV, TSV, and Delta formats.
-
Delta Lake tables and Apache Iceberg tables through Iceberg catalogs.
Clients and Tools
|
Operational Insights SDKs
Operational Insights SDKs for the .NET, Go, Java, Node.js, and Python platforms are available here. |
-
BI tools: Tableau, Power BI, and Apache Superset, through tabular views.
For setup steps, see Managing Links.