Set Up an External Data Source
- Operational Insights
- how-to
To provide query access to data that resides in external object storage, you create an external link and associate it with an external collection.
Supported External Sources
Operational Insights supports external links to data in Amazon S3, GCS, and Azure Blob Storage.
This data remains in the storage bucket or container—Operational Insights does not copy it into a collection.
You can query Delta tables residing in S3 buckets, GCS buckets, or Azure Blob Storage containers that are in one of the following formats:
-
JSON
-
CSV
-
TSV
-
Parquet
-
Avro
Apache Iceberg
Operational Insights also supports read-only access to Apache Iceberg tables through external catalogs. Unlike S3 and GCS external collections, Iceberg tables are registered through a catalog entity rather than a direct link to object storage.
To query Iceberg data:
-
Register a catalog using
CREATE CATALOG. -
Register an Iceberg table on that catalog using
CREATE EXTERNAL COLLECTION.
See Iceberg Tables for the full list of supported catalog types and prerequisites.