Set Up an External Data Source

  • Operational Insights
  • how-to
To provide query access to data that resides in external object storage, you create an external link and associate it with an external collection.

Supported External Sources

Operational Insights supports external links to data in Amazon S3, GCS, and Azure Blob Storage. This data remains in the storage bucket or container—​Operational Insights does not copy it into a collection. You can query Delta tables residing in S3 buckets, GCS buckets, or Azure Blob Storage containers that are in one of the following formats:

  • JSON

  • CSV

  • TSV

  • Parquet

  • Avro

Apache Iceberg

Operational Insights also supports read-only access to Apache Iceberg tables through external catalogs. Unlike S3 and GCS external collections, Iceberg tables are registered through a catalog entity rather than a direct link to object storage.

To query Iceberg data:

  1. Register a catalog using CREATE CATALOG.

  2. Register an Iceberg table on that catalog using CREATE EXTERNAL COLLECTION.

See Iceberg Tables for the full list of supported catalog types and prerequisites.