Set Up an External Data Source
- how-to
To provide query access to data that resides in external object storage, you create an external link and associate it with an external collection.
Supported External Sources
Enterprise Analytics supports external links to the following object storage providers:
-
Amazon S3
-
S3-compatible object stores
-
Azure Blob Storage
-
Google Cloud Storage (GCS)
This data remains in the source location — Enterprise Analytics does not copy it into a collection. You can query Delta tables residing in S3 buckets, S3 objects, or Azure Blob Storage containers, in one of the following formats:
-
JSON
-
CSV
-
TSV
-
Parquet
-
Avro
Apache Iceberg
Enterprise Analytics also supports read-only access to Apache Iceberg tables through external catalogs. Unlike S3 external collections, Iceberg tables are registered via a catalog entity rather than a direct link to object storage.
To query Iceberg data:
-
Register a catalog using
CREATE CATALOG. -
Register an Iceberg table on that catalog using
CREATE EXTERNAL COLLECTION.
See Iceberg Support for the full list of supported catalog types and prerequisites.
Creating a Link with an SDK
Enterprise Analytics uses different types of links to store credentials for accessing different types of data sources. You can use the UI to create links.
To create a link with an SDK, note the following:
-
External: in an SDK, you use the
S3ExternalAnalyticsLinkclass and then theAnalyticsIndexManagerclass to create the link.
For more information about data sources, see Access and Organize Data in Enterprise Analytics.