Skip to content

Latest commit

 

History

History
47 lines (28 loc) · 2.55 KB

File metadata and controls

47 lines (28 loc) · 2.55 KB
description Documentation for Data Lakes
sidebarTitle Overview
slug /sql-reference/datalakes
title Data Lakes
doc_type reference

In this section, we will take a look at ClickHouse's support for Data Lakes. ClickHouse supports many of the most popular table formats and data catalogs, including Iceberg, Delta Lake, Hudi, AWS Glue, REST Catalog, Unity Catalog and Microsoft OneLake.

Open table formats {#open-table-formats}

Iceberg {#iceberg}

See iceberg which supports reading from Amazon S3 and S3-compatible services, HDFS, Azure and local file systems. icebergCluster is the distributed variant of the iceberg function.

Delta Lake {#delta-lake}

See deltaLake which supports reading from Amazon S3 and S3-compatible services, Azure and local file systems. deltaLakeCluster is the distributed variant of the deltaLake function.

Hudi {#hudi}

See hudi which supports reading from Amazon S3 and S3-compatible services. hudiCluster is the distributed variant of the hudi function.

Data catalogs {#data-catalogs}

AWS Glue {#aws-glue}

AWS Glue Data Catalog can be used with Iceberg tables. You can use it with the iceberg table engine, or with the DataLakeCatalog database engine.

Iceberg REST Catalog {#iceberg-rest-catalog}

The Iceberg REST Catalog can be used with Iceberg tables. You can use it with the iceberg table engine, or with the DataLakeCatalog database engine.

Snowflake Horizon Catalog {#snowflake-horizon-catalog}

Snowflake Horizon Catalog exposes the Iceberg REST API for Snowflake-managed Iceberg tables. Use DataLakeCatalog with catalog_type = 'horizon'. See the Horizon catalog guide.

Unity Catalog {#unity-catalog}

Unity Catalog can be used with both Delta Lake and Iceberg tables. You can use it with the iceberg or deltaLake table engines, or with the DataLakeCatalog database engine.

Microsoft OneLake {#microsoft-onelake}

Microsoft OneLake can be used with both Delta Lake and Iceberg tables. You can use it with the DataLakeCatalog database engine.