Back to Clickhouse

Data Lakes

docs/en/sql-reference/datalakes.md

26.4.1.1-new2.3 KB
Original Source

In this section, we will take a look at ClickHouse's support for Data Lakes. ClickHouse supports many of the most popular table formats and data catalogs, including Iceberg, Delta Lake, Hudi, AWS Glue, REST Catalog, Unity Catalog and Microsoft OneLake.

Open table formats {#open-table-formats}

Iceberg {#iceberg}

See iceberg which supports reading from Amazon S3 and S3-compatible services, HDFS, Azure and local file systems. icebergCluster is the distributed variant of the iceberg function.

Delta Lake {#delta-lake}

See deltaLake which supports reading from Amazon S3 and S3-compatible services, Azure and local file systems. deltaLakeCluster is the distributed variant of the deltaLake function.

Hudi {#hudi}

See hudi which supports reading from Amazon S3 and S3-compatible services. hudiCluster is the distributed variant of the hudi function.

Data catalogs {#data-catalogs}

AWS Glue {#aws-glue}

AWS Glue Data Catalog can be used with Iceberg tables. You can use it with the iceberg table engine, or with the DataLakeCatalog database engine.

Iceberg REST Catalog {#iceberg-rest-catalog}

The Iceberg REST Catalog can be used with Iceberg tables. You can use it with the iceberg table engine, or with the DataLakeCatalog database engine.

Unity Catalog {#unity-catalog}

Unity Catalog can be used with both Delta Lake and Iceberg tables. You can use it with the iceberg or deltaLake table engines, or with the DataLakeCatalog database engine.

Microsoft OneLake {#microsoft-onelake}

Microsoft OneLake can be used with both Delta Lake and Iceberg tables. You can use it with the DataLakeCatalog database engine.