Back to Trino

Alluxio file system support

docs/src/main/sphinx/object-storage/file-system-alluxio.md

4801.4 KB
Original Source

Alluxio file system support

Trino includes a native implementation to access Alluxio as a file system with a catalog using the Delta Lake, Hive, Hudi, or Iceberg connectors. An Alluxio cluster acts as caching layer for one or more Trino catalogs and even clusters or other systems, in front of the actual object storage.

For comparison the caches data locally on the Trino cluster nodes and is separate for each catalog and cluster.

Enable the Alluxio file system with fs.alluxio.enabled=true in your catalog properties file.

Configuration

Use the following properties to configure general aspects of Alluxio file system support in your catalog properties file:

:::{list-table} :widths: 40, 60 :header-rows: 1

    • Property
    • Description
    • fs.alluxio.enabled
    • Activate the Alluxio file system support. Defaults to false. :::

Alluxio client configuration

The Alluxio cluster connection is configured in the alluxio-site.properties properties file. The same config file must be located in /opt/alluxio/conf on all Trino cluster nodes. Follow the Alluxio client configuration documentation for more details.

Example content of alluxio-site.properties:

properties
alluxio.master.hostname=127.0.0.1
alluxio.master.port=19998
alluxio.security.authentication.type=NOSASL