ContextQMD
Back to Datahub

Mysql Pre

metadata-ingestion/docs/sources/mysql/mysql_pre.md

1.5.0.31011 B
Original Source

Overview

The mysql module ingests metadata from Mysql into DataHub. It is intended for production ingestion workflows and module-specific capabilities are documented below.

Prerequisites

Grant the following privileges to the ingestion user:

  • grant select on DATABASE.* to 'USERNAME'@'%' (required for metadata and profiling)
  • grant show view on DATABASE.* to 'USERNAME'@'%' (required for view definitions)

AWS RDS IAM Authentication

AWS RDS MySQL supports IAM authentication instead of username/password.

Setup:

Follow AWS RDS IAM Database Authentication to:

  1. Enable IAM database authentication on your RDS instance
  2. Create database users with IAM authentication
  3. Configure IAM policies with rds-db:connect permissions

Configuration:

Set auth_mode: "AWS_IAM" in your recipe. Optionally configure aws_config for credentials and region (defaults to boto3's credential chain).