Back to Gitlabhq

Snowflake

doc/integration/snowflake.md

19.2.03.7 KB
Original Source

{{< details >}}

  • Tier: Premium, Ultimate
  • Offering: GitLab.com, GitLab Self-Managed, GitLab Dedicated

{{< /details >}}

{{< history >}}

{{< /history >}}

The Snowflake GitLab Data Connector pulls data into Snowflake.

In Snowflake you can then view, combine, manipulate, and report on all of the data. The GitLab Data Connector is based on GitLab REST APIs and requires both Snowflake and GitLab configuration.

Prerequisites

  1. If you do not have a GitLab personal access token:
    1. Sign in to GitLab.
    2. Follow steps outlined to create a personal access token.
  2. Create a external access integration in Snowflake. For more information, see setup documentation in the snowflake-connector project.
  3. Create a warehouse in Snowflake.

Configure the GitLab Data Connector

  1. Sign in to Snowflake.
  2. Select Data Products > Marketplace.
  3. Search for GitLab Data Connector.
  4. Select Data Products > Apps.
  5. Select GitLab Data Connector.
  6. Select a warehouse where the GitLab Data Connector runs.
  7. Select Start Configuration.
  8. Select Grant privileges.
  9. Enter a destination warehouse and schema. These can be any warehouse and schema that you want.
  10. Select Configure.
  11. Enter an External access integration.
  12. Enter the path where the GitLab personal access token secret is stored.
  13. Enter the domain for your GitLab instance. For example, gitlab.com.
  14. Select Connect.
  15. Enter a group name. For example, my-group.
  16. Select Finalize configurator.
  17. Select Configure.

Enable projects and groups

After configuring the GitLab Data Connector, you must specify which projects or groups have their audit events ingested into Snowflake. If you do not add at least one project or group, no data is ingested.

Enable projects

To add projects whose audit events you want to ingest:

  1. Sign in to Snowflake.
  2. Select Data Products > Apps.
  3. Select GitLab Data Connector.
  4. Select the Enabled Projects tab.
  5. Enter the path of the project you want to enable. For example, my-group/my-project.
  6. Select Add.
  7. Repeat for each additional project.

Enable groups

To add groups whose audit events you want to ingest:

  1. Sign in to Snowflake.
  2. Select Data Products > Apps.
  3. Select GitLab Data Connector.
  4. Select the Enabled Groups tab.
  5. Enter the path of the group you want to enable. For example, my-group.
  6. Select Add.
  7. Repeat for each additional group.

View data in Snowflake

  1. Sign in to Snowflake.
  2. Select Data > Databases.
  3. Select the warehouse previously configured.

Troubleshooting

No data appearing in Snowflake

If no data appears in Snowflake, check the following:

  • You have not added at least one project or group in the Enabled Projects or Enabled Groups tab. For more information, see Enable projects and groups.
  • The GitLab personal access token does not have the required scopes to read audit events.
  • The Snowflake warehouse configured for the GitLab Data Connector is suspended.