ContextQMD
Back to Aws Doc Sdk Examples

AWS Glue code examples for the SDK for Ruby

ruby/example_code/glue/README.md

latest3.9 KB
Original Source

AWS Glue code examples for the SDK for Ruby

Overview

Shows how to use the AWS SDK for Ruby to work with AWS Glue.

<!--custom.overview.start--> <!--custom.overview.end-->

AWS Glue is a scalable, serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.

⚠ Important

  • Running this code might result in charges to your AWS account. For more details, see AWS Pricing and Free Tier.
  • Running the tests might result in charges to your AWS account.
  • We recommend that you grant your code least privilege. At most, grant only the minimum permissions required to perform the task. For more information, see Grant least privilege.
  • This code is not tested in every AWS Region. For more information, see AWS Regional Services.
<!--custom.important.start--> <!--custom.important.end-->

Code examples

Prerequisites

For prerequisites, see the README in the ruby folder.

<!--custom.prerequisites.start--> <!--custom.prerequisites.end-->

Get started

Basics

Code examples that show you how to perform the essential operations within a service.

Single actions

Code excerpts that show you how to call individual service functions.

<!--custom.examples.start--> <!--custom.examples.end-->

Run the examples

Instructions

<!--custom.instructions.start--> <!--custom.instructions.end-->

Hello AWS Glue

This example shows you how to get started using AWS Glue.

ruby hello/hello_glue.rb

Learn the basics

This example shows you how to do the following:

  • Create a crawler that crawls a public Amazon S3 bucket and generates a database of CSV-formatted metadata.
  • List information about databases and tables in your AWS Glue Data Catalog.
  • Create a job to extract CSV data from the S3 bucket, transform the data, and load JSON-formatted output into another S3 bucket.
  • List information about job runs, view transformed data, and clean up resources.
<!--custom.basic_prereqs.glue_Scenario_GetStartedCrawlersJobs.start--> <!--custom.basic_prereqs.glue_Scenario_GetStartedCrawlersJobs.end-->

Start the example by running the following at a command prompt:

ruby glue_wrapper.rb
<!--custom.basics.glue_Scenario_GetStartedCrawlersJobs.start--> <!--custom.basics.glue_Scenario_GetStartedCrawlersJobs.end-->

Tests

⚠ Running tests might result in charges to your AWS account.

To find instructions for running these tests, see the README in the ruby folder.

<!--custom.tests.start--> <!--custom.tests.end-->

Additional resources

<!--custom.resources.start--> <!--custom.resources.end-->

Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.

SPDX-License-Identifier: Apache-2.0