ContextQMD
Back to Aws Doc Sdk Examples

AWS Glue code examples for the SDK for JavaScript (v3)

javascriptv3/example_code/glue/README.md

latest4.8 KB
Original Source

AWS Glue code examples for the SDK for JavaScript (v3)

Overview

Shows how to use the AWS SDK for JavaScript (v3) to work with AWS Glue.

<!--custom.overview.start--> <!--custom.overview.end-->

AWS Glue is a scalable, serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.

⚠ Important

  • Running this code might result in charges to your AWS account. For more details, see AWS Pricing and Free Tier.
  • Running the tests might result in charges to your AWS account.
  • We recommend that you grant your code least privilege. At most, grant only the minimum permissions required to perform the task. For more information, see Grant least privilege.
  • This code is not tested in every AWS Region. For more information, see AWS Regional Services.
<!--custom.important.start--> <!--custom.important.end-->

Code examples

Prerequisites

For prerequisites, see the README in the javascriptv3 folder.

<!--custom.prerequisites.start--> <!--custom.prerequisites.end-->

Get started

Basics

Code examples that show you how to perform the essential operations within a service.

Single actions

Code excerpts that show you how to call individual service functions.

<!--custom.examples.start--> <!--custom.examples.end-->

Run the examples

Instructions

Note: All code examples are written in ECMAscript 6 (ES6). For guidelines on converting to CommonJS, see JavaScript ES6/CommonJS syntax.

Run a single action

bash
node ./actions/<fileName>

Run a scenario

Most scenarios can be run with the following command:

bash
node ./scenarios/<fileName>

Run with options

Some actions and scenarios can be run with options from the command line:

bash
node ./scenarios/<fileName> --option1 --option2

util.parseArgs is used to configure these options. For the specific options available to each script, see the parseArgs usage for that file.

<!--custom.instructions.start--> <!--custom.instructions.end-->

Hello AWS Glue

This example shows you how to get started using AWS Glue.

bash
node ./hello.js

Learn the basics

This example shows you how to do the following:

  • Create a crawler that crawls a public Amazon S3 bucket and generates a database of CSV-formatted metadata.
  • List information about databases and tables in your AWS Glue Data Catalog.
  • Create a job to extract CSV data from the S3 bucket, transform the data, and load JSON-formatted output into another S3 bucket.
  • List information about job runs, view transformed data, and clean up resources.
<!--custom.basic_prereqs.glue_Scenario_GetStartedCrawlersJobs.start--> <!--custom.basic_prereqs.glue_Scenario_GetStartedCrawlersJobs.end--> <!--custom.basics.glue_Scenario_GetStartedCrawlersJobs.start--> <!--custom.basics.glue_Scenario_GetStartedCrawlersJobs.end-->

Tests

⚠ Running tests might result in charges to your AWS account.

To find instructions for running these tests, see the README in the javascriptv3 folder.

<!--custom.tests.start--> <!--custom.tests.end-->

Additional resources

<!--custom.resources.start--> <!--custom.resources.end-->

Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.

SPDX-License-Identifier: Apache-2.0