Amazon S3 Batch for the SDK for Python (boto3)

Overview

This example demonstrates how to use the AWS SDK for Python (boto3) to work with Amazon Simple Storage Service (Amazon S3) Batch Scenario. The scenario covers various operations such as creating an AWS Batch compute environment, creating a job queue, creating a job defination, and submitting a job, and so on.

Here are the top six service operations this scenario covers.

Create an AWS Batch computer environment: Creates an AWS Batch computer environment.
Sets up a job queue: Creates a job queue that will manage the submission of jobs.
Creates a job definition: Creates a job definition that specifies how the jobs should be executed.
Registers a Job Definition: Registers a job definition making it available for job submissions.
Submits a Batch Job: Submits a job.
Checks the status of the job: Checks the status of the job.

⚠ Important

Running this code might result in charges to your AWS account. For more details, see AWS Pricing and Free Tier.
Running the tests might result in charges to your AWS account.
We recommend that you grant your code least privilege. At most, grant only the minimum permissions required to perform the task. For more information, see Grant least privilege.
This code is not tested in every AWS Region. For more information, see AWS Regional Services.

Code examples

Prerequisites

To run these examples, you need:

Python 3.x installed.
Run python pip install -r requirements.txt
AWS credentials configured. For more information, see Configuring the AWS CLI.

Running the workflow

To run this workflow, pull AWS tokens and run the command below:

bash

python s3_batch_scenario.py

Additional resources

SPDX-License-Identifier: Apache-2.0