Back to Airflow

Amazon Athena

providers/amazon/docs/operators/athena/athena_boto.rst

3.2.12.7 KB
Original Source

.. Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

============= Amazon Athena

Amazon Athena <https://aws.amazon.com/athena/>__ is an interactive query service that makes it easy to analyze data in Amazon Simple Storage Service (S3) using standard SQL. Athena is serverless, so there is no infrastructure to setup or manage, and you pay only for the queries you run. To get started, simply point to your data in S3, define the schema, and start querying using standard SQL.

Prerequisite Tasks

.. include:: ../../_partials/prerequisite_tasks.rst

Generic Parameters

.. include:: ../../_partials/generic_parameters.rst

Operators

.. _howto/operator:AthenaOperator:

Run a query in Amazon Athena

Use the :class:~airflow.providers.amazon.aws.operators.athena.AthenaOperator to run a query in Amazon Athena.

In the following example, we query an existing Athena table and send the results to an existing Amazon S3 bucket. For more examples of how to use this operator, please see the Sample Dag <https://github.com/apache/airflow/blob/|version|/providers/amazon/tests/system/amazon/aws/example_athena.py>__.

.. exampleinclude:: /../../amazon/tests/system/amazon/aws/example_athena.py :language: python :start-after: [START howto_operator_athena] :dedent: 4 :end-before: [END howto_operator_athena]

Sensors

.. _howto/sensor:AthenaSensor:

Wait on Amazon Athena query results

Use the :class:~airflow.providers.amazon.aws.sensors.athena.AthenaSensor to wait for the results of a query in Amazon Athena.

.. exampleinclude:: /../../amazon/tests/system/amazon/aws/example_athena.py :language: python :start-after: [START howto_sensor_athena] :dedent: 4 :end-before: [END howto_sensor_athena]

Reference

  • AWS boto3 library documentation for Athena <https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html>__