ContextQMD
Back to Airbyte

Google PageSpeed Insights

docs/integrations/sources/google-pagespeed-insights.md

2.0.010.3 KB
Original Source

Google PageSpeed Insights

This page guides you through the process of setting up the Google PageSpeed Insights source connector.

Sync overview

Prerequisites

Set up the Google PageSpeed Insights source connector

  1. Log into your Airbyte Cloud or Airbyte Open Source account.
  2. Click Sources and then click + New source.
  3. On the Set up the source page, select Google PageSpeed Insights from the Source type dropdown.
  4. Enter a name for your source.
  5. For API Key, enter your Google PageSpeed API Key.
  6. For URLs to analyse, enter one or many URLs you want to create PageSpeed Insights for. Example: https://www.google.com.
  7. For Analyses Strategies, enter either "desktop", "mobile" or both to define which Analyses strategy to use.
  8. For Lighthouse Categories, select one or many of the provided options. Categories are also called "audits" in some of the Google Lighthouse documentation.
  9. Click Set up source.

IMPORTANT: As of 2022-12-13, the PageSpeed Insights API - as well as this Airbyte Connector - allow to specify a URL with prefix "origin:" - like origin:https://www.google.com. This results in condensed, aggregated reports about the specified origin - see this FAQ. However: This option is not specified in any official documentation anymore, therefore it might be deprecated anytime soon!

Supported sync modes

The Google PageSpeed Insights source connector supports the following sync modes:

  • Full Refresh

Supported Streams

The Google PageSpeed Insights source connector supports the following stream:

  • pagespeed: Full pagespeed report of the selected URLs, lighthouse categories and analyses strategies.

Features

FeatureSupported?(Yes/No)Notes
Full Refresh SyncYes
Incremental SyncNo

Performance considerations

When using the connector without an API key, Google utilizes an undocumented, but strict rate limit - which also depends on how many global requests are currently sent to the PageSpeed API. The connector will retry, using an exponential backoff interval.

If the connector is used with an API key, Google allows for 25.000 queries per day and 240 queries per minute. Therefore, under normal usage, the connector should not trigger any rate limits. Create an issue if you see any rate limit issues that are not automatically retried successfully.

Changelog

<details> <summary>Expand to review</summary>
VersionDatePull RequestSubject
0.2.452026-03-1774938Update dependencies
0.2.442026-02-2473931Update dependencies
0.2.432026-02-1773374Update dependencies
0.2.422026-02-1073109Update dependencies
0.2.412026-02-0372679Update dependencies
0.2.402026-01-2071874Update dependencies
0.2.392026-01-1471695Update dependencies
0.2.382025-12-1870480Update dependencies
0.2.372025-11-2570081Update dependencies
0.2.362025-11-1869366Update dependencies
0.2.352025-11-0468274Update dependencies
0.2.342025-10-1468001Update dependencies
0.2.332025-10-0767254Update dependencies
0.2.322025-09-3066297Update dependencies
0.2.312025-09-0966039Update dependencies
0.2.302025-08-2365378Update dependencies
0.2.292025-08-0964613Update dependencies
0.2.282025-08-0264255Update dependencies
0.2.272025-07-2663891Update dependencies
0.2.262025-07-1963522Update dependencies
0.2.252025-07-1263105Update dependencies
0.2.242025-07-0562573Update dependencies
0.2.232025-06-2862184Update dependencies
0.2.222025-06-2161844Update dependencies
0.2.212025-06-1461093Update dependencies
0.2.202025-05-2460729Update dependencies
0.2.192025-05-1059832Update dependencies
0.2.182025-05-0358804Update dependencies
0.2.172025-04-1958210Update dependencies
0.2.162025-04-1257096Update dependencies
0.2.152025-03-2956717Update dependencies
0.2.142025-03-2256022Update dependencies
0.2.132025-03-0855322Update dependencies
0.2.122025-03-0154925Update dependencies
0.2.112025-02-2254400Update dependencies
0.2.102025-02-1553729Update dependencies
0.2.92025-02-0852367Update dependencies
0.2.82025-01-1851693Update dependencies
0.2.72025-01-1151118Update dependencies
0.2.62024-12-2850529Update dependencies
0.2.52024-12-2150030Update dependencies
0.2.42024-12-1449526Update dependencies
0.2.32024-12-1249177Update dependencies
0.2.22024-12-1147793Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64
0.2.12024-08-1644196Bump source-declarative-manifest version
0.2.02024-08-1544143Refactor connector to manifest-only format
0.1.172024-08-1043617Update dependencies
0.1.162024-08-0343130Update dependencies
0.1.152024-07-2742770Update dependencies
0.1.142024-07-2042319Update dependencies
0.1.132024-07-1341706Update dependencies
0.1.122024-07-1041591Update dependencies
0.1.112024-07-0941155Update dependencies
0.1.102024-07-0641011Update dependencies
0.1.92024-06-2940439Update dependencies
0.1.82024-06-2240104Update dependencies
0.1.72024-06-0639272[autopull] Upgrade base image to v1.2.2
0.1.62024-05-2138147Make compatable with builder
0.1.52024-04-1937171Updating to 0.80.0 CDK
0.1.42024-04-1837171Manage dependencies with Poetry.
0.1.32024-04-1537171Base image migration: remove Dockerfile and use the python-connector-base image
0.1.22024-04-1237171schema descriptions
0.1.12023-05-25#22287🐛 Fix URL pattern regex
0.1.02022-11-26#19813🎉 New Source: Google PageSpeed Insights [low-code CDK]
</details>