legacy-task-load-gcs

DEPRECATED: This toolkit is for legacy (non-dataflow) GCS connectors only.

This toolkit contains GCS-specific loading infrastructure for connectors that use the legacy task-based architecture. It provides GCS client wrappers and upload utilities that predate the modern dataflow pipeline.

Do Not Use For New Connectors

New GCS connectors should use core-load with the dataflow pipeline, using load-gcp for GCP credentials only. This toolkit should only be used and updated for the existing connectors that depend on it.

Connectors Using This Toolkit

• destination-bigquery

Configuration

To use this toolkit, add it to your connector's toolkits list along with useLegacyTaskLoader:

airbyteBulkConnector {
    core = 'load'
    toolkits = ['legacy-task-load-gcs']
    useLegacyTaskLoader = true
}

Contents

• GCS client wrappers
• GCS upload/download utilities
• GCS-specific configuration handling

Migration Path

Connectors should migrate to the modern dataflow pipeline when possible. For GCP credentials, use load-gcp instead. The dataflow architecture provides better performance, cleaner separation of concerns, and is the actively maintained code path.