docs/v3/release-notes/oss/version-3-0.mdx
Released on October 25, 2024
Enhancements ➕➕
ThreadPoolTaskRunner by @soamicharan in #15719serve by @zzstoatzz in #15727Cached state in console logs by @zzstoatzz in #15801Bug Fixes 🐞
run_namespaced_job by @zzstoatzz in #15732/api to PREFECT_UI_API_URL in default case by @zzstoatzz in #15736run_coro_as_sync by @kzvezdarov in #15687run_dbt_ functions in sync_compatible by @EmilRex in #15740variables.properties.env in deep merge by @kevingrismore in #15692Integrations & Dependencies 🤝
pydantic-settings by @zzstoatzz in #15797prefect-gcp
prefect-dbt
prefect-kubernetes
_request_timeout to Kubernetes watches by @kevingrismore in #15744Development & Tidiness 🧹
setuptools and update pip pin in Docker build by @desertaxle in #15759README.md by @zzstoatzz in #15807automation-assement.py by @jakekaplan in #15710Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.10...3.0.11
Released on October 15, 2024
This release fixes an issue where served flows would exit early and continues our reorganization of settings with pydantic-settings.
Bug Fixes 🐞
.serve exits early and add integration test by @zzstoatzz in #15691Development
APISettings setting group by @desertaxle in #15701Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.9...3.0.10
Released on October 15, 2024
Enhancements ✨
Bug Fixes 🐞
PREFECT_HOME in root_settings_context by @zzstoatzz in #15696config.load_kube_config by @zzstoatzz in #15655TaskWorker creates a anyio.TaskGroup in an async context by @desertaxle in #15684Development & Tidiness 🧹
versioneer.py to ignore uncommitted changes by @desertaxle in #15672.env file by @desertaxle in #15682pydantic<2 by @zzstoatzz in #15642Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.8...3.0.9
Released on October 10, 2024
This release reverts a change that caused a loss of "set" environment variables in runtime environments.
APISettings to group to group API-specific client settings" by @zzstoatzz in #15648Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.7...3.0.8
Released on October 10, 2024
This release includes a couple of bug fixes, including a fix for generating the Docker image name for the installed version of prefect.
Enhancements ➕➕
Bug Fixes 🐞
Development & Tidiness 🧹
pydantic models by @zzstoatzz in #15634APISettings to group to group API-specific client settings by @desertaxle in #15580Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.6...3.0.7
Released on October 09, 2024
This update focuses on fixing prefect-client compatibility checks. Key changes include adding version information to prefect-client and adjusting task logging levels.
Enhancements ➕➕
DEBUG by @zzstoatzz in #15631Bug Fixes 🐞
__version__ for prefect_client by @desertaxle in #15624Development & Tidiness 🧹
PrefectFuture by @zzstoatzz in #15625Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.5...3.0.6
Released on October 08, 2024
This release introduces support for loading settings from .env files, offering greater flexibility and ease of use in managing your Prefect configurations between projects.
New Features 🎉
.env by @zzstoatzz in #15565Enhancements ➕➕
pydantic-settings by @zzstoatzz in #15412Bug Fixes 🐞
TaskSource key computation to handle OSError("source not available") by @kzvezdarov in #15583lookup_type throws a KeyError in BaseResult.__new__ by @zzstoatzz in #15596keys by @zzstoatzz in #15611pydantic by @zzstoatzz in #15613run_deployment by @zzstoatzz in #15615Integrations & Dependencies 🤝
ConnectionComponents #15511 by @Ben-Taarit in #15553AwsClientParameters validation for verify by @zzstoatzz in #15574Development & Tidiness 🧹
await for task submissions in global concurrency limits example by @biancaines in #15581.env file support by @zzstoatzz in #15617Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.4...3.0.5
Released on October 01, 2024
Enhancements ➕➕
prefect deployment ls to show work pool by @zzstoatzz in #15454prefect deploy CLI. by @collincchoy in #15468prefect deploy by @zzstoatzz in #15484get_current_workspace cloud client method by @zzstoatzz in #15542end_time to flow run filters by @znicholasbrown in #15502transaction context manager to default write_on_commit to True by @desertaxle in #15515Bug Fixes 🐞
_coerce_env for k8s worker by @zzstoatzz in #15522Integrations & Dependencies 🤝
pytest and pytest-asyncio to the latest versions by @chrisguidry in #15523ConnectionComponents components from prefect-sqlalchemy in prefect-dbt by @westford14 in #15499Development & Tidiness 🧹
state.result for when used with run_deployment by @benjamincerigo in #15509websockets.exceptions.ConnectionClosedError by @desertaxle in #15467get_lost_followers retries by @zzstoatzz in #15518Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.3...3.0.4
Released on September 20, 2024
This release introduces improvements to cache policy configuration, offering developers more control and flexibility in managing task result caching:
key_storage parameter.isolation_level parameter.lock_manager parameter.These enhancements allow for more sophisticated caching strategies, improving performance and resource management in complex workflows.
To learn more about these changes, check out the task caching docs.
New Features 🎉
key_storage, isolation_level and lock_manager configuration to cache policies by @desertaxle in #15382Enhancements ➕➕
ConcurrencyOptions by @jeanluciano in #15291concurrency_limit field to flow.serve by @jeanluciano in #15376concurrency_limit in client methods by @jeanluciano in #15425Bug Fixes 🐞
flow.name with RunnerDeployment.from_storage by @zzstoatzz in #15393ray to fix server startup issues by @desertaxle in #15392retry_delay_seconds by @desertaxle in #15424run_count when entering RUNNING state by @desertaxle in #15436Integrations & Dependencies 🤝
prefect-redis for 0.2.0 release by @desertaxle in #15409AzureBlobStorageContainer.list_blobs method by @westford14 in #15390oracledb driver support in prefect-sqlalchemy by @Ben-Taarit in #15385Development & Tidiness 🧹
__add__ and __sub__ on cache policies by @desertaxle in #15379mypy type checking to /models by @bunchesofdonald in #15062Released on September 13, 2024
New Features 🎉
Enhancements ➕➕
FilesystemLockManager by @desertaxle in #15307strict mode by @cicdw in #15297prefect_test_harness startup timeout configurable by @desertaxle in #15354Runner enforces Deployment.concurrency_limit by @jeanluciano in #15085Bug Fixes 🐞
env on work-pools by @zzstoatzz in #15325safe_load_namespace by @desertaxle in #15358Integrations & Dependencies 🤝
prefect-databricks by @zzstoatzz in #15313DbtCoreOperation docstring by @zzstoatzz in #15317google into import guard by @desertaxle in #15334S3Bucket.download_object_to_path by @zzstoatzz in #15293DaskTaskRunner was attempting to create a duplicate cluster by @desertaxle in #15341Development & Tidiness 🧹
ResultStore by default for task transactions by @desertaxle in #15264RecordStore implementations by @desertaxle in #15314RedisRecordStore with RedisLockManager by @desertaxle in #15320self as normal arg when setting task run name by @jlowin in #15324for_each trigger example by @zzstoatzz in #15326Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.1...3.0.2
Released on September 06, 2024
This release contains a large collection of relatively small improvements and bug fixes on the back of our major 3.0.0 release. One particular set of improvements that I'd like to focus on are enhancements to server side logging and event handling. We received a few reports of task run states not showing up in the UI/API. It's important to note that events - and now task run states! - require a websocket connection to the API (the good news is that this will not disrupt workflow execution). Websockets are sometimes blocked by default in firewalls and network configuration, so we are working to raise failures to establish such a connection more prominently and potentially allow for alternative configurations. If you notice any issues with this, please let us know!
Enhancements ➕➕
prompt_select_from_table by @zzstoatzz in #15202ResultStore by @desertaxle in #15214CausalOrdering from task-run-recorder by @jakekaplan in #15244ResultStore with a Transaction by @desertaxle in #15247LockManager protocol and add locking abilities to ResultStore by @desertaxle in #15225Bug Fixes 🐞
pull_code instruction by @zzstoatzz in #15215prefect-docker cache key by @zzstoatzz in #15262Integrations & Dependencies 🤝
KeepAliveClientRequest class for k8s async client by @kevingrismore in #15220enable_socket_keep_alive by @jeanluciano in #15142prefect-kubernetes: add missing config loaders by @srsapient in #15209prefect-azure tests by @zzstoatzz in #15211Development & Tidiness 🧹
uv dev dependency by @cicdw in #15251pydantic==2.9.0 by @desertaxle in #15249is not for type comparison instead of != by @zzstoatzz in #15253Full Changelog: https://github.com/PrefectHQ/prefect/compare/3.0.0...3.0.1
Released on September 03, 2024
Prefect 3.0.0
For more information see our blog post on 3.0.
Full Changelog: https://github.com/PrefectHQ/prefect/compare/2.19.0...3.0.0