ContextQMD
Back to Datahub

v0.3.6

docs/managed-datahub/release-notes/v_0_3_6.md

1.5.0.37.3 KB
Original Source

v0.3.6

Release Availability Date

08-Oct-2024

If you are using an older CLI/SDK version, then please upgrade it. This applies for all CLI/SDK usages, if you are using it through your terminal, GitHub Actions, Airflow, in Python SDK somewhere, Java SDK, etc. This is a strong recommendation to upgrade, as we keep on pushing fixes in the CLI, and it helps us support you better.

Release Changelog

  • All changes in https://github.com/datahub-project/datahub/releases/tag/v0.14.1

  • Breaking Changes

    • Automatic downgrade to a previous release is not supported. Please reach out to support if required.
    • Metadata tests that are created/edited will not automatically run on a small batch (less than 10,000 assets) immediately anymore, but instead will rely on the scheduled run. Scheduled runs and metadata tests running on asset changes are unimpacted. This bug is fixed in 0.3.6.1.
    • Rest API Authorization enabled by default

  • Bug Fixes

    • No longer push notifications for soft-deleted entities
    • Fixed a bug in the share modal where sharing was disabled even if instances to share were selected
    • Correctly show the lineage count of upstreams and downstreams when there are large numbers
    • Combine sibling entities in all search lists throughout the app, and not just the main search page
    • Fix view select for Impact Analysis Tab
    • Remove "Remove from Domain", "Remove from Data Product", and "Remove from Glossary" buttons when adding assets to domains, data products, and glossary
    • Add 'explore all' button below all autocomplete results
    • Remove Ctrl-K as a mechanism to invoke the search bar on Mac (Command K only)
    • Adding Nullable tag back to V2 UI Columns tab.
    • Remove Resources section on Homepage
    • Use Browse Path instead of Container Path for rendering the context paths for assets across Search, Entity Profile, and more.
    • Minor fixes with Snowflake Tag Sync automation to prevent rate limiting on removals of tags that do not yet exist in Snowflake
    • Minor improvements to the Home Page Settings experience (Settings > Home Page)
    • Show the number of assets ingested when ingestion succeeds with warnings
    • Fetch more than 20 related proposals for an asset when rendering profile page (Glossary term, Tag proposals)
    • Add 'ALTER TABLE' expression to BigQuery Audit Log based Freshness Assertion
    • Hide the 'For You' section on the home page if there is no applicable content
    • Fixed mouse interactions with graphs on statistics pages
    • Fixed rare issues with lineage visualization node positioning and edge drawing
    • Fixed bug with changing advanced search filter condition
    • Hide "Remove from [X]" buttons when adding assets to domains, data products, and glossary terms
    • Change lineage sidebar summaries to use the default lineage time range
    • Impact analysis and data product assets pages properly show results based on the currently selected view
    • The New Users section in the Analytics page now tracks actual new users instead of last login
    • Data Contracts builder now shows custom assertions as expected
    • "View in Platform" buttons link location fixed
    • Compact search cards unnecessary title truncation fixed
    • Domain contents summary updates after domain is changed, without refresh
    • Incidents tab updates after an incident is created, updated, or resolved, without refresh
    • On lineage visualization, fix lineage expansion through transformation nodes while hiding transformations
    • On lineage visualization, fix positioning of query nodes on lineage expansion
    • On lineage visualization, cycles in graphs should no longer result in disappearing edges
    • Remote executor cleans up temporary files to avoid disk memory leak
    • Fixed hover cards when using Compact Card View

  • Product changes

    • Show total (nested) asset count on home page Domain cards
    • Add the ability to copy an urn from the ML Model asset profile page
    • Added the deleteStructuredProperty GraphQL API to delete structured properties
    • Improved "matched" section on search cards to let users know if a column is matched by a search term
    • The "Documentation" button under the "Govern" dropdown has been rebranded to the "Compliance Forms" button to more accurately reflect this feature.
    • On the Compliance Forms page, we now show you an overview of your organization's forms created to help govern your data assets. Here, you'll be able to manage all of your forms from the UI. The previous content of this page still exists under the "Analytics" tab.
    • We have several new question types available for forms - questions to collect documentation, ownership, domains, and glossary terms.
    • You can also now submit a response on up to 10,000 assets in the bulk form submission screen even if you have more than 10,000 assets. You can always submit again once these answers are processed.
    • We now show the bulk form submission screen first when entering a form from the Task Center.
    • We added a search bar in the bulk form submission flow to allow users to search when selecting assets to submit a response for.
    • Support Generating AI summaries of Queries via the UI - Request this to be enabled your by Acryl representative.
    • Allow hiding "Pending Tasks" module on home page, allows horizontal expansion of content
    • Moved "Pinned Links" up to the top of the home page as a separate category, from the left sidebar bottom (based on requests)
    • Assertions page uplift! Redesigned Asset Assertions (Entity Profile > Quality) to include a new Summary tab as well as search, filtering, and grouping capabilities on the assertions list.
    • Add toggle in lineage visualization for showing soft-deleted and non-existent entities
    • Add "Last Updated (in Source)" filter to search
    • Add "View In [Source]" button to lineage visualization sidebar
    • Send test notification button will always be visible in the subscriptions side bar if the user has set their memberID
    • On sibling combined entity page, viewing different schema versions no longer supported
    • On sibling combined entity page, change history drawer reflects changes to both siblings
    • On sibling combined entity sidebar, lineage summary is hidden to avoid confusion
    • For siblings combined entity page or search / hover card, multiple "View in Platform" icons should appear if applicable
    • Search cards configured to better handle smaller widths

  • Ingestion changes

  • Platform changes

    • Python images based on ubuntu base image
    • Postgres NPE fixed (upgraded ebean framework)
    • Domains/Containers have additional conditions: [DESCENDANTS_INCL, ANCESTORS_INCL, RELATED_INCL]
    • Removed legacy browsePathV2 GMS bootstrap job
    • Graphql dataloaders are now lazy loaded
    • Added fallback versioning strategy to aggregation query
    • Authorization cache added per request
    • API Throttling on Kafka lag extended to API for programmatic access
    • New GraphQL API to create subscriptions on behalf of individual users. Simply provide a new optional 'userUrn' parameter to the createSubscription mutation.
    • Several Timeline/Schema History bugs have been fixed which may impact version calculations in some scenarios
    • OIDC callback does not update corpUserStatus if the user is already ACTIVE