<!-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -->

RFCs

The RFC process is documented on our site. Please familiarize yourself with it, before working a new RFC.

Status can be one of these values.

Status	Meaning
:eyes: UNDER REVIEW	RFC has been proposed and community is actively debating the design/proposal.
:hammer_and_wrench: IN PROGRESS	The initial phase of implementation is underway.
:arrows_counterclockwise: ONGOING	Some or most work has landed; community continues to improve or build follow on phases.
:x: ABANDONED	The proposal was not implemented, due to various reasons.
:white_check_mark: COMPLETED	All work is deemed complete.

The list of all RFCs can be found here.

Older RFC content is still here.

RFC Number	Title	Status
1	CSV Source Support for Delta Streamer	:white_check_mark: COMPLETED
2	ORC Storage in Hudi	:white_check_mark: COMPLETED
3	Timeline Service with Incremental File System View Syncing	:white_check_mark: COMPLETED
4	Faster Hive incremental pull queries	:white_check_mark: COMPLETED
5	HUI (Hudi WebUI)	:x: ABANDONED
6	Add indexing support to the log file	:x: ABANDONED
7	Point in time Time-Travel queries on Hudi table	:white_check_mark: COMPLETED
8	Metadata based Record Index	:white_check_mark: COMPLETED
9	Hudi Dataset Snapshot Exporter	:white_check_mark: COMPLETED
10	Restructuring and auto-generation of docs	:white_check_mark: COMPLETED
11	Refactor of the configuration framework of hudi project	:x: ABANDONED
12	Efficient Migration of Large Parquet Tables to Apache Hudi	:white_check_mark: COMPLETED
13	Integrate Hudi with Flink	:white_check_mark: COMPLETED
14	JDBC incremental puller	:white_check_mark: COMPLETED
15	HUDI File Listing Improvements	:white_check_mark: COMPLETED
16	Abstraction for HoodieInputFormat and RecordReader	:white_check_mark: COMPLETED
17	Abstract common meta sync module support multiple meta service	:white_check_mark: COMPLETED
18	Insert Overwrite API	:white_check_mark: COMPLETED
19	Clustering data for freshness and query performance	:white_check_mark: COMPLETED
20	handle failed records	:arrows_counterclockwise: ONGOING
21	Allow HoodieRecordKey to be Virtual	:white_check_mark: COMPLETED
22	Snapshot Isolation using Optimistic Concurrency Control for multi-writers	:white_check_mark: COMPLETED
23	Hudi Observability metrics collection	:x: ABANDONED
24	Hoodie Flink Writer Proposal	:white_check_mark: COMPLETED
25	Spark SQL Extension For Hudi	:white_check_mark: COMPLETED
26	Optimization For Hudi Table Query	:white_check_mark: COMPLETED
27	Data skipping index to improve query performance	:white_check_mark: COMPLETED
28	Support Z-order curve	:white_check_mark: COMPLETED
29	Hash Index	:white_check_mark: COMPLETED
30	Batch operation	:x: ABANDONED
31	Hive integration Improvement	:x: ABANDONED
32	Kafka Connect Sink for Hudi	:arrows_counterclockwise: ONGOING
33	Hudi supports more comprehensive Schema Evolution	:white_check_mark: COMPLETED
34	Hudi BigQuery Integration	:white_check_mark: COMPLETED
35	Make Flink MOR table writing streaming friendly	:white_check_mark: COMPLETED
36	HUDI Metastore Server	:arrows_counterclockwise: ONGOING
37	Hudi Metadata based Bloom Index	:white_check_mark: COMPLETED
38	Spark Datasource V2 Integration	:white_check_mark: COMPLETED
39	Incremental source for Debezium	:white_check_mark: COMPLETED
40	Connector for Trino	:white_check_mark: COMPLETED
41	Snowflake Integration, supported via Apache XTable (Incubating)	:x: ABANDONED
42	Consistent Hashing Index	:arrows_counterclockwise: ONGOING
43	Table Management Service	:x: ABANDONED
44	Hudi Connector for Presto	:white_check_mark: COMPLETED
45	Asynchronous Metadata Indexing	:white_check_mark: COMPLETED
46	Optimizing Record Payload Handling	:white_check_mark: COMPLETED
47	Add Call Produce Command for Spark SQL	:white_check_mark: COMPLETED
48	LogCompaction for MOR tables	:white_check_mark: COMPLETED
49	Support sync with DataHub	:white_check_mark: COMPLETED
50	Improve Timeline Server	:x: ABANDONED
51	Change Data Capture	:arrows_counterclockwise: ONGOING
52	Introduce Secondary Index to Improve HUDI Query Performance	:x: ABANDONED
53	Use Lock-Free Message Queue Improving Hoodie Writing Efficiency	:white_check_mark: COMPLETED
54	New Table APIs and Streamline Hudi Configs	:x: ABANDONED
55	Improve Hive/Meta sync class design and hierarchies	:white_check_mark: COMPLETED
56	Early Conflict Detection For Multi-Writer	:white_check_mark: COMPLETED
57	DeltaStreamer Protobuf Support	:white_check_mark: COMPLETED
58	Integrate column stats index with all query engines	:white_check_mark: COMPLETED
59	Multiple event_time Fields Latest Verification in a Single Table	:eyes: UNDER REVIEW
60	Federated Storage Layer	:eyes: UNDER REVIEW
61	Snapshot view management	:eyes: UNDER REVIEW
62	Diagnostic Reporter	:eyes: UNDER REVIEW
63	Expression Indexes	:arrows_counterclockwise: ONGOING
64	New Hudi Table Spec API for Query Integrations	:eyes: UNDER REVIEW
65	Partition TTL Management	:white_check_mark: COMPLETED
66	Non Blocking Concurrency Control	:white_check_mark: COMPLETED
67	Hudi Bundle Standards	:white_check_mark: COMPLETED
68	A More Effective HoodieMergeHandler for COW Table with Parquet	:x: ABANDONED
69	Hudi 1.x	:white_check_mark: COMPLETED
70	Hudi Reverse Streamer	:eyes: UNDER REVIEW
71	Enhance OCC conflict detection	:eyes: UNDER REVIEW
72	Redesign Hudi-Spark Integration	:arrows_counterclockwise: ONGOING
73	Multi-Table Transactions	:eyes: UNDER REVIEW
74	HoodieStorage: Hudi Storage Abstraction and APIs	:arrows_counterclockwise: ONGOING
75	Hudi-Native HFile Reader and Writer	:white_check_mark: COMPLETED
76	Auto Record key generation	:white_check_mark: COMPLETED
77	Secondary Index	:white_check_mark: COMPLETED
78	1.0 Migration	:hammer_and_wrench: IN PROGRESS
79	Robust handling of spark task retries and failures	:x: ABANDONED
80	Column Groups	:hammer_and_wrench: IN PROGRESS
81	Introduce Primary Key Sorted Table	:eyes: UNDER REVIEW
82	Concurrent schema evolution detection	:white_check_mark: COMPLETED
83	Incremental Table Service	:white_check_mark: COMPLETED
84	Optimized SerDe of DataStream in Flink operators	:white_check_mark: COMPLETED
85	Hudi Issue and Sprint Management in Jira	:white_check_mark: COMPLETED
86	DataFrame Implementation of HUDI write path	:eyes: UNDER REVIEW
87	Avro elimination for Flink writer	:hammer_and_wrench: IN PROGRESS
88	New Schema/DataType/Expression Abstractions	:eyes: UNDER REVIEW
89	Dynamic Partition Level Bucket Index	:eyes: UNDER REVIEW
90	Add support for cancellable clustering table service plans	:eyes: UNDER REVIEW
91	Storage-based lock provider using conditional writes	:hammer_and_wrench: IN PROGRESS
92	Support Bitmap Index	:hammer_and_wrench: IN PROGRESS
93	Pluggable Table Formats in Hudi	:hammer_and_wrench: IN PROGRESS
94	Hudi Timeline User Interface (UI)	:eyes: UNDER REVIEW
95	Hudi Flink Source Based on FLIP-27	:eyes: UNDER REVIEW
96	Introduce Unified Bucket Index	:eyes: UNDER REVIEW
97	Deprecate Hudi Payload Class Usage	:eyes: UNDER REVIEW
98	Spark Datasource V2 Read	:eyes: UNDER REVIEW
99	Hudi Type System Redesign	:eyes: UNDER REVIEW
100	Unstructured Data Storage in Hudi	:eyes: UNDER REVIEW
101	Updates to the HoodieRecordMerger API	:hammer_and_wrench: IN PROGRESS
102	RLI support for Flink streaming	:eyes: UNDER REVIEW
103	Hudi LSM tree layout	:eyes: UNDER REVIEW