"Apache Hadoop" Changelog

Release 2.10.2 - 2022-05-31

IMPORTANT ISSUES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-17338	Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc	Major	fs/s3	Yongjun Zhang	Yongjun Zhang

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-12077	Provide a multi-URI replication Inode for ViewFs	Major	fs	Gera Shegalov	Gera Shegalov
HADOOP-13055	Implement linkMergeSlash and linkFallback for ViewFileSystem	Major	fs, viewfs	Zhe Zhang	Manoj Govindassamy

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-13722	Code cleanup -- ViewFileSystem and InodeTree	Minor	viewfs	Manoj Govindassamy	Manoj Govindassamy
YARN-1151	Ability to configure auxiliary services from HDFS-based JAR files	Major	nodemanager	john lilley	Xuan Gong
HADOOP-15584	move httpcomponents version in pom.xml	Minor	build	Brandon Scheller	Brandon Scheller
HADOOP-16208	Do Not Log InterruptedException in Client	Minor	common	David Mollitor	David Mollitor
HADOOP-16052	Remove Subversion and Forrest from Dockerfile	Minor	build	Akira Ajisaka	Xieming Li
YARN-10036	Install yarnpkg and upgrade nodejs in Dockerfile	Major	buid, yarn-ui-v2	Akira Ajisaka	Akira Ajisaka
HADOOP-16811	Use JUnit TemporaryFolder Rule in TestFileUtils	Minor	common, test	David Mollitor	David Mollitor
HADOOP-16054	Update Dockerfile to use Bionic	Major	build, test	Akira Ajisaka	Akira Ajisaka
YARN-10451	RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.	Major	.	Eric Payne	Eric Payne
YARN-9667	Container-executor.c duplicates messages to stdout	Major	nodemanager, yarn	Adam Antal	Peter Bacsko
MAPREDUCE-7301	Expose Mini MR Cluster attribute for testing	Minor	test	Swaroopa Kadam	Swaroopa Kadam
HDFS-15567	[SBN Read] HDFS should expose msync() API to allow downstream applications call it explicitly.	Major	ha, hdfs-client	Konstantin Shvachko	Konstantin Shvachko
YARN-10450	Add cpu and memory utilization per node and cluster-wide metrics	Minor	yarn	Jim Brennan	Jim Brennan
HDFS-15652	Make block size from NNThroughputBenchmark configurable	Minor	benchmarks	Hui Fei	Hui Fei
HDFS-15665	Balancer logging improvement	Major	balancer & mover	Konstantin Shvachko	Konstantin Shvachko
HADOOP-17342	Creating a token identifier should not do kerberos name resolution	Major	common	Jim Brennan	Jim Brennan
YARN-10479	RMProxy should retry on SocketTimeout Exceptions	Major	yarn	Jim Brennan	Jim Brennan
HDFS-15623	Respect configured values of rpc.engine	Major	hdfs	Hector Sandoval Chaverri	Hector Sandoval Chaverri
HDFS-15717	Improve fsck logging	Major	logging, namenode	Ahmed Hussein	Ahmed Hussein
HDFS-15751	Add documentation for msync() API to filesystem.md	Major	documentation	Konstantin Shvachko	Konstantin Shvachko
YARN-10562	Follow up changes for YARN-9833	Major	yarn	Jim Brennan	Jim Brennan
HADOOP-17478	Improve the description of hadoop.http.authentication.signature.secret.file	Minor	documentation	Akira Ajisaka	Akira Ajisaka
HADOOP-17501	Fix logging typo in ShutdownHookManager	Major	common	Konstantin Shvachko	Fengnan Li
HADOOP-17354	Move Jenkinsfile outside of the root directory	Major	build	Akira Ajisaka	Akira Ajisaka
MAPREDUCE-7319	Log list of mappers at trace level in ShuffleHandler audit log	Minor	yarn	Jim Brennan	Jim Brennan
YARN-10626	Log resource allocation in NM log at container start time	Major	.	Eric Badger	Eric Badger
YARN-10613	Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF	Minor	capacity scheduler, scheduler preemption	Eric Payne	Eric Payne
MAPREDUCE-7324	ClientHSSecurityInfo class is in wrong META-INF file	Major	.	Eric Badger	Eric Badger
HADOOP-17546	Update Description of hadoop-http-auth-signature-secret in HttpAuthentication.md	Minor	.	Ravuri Sushma sree	Ravuri Sushma sree
HADOOP-17570	Apply YETUS-1102 to re-enable GitHub comments	Major	build	Akira Ajisaka	Akira Ajisaka
HADOOP-16870	Use spotbugs-maven-plugin instead of findbugs-maven-plugin	Major	build	Akira Ajisaka	Akira Ajisaka
HDFS-15931	Fix non-static inner classes for better memory management	Major	.	Viraj Jasani	Viraj Jasani
HADOOP-17680	Allow ProtobufRpcEngine to be extensible	Major	common	Hector Sandoval Chaverri	Hector Sandoval Chaverri
HADOOP-17756	Increase precommit job timeout from 20 hours to 24 hours.	Major	build	Takanobu Asanuma	Takanobu Asanuma
HDFS-15150	Introduce read write lock to Datanode	Major	datanode	Stephen O'Donnell	Stephen O'Donnell
YARN-10834	Intra-queue preemption: apps that don't use defined custom resource won't be preempted.	Major	.	Eric Payne	Eric Payne
HADOOP-17775	Remove JavaScript package from Docker environment	Major	build	Masatake Iwasaki	Masatake Iwasaki
HADOOP-12665	Document hadoop.security.token.service.use_ip	Major	documentation	Arpit Agarwal	Akira Ajisaka
YARN-10456	RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry	Major	resourcemanager	Eric Payne	Eric Payne
YARN-10860	Make max container per heartbeat configs refreshable	Major	.	Eric Badger	Eric Badger
HADOOP-17813	Checkstyle - Allow line length: 100	Major	.	Akira Ajisaka	Viraj Jasani
HADOOP-17819	Add extensions to ProtobufRpcEngine RequestHeaderProto	Major	common	Hector Sandoval Chaverri	Hector Sandoval Chaverri
HADOOP-17897	Allow nested blocks in switch case in checkstyle settings	Minor	build	Masatake Iwasaki	Masatake Iwasaki
HADOOP-17857	Check real user ACLs in addition to proxied user ACLs	Major	.	Eric Payne	Eric Payne
HADOOP-17926	Maven-eclipse-plugin is no longer needed since Eclipse can import Maven projects by itself.	Minor	documentation	Rintaro Ikeda	Rintaro Ikeda
YARN-10935	AM Total Queue Limit goes below per-user AM Limit if parent is full.	Major	capacity scheduler, capacityscheduler	Eric Payne	Eric Payne
HDFS-16257	[HDFS] [RBF] Guava cache performance issue in Router MountTableResolver	Major	.	Janus Chow	Janus Chow
YARN-1115	Provide optional means for a scheduler to check real user ACLs	Major	capacity scheduler, scheduler	Eric Payne
HDFS-16294	Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED	Major	datanode	JiangHua Zhu	JiangHua Zhu
HDFS-16301	Improve BenchmarkThroughput#SIZE naming standardization	Minor	benchmarks, test	JiangHua Zhu	JiangHua Zhu
HADOOP-18035	Skip unit test failures to run all the unit tests	Major	build	Akira Ajisaka	Akira Ajisaka
HADOOP-18040	Use maven.test.failure.ignore instead of ignoreTestFailure	Major	build	Akira Ajisaka	Akira Ajisaka
YARN-8234	Improve RM system metrics publisher's performance by pushing events to timeline server in batch	Critical	resourcemanager, timelineserver	Hu Ziqian	Ashutosh Gupta
HADOOP-18093	Better exception handling for testFileStatusOnMountLink() in ViewFsBaseTest.java	Trivial	.	Xing Lin	Xing Lin
HADOOP-18099	Upgrade bundled Tomcat to 8.5.75	Major	httpfs, kms	Akira Ajisaka	Ashutosh Gupta
HADOOP-18110	ViewFileSystem: Add Support for Localized Trash Root	Major	common	Xing Lin	Xing Lin
HADOOP-18144	getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path	Major	common	Xing Lin	Xing Lin
HADOOP-18136	Verify FileUtils.unTar() handling of missing .tar files	Minor	test, util	Steve Loughran	Steve Loughran
HDFS-16529	Remove unnecessary setObserverRead in TestConsistentReadsObserver	Trivial	test	wangzhaohui	wangzhaohui
HADOOP-18155	Refactor tests in TestFileUtil	Trivial	common	Gautham Banasandra	Gautham Banasandra
HADOOP-18088	Replace log4j 1.x with reload4j	Major	.	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-11125	Backport YARN-6483 to branch-2.10	Major	resourcemanager	Ashutosh Gupta	Ashutosh Gupta
HADOOP-18172	Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package	Minor	.	Xing Lin	Xing Lin

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-10650	DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission	Minor	.	John Zhuge	John Zhuge
HADOOP-13965	Groups should be consistent in using default group mapping class	Minor	security	Yiqun Lin	Yiqun Lin
YARN-6977	Node information is not provided for non am containers in RM logs	Major	capacity scheduler	Sumana Sathish	Suma Shivaprasad
HADOOP-15261	Upgrade commons-io from 2.4 to 2.5	Major	minikdc	PandaMonkey	PandaMonkey
HADOOP-15331	Fix a race condition causing parsing error of java.io.BufferedInputStream in class org.apache.hadoop.conf.Configuration	Major	common	Miklos Szegedi	Miklos Szegedi
YARN-8222	Fix potential NPE when gets RMApp from RM context	Critical	.	Tao Yang	Tao Yang
HDFS-13174	hdfs mover -p /path times out after 20 min	Major	balancer & mover	István Fajth	István Fajth
HDFS-13723	Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh	Major	security, test	Siyao Meng	Siyao Meng
YARN-7266	Timeline Server event handler threads locked	Major	ATSv2, timelineserver	Venkata Puneet Ravuri	Prabhu Joseph
HDFS-13677	Dynamic refresh Disk configuration results in overwriting VolumeMap	Blocker	.	ZanderXu	ZanderXu
HADOOP-16334	Fix yetus-wrapper not working when HADOOP_YETUS_VERSION >= 0.9.0	Major	yetus	Wanqiang Ji	Wanqiang Ji
YARN-9594	Fix missing break statement in ContainerScheduler#handle	Major	.	lujie	lujie
YARN-9744	RollingLevelDBTimelineStore.getEntityByTime fails with NPE	Major	timelineserver	Prabhu Joseph	Prabhu Joseph
YARN-9785	Fix DominantResourceCalculator when one resource is zero	Blocker	.	Bilwa S T	Bilwa S T
YARN-9833	Race condition when DirectoryCollection.checkDirs() runs during container launch	Major	.	Peter Bacsko	Peter Bacsko
HDFS-14216	NullPointerException happens in NamenodeWebHdfs	Critical	.	lujie	lujie
YARN-9984	FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node	Major	fairscheduler	Wilfred Spiegelenburg	Wilfred Spiegelenburg
HADOOP-16841	The description of hadoop.http.authentication.signature.secret.file contains outdated information	Minor	documentation	Akira Ajisaka	Xieming Li
HADOOP-16768	SnappyCompressor test cases wrongly assume that the compressed data is always smaller than the input data	Major	io, test	zhao bo	Akira Ajisaka
HADOOP-17068	client fails forever when namenode ipaddr changed	Major	hdfs-client	Sean Chow	Sean Chow
HADOOP-17116	Skip Retry INFO logging on first failover from a proxy	Major	ha	Hanisha Koneru	Hanisha Koneru
MAPREDUCE-7294	Only application master should upload resource to Yarn Shared Cache	Major	mrv2	zhenzhao wang	zhenzhao wang
YARN-10438	Handle null containerId in ClientRMService#getContainerReport()	Major	resourcemanager	Raghvendra Singh	Shubham Gupta
MAPREDUCE-7289	Fix wrong comment in LongLong.java	Trivial	documentation, examples	Akira Ajisaka	Wanqiang Ji
YARN-10393	MR job live lock caused by completed state container leak in heartbeat between node manager and RM	Major	nodemanager, yarn	zhenzhao wang	Jim Brennan
YARN-10455	TestNMProxy.testNMProxyRPCRetry is not consistent	Major	.	Ahmed Hussein	Ahmed Hussein
HADOOP-17223	update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13	Blocker	.	Pranav Bheda	Pranav Bheda
HADOOP-17309	Javadoc warnings and errors are ignored in the precommit jobs	Major	build, documentation	Akira Ajisaka	Akira Ajisaka
MAPREDUCE-7302	Upgrading to JUnit 4.13 causes testcase TestFetcher.testCorruptedIFile() to fail	Major	test	Peter Bacsko	Peter Bacsko
HDFS-15644	Failed volumes can cause DNs to stop block reporting	Major	block placement, datanode	Ahmed Hussein	Ahmed Hussein
YARN-10467	ContainerIdPBImpl objects can be leaked in RMNodeImpl.completedContainers	Major	resourcemanager	Haibo Chen	Haibo Chen
HADOOP-17340	TestLdapGroupsMapping failing -string mismatch in exception validation	Major	test	Steve Loughran	Steve Loughran
HADOOP-17352	Update PATCH_NAMING_RULE in the personality file	Minor	build	Akira Ajisaka	Akira Ajisaka
HADOOP-17358	Improve excessive reloading of Configurations	Major	conf	Ahmed Hussein	Ahmed Hussein
YARN-8558	NM recovery level db not cleaned up properly on container finish	Critical	.	Bibin Chundatt	Bibin Chundatt
YARN-10498	Fix Yarn CapacityScheduler Markdown document	Trivial	documentation	zhaoshengjie	zhaoshengjie
HDFS-15660	StorageTypeProto is not compatiable between 3.x and 2.6	Major	.	Ryan Wu	Ryan Wu
HDFS-15725	Lease Recovery never completes for a committed block which the DNs never finalize	Major	namenode	Stephen O'Donnell	Stephen O'Donnell
HADOOP-17438	Increase docker memory limit in Jenkins	Major	build, scripts, test, yetus	Ahmed Hussein	Ahmed Hussein
HADOOP-16947	Stale record should be remove when MutableRollingAverages generating aggregate data.	Major	.	Haibin Huang	Haibin Huang
HDFS-15632	AbstractContractDeleteTest should set recursive parameter to true for recursive test cases.	Major	.	Konstantin Shvachko	Anton Kutuzov
HDFS-10498	Intermittent test failure org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength.testSnapshotfileLength	Major	hdfs, snapshots	Hanisha Koneru	Jim Brennan
HADOOP-17495	Backport HADOOP-16947 "Stale record should be remove when MutableRollingAverages generating aggregate data." to branch 2.10	Major	.	Felix N	Felix N
HDFS-15801	Backport HDFS-14582 to branch-2.10 (Failed to start DN with ArithmeticException when NULL checksum used)	Major	.	Janus Chow	Janus Chow
YARN-10428	Zombie applications in the YARN queue using FAIR + sizebasedweight	Critical	capacityscheduler	Guang Yang	Andras Gyori
HDFS-15792	ClasscastException while loading FSImage	Major	nn	Renukaprasad C	Renukaprasad C
HADOOP-17516	Upgrade ant to 1.10.9	Major	.	Akira Ajisaka	Akira Ajisaka
YARN-10500	TestDelegationTokenRenewer fails intermittently	Major	test	Akira Ajisaka	Masatake Iwasaki
MAPREDUCE-7323	Remove job_history_summary.py	Major	.	Akira Ajisaka	Akira Ajisaka
HADOOP-17510	Hadoop prints sensitive Cookie information.	Major	.	Renukaprasad C	Renukaprasad C
HDFS-15422	Reported IBR is partially replaced with stored info when queuing.	Critical	namenode	Kihwal Lee	Stephen O'Donnell
YARN-10651	CapacityScheduler crashed with NPE in AbstractYarnScheduler.updateNodeResource()	Major	.	Haibo Chen	Haibo Chen
MAPREDUCE-7320	ClusterMapReduceTestCase does not clean directories	Major	.	Ahmed Hussein	Ahmed Hussein
HDFS-15849	ExpiredHeartbeats metric should be of Type.COUNTER	Major	metrics	Konstantin Shvachko	Qi Zhu
HADOOP-17557	skip-dir option is not processed by Yetus	Major	build, precommit, yetus	Ahmed Hussein	Ahmed Hussein
HADOOP-17572	[branch-2.10] Docker image build fails due to the removal of openjdk-7-jdk package	Blocker	build	Akira Ajisaka	Akira Ajisaka
HADOOP-17582	Replace GitHub App Token with GitHub OAuth token	Major	build	Akira Ajisaka	Akira Ajisaka
HADOOP-17586	Upgrade org.codehaus.woodstox:stax2-api to 4.2.1	Major	.	Ayush Saxena	Ayush Saxena
YARN-10588	Percentage of queue and cluster is zero in WebUI	Major	.	Bilwa S T	Bilwa S T
MAPREDUCE-7322	revisiting TestMRIntermediateDataEncryption	Major	job submission, security, test	Ahmed Hussein	Ahmed Hussein
HADOOP-17592	Fix the wrong CIDR range example in Proxy User documentation	Minor	documentation	Kwangsun Noh	Kwangsun Noh
MAPREDUCE-7325	Intermediate data encryption is broken in LocalJobRunner	Major	job submission, security	Ahmed Hussein	Ahmed Hussein
YARN-10697	Resources are displayed in bytes in UI for schedulers other than capacity	Major	.	Bilwa S T	Bilwa S T
HADOOP-17602	Upgrade JUnit to 4.13.1	Major	build, security, test	Ahmed Hussein	Ahmed Hussein
MAPREDUCE-7332	Fix SpillCallBackPathsFinder to use JDK7 on branch-2.10	Minor	job submission, security	Ahmed Hussein	Ahmed Hussein
YARN-10501	Can't remove all node labels after add node label without nodemanager port	Critical	yarn	caozhiqiang	caozhiqiang
YARN-10716	Fix typo in ContainerRuntime	Trivial	documentation	Wanqiang Ji	xishuhai
HADOOP-17603	Upgrade tomcat-embed-core to 7.0.108	Major	build, security	Ahmed Hussein	Ahmed Hussein
HADOOP-17601	Upgrade Jackson databind in branch-2.10 to 2.9.10.7	Major	.	Ahmed Hussein	Ahmed Hussein
YARN-10733	TimelineService Hbase tests are failing with timeout error on branch-2.10	Major	test, timelineserver, yarn	Ahmed Hussein	Ahmed Hussein
HDFS-15963	Unreleased volume references cause an infinite loop	Critical	datanode	Shuyan Zhang	Shuyan Zhang
YARN-10460	Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail	Major	nodemanager, test	Peter Bacsko	Peter Bacsko
YARN-10749	Can't remove all node labels after add node label without nodemanager port, broken by YARN-10647	Major	.	D M Murali Krishna Reddy	D M Murali Krishna Reddy
YARN-10555	Missing access check before getAppAttempts	Critical	webapp	lujie	lujie
HADOOP-17718	Explicitly set locale in the Dockerfile	Blocker	build	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-10770	container-executor permission is wrong in SecureContainer.md	Major	documentation	Akira Ajisaka	Siddharth Ahuja
HDFS-15915	Race condition with async edits logging due to updating txId outside of the namesystem log	Major	hdfs, namenode	Konstantin Shvachko	Konstantin Shvachko
HDFS-16040	RpcQueueTime metric counts requeued calls as unique events.	Major	hdfs	Simbarashe Dzinamarira	Simbarashe Dzinamarira
HDFS-16068	WebHdfsFileSystem has a possible connection leak in connection with HttpFS	Major	.	Takanobu Asanuma	Takanobu Asanuma
HDFS-15618	Improve datanode shutdown latency	Major	datanode	Ahmed Hussein	Ahmed Hussein
HADOOP-17769	Upgrade JUnit to 4.13.2	Major	.	Ahmed Hussein	Ahmed Hussein
YARN-10824	Title not set for JHS and NM webpages	Major	.	Rajshree Mishra	Bilwa S T
MAPREDUCE-7353	Mapreduce job fails when NM is stopped	Major	.	Bilwa S T	Bilwa S T
HADOOP-17793	Better token validation	Major	.	Artem Smotrakov	Artem Smotrakov
HDFS-16042	DatanodeAdminMonitor scan should be delay based	Major	datanode	Ahmed Hussein	Ahmed Hussein
HADOOP-17028	ViewFS should initialize target filesystems lazily	Major	client-mounts, fs, viewfs	Uma Maheswara Rao G	Abhishek Das
HADOOP-17370	Upgrade commons-compress to 1.21	Major	common	Dongjoon Hyun	Akira Ajisaka
HADOOP-17886	Upgrade ant to 1.10.11	Major	.	Ahmed Hussein	Ahmed Hussein
HADOOP-17885	Upgrade JSON smart to 1.3.3 on branch-2.10	Major	.	Ahmed Hussein	Ahmed Hussein
HDFS-16207	Remove NN logs stack trace for non-existent xattr query	Major	namenode	Ahmed Hussein	Ahmed Hussein
HDFS-16198	Short circuit read leaks Slot objects when InvalidToken exception is thrown	Major	.	Eungsop Yoo	Eungsop Yoo
HDFS-16233	Do not use exception handler to implement copy-on-write for EnumCounters	Major	namenode	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-16181	[SBN Read] Fix metric of RpcRequestCacheMissAmount can't display when tailEditLog form JN	Critical	.	wangzhaohui	wangzhaohui
YARN-8127	Resource leak when async scheduling is enabled	Critical	.	Weiwei Yang	Tao Yang
HADOOP-17964	Increase Java heap size for running Maven in Dockerfile of branch-2.10	Major	build	Masatake Iwasaki	Masatake Iwasaki
HADOOP-16532	Fix TestViewFsTrash to use the correct homeDir.	Minor	test, viewfs	Steve Loughran	Xing Lin
HADOOP-17965	Fix documentation build failure using JDK 7 on branch-2.10	Major	build	Masatake Iwasaki	Masatake Iwasaki
HDFS-7612	TestOfflineEditsViewer.testStored() uses incorrect default value for cacheDir	Major	test	Konstantin Shvachko	Michael Kuchenbecker
HADOOP-17978	Exclude ASF license check for pkg-resolver JSON	Major	build	Gautham Banasandra	Gautham Banasandra
HADOOP-17880	Build Hadoop on Centos 7	Major	build	baizhendong
HADOOP-17988	Disable JIRA plugin for YETUS on Hadoop	Critical	build	Gautham Banasandra	Gautham Banasandra
HDFS-16311	Metric metadataOperationRate calculation error in DataNodeVolumeMetrics	Major	.	Tao Li	Tao Li
HADOOP-17999	No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem	Major	.	Abhishek Das	Abhishek Das
YARN-9063	ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing	Major	timelineserver, timelineservice	Tarun Parimi	Ashutosh Gupta
HADOOP-18049	Pin python lazy-object-proxy to 1.6.0 in Docker file as newer versions are incompatible with python2.7	Major	build	Dhananjay Badaya	Dhananjay Badaya
HADOOP-13500	Synchronizing iteration of Configuration properties object	Major	conf	Jason Darrell Lowe	Dhananjay Badaya
YARN-10178	Global Scheduler async thread crash caused by 'Comparison method violates its general contract	Major	capacity scheduler	tuyu	Andras Gyori
HDFS-16410	Insecure Xml parsing in OfflineEditsXmlLoader	Minor	.	Ashutosh Gupta	Ashutosh Gupta
HADOOP-18158	Fix failure of create-release script due to releasedocmaker changes in branch-2.10	Major	build	Masatake Iwasaki	Masatake Iwasaki
HADOOP-18129	Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem	Major	.	Abhishek Das	Abhishek Das
HDFS-16517	In 2.10 the distance metric is wrong for non-DN machines	Major	.	Owen O'Malley	Owen O'Malley
HDFS-16518	KeyProviderCache close cached KeyProvider with Hadoop ShutdownHookManager	Major	hdfs	Lei Yang	Lei Yang
HADOOP-18169	getDelegationTokens in ViewFs should also fetch the token from the fallback FS	Major	.	Xing Lin	Xing Lin
YARN-10720	YARN WebAppProxyServlet should support connection timeout to prevent proxy server from hanging	Critical	.	Qi Zhu	Qi Zhu
HDFS-11041	Unable to unregister FsDatasetState MBean if DataNode is shutdown twice	Trivial	datanode	Wei-Chiu Chuang	Wei-Chiu Chuang
MAPREDUCE-7246	In MapredAppMasterRest#Mapreduce_Application_Master_Info_API, the datatype of appId should be "string".	Major	documentation	jenny	Ashutosh Gupta
YARN-11126	ZKConfigurationStore Java deserialisation vulnerability	Major	yarn	Tamas Domok	Tamas Domok
YARN-11162	Set the zk acl for nodes created by ZKConfigurationStore.	Major	resourcemanager	Owen O'Malley	Owen O'Malley

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-7011	TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec	Trivial	.	Christopher Douglas	Christopher Douglas

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-15133	[JDK9] Ignore com.sun.javadoc.* and com.sun.tools.* in animal-sniffer-maven-plugin to compile with Java 9	Major	.	Akira Ajisaka	Akira Ajisaka
HADOOP-15293	TestLogLevel fails on Java 9	Major	test	Akira Ajisaka	Takanobu Asanuma
HADOOP-15513	Add additional test cases to cover some corner cases for FileUtil#symlink	Major	.	Giovanni Matteo Fumarola	Giovanni Matteo Fumarola
HADOOP-15783	[JDK10] TestSFTPFileSystem.testGetModifyTime fails	Major	.	Akira Ajisaka	Akira Ajisaka
HADOOP-16764	Rewrite Python example codes using Python3	Minor	documentation	Kengo Seki	Kengo Seki
HADOOP-16767	S3AInputStream reopening does not handle non IO exceptions properly	Major	.	Sergei Poganshev	Sergei Poganshev
HADOOP-17336	Backport HADOOP-16005-"NativeAzureFileSystem does not support setXAttr" and HADOOP-16785. "Improve wasb and abfs resilience on double close() calls. followup to abfs close() fix." to branch-2.10	Major	fs/azure	Sally Zuo	Sally Zuo
HDFS-15716	TestUpgradeDomainBlockPlacementPolicy flaky	Major	namenode, test	Ahmed Hussein	Ahmed Hussein
HADOOP-16748	Migrate to Python 3 and upgrade Yetus to 0.13.0	Major	.	Akira Ajisaka	Akira Ajisaka
HDFS-13975	TestBalancer#testMaxIterationTime fails sporadically	Major	.	Jason Darrell Lowe	Toshihiko Uchida
HDFS-16072	TestBlockRecovery fails consistently on Branch-2.10	Major	datanode, test	Ahmed Hussein	Ahmed Hussein
HDFS-15659	Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster	Major	test	Akira Ajisaka	Ahmed Hussein
HADOOP-17952	Replace Guava VisibleForTesting by Hadoop's own annotation in hadoop-common-project modules	Major	.	Viraj Jasani	Viraj Jasani
YARN-8546	Resource leak caused by a reserved container being released more than once under async scheduling	Major	capacity scheduler	Weiwei Yang	Tao Yang
HDFS-13248	RBF: Namenode need to choose block location for the client	Major	.	Wu Weiwei	Owen O'Malley

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-15808	Add metrics for FSNamesystem read/write lock hold long time	Major	hdfs	Tao Li	Tao Li
HDFS-16298	Improve error msg for BlockMissingException	Minor	.	Tao Li	Tao Li
HDFS-16312	Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents	Minor	.	Tao Li	Tao Li
YARN-10540	Node page is broken in YARN UI1 and UI2 including RMWebService api for nodes	Critical	webapp	Sunil G	Jim Brennan
HADOOP-17445	Update the year to 2021	Major	.	Xiaoqiao He	Xiaoqiao He
HADOOP-17571	Upgrade com.fasterxml.woodstox:woodstox-core for security reasons	Major	.	Viraj Jasani	Viraj Jasani
HDFS-15895	DFSAdmin#printOpenFiles has redundant String#format usage	Minor	.	Viraj Jasani	Viraj Jasani
HADOOP-18061	Update the year to 2022	Major	.	Ayush Saxena	Ayush Saxena
HADOOP-18191	Log retry count while handling exceptions in RetryInvocationHandler	Minor	.	Viraj Jasani	Viraj Jasani
HADOOP-18125	Utility to identify git commit / Jira fixVersion discrepancies for RC preparation	Major	.	Viraj Jasani	Viraj Jasani
HDFS-16551	Backport HADOOP-17588 to 3.3 and other active old branches.	Major	.	Renukaprasad C	Renukaprasad C