"Apache Hadoop" Changelog

Release 2.10.1 - 2020-09-14

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor

IMPORTANT ISSUES:

JIRA	Summary	Priority	Component	Reporter	Contributor

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-14597	Native compilation broken with OpenSSL-1.1.0 because EVP_CIPHER_CTX has been made opaque	Major	.	Ravi Prakash	Ravi Prakash
MAPREDUCE-7069	Add ability to specify user environment variables individually	Major	.	Jim Brennan	Jim Brennan
HDFS-13511	Provide specialized exception when block length cannot be obtained	Major	.	Ted Yu	Gabor Bota
HDFS-10659	Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory	Major	ha, journal-node	Amit Anand	star
MAPREDUCE-7208	Tuning TaskRuntimeEstimator	Minor	.	Ahmed Hussein	Ahmed Hussein
HDFS-14979	[Observer Node] Balancer should submit getBlocks to Observer Node when possible	Major	balancer & mover, hdfs	Erik Krogen	Erik Krogen
HDFS-14991	Backport better time precision of configuration#getTimeDuration to branch-2 to support SBN read	Major	hdfs	Chen Liang	Chen Liang
HDFS-14952	Skip safemode if blockTotal is 0 in new NN	Trivial	namenode	Rajesh Balamohan	Xiaoqiao He
YARN-8842	Expose metrics for custom resource types in QueueMetrics	Major	.	Szilard Nemeth	Szilard Nemeth
HADOOP-16735	Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN	Minor	documentation, fs/s3	Mingliang Liu	Mingliang Liu
YARN-10012	Guaranteed and max capacity queue metrics for custom resources	Major	.	Jonathan Hung	Manikandan R
HDFS-15050	Optimize log information when DFSInputStream meet CannotObtainBlockLengthException	Major	dfsclient	Xiaoqiao He	Xiaoqiao He
YARN-10039	Allow disabling app submission from REST endpoints	Major	.	Jonathan Hung	Jonathan Hung
YARN-9894	CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.	Major	capacity scheduler, test	Eric Payne	Eric Payne
YARN-10009	In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined	Critical	capacity scheduler	Eric Payne	Eric Payne
HADOOP-16753	Refactor HAAdmin	Major	ha	Akira Ajisaka	Xieming Li
HDFS-14968	Add ability to know datanode staleness	Minor	datanode, logging, namenode	Ahmed Hussein	Ahmed Hussein
MAPREDUCE-7262	MRApp helpers block for long intervals (500ms)	Minor	mr-am	Ahmed Hussein	Ahmed Hussein
YARN-10084	Allow inheritance of max app lifetime / default app lifetime	Major	capacity scheduler	Eric Payne	Eric Payne
HDFS-15046	Backport HDFS-7060 to branch-2.10	Major	datanode	Wei-Chiu Chuang	Lisheng Sun
HDFS-12491	Support wildcard in CLASSPATH for libhdfs	Major	libhdfs	John Zhuge	Muhammad Samir Khan
YARN-10116	Expose diagnostics in RMAppManager summary	Major	.	Jonathan Hung	Jonathan Hung
HADOOP-16739	Fix native build failure of hadoop-pipes on CentOS 8	Major	tools/pipes	Masatake Iwasaki	Masatake Iwasaki
HDFS-14758	Decrease lease hard limit	Minor	.	Eric Payne	Hemanth Boyina
YARN-9018	Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path	Major	.	Kuhu Shukla	Kuhu Shukla
HADOOP-16882	Update jackson-databind to 2.9.10.2 in branch-3.1, branch-2.10	Blocker	.	Wei-Chiu Chuang	Lisheng Sun
HADOOP-16776	backport HADOOP-16775: distcp copies to s3 are randomly corrupted	Blocker	tools/distcp	Amir Shenavandeh	Amir Shenavandeh
HDFS-15197	[SBN read] Change ObserverRetryOnActiveException log to debug	Minor	hdfs	Chen Liang	Chen Liang
YARN-10200	Add number of containers to RMAppManager summary	Major	.	Jonathan Hung	Jonathan Hung
YARN-8213	Add Capacity Scheduler performance metrics	Critical	capacityscheduler, metrics	Weiwei Yang	Weiwei Yang
HADOOP-16952	Add .diff to gitignore	Minor	.	Ayush Saxena	Ayush Saxena
YARN-10212	Create separate configuration for max global AM attempts	Major	.	Jonathan Hung	Bilwa S T
HDFS-14476	lock too long when fix inconsistent blocks between disk and in-memory	Major	datanode	Sean Chow	Sean Chow
YARN-8680	YARN NM: Implement Iterable Abstraction for LocalResourceTracker state	Critical	yarn	Pradeep Ambati	Pradeep Ambati
YARN-9954	Configurable max application tags and max tag length	Major	.	Jonathan Hung	Bilwa S T
YARN-10260	Allow transitioning queue from DRAINING to RUNNING state	Major	.	Jonathan Hung	Bilwa S T
HDFS-15264	Backport Datanode detection to branch-2.10	Major	.	Lisheng Sun	Lisheng Sun
YARN-6492	Generate queue metrics for each partition	Major	capacity scheduler	Jonathan Hung	Manikandan R
HADOOP-17047	TODO comments exist in trunk while the related issues are already fixed.	Trivial	.	Rungroj Maipradit	Rungroj Maipradit
HADOOP-17090	Increase precommit job timeout from 5 hours to 20 hours	Major	build	Akira Ajisaka	Akira Ajisaka
YARN-10297	TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently	Major	.	Jonathan Hung	Jim Brennan
HADOOP-17127	Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime	Minor	common	Jim Brennan	Jim Brennan
HDFS-15404	ShellCommandFencer should expose info about source	Major	.	Chen Liang	Chen Liang
YARN-10343	Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.	Major	.	Eric Payne	Eric Payne
YARN-1529	Add Localization overhead metrics to NM	Major	nodemanager	Gera Shegalov	Jim Brennan
YARN-10251	Show extended resources on legacy RM UI.	Major	.	Eric Payne	Eric Payne
HADOOP-17159	Make UGI support forceful relogin from keytab ignoring the last login time	Major	security	Sandeep Guggilam	Sandeep Guggilam
HADOOP-17251	Upgrade netty-all to 4.1.50.Final on branch-2.10	Major	.	Masatake Iwasaki	Masatake Iwasaki
HADOOP-17249	Upgrade jackson-databind to 2.9.10.6 on branch-2.10	Major	.	Masatake Iwasaki	Masatake Iwasaki
HADOOP-17253	Upgrade zookeeper to 3.4.14 on branch-2.10	Major	.	Masatake Iwasaki	Masatake Iwasaki
HADOOP-17254	Upgrade hbase to 1.4.13 on branch-2.10	Major	.	Masatake Iwasaki	Masatake Iwasaki
HADOOP-16918	Dependency update for Hadoop 2.10	Major	.	Wei-Chiu Chuang

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-9376	TestSeveralNameNodes fails occasionally	Major	test	Kihwal Lee	Masatake Iwasaki
MAPREDUCE-6881	Fix warnings from Spotbugs in hadoop-mapreduce	Major	.	Weiwei Yang	Weiwei Yang
HADOOP-14354	SysInfoWindows is not thread safe	Major	.	Íñigo Goiri	Íñigo Goiri
HADOOP-14400	Fix warnings from spotbugs in hadoop-tools	Major	tools	Weiwei Yang	Weiwei Yang
YARN-6515	Fix warnings from Spotbugs in hadoop-yarn-server-nodemanager	Major	nodemanager	Naganarasimha G R	Naganarasimha G R
HDFS-11696	Fix warnings from Spotbugs in hadoop-hdfs	Major	.	Yiqun Lin	Yiqun Lin
HADOOP-14910	Upgrade netty-all jar to latest 4.0.x.Final	Critical	.	Vinayakumar B	Vinayakumar B
YARN-7589	TestPBImplRecords fails with NullPointerException	Major	.	Jason Darrell Lowe	Daniel Templeton
YARN-7739	DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation	Blocker	.	Wangda Tan	Wangda Tan
YARN-8011	TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk	Minor	.	Tao Yang	Tao Yang
HADOOP-15062	TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9	Major	.	Miklos Szegedi	Miklos Szegedi
YARN-8004	Add unit tests for inter queue preemption for dominant resource calculator	Critical	yarn	Sumana Sathish	Zian Chen
YARN-8210	AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs	Major	yarn	Suma Shivaprasad	Suma Shivaprasad
YARN-8202	DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation	Blocker	.	Szilard Nemeth	Szilard Nemeth
YARN-8179	Preemption does not happen due to natural_termination_factor when DRF is used	Major	.	kyungwan nam	kyungwan nam
YARN-8369	Javadoc build failed due to "bad use of '>'"	Critical	build, docs	Takanobu Asanuma	Takanobu Asanuma
YARN-8382	cgroup file leak in NM	Major	nodemanager	Hu Ziqian	Hu Ziqian
HDFS-12459	Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API	Major	webhdfs	Weiwei Yang	Weiwei Yang
HDFS-14054	TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky	Major	.	Zsolt Venczel	Zsolt Venczel
YARN-9205	When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)	Critical	.	Zhankun Tang	Zhankun Tang
YARN-4901	QueueMetrics needs to be cleared before MockRM is initialized	Major	scheduler	Daniel Templeton	Peter Bacsko
HDFS-14647	NPE during secure namenode startup	Major	hdfs	Fengnan Li	Fengnan Li
HADOOP-16255	ChecksumFS.Make FileSystem.rename(path, path, options) doesn't rename checksum	Major	fs	Steve Loughran	Jungtaek Lim
HADOOP-16580	Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException	Major	common	Adam Antal	Adam Antal
HADOOP-16662	Remove unnecessary InnerNode check in NetworkTopology#add()	Minor	.	Lisheng Sun	Lisheng Sun
YARN-9915	Fix FindBug issue in QueueMetrics	Minor	.	Prabhu Joseph	Prabhu Joseph
HDFS-12749	DN may not send block report to NN after NN restart	Major	datanode	TanYuxin	Xiaoqiao He
HDFS-13901	INode access time is ignored because of race between open and rename	Major	.	Jinglun	Jinglun
HDFS-14931	hdfs crypto commands limit column width	Major	.	Eric Badger	Eric Badger
YARN-9945	Fix javadoc in FederationProxyProviderUtil in branch-2	Major	.	Jonathan Hung	Jonathan Hung
HDFS-14806	Bootstrap standby may fail if used in-progress tailing	Major	namenode	Chen Liang	Chen Liang
HDFS-14941	Potential editlog race condition can cause corrupted file	Major	namenode	Chen Liang	Chen Liang
HDFS-14958	TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup	Minor	hdfs	Jim Brennan	Jim Brennan
HDFS-14884	Add sanity check that zone key equals feinfo key while setting Xattrs	Major	encryption, hdfs	Mukul Kumar Singh	Mukul Kumar Singh
HADOOP-15097	AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path	Minor	fs, test	zhoutai.zt	Xieming Li
HADOOP-16700	RpcQueueTime may be negative when the response has to be sent later	Minor	.	xuzq	xuzq
YARN-9838	Fix resource inconsistency for queues when moving app with reserved container to another queue	Critical	capacity scheduler	jiulongzhu	jiulongzhu
HDFS-14973	Balancer getBlocks RPC dispersal does not function properly	Major	balancer & mover	Erik Krogen	Erik Krogen
MAPREDUCE-7240	Exception ' Invalid event: TA_TOO_MANY_FETCH_FAILURE at SUCCESS_FINISHING_CONTAINER' cause job error	Critical	.	luhuachao	luhuachao
HDFS-14986	ReplicaCachingGetSpaceUsed throws ConcurrentModificationException	Major	datanode, performance	Ryan Wu	Aiphago
MAPREDUCE-7249	Invalid event TA_TOO_MANY_FETCH_FAILURE at SUCCESS_CONTAINER_CLEANUP causes job failure	Critical	applicationmaster, mrv2	Wilfred Spiegelenburg	Wilfred Spiegelenburg
HDFS-15005	Backport HDFS-12300 to branch-2	Major	hdfs	Chao Sun	Chao Sun
HDFS-15017	Remove redundant import of AtomicBoolean in NameNodeConnector.	Major	balancer & mover, hdfs	Konstantin Shvachko	Chao Sun
HADOOP-16754	Fix docker failed to build yetus/hadoop	Blocker	build	Kevin Su	Kevin Su
HDFS-15032	Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider	Major	balancer & mover	Erik Krogen	Erik Krogen
HDFS-15036	Active NameNode should not silently fail the image transfer	Major	namenode	Konstantin Shvachko	Chen Liang
HDFS-15048	Fix findbug in DirectoryScanner	Major	.	Takanobu Asanuma	Masatake Iwasaki
HDFS-14519	NameQuota is not update after concat operation, so namequota is wrong	Major	.	Ranith Sardar	Ranith Sardar
HDFS-15076	Fix tests that hold FSDirectory lock, without holding FSNamesystem lock.	Major	test	Konstantin Shvachko	Konstantin Shvachko
HDFS-14934	[SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0	Major	.	Takanobu Asanuma	Ayush Saxena
HADOOP-16789	In TestZKFailoverController, restore changes from HADOOP-11149 that were dropped by HDFS-6440	Minor	common	Jim Brennan	Jim Brennan
HDFS-15077	Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout	Minor	test	Masatake Iwasaki	Masatake Iwasaki
YARN-7387	org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently	Major	.	Miklos Szegedi	Jim Brennan
YARN-8672	TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out	Major	nodemanager	Jason Darrell Lowe	Chandni Singh
MAPREDUCE-7252	Handling 0 progress in SimpleExponential task runtime estimator	Minor	.	Ahmed Hussein	Ahmed Hussein
HADOOP-16749	Configuration parsing of CDATA values are blank	Major	conf	Jonathan Turner Eagles	Daryn Sharp
HDFS-15099	[SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException on ObserverNode	Major	namenode	Konstantin Shvachko	Chen Liang
HADOOP-16683	Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException	Major	common	Adam Antal	Adam Antal
HDFS-13339	Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume	Critical	datanode	liaoyuxiangqin	Zsolt Venczel
MAPREDUCE-7256	Fix javadoc error in SimpleExponentialSmoothing	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
MAPREDUCE-7247	Modify HistoryServerRest.html content,change The job attempt id‘s datatype from string to int	Major	documentation	zhaoshengjie	zhaoshengjie
HADOOP-16808	Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin	Minor	build	Akira Ajisaka	Xieming Li
HADOOP-16793	Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()	Minor	.	Lisheng Sun	Lisheng Sun
YARN-9790	Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero	Major	.	kyungwan nam	kyungwan nam
HDFS-13179	TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently	Critical	fs	Gabor Bota	Ahmed Hussein
MAPREDUCE-7259	testSpeculateSuccessfulWithUpdateEvents fails Intermittently	Minor	.	Ahmed Hussein	Ahmed Hussein
HDFS-15146	TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently	Minor	.	Ahmed Hussein	Ahmed Hussein
MAPREDUCE-7079	JobHistory#ServiceStop implementation is incorrect	Major	.	Jason Darrell Lowe	Ahmed Hussein
HDFS-15118	[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.	Major	hdfs-client	Konstantin Shvachko	Chen Liang
HDFS-15148	dfs.namenode.send.qop.enabled should not apply to primary NN port	Major	.	Chen Liang	Chen Liang
YARN-8292	Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative	Critical	yarn	Sumana Sathish	Wangda Tan
HDFS-15115	Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug	Major	.	wangzhixiang	wangzhixiang
HADOOP-16849	start-build-env.sh behaves incorrectly when username is numeric only	Minor	build	Jihyun Cho	Jihyun Cho
HDFS-15161	When evictableMmapped or evictable size is zero, do not throw NoSuchElementException in ShortCircuitCache#close()	Major	.	Lisheng Sun	Lisheng Sun
HDFS-15164	Fix TestDelegationTokensWithHA	Major	.	Ayush Saxena	Ayush Saxena
HADOOP-16868	ipc.Server readAndProcess threw NullPointerException	Major	rpc-server	Tsz-wo Sze	Tsz-wo Sze
HADOOP-16869	Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure	Major	build	Akira Ajisaka	Akira Ajisaka
HDFS-15052	WebHDFS getTrashRoot leads to OOM due to FileSystem object creation	Major	webhdfs	Wei-Chiu Chuang	Masatake Iwasaki
HDFS-15185	StartupProgress reports edits segments until the entire startup completes	Major	namenode	Konstantin Shvachko	Konstantin Shvachko
HDFS-15166	Remove redundant field fStream in ByteStringLog	Major	.	Konstantin Shvachko	Xieming Li
YARN-10140	TestTimelineAuthFilterForV2 fails due to login failures in branch-2.10	Major	timelineservice	Ahmed Hussein	Ahmed Hussein
YARN-10156	Fix typo 'complaint' which means quite different in Federation.md	Minor	documentation, federation	Sungpeo Kook	Sungpeo Kook
HDFS-15147	LazyPersistTestCase wait logic is error-prone	Minor	.	Ahmed Hussein	Ahmed Hussein
HADOOP-16891	Upgrade jackson-databind to 2.9.10.3	Blocker	.	Siyao Meng	Siyao Meng
HDFS-15204	TestRetryCacheWithHA testRemoveCacheDescriptor fails intermittently	Major	hdfs	Ahmed Hussein	Ahmed Hussein
HADOOP-16840	AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket	Major	fs/oss	wujinhu	wujinhu
YARN-9427	TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers fails sporadically	Major	scheduler, test	Prabhu Joseph	Ahmed Hussein
HDFS-11396	TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out	Minor	namenode, test	John Zhuge	Ayush Saxena
HADOOP-16949	pylint fails in the build environment	Critical	build	Akira Ajisaka	Akira Ajisaka
YARN-10227	Pull YARN-8242 back to branch-2.10	Major	yarn	Jim Brennan	Jim Brennan
YARN-2710	RM HA tests failed intermittently on trunk	Major	client	Wangda Tan	Ahmed Hussein
MAPREDUCE-7272	TaskAttemptListenerImpl excessive log messages	Major	.	Ahmed Hussein	Ahmed Hussein
HDFS-15283	Cache pool MAXTTL is not persisted and restored on cluster restart	Major	namenode	Stephen O'Donnell	Stephen O'Donnell
HADOOP-16944	Use Yetus 0.12.0 in GitHub PR	Major	build	Akira Ajisaka	Akira Ajisaka
HDFS-15276	Concat on INodeRefernce fails with illegal state exception	Critical	.	Hemanth Boyina	Hemanth Boyina
HADOOP-16361	TestSecureLogins#testValidKerberosName fails on branch-2	Major	security	Jim Brennan	Jim Brennan
HDFS-15281	ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address	Major	ha, namenode	Dhiraj Hegde	Dhiraj Hegde
HDFS-15297	TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk	Major	datanode, test	Mingliang Liu	Ayush Saxena
YARN-8193	YARN RM hangs abruptly (stops allocating resources) when running successive applications.	Blocker	yarn	Zian Chen	Zian Chen
YARN-10255	fix intermittent failure TestContainerSchedulerQueuing.testContainerUpdateExecTypeGuaranteedToOpportunistic in branch-2.10	Major	.	Ahmed Hussein	Ahmed Hussein
HDFS-15302	Backport HDFS-15286 to branch-2.x	Blocker	.	Akira Ajisaka	Hemanth Boyina
YARN-8959	TestContainerResizing fails randomly	Minor	.	Bibin Chundatt	Ahmed Hussein
HDFS-15323	StandbyNode fails transition to active due to insufficient transaction tailing	Major	namenode, qjm	Konstantin Shvachko	Konstantin Shvachko
HADOOP-15565	ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.	Major	.	Jinglun	Jinglun
YARN-9444	YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource	Minor	api	Gergely Pollak	Gergely Pollak
HDFS-15038	TestFsck testFsckListCorruptSnapshotFiles is failing in trunk	Major	.	Hemanth Boyina	Hemanth Boyina
HADOOP-17045	`Configuration` javadoc describes supporting environment variables, but the feature is not available	Minor	.	Nick Dimiduk	Masatake Iwasaki
HDFS-15293	Relax the condition for accepting a fsimage when receiving a checkpoint	Critical	namenode	Chen Liang	Chen Liang
HADOOP-17052	NetUtils.connect() throws unchecked exception (UnresolvedAddressException) causing clients to abort	Major	net	Dhiraj Hegde	Dhiraj Hegde
HADOOP-17062	Fix shelldocs path in Jenkinsfile	Major	build	Akira Ajisaka	Akira Ajisaka
HDFS-15386	ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories	Major	.	Toshihiro Suzuki	Toshihiro Suzuki
YARN-10300	appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat	Major	.	Eric Badger	Eric Badger
HADOOP-17059	ArrayIndexOfboundsException in ViewFileSystem#listStatus	Major	viewfs	Hemanth Boyina	Hemanth Boyina
YARN-10312	Add support for yarn logs -logFile to retain backward compatibility	Major	client	Jim Brennan	Jim Brennan
HDFS-12453	TestDataNodeHotSwapVolumes fails in trunk Jenkins runs	Critical	test	Arpit Agarwal	Lei (Eddy) Xu
HADOOP-17089	WASB: Update azure-storage-java SDK	Critical	fs/azure	Thomas Marqardt	Thomas Marqardt
HDFS-15421	IBR leak causes standby NN to be stuck in safe mode	Blocker	namenode	Kihwal Lee	Akira Ajisaka
YARN-9903	Support reservations continue looking for Node Labels	Major	.	Tarun Parimi	Jim Brennan
HADOOP-17094	vulnerabilities reported in jackson and jackson-databind in branch-2.10	Major	.	Ahmed Hussein	Ahmed Hussein
HADOOP-17120	Fix failure of docker image creation due to pip2 install error	Major	.	Masatake Iwasaki	Masatake Iwasaki
YARN-10348	Allow RM to always cancel tokens after app completes	Major	yarn	Jim Brennan	Jim Brennan
HDFS-14498	LeaseManager can loop forever on the file for which create has failed	Major	namenode	Sergey Shelukhin	Stephen O'Donnell
YARN-4771	Some containers can be skipped during log aggregation after NM restart	Major	nodemanager	Jason Darrell Lowe	Jim Brennan
HDFS-15313	Ensure inodes in active filesystem are not deleted during snapshot delete	Major	snapshots	Shashikant Banerjee	Shashikant Banerjee
YARN-10363	TestRMAdminCLI.testHelp is failing in branch-2.10	Major	yarn	Jim Brennan	Bilwa S T
HADOOP-17184	Add --mvn-custom-repos parameter to yetus calls	Major	build	Mingliang Liu	Mingliang Liu
HADOOP-17185	Set MAVEN_OPTS in Jenkinsfile	Major	build	Akira Ajisaka	Akira Ajisaka
HDFS-15499	Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion	Major	httpfs	Mingliang Liu	Mingliang Liu
HADOOP-17164	UGI loginUserFromKeytab doesn't set the last login time	Major	security	Sandeep Guggilam	Sandeep Guggilam
YARN-4575	ApplicationResourceUsageReport should return ALL reserved resource	Major	.	Bibin Chundatt	Bibin Chundatt
YARN-7677	Docker image cannot set HADOOP_CONF_DIR	Major	.	Eric Badger	Jim Brennan
YARN-8459	Improve Capacity Scheduler logs to debug invalid states	Major	capacity scheduler	Wangda Tan	Wangda Tan
MAPREDUCE-7286	Fix findbugs warnings in hadoop-mapreduce-project on branch-2.10	Minor	.	Masatake Iwasaki	Masatake Iwasaki
HADOOP-17204	Fix typo in Hadoop KMS document	Trivial	documentation, kms	Akira Ajisaka	Xieming Li
HADOOP-17202	Fix findbugs warnings in hadoop-tools on branch-2.10	Minor	.	Masatake Iwasaki	Masatake Iwasaki
HDFS-15290	NPE in HttpServer during NameNode startup	Major	namenode	Konstantin Shvachko	Simbarashe Dzinamarira
YARN-10358	Fix findbugs warnings in hadoop-yarn-project on branch-2.10	Minor	.	Masatake Iwasaki	Masatake Iwasaki
YARN-10177	Backport YARN-7307 to branch-2.10 Allow client/AM update supported resource types via YARN APIs	Blocker	.	Wei-Chiu Chuang	Wei-Chiu Chuang

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
YARN-9404	TestApplicationLifetimeMonitor#testApplicationLifetimeMonitor fails intermittent	Major	resourcemanager	Prabhu Joseph	Prabhu Joseph
YARN-10072	TestCSAllocateCustomResource failures	Major	yarn	Jim Brennan	Jim Brennan
HDFS-15125	Pull back HDFS-11353, HDFS-13993, HDFS-13945, and HDFS-14324 to branch-2.10	Minor	hdfs	Jim Brennan	Jim Brennan
YARN-10161	TestRouterWebServicesREST is corrupting STDOUT	Minor	yarn	Jim Brennan	Jim Brennan
HADOOP-14206	TestSFTPFileSystem#testFileExists failure: Invalid encoding for signature	Major	fs, test	John Zhuge	Jim Brennan
HADOOP-17205	Move personality file from Yetus to Hadoop repository	Major	test, yetus	Chao Sun	Chao Sun

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-14056	Update maven-javadoc-plugin to 2.10.4	Major	build	Akira Ajisaka	Akira Ajisaka
HADOOP-12940	Fix warnings from Spotbugs in hadoop-common	Major	.	Akira Ajisaka	Akira Ajisaka
YARN-7411	Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee	Major	resourcemanager	Sunil G	Sunil G
YARN-7541	Node updates don't update the maximum cluster capability for resources other than CPU and memory	Critical	resourcemanager	Daniel Templeton	Daniel Templeton
HADOOP-15787	[JDK11] TestIPC.testRTEDuringConnectionSetup fails	Major	.	Akira Ajisaka	Zsolt Venczel
HDFS-13404	RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails	Major	test	Takanobu Asanuma	Takanobu Asanuma
HDFS-14590	[SBN Read] Add the document link to the top page	Major	documentation	Takanobu Asanuma	Takanobu Asanuma
HADOOP-16652	Backport HADOOP-16587 - "Make AAD endpoint configurable on all Auth flows" to branch-2	Minor	fs/azure	Bilahari T H	Bilahari T H
YARN-9773	Add QueueMetrics for Custom Resources	Major	.	Manikandan R	Manikandan R
HADOOP-16598	Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches	Major	common	Duo Zhang	Duo Zhang
HDFS-14792	[SBN read] StanbyNode does not come out of safemode while adding new blocks.	Major	namenode	Konstantin Shvachko
HADOOP-16610	Upgrade to yetus 0.11.1 and use emoji vote on github pre commit	Major	build	Duo Zhang	Duo Zhang
HADOOP-16758	Refine testing.md to tell user better how to use auth-keys.xml	Minor	fs/s3	Mingliang Liu	Mingliang Liu
HADOOP-16609	Add Jenkinsfile for all active branches	Major	build	Duo Zhang	Akira Ajisaka
HADOOP-16734	Backport HADOOP-16455- "ABFS: Implement FileSystem.access() method" to branch-2	Minor	fs/azure	Bilahari T H	Bilahari T H
HADOOP-16778	ABFS: Backport HADOOP-16660 ABFS: Make RetryCount in ExponentialRetryPolicy Configurable to Branch-2	Major	fs/azure	Sneha Vijayarajan	Sneha Vijayarajan
HADOOP-14918	Remove the Local Dynamo DB test option	Major	fs/s3	Steve Loughran	Gabor Bota
HADOOP-16933	Backport HADOOP-16890- "ABFS: Change in expiry calculation for MSI token provider" & HADOOP-16825 "ITestAzureBlobFileSystemCheckAccess failing" to branch-2	Minor	fs/azure	Bilahari T H	Bilahari T H
HDFS-10499	TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently	Major	namenode, test	Hanisha Koneru	Yiqun Lin
HADOOP-17199	Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers	Major	fs/s3	Steve Loughran	Steve Loughran

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-16784	Update the year to 2020	Major	.	Ayush Saxena	Ayush Saxena
HADOOP-16647	Support OpenSSL 1.1.1 LTS	Critical	security	Wei-Chiu Chuang	Rakesh Radhakrishnan