"Apache Hadoop" Changelog

Release 2.9.2 - 2018-11-19

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor

IMPORTANT ISSUES:

JIRA	Summary	Priority	Component	Reporter	Contributor

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-13283	Percentage based Reserved Space Calculation for DataNode	Major	datanode, hdfs	Lukas Majercak	Lukas Majercak

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-14987	Improve KMSClientProvider log around delegation token checking	Major	.	Xiaoyu Yao	Xiaoyu Yao
YARN-7274	Ability to disable elasticity at leaf queue level	Major	capacityscheduler	Scott Brokaw	Zian Chen
HADOOP-15394	Backport PowerShell NodeFencer HADOOP-14309 to branch-2	Minor	.	Íñigo Goiri	Íñigo Goiri
HDFS-13462	Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers	Major	hdfs, journal-node	Lukas Majercak	Lukas Majercak
HADOOP-14841	Kms client should disconnect if unable to get output stream from connection.	Major	kms	Xiao Chen	Rushabh S Shah
HDFS-13272	DataNodeHttpServer to have configurable HttpServer2 threads	Major	datanode	Erik Krogen	Erik Krogen
HADOOP-15441	Log kms url and token service at debug level.	Minor	.	Wei-Chiu Chuang	Gabor Bota
HADOOP-15486	Make NetworkTopology#netLock fair	Major	net	Nanda kumar	Nanda kumar
HADOOP-15449	Increase default timeout of ZK session to avoid frequent NameNode failover	Critical	common	Karthik Palanisamy	Karthik Palanisamy
HDFS-13602	Add checkOperation(WRITE) checks in FSNamesystem	Major	ha, namenode	Erik Krogen	Chao Sun
HDFS-13653	Make dfs.client.failover.random.order a per nameservice configuration	Major	federation	Ekanth Sethuramalingam	Ekanth Sethuramalingam
HDFS-13686	Add overall metrics for FSNamesystemLock	Major	hdfs, namenode	Lukas Majercak	Lukas Majercak
HDFS-13714	Fix TestNameNodePrunesMissingStorages test failures on Windows	Major	hdfs, namenode, test	Lukas Majercak	Lukas Majercak
HDFS-13719	Docs around dfs.image.transfer.timeout are misleading	Major	documentation	Kitti Nanasi	Kitti Nanasi
HDFS-11060	make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable	Minor	hdfs	Lantao Jin	Lantao Jin
HDFS-13813	Exit NameNode if dangling child inode is detected when saving FsImage	Major	hdfs, namenode	Siyao Meng	Siyao Meng
HDFS-13821	RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache	Major	hdfs	Fei Hui	Fei Hui
HADOOP-15689	Add "*.patch" into .gitignore file of branch-2	Major	.	Rui Gao	Rui Gao
HDFS-13854	RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit.	Major	federation, hdfs	yanghuafeng	yanghuafeng
YARN-8051	TestRMEmbeddedElector#testCallbackSynchronization is flakey	Major	test	Robert Kanter	Robert Kanter
HDFS-13857	RBF: Choose to enable the default nameservice to read/write files	Major	federation, hdfs	yanghuafeng	yanghuafeng
HDFS-13812	Fix the inconsistent default refresh interval on Caching documentation	Trivial	documentation	BELUGA BEHR	Hrishikesh Gadre
HDFS-13902	Add JMX, conf and stacks menus to the datanode page	Minor	datanode	fengchuang	fengchuang

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-15121	Encounter NullPointerException when using DecayRpcScheduler	Major	.	Tao Jie	Tao Jie
YARN-7765	[Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM	Blocker	.	Sumana Sathish	Rohith Sharma K S
MAPREDUCE-7027	HadoopArchiveLogs shouldn't delete the original logs if the HAR creation fails	Critical	harchive	Gergely Novák	Gergely Novák
HDFS-10803	TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available	Major	.	Yiqun Lin	Yiqun Lin
YARN-8068	Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+	Blocker	yarn	Sunil Govindan	Sunil Govindan
HADOOP-15317	Improve NetworkTopology chooseRandom's loop	Major	.	Xiao Chen	Xiao Chen
HADOOP-15375	Branch-2 pre-commit failed to build docker image	Major	.	Xiao Chen	Xiao Chen
HADOOP-15357	Configuration.getPropsWithPrefix no longer does variable substitution	Major	.	Jim Brennan	Jim Brennan
HDFS-7101	Potential null dereference in DFSck#doWork()	Minor	.	Ted Yu	skrho
YARN-8120	JVM can crash with SIGSEGV when exiting due to custom leveldb logger	Major	nodemanager, resourcemanager	Jason Lowe	Jason Lowe
YARN-8147	TestClientRMService#testGetApplications sporadically fails	Major	test	Jason Lowe	Jason Lowe
HADOOP-14970	MiniHadoopClusterManager doesn't respect lack of format option	Minor	.	Erik Krogen	Erik Krogen
HDFS-12828	OIV ReverseXML Processor fails with escaped characters	Critical	hdfs	Erik Krogen	Erik Krogen
HADOOP-15180	branch-2 : daemon processes' sysout overwrites 'ulimit -a' in daemon's out file	Minor	scripts	Ranith Sardar	Ranith Sardar
HADOOP-15396	Some java source files are executable	Minor	.	Akira Ajisaka	Shashikant Banerjee
YARN-7786	NullPointerException while launching ApplicationMaster	Major	.	lujie	lujie
HDFS-10183	Prevent race condition during class initialization	Minor	fs	Pavel Avgustinov	Pavel Avgustinov
HDFS-13408	MiniDFSCluster to support being built on randomized base directory	Major	test	Xiao Liang	Xiao Liang
HADOOP-15390	Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens	Critical	.	Xiao Chen	Xiao Chen
HDFS-13336	Test cases of TestWriteToReplica failed in windows	Major	.	Xiao Liang	Xiao Liang
HADOOP-15385	Many tests are failing in hadoop-distcp project in branch-2	Critical	tools/distcp	Rushabh S Shah	Jason Lowe
HDFS-13509	Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows	Major	.	Xiao Liang	Xiao Liang
MAPREDUCE-7073	Optimize TokenCache#obtainTokensForNamenodesInternal	Major	.	Bibin A Chundatt	Bibin A Chundatt
YARN-8232	RMContainer lost queue name when RM HA happens	Major	resourcemanager	Hu Ziqian	Hu Ziqian
HDFS-13537	TestHdfsHelper does not generate jceks path properly for relative path in Windows	Major	.	Xiao Liang	Xiao Liang
HADOOP-15446	WASB: PageBlobInputStream.skip breaks HBASE replication	Major	fs/azure	Thomas Marquardt	Thomas Marquardt
YARN-7003	DRAINING state of queues is not recovered after RM restart	Major	capacityscheduler	Tao Yang	Tao Yang
YARN-8244	TestContainerSchedulerQueuing.testStartMultipleContainers failed	Major	.	Miklos Szegedi	Jim Brennan
HDFS-13581	DN UI logs link is broken when https is enabled	Minor	datanode	Namit Maheshwari	Shashikant Banerjee
HDFS-13586	Fsync fails on directories on Windows	Critical	datanode, hdfs	Lukas Majercak	Lukas Majercak
HDFS-13590	Backport HDFS-12378 to branch-2	Major	datanode, hdfs, test	Lukas Majercak	Lukas Majercak
HADOOP-15450	Avoid fsync storm triggered by DiskChecker and handle disk full situation	Blocker	.	Kihwal Lee	Arpit Agarwal
HDFS-13588	Fix TestFsDatasetImpl test failures on Windows	Major	.	Xiao Liang	Xiao Liang
YARN-8344	Missing nm.stop() in TestNodeManagerResync to fix testKillContainersOnResync	Major	.	Giovanni Matteo Fumarola	Giovanni Matteo Fumarola
YARN-8327	Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows	Major	log-aggregation	Giovanni Matteo Fumarola	Giovanni Matteo Fumarola
YARN-8346	Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full"	Blocker	.	Rohith Sharma K S	Jason Lowe
HDFS-13618	Fix TestDataNodeFaultInjector test failures on Windows	Major	test	Xiao Liang	Xiao Liang
HADOOP-15473	Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997	Critical	kms	Gabor Bota	Gabor Bota
MAPREDUCE-7103	Fix TestHistoryViewerPrinter on windows due to a mismatch line separator	Minor	.	Giovanni Matteo Fumarola	Giovanni Matteo Fumarola
YARN-8359	Exclude containermanager.linux test classes on Windows	Major	.	Giovanni Matteo Fumarola	Jason Lowe
HDFS-13664	Refactor ConfiguredFailoverProxyProvider to make inheritance easier	Minor	hdfs-client	Chao Sun	Chao Sun
HDFS-13667	Typo: Marking all "datandoes" as stale	Trivial	namenode	Wei-Chiu Chuang	Nanda kumar
YARN-8405	RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773	Major	.	Rohith Sharma K S	Íñigo Goiri
MAPREDUCE-7108	TestFileOutputCommitter fails on Windows	Minor	test	Zuoming Zhang	Zuoming Zhang
YARN-8404	Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down	Blocker	.	Rohith Sharma K S	Rohith Sharma K S
HDFS-13675	Speed up TestDFSAdminWithHA	Major	hdfs, namenode	Lukas Majercak	Lukas Majercak
HDFS-13673	TestNameNodeMetrics fails on Windows	Minor	test	Zuoming Zhang	Zuoming Zhang
HDFS-13676	TestEditLogRace fails on Windows	Minor	test	Zuoming Zhang	Zuoming Zhang
HADOOP-15523	Shell command timeout given is in seconds whereas it is taken as millisec while scheduling	Major	.	Bilwa S T	Bilwa S T
YARN-8444	NodeResourceMonitor crashes on bad swapFree value	Major	.	Jim Brennan	Jim Brennan
YARN-8443	Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers	Major	webapp	Tao Yang	Tao Yang
YARN-8457	Compilation is broken with -Pyarn-ui	Major	webapp	Sunil Govindan	Sunil Govindan
YARN-8401	[UI2] new ui is not accessible with out internet connection	Blocker	.	Bibin A Chundatt	Bibin A Chundatt
YARN-8451	Multiple NM heartbeat thread created when a slow NM resync with RM	Major	nodemanager	Botong Huang	Botong Huang
HADOOP-15548	Randomize local dirs	Minor	.	Jim Brennan	Jim Brennan
YARN-8473	Containers being launched as app tears down can leave containers in NEW state	Major	nodemanager	Jason Lowe	Jason Lowe
HDFS-13729	Fix broken links to RBF documentation	Minor	documentation	jwhitter	Gabor Bota
YARN-8518	test-container-executor test_is_empty() is broken	Major	.	Jim Brennan	Jim Brennan
YARN-8515	container-executor can crash with SIGPIPE after nodemanager restart	Major	.	Jim Brennan	Jim Brennan
YARN-8421	when moving app, activeUsers is increased, even though app does not have outstanding request	Major	.	kyungwan nam
HADOOP-15614	TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails	Major	.	Kihwal Lee	Weiwei Yang
YARN-8577	Fix the broken anchor in SLS site-doc	Minor	documentation	Weiwei Yang	Weiwei Yang
YARN-4606	CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps	Critical	capacity scheduler, capacityscheduler	Karam Singh	Manikandan R
HADOOP-15637	LocalFs#listLocatedStatus does not filter out hidden .crc files	Minor	fs	Erik Krogen	Erik Krogen
HADOOP-15644	Hadoop Docker Image Pip Install Fails on branch-2	Critical	build	Haibo Chen	Haibo Chen
YARN-8331	Race condition in NM container launched after done	Major	.	Yang Wang	Pradeep Ambati
HDFS-13758	DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction	Major	namenode	Wei-Chiu Chuang	chencan
YARN-8612	Fix NM Collector Service Port issue in YarnConfiguration	Major	ATSv2	Prabha Manepalli	Prabha Manepalli
HADOOP-15674	Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite	Major	common	Gabor Bota	Szilard Nemeth
YARN-8640	Restore previous state in container-executor after failure	Major	.	Jim Brennan	Jim Brennan
HADOOP-14314	The OpenSolaris taxonomy link is dead in InterfaceClassification.md	Major	documentation	Daniel Templeton	Rui Gao
YARN-8649	NPE in localizer hearbeat processing if a container is killed while localizing	Major	.	lujie	lujie
HADOOP-10219	ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns	Major	ipc	Steve Loughran	Kihwal Lee
MAPREDUCE-7131	Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate	Major	.	Anthony Hsu	Anthony Hsu
HDFS-13836	RBF: Handle mount table znode with null value	Major	federation, hdfs	yanghuafeng	yanghuafeng
YARN-8709	CS preemption monitor always fails since one under-served queue was deleted	Major	capacityscheduler, scheduler preemption	Tao Yang	Tao Yang
HDFS-13051	Fix dead lock during async editlog rolling if edit queue is full	Major	namenode	zhangwei	Daryn Sharp
YARN-8729	Node status updater thread could be lost after it is restarted	Critical	nodemanager	Tao Yang	Tao Yang
HDFS-13914	Fix DN UI logs link broken when https is enabled after HDFS-13902	Minor	datanode	Jianfei Jiang	Jianfei Jiang
MAPREDUCE-7133	History Server task attempts REST API returns invalid data	Major	jobhistoryserver	Oleksandr Shevchenko	Oleksandr Shevchenko
YARN-8720	CapacityScheduler does not enforce max resource allocation check at queue level	Major	capacity scheduler, capacityscheduler, resourcemanager	Tarun Parimi	Tarun Parimi
HDFS-13844	Fix the fmt_bytes function in the dfs-dust.js	Minor	hdfs, ui	yanghuafeng	yanghuafeng
HADOOP-15755	StringUtils#createStartupShutdownMessage throws NPE when args is null	Major	.	Lokesh Jain	Dinesh Chitlangia
MAPREDUCE-3801	org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently	Major	mrv2	Robert Joseph Evans	Jason Lowe
MAPREDUCE-7137	MRAppBenchmark.benchmark1() fails with NullPointerException	Minor	test	Oleksandr Shevchenko	Oleksandr Shevchenko
MAPREDUCE-7138	ThrottledContainerAllocator in MRAppBenchmark should implement RMHeartbeatHandler	Minor	test	Oleksandr Shevchenko	Oleksandr Shevchenko
HDFS-13908	TestDataNodeMultipleRegistrations is flaky	Major	.	Íñigo Goiri	Ayush Saxena
YARN-8804	resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues	Critical	capacityscheduler	Tao Yang	Tao Yang
YARN-8774	Memory leak when CapacityScheduler allocates from reserved container with non-default label	Critical	capacityscheduler	Tao Yang	Tao Yang
HADOOP-15817	Reuse Object Mapper in KMSJSONReader	Major	kms	Jonathan Eagles	Jonathan Eagles
HADOOP-15820	ZStandardDecompressor native code sets an integer field as a long	Blocker	.	Jason Lowe	Jason Lowe
HDFS-13964	RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice	Major	.	Ayush Saxena	Ayush Saxena
HADOOP-15835	Reuse Object Mapper in KMSJSONWriter	Major	.	Jonathan Eagles	Jonathan Eagles
HDFS-13976	Backport HDFS-12813 to branch-2.9	Major	hdfs, hdfs-client	Lukas Majercak	Lukas Majercak
HADOOP-15679	ShutdownHookManager shutdown time needs to be configurable & extended	Major	util	Steve Loughran	Steve Loughran
HDFS-13802	RBF: Remove FSCK from Router Web UI	Major	.	Fei Hui	Fei Hui
HADOOP-15859	ZStandardDecompressor.c mistakes a class for an instance	Blocker	.	Ben Lau	Jason Lowe
HADOOP-15850	CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0	Critical	tools/distcp	Ted Yu	Ted Yu
YARN-7502	Nodemanager restart docs should describe nodemanager supervised property	Major	documentation	Jason Lowe	Suma Shivaprasad
HADOOP-15866	Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility	Blocker	.	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-15822	zstd compressor can fail with a small output buffer	Major	.	Jason Lowe	Jason Lowe
HADOOP-15899	Update AWS Java SDK versions in NOTICE.txt	Major	.	Akira Ajisaka	Akira Ajisaka
HADOOP-15900	Update JSch versions in LICENSE.txt	Major	.	Akira Ajisaka	Akira Ajisaka
YARN-8858	CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.	Major	.	Sumana Sathish	Wangda Tan
YARN-8233	NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null	Critical	capacityscheduler	Tao Yang	Tao Yang
HADOOP-15923	create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent	Blocker	build	Akira Ajisaka	Akira Ajisaka

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-13337	Backport HDFS-4275 to branch-2.9	Minor	.	Íñigo Goiri	Xiao Liang
HDFS-13503	Fix TestFsck test failures on Windows	Major	hdfs	Xiao Liang	Xiao Liang
HDFS-13542	TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13551	TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster	Minor	.	Anbang Hu	Anbang Hu
HDFS-11700	TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13548	TestResolveHdfsSymlink#testFcResolveAfs fails on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13567	TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir	Minor	.	Anbang Hu	Anbang Hu
HDFS-13557	TestDFSAdmin#testListOpenFiles fails on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13550	TestDebugAdmin#testComputeMetaCommand fails on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13559	TestBlockScanner does not close TestContext properly	Minor	.	Anbang Hu	Anbang Hu
HDFS-13570	TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13558	TestDatanodeHttpXFrame does not shut down cluster	Minor	.	Anbang Hu	Anbang Hu
HDFS-13554	TestDatanodeRegistration#testForcedRegistration does not shut down cluster	Minor	.	Anbang Hu	Anbang Hu
HDFS-13556	TestNestedEncryptionZones does not shut down cluster	Minor	.	Anbang Hu	Anbang Hu
HDFS-13560	Insufficient system resources exist to complete the requested service for some tests on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13592	TestNameNodePrunesMissingStorages#testNameNodePrunesUnreportedStorages does not shut down cluster properly	Minor	.	Anbang Hu	Anbang Hu
HDFS-13593	TestBlockReaderLocalLegacy#testBlockReaderLocalLegacyWithAppend fails on Windows	Minor	test	Anbang Hu	Anbang Hu
HDFS-13587	TestQuorumJournalManager fails on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13620	Randomize the test directory path for TestHDFSFileSystemContract	Minor	.	Anbang Hu	Anbang Hu
HDFS-13591	TestDFSShell#testSetrepLow fails on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13632	Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for TestDFSAdminWithHA	Minor	.	Anbang Hu	Anbang Hu
MAPREDUCE-7102	Fix TestJavaSerialization for Windows due a mismatch line separator	Minor	.	Giovanni Matteo Fumarola	Giovanni Matteo Fumarola
HDFS-13652	Randomize baseDir for MiniDFSCluster in TestBlockScanner	Minor	.	Anbang Hu	Anbang Hu
YARN-8370	Some Node Manager tests fail on Windows due to improper path/file separator	Minor	.	Anbang Hu	Anbang Hu
YARN-8422	TestAMSimulator failing with NPE	Minor	.	Giovanni Matteo Fumarola	Giovanni Matteo Fumarola
HADOOP-15532	TestBasicDiskValidator fails with NoSuchFileException	Minor	.	Íñigo Goiri	Giovanni Matteo Fumarola
HDFS-13563	TestDFSAdminWithHA times out on Windows	Minor	.	Anbang Hu	Lukas Majercak
HDFS-13681	Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test failure on Windows	Major	test	Xiao Liang	Xiao Liang

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-13299	RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)	Blocker	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-13353	RBF: TestRouterWebHDFSContractCreate failed	Major	test	Takanobu Asanuma	Takanobu Asanuma
YARN-8110	AMRMProxy recover should catch for all throwable to avoid premature exit	Major	.	Botong Huang	Botong Huang
HDFS-13402	RBF: Fix java doc for StateStoreFileSystemImpl	Minor	hdfs	Yiran Wu	Yiran Wu
HDFS-13410	RBF: Support federation with no subclusters	Minor	.	Íñigo Goiri	Íñigo Goiri
HDFS-13384	RBF: Improve timeout RPC call mechanism	Minor	.	Íñigo Goiri	Íñigo Goiri
HDFS-13045	RBF: Improve error message returned from subcluster	Minor	.	Wei Yan	Íñigo Goiri
HDFS-13428	RBF: Remove LinkedList From StateStoreFileImpl.java	Trivial	federation	BELUGA BEHR	BELUGA BEHR
HDFS-13386	RBF: Wrong date information in list file(-ls) result	Minor	.	Dibyendu Karmakar	Dibyendu Karmakar
YARN-7810	TestDockerContainerRuntime test failures due to UID lookup of a non-existent user	Major	.	Shane Kumpf	Shane Kumpf
HDFS-13435	RBF: Improve the error loggings for printing the stack trace	Major	.	Yiqun Lin	Yiqun Lin
YARN-7189	Container-executor doesn't remove Docker containers that error out early	Major	yarn	Eric Badger	Eric Badger
HDFS-13466	RBF: Add more router-related information to the UI	Minor	.	Wei Yan	Wei Yan
HDFS-13453	RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table	Major	.	Dibyendu Karmakar	Dibyendu Karmakar
HDFS-13478	RBF: Disabled Nameservice store API	Major	.	Íñigo Goiri	Íñigo Goiri
HDFS-13490	RBF: Fix setSafeMode in the Router	Major	.	Íñigo Goiri	Íñigo Goiri
HDFS-13484	RBF: Disable Nameservices from the federation	Major	.	Íñigo Goiri	Íñigo Goiri
HDFS-13326	RBF: Improve the interfaces to modify and view mount tables	Minor	.	Wei Yan	Gang Li
HDFS-13499	RBF: Show disabled name services in the UI	Minor	.	Íñigo Goiri	Íñigo Goiri
HDFS-13508	RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries	Minor	.	Ekanth Sethuramalingam	Ekanth Sethuramalingam
HDFS-13434	RBF: Fix dead links in RBF document	Major	documentation	Akira Ajisaka	Chetna Chaudhari
HDFS-13488	RBF: Reject requests when a Router is overloaded	Major	.	Íñigo Goiri	Íñigo Goiri
HDFS-13525	RBF: Add unit test TestStateStoreDisabledNameservice	Major	.	Yiqun Lin	Yiqun Lin
YARN-8253	HTTPS Ats v2 api call fails with "bad HTTP parsed"	Critical	ATSv2	Yesha Vora	Charan Hebri
HADOOP-15454	TestRollingFileSystemSinkWithLocal fails on Windows	Major	test	Xiao Liang	Xiao Liang
HADOOP-15498	TestHadoopArchiveLogs (#testGenerateScript, #testPrepareWorkingDir) fails on Windows	Minor	.	Anbang Hu	Anbang Hu
HADOOP-15497	TestTrash should use proper test path to avoid failing on Windows	Minor	.	Anbang Hu	Anbang Hu
HDFS-13637	RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE	Critical	federation	CR Hota	CR Hota
YARN-4781	Support intra-queue preemption for fairness ordering policy.	Major	scheduler	Wangda Tan	Eric Payne
HDFS-13281	Namenode#createFile should be /.reserved/raw/ aware.	Critical	encryption	Rushabh S Shah	Rushabh S Shah
YARN-4677	RMNodeResourceUpdateEvent update from scheduler can lead to race condition	Major	graceful, resourcemanager, scheduler	Brook Zhou	Wilfred Spiegelenburg
HADOOP-15529	ContainerLaunch#testInvalidEnvVariableSubstitutionType is not supported in Windows	Minor	.	Giovanni Matteo Fumarola	Giovanni Matteo Fumarola
HADOOP-15458	TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows	Minor	test	Xiao Liang	Xiao Liang
YARN-8481	AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters	Minor	amrmproxy, federation	Botong Huang	Botong Huang
HDFS-13475	RBF: Admin cannot enforce Router enter SafeMode	Major	.	Wei Yan	Chao Sun
HDFS-13733	RBF: Add Web UI configurations and descriptions to RBF document	Minor	documentation	Takanobu Asanuma	Takanobu Asanuma
HDFS-13743	RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver	Major	.	Takanobu Asanuma	Takanobu Asanuma
HDFS-13750	RBF: Router ID in RouterRpcClient is always null	Major	.	Takanobu Asanuma	Takanobu Asanuma
HDFS-13848	Refactor NameNode failover proxy providers	Major	ha, hdfs-client	Konstantin Shvachko	Konstantin Shvachko
HADOOP-15699	Fix some of testContainerManager failures in Windows	Major	.	Botong Huang	Botong Huang
HADOOP-15731	TestDistributedShell fails on Windows	Major	.	Botong Huang	Botong Huang
HADOOP-15759	AliyunOSS: update oss-sdk version to 3.0.0	Major	fs/oss	wujinhu	wujinhu
HADOOP-15671	AliyunOSS: Support Assume Roles in AliyunOSS	Major	fs/oss	wujinhu	wujinhu
HDFS-13790	RBF: Move ClientProtocol APIs to its own module	Major	.	Íñigo Goiri	Chao Sun
HADOOP-15607	AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream	Critical	.	wujinhu	wujinhu
HADOOP-15868	AliyunOSS: update document for properties of multiple part download, multiple part upload and directory copy	Major	fs/oss	wujinhu	wujinhu

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor