Apache Hadoop Changelog

Release 2.7.3 - 2016-08-25

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-11252	RPC client does not time out by default	Critical	ipc	Wilfred Spiegelenburg	Masatake Iwasaki

IMPORTANT ISSUES:

JIRA	Summary	Priority	Component	Reporter	Contributor
YARN-4785	inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler	Major	webapp	Jayesh	Varun Vasudev

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-2580	NameNode#main(...) can make use of GenericOptionsParser.	Minor	namenode	Harsh J	Harsh J
HDFS-8101	DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime	Minor	hdfs-client	Sean Busbey	Sean Busbey
YARN-3404	View the queue name to YARN Application page	Minor	.	Ryu Kobayashi	Ryu Kobayashi
HDFS-8647	Abstract BlockManager's rack policy into BlockPlacementPolicy	Major	.	Ming Ma	Brahma Reddy Battula
MAPREDUCE-5485	Allow repeating job commit by extending OutputCommitter API	Critical	.	Nemon Lou	Junping Du
HDFS-9314	Improve BlockPlacementPolicyDefault's picking of excess replicas	Major	.	Ming Ma	Xiao Chen
MAPREDUCE-6436	JobHistory cache issue	Blocker	.	Ryu Kobayashi	Kai Sasaki
HDFS-9198	Coalesce IBR processing in the NN	Major	namenode	Daryn Sharp	Daryn Sharp
HADOOP-12570	HDFS Secure Mode Documentation updates	Major	documentation	Arpit Agarwal	Arpit Agarwal
HDFS-9569	Log the name of the fsimage being loaded for better supportability	Trivial	namenode	Yongjun Zhang	Yongjun Zhang
HDFS-9415	Document dfs.cluster.administrators and dfs.permissions.superusergroup	Major	documentation	Arpit Agarwal	Xiaobing Zhou
YARN-4492	Add documentation for preemption supported in Capacity scheduler	Minor	capacity scheduler	Naganarasimha G R	Naganarasimha G R
HDFS-9654	Code refactoring for HDFS-8578	Minor	datanode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-9669	TcpPeerServer should respect ipc.server.listen.queue.size	Major	.	Elliott Clark	Elliott Clark
HDFS-9629	Update the footer of Web UI to show year 2016	Major	.	Xiao Chen	Xiao Chen
HADOOP-12772	NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values	Minor	.	Kuhu Shukla	Kuhu Shukla
HADOOP-12805	Annotate CanUnbuffer with @InterfaceAudience.Public	Major	.	Ted Yu	Ted Yu
YARN-4690	Skip object allocation in FSAppAttempt#getResourceUsage when possible	Major	.	Ming Ma	Ming Ma
HDFS-4946	Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable	Major	namenode	James Kinley	Nathan Roberts
HADOOP-12794	Support additional compression levels for GzipCodec	Major	io	Ravi Mutyala	Ravi Mutyala
HADOOP-12800	Copy docker directory from 2.8 to 2.7/2.6 repos to enable pre-commit Jenkins runs	Major	build, yetus	Zhe Zhang	Zhe Zhang
HDFS-8578	On upgrade, Datanode should process all storage/data dirs in parallel	Critical	datanode	Raju Bairishetti	Vinayakumar B
MAPREDUCE-6622	Add capability to set JHS job cache to a task-based limit	Critical	jobhistoryserver	Ray Chiang	Ray Chiang
HDFS-9906	Remove spammy log spew when a datanode is restarted	Major	namenode	Elliott Clark	Brahma Reddy Battula
HADOOP-12789	log classpath of ApplicationClassLoader at INFO level	Minor	util	Sangjin Lee	Sangjin Lee
HDFS-9860	Backport HDFS-9638 to branch-2.7.	Major	distcp, documentation	Gary Steelman	Wei-Chiu Chuang
HDFS-10264	Logging improvements in FSImageFormatProtobuf.Saver	Major	namenode	Konstantin Shvachko	Xiaobing Zhou
HADOOP-13039	Add documentation for configuration property ipc.maximum.data.length for controlling maximum RPC message size.	Major	documentation	Chris Nauroth	Mingliang Liu
HADOOP-13103	Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException	Minor	security	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-10488	Update WebHDFS documentation regarding CREATE and MKDIR default permissions	Minor	documentation, webhdfs	Wellington Chevreuil	Wellington Chevreuil
HADOOP-13298	Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/	Minor	.	Xiao Chen	Tsuyoshi Ozawa

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-8818	Should use equals() rather than == to compare String or Text in MD5MD5CRC32FileChecksum and TFileDumper	Minor	fs, io	Brandon Li	Brandon Li
HADOOP-9121	InodeTree.java has redundant check for vName while throwing exception	Major	fs	Arup Malakar	Arup Malakar
HADOOP-7817	RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos()	Major	fs	Kristofer Tomasette	Kanaka Kumar Avvaru
MAPREDUCE-6413	TestLocalJobSubmission is failing with unknown host	Major	test	Jason Lowe	zhihai xu
YARN-3695	ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception.	Major	.	Junping Du	Raju Bairishetti
HADOOP-12107	long running apps may have a huge number of StatisticsData instances under FileSystem	Critical	fs	Sangjin Lee	Sangjin Lee
YARN-3849	Too much of preemption activity causing continuos killing of containers across queues	Critical	capacityscheduler	Sunil Govindan	Sunil Govindan
HDFS-8772	Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails	Major	.	Walter Su	Walter Su
MAPREDUCE-5817	Mappers get rescheduled on node transition even after all reducers are completed	Major	applicationmaster	Sangjin Lee	Sangjin Lee
HDFS-8845	DiskChecker should not traverse the entire tree	Major	.	Chang Li	Chang Li
YARN-4121	Typos in capacity scheduler documentation.	Trivial	documentation	Kai Sasaki	Kai Sasaki
HDFS-8581	ContentSummary on / skips further counts on yielding lock	Minor	namenode	tongshiquan	J.Andreina
HADOOP-12348	MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter.	Major	metrics	zhihai xu	zhihai xu
HADOOP-12374	Description of hdfs expunge command is confusing	Major	documentation, trash	Weiwei Yang	Weiwei Yang
HDFS-9072	Fix random failures in TestJMXGet	Critical	test	J.Andreina	J.Andreina
MAPREDUCE-6460	TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails	Major	test	zhihai xu	zhihai xu
MAPREDUCE-6302	Preempt reducers after a configurable timeout irrespective of headroom	Critical	.	mai shurong	Karthik Kambatla
YARN-4288	NodeManager restart should keep retrying to register to RM while connection exception happens during RM failed over.	Critical	nodemanager	Junping Du	Junping Du
HDFS-9313	Possible NullPointerException in BlockManager if no excess replica can be chosen	Major	.	Ming Ma	Ming Ma
HADOOP-12296	when setnetgrent returns 0 in linux, exception should be thrown	Major	.	Chang Li	Chang Li
HDFS-4937	ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()	Major	namenode	Kihwal Lee	Kihwal Lee
HDFS-6481	DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs	Minor	namenode	Ted Yu	Tsz Wo Nicholas Sze
HDFS-9383	TestByteArrayManager#testByteArrayManager fails	Major	.	Kihwal Lee	Tsz Wo Nicholas Sze
HADOOP-12482	Race condition in JMX cache update	Major	.	Tony Wu	Tony Wu
YARN-4347	Resource manager fails with Null pointer exception	Major	yarn	Yesha Vora	Jian He
HADOOP-12545	Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp	Major	documentation	Mohammad Arshad	Mohammad Arshad
YARN-4374	RM capacity scheduler UI rounds user limit factor	Major	capacityscheduler	Chang Li	Chang Li
YARN-3769	Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler	Major	capacityscheduler	Eric Payne	Eric Payne
YARN-4380	TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently	Major	test	Tsuyoshi Ozawa	Varun Saxena
YARN-4398	Yarn recover functionality causes the cluster running slowly and the cluster usage rate is far below 100	Major	resourcemanager	NING DING	NING DING
HADOOP-12565	Replace DSA with RSA for SSH key type in SingleCluster.md	Minor	documentation	Alexander Veit	Mingliang Liu
YARN-4422	Generic AHS sometimes doesn't show started, node, or logs on App page	Major	.	Eric Payne	Eric Payne
HADOOP-12602	TestMetricsSystemImpl#testQSize occasionally fail	Major	test	Wei-Chiu Chuang	Masatake Iwasaki
YARN-4439	Clarify NMContainerStatus#toString method.	Major	.	Jian He	Jian He
HDFS-9516	truncate file fails with data dirs on multiple disks	Major	datanode	Bogdan Raducanu	Plamen Jeliazkov
YARN-4452	NPE when submit Unmanaged application	Critical	.	Naganarasimha G R	Naganarasimha G R
HDFS-9533	seen_txid in the shared edits directory is modified during bootstrapping	Major	ha, namenode	Kihwal Lee	Kihwal Lee
HDFS-9347	Invariant assumption in TestQuorumJournalManager.shutdown() is wrong	Major	test	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12636	Prevent ServiceLoader failure init for unused FileSystems	Major	fs	Íñigo Goiri	Íñigo Goiri
MAPREDUCE-6583	Clarify confusing sentence in MapReduce tutorial document	Minor	documentation	chris snow	Kai Sasaki
HDFS-9505	HDFS Architecture documentation needs to be refreshed.	Major	documentation	Chris Nauroth	Masatake Iwasaki
HDFS-7163	WebHdfsFileSystem should retry reads according to the configured retry policy.	Major	webhdfs	Eric Payne	Eric Payne
HADOOP-12559	KMS connection failures should trigger TGT renewal	Major	security	Zhe Zhang	Zhe Zhang
HADOOP-12682	Fix TestKMS#testKMSRestart* failure	Major	.	Wei-Chiu Chuang	Wei-Chiu Chuang
MAPREDUCE-6577	MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set	Critical	mr-am	Sangjin Lee	Sangjin Lee
YARN-4546	ResourceManager crash due to scheduling opportunity overflow	Critical	resourcemanager	Jason Lowe	Jason Lowe
HDFS-9600	do not check replication if the block is under construction	Critical	.	Phil Yang	Phil Yang
HADOOP-12613	TestFind.processArguments occasionally fails	Major	test	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4414	Nodemanager connection errors are retried at multiple levels	Major	nodemanager	Jason Lowe	Chang Li
HDFS-9648	TestStartup.testImageChecksum is broken by HDFS-9569's message change	Trivial	namenode	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12706	TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally	Major	test	Jason Lowe	Sangjin Lee
YARN-4581	AHS writer thread leak makes RM crash while RM is recovering	Major	resourcemanager	sandflee	sandflee
MAPREDUCE-6554	MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory	Critical	.	Bibin A Chundatt	Bibin A Chundatt
HDFS-9661	Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw	Major	datanode	ade	ade
HDFS-9625	set replication for empty file failed when set storage policy	Major	namenode	DENG FEI	DENG FEI
HDFS-9634	webhdfs client side exceptions don't provide enough details	Major	webhdfs	Eric Payne	Eric Payne
YARN-4610	Reservations continue looking for one app causes other apps to starve	Blocker	capacityscheduler	Jason Lowe	Jason Lowe
YARN-4598	Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL	Major	nodemanager	tangshangwen	tangshangwen
HDFS-9690	ClientProtocol.addBlock is not idempotent after HDFS-8071	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
MAPREDUCE-6619	HADOOP_CLASSPATH is overwritten in MR container	Major	mrv2	shanyu zhao	Junping Du
YARN-4428	Redirect RM page to AHS page when AHS turned on and RM page is not available	Major	.	Chang Li	Chang Li
MAPREDUCE-6618	YarnClientProtocolProvider leaking the YarnClient thread.	Major	.	Xuan Gong	Xuan Gong
YARN-3102	Decommisioned Nodes not listed in Web UI	Minor	resourcemanager	Bibin A Chundatt	Kuhu Shukla
HDFS-9406	FSImage may get corrupted after deleting snapshot	Major	namenode	Stanislav Antic	Yongjun Zhang
MAPREDUCE-6621	Memory Leak in JobClient#submitJobInternal()	Major	.	Xuan Gong	Xuan Gong
HDFS-9740	Use a reasonable limit in DFSTestUtil.waitForMetric()	Major	test	Kihwal Lee	Chang Li
HADOOP-12761	incremental maven build is not really incremental	Minor	build	Sangjin Lee	Sangjin Lee
HDFS-9743	Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7	Major	.	Kihwal Lee	Kihwal Lee
HDFS-9730	Storage ID update does not happen when there is a layout change	Major	datanode	Kihwal Lee	Tsz Wo Nicholas Sze
HDFS-9724	Degraded performance in WebHDFS listing as it does not reuse ObjectMapper	Critical	performance	Akira Ajisaka	Akira Ajisaka
HADOOP-12773	HBase classes fail to load with client/job classloader enabled	Major	util	Sangjin Lee	Sangjin Lee
HDFS-9784	Example usage is not correct in Transparent Encryption document	Major	documentation	Takashi Ohnishi	Takashi Ohnishi
HDFS-9752	Permanent write failures may happen to slow writers during datanode rolling upgrades	Critical	.	Kihwal Lee	Walter Su
HDFS-9779	TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value	Minor	test	Kuhu Shukla	Kuhu Shukla
HADOOP-12792	TestUserGroupInformation#testGetServerSideGroups fails in chroot	Minor	security, test	Eric Badger	Eric Badger
HADOOP-12589	Fix intermittent test failure of TestCopyPreserveFlag	Major	test	Tsuyoshi Ozawa	Masatake Iwasaki
HADOOP-12786	"hadoop key" command usage is not documented	Major	documentation	Akira Ajisaka	Xiao Chen
HDFS-9765	TestBlockScanner#testVolumeIteratorWithCaching fails intermittently	Major	test	Mingliang Liu	Akira Ajisaka
HADOOP-12810	FileSystem#listLocatedStatus causes unnecessary RPC calls	Major	fs, fs/s3	Ryan Blue	Ryan Blue
MAPREDUCE-6637	Testcase Failure : TestFileInputFormat.testSplitLocationInfo	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4707	Remove the extra char (>) from SecureContainer.md	Major	documentation	Brahma Reddy Battula	Brahma Reddy Battula
MAPREDUCE-6635	Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException	Critical	.	Sergey Shelukhin	Junping Du
YARN-2046	Out of band heartbeats are sent only on container kill and possibly too early	Major	nodemanager	Jason Lowe	Ming Ma
YARN-4722	AsyncDispatcher logs redundant event queue sizes	Major	.	Jason Lowe	Jason Lowe
YARN-4723	NodesListManager$UnknownNodeId ClassCastException	Critical	resourcemanager	Jason Lowe	Kuhu Shukla
HDFS-9864	Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc	Major	documentation	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-9880	TestDatanodeRegistration fails occasionally	Major	test	Kihwal Lee	Kihwal Lee
HDFS-9766	TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently	Major	test	Mingliang Liu	Xiao Chen
HDFS-9851	Name node throws NPE when setPermission is called on a path that does not exist	Critical	namenode	David Yan	Brahma Reddy Battula
HADOOP-12870	Fix typo admininistration in CommandsManual.md	Minor	documentation	Akira Ajisaka	John Zhuge
HDFS-9048	DistCp documentation is out-of-dated	Major	.	Haohui Mai	Daisuke Kobayashi
HADOOP-12871	Fix dead link to NativeLibraries.html in CommandsManual.md	Minor	documentation	Akira Ajisaka	Brahma Reddy Battula
HADOOP-12872	Fix formatting in ServiceLevelAuth.md	Trivial	documentation	Akira Ajisaka	Brahma Reddy Battula
MAPREDUCE-4785	TestMRApp occasionally fails	Major	mrv2, test	Jason Lowe	Haibo Chen
YARN-4761	NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler	Major	fairscheduler	Sangjin Lee	Sangjin Lee
YARN-4760	proxy redirect to history server uses wrong URL	Major	webapp	Jason Lowe	Eric Badger
HDFS-9865	TestBlockReplacement fails intermittently in trunk	Major	test	Yiqun Lin	Yiqun Lin
HDFS-9812	Streamer threads leak if failure happens when closing DFSOutputStream	Major	hdfs-client	Yiqun Lin	Yiqun Lin
HADOOP-12688	Fix deadlinks in Compatibility.md	Major	documentation	Akira Ajisaka	Gabor Liptak
HDFS-9904	testCheckpointCancellationDuringUpload occasionally fails	Major	test	Kihwal Lee	Yiqun Lin
MAPREDUCE-6645	TestWordStats outputs logs under directories other than target/test-dir	Major	test	Akira Ajisaka	Gabor Liptak
HDFS-9874	Long living DataXceiver threads cause volume shutdown to block.	Critical	datanode	Rushabh S Shah	Rushabh S Shah
YARN-4686	MiniYARNCluster.start() returns before cluster is completely started	Major	test	Rohith Sharma K S	Eric Badger
MAPREDUCE-6363	[NNBench] Lease mismatch error when running with multiple mappers	Critical	benchmarks	Brahma Reddy Battula	Bibin A Chundatt
MAPREDUCE-6580	Test failure : TestMRJobsWithProfiler	Major	.	Rohith Sharma K S	Eric Badger
MAPREDUCE-6656	[NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363	Blocker	.	J.Andreina	J.Andreina
YARN-4850	test-fair-scheduler.xml isn't valid xml	Blocker	fairscheduler, test	Allen Wittenauer	Yufei Gu
HADOOP-12958	PhantomReference for filesystem statistics can trigger OOM	Major	.	Jason Lowe	Sangjin Lee
HDFS-10182	Hedged read might overwrite user's buf	Major	.	zhouyingchao	zhouyingchao
YARN-4773	Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled	Minor	nodemanager	Jason Lowe	Jun Gong
HDFS-9478	Reason for failing ipc.FairCallQueue contruction should be thrown	Minor	.	Archana T	Ajith S
HADOOP-12902	JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter	Major	documentation	Robert Kanter	Gabor Liptak
YARN-4183	Clarify the behavior of timeline service config properties	Major	.	Mit Desai	Naganarasimha G R
YARN-4706	UI Hosting Configuration in TimelineServer doc is broken	Critical	documentation	Akira Ajisaka	Akira Ajisaka
HDFS-10178	Permanent write failures can happen if pipeline recoveries occur for the first packet	Critical	.	Kihwal Lee	Kihwal Lee
HDFS-9917	IBR accumulate more objects when SNN was down for sometime.	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10239	Fsshell mv fails if port usage doesn't match in src and destination paths	Major	.	Kuhu Shukla	Kuhu Shukla
YARN-4915	Fix typo in YARN Secure Containers documentation	Trivial	documentation, yarn	Takashi Ohnishi	Takashi Ohnishi
YARN-4917	Fix typos in documentation of Capacity Scheduler.	Minor	documentation	Takashi Ohnishi	Takashi Ohnishi
HDFS-10261	TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports	Major	.	Eric Badger	Eric Badger
MAPREDUCE-6670	TestJobListCache#testEviction sometimes fails on Windows with timeout	Minor	test	Gergely Novák	Gergely Novák
MAPREDUCE-6633	AM should retry map attempts if the reduce task encounters commpression related errors.	Major	.	Rushabh S Shah	Rushabh S Shah
YARN-4938	MiniYarnCluster should not request transitionToActive to RM on non-HA environment	Major	test	Akira Ajisaka	Eric Badger
HADOOP-12406	AbstractMapWritable.readFields throws ClassNotFoundException with custom writables	Blocker	io	Nadeem Douba	Nadeem Douba
HDFS-10271	Extra bytes are getting released from reservedSpace for append	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4794	Deadlock in NMClientImpl	Critical	.	Sumana Sathish	Jian He
HDFS-9772	TestBlockReplacement#testThrottler doesn't work as expected	Minor	test	Yiqun Lin	Yiqun Lin
YARN-4924	NM recovery race can lead to container not cleaned up	Major	nodemanager	Nathan Roberts	sandflee
HADOOP-12989	Some tests in org.apache.hadoop.fs.shell.find occasionally time out	Major	test	Akira Ajisaka	Takashi Ohnishi
YARN-4940	yarn node -list -all failed if RM start with decommissioned node	Major	.	sandflee	sandflee
HDFS-10275	TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly	Major	test	Yiqun Lin	Yiqun Lin
MAPREDUCE-6680	JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)	Major	jobhistoryserver	Junping Du	Junping Du
HADOOP-13042	Restore lost leveldbjni LICENSE and NOTICE changes	Major	.	Andrew Wang	Andrew Wang
HADOOP-13043	Add LICENSE.txt entries for bundled javascript dependencies	Major	.	Andrew Wang	Andrew Wang
HDFS-10319	Balancer should not try to pair storages with different types	Minor	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-9555	LazyPersistFileScrubber should still sleep if there are errors in the clear progress	Major	.	Phil Yang	Phil Yang
HADOOP-13052	ChecksumFileSystem mishandles crc file permissions	Major	fs	Daryn Sharp	Daryn Sharp
HDFS-9905	WebHdfsFileSystem#runWithRetry should display original stack trace on error	Major	test	Kihwal Lee	Wei-Chiu Chuang
HDFS-10245	Fix the findbug warnings in branch-2.7	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4556	TestFifoScheduler.testResourceOverCommit fails	Major	scheduler, test	Akihiro Suda	Akihiro Suda
HDFS-9958	BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.	Major	.	Kuhu Shukla	Kuhu Shukla
YARN-5008	LeveldbRMStateStore database can grow substantially leading to long recovery times	Major	resourcemanager	Jason Lowe	Jason Lowe
YARN-5009	NMLeveldbStateStoreService database can grow substantially leading to longer recovery times	Major	nodemanager	Jason Lowe	Jason Lowe
HDFS-10335	Mover$Processor#chooseTarget() always chooses the first matching target storage group	Critical	balancer & mover	Mingliang Liu	Mingliang Liu
HDFS-10347	Namenode report bad block method doesn't log the bad block or datanode.	Minor	namenode	Rushabh S Shah	Rushabh S Shah
YARN-4834	ProcfsBasedProcessTree doesn't track daemonized processes	Major	nodemanager	Nathan Roberts	Nathan Roberts
MAPREDUCE-6514	Job hangs as ask is not updated after ramping down of all reducers	Blocker	applicationmaster	Varun Saxena	Varun Saxena
HDFS-2043	TestHFlush failing intermittently	Major	test	Aaron T. Myers	Yiqun Lin
MAPREDUCE-6689	MapReduce job can infinitely increase number of reducer resource requests	Blocker	.	Wangda Tan	Wangda Tan
YARN-4747	AHS error 500 due to NPE when container start event is missing	Major	timelineserver	Jason Lowe	Varun Saxena
HADOOP-13084	Fix ASF License warnings in branch-2.7	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10372	Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume	Major	test	Rushabh S Shah	Rushabh S Shah
MAPREDUCE-6558	multibyte delimiters with compressed input files generate duplicate records	Major	mrv1, mrv2	Wilfred Spiegelenburg	Wilfred Spiegelenburg
MAPREDUCE-6513	MR job got hanged forever when one NM unstable for some time	Critical	applicationmaster, resourcemanager	Bob.zhao	Varun Saxena
YARN-3840	Resource Manager web ui issue when sorting application by id (with application having id > 9999)	Major	resourcemanager	LINTE	Varun Saxena
YARN-5055	max apps per user can be larger than max per queue	Minor	capacityscheduler, resourcemanager	Jason Lowe	Eric Badger
YARN-4751	In 2.7, Labeled queue usage not shown properly in capacity scheduler UI	Major	capacity scheduler, yarn	Eric Payne	Eric Payne
HDFS-9365	Balancer does not work with the HDFS-6376 HA setup	Major	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
YARN-4459	container-executor should only kill process groups	Major	nodemanager	Jun Gong	Jun Gong
HDFS-9476	TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail	Major	.	Wei-Chiu Chuang	Masatake Iwasaki
HDFS-10458	getFileEncryptionInfo should return quickly for non-encrypted cluster	Major	encryption, namenode	Zhe Zhang	Zhe Zhang
YARN-5206	RegistrySecurity includes id:pass in exception text if considered invalid	Minor	client, security	Steve Loughran	Steve Loughran
HADOOP-13270	BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks	Critical	.	Haibo Chen	Kai Sasaki
HADOOP-13255	KMSClientProvider should check and renew tgt when doing delegation token operations.	Major	kms	Xiao Chen	Xiao Chen
HDFS-10474	hftp copy fails when file name with Chinese+special char in branch-2	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-13192	org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly	Critical	util	binde	binde
HADOOP-13350	Additional fix to LICENSE and NOTICE	Blocker	build	Xiao Chen	Xiao Chen
HADOOP-12893	Verify LICENSE.txt and NOTICE.txt	Blocker	build	Allen Wittenauer	Xiao Chen
HADOOP-13297	Add missing dependency in setting maven-remote-resource-plugin to fix builds	Major	build	Akira Ajisaka	Sean Busbey
HDFS-10623	Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens.	Major	hdfs	Jitendra Nath Pandey	Hanisha Koneru
YARN-5309	Fix SSLFactory truststore reloader thread leak in TimelineClientImpl	Blocker	timelineserver, yarn	Thomas Friedrich	Weiwei Yang
HDFS-8914	Document HA support in the HDFS HdfsDesign.md	Major	documentation	Ravindra Babu	Lars Francke
HADOOP-12588	Fix intermittent test failure of TestGangliaMetrics	Major	.	Tsuyoshi Ozawa	Masatake Iwasaki
HADOOP-13434	Add quoting to Shell class	Major	.	Owen O'Malley	Owen O'Malley
HDFS-9530	ReservedSpace is not cleared for abandoned Blocks	Critical	datanode	Fei Hui	Brahma Reddy Battula

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-6191	TestJavaSerialization fails with getting incorrect MR job result	Minor	test	sam liu	sam liu
YARN-3602	TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup	Minor	test	zhihai xu	zhihai xu
HADOOP-12736	TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out	Major	.	Xiao Chen	Xiao Chen
HADOOP-12715	TestValueQueue#testgetAtMostPolicyALL fails intermittently	Major	.	Xiao Chen	Xiao Chen
HDFS-9688	Test the effect of nested encryption zones in HDFS downgrade	Major	encryption, test	Zhe Zhang	Zhe Zhang
YARN-5069	TestFifoScheduler.testResourceOverCommit race condition	Major	test	Eric Badger	Eric Badger

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
YARN-4623	TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE	Major	yarn	Jason Lowe	Naganarasimha G R
HDFS-10186	DirectoryScanner: Improve logs by adding full path of both actual and expected block directories	Minor	datanode	Rakesh R	Rakesh R
HADOOP-13154	S3AFileSystem printAmazonServiceException/printAmazonClientException appear copy & paste of AWS examples	Blocker	fs/s3	Steve Loughran	Steve Loughran
YARN-3362	Add node label usage in RM CapacityScheduler web UI	Major	capacityscheduler, resourcemanager, webapp	Wangda Tan	Naganarasimha G R
YARN-3426	Add jdiff support to YARN	Blocker	.	Li Lu	Li Lu

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-11814	Reformat hadoop-annotations, o.a.h.classification.tools	Minor	.	Li Lu	Li Lu
YARN-4653	Document YARN security model from the perspective of Application Developers	Major	site	Steve Loughran	Steve Loughran
HADOOP-13312	Update CHANGES.txt to reflect all the changes in branch-2.7	Blocker	.	Akira Ajisaka	Akira Ajisaka