Apache Hadoop Changelog

Release 1.2.0 - 2013-05-13

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-8164	Handle paths using back slash as path separator for windows only	Major	fs	Suresh Srinivas	Daryn Sharp
MAPREDUCE-4629	Remove JobHistory.DEBUG_MODE	Major	.	Karthik Kambatla	Karthik Kambatla
HDFS-4122	Cleanup HDFS logs and reduce the size of logged messages	Major	datanode, hdfs-client, namenode	Suresh Srinivas	Suresh Srinivas
HDFS-4350	Make enabling of stale marking on read and write paths independent	Major	.	Andrew Wang	Andrew Wang
MAPREDUCE-4737	Hadoop does not close output file / does not call Mapper.cleanup if exception in map	Major	.	Daniel Dai	Arun C Murthy

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-461	Enable ServicePlugins for the JobTracker	Minor	.	Fredrik Hedberg	Fredrik Hedberg
HDFS-3515	Port HDFS-1457 to branch-1	Major	namenode	Eli Collins	Eli Collins
HADOOP-8023	Add unset() method to Configuration	Critical	conf	Alejandro Abdelnur	Alejandro Abdelnur
MAPREDUCE-4355	Add RunningJob.getJobStatus()	Major	mrv1, mrv2	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-987	Exposing MiniDFS and MiniMR clusters as a single process command-line	Minor	build, test	Philip Zeyliger	Ahmed Radwan
MAPREDUCE-3678	The Map tasks logs should have the value of input split it processed	Major	mrv1, mrv2	Bejoy KS	Harsh J
HADOOP-8988	Backport HADOOP-8343 to branch-1	Major	conf	Jing Zhao	Jing Zhao
HADOOP-8820	Backport HADOOP-8469 and HADOOP-8470: add "NodeGroup" layer in new NetworkTopology (also known as NetworkTopologyWithNodeGroup)	Major	net	Junping Du	Junping Du
HDFS-3941	Backport HDFS-3498 and HDFS3601: update replica placement policy for new added "NodeGroup" layer topology	Major	namenode	Junping Du	Junping Du
HDFS-4219	Port slive to branch-1	Major	.	Arpit Gupta	Arpit Gupta
HADOOP-9090	Support on-demand publish of metrics	Minor	metrics	Mostafa Elhemali	Mostafa Elhemali
HDFS-3942	Backport HDFS-3495: Update balancer policy for Network Topology with additional 'NodeGroup' layer	Major	balancer & mover	Junping Du	Junping Du
MAPREDUCE-4660	Update task placement policy for NetworkTopology with 'NodeGroup' layer	Major	jobtracker, mrv1, scheduler	Junping Du	Junping Du
HDFS-4597	Backport WebHDFS concat to branch-1	Major	webhdfs	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
MAPREDUCE-5081	Backport DistCpV2 and the related JIRAs to branch-1	Major	distcp	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
MAPREDUCE-4824	Provide a mechanism for jobs to indicate they should not be recovered on restart	Major	mrv1	Tom White	Tom White
MAPREDUCE-5129	Add tag info to JH files	Minor	.	Billie Rinaldi	Billie Rinaldi
HDFS-4776	Backport SecondaryNameNode web ui to branch-1	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-4774	Backport HDFS-4525 'Provide an API for knowing whether file is closed or not' to branch-1	Major	hdfs-client, namenode	Ted Yu	Ted Yu
HDFS-3601	Implementation of ReplicaPlacementPolicyNodeGroup to support 4-layer network topology	Major	namenode	Junping Du	Junping Du
HDFS-3495	Update Balancer to support new NetworkTopology with NodeGroup	Major	balancer & mover	Junping Du	Junping Du

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-385	Design a pluggable interface to place replicas of blocks in HDFS	Major	.	dhruba borthakur	dhruba borthakur
HADOOP-7096	Allow setting of end-of-record delimiter for TextInputFormat	Major	.	Ahmed Radwan	Ahmed Radwan
HDFS-1957	Documentation for HFTP	Minor	documentation	Ari Rabkin	Ari Rabkin
HDFS-2533	Remove needless synchronization on FSDataSet.getBlockFile	Minor	datanode, performance	Todd Lipcon	Todd Lipcon
HDFS-3163	TestHDFSCLI.testAll fails if the user name is not all lowercase	Trivial	test	Brandon Li	Brandon Li
HDFS-3479	backport HDFS-3335 (check for edit log corruption at the end of the log) to branch-1	Major	.	Colin P. McCabe	Colin P. McCabe
HDFS-3521	Allow namenode to tolerate edit log corruption	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-3604	Add dfs.webhdfs.enabled to hdfs-default.xml	Minor	.	Eli Collins	Eli Collins
HDFS-3596	Improve FSEditLog pre-allocation in branch-1	Minor	.	Colin P. McCabe	Colin P. McCabe
HDFS-3647	Backport HDFS-2868 (Add number of active transfer threads to the DataNode status) to branch-1	Major	datanode	Steve Hoffman	Harsh J
MAPREDUCE-4415	Backport the Job.getInstance methods from MAPREDUCE-1505 to branch-1	Major	mrv1	Harsh J	Harsh J
HDFS-3697	Enable fadvise readahead by default	Minor	datanode, performance	Todd Lipcon	Todd Lipcon
HADOOP-8711	provide an option for IPC server users to avoid printing stack information for certain exceptions	Major	ipc	Brandon Li	Brandon Li
MAPREDUCE-4565	Backport MR-2855 to branch-1: ResourceBundle lookup during counter name resolution takes a lot of time	Major	.	Karthik Kambatla	Karthik Kambatla
HDFS-3817	avoid printing stack information for SafeModeException	Major	namenode	Brandon Li	Brandon Li
HDFS-3819	Should check whether invalidate work percentage default value is not greater than 1.0f	Minor	.	Jing Zhao	Jing Zhao
HDFS-3838	fix the typo in FSEditLog.java: isToterationEnabled should be isTolerationEnabled	Trivial	namenode	Brandon Li	Brandon Li
MAPREDUCE-4408	allow jobs to set a JAR that is in the distributed cached	Major	mrv1, mrv2	Alejandro Abdelnur	Robert Kanter
MAPREDUCE-4499	Looking for speculative tasks is very expensive in 1.x	Major	mrv1, performance	Nathan Roberts	Koji Noguchi
HADOOP-7688	When a servlet filter throws an exception in init(..), the Jetty server failed silently.	Major	.	Tsz Wo Nicholas Sze	Uma Maheswara Rao G
MAPREDUCE-2770	Improve hadoop.job.history.location doc in mapred-default.xml	Trivial	documentation	Eli Collins	Sandy Ryza
MAPREDUCE-4464	Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()	Minor	task	Clint Heath	Clint Heath
MAPREDUCE-4556	FairScheduler: PoolSchedulable#updateDemand() has potential redundant computation	Minor	contrib/fair-share	Karthik Kambatla	Karthik Kambatla
HADOOP-8931	Add Java version to startup message	Trivial	.	Eli Collins	Eli Collins
HDFS-4057	NameNode.namesystem should be private. Use getNamesystem() instead.	Minor	namenode	Brandon Li	Brandon Li
HADOOP-8951	RunJar to fail with user-comprehensible error message if jar missing	Minor	util	Steve Loughran	Steve Loughran
HDFS-4062	In branch-1, FSNameSystem#invalidateWorkForOneNode and FSNameSystem#computeReplicationWorkForBlock should print logs outside of the namesystem lock	Minor	.	Jing Zhao	Jing Zhao
HADOOP-8971	Backport: hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (HADOOP-8926)	Major	util	Gopal V	Gopal V
HADOOP-8968	Add a flag to completely disable the worker version check	Major	.	Alejandro Abdelnur	Alejandro Abdelnur
MAPREDUCE-4703	Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped.	Major	mrv1, mrv2, test	Ahmed Radwan	Ahmed Radwan
MAPREDUCE-4845	ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2	Major	client	Sandy Ryza	Sandy Ryza
HDFS-4320	Add a separate configuration for namenode rpc address instead of only using fs.default.name	Major	datanode, namenode	Mostafa Elhemali	Mostafa Elhemali
MAPREDUCE-4907	TrackerDistributedCacheManager issues too many getFileStatus calls	Major	mrv1, tasktracker	Sandy Ryza	Sandy Ryza
MAPREDUCE-2931	CLONE - LocalJobRunner should support parallel mapper execution	Major	.	Forest Tan	Sandy Ryza
MAPREDUCE-4837	Add webservices for jobtracker	Major	.	Arun C Murthy	Arun C Murthy
HDFS-4551	Change WebHDFS buffersize behavior to improve default performance	Major	webhdfs	Mark Wagner	Mark Wagner
HADOOP-9379	capture the ulimit info after printing the log to the console	Trivial	.	Arpit Gupta	Arpit Gupta
HADOOP-9434	Backport HADOOP-9267 to branch-1	Minor	bin	Yu Li	Yu Li
HDFS-4635	Move BlockManager#computeCapacity to LightWeightGSet	Major	namenode	Suresh Srinivas	Suresh Srinivas
HADOOP-9253	Capture ulimit info in the logs at service start time	Major	.	Arpit Gupta	Arpit Gupta
HDFS-4651	Offline Image Viewer backport to branch-1	Major	tools	Chris Nauroth	Chris Nauroth
HADOOP-9071	configure ivy log levels for resolve/retrieve	Major	build	Giridharan Kesavan	Giridharan Kesavan
HDFS-3940	Add Gset#clear method and clear the block map when namenode is shutdown	Minor	.	Eli Collins	Suresh Srinivas
HDFS-3498	Make Replica Removal Policy pluggable and ReplicaPlacementPolicyDefault extensible for reusing code in subclass	Major	namenode	Junping Du	Junping Du

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-7101	UserGroupInformation.getCurrentUser() fails when called from non-Hadoop JAAS context	Blocker	security	Todd Lipcon	Todd Lipcon
HDFS-2827	Cannot save namespace after renaming a directory above a file with an open lease	Major	namenode	Uma Maheswara Rao G	Uma Maheswara Rao G
HADOOP-8355	SPNEGO filter throws/logs exception when authentication fails	Minor	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-8460	Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR	Major	documentation	Robert Joseph Evans	Robert Joseph Evans
MAPREDUCE-4195	With invalid queueName request param, jobqueue_details.jsp shows NPE	Critical	jobtracker	Gera Shegalov
MAPREDUCE-3727	jobtoken location property in jobconf refers to wrong jobtoken file	Critical	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-8512	AuthenticatedURL should reset the Token when the server returns other than OK on authentication	Minor	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-7868	Hadoop native fails to compile when default linker option is -Wl,--as-needed	Major	native	James Page	Trevor Robinson
MAPREDUCE-2289	Permissions race can make getStagingDir fail on local filesystem	Major	job submission	Todd Lipcon	Ahmed Radwan
HADOOP-8249	invalid hadoop-auth cookies should trigger authentication if info is avail before returning HTTP 401	Major	security	bc Wong	Alejandro Abdelnur
HDFS-3595	TestEditLogLoading fails in branch-1	Major	namenode	Colin P. McCabe	Colin P. McCabe
MAPREDUCE-4317	Job view ACL checks are too permissive	Major	mrv1	Harsh J	Karthik Kambatla
MAPREDUCE-4385	FairScheduler.maxTasksToAssign() should check for fairscheduler.assignmultiple.maps < TaskTracker.availableSlots	Major	.	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-4359	Potential deadlock in Counters	Major	.	Todd Lipcon	Tom White
MAPREDUCE-3993	Graceful handling of codec errors during decompression	Major	mrv1, mrv2	Todd Lipcon	Karthik Kambatla
HDFS-3628	The dfsadmin -setBalancerBandwidth command on branch-1 does not check for superuser privileges	Blocker	datanode, namenode	Harsh J	Harsh J
HADOOP-8586	Fixup a bunch of SPNEGO misspellings	Major	.	Eli Collins	Eli Collins
HADOOP-8587	HarFileSystem access of harMetaCache isn't threadsafe	Minor	fs	Eli Collins	Eli Collins
HADOOP-7836	TestSaslRPC#testDigestAuthMethodHostBasedToken fails with hostname localhost.localdomain	Minor	ipc, test	Eli Collins	Daryn Sharp
HADOOP-8423	MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data	Major	io	Jason B	Todd Lipcon
HADOOP-8612	Backport HADOOP-8599 to branch-1 (Non empty response when read beyond eof)	Major	fs	Matt Foley	Eli Collins
HADOOP-8606	FileSystem.get may return the wrong filesystem	Major	fs	Daryn Sharp	Daryn Sharp
HADOOP-8613	AbstractDelegationTokenIdentifier#getUser() should set token auth type	Critical	.	Daryn Sharp	Daryn Sharp
HDFS-3679	fuse_dfs notrash option sets usetrash	Minor	fuse-dfs	Conrad Meyer	Conrad Meyer
MAPREDUCE-4036	Streaming TestUlimit fails on CentOS 6	Major	test	Alejandro Abdelnur	Alejandro Abdelnur
HDFS-3754	BlockSender doesn't shutdown ReadaheadPool threads	Major	datanode	Eli Collins	Eli Collins
HADOOP-8611	Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails	Major	security	Kihwal Lee	Robert Parker
MAPREDUCE-4595	TestLostTracker failing - possibly due to a race in JobHistory.JobHistoryFilesManager#run()	Critical	.	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-1684	ClusterStatus can be cached in CapacityTaskScheduler.assignTasks()	Major	capacity-sched	Amareshwari Sriramadasu	Koji Noguchi
MAPREDUCE-4572	Can not access user logs - Jetty is not configured by default to serve aliases/symlinks	Major	tasktracker, webapps	Ahmed Radwan	Ahmed Radwan
HDFS-2757	Cannot read a local block that's being written to when using the local read short circuit	Major	.	Jean-Daniel Cryans	Jean-Daniel Cryans
HADOOP-8781	hadoop-config.sh should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH	Major	scripts	Alejandro Abdelnur	Alejandro Abdelnur
MAPREDUCE-4576	Large dist cache can block tasktracker heartbeat	Major	.	Robert Joseph Evans	Robert Joseph Evans
HADOOP-8767	secondary namenode on slave machines	Minor	bin	giovanni delussu	giovanni delussu
HADOOP-8819	Should use && instead of & in a few places in FTPFileSystem,FTPInputStream,S3InputStream,ViewFileSystem,ViewFs	Major	fs	Brandon Li	Brandon Li
HADOOP-8786	HttpServer continues to start even if AuthenticationFilter fails to init	Major	.	Todd Lipcon	Todd Lipcon
HDFS-3961	FSEditLog preallocate() needs to reset the position of PREALLOCATE_BUFFER when more than 1MB size is needed	Major	.	Jing Zhao	Jing Zhao
HADOOP-8832	backport serviceplugin to branch-1	Major	.	Brandon Li	Brandon Li
HDFS-3963	backport namenode/datanode serviceplugin to branch-1	Major	.	Brandon Li	Brandon Li
HDFS-3698	TestHftpFileSystem is failing in branch-1 due to changed default secure port	Major	security	Aaron T. Myers	Aaron T. Myers
HADOOP-7698	jsvc target fails on x86_64	Critical	build	Daryn Sharp	Daryn Sharp
MAPREDUCE-4652	ValueAggregatorJob sets the wrong job jar	Major	examples, mrv1	Ahmed Radwan	Ahmed Radwan
MAPREDUCE-4662	JobHistoryFilesManager thread pool never expands	Major	jobhistoryserver	Thomas Graves	Kihwal Lee
HADOOP-8791	rm "Only deletes non empty directory and files."	Major	documentation	Bertrand Dechoux	Jing Zhao
HADOOP-8386	hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu)	Major	scripts	Christopher Berner	Christopher Berner
MAPREDUCE-4706	FairScheduler#dump(): Computing of # running maps and reduces is commented out	Critical	contrib/fair-share	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-4451	fairscheduler fail to init job with kerberos authentication configured	Major	contrib/fair-share	Erik.fang	Erik.fang
HADOOP-6496	HttpServer sends wrong content-type for CSS files (and others)	Minor	.	Lars Francke	Ivan Mitic
HADOOP-7827	jsp pages missing DOCTYPE	Trivial	.	Dave Vronay	Dave Vronay
HDFS-3402	Fix hdfs scripts for secure datanodes	Minor	scripts, security	Benoy Antony	Benoy Antony
HDFS-4072	On file deletion remove corresponding blocks pending replication	Minor	namenode	Jing Zhao	Jing Zhao
HADOOP-8861	FSDataOutputStream.sync should call flush() if the underlying wrapped stream is not Syncable	Major	fs	Amareshwari Sriramadasu	Amareshwari Sriramadasu
HDFS-3540	Further improvement on recovery mode and edit log toleration in branch-1	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-8900	BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size	Major	.	Slavik Krassovsky	Andy Isaacson
MAPREDUCE-1806	CombineFileInputFormat does not work with paths not on default FS	Major	harchive	Paul Yang	Gera Shegalov
MAPREDUCE-4765	Restarting the JobTracker programmatically can cause DelegationTokenRenewal to throw an exception	Minor	jobtracker, mrv1	Robert Kanter	Robert Kanter
HDFS-4168	TestDFSUpgradeFromImage fails in branch-1	Major	namenode	Tsz Wo Nicholas Sze	Jing Zhao
HADOOP-8963	CopyFromLocal doesn't always create user directory	Trivial	.	Billie Rinaldi	Arpit Gupta
HDFS-4180	TestFileCreation fails in branch-1 but not branch-1.1	Minor	test	Tsz Wo Nicholas Sze	Jing Zhao
HADOOP-9036	TestSinkQueue.testConcurrentConsumers fails intermittently (Backports HADOOP-7292)	Major	.	Ivan Mitic	Suresh Srinivas
HDFS-4207	All hadoop fs operations fail if the default fs is down even if a different file system is specified in the command	Minor	hdfs-client	Steve Loughran	Jing Zhao
HADOOP-9095	TestNNThroughputBenchmark fails in branch-1	Minor	net	Tsz Wo Nicholas Sze	Jing Zhao
MAPREDUCE-4778	Fair scheduler event log is only written if directory exists on HDFS	Major	jobtracker, scheduler	Sandy Ryza	Sandy Ryza
HADOOP-9098	Add missing license headers	Blocker	build	Tom White	Arpit Agarwal
MAPREDUCE-4860	DelegationTokenRenewal attempts to renew token even after a job is removed	Major	security	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-4806	Cleanup: Some (5) private methods in JobTracker.RecoveryManager are not used anymore after MAPREDUCE-3837	Major	mrv1	Karthik Kambatla	Karthik Kambatla
HDFS-4337	Backport HDFS-4240 to branch-1: Make sure nodes are avoided to place replica if some replica are already under the same nodegroup.	Major	namenode	Junping Du	meng gong
MAPREDUCE-2217	The expire launching task should cover the UNASSIGNED task	Major	jobtracker	Scott Chen	Karthik Kambatla
MAPREDUCE-4909	TestKeyValueTextInputFormat fails with Open JDK 7 on Windows	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-4355	TestNameNodeMetrics.testCorruptBlock fails with open JDK7	Major	test	Brandon Li	Brandon Li
HDFS-4358	TestCheckpoint failure with JDK7	Major	test	Arpit Agarwal	Arpit Agarwal
MAPREDUCE-4904	TestMultipleLevelCaching failed in branch-1	Major	test	meng gong	Junping Du
HADOOP-9179	TestFileSystem fails with open JDK7	Major	.	Brandon Li	Brandon Li
MAPREDUCE-4916	TestTrackerDistributedCacheManager is flaky due to other badly written tests in branch-1	Major	.	Arun C Murthy	Xuan Gong
MAPREDUCE-4914	TestMiniMRDFSSort fails with openJDK7	Major	test	Brandon Li	Brandon Li
MAPREDUCE-4915	TestShuffleExceptionCount fails with open JDK7	Major	test	Brandon Li	Brandon Li
HDFS-4351	Fix BlockPlacementPolicyDefault#chooseTarget when avoiding stale nodes	Major	namenode	Andrew Wang	Andrew Wang
MAPREDUCE-4278	cannot run two local jobs in parallel from the same gateway.	Major	.	Araceli Henley	Sandy Ryza
HADOOP-9191	TestAccessControlList and TestJobHistoryConfig fail with JDK7	Major	test	Arpit Agarwal	Arpit Agarwal
MAPREDUCE-4850	Job recovery may fail if staging directory has been deleted	Major	mrv1	Tom White	Tom White
MAPREDUCE-4930	Backport MAPREDUCE-4678 and MAPREDUCE-4925 to branch-1	Major	examples	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-4924	flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR	Trivial	mrv1	Robert Kanter	Robert Kanter
MAPREDUCE-4315	jobhistory.jsp throws 500 when a .txt file is found in /done	Major	jobhistoryserver	Alexander Alten-Lorenz	Sandy Ryza
MAPREDUCE-4923	Add toString method to TaggedInputSplit	Minor	mrv1, mrv2, task	Sandy Ryza	Sandy Ryza
HADOOP-8580	ant compile-native fails with automake version 1.11.3	Major	.	Eugene Koontz
MAPREDUCE-4929	mapreduce.task.timeout is ignored	Major	mrv1	Sandy Ryza	Sandy Ryza
MAPREDUCE-4963	StatisticsCollector improperly keeps track of "Last Day" and "Last Hour" statistics for new TaskTrackers	Major	mrv1	Robert Kanter	Robert Kanter
MAPREDUCE-4962	jobdetails.jsp uses display name instead of real name to get counters	Major	jobtracker, mrv1	Sandy Ryza	Sandy Ryza
HDFS-4444	Add space between total transaction time and number of transactions in FSEditLog#printStatistics	Trivial	.	Stephen Chu	Stephen Chu
MAPREDUCE-2264	Job status exceeds 100% in some cases	Major	jobtracker	Adam Kramer	Devaraj K
MAPREDUCE-4969	TestKeyValueTextInputFormat test fails with Open JDK 7	Major	test	Arpit Agarwal	Arpit Agarwal
MAPREDUCE-4843	When using DefaultTaskController, JobLocalizer not thread safe	Critical	tasktracker	yunjiong zhao	Karthik Kambatla
MAPREDUCE-4967	TestJvmReuse fails on assertion	Major	tasktracker, test	Chris Nauroth	Karthik Kambatla
MAPREDUCE-4434	Backport MR-2779 (JobSplitWriter.java can't handle large job.split file) to branch-1	Major	mrv1	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-4970	Child tasks (try to) create security audit log files	Major	.	Sandy Ryza	Sandy Ryza
HADOOP-9124	SortedMapWritable violates contract of Map interface for equals() and hashCode()	Minor	io	Patrick Hunt	Surenkumar Nihalani
HDFS-4466	Remove the deadlock from AbstractDelegationTokenSecretManager	Major	namenode, security	Brandon Li	Brandon Li
HADOOP-9154	SortedMapWritable#putAll() doesn't add key/value classes to the map	Major	io	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-4643	Make job-history cleanup-period configurable	Major	jobhistoryserver	Karthik Kambatla	Sandy Ryza
HDFS-4222	NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues	Minor	namenode	Xiaobo Peng	Xiaobo Peng
HDFS-4479	logSync() with the FSNamesystem lock held in commitBlockSynchronization	Major	.	Jing Zhao	Jing Zhao
HADOOP-8917	add LOCALE.US to toLowerCase in SecurityUtil.replacePattern	Major	.	Arpit Gupta	Arpit Gupta
MAPREDUCE-5008	Merger progress miscounts with respect to EOF_MARKER	Major	.	Sandy Ryza	Sandy Ryza
MAPREDUCE-5035	Update MR1 memory configuration docs	Major	mrv1	Tom White	Tom White
MAPREDUCE-4933	MR1 final merge asks for length of file it just wrote before flushing it	Major	mrv1, task	Sandy Ryza	Sandy Ryza
HDFS-4518	Finer grained metrics for HDFS capacity	Major	.	Arpit Agarwal	Arpit Agarwal
HADOOP-9349	Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another	Major	tools	Sandy Ryza	Sandy Ryza
HDFS-4519	Support override of jsvc binary and log file locations when launching secure datanode.	Major	datanode, scripts	Chris Nauroth	Chris Nauroth
HDFS-4544	Error in deleting blocks should not do check disk, for all types of errors	Major	.	Amareshwari Sriramadasu	Arpit Agarwal
MAPREDUCE-5049	CombineFileInputFormat counts all compressed files non-splitable	Major	.	Sandy Ryza	Sandy Ryza
HADOOP-9369	DNS#reverseDns() can return hostname with . appended at the end	Major	net	Karthik Kambatla	Karthik Kambatla
HDFS-4558	start balancer failed with NPE	Critical	balancer & mover	Wenwu Peng	Junping Du
HADOOP-9099	NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address	Minor	test	Ivan Mitic	Ivan Mitic
HADOOP-9451	Node with one topology layer should be handled as fault topology when NodeGroup layer is enabled	Major	net	Junping Du	Junping Du
MAPREDUCE-4463	JobTracker recovery fails with HDFS permission issue	Blocker	mrv1	Tom White	Tom White
MAPREDUCE-5131	Provide better handling of job status related apis during JT restart	Major	.	Arun C Murthy	Arun C Murthy
HDFS-4413	Secondary namenode won't start if HDFS isn't the default file system	Major	namenode	Mostafa Elhemali	Mostafa Elhemali
HADOOP-9467	Metrics2 record filtering (.record.filter.include/exclude) does not filter by name	Major	metrics	Chris Nauroth	Chris Nauroth
MAPREDUCE-5066	JobTracker should set a timeout when calling into job.end.notification.url	Major	.	Ivan Mitic	Ivan Mitic
HADOOP-9473	typo in FileUtil copy() method	Trivial	fs	Glen Mazza
HDFS-4715	Backport HDFS-3577 and other related WebHDFS issue to branch-1	Major	webhdfs	Tsz Wo Nicholas Sze	Mark Wagner
HADOOP-9492	Fix the typo in testConf.xml to make it consistent with FileUtil#copy()	Trivial	test	Jing Zhao	Jing Zhao
MAPREDUCE-5169	Job recovery fails if job tracker is restarted after the job is submitted but before its initialized	Major	.	Arpit Gupta	Arun C Murthy
HADOOP-9458	In branch-1, RPC.getProxy(..) may call proxy.getProtocolVersion(..) without retry	Critical	ipc	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-9502	chmod does not return error exit codes for some exceptions	Minor	fs	Ramya Sunil	Tsz Wo Nicholas Sze
MAPREDUCE-5166	ConcurrentModificationException in LocalJobRunner	Blocker	.	Gunther Hagleitner	Sandy Ryza
MAPREDUCE-5158	Cleanup required when mapreduce.job.restart.recover is set to false	Major	jobtracker	Yesha Vora	Mayank Bansal
MAPREDUCE-5198	Race condition in cleanup during task tracker renint with LinuxTaskController	Major	tasktracker	Arpit Gupta	Arpit Gupta
MAPREDUCE-5154	staging directory deletion fails because delegation tokens have been cancelled	Major	jobtracker	Sandy Ryza	Sandy Ryza
MAPREDUCE-5202	Revert MAPREDUCE-4397 to avoid using incorrect config files	Major	.	Owen O'Malley	Owen O'Malley
HADOOP-9537	Backport AIX patches to branch-1	Major	security	Arpit Agarwal	Arpit Agarwal
HADOOP-9543	TestFsShellReturnCode may fail in branch-1	Minor	test	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-9544	backport UTF8 encoding fixes to branch-1	Major	io	Chris Nauroth	Chris Nauroth
HADOOP-9375	Port HADOOP-7290 to branch-1 to fix TestUserGroupInformation failure	Trivial	test	Xiaobo Peng	Suresh Srinivas
HDFS-4240	In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup	Major	namenode	Junping Du	Junping Du
HDFS-3499	Make NetworkTopology support user specified topology class	Major	datanode	Junping Du	Junping Du
MAPREDUCE-5028	Maps fail when io.sort.mb is set to high value	Critical	.	Karthik Kambatla	Karthik Kambatla

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-9174	TestSecurityUtil fails on Open JDK 7	Major	test	Arpit Agarwal	Arpit Agarwal
HADOOP-9175	TestWritableName fails with Open JDK 7	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-4256	Backport concatenation of files into a single file to branch-1	Major	namenode	Suresh Srinivas	Sanjay Radia

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-7754	Expose file descriptors from Hadoop-wrapped local FileSystems	Major	native, performance	Todd Lipcon	Todd Lipcon
HDFS-3912	Detecting and avoiding stale datanodes for writing	Major	.	Jing Zhao	Jing Zhao
HDFS-4071	Add number of stale DataNodes to metrics for Branch-1	Minor	datanode, namenode	Jing Zhao	Jing Zhao
HADOOP-8817	Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1	Major	.	Junping Du	Junping Du
HADOOP-8469	Make NetworkTopology class pluggable	Major	.	Junping Du	Junping Du
HADOOP-8470	Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup)	Major	.	Junping Du	Junping Du