Apache Hadoop Changelog

Release 0.20.2 - 2010-02-16

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-793	DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet	Blocker	datanode	Hairong Kuang	Hairong Kuang

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-623	Resolve javac warnings in mapred	Major	build	Jothi Padmanabhan	Jothi Padmanabhan
HADOOP-1849	IPC server max queue size should be configurable	Major	ipc	Raghu Angadi	Konstantin Shvachko

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-5759	IllegalArgumentException when CombineFileInputFormat is used as job InputFormat	Major	.	Amareshwari Sriramadasu	Amareshwari Sriramadasu
MAPREDUCE-826	harchive doesn't use ToolRunner / harchive returns 0 even if the job fails with exception	Trivial	harchive	Koji Noguchi	Koji Noguchi
MAPREDUCE-112	Reduce Input Records and Reduce Output Records counters are not being set when using the new Mapreduce reducer API	Blocker	.	Jothi Padmanabhan	Jothi Padmanabhan
HADOOP-6231	Allow caching of filesystem instances to be disabled on a per-instance basis	Major	fs	Tom White	Ben Slusky
MAPREDUCE-979	JobConf.getMemoryFor{Map\|Reduce}Task doesn't fallback to newer config knobs when mapred.taskmaxvmem is set to DISABLED_MEMORY_LIMIT of -1	Blocker	jobtracker, tasktracker	Arun C Murthy	Sreekanth Ramakrishnan
HDFS-677	Rename failure due to quota results in deletion of src directory	Blocker	namenode	Suresh Srinivas	Suresh Srinivas
HDFS-579	HADOOP-3792 update of DfsTask incomplete	Major	hdfs-client	Christian Kunz	Christian Kunz
MAPREDUCE-1070	Deadlock in FairSchedulerServlet	Major	.	Todd Lipcon	Todd Lipcon
HADOOP-6097	Multiple bugs w/ Hadoop archives	Major	fs	Ben Slusky	Ben Slusky
HDFS-723	Deadlock in DFSClient#DFSOutputStream	Blocker	.	Hairong Kuang	Hairong Kuang
HDFS-732	HDFS files are ending up truncated	Blocker	hdfs-client	Christian Kunz	Tsz Wo Nicholas Sze
MAPREDUCE-1163	hdfsJniHelper.h: Yahoo! specific paths are encoded	Trivial	.	Allen Wittenauer	Allen Wittenauer
HDFS-761	Failure to process rename operation from edits log due to quota verification	Major	namenode	Suresh Srinivas	Suresh Srinivas
MAPREDUCE-1068	In hadoop-0.20.0 streaming job do not throw proper verbose error message if file is not present	Major	contrib/streaming	Peeyush Bishnoi	Amareshwari Sriramadasu
HDFS-596	Memory leak in libhdfs: hdfsFreeFileInfo() in libhdfs does not free memory for mOwner and mGroup	Blocker	fuse-dfs	Zhang Bingjun	Zhang Bingjun
MAPREDUCE-1147	Map output records counter missing for map-only jobs in new API	Blocker	.	Chris Douglas	Amar Kamat
HADOOP-6269	Missing synchronization for defaultResources in Configuration.addResource	Major	conf	Todd Lipcon	Sreekanth Ramakrishnan
MAPREDUCE-1182	Reducers fail with OutOfMemoryError while copying Map outputs	Blocker	.	Chandra Prakash Bhagtani	Chandra Prakash Bhagtani
HDFS-781	Metrics PendingDeletionBlocks is not decremented	Blocker	namenode	Suresh Srinivas	Suresh Srinivas
HDFS-185	Chown , chgrp , chmod operations allowed when namenode is in safemode .	Major	.	Ravi Phulari	Ravi Phulari
HADOOP-6428	HttpServer sleeps with negative values	Major	.	Tsz Wo Nicholas Sze	Konstantin Boudnik
HDFS-101	DFS write pipeline : DFSClient sometimes does not detect second datanode failure	Blocker	datanode	Raghu Angadi	Hairong Kuang
HADOOP-6460	Namenode runs of out of memory due to memory leak in ipc Server	Blocker	.	Suresh Srinivas	Suresh Srinivas
HADOOP-5623	Streaming: process provided status messages are overwritten every 10 seoncds	Major	.	Rick Cox	Rick Cox
HADOOP-6315	GzipCodec should not represent BuiltInZlibInflater as decompressorType	Major	io	Aaron Kimball	Aaron Kimball
HDFS-187	TestStartup fails if hdfs is running in the same machine	Major	test	Tsz Wo Nicholas Sze	Todd Lipcon
HDFS-745	TestFsck timeout on 0.20.	Major	.	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
MAPREDUCE-433	TestReduceFetch failed.	Major	.	Tsz Wo Nicholas Sze	Chris Douglas
HADOOP-6498	IPC client bug may cause rpc call hang	Blocker	ipc	Ruyue Ma	Ruyue Ma
HDFS-872	DFSClient 0.20.1 is incompatible with HDFS 0.20.2	Major	datanode, hdfs-client	Bassam Tabbara	Todd Lipcon
MAPREDUCE-1010	Adding tests for changes in archives.	Minor	harchive	Mahadev konar	Mahadev konar
HADOOP-6506	Failing tests prevent the rest of test targets from execution.	Major	build	Konstantin Boudnik	Konstantin Boudnik
HADOOP-6524	Contrib tests are failing Clover'ed build	Major	build	Konstantin Boudnik	Konstantin Boudnik
HDFS-927	DFSInputStream retries too many times for new block locations	Critical	hdfs-client	Todd Lipcon	Todd Lipcon
HADOOP-5611	C++ libraries do not build on Debian Lenny	Critical	.	Todd Lipcon	Todd Lipcon
MAPREDUCE-1251	c++ utils doesn't compile	Major	.	Eli Collins	Eli Collins
HADOOP-5612	Some c++ scripts are not chmodded before ant execution	Major	build	Todd Lipcon	Todd Lipcon
HADOOP-6575	Tests do not run on 0.20 branch	Major	.	Chris Douglas	Chris Douglas
HADOOP-6576	TestStreamingStatus is failing on 0.20 branch	Major	.	Chris Douglas	Todd Lipcon
MAPREDUCE-617	Streaming should not throw java.lang.RuntimeException and ERROR while displaying help	Minor	contrib/streaming	Karam Singh

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-919	Create test to validate the BlocksVerified metric	Major	test	gary murry
HDFS-907	Add tests for getBlockLocations and totalLoad metrics.	Minor	namenode	Ravi Phulari	Ravi Phulari