<!--- # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License"); you may not use this file except in compliance # with the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. -->

Apache Hadoop Changelog

Release 0.21.1 - Unreleased (as of 2018-09-01)

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-1905	Context.setStatus() and progress() api are ignored	Blocker	task	Amareshwari Sriramadasu	Amareshwari Sriramadasu

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-2040	Forrest Documentation for Dynamic Priority Scheduler	Minor	contrib/dynamic-scheduler	Thomas Sandholm	Thomas Sandholm

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-1501	FileInputFormat to support multi-level/recursive directory listing	Major	.	Zheng Shao	Zheng Shao
HADOOP-6786	test-patch needs to verify Herriot integrity	Major	build	Konstantin Boudnik	Konstantin Boudnik
HDFS-1343	Instrumented build should be concentrated in one build area	Minor	build	Konstantin Boudnik	Konstantin Boudnik
MAPREDUCE-2140	Re-generate fair scheduler design doc PDF	Trivial	.	Matei Zaharia	Matei Zaharia
HADOOP-7177	CodecPool should report which compressor it is using	Trivial	native	Allen Wittenauer	Allen Wittenauer
HDFS-1596	Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml	Major	documentation, namenode	Patrick Angeles	Harsh J
HADOOP-7117	Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xml	Major	conf	Patrick Angeles	Harsh J
HADOOP-7193	Help message is wrong for touchz command.	Minor	fs	Uma Maheswara Rao G	Uma Maheswara Rao G

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-6925	BZip2Codec incorrectly implements read()	Critical	io	Todd Lipcon	Todd Lipcon
HADOOP-6833	IPC leaks call parameters when exceptions thrown	Blocker	.	Todd Lipcon	Todd Lipcon
MAPREDUCE-1897	trunk build broken on compile-mapred-test	Major	test	Greg Roelofs	Konstantin Boudnik
MAPREDUCE-2032	TestJobOutputCommitter fails in ant test run	Major	task	Amareshwari Sriramadasu	Dick King
HDFS-1363	startFileInternal should return the last block of the file opened for append as an under-construction block	Major	.	Konstantin Shvachko	Konstantin Shvachko
HDFS-1411	The startup command of the Backup Node is "bin/hdfs namenode -backup"	Minor	documentation	Ching-Shen Chen	Ching-Shen Chen
MAPREDUCE-1280	Eclipse Plugin does not work with Eclipse Ganymede (3.4)	Major	.	Aaron Kimball	Alex Kozlov
HDFS-1413	Broken links to HDFS Wiki in hdfs site and documentation.	Major	documentation	Konstantin Shvachko	Konstantin Shvachko
MAPREDUCE-1984	herriot TestCluster fails because exclusion is not there	Major	.	Balaji Rajagopalan	Balaji Rajagopalan
HADOOP-6971	Clover build doesn't generate per-test coverage	Major	build, test	Konstantin Boudnik	Konstantin Boudnik
HDFS-1420	Clover build doesn't generate per-test coverage	Major	build, test	Konstantin Boudnik	Konstantin Boudnik
MAPREDUCE-2090	Clover build doesn't generate per-test coverage	Major	build, test	Konstantin Boudnik	Konstantin Boudnik
HADOOP-6969	CHANGES.txt does not reflect the release of version 0.21.0.	Major	.	Konstantin Shvachko	Tom White
HDFS-1416	CHANGES.txt does not reflect the release version 0.21.0.	Major	.	Konstantin Shvachko	Tom White
MAPREDUCE-2086	CHANGES.txt does not reflect the release of version 0.21.0.	Major	.	Konstantin Shvachko	Tom White
HADOOP-6993	Broken link on cluster setup page of docs	Major	documentation	Aaron T. Myers	Eli Collins
HDFS-1444	Test related code of build.xml is error-prone and needs to be re-aligned.	Minor	build	Konstantin Boudnik	Konstantin Boudnik
HDFS-1452	ant compile-contrib is broken	Major	contrib/hdfsproxy	Jakob Homan	Konstantin Boudnik
MAPREDUCE-2134	ant binary-system is broken in mapreduce project.	Major	build	Vinay Kumar Thota	Konstantin Boudnik
HDFS-1474	ant binary-system is broken	Major	build	Konstantin Boudnik	Konstantin Boudnik
HADOOP-6954	Sources JARs are not correctly published to the Maven repository	Major	build	Tom White	Tom White
HADOOP-7052	misspelling of threshold in conf/log4j.properties	Major	conf	Jingguo Yao	Jingguo Yao
HADOOP-7053	wrong FSNamesystem Audit logging setting in conf/log4j.properties	Minor	conf	Jingguo Yao	Jingguo Yao
HDFS-1377	Quota bug for partial blocks allows quotas to be violated	Blocker	namenode	Eli Collins	Eli Collins
HDFS-1206	TestFiHFlush fails intermittently	Major	test	Tsz Wo Nicholas Sze	Konstantin Boudnik
MAPREDUCE-2223	TestMRCLI might fail on Ubuntu with default /etc/hosts	Minor	test	Konstantin Boudnik	Konstantin Boudnik
HDFS-1548	Fault-injection tests are executed multiple times if invoked with run-test-hdfs-fault-inject target	Major	build, test	Konstantin Boudnik	Konstantin Boudnik
HDFS-1552	Remove java5 dependencies from build	Major	build	Konstantin Boudnik	Konstantin Boudnik
MAPREDUCE-2228	Remove java5 dependencies from build	Major	build	Konstantin Boudnik	Konstantin Boudnik
MAPREDUCE-1929	Allow artifacts to be published to the staging Apache Nexus Maven Repository	Blocker	build	Tom White	Tom White
HDFS-996	JUnit tests should never depend on anything in conf	Blocker	test	Konstantin Boudnik	Konstantin Boudnik
HADOOP-7120	200 new Findbugs warnings	Major	test	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-1598	ListPathsServlet excludes .*.crc files	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-1612	HDFS Design Documentation is outdated	Minor	documentation	Joe Crobak	Joe Crobak
HADOOP-7162	FsShell: call srcFs.listStatus(src) twice	Minor	fs	Alexey Diomin	Alexey Diomin
HDFS-1665	Balancer sleeps inadequately	Minor	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-1728	SecondaryNameNode.checkpointSize is in byte but not MB.	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-1750	fs -ls hftp://file not working	Major	.	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-7174	null is displayed in the console,if the src path is invalid while doing copyToLocal operation from commandLine	Minor	fs	Uma Maheswara Rao G	Uma Maheswara Rao G
HADOOP-7194	Potential Resource leak in IOUtils.java	Major	io	Devaraj K	Devaraj K
HADOOP-7019	Refactor build targets to enable faster cross project dev cycles.	Major	build	Owen O'Malley	Luke Lu
HDFS-1189	Quota counts missed between clear quota and set quota	Major	namenode	Kang Xiao	John George
MAPREDUCE-2317	HadoopArchives throwing NullPointerException while creating hadoop archives (.har files)	Minor	harchive	Devaraj K	Devaraj K
HADOOP-7183	WritableComparator.get should not cache comparator objects	Blocker	.	Todd Lipcon	Tom White
HADOOP-7215	RPC clients must connect over a network interface corresponding to the host name in the client's kerberos principal key	Blocker	security	Suresh Srinivas	Suresh Srinivas

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-6934	test for ByteWritable comparator	Major	record	Johannes Zillmann	Johannes Zillmann

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-7072	Remove java5 dependencies from build	Major	build	Konstantin Boudnik	Konstantin Boudnik

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-6944	[Herriot] Implement a functionality for getting proxy users definitions like groups and hosts.	Major	test	Vinay Kumar Thota	Vinay Kumar Thota
MAPREDUCE-1809	Ant build changes for Streaming system tests in contrib projects.	Major	build	Vinay Kumar Thota	Vinay Kumar Thota