Back to Hadoop

Licensed to the Apache Software Foundation (ASF) under one

hadoop-common-project/hadoop-common/src/site/markdown/release/2.9.0/CHANGELOG.2.9.0.md

2.0.5-alpha-rc2353.1 KB
Original Source
<!--- # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License"); you may not use this file except in compliance # with the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. -->

Apache Hadoop Changelog

Release 2.9.0 - 2017-11-17

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
YARN-4784Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFOMajorfairschedulerYufei GuYufei Gu
HADOOP-13588ConfServlet should respect Accept request headerMajorconfWeiwei YangWeiwei Yang
MAPREDUCE-6776yarn.app.mapreduce.client.job.max-retries should have a more useful defaultMajorclientDaniel TempletonMiklos Szegedi
YARN-5388Deprecate and remove DockerContainerExecutorCriticalnodemanagerDaniel TempletonDaniel Templeton
HADOOP-12705Upgrade Jackson 2.2.3 to 2.7.8MajorbuildSteve LoughranSean Mackrory
HADOOP-13050Upgrade to AWS SDK 1.11.45Blockerbuild, fs/s3Steve LoughranSteve Loughran
HADOOP-13119Add ability to secure log servlet using proxy usersMajor.Jeffrey E RodriguezYuanbo Liu
HADOOP-14174Set default ADLS access token provider type to ClientCredentialMajorfs/adlJohn ZhugeJohn Zhuge
HDFS-11402HDFS Snapshots should capture point-in-time copies of OPEN filesMajorhdfsManoj GovindassamyManoj Govindassamy
YARN-2962ZKRMStateStore: Limit the number of znodes under a znodeCriticalresourcemanagerKarthik KambatlaVarun Saxena
HADOOP-14419Remove findbugs report from docs profileMinor.Andras BokorAndras Bokor
YARN-6127Add support for work preserving NM restart when AMRMProxy is enabledMajoramrmproxy, nodemanagerSubru KrishnanBotong Huang
HADOOP-14539Move commons logging APIs over to slf4j in hadoop-commonMajor.Akira AjisakaWenxin He
HADOOP-14260Configuration.dumpConfiguration should redact sensitive informationMajorconf, securityVihang KarajgaonkarJohn Zhuge
YARN-6623Add support to turn off launching privileged containers in the container-executorBlockernodemanagerVarun VasudevVarun Vasudev
YARN-5049Extend NMStateStore to save queued container informationMajornodemanager, resourcemanagerKonstantinos KaranasosArun Suresh

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-12321Make JvmPauseMonitor an AbstractServiceMajor.Steve LoughranSunil Govindan
HDFS-9525hadoop utilities need to support provided delegation tokensBlockersecurityAllen WittenauerHeesoo Kim
HADOOP-12702Add an HDFS metrics sinkMajormetricsDaniel TempletonDaniel Templeton
HADOOP-12847hadoop daemonlog should support https and SPNEGO for Kerberized clusterMajorsecurityWei-Chiu ChuangWei-Chiu Chuang
YARN-2928YARN Timeline Service v.2: alpha 1CriticaltimelineserverSangjin LeeSangjin Lee
MAPREDUCE-6331[Umbrella] Make MapReduce work with Timeline Service Nextgen (YARN-2928)Major.Vinod Kumar VavilapalliSangjin Lee
HADOOP-12747support wildcard in libjars argumentMajorutilSangjin LeeSangjin Lee
MAPREDUCE-6690Limit the number of resources a single map reduce job can submit for localizationMajor.Chris TrezzoChris Trezzo
HADOOP-13396Allow pluggable audit loggers in KMSMajorkmsXiao ChenXiao Chen
HDFS-9820Improve distcp to support efficient restore to an earlier snapshotMajordistcpYongjun ZhangYongjun Zhang
YARN-4597Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycleMajornodemanagerChris DouglasArun Suresh
HADOOP-13578Add Codec for ZStandard CompressionMajor.churro moraleschurro morales
HADOOP-13933Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagersMajortoolsSurendra Singh LilhoreSurendra Singh Lilhore
YARN-5910Support for multi-cluster delegation tokensMinorsecurityClay B.Jian He
YARN-5864YARN Capacity Scheduler - Queue PrioritiesMajor.Wangda TanWangda Tan
HDFS-11194Maintain aggregated peer performance metrics on NameNodeMajornamenodeXiaobing ZhouArpit Agarwal
MAPREDUCE-6871Allow users to specify racks and nodes for strict locality for AMsMajorclientRobert KanterRobert Kanter
HDFS-11417Add datanode admin command to get the storage info.Major.Surendra Singh LilhoreSurendra Singh Lilhore
YARN-679add an entry point that can start any Yarn serviceMajorapiSteve LoughranSteve Loughran
HDFS-10480Add an admin command to list currently open filesMajor.Kihwal LeeManoj Govindassamy
YARN-4161Capacity Scheduler : Assign single or multiple containers per heart beat driven by configurationMajorcapacity schedulerMayank BansalWei Yan
YARN-5355YARN Timeline Service v.2: alpha 2CriticaltimelineserverSangjin LeeVrushali C
HADOOP-13345S3Guard: Improved Consistency for S3AMajorfs/s3Chris NaurothChris Nauroth
HDFS-7877[Umbrella] Support maintenance state for datanodesMajordatanode, namenodeMing MaMing Ma
YARN-2915Enable YARN RM scale out via federation using multiple RM'sMajornodemanager, resourcemanagerSriram RaoSubru Krishnan
YARN-1492truly shared cache for jars (jobjar/libjar)Major.Sangjin LeeChris Trezzo
HDFS-10467Router-based HDFS federationMajorfsÍñigo GoiriÍñigo Goiri
YARN-5734OrgQueue for easy CapacityScheduler queue configuration managementMajor.Min ShenMin Shen
MAPREDUCE-5951Add support for the YARN Shared CacheMajor.Chris TrezzoChris Trezzo
YARN-6871Add additional deSelects params in RMWebServices#getAppReportMajorresourcemanager, routerGiovanni Matteo FumarolaTanuj Nayak
MAPREDUCE-6732mapreduce tasks for YARN Timeline Service v.2: alpha 2Major.Sangjin LeeVrushali C
HADOOP-14840Tool to estimate resource requirements of an application pipeline based on prior executionsMajortoolsSubru KrishnanRui Li
YARN-3813Support Application timeout feature in YARN.MajorschedulernijelRohith Sharma K S
YARN-2877Extend YARN to support distributed schedulingMajornodemanager, resourcemanagerSriram RaoKonstantinos Karanasos
YARN-5220Scheduling of OPPORTUNISTIC containers through YARN RMMajorresourcemanagerKonstantinos KaranasosKonstantinos Karanasos

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
YARN-2280Resource manager web service fields are not accessibleTrivialresourcemanagerKrisztian HorvathKrisztian Horvath
HDFS-9267TestDiskError should get stored replicas through FsDatasetTestUtils.MinortestLei (Eddy) XuLei (Eddy) Xu
HDFS-9491Tests should get the number of pending async delets via FsDatasetTestUtilsMinortestTony WuTony Wu
HADOOP-12625Add a config to disable the /logs endpointsMajorsecurityRobert KanterRobert Kanter
YARN-4341add doc about timeline performance tool usageMajor.Chang LiChang Li
HDFS-9281Change TestDeleteBlockPool to not explicitly use File to check block pool existence.MinortestLei (Eddy) XuLei (Eddy) Xu
HDFS-8477describe dfs.ha.zkfc.port in hdfs-default.xmlMinor.Kanaka Kumar AvvaruKanaka Kumar Avvaru
HDFS-9350Avoid creating temprorary strings in Block.toString() and getBlockName()MinorperformanceStaffan FribergStaffan Friberg
HADOOP-12566Add NullGroupMappingMajor.Daniel TempletonDaniel Templeton
YARN-2934Improve handling of container's stderrCritical.Gera ShegalovNaganarasimha G R
HADOOP-12663Remove Hard-Coded Values From FileSystem.javaTrivialfsBELUGA BEHRBELUGA BEHR
HADOOP-12683Add number of samples in last interval in snapshot of MutableStatMinormetricsVikram SrivastavaVikram Srivastava
HADOOP-8887Use a Maven plugin to build the native code using CMakeMinorbuildColin P. McCabeColin P. McCabe
HADOOP-12713Disable spurious checkstyle checksMajor.Andrew WangAndrew Wang
HADOOP-12662The build should fail if a -Dbundle option failsMinor.Kai ZhengKai Zheng
HDFS-9576HTrace: collect position/length information on read operationsMajorhdfs-client, tracingZhe ZhangZhe Zhang
YARN-4603FairScheduler should mention user requested queuename in error message when failed in queue ACL checkTrivialfairschedulerTao JieTao Jie
HDFS-9674The HTrace span for OpWriteBlock should record the maxWriteToDisk timeMajordatanode, tracingColin P. McCabeColin P. McCabe
YARN-4496Improve HA ResourceManager Failover detection on the clientMajorclient, resourcemanagerArun SureshJian He
YARN-3542Re-factor support for CPU as a resource using the new ResourceHandler mechanismCriticalnodemanagerSidharta SeethanaVarun Vasudev
HDFS-9541Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GBMajorlibhdfsColin P. McCabeColin P. McCabe
YARN-4462FairScheduler: Disallow preemption from a queueMajorfairschedulerTao JieTao Jie
HDFS-9677Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStampMinornamenodeJing ZhaoMingliang Liu
MAPREDUCE-6431JobClient should be an AutoClosableMajor.André KelpeHaibo Chen
HDFS-7764DirectoryScanner shouldn't abort the scan if one directory had an errorMajordatanodeRakesh RRakesh R
YARN-4647Make RegisterNodeManagerRequestPBImpl thread-safeMajornodemanagerKarthik KambatlaKarthik Kambatla
YARN-4649Add additional logging to some NM state store operationsMinor.Sidharta SeethanaSidharta Seethana
HADOOP-12759RollingFileSystemSink should eagerly rotate directoriesCritical.Daniel TempletonDaniel Templeton
YARN-4628Display application priority in yarn topMinor.Bibin A ChundattBibin A Chundatt
YARN-4655Log uncaught exceptions/errors in various thread pools in YARNMajor.Sidharta SeethanaSidharta Seethana
HDFS-9637Tests for RollingFileSystemSinkMajortestDaniel TempletonDaniel Templeton
YARN-4569Remove incorrect part of maxResources in FairScheduler documentationMajordocumentationRay ChiangRay Chiang
MAPREDUCE-6634Log uncaught exceptions/errors in various thread pools in mapreduceMajor.Sidharta SeethanaSidharta Seethana
HADOOP-12817Enable TLS v1.1 and 1.2MajorsecurityRobert KanterRobert Kanter
MAPREDUCE-6627Add machine-readable output to mapred job -history commandMajorclientRobert KanterRobert Kanter
YARN-4708Missing default mapper type in TimelineServer performance test tool usageMinortimelineserverKai SasakiKai Sasaki
HADOOP-12829StatisticsDataReferenceCleaner swallows interrupt exceptionsMinorfsGregory ChananGregory Chanan
MAPREDUCE-6640mapred job -history command should be able to take Job IDMajorclientRobert KanterRobert Kanter
YARN-4697NM aggregation thread pool is not bound by limitsCriticalnodemanagerHaibo ChenHaibo Chen
YARN-4579Allow DefaultContainerExecutor container log directory permissions to be configurableMajoryarnRay ChiangRay Chiang
HADOOP-12841Update s3-related properties in core-default.xmlMinorfs/s3Wei-Chiu ChuangWei-Chiu Chuang
YARN-4718Rename variables in SchedulerNode to reduce ambiguity post YARN-1011MajorschedulerKarthik KambatlaÍñigo Goiri
HDFS-9521TransferFsImage.receiveFile should account and log separate times for image download and fsync to diskMinor.Wellington ChevreuilWellington Chevreuil
HADOOP-11404Clarify the "expected client Kerberos principal is null" authorization messageMinorsecurityStephen ChuStephen Chu
YARN-4719Add a helper library to maintain node state and allows common queriesMajorschedulerKarthik KambatlaKarthik Kambatla
HDFS-9928Make HDFS commands guide up to dateMajordocumentationWei-Chiu ChuangWei-Chiu Chuang
YARN-4560Make scheduler error checking message more user friendlyTrivialyarnRay ChiangRay Chiang
HDFS-9579Provide bytes-read-by-network-distance metrics at FileSystem.Statistics levelMajor.Ming MaMing Ma
YARN-4732*ProcessTree classes have too many whitespace issuesTrivial.Karthik KambatlaGabor Liptak
HADOOP-12952/BUILDING example of zero-docs dist should skip javadocsTrivialbuild, documentationSteve LoughranSteve Loughran
YARN-4436DistShell ApplicationMaster.ExecBatScripStringtPath is misspelledTrivialapplications/distributed-shellDaniel TempletonMatt LaMantia
YARN-4639Remove dead code in TestDelegationTokenRenewer added in YARN-3055TrivialresourcemanagerDaniel TempletonDaniel Templeton
YARN-4607Pagination support for AppAttempt page TotalOutstandingResource Requests tableMinor.Bibin A ChundattBibin A Chundatt
YARN-4769Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UIMajor.Varun VasudevVarun Vasudev
HADOOP-12984Add GenericTestUtils.getTestDir method and use it for temporary directory in testsMajorbuild, testSteve LoughranSteve Loughran
YARN-4541Change log message in LocalizedResource#handle() to DEBUGMinor.Ray ChiangRay Chiang
YARN-1297FairScheduler: Move some logs to debug and check if debug logging is enabledMajorfairschedulerSandy RyzaYufei Gu
YARN-5003Add container resource to RM audit logMajorresourcemanager, schedulerNathan RobertsNathan Roberts
HADOOP-13068Clean up RunJar and related test classTrivialutilAndras BokorAndras Bokor
YARN-4577Enable aux services to have their own custom classpath/jar fileMajor.Xuan GongXuan Gong
YARN-5053More informative diagnostics when applications killed by a userMajorresourcemanagerJason LoweEric Badger
MAPREDUCE-6686Add a way to download the job config from the mapred CLIMajorclientRobert KanterRobert Kanter
HADOOP-12782Faster LDAP group name resolution with ActiveDirectoryMajorsecurityWei-Chiu ChuangWei-Chiu Chuang
MAPREDUCE-6696Add a configuration to limit the number of map tasks allowed per job.Majorjob submissionzhihai xuzhihai xu
YARN-4878Expose scheduling policy and max running apps over JMX for Yarn queuesMajoryarnYufei GuYufei Gu
HDFS-9782RollingFileSystemSink should have configurable roll intervalMajor.Daniel TempletonDaniel Templeton
HADOOP-13160Suppress checkstyle JavadocPackage check for test sourceMinor.John ZhugeJohn Zhuge
YARN-4766NM should not aggregate logs older than the retention policyMajorlog-aggregation, nodemanagerHaibo ChenHaibo Chen
HADOOP-13197Add non-decayed call metrics for DecayRpcSchedulerMajoripc, metricsXiaoyu YaoXiaoyu Yao
HADOOP-12291Add support for nested groups in LdapGroupsMappingMajorsecurityGautam GopalakrishnanEsther Kundin
HDFS-7541Upgrade Domains in HDFSMajor.Ming MaMing Ma
HDFS-10256Use GenericTestUtils.getTestDir method in tests for temporary directoriesMajorbuild, testVinayakumar BVinayakumar B
YARN-5083YARN CLI for AM logs does not give any error message if entered invalid am valueMajoryarnSumana SathishJian He
YARN-5082Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limitMajor.sandfleesandflee
YARN-4958The file localization process should allow for wildcards to reduce the application footprint in the state storeCriticalnodemanagerDaniel TempletonDaniel Templeton
MAPREDUCE-6719The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state storeCriticaldistributed-cacheDaniel TempletonDaniel Templeton
MAPREDUCE-6721mapreduce.reduce.shuffle.memory.limit.percent=0.0 should be legal to enforce shuffle to diskMajormrv2, taskGera ShegalovGera Shegalov
HADOOP-13034Log message about input options in distcp lacks some itemsMinortools/distcpTakashi OhnishiTakashi Ohnishi
HDFS-10568Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriterMajorhdfs-clientYiqun LinYiqun Lin
HADOOP-13337Update maven-enforcer-plugin version to 1.4.1MajorbuildTsuyoshi OzawaTsuyoshi Ozawa
YARN-4568Fix message when NodeManager runs into errors initializing the recovery directoryMajoryarnRay ChiangRay Chiang
MAPREDUCE-6717Remove deprecated StringUtils.getFormattedTimeWithDiffMinor.Akira AjisakaShen Yinjie
HDFS-10387DataTransferProtocol#writeBlock missing some javadocsMinordatanode, hdfsYongjun ZhangJohn Zhuge
YARN-5339passing file to -out for YARN log CLI doesnt give warning or error codeMajor.Sumana SathishXuan Gong
YARN-5303Clean up ContainerExecutor JavaDocMinornodemanagerDaniel TempletonDaniel Templeton
MAPREDUCE-6652Add configuration property to prevent JHS from loading jobs with a task count greater than XMajorjobhistoryserverHaibo ChenHaibo Chen
YARN-5181ClusterNodeTracker: add method to get list of nodes matching a specific resourceNameMajorschedulerKarthik KambatlaKarthik Kambatla
YARN-4996Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic, or better yet parameterizedMinorresourcemanager, testDaniel TempletonKai Sasaki
MAPREDUCE-6365Refactor JobResourceUploader#uploadFilesInternalMinor.Chris TrezzoChris Trezzo
HADOOP-13354Update WASB driver to use the latest version (4.2.0) of SDK for Microsoft Azure Storage ClientsMajorfs/azureSivaguru SankaridurgSivaguru Sankaridurg
YARN-5460Change container runtime type logging in DelegatingLinuxContainerRuntime to debugTrivialyarnShane KumpfShane Kumpf
HADOOP-13458LoadBalancingKMSClientProvider#doOp should log IOException stacktraceTrivialkmsWei-Chiu ChuangChen Liang
MAPREDUCE-6748Enhance logging for Cluster.java around InetSocketAddressMinor.sarun singlaVrushali C
YARN-4910Fix incomplete log info in ResourceLocalizationServiceTrivial.Jun GongJun Gong
HADOOP-13380TestBasicDiskValidator should not write data to /tmpMinor.Lei (Eddy) XuYufei Gu
MAPREDUCE-6751Add debug log message when splitting is not possible due to unsplittable compressionMinorclient, mrv1, mrv2Peter VaryPeter Vary
YARN-5455Update Javadocs for LinuxContainerExecutorMajornodemanagerDaniel TempletonDaniel Templeton
YARN-4702FairScheduler: Allow setting maxResources for ad hoc queuesMajorfairschedulerKarthik KambatlaDaniel Templeton
HDFS-10645Make block report size as a metric and add this metric to datanode web uiMajordatanode, uiYuanbo LiuYuanbo Liu
YARN-4491yarn list command to support filtering by tagsMinorclientSteve LoughranVarun Saxena
HDFS-10784Implement WebHdfsFileSystem#listStatusIteratorMajorwebhdfsAndrew WangAndrew Wang
HDFS-10822Log DataNodes in the write pipelineTrivialhdfs-clientJohn ZhugeJohn Zhuge
YARN-5616Clean up WeightAdjusterMajorfairschedulerYufei GuYufei Gu
HDFS-10778Add -format option to make the output of FileDistribution processor human-readable in OfflineImageViewerMajortoolsYiqun LinYiqun Lin
HDFS-10847Complete the document for FileDistribution processor in OfflineImageViewerMinordocumentationYiqun LinYiqun Lin
HDFS-10837Standardize serializiation of WebHDFS DirectoryListingMajorwebhdfsAndrew WangAndrew Wang
HADOOP-13411Checkstyle suppression by annotation or commentMinor.John ZhugeJohn Zhuge
HADOOP-13412Move dev-support/checkstyle/suppressions.xml to hadoop-build-toolsTrivial.John ZhugeJohn Zhuge
HDFS-10823Implement HttpFSFileSystem#listStatusIteratorMajorhttpfsAndrew WangAndrew Wang
MAPREDUCE-6632Master.getMasterAddress() should be updated to use YARN-4629MinorapplicationmasterDaniel TempletonDaniel Templeton
YARN-5400Light cleanup in ZKRMStateStoreTrivialresourcemanagerDaniel TempletonDaniel Templeton
MAPREDUCE-6718add progress log to JHS during startupMinorjobhistoryserverHaibo ChenHaibo Chen
MAPREDUCE-6638Do not attempt to recover progress from previous job attempts if spill encryption is enabledMajorapplicationmasterKarthik KambatlaHaibo Chen
HADOOP-13628Support to retrieve specific property from configuration via REST APIMajorconfWeiwei YangWeiwei Yang
HDFS-10683Make class Token$PrivateToken privateMinor.John ZhugeJohn Zhuge
HADOOP-13688Stop bundling HTML source code in javadoc JARsMajorbuildAndrew WangAndrew Wang
YARN-5551Ignore file backed pages from memory computation when smaps is enabledMinor.Rajesh BalamohanRajesh Balamohan
YARN-5466DefaultContainerExecutor needs JavaDocsMinornodemanagerDaniel TempletonDaniel Templeton
HADOOP-13522Add %A and %a formats for fs -stat command to print permissionsMajorfsAlex GarbariniAlex Garbarini
HADOOP-13737Cleanup DiskChecker interfaceMajorutilArpit AgarwalArpit Agarwal
HADOOP-13702Add a new instrumented read-write lockMajorcommonJingcheng DuJingcheng Du
MAPREDUCE-6792Allow user's full principal name as owner of MapReduce staging directory in JobSubmissionFiles#JobStagingDir()MajorclientSanthosh G NayakSanthosh G Nayak
YARN-5575Many classes use bare yarn. properties instead of the defined constantsMajor.Daniel TempletonDaniel Templeton
HDFS-11049The description of dfs.block.replicator.classname is not clearMinordocumentationYiqun LinYiqun Lin
HDFS-11069Tighten the authorization of datanode RPCMajordatanode, securityKihwal LeeKihwal Lee
YARN-4456Clean up Lint warnings in nodemanagerMinornodemanagerDaniel TempletonDaniel Templeton
YARN-4668Reuse objectMapper instance in YarnMajortimelineclientYiqun LinYiqun Lin
YARN-4907Make all MockRM#waitForState consistent.MajorresourcemanagerYufei GuYufei Gu
YARN-4396Log the trace information on FSAppAttempt#assignContainerMajorapplications, fairschedulerYiqun LinYiqun Lin
HDFS-11088Quash unnecessary safemode WARN message during NameNode startupTrivial.Andrew WangYiqun Lin
YARN-4998Minor cleanup to UGI use in AdminServiceTrivialresourcemanagerDaniel TempletonDaniel Templeton
HDFS-10756Expose getTrashRoot to HTTPFS and WebHDFSMajorencryption, httpfs, webhdfsXiao ChenYuanbo Liu
YARN-5356NodeManager should communicate physical resource capability to ResourceManagerMajornodemanager, resourcemanagerNathan RobertsÍñigo Goiri
HADOOP-13802Make generic options help more consistent, and alignedMinor.Grant SohnGrant Sohn
HDFS-9482Replace DatanodeInfo constructors with a builder patternMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-13687Provide a unified dependency artifact that transitively includes the cloud storage modules shipped with Hadoop.MajorbuildChris NaurothChris Nauroth
YARN-5552Add Builder methods for common yarn API recordsMajor.Arun SureshTao Jie
YARN-4033In FairScheduler, parent queues should also display queue statusMajorfairschedulerSiqi LiSiqi Li
HADOOP-13427Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}MajorfsSteve LoughranMingliang Liu
YARN-5375invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failuresMajorresourcemanagersandfleesandflee
YARN-5722FairScheduler hides group resolution exceptions when assigning queueMajorfairschedulerWilfred SpiegelenburgWilfred Spiegelenburg
HADOOP-11552Allow handoff on the server side for RPC requestsMajoripcSiddharth SethSiddharth Seth
HADOOP-13605Clean up FileSystem javadocs, logging; improve diagnostics on FS loadMajorfsSteve LoughranSteve Loughran
HADOOP-13018Make Kdiag check whether hadoop.token.files points to existent and valid filesMajor.Ravi PrakashRavi Prakash
YARN-5890FairScheduler should log information about AM-resource-usage and max-AM-share for queuesMajorfairschedulerYufei GuYufei Gu
HDFS-7588Improve the HDFS Web UI browser to allow chowning / chmoding, creating dirs and uploading filesMajorui, webhdfsRavi PrakashRavi Prakash
YARN-4997Update fair scheduler to use pluggable auth providerMajorfairschedulerDaniel TempletonTao Jie
MAPREDUCE-6787Allow job_conf.xml to be downloadable on the job overview page in JHSMajorjobhistoryserverHaibo ChenHaibo Chen
HDFS-11211Add a time unit to the DataNode client trace formatMinordatanodeAkira AjisakaJagadesh Kiran N
HDFS-10206Datanodes not sorted properly by distance when the reader isn't a datanodeMajor.Ming MaNanda kumar
HADOOP-13709Ability to clean up subprocesses spawned by Shell when the process exitsMajor.Eric BadgerEric Badger
HDFS-10930Refactor: Wrap Datanode IO related operationsMajordatanodeXiaoyu YaoXiaoyu Yao
HDFS-10959Adding per disk IO statistics and metrics in DataNode.MajordatanodeXiaoyu YaoXiaoyu Yao
HDFS-10913Introduce fault injectors to simulate slow mirrorsMajordatanode, testXiaobing ZhouXiaobing Zhou
HADOOP-13911Remove TRUSTSTORE_PASSWORD related scripts from KMSMinorkmsXiao ChenJohn Zhuge
HADOOP-13863Azure: Add a new SAS key mode for WASB.Majorfs/azureDushyanthDushyanth
HDFS-10917Collect peer performance statistics on DataNode.MajordatanodeXiaobing ZhouXiaobing Zhou
YARN-5969FairShareComparator: Cache value of getResourceUsage for better performanceMajorfairschedulerzhangshilongzhangshilong
HDFS-11279Cleanup unused DataNode#checkDiskErrorAsync()Minor.Xiaoyu YaoHanisha Koneru
YARN-6015AsyncDispatcher thread name can be set to improved debuggingMajor.Ajith SAjith S
HADOOP-13953Make FTPFileSystem's data connection mode and transfer mode configurableMajorfsXiao ChenXiao Chen
HDFS-11299Support multiple Datanode File IO hooksMajorhdfsHanisha KoneruHanisha Koneru
YARN-5849Automatically create YARN control group for pre-mounted cgroupsMinor.Miklos SzegediMiklos Szegedi
HDFS-11339Support File IO sampling for Datanode IO profiling hooksMajordatanodeHanisha KoneruHanisha Koneru
HDFS-11274Datanode should only check the failed volume upon IO errorsMajordatanodeXiaoyu YaoXiaoyu Yao
HDFS-11306Print remaining edit logs from buffer if edit log can't be rolled.Majorha, namenodeWei-Chiu ChuangWei-Chiu Chuang
HADOOP-13496Include file lengths in Mismatch in length error for distcpMinor.Ted YuTed Yu
YARN-6028Add document for container metricsMajordocumentation, nodemanagerWeiwei YangWeiwei Yang
MAPREDUCE-6728Give fetchers hint when ShuffleHandler rejects a shuffling connectionMajormrv2Haibo ChenHaibo Chen
HDFS-10534NameNode WebUI should display DataNode usage histogramMajornamenode, uiZhe ZhangKai Sasaki
HADOOP-14003Make additional KMS tomcat settings configurableMajorkmsAndrew WangAndrew Wang
HDFS-11374Skip FSync in Test util CreateEditsLog to speed up edit log generationMinorhdfsHanisha KoneruHanisha Koneru
HDFS-9884Use doxia macro to generate in-page TOC of HDFS site documentationMajordocumentationMasatake IwasakiMasatake Iwasaki
YARN-6131FairScheduler: Lower update interval for faster testsMajorfairschedulerKarthik KambatlaKarthik Kambatla
YARN-6106Document FairScheduler 'allowPreemptionFrom' queue propertyMinorfairschedulerYufei GuYufei Gu
YARN-4658Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler commentMajor.Daniel TempletonUdai Kiran Potluri
MAPREDUCE-6644Use doxia macro to generate in-page TOC of MapReduce site documentationMajordocumentationMasatake IwasakiMasatake Iwasaki
HDFS-11112Journal Nodes should refuse to format non-empty directoriesMajor.Arpit AgarwalYiqun Lin
HADOOP-14050Add process name to kms processMinorkms, scriptsRushabh S ShahRushabh S Shah
HADOOP-14053Update the link to HTrace SpanReceiversMinordocumentationAkira AjisakaYiqun Lin
HADOOP-12097Allow port range to be specified while starting webappMajor.Varun SaxenaVarun Saxena
MAPREDUCE-6404Allow AM to specify a port range for starting its webappMajorapplicationmasterVarun SaxenaVarun Saxena
MAPREDUCE-6842Update the links in PiEstimator documentMinordocumentationAkira AjisakaJung Yoo
HDFS-11390Add process name to httpfs processMinorhttpfs, scriptsJohn ZhugeWeiwei Yang
HDFS-11409DatanodeInfo getNetworkLocation and setNetworkLocation shoud use volatile instead of synchronizedMinorperformanceChen LiangChen Liang
YARN-6061Add an UncaughtExceptionHandler for critical threads in RMMajorresourcemanagerYufei GuYufei Gu
YARN-4753Use doxia macro to generate in-page TOC of YARN site documentationMajordocumentationMasatake IwasakiMasatake Iwasaki
HDFS-11333Print a user friendly error message when plugins are not foundMinornamenodeWei-Chiu ChuangWei-Chiu Chuang
YARN-6174Log files pattern should be same for both running and finished containerMajoryarnSumana SathishXuan Gong
HDFS-11375Display the volume storage type in datanode UIMinordatanode, uiSurendra Singh LilhoreSurendra Singh Lilhore
YARN-6125The application attempt's diagnostic message should have a maximum sizeCriticalresourcemanagerDaniel TempletonAndras Piros
HDFS-11406Remove unused getStartInstance and getFinalizeInstance in FSEditLogOpTrivial.Andrew WangAlison Yu
HDFS-11438Fix typo in error message of StoragePolicyAdmin toolTrivial.Alison YuAlison Yu
YARN-6194Cluster capacity in SchedulingPolicy is updated only on allocation file reloadMajorfairschedulerKarthik KambatlaYufei Gu
HADOOP-14097Remove Java6 specific code from GzipCodec.javaMinor.Akira AjisakaElek, Marton
HADOOP-13817Add a finite shell command timeout to ShellBasedUnixGroupsMappingMinorsecurityHarsh JHarsh J
HDFS-11295Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete()MajornamenodeX. LiangElek, Marton
HADOOP-14083KMS should support old SSL clientsMinorkmsJohn ZhugeJohn Zhuge
HADOOP-14127Add log4j configuration to enable logging in hadoop-distcp's testsMinortestXiao ChenXiao Chen
HDFS-11466Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000msMajornamenodeAndrew WangAndrew Wang
YARN-6189Improve application status log message when RM restarted when app is in NEW stateMajor.Yesha VoraJunping Du
HDFS-11432Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commandsMajorfederationBrahma Reddy BattulaBrahma Reddy Battula
HDFS-11418HttpFS should support old SSL clientsMinorhttpfsJohn ZhugeJohn Zhuge
HDFS-11461DataNode Disk Outlier DetectionMajorhdfsHanisha KoneruHanisha Koneru
HADOOP-13930Azure: Add Authorization support to WASBMajorfs/azureDushyanthSivaguru Sankaridurg
HDFS-11494Log message when DN is not selected for block replicationMinor.Yiqun LinYiqun Lin
HDFS-8741Proper error msg to be printed when invalid operation type is given to WebHDFS operationsMinorwebhdfsArchana TSurendra Singh Lilhore
HADOOP-14108CLI MiniCluster: add an option to specify NameNode HTTP portMinor.Takanobu AsanumaTakanobu Asanuma
HDFS-10838Last full block report received time for each DN should be easily discoverableMajoruiArpit AgarwalSurendra Singh Lilhore
HDFS-11477Simplify file IO profiling configurationMinor.Hanisha KoneruHanisha Koneru
YARN-6287RMCriticalThreadUncaughtExceptionHandler.rmContext should be finalMinorresourcemanagerDaniel TempletonCorey Barker
HADOOP-14150Implement getHomeDirectory() method in NativeAzureFileSystemCriticalfs/azureNamit MaheshwariSanthosh G Nayak
YARN-6300NULL_UPDATE_REQUESTS is redundant in TestFairSchedulerMinor.Daniel TempletonYuanbo Liu
YARN-6042Dump scheduler and queue state information into FairScheduler DEBUG logMajorfairschedulerYufei GuYufei Gu
HDFS-11511Support Timeout when checking single diskMajorhdfsHanisha KoneruHanisha Koneru
HDFS-11517Expose slow disks via DataNode JMXMajorhdfsHanisha KoneruHanisha Koneru
HADOOP-14169Implement listStatusIterator, listLocatedStatus for ViewFsMinorviewfsErik KrogenErik Krogen
HDFS-11547Add logs for slow BlockReceiver while writing data to diskMajordatanodeXiaobing ZhouXiaobing Zhou
MAPREDUCE-6865Fix typo in javadoc for DistributedCacheTrivial.Attila SasvariAttila Sasvari
YARN-6309Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to seeMinorfairschedulerDaniel Templetonesmaeil mirzaee
HADOOP-13945Azure: Add Kerberos and Delegation token support to WASB client.Majorfs/azureSanthosh G NayakSanthosh G Nayak
HDFS-11545Propagate DataNode's slow disks info to the NameNode via HeartbeatMajor.Hanisha KoneruHanisha Koneru
YARN-6284hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnableMajorresourcemanagerDaniel TempletonLaura Adams
HADOOP-14213Move Configuration runtime check for hadoop-site.xml to initializationMajor.Jonathan EaglesJonathan Eagles
HDFS-11534Add counters for number of blocks in pending IBRMajorhdfsXiaobing ZhouXiaobing Zhou
YARN-5956Refactor ClientRMService to unify error handling across apisMinorresourcemanagerKai SasakiKai Sasaki
YARN-6379Remove unused argument in ClientRMServiceTrivial.Kai SasakiKai Sasaki
HADOOP-14233Delay construction of PreCondition.check failure message in Configuration#setMajor.Jonathan EaglesJonathan Eagles
HADOOP-14240Configuration#get return value optimizationMajor.Jonathan EaglesJonathan Eagles
YARN-6339Improve performance for createAndGetApplicationReportMajor.yunjiong zhaoyunjiong zhao
HDFS-11170Add builder-based create API to FileSystemMajor.Sammi ChenSammi Chen
YARN-6329Remove unnecessary TODO comment from AppLogAggregatorImpl.javaMinor.Akira Ajisakavictor bertschinger
HDFS-9705Refine the behaviour of getFileChecksum when length = 0Minor.Kai ZhengSammi Chen
HDFS-11551Handle SlowDiskReport from DataNode at the NameNodeMajorhdfsHanisha KoneruHanisha Koneru
HDFS-11603Improve slow mirror/disk warnings in BlockReceiverMajordatanodeArpit AgarwalArpit Agarwal
HDFS-11560Expose slow disks via NameNode JMXMajornamenodeHanisha KoneruHanisha Koneru
HDFS-9651All web UIs should include a robots.txt fileMinor.Lars FranckeLars Francke
HDFS-11628Clarify the behavior of HDFS Mover in documentationMajordocumentationXiaobing ZhouXiaobing Zhou
YARN-6381FSAppAttempt has several variables that should be finalMajorfairschedulerDaniel TempletonAmeet Zaveri
HDFS-11302Improve Logging for SSLHostnameVerifierMajorsecurityXiaoyu YaoChen Liang
HADOOP-14104Client should always ask namenode for kms provider path.MajorkmsRushabh S ShahRushabh S Shah
YARN-5797Add metrics to the node manager for cleaning the PUBLIC and PRIVATE cachesMajor.Chris TrezzoChris Trezzo
HADOOP-14276Add a nanosecond API to Time/Timer/FakeTimerMinorutilErik KrogenErik Krogen
YARN-6195Export UsedCapacity and AbsoluteUsedCapacity to JMXMajorcapacityscheduler, metrics, yarnBenson QiuBenson Qiu
HDFS-11558BPServiceActor thread name is too longMinordatanodeTsz Wo Nicholas SzeXiaobing Zhou
HADOOP-14246Authentication Tokens should use SecureRandom instead of Random and 256 bit secretsMajorsecurityRobert KanterRobert Kanter
HDFS-11648Lazy construct the IIP pathnameMajor.Daryn SharpDaryn Sharp
HADOOP-14274Azure: Simplify Ranger-WASB policy modelMajorfs/azureSivaguru SankaridurgSivaguru Sankaridurg
MAPREDUCE-6673Add a test example job that grows in memory usage over timeMajortestKarthik KambatlaKarthik Kambatla
HADOOP-11794Enable distcp to copy blocks in parallelMajortools/distcpdhruba borthakurYongjun Zhang
YARN-6406Remove SchedulerRequestKeys when no more pending ResourceRequestMajor.Arun SureshArun Suresh
HDFS-11634Optimize BlockIterator when iterating starts in the middle.Major.Konstantin ShvachkoKonstantin Shvachko
HADOOP-14141Store KMS SSL keystore password in catalina.propertiesMinorkmsJohn ZhugeJohn Zhuge
YARN-6164Expose Queue Configurations per Node Label through YARN client apiMajor.Benson QiuBenson Qiu
YARN-6392Add submit time to Application Summary logMinorresourcemanagerzhihai xuzhihai xu
HADOOP-12856FileUtil.checkDest() and RawLocalFileSystem.mkdirs() to throw stricter IOEs; RawLocalFS contract tests to verifyMinorfsSteve LoughranSteve Loughran
HDFS-11384Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spikeMajorbalancer & moveryunjiong zhaoKonstantin Shvachko
HDFS-8873Allow the directoryScanner to be rate-limitedMajordatanodeNathan RobertsDaniel Templeton
HDFS-11722Change Datanode file IO profiling sampling to percentageMajorhdfsHanisha KoneruHanisha Koneru
HDFS-11687Add new public encryption APIs required by HiveMajorencryptionAndrew WangLei (Eddy) Xu
HADOOP-14383Implement FileSystem that reads from HTTP / HTTPS endpointsMajorfsHaohui MaiHaohui Mai
YARN-6457Allow custom SSL configuration to be supplied in WebAppsMajorwebapp, yarnSanjay M PujareSanjay M Pujare
HADOOP-14216Improve Configuration XML Parsing PerformanceMajor.Jonathan EaglesJonathan Eagles
HDFS-11800Document output of 'hdfs count -u' should contain PATHNAMEMinorhdfsXiaobing ZhouXiaobing Zhou
HADOOP-14413Add Javadoc comment for jitter parameter on CachingGetSpaceUsedTrivial.Erik KrogenErik Krogen
HADOOP-14417Update default SSL cipher list for KMSMinorkms, securityJohn ZhugeJohn Zhuge
HDFS-11816Update default SSL cipher list for HttpFSMinorhttpfs, securityJohn ZhugeJohn Zhuge
HDFS-11641Reduce cost of audit logging by using FileStatus instead of HdfsFileStatusMajorhdfsDaryn SharpDaryn Sharp
HADOOP-14242Make KMS Tomcat SSL property sslEnabledProtocols and clientAuth configurableMajorkmsJohn ZhugeJohn Zhuge
HDFS-11579Make HttpFS Tomcat SSL property sslEnabledProtocols and clientAuth configurableMajorhttpfsJohn ZhugeJohn Zhuge
YARN-6493Print requested node partition in assignContainer logsMajor.Jonathan HungJonathan Hung
HADOOP-14407DistCp - Introduce a configurable copy buffer sizeMajortools/distcpOmkar Aradhya K SOmkar Aradhya K S
YARN-6582FSAppAttempt demand can be updated atomically in updateDemand()Major.Karthik KambatlaKarthik Kambatla
HDFS-11421Make WebHDFS' ACLs RegEx configurableMajorwebhdfsHarsh JHarsh J
HDFS-11891DU#refresh should print the path of the directory when an exception is caughtMinor.Chen LiangChen Liang
HADOOP-14442Owner support for ranger-wasb integrationMajorfs, fs/azureVarada HemeswariVarada Hemeswari
YARN-6497Method length of ResourceManager#serviceInit() is too longMinorresourcemanagerYufei GuGergely Novák
HDFS-11383Intern strings in BlockLocation and ExtendedBlockMajor.Misha DmitrievMisha Dmitriev
YARN-6208Improve the log when FinishAppEvent sent to the NodeManager which didn't run the applicationMinor.Akira AjisakaAkira Ajisaka
HADOOP-14440Add metrics for connections droppedMajor.Eric BadgerEric Badger
HADOOP-14491Azure has messed doc structureMajordocumentation, fs/azureMingliang LiuMingliang Liu
HDFS-11914Add more diagnosis info for fsimage transfer failure.Major.Yongjun ZhangYongjun Zhang
HDFS-11840Log HDFS Mover exception message of exit to its own logMinorbalancer & moverLiXin GeLiXin Ge
HDFS-11861ipc.Client.Connection#sendRpcRequest should log request nameTrivialipcJohn ZhugeJohn Zhuge
HADOOP-14465LdapGroupsMapping - support user and group search baseMajorcommon, securityShwetha G SShwetha G S
HADOOP-14310RolloverSignerSecretProvider.LOG should be @VisibleForTestingMinorsecurityDaniel TempletonArun Shanmugam Kumar
HDFS-11907Add metric for time taken by NameNode resource checkMajor.Chen LiangChen Liang
HADOOP-14503Make RollingAverages a mutable metricMajorcommonHanisha KoneruHanisha Koneru
HADOOP-14506Add create() contract test that verifies ancestor dir creationMinorfsAaron FabbriSean Mackrory
HADOOP-14523OpensslAesCtrCryptoCodec.finalize() holds excessive amounts of memoryMajor.Misha DmitrievMisha Dmitriev
HADOOP-14524Make CryptoCodec Closeable so it can be cleaned up proactivelyMajor.Xiao ChenXiao Chen
HADOOP-14424Add CRC32C performance test.MinorcommonLiXin GeLiXin Ge
HDFS-11345Document the configuration key for FSNamesystem lock fairnessMinordocumentation, namenodeZhe ZhangErik Krogen
HDFS-11992Replace commons-logging APIs with slf4j in FsDatasetImplMajor.Akira Ajisakahu xiaodong
HDFS-11993Add log info when connect to datanode socket address failedMajorhdfs-clientchencanchencan
HADOOP-14536Update azure-storage sdk to version 5.3.0Majorfs/azureMingliang LiuGeorgi Chalakov
YARN-6738LevelDBCacheTimelineStore should reuse ObjectMapper instancesMajortimelineserverZoltan HaindrichZoltan Haindrich
HADOOP-14515Specifically configure zookeeper-related log levels in KMS log4jMajorkmsXiao ChenXiao Chen
HDFS-11881NameNode consumes a lot of memory for snapshot diff report generationMajorhdfs, snapshotsManoj GovindassamyManoj Govindassamy
HADOOP-14611NetworkTopology.DEFAULT_HOST_LEVEL is unusedTrivial.Daniel TempletonChen Liang
YARN-6751Display reserved resources in web UI per queueMajorfairscheduler, webappAbdullah YousufiAbdullah Yousufi
HDFS-12042Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumptionMajor.Misha DmitrievMisha Dmitriev
HDFS-12078Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xmlMinordocumentation, hdfsWeiwei YangWeiwei Yang
YARN-6752Display reserved resources in web UI per applicationMajorfairschedulerAbdullah YousufiAbdullah Yousufi
YARN-6746SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead codeMinorschedulerDaniel TempletonDeepti Sawhney
YARN-6410FSContext.scheduler should be finalMinorfairschedulerDaniel TempletonYeliang Cang
YARN-6764Simplify the logic in FairScheduler#attemptSchedulingTrivialfairschedulerYufei GuYufei Gu
HADOOP-14443Azure: Support retry and client side failover for authorization, SASKey and delegation token generationMajorfs/azureSanthosh G NayakSanthosh G Nayak
HADOOP-14535wasb: implement high-performance random access and seek of block blobsMajorfs/azureThomas MarquardtThomas Marquardt
HADOOP-14629Improve exception checking in FileContext related JUnit testsMajorfs, testAndras BokorAndras Bokor
YARN-6689PlacementRule should be configurableMajor.Jonathan HungJonathan Hung
HDFS-12130Optimizing permission check for getContentSummaryMajornamenodeChen LiangChen Liang
HDFS-12137DN dataset lock should be fairCriticaldatanodeDaryn SharpDaryn Sharp
YARN-6280Introduce deselect query param to skip ResourceRequest from getApp/getApps REST APIMajorresourcemanager, restapiLantao JinLantao Jin
HDFS-12138Remove redundant 'public' modifiers from BlockCollectionTrivialnamenodeChen LiangChen Liang
HADOOP-14640Azure: Support affinity for service running on localhost and reuse SPNEGO hadoop.auth cookie for authorization, SASKey and delegation token generationMajorfs/azureSanthosh G NayakSanthosh G Nayak
YARN-6778In ResourceWeights, weights and setWeights() should be finalMinorschedulerDaniel TempletonDaniel Templeton
HDFS-12067Correct dfsadmin commands usage message to reflects IPC portMajor.steven-wugangsteven-wugang
HADOOP-14666Tests use assertTrue(....equals(...)) instead of assertEquals()MinortestDaniel TempletonDaniel Templeton
HADOOP-14659UGI getShortUserName does not need to search the SubjectMajorcommonDaryn SharpDaryn Sharp
YARN-6768Improve performance of yarn api record toString and fromStringMajor.Jonathan EaglesJonathan Eagles
YARN-6779DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTestingTrivialfairschedulerDaniel TempletonYeliang Cang
YARN-6845Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.TrivialfairschedulerYufei GuYufei Gu
HADOOP-14681Remove MockitoMaker classMajortestAndras BokorAndras Bokor
HDFS-12143Improve performance of getting and removing inode featuresMajornamenodeDaryn SharpDaryn Sharp
HDFS-12171Reduce IIP object allocations for inode lookupMajornamenodeDaryn SharpDaryn Sharp
HDFS-12190Enable 'hdfs dfs -stat' to display access timeMajorhdfs, shellYongjun ZhangYongjun Zhang
YARN-6864FSPreemptionThread cleanup for readabilityMinorfairschedulerDaniel TempletonDaniel Templeton
YARN-5892Support user-specific minimum user limit percentage in Capacity SchedulerMajorcapacityschedulerEric PayneEric Payne
HADOOP-14455ViewFileSystem#rename should support be supported within same nameservice with different mountpointsMajorviewfsBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-14690RetryInvocationHandler$RetryInfo should override toString()Minor.Akira AjisakaYeliang Cang
HADOOP-14709Fix checkstyle warnings in ContractTestUtilsMinortestSteve LoughranThomas Marquardt
MAPREDUCE-6914Tests use assertTrue(....equals(...)) instead of assertEquals()MinortestDaniel TempletonDaniel Templeton
YARN-6832Tests use assertTrue(....equals(...)) instead of assertEquals()MinortestDaniel TempletonDaniel Templeton
HADOOP-14706Adding a helper method to determine whether a log is Log4j implementMinorutilWenxin HeWenxin He
HDFS-12251Add document for StreamCapabilitiesMajor.Lei (Eddy) XuLei (Eddy) Xu
YARN-6634[API] Refactor ResourceManager WebServices to make API explicitCriticalresourcemanagerSubru KrishnanGiovanni Matteo Fumarola
YARN-6802Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUIMajorfairschedulerYunFan ZhouYunFan Zhou
HDFS-12264DataNode uses a deprecated method IoUtils#cleanup.Major.Ajay KumarAjay Kumar
YARN-6757Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-pathMinornodemanagerMiklos SzegediMiklos Szegedi
YARN-6811[ATS1.5] All history logs should be kept under its own User Directory.Majortimelineclient, timelineserverRohith Sharma K SRohith Sharma K S
YARN-6879TestLeafQueue.testDRFUserLimits() has commented out codeTrivialcapacity scheduler, testDaniel TempletonAngela Wang
MAPREDUCE-6923Optimize MapReduce Shuffle I/O for small partitionsMajor.Robert SchmidtkeRobert Schmidtke
YARN-6884AllocationFileLoaderService.loadQueue() has an if without bracesTrivialfairschedulerDaniel Templetonweiyuan
HADOOP-14627Support MSI and DeviceCode token provider in ADLSMajorfs/adlAtul SikariaAtul Sikaria
HADOOP-14741Refactor curator based ZooKeeper communication into common libraryMajor.Subru KrishnanÍñigo Goiri
YARN-6917Queue path is recomputed from scratch on every allocationMinorcapacityschedulerJason LoweEric Payne
HADOOP-14662Update azure-storage sdk to version 5.4.0Majorfs/azureThomas MarquardtThomas Marquardt
YARN-3254HealthReport should include disk full informationMajornodemanagerAkira AjisakaSuma Shivaprasad
HDFS-12117HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST InterfaceMajorhttpfsWellington ChevreuilWellington Chevreuil
YARN-7053Move curator transaction support to ZKCuratorManagerMajor.Jonathan HungJonathan Hung
HADOOP-14251Credential provider should handle property key deprecationCriticalsecurityJohn ZhugeJohn Zhuge
YARN-7049FSAppAttempt preemption related fields have confusing namesMajorfairschedulerKarthik KambatlaKarthik Kambatla
YARN-6999Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMasterMinordocumentation, securityLinlin ZhouLinlin Zhou
YARN-7037Optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServicesMajornodemanagerTao YangTao Yang
MAPREDUCE-6937Backport MAPREDUCE-6870 to branch-2 while preserving compatibilityMajor.Zhe ZhangPeter Bacsko
YARN-6780ResourceWeights.toString() cleanupMinorschedulerDaniel Templetonweiyuan
YARN-5547NMLeveldbStateStore should be more tolerant of unknown keysMajornodemanagerJason LoweAjith S
HDFS-12182BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocksTrivialhdfsWellington ChevreuilWellington Chevreuil
HADOOP-14688Intern strings in KeyVersion and EncryptedKeyVersionMajorkmsXiao ChenXiao Chen
HADOOP-14827Allow StopWatch to accept a Timer parameter for testsMinorcommon, testErik KrogenErik Krogen
HDFS-12131Add some of the FSNamesystem JMX values as metricsMinorhdfs, namenodeErik KrogenErik Krogen
HADOOP-14844Remove requirement to specify TenantGuid for MSI Token ProviderMajorfs/adlAtul SikariaAtul Sikaria
YARN-6799Remove the duplicated code in CGroupsHandlerImp.javaTrivialnodemanagerYufei Guweiyuan
HADOOP-14520WASB: Block compaction for Azure Block BlobsMajorfs/azureGeorgi ChalakovGeorgi Chalakov
HADOOP-14839DistCp log output should contain copied and deleted files and directoriesMajortools/distcpKonstantin ShaposhnikovYiqun Lin
HADOOP-14843Improve FsPermission symbolic parsing unit test coverageMinorfsJason LoweBharat Viswanadham
YARN-7057FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemptionMajorfairschedulerKarthik KambatlaKarthik Kambatla
HADOOP-14864FSDataInputStream#unbuffer UOE should include stream class nameMinorfsJohn ZhugeBharat Viswanadham
HDFS-12441Suppress UnresolvedPathException in namenode logMinor.Kihwal LeeKihwal Lee
HDFS-12472Add JUNIT timeout to TestBlockStatsMXBeanMinor.Lei (Eddy) XuBharat Viswanadham
MAPREDUCE-6958Shuffle audit logger should log size of shuffle transferMinor.Jason LoweJason Lowe
HADOOP-7308Remove unused TaskLogAppender configurations from log4j.propertiesMajorconfTodd LipconTodd Lipcon
HDFS-12496Make QuorumJournalManager timeout properties configurableMajor.Ajay KumarAjay Kumar
YARN-7045Remove FSLeafQueue#addAppSchedulableMajorfairschedulerYufei GuSen Zhao
HDFS-12530Processor argument in Offline Image Viewer should be case insensitiveMinortoolsHanisha KoneruHanisha Koneru
YARN-7240Add more states and transitions to stabilize the NM Container state machineMajor.Arun Sureshkartheek muthyala
YARN-65Reduce RM app memory footprint once app has completedMajorresourcemanagerJason LoweManikandan R
YARN-6333Improve doc for minSharePreemptionTimeout, fairSharePreemptionTimeout and fairSharePreemptionThresholdMajorfairschedulerYufei GuChetna Chaudhari
HADOOP-14095Document caveats about the default JavaKeyStoreProvider in KMSMajordocumentation, kmsXiao ChenXiao Chen
YARN-4879Enhance Allocate Protocol to Identify Requests ExplicitlyMajorapplications, resourcemanagerSubru KrishnanSubru Krishnan
HDFS-12420Add an option to disallow 'namenode format -force'Major.Ajay KumarAjay Kumar
HADOOP-14521KMS client needs retry logicMajor.Rushabh S ShahRushabh S Shah
YARN-2162add ability in Fair Scheduler to optionally configure maxResources in terms of percentageMajorfairscheduler, schedulerAshwin ShankarYufei Gu
YARN-7207Cache the RM proxy server addressMajorRMYufei GuYufei Gu
HADOOP-14920KMSClientProvider won't work with KMS delegation token retrieved from non-Java client.MajorkmsXiaoyu YaoXiaoyu Yao
YARN-6930Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManagerMajornodemanagerVinod Kumar VavilapalliShane Kumpf
HDFS-12603Enable async edit logging by defaultMajornamenodeAndrew WangAndrew Wang
HDFS-12642Log block and datanode details in BlockRecoveryWorkerMajordatanodeXiao ChenXiao Chen
HADOOP-14938Configuration.updatingResource map should be initialized lazilyMajor.Misha DmitrievMisha Dmitriev
YARN-6608Backport all SLS improvements from trunk to branch-2Major.Carlo CurinoCarlo Curino
HADOOP-14880[KMS] Document&test missing KMS client side configsMinor.Wei-Chiu ChuangGabor Bota
HDFS-12619Do not catch and throw unchecked exceptions if IBRs fail to processMinornamenodeWei-Chiu ChuangWei-Chiu Chuang
YARN-7359TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnosticMinor.Haibo ChenHaibo Chen
HADOOP-14944Add JvmMetrics to KMSMajorkmsXiao ChenXiao Chen
YARN-7261Add debug message for better download latency monitoringMajornodemanagerYufei GuYufei Gu
YARN-7357Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotationsTrivialresourcemanagerDaniel TempletonSen Zhao
YARN-4163Audit getQueueInfo and getApplications callsMajor.Chang LiChang Li
HADOOP-9657NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 portsMinornetSteve LoughranVarun Saxena
YARN-7389Make TestResourceManager Scheduler agnosticMajortestRobert KanterRobert Kanter
YARN-7358TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity schedulerMinorresourcemanagerHaibo ChenHaibo Chen
YARN-7262Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflowMajor.Robert KanterRobert Kanter
HADOOP-14870backport HADOOP-14553 parallel tests to branch-2Majorfs/azure, testSteve LoughranSteve Loughran
HADOOP-14992Upgrade Avro patch versionMajorbuildChris DouglasBharat Viswanadham
YARN-6413FileSystem based Yarn Registry implementationMajoramrmproxy, api, resourcemanagerEllen HuiEllen Hui
HDFS-12744More logs when short-circuit read is failed and disabledMajordatanodeWeiwei YangWeiwei Yang
MAPREDUCE-6975Logging task countersMajortaskPrabhu JosephPrabhu Joseph
HADOOP-14112Über-jira adl:// Azure Data Lake Phase I: StabilizationMajorfs/adlSteve LoughranJohn Zhuge
HADOOP-14552Über-jira: WASB client phase II: performance and testingMajorfs/azureSteve LoughranThomas Marquardt
HADOOP-13738DiskChecker should perform some disk IOMajor.Arpit AgarwalArpit Agarwal

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7256Resource leak during failure scenario of closing of resources.Minorutilramkrishna.s.vasudevanramkrishna.s.vasudevan
YARN-524TestYarnVersionInfo failing if generated properties doesn't include an SVN URLMinorapiSteve LoughranSteve Loughran
YARN-1471The SLS simulator is not running the preemption policy for CapacitySchedulerMinor.Carlo CurinoCarlo Curino
HADOOP-11703git should ignore .DS_Store files on Mac OS XMajor.Abin ShahabAbin Shahab
HDFS-8797WebHdfsFileSystem creates too many connections for preadMajorwebhdfsJing ZhaoJing Zhao
HDFS-9107Prevent NN's unrecoverable death spiral after full GCCriticalnamenodeDaryn SharpDaryn Sharp
HDFS-9034"StorageTypeStats" Metric should not count failed storage.MajornamenodeArchana TSurendra Singh Lilhore
YARN-4156TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacitySchedulerMajor.Anubhav DhootAnubhav Dhoot
YARN-4417Make RM and Timeline-server REST APIs more consistentMajor.Wangda TanWangda Tan
YARN-4522Queue acl can be checked at app submissionMajor.Jian HeJian He
YARN-4530LocalizedResource trigger a NPE Cause the NodeManager exitMajor.tangshangwentangshangwen
HADOOP-12655TestHttpServer.testBindAddress bind port range is wider than expectedMajor.Wei-Chiu ChuangWei-Chiu Chuang
HADOOP-12573TestRPC.testClientBackOff failingMajortestSteve LoughranXiao Chen
HADOOP-12653Use SO_REUSEADDR to avoid getting "Address already in use" when using kerberos and attempting to bind to any port on the local IP addressMajornetColin P. McCabeColin P. McCabe
YARN-4571Make app id/name available to the yarn authorizer provider for better auditingMajor.Jian HeJian He
YARN-4551Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitionsMinornodemanagerKarthik KambatlaSunil Govindan
HDFS-9517Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributesTrivialdistcpWei-Chiu ChuangWei-Chiu Chuang
HDFS-9624DataNode start slowly due to the initial DU command operationsMajor.Yiqun LinYiqun Lin
YARN-4611Fix scheduler load simulator to support multi-layer network locationMajor.Ming MaMing Ma
YARN-4584RM startup failure when AM attempts greater than max-attemptsCritical.Bibin A ChundattBibin A Chundatt
HDFS-9618Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocksMinornamenodeMasatake IwasakiMasatake Iwasaki
YARN-4497RM might fail to restart when recovering apps whose attempts are missingCritical.Jun GongJun Gong
YARN-4612Fix rumen and scheduler load simulator handle killed tasks properlyMajor.Ming MaMing Ma
MAPREDUCE-6620Jobs that did not start are shown as starting in 1969 in the JHS web UIMajorjobhistoryserverDaniel TempletonHaibo Chen
YARN-4625Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistentMajor.Xuan GongXuan Gong
YARN-4594container-executor fails to remove directory tree when chmod requiredMajornodemanagerColin P. McCabeColin P. McCabe
YARN-4669Fix logging statements in resource manager's Application classTrivial.Sidharta SeethanaSidharta Seethana
YARN-4629Distributed shell breaks under strong securityMajorapplications/distributed-shell, securityDaniel TempletonDaniel Templeton
HDFS-9608Disk IO imbalance in HDFS with heterogeneous storagesMajor.Wei ZhouWei Zhou
YARN-4689FairScheduler: Cleanup preemptContainer to be more readableTrivialfairschedulerKarthik KambatlaKai Sasaki
YARN-4651movetoqueue option does not documented in 'YARN Commands'MajordocumentationTakashi OhnishiTakashi Ohnishi
YARN-4648Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemptionMajorfairschedulerKarthik KambatlaKai Sasaki
YARN-4729SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPEMajorschedulerKarthik KambatlaKarthik Kambatla
YARN-4701When task logs are not available, port 8041 is referenced instead of port 8042MajoryarnHaibo ChenHaibo Chen
HDFS-9858RollingFileSystemSink can throw an NPE on non-secure clustersMajor.Daniel TempletonDaniel Templeton
YARN-4731container-executor should not follow symlinks in recursive_unlink_childrenBlocker.Bibin A ChundattColin P. McCabe
HADOOP-10321TestCompositeService should cover all enumerations of adding a service to a parent serviceMajor.Karthik KambatlaRay Chiang
YARN-4737Add CSRF filter support in YARNMajornodemanager, resourcemanager, webappJonathan MaronJonathan Maron
YARN-4762NMs failing on DelegatingLinuxContainerRuntime init with LCE onBlocker.Vinod Kumar VavilapalliSidharta Seethana
YARN-4764Application submission fails when submitted queue is not available in scheduler xmlMajor.Bibin A ChundattBibin A Chundatt
HADOOP-12895SSLFactory#createSSLSocketFactory exception message is wrongTrivial.Wei-Chiu ChuangWei-Chiu Chuang
HADOOP-12906AuthenticatedURL should convert a 404/Not Found into an FileNotFoundException.Minorio, securitySteve LoughranSteve Loughran
HDFS-9947Block#toString should not output information from derived classesMinor.Colin P. McCabeColin P. McCabe
YARN-4816SystemClock API broken in 2.9.0Major.Siddharth SethSiddharth Seth
HDFS-9780RollingFileSystemSink doesn't work on secure clustersCritical.Daniel TempletonDaniel Templeton
HADOOP-12888Shell to disable bash and setsid support when running under JVM security managerMajorsecurityCostin LeauCostin Leau
YARN-4593Deadlock in AbstractService.getConfig()MajoryarnSteve LoughranSteve Loughran
HDFS-10173Typo in DataXceiverServerTrivialdatanodeMichael HanMichael Han
YARN-4812TestFairScheduler#testContinuousScheduling fails intermittentlyMajorfairschedulerKarthik KambatlaKarthik Kambatla
MAPREDUCE-6110JobHistoryServer CLI throws NullPointerException with job ids that do not existMinorjobhistoryserverLi LuKai Sasaki
MAPREDUCE-6535TaskID default constructor results in NPE on toString()Majormrv2Daniel TempletonDaniel Templeton
MAPREDUCE-6655Fix a typo (STRICT_IE6) in Encrypted ShuffleTrivialdocumentationWei-Chiu ChuangWei-Chiu Chuang
HADOOP-12954Add a way to change hadoop.security.token.service.use_ipMajorsecurityRobert KanterRobert Kanter
YARN-4657Javadoc comment is broken for Resources.multiplyByAndAddTo()Trivial.Daniel TempletonDaniel Templeton
YARN-4880Running TestZKRMStateStorePerf with real zookeeper cluster throws NPEMajor.Rohith Sharma K SSunil Govindan
YARN-4609RM Nodes list page takes too much time to loadMajorwebappBibin A ChundattBibin A Chundatt
YARN-4906Capture container start/finish time in container metricsMajor.Jian HeJian He
HDFS-10192Namenode safemode not coming out during failoverMajornamenodeBrahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6647MR usage counters use the resources requested instead of the resources allocatedMajor.Haibo ChenHaibo Chen
HADOOP-13006FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt runMinortestSteve LoughranKai Sasaki
YARN-4927TestRMHA#testTransitionedToActiveRefreshFail fails with FairSchedulerMajortestKarthik KambatlaBibin A Chundatt
YARN-4562YARN WebApp ignores the configuration passed to it for keystore settingsMajor.Sergey ShelukhinSergey Shelukhin
YARN-4897dataTables_wrapper change min heightMinor.Bibin A ChundattBibin A Chundatt
HDFS-8356Document missing properties in hdfs-default.xmlMajordocumentationRay ChiangRay Chiang
YARN-4810NM applicationpage cause internal error 500Major.Bibin A ChundattBibin A Chundatt
HDFS-10273Remove duplicate logSync() and log message in FSN#enterSafemode()Minor.Vinayakumar BVinayakumar B
HDFS-10282The VolumeScanner should warn about replica files which are misplacedMajordatanodeColin P. McCabeColin P. McCabe
HDFS-10283o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittentlyMajortestMingliang LiuMingliang Liu
HDFS-10306SafeModeMonitor should not leave safe mode if name system is starting active serviceMajornamenodeMingliang LiuMingliang Liu
YARN-4935TestYarnClient#testSubmitIncorrectQueue fails with FairSchedulerMajortestYufei GuYufei Gu
MAPREDUCE-2398MRBench: setting the baseDir parameter has no effectMinorbenchmarksMichael NollWilfred Spiegelenburg
YARN-4976Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to dieMajorresourcemanagerGiovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-4795ContainerMetrics drops recordsMajorresourcemanagerDaniel TempletonDaniel Templeton
YARN-4983JVM and UGI metrics disappear after RM is once transitioned to standby modeMajor.Li LuLi Lu
HADOOP-13012yetus-wrapper should fail sooner when download failsMinoryetusSteven K. WongSteven K. Wong
HADOOP-12469distcp should not ignore the ignoreFailures optionCriticaltools/distcpGera ShegalovMingliang Liu
MAPREDUCE-6677LocalContainerAllocator doesn't specify resource of the containers allocated.Majormr-amHaibo ChenHaibo Chen
YARN-5002getApplicationReport call may raise NPE for removed queuesCritical.Sumana SathishJian He
HADOOP-13118Fix IOUtils#cleanup and IOUtils#closeStream javadocTrivialioWei-Chiu ChuangWei-Chiu Chuang
HADOOP-10694Remove synchronized input streams from Writable deserializationMajorioGopal VGopal V
HDFS-10410RedundantEditLogInputStream#LOG is set to wrong classMinor.John ZhugeJohn Zhuge
HDFS-10208Addendum for HDFS-9579: to handle the case when client machine can't resolve network pathMajor.Ming MaMing Ma
MAPREDUCE-6701application master log can not be available when clicking jobhistory's am logs linkCriticaljobhistoryserverchenyukangHaibo Chen
HDFS-10404Fix formatting of CacheAdmin command usage help textMajorcachingYiqun LinYiqun Lin
MAPREDUCE-6657job history server can fail on startup when NameNode is in start phaseMajorjobhistoryserverHaibo ChenHaibo Chen
HDFS-10360DataNode may format directory and lose blocks if current/VERSION is missingMajordatanodeWei-Chiu ChuangWei-Chiu Chuang
YARN-5076YARN web interfaces lack XFS protectionMajornodemanager, resourcemanager, timelineserverJonathan MaronJonathan Maron
YARN-5126Remove CHANGES.txt from branch-2Major.Akira AjisakaAkira Ajisaka
YARN-5112Excessive log warnings for directory permission issue on NM recovery.Major.Jian HeJian He
YARN-4979FSAppAttempt demand calculation considers demands at multiple locality levels differentMajorfairschedulerzhihai xuzhihai xu
MAPREDUCE-6703Add flag to allow MapReduce AM to request for OPPORTUNISTIC containersMajor.Arun SureshArun Suresh
YARN-5131Distributed shell AM fails when extra container arrives during finishingMajor.Sumana SathishWangda Tan
YARN-4866FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policyMajorfairschedulerKarthik KambatlaYufei Gu
HDFS-10463TestRollingFileSystemSinkWithHdfs needs some cleanupCritical.Daniel TempletonDaniel Templeton
HDFS-10449TestRollingFileSystemSinkWithHdfs#testFailedClose() fails on branch-2MajortestTakanobu AsanumaTakanobu Asanuma
HDFS-10468HDFS read ends up ignoring an interruptMajor.Siddharth SethJing Zhao
MAPREDUCE-6240Hadoop client displays confusing error messageMajorclientMohammad Kamrul IslamGera Shegalov
YARN-4308ContainersAggregated CPU resource utilization reports negative usage in first few heartbeatsMajornodemanagerSunil GovindanSunil Govindan
HDFS-10508DFSInputStream should set thread's interrupt status after catching InterruptException from sleepMajor.Jing ZhaoJing Zhao
HADOOP-13243TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittentlyMinortestDaniel TempletonDaniel Templeton
YARN-5077Fix FSLeafQueue#getFairShare() for queues with zero fairshareMajor.Yufei GuYufei Gu
HDFS-10437ReconfigurationProtocol not covered by HDFSPolicyProvider.MajornamenodeChris NaurothArpit Agarwal
MAPREDUCE-6197Cache MapOutputLocations in ShuffleHandlerMajor.Siddharth SethJunping Du
YARN-5266Wrong exit code while trying to get app logs using regex via CLICriticalyarnSumana SathishXuan Gong
HDFS-10561test_native_mini_dfs fails by NoClassDefFoundErrorMajornative, testAkira AjisakaAkira Ajisaka
HDFS-10555Unable to loadFSEdits due to a failure in readCachePoolInfoCriticalcaching, namenodeUma Maheswara Rao GUma Maheswara Rao G
MAPREDUCE-5803Counters page display all task neverthless of task type( Map or Reduce)MinorjobhistoryserverRohith Sharma K SKai Sasaki
YARN-5182MockNodes.newNodes creates one more node per rack than requestedMajortestKarthik KambatlaKarthik Kambatla
YARN-5282Fix typos in CapacityScheduler documentationTrivialdocumentationRay ChiangRay Chiang
HDFS-10572Fix TestOfflineEditsViewer#testGeneratedBlockertestXiaoyu YaoSurendra Singh Lilhore
YARN-5296NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImplMajornodemanagerKaram SinghJunping Du
YARN-5294Pass remote ip address down to YarnAuthorizationProviderMajor.Jian HeJian He
YARN-4366Fix Lint Warnings in YARN CommonMajoryarnDaniel TempletonDaniel Templeton
YARN-5362TestRMRestart#testFinishedAppRemovalAfterRMRestart can failMajor.Jason Lowesandflee
HDFS-10617PendingReconstructionBlocks.size() should be synchronizedMajor.Eric BadgerEric Badger
YARN-5383Fix findbugs for nodemanager & checkstyle warnings in nodemanager.ContainerExecutorMajornodemanagerVrushali CVrushali C
MAPREDUCE-6733MapReduce JerseyTest tests failing with "java.net.BindException: Address already in use"CriticaltestVinod Kumar VavilapalliVinod Kumar Vavilapalli
HADOOP-13254Create framework for configurable disk checkersMajorutilYufei GuYufei Gu
YARN-5272Handle queue names consistently in FairSchedulerMajorfairschedulerWilfred SpiegelenburgWilfred Spiegelenburg
YARN-5213Fix a bug in LogCLIHelpers which cause TestLogsCLI#testFetchApplictionLogs fails intermittentlyMajortestRohith Sharma K SXuan Gong
YARN-5441Fixing minor Scheduler test case failuresMajor.Subru KrishnanSubru Krishnan
YARN-5440Use AHSClient in YarnClient when TimelineServer is runningMajor.Xuan GongXuan Gong
YARN-5203Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST APIMajor.Subru KrishnanEllen Hui
HDFS-9276Failed to Update HDFS Delegation Token for long running application in HA modeMajorfs, ha, securityLiangliang GuLiangliang Gu
YARN-5436Race in AsyncDispatcher can cause random test failures in Tez (probably YARN also)Major.Zhiyuan YangZhiyuan Yang
YARN-5444Fix failing unit tests in TestLinuxContainerExecutorWithMocksMajornodemanagerYufei GuYufei Gu
HADOOP-13443KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to defaultMinorkmsAnthony Young-GarnerAnthony Young-Garner
YARN-5333Some recovered apps are put into default queue when RM HAMajor.Jun GongJun Gong
HADOOP-13353LdapGroupsMapping getPassward shouldn't return null when IOException throwsMajorsecurityZhaohao LiangWei-Chiu Chuang
HADOOP-13403AzureNativeFileSystem rename/delete performance improvementsMajorfs/azureSubramanyam PattipakaSubramanyam Pattipaka
HDFS-10457DataNode should not auto-format block pool directory if VERSION is missingMajordatanodeWei-Chiu ChuangWei-Chiu Chuang
HDFS-4176EditLogTailer should call rollEdits with a timeoutMajorha, namenodeTodd LipconLei (Eddy) Xu
HADOOP-13476CredentialProviderFactory fails at class loading from libhdfs (JNI)Majorfs/s3Aaron FabbriAaron Fabbri
HADOOP-13461NPE in KeyProvider.rollNewVersionMinor.Colm O hEigeartaighColm O hEigeartaigh
HADOOP-13441Document LdapGroupsMapping keystore password propertiesMinorsecurityWei-Chiu ChuangYuanbo Liu
YARN-4833For Queue AccessControlException client retries multiple times on both RMMajor.Bibin A ChundattBibin A Chundatt
HDFS-9696Garbage snapshot records lingering foreverCritical.Kihwal LeeKihwal Lee
YARN-5521TestCapacityScheduler#testKillAllAppsInQueue fails randomlyMajor.Varun Saxenasandflee
HADOOP-13437KMS should reload whitelist and default key ACLs when hot-reloadingMajorkmsXiao ChenXiao Chen
YARN-5475Test failed for TestAggregatedLogFormat on trunkMajor.Junping DuJun Gong
YARN-5523Yarn running container log fetching causes OutOfMemoryErrorMajorlog-aggregationPrasanth JayachandranXuan Gong
HADOOP-11786Fix Javadoc typos in org.apache.hadoop.fs.FileSystemTrivialdocumentationChen HeAndras Bokor
YARN-5526DrainDispacher#ServiceStop blocked if setDrainEventsOnStop invokedMajor.sandfleesandflee
HDFS-10763Open files can leak permanently due to inconsistent lease updateCritical.Kihwal LeeKihwal Lee
YARN-5533JMX AM Used metrics for queue wrong when app submited to nodelabel partitionMajor.Bibin A ChundattBibin A Chundatt
MAPREDUCE-6762ControlledJob#toString failed with NPE when job status is not successfully updatedMajor.Weiwei YangWeiwei Yang
HADOOP-13526Add detailed logging in KMS for the authentication failure of proxy userMinorkmsSuraj AcharyaSuraj Acharya
HDFS-8312Trash does not descent into child directories to check for permissionsCriticalfs, securityEric YangWeiwei Yang
YARN-5537Intermittent test failure of TestAMRMClient#testAMRMClientWithContainerResourceChangeMajor.Varun SaxenaBibin A Chundatt
YARN-5430Return container's ip and host from NM ContainerStatus callMajor.Jian HeJian He
YARN-5373NPE listing wildcard directory in containerLaunchBlockernodemanagerHaibo ChenDaniel Templeton
MAPREDUCE-6628Potential memory leak in CryptoOutputStreamMajorsecurityMariappan AsokanMariappan Asokan
MAPREDUCE-6777Typos in 4 log messagesTrivial.Mehran HassaniMehran Hassani
YARN-5642Typos in 9 log messagesTrivial.Mehran HassaniMehran Hassani
YARN-5657Fix TestDefaultContainerExecutorMajortestAkira AjisakaArun Suresh
HADOOP-13602Fix some warnings by findbugs in hadoop-maven-pluginMajor.Tsuyoshi OzawaTsuyoshi Ozawa
YARN-4973YarnWebParams next.fresh.interval should be next.refresh.intervalMinorwebappDaniel TempletonDaniel Templeton
YARN-5662Provide an option to enable ContainerMonitorMajor.Jian HeJian He
HADOOP-11780Prevent IPC reader thread deathCriticalipcDaryn SharpDaryn Sharp
HADOOP-13164Optimize S3AFileSystem::deleteUnnecessaryFakeDirectoriesMinorfs/s3Rajesh BalamohanRajesh Balamohan
YARN-5693Reduce loglevel to Debug in ContainerManagementProtocolProxy and AMRMClientImplMajoryarnYufei GuYufei Gu
YARN-5678Log demand as demand in FSLeafQueue and FSParentQueueMajorfairschedulerYufei GuYufei Gu
YARN-5672FairScheduler: wrong queue name in log when adding applicationMinorfairschedulerWilfred SpiegelenburgWilfred Spiegelenburg
YARN-4767Network issues can cause persistent RM UI outageCriticalwebappDaniel TempletonDaniel Templeton
MAPREDUCE-6789Fix TestAMWebApp failureMajortestAkira AjisakaDaniel Templeton
HADOOP-13690Fix typos in core-default.xmlMinordocumentationYiqun LinYiqun Lin
HDFS-10969Fix typos in hdfs-default.xmlMinordocumentationYiqun LinYiqun Lin
YARN-5057resourcemanager.security.TestDelegationTokenRenewer fails in trunkMajor.Yongjun ZhangJason Lowe
HADOOP-13697LogLevel#main throws exception if no arguments providedMajor.Mingliang LiuMingliang Liu
HDFS-10699Log object instance get incorrectly in TestDFSAdminMinor.Yiqun LinYiqun Lin
HDFS-10423Increase default value of httpfs maxHttpHeaderSizeMinorhdfsNicolae PopaNicolae Popa
HADOOP-13626Remove distcp dependency on FileStatus serializationMajortools/distcpChris DouglasChris Douglas
YARN-5711Propogate exceptions back to client when using hedging RM failover providerCriticalapplications, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5754Null check missing for earliest in FifoPolicyMajorfairschedulerYufei GuYufei Gu
HDFS-11040Add documentation for HDFS-9820 distcp improvementMajordistcpYongjun ZhangYongjun Zhang
YARN-5753fix NPE in AMRMClientImpl.getMatchingRequests()MajoryarnHaibo ChenHaibo Chen
HDFS-9929Duplicate keys in NAMENODE_SPECIFIC_KEYSMinornamenodeAkira AjisakaAkira Ajisaka
YARN-5752TestLocalResourcesTrackerImpl#testLocalResourceCache times outMajor.Eric BadgerEric Badger
YARN-5710Fix inconsistent naming in class ResourceRequestTrivialyarnYufei GuYufei Gu
YARN-5686DefaultContainerExecutor random working dir algorigthm skews resultsMinor.Miklos SzegediVrushali C
MAPREDUCE-6798Fix intermittent failure of TestJobHistoryParsing.testJobHistoryMethods()MajorjobhistoryserverHaibo ChenHaibo Chen
YARN-5757RM REST API documentation is not up to dateTrivialresourcemanager, yarnMiklos SzegediMiklos Szegedi
YARN-5420Delete org.apache.hadoop.yarn.server.resourcemanager.resource.Priority as its not necessaryMinorresourcemanagerSunil GovindanSunil Govindan
YARN-5172Update yarn daemonlog documentation due to HADOOP-12847TrivialdocumentationWei-Chiu ChuangWei-Chiu Chuang
YARN-4388Cleanup "mapreduce.job.hdfs-servers" from yarn-default.xmlMinoryarnJunping DuJunping Du
YARN-2306Add test for leakage of reservation metrics in fair schedulerMinorfairschedulerHong ZhiguoHong Zhiguo
YARN-4743FairSharePolicy breaks TimSort assumptionMajorfairschedulerZephyr GuoZephyr Guo
YARN-5809AsyncDispatcher possibly invokes multiple shutdown thread when handling exceptionMajor.Jian HeJian He
YARN-5805Add isDebugEnabled check for debug logs in nodemanagerMinor.Bibin A ChundattBibin A Chundatt
YARN-5788Apps not activiated and AM limit resource in UI and REST not updated after -replaceLabelsOnNodeMajor.Bibin A ChundattBibin A Chundatt
MAPREDUCE-6765MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supportedMinormr-amHaibo ChenHaibo Chen
HDFS-11095BlockManagerSafeMode should respect extension period default config value (30s)MinornamenodeMingliang LiuMingliang Liu
YARN-4862Handle duplicate completed containers in RMNodeImplMajorresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-5377Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainersMajor.Rohith Sharma K SKonstantinos Karanasos
MAPREDUCE-6782JHS task page search based on each individual column not workingMajorjobhistoryserverBibin A ChundattAjith S
HADOOP-13789Hadoop Common includes generated test protos in both jar and test-jarMajorbuild, commonSean BusbeySean Busbey
YARN-5823Update NMTokens in case of requests with only opportunistic containersBlocker.Konstantinos KaranasosKonstantinos Karanasos
YARN-5862TestDiskFailures.testLocalDirsFailures failedMajor.Yufei GuYufei Gu
YARN-5453FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResourceMajorfairschedulersandfleesandflee
YARN-5843Incorrect documentation for timeline service entityType/events REST end pointsMinor.Bibin A ChundattBibin A Chundatt
YARN-5834TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect valueTrivial.Miklos SzegediChang Li
YARN-5545Fix issues related to Max App in capacity schedulerMajorcapacity schedulerBibin A ChundattBibin A Chundatt
YARN-5825ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized blockMajorcapacity schedulerSunil GovindanSunil Govindan
YARN-5874RM -format-state-store and -remove-application-from-state-store commands fail with NPECriticalresourcemanagerVarun SaxenaVarun Saxena
YARN-5873RM crashes with NPE if generic application history is enabledCriticalresourcemanagerVarun SaxenaVarun Saxena
MAPREDUCE-6811TestPipeApplication#testSubmitter fails after HADOOP-13802MajortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-5891yarn rmadmin -help contains a misspelled ResourceManagerTrivialresourcemanagerGrant SohnGrant Sohn
YARN-5870Expose getApplications API in YarnClient with GetApplicationsRequest parameterMajorclientGour SahaJian He
YARN-3538TimelineServer doesn't catch/translate all exceptions raisedMinortimelineserverSteve LoughranSteve Loughran
YARN-5904Reduce the number of default server threads for AMRMProxyServiceMinornodemanagerSubru KrishnanSubru Krishnan
MAPREDUCE-6793io.sort.factor code default and mapred-default.xml values inconsistentTrivialtaskGera ShegalovPrabhu Joseph
YARN-5911DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is trueMajor.Varun SaxenaVarun Saxena
YARN-5918Handle Opportunistic scheduling allocate request failure when NM is lostMajor.Bibin A ChundattBibin A Chundatt
YARN-5920Fix deadlock in TestRMHA.testTransitionedToStandbyShouldNotHangMajortestRohith Sharma K SVarun Saxena
HADOOP-13833TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP13605CriticaltestBrahma Reddy BattulaBrahma Reddy Battula
YARN-5851TestContainerManagerSecurity testContainerManager[1] failedMajornodemanagerHaibo ChenHaibo Chen
MAPREDUCE-6565Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution.Major.Chris NaurothLi Lu
YARN-5942"Overridden" is misspelled as "overriden" in FairScheduler.mdTrivialsiteDaniel TempletonHeather Sutherland
YARN-5901Fix race condition in TestGetGroups beforeclass setup()MajoryarnHaibo ChenHaibo Chen
YARN-5929Missing scheduling policy in the FS queue metric.Major.Yufei GuYufei Gu
HADOOP-13675Bug in return value for delete() calls in WASBMajorfs/azureDushyanthDushyanth
MAPREDUCE-6571JobEndNotification info logs are missing in AM container syslogMinorapplicationmasterPrabhu JosephHaibo Chen
HADOOP-13859TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties.MajorcommonHaibo ChenHaibo Chen
YARN-5932Retrospect moveApplicationToQueue in align with YARN-5611Majorcapacity scheduler, resourcemanagerSunil GovindanSunil Govindan
YARN-5136Error in handling event type APP_ATTEMPT_REMOVED to the schedulerMajor.tangshangwenWilfred Spiegelenburg
MAPREDUCE-6817The format of job start time in JHS is different from those of submit and finish timeMajorjobhistoryserverHaibo ChenHaibo Chen
YARN-5963Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history codeTrivialclient, nodemanagerGrant SohnGrant Sohn
HADOOP-13867FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementationsMajor.Vinayakumar BVinayakumar B
YARN-4752FairScheduler should preempt for a ResourceRequest and all preempted containers should be on the same nodeMajorfairschedulerKarthik KambatlaKarthik Kambatla
HDFS-11226cacheadmin,cryptoadmin and storagepolicyadmin should support generic optionsMinortoolsArchana TBrahma Reddy Battula
MAPREDUCE-6822should set HADOOP_JOB_HISTORYSERVER_HEAPSIZE only if it's empty on branch2MajorscriptsFei Hui
YARN-5999AMRMClientAsync will stop if any exceptions thrown on allocate callMajor.Jian HeJian He
HADOOP-13831Correct check for error code to detect Azure Storage Throttling and provide retriesMajorfs/azureGaurav KanadeGaurav Kanade
HADOOP-13508FsPermission string constructor does not recognize sticky bitMajor.Atul SikariaAtul Sikaria
HDFS-11253FileInputStream leak on failure path in BlockSenderMajordatanodeArpit AgarwalArpit Agarwal
YARN-4330MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages.Blockertest, yarnSteve LoughranVarun Saxena
YARN-5903Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup methodMajoryarnHaibo ChenHaibo Chen
YARN-5774MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.BlockerresourcemanagerYufei GuYufei Gu
YARN-6000Make AllocationFileLoaderService.Listener publicMajorfairscheduler, yarnTao JieTao Jie
YARN-6026A couple of spelling errors in the docsTrivialdocumentationGrant SohnGrant Sohn
HADOOP-13940Document the missing envvars commandsMinordocumentationYiqun LinYiqun Lin
HADOOP-13943TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863MajortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-5962Spelling errors in logging and exceptions for resource manager codeTrivialresourcemanagerGrant SohnGrant Sohn
YARN-5257Fix unreleased resources and null dereferencesMajor.Yufei GuYufei Gu
YARN-6001Improve moveApplicationQueues command lineMajorclientSunil GovindanSunil Govindan
YARN-4882Change the log level to DEBUG for recovering completed applicationsMajorresourcemanagerRohith Sharma K SDaniel Templeton
HDFS-11251ConcurrentModificationException during DataNode#refreshVolumesMajor.Jason LoweManoj Govindassamy
HDFS-11267Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in StorageMajor.Manoj GovindassamyManoj Govindassamy
HADOOP-13942Build failure due to errors of javadoc build in hadoop-azureMajorfs/azureKai SasakiKai Sasaki
YARN-5988RM unable to start in secure setupBlocker.Ajith SAjith S
MAPREDUCE-6715Fix Several Unsafe PracticesMajor.Yufei GuYufei Gu
HDFS-11282Document the missing metrics of DataNode Volume IO operationsMinordocumentationYiqun LinYiqun Lin
YARN-6041Opportunistic containers : Combined patch for branch-2Major.Arun SureshArun Suresh
YARN-6066Opportunistic containers minor fixes: API annotations and config parameter changesMinor.Arun SureshArun Suresh
YARN-6068Log aggregation get failed when NM restart even with recoveryBlocker.Junping DuJunping Du
YARN-6073Misuse of format specifier in Preconditions.checkArgumentTrivial.Yongjun ZhangYuanbo Liu
YARN-5899Debug log in AbstractCSQueue#canAssignToThisQueue needs improvementTrivialcapacity schedulerYing ZhangYing Zhang
YARN-6054TimelineServer fails to start when some LevelDb state files are missing.Critical.Ravi PrakashRavi Prakash
YARN-6022Revert changes of AbstractResourceRequestBlocker.Wangda TanWangda Tan
YARN-4148When killing app, RM releases app's resource before they are released by NMMajorresourcemanagerJun GongJason Lowe
YARN-6079simple spelling errors in yarn test codeTrivialtestGrant Sohnvijay
HADOOP-13903Improvements to KMS logging to help debug authorization errorsMinorkmsTristan StevensTristan Stevens
YARN-6072RM unable to start in secure modeBlockerresourcemanagerBibin A ChundattAjith S
YARN-6081LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved containerCritical.Wangda TanWangda Tan
HADOOP-13928TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime errorMajorfs/adl, testJohn ZhugeJohn Zhuge
HDFS-11307The rpc to portmap service for NFS has hardcoded timeout.Major.Jitendra Nath PandeyMukul Kumar Singh
YARN-6057yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of boundsMinor.Bibin A ChundattJulia Sommer
HADOOP-13976Path globbing does not match newlinesMajor.Eric BadgerEric Badger
HDFS-11209SNN can't checkpoint when rolling upgrade is not finalizedCriticalrolling upgradesXiaoyu YaoXiaoyu Yao
HDFS-10733NameNode terminated after full GC thinking QJM is unresponsive.Majornamenode, qjmKonstantin ShvachkoVinitha Reddy Gankidi
HDFS-11316TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails in trunkMinor.Yiqun LinYiqun Lin
HDFS-11287Storage class member storageDirs should be private to avoid unprotected access by derived classesMajor.Manoj GovindassamyManoj Govindassamy
YARN-6110Fix opportunistic containers documentationMinordocumentationAkira AjisakaAkira Ajisaka
YARN-6104RegistrySecurity overrides zookeeper sasl system propertiesMajor.Billie RinaldiBillie Rinaldi
HADOOP-13858TestGridmixMemoryEmulation and TestResourceUsageEmulators fail on the environment other than Linux or WindowsMajortestAkira AjisakaAkira Ajisaka
YARN-6117SharedCacheManager does not start upMajor.Chris TrezzoChris Trezzo
YARN-6082Invalid REST api response for getApps since queueUsagePercentage is coming as INFCritical.Sunil GovindanSunil Govindan
HDFS-11365Log portnumber in PrivilegedNfsGatewayStarterMinornfsMukul Kumar SinghMukul Kumar Singh
MAPREDUCE-6808Log map attempts as part of shuffle handler audit logMajor.Jonathan EaglesGergő Pásztor
HDFS-11369Change exception message in StorageLocationCheckerMinordatanodeArpit AgarwalArpit Agarwal
YARN-4975Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queuesMajorfairschedulerAshwin ShankarYufei Gu
HDFS-11364Add a test to verify Audit log entries for setfacl/getfacl commands over FS shellMajorhdfs, testManoj GovindassamyManoj Govindassamy
HADOOP-13988KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUserMajorcommon, kmsGreg SeniaXiaoyu Yao
HADOOP-14029Fix KMSClientProvider for non-secure proxyuser use caseMajorkmsXiaoyu YaoXiaoyu Yao
YARN-5641Localizer leaves behind tarballs after container is completeMajor.Eric BadgerEric Badger
HDFS-11378Verify multiple DataNodes can be decommissioned/maintenance at the same timeMajorhdfsManoj GovindassamyManoj Govindassamy
YARN-6103Log updates for ZKRMStateStoreTrivial.Bibin A ChundattDaniel Sturman
HDFS-11335Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConfMajor.Manoj GovindassamyManoj Govindassamy
HDFS-11363Need more diagnosis info when seeing Slow waitForAckedSeqnoMajor.Yongjun ZhangXiao Chen
HDFS-11387Socket reuse address option is not honored in PrivilegedNfsGatewayStarterMajornfsMukul Kumar SinghMukul Kumar Singh
HADOOP-14044Synchronization issue in delegation token cancel functionalityMajor.Hrishikesh GadreHrishikesh Gadre
MAPREDUCE-6338MR AppMaster does not honor ephemeral port rangeMajormr-am, mrv2Frank NguyenFrank Nguyen
HDFS-11377Balancer hung due to no available mover threadsMajorbalancer & moveryunjiong zhaoyunjiong zhao
YARN-6145Improve log message on fail overMajor.Jian HeJian He
YARN-6031Application recovery has failed when node label feature is turned off during RM recoveryMinorschedulerYing ZhangYing Zhang
YARN-6137Yarn client implicitly invoke ATS client which accesses HDFSMajor.Yesha VoraLi Lu
HADOOP-13433Race in UGI.reloginFromKeytabMajorsecurityDuo ZhangDuo Zhang
YARN-6112UpdateCallDuration is calculated only when debug logging is enabledMajorfairschedulerYufei GuYufei Gu
YARN-6144FairScheduler: preempted resources can become negativeBlockerfairscheduler, resourcemanagerMiklos SzegediMiklos Szegedi
YARN-6118Add javadoc for Resources.isNoneMinorschedulerKarthik KambatlaAndres Perez
YARN-6166Unnecessary INFO logs in AMRMClientAsyncImpl$CallbackHandlerThread.runTrivial.Grant WGrant W
HADOOP-14055SwiftRestClient includes pass length in exception if auth failsMinorsecurityMarcell HegedusMarcell Hegedus
HDFS-11403Zookeper ACLs on NN HA enabled clusters to be handled consistentlyMajorhdfsLaszlo PuskasHanisha Koneru
HADOOP-13233help of stat is confusingTrivialdocumentation, fsXiaohe LanAttila Bukor
HADOOP-14058Fix NativeS3FileSystemContractBaseTest#testDirWithDifferentMarkersWorksMinorfs/s3, testAkira AjisakaYiqun Lin
HDFS-11084Add a regression test for sticky bit support of OIV ReverseXML processorMajortoolsWei-Chiu ChuangWei-Chiu Chuang
HDFS-11391Numeric usernames do no work with WebHDFS FS (write access)MajorwebhdfsPierre VillardPierre Villard
YARN-4212FairScheduler: Can't create a DRF queue under a FAIR policy queueMajor.Arun SureshYufei Gu
YARN-6177Yarn client should exit with an informative error message if an incompatible Jersey library is used at clientMajor.Weiwei YangWeiwei Yang
YARN-6171ConcurrentModificationException on FSAppAttempt.containersToPreemptMajorfairschedulerMiklos SzegediMiklos Szegedi
HDFS-11410Use the cached instance when edit logging SetAclOp, SetXAttrOp and RemoveXAttrOpMajornamenodeXiao ChenXiao Chen
YARN-6188Fix OOM issue with decommissioningNodesWatcher in the case of clusters with large number of nodesMajorresourcemanagerAjay JadhavAjay Jadhav
HDFS-11177'storagepolicies -getStoragePolicy' command should accept URI based path.MajorshellSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-11404Increase timeout on TestShortCircuitLocalRead.testDeprecatedGetBlockLocalPathInfoRpcMajor.Eric BadgerEric Badger
MAPREDUCE-6825YARNRunner#createApplicationSubmissionContext method is longer than 150 linesTrivial.Chris TrezzoGergely Novák
YARN-6210FS: Node reservations can interfere with preemptionMajorfairschedulerKarthik KambatlaKarthik Kambatla
YARN-6211Synchronization improvement for moveApplicationAcrossQueues and updateApplicationPriorityMajor.Bibin A ChundattBibin A Chundatt
YARN-6222TestFairScheduler.testReservationMetrics is flakyMajorfairschedulerYufei GuYufei Gu
HADOOP-14114S3A can no longer handle unencoded + in URIsMinorfs/s3Sean MackrorySean Mackrory
HDFS-10620StringBuilder created and appended even if logging is disabledMajornamenodeStaffan FribergStaffan Friberg
HADOOP-14116FailoverOnNetworkExceptionRetry does not wait when failover on certain exceptionMajor.Jian HeJian He
HDFS-11433Document missing usages of OfflineEditsViewer processorsMinordocumentation, toolsYiqun LinYiqun Lin
HDFS-11462Fix occasional BindException in TestNameNodeMetricsLoggerMajortestArpit AgarwalArpit Agarwal
YARN-6172FSLeafQueue demand update needs to be atomicMajorresourcemanagerVarun SaxenaMiklos Szegedi
HADOOP-14119Remove unused imports from GzipCodec.javaMinor.Akira AjisakaYiqun Lin
MAPREDUCE-6841Fix dead link in MapReduce tutorial documentMinordocumentationAkira AjisakaVictor Nee
YARN-6231FairSchedulerTestBase helper methods should call scheduler.update to avoid flakinessMajor.Arun SureshKarthik Kambatla
HDFS-11479Socket re-use address option should be used in SimpleUdpServerMajornfsMukul Kumar SinghMukul Kumar Singh
HADOOP-14131kms.sh creates bogus dir for tomcat logsMinorkmsJohn ZhugeJohn Zhuge
MAPREDUCE-6852Job#updateStatus() failed with NPE due to race conditionMajor.Junping DuJunping Du
MAPREDUCE-6753Variable in byte printed directly in mapreduce clientMajorclientNemo ChenKai Sasaki
HADOOP-6801io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.javaMinor.Erik StefflHarsh J
YARN-6263NMTokenSecretManagerInRM.createAndGetNMToken is not thread safeMajoryarnHaibo ChenHaibo Chen
YARN-6218Fix TestAMRMClient when using FairSchedulerMinor.Miklos SzegediMiklos Szegedi
HDFS-11476Fix NPE in FsDatasetImpl#checkAndUpdateMajordatanodeXiaobing ZhouXiaobing Zhou
YARN-6271yarn rmadin -getGroups returns information from standby RMCriticalyarnSumana SathishJian He
YARN-6248user is not removed from UsersManager’s when app is killed with pending container requests.Major.Eric PayneEric Payne
HADOOP-14026start-build-env.sh: invalid docker image nameMajorbuildGergő PásztorGergő Pásztor
HDFS-11441Add escaping to error message in KMS web UIMinorsecurityAaron T. MyersAaron T. Myers
YARN-5665Enhance documentation for yarn.resourcemanager.scheduler.class propertyTrivialdocumentationMiklos SzegediYufei Gu
MAPREDUCE-6855Specify charset when create String in CredentialsTestJobMinor.Akira AjisakaKai Sasaki
HDFS-11508Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT stateMajornfsMukul Kumar SinghMukul Kumar Singh
MAPREDUCE-6839TestRecovery.testCrashed failedMajortestGergő PásztorGergő Pásztor
YARN-6207Move application across queues should handle delayed event processingMajorcapacity schedulerBibin A ChundattBibin A Chundatt
YARN-6297TestAppLogAggregatorImp.verifyFilesUploaded() should check # of filed uploaded with that of files expectedMajor.Haibo ChenHaibo Chen
YARN-6165Intra-queue preemption occurs even when preemption is turned off for a specific queue.Majorcapacity scheduler, scheduler preemptionEric PayneEric Payne
YARN-6264AM not launched when a single vcore is available on the clusterMajorfairschedulerYufei GuYufei Gu
YARN-6310OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptionsMajoryarnHaibo ChenHaibo Chen
YARN-6321TestResources test timeouts are too aggressiveMajortestJason LoweEric Badger
HDFS-11340DataNode reconfigure for disks doesn't remove the failed volumesMajor.Manoj GovindassamyManoj Govindassamy
HDFS-11512Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksumMinor.Eric BadgerEric Badger
HDFS-11499Decommissioning stuck because of failing recoveryMajorhdfs, namenodeLukas MajercakLukas Majercak
HDFS-11395RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNodeMajorhaNanda kumarNanda kumar
HDFS-11526Fix confusing block recovery messageMinordatanodeWei-Chiu ChuangYiqun Lin
HADOOP-14170FileSystemContractBaseTest is not cleaning up test directory clearlyMajorfsMingliang LiuMingliang Liu
YARN-6328Fix a spelling mistake in CapacitySchedulerTrivialcapacity schedulerJin YiboJin Yibo
HDFS-11420Edit file should not be processed by the same type processor in OfflineEditsViewerMajortoolsYiqun LinYiqun Lin
YARN-6294ATS client should better handle Socket closed caseMajortimelineclientSumana SathishLi Lu
YARN-6332Make RegistrySecurity use short user names for ZK ACLsMajor.Billie RinaldiBillie Rinaldi
YARN-4051ContainerKillEvent lost when container is still recovering and application finishesCriticalnodemanagersandfleesandflee
HDFS-11533reuseAddress option should be used for child channels in Portmap and SimpleTcpServerMajornfsMukul Kumar SinghMukul Kumar Singh
HDFS-10394move declaration of okhttp version from hdfs-client to hadoop-project POMMinorbuildSteve LoughranXiaobing Zhou
HDFS-11516Admin command line should print message to stderr in failure caseMinor.Kai SasakiKai Sasaki
YARN-6217TestLocalCacheDirectoryManager test timeout is too aggressiveMajortestJason LoweMiklos Szegedi
YARN-6353Clean up OrderingPolicy javadocMinorresourcemanagerDaniel TempletonDaniel Templeton
HADOOP-14059typo in s3a rename(self, subdir) error messageMinor.Steve LoughranSteve Loughran
HDFS-6648Order of namenodes in ConfiguredFailoverProxyProvider is undefinedMajorha, hdfs-clientRafal WojdylaÍñigo Goiri
HDFS-11132Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing filesMajorfs/adl, testVishwajeet DusaneVishwajeet Dusane
HADOOP-14204S3A multipart commit failing, "UnsupportedOperationException at java.util.Collections$UnmodifiableList.sort"Criticalfs/s3Steve LoughranSteve Loughran
HADOOP-14205No FileSystem for scheme: adlMajorfs/adlJohn ZhugeJohn Zhuge
HDFS-11561HttpFS doc errorsTrivialdocumentation, httpfs, testYuanbo LiuYuanbo Liu
HADOOP-9631ViewFs should use underlying FileSystem's server side defaultsMajorfs, viewfsLohit VijayarenuErik Krogen
HADOOP-14214DomainSocketWatcher::add()/delete() should not self interrupt while looping await()Criticalhdfs-clientMingliang LiuMingliang Liu
HADOOP-14195CredentialProviderFactory$getProviders is not thread-safeMajorsecurityVihang KarajgaonkarVihang Karajgaonkar
HADOOP-14211FilterFs and ChRootedFs are too aggressive about enforcing "authorityNeeded"MajorviewfsErik KrogenErik Krogen
YARN-6360Prevent FS state dump logger from cramming other log filesMajorfairschedulerYufei GuYufei Gu
YARN-6334TestRMFailover#testAutomaticFailover always passes even when it should failMajor.Yufei GuYufei Gu
MAPREDUCE-6866Fix getNumMapTasks() documentation in JobConfMinordocumentationJoe MészárosJoe Mészáros
MAPREDUCE-6868License check for jdiff output files should be ignoredMajorbuildAkira AjisakaAkira Ajisaka
HDFS-10506OIV's ReverseXML processor cannot reconstruct some snapshot detailsMajortoolsColin P. McCabeAkira Ajisaka
HDFS-11486Client close() should not fail fast if the last block is being decommissionedMajor.Wei-Chiu ChuangWei-Chiu Chuang
YARN-6359TestRM#testApplicationKillAtAcceptedState fails rarely due to race conditionMajortestRobert KanterRobert Kanter
YARN-5368Memory leak in timeline serverCriticaltimelineserverWataru YukawaJonathan Eagles
YARN-6050AMs can't be scheduled on racks or nodesMajor.Robert KanterRobert Kanter
HDFS-11571Typo in DataStorage exception messageMinordatanodeDaniel TempletonAnna Budai
YARN-5685RM configuration allows all failover methods to disabled when automatic failover is enabledCriticalresourcemanagerDaniel TempletonDaniel Templeton
HADOOP-14247FileContextMainOperationsBaseTest should clean up test root pathMinorfs, testMingliang LiuMingliang Liu
YARN-6352Header injections are possible in application proxy servletMajorresourcemanager, securityNaganarasimha G RNaganarasimha G R
MAPREDUCE-6862Fragments are not handled correctly by resource limit checkingMinor.Chris TrezzoChris Trezzo
MAPREDUCE-6873MR Job Submission Fails if MR framework application path not on defaultFSMinormrv2Erik KrogenErik Krogen
HADOOP-14256[S3A DOC] Correct the format for "Seoul" exampleMinordocumentation, fs/s3Brahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6850Shuffle Handler keep-alive connections are closed from the server sideMajor.Jonathan EaglesJonathan Eagles
MAPREDUCE-6836exception thrown when accessing the job configuration web UIMinorwebappsSangjin LeeHaibo Chen
HDFS-11592Closing a file has a wasteful preconditions in NameNodeMajornamenodeEric BadgerEric Badger
YARN-6354LeveldbRMStateStore can parse invalid keys when recovering reservationsMajorresourcemanagerJason LoweJason Lowe
YARN-5703ReservationAgents are not correctly configuredMajorcapacity scheduler, resourcemanagerSean PoManikandan R
HADOOP-14268Fix markdown itemization in hadoop-aws documentsMinordocumentation, fs/s3Akira AjisakaAkira Ajisaka
HADOOP-14272Azure: WasbRemoteCallHelper should use String equals for comparison.Majorfs/azureSanthosh G NayakSanthosh G Nayak
HADOOP-14273Azure: NativeAzureFileSystem should respect config for kerberosSupportEnabled flagMajorfs/azureSanthosh G NayakSanthosh G Nayak
YARN-6436TestSchedulingPolicy#testParseSchedulingPolicy timeout is too lowMajortestJason LoweEric Badger
YARN-6004Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 linesTrivialtestChris TrezzoChris Trezzo
YARN-6420RM startup failure due to wrong order in nodelabel editlogCritical.Bibin A ChundattBibin A Chundatt
MAPREDUCE-6824TaskAttemptImpl#createCommonContainerLaunchContext is longer than 150 linesTrivial.Chris TrezzoChris Trezzo
YARN-6403Invalid local resource request can raise NPE and make NM exitMajornodemanagerTao YangTao Yang
HDFS-11538Move ClientProtocol HA proxies into hadoop-hdfs-clientBlockerhdfs-clientAndrew WangHuafeng Wang
YARN-6437TestSignalContainer#testSignalRequestDeliveryToNM fails intermittentlyMajortestJason LoweJason Lowe
YARN-6448Continuous scheduling thread crashes while sorting nodesMajor.Yufei GuYufei Gu
MAPREDUCE-6846Fragments specified for libjar paths are not handled correctlyMinor.Chris TrezzoChris Trezzo
HDFS-11131TestThrottledAsyncChecker#testCancellation is flakyMajortestArpit AgarwalArpit Agarwal
HADOOP-13996Fix some release build issuesBlockerbuildAndrew WangAndrew Wang
HDFS-11362StorageDirectory should initialize a non-null default StorageDirTypeMinorhdfsHanisha KoneruHanisha Koneru
HDFS-11608HDFS write crashed with block size greater than 2 GBCriticalhdfs-clientXiaobing ZhouXiaobing Zhou
YARN-6288Exceptions during aggregated log writes are mishandledCriticallog-aggregationAkira AjisakaAkira Ajisaka
YARN-6368Decommissioning an NM results in a -1 exit codeMinor.Miklos SzegediMiklos Szegedi
HADOOP-14066VersionInfo should be marked as public APICriticalcommonThejas M NairAkira Ajisaka
YARN-6343Docker docs MR example is brokenMajornodemanagerDaniel TempletonPrashant Jha
HADOOP-14293Initialize FakeTimer with a less trivial valueMajortestAndrew WangAndrew Wang
HADOOP-13545Upgrade HSQLDB to 2.3.4MinorbuildGiovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-6461TestRMAdminCLI has very low test timeoutsMajortestJason LoweEric Badger
YARN-6463correct spelling mistake in FileSystemRMStateStoreTrivial.Yeliang CangYeliang Cang
YARN-6439Fix ReservationSystem creation of default ReservationQueueMajor.Carlo CurinoCarlo Curino
HDFS-11630TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins buildsMajorhdfsHanisha KoneruHanisha Koneru
HDFS-11163Mover should move the file blocks to default storage once policy is unsetMajorbalancer & moverSurendra Singh LilhoreSurendra Singh Lilhore
YARN-6450TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTestMajortestJason LoweJason Lowe
YARN-3760FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()CriticalnodemanagerDaryn SharpHaibo Chen
YARN-6216Unify Container Resizing code paths with Container Updates making it scheduler agnosticMajorcapacity scheduler, fairscheduler, resourcemanagerArun SureshArun Suresh
YARN-5994TestCapacityScheduler.testAMLimitUsage fails intermittentlyMajor.Eric BadgerEric Badger
YARN-6433Only accessible cgroup mount directories should be selected for a controllerMajornodemanagerMiklos SzegediMiklos Szegedi
YARN-6480Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestartMajor.Eric BadgerEric Badger
HADOOP-14311Add python2.7-dev to DockerfileMajor.Allen WittenauerAllen Wittenauer
YARN-6304Skip rm.transitionToActive call to RM if RM is already active.MajorresourcemanagerRohith Sharma K SRohith Sharma K S
HDFS-11615FSNamesystemLock metrics can be inaccurate due to millisecond precisionMajorhdfsErik KrogenErik Krogen
HADOOP-14318Remove non-existent setfattr command option from FileSystemShell.mdMinordocumentationDoris GuDoris Gu
HADOOP-14315Python example in the rack awareness document doesn't work due to bad indentationMinordocumentationKengo SekiKengo Seki
HADOOP-13997Typo in metrics docsTrivialdocumentationDaniel TempletonAna Krasteva
YARN-6302Fail the node if Linux Container Executor is not configured properlyMinor.Miklos SzegediMiklos Szegedi
HDFS-11660TestFsDatasetCache#testPageRounder fails intermittently with AssertionErrorMajortestAndrew WangAndrew Wang
HDFS-11685TestDistributedFileSystem.java fails to compileMajortestJohn ZhugeJohn Zhuge
YARN-6501FSSchedulerNode.java fails to compile with JDK7MajorresourcemanagerJohn ZhugeJohn Zhuge
YARN-6453fairscheduler-statedump.log gets generated regardless of serviceBlockerfairscheduler, schedulerAllen WittenauerYufei Gu
YARN-6153keepContainer does not work when AM retry window is setMajorresourcemanagerkyungwan namkyungwan nam
HDFS-11689New exception thrown by DFSClient#isHDFSEncryptionEnabled broke hacky hive codeMajor.Yongjun ZhangYongjun Zhang
YARN-5889Improve and refactor user-limit calculation in capacity schedulerMajorcapacity schedulerSunil GovindanSunil Govindan
YARN-6500Do not mount inaccessible cgroups directories in CgroupsLCEResourcesHandlerMajornodemanagerMiklos SzegediMiklos Szegedi
HDFS-11691Add a proper scheme to the datanode links in NN web UIMajor.Kihwal LeeKihwal Lee
HADOOP-14341Support multi-line value for ssl.server.exclude.cipher.listMajor.John ZhugeJohn Zhuge
YARN-5617AMs only intended to run one attempt can be run more than onceMajorresourcemanagerJason LoweJason Lowe
YARN-6510Fix profs stat file warning caused by process names that includes parenthesisMajor.Wilfred SpiegelenburgWilfred Spiegelenburg
HADOOP-14351Azure: RemoteWasbAuthorizerImpl and RemoteSASKeyGeneratorImpl should not use Kerberos interactive user cacheMajorfs/azureSanthosh G NayakSanthosh G Nayak
HADOOP-14346CryptoOutputStream throws IOException on flush() if stream is closedMajor.Pierre LacavePierre Lacave
HDFS-11709StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefullyCriticalha, namenodeZhe ZhangErik Krogen
YARN-5894fixed license warning caused by de.ruedigermoeller:fst:jar:2.24BlockeryarnHaibo ChenHaibo Chen
HADOOP-14320TestIPC.testIpcWithReaderQueuing fails intermittentlyMajor.Eric BadgerEric Badger
YARN-6536TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittentlyMajor.Eric BadgerJason Lowe
YARN-6520Fix warnings from Spotbugs in hadoop-yarn-clientMajor.Weiwei YangWeiwei Yang
HDFS-11609Some blocks can be permanently lost if nodes are decommissioned while deadBlockernamenodeKihwal LeeKihwal Lee
HDFS-8498Blocks can be committed with wrong sizeCriticalhdfs-clientDaryn SharpJing Zhao
HDFS-11714Newly added NN storage directory won't get initialized and cause space exhaustionCritical.Kihwal LeeKihwal Lee
HDFS-11593Change SimpleHttpProxyHandler#exceptionCaught log level from info to debugMinordatanodeXiaoyu YaoXiaobing Zhou
HADOOP-14371License error in TestLoadBalancingKMSClientProvider.javaMajor.hu xiaodonghu xiaodong
HADOOP-14369NetworkTopology calls expensive toString() when loggingMajor.Íñigo GoiriÍñigo Goiri
YARN-6519Fix warnings from Spotbugs in hadoop-yarn-server-resourcemanagerMajorresourcemanagerWeiwei YangWeiwei Yang
YARN-6481Yarn top shows negative container number in FSMajoryarnYufei GuTao Jie
HADOOP-14306TestLocalFileSystem tests have very low timeoutsMajor.Eric BadgerEric Badger
HADOOP-14372TestSymlinkLocalFS timeouts are too lowMajor.Eric BadgerEric Badger
HDFS-11739Fix regression in tests caused by YARN-679MajortestSteve LoughranSteve Loughran
HADOOP-14207"dfsadmin -refreshCallQueue" fails with DecayRpcSchedulerBlockerrpc-serverSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-11702Remove indefinite caching of key provider uri in DFSClientMajorhdfs-clientRushabh S ShahRushabh S Shah
YARN-3839Quit throwing NMNotYetReadyExceptionMajornodemanagerKarthik KambatlaManikandan R
HADOOP-14374License error in GridmixTestUtils.javaMajor.lixinglonglixinglong
HADOOP-14100Upgrade Jsch jar to latest version to fix vulnerability in old versionsCritical.Vinayakumar BVinayakumar B
YARN-5301NM mount cpu cgroups failed on some systemsMajor.sandfleeMiklos Szegedi
HADOOP-14377Increase Common test timeouts from 1 second to 10 secondsMajor.Eric BadgerEric Badger
YARN-3742YARN RM will shut down if ZKClient creation times outMajorresourcemanagerWilfred SpiegelenburgDaniel Templeton
HADOOP-14373License error In org.apache.hadoop.metrics2.util.ServersMajor.hu xiaodonghu xiaodong
YARN-6552Increase YARN test timeouts from 1 second to 10 secondsMajor.Eric BadgerEric Badger
MAPREDUCE-6882Increase MapReduce test timeouts from 1 second to 10 secondsMajor.Eric BadgerEric Badger
HADOOP-14405Fix performance regression due to incorrect use of DataChecksumMajornative, performanceLiXin GeLiXin Ge
HDFS-11745Increase HDFS test timeouts from 1 second to 10 secondsMajor.Eric BadgerEric Badger
HDFS-11755Underconstruction blocks can be considered missingMajor.Nathan RobertsNathan Roberts
YARN-6571Fix JavaDoc issues in SchedulingPolicyTrivialfairschedulerDaniel TempletonWeiwei Yang
HADOOP-14361Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrentlyMajorfs/azureTrupti DhavleSanthosh G Nayak
HADOOP-14410Correct spelling of 'beginning' and variantsTrivial.Dongtao ZhangDongtao Zhang
YARN-5543ResourceManager SchedulingMonitor could potentially terminate the preemption checker threadMajorcapacityscheduler, resourcemanagerMin ShenMin Shen
YARN-6380FSAppAttempt keeps redundant copy of the queueMajorfairschedulerDaniel TempletonDaniel Templeton
HDFS-11674reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recoveredCriticaldatanodeVinayakumar BVinayakumar B
YARN-6580Incorrect logger for FairSharePolicyMinorfairschedulerYufei GuVrushali C
HADOOP-14376Memory leak when reading a compressed file using the native libraryMajorcommon, ioEli AcherkanEli Acherkan
HDFS-11818TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittentlyMajor.Eric BadgerNathan Roberts
HDFS-11644Support for querying outputstream capabilitiesMajorerasure-codingAndrew WangManoj Govindassamy
YARN-6598History server getApplicationReport NPE when fetching report for pre-2.8 jobBlockertimelineserverJason LoweJason Lowe
YARN-6603NPE in RMAppsBlockMajorresourcemanagerJason LoweJason Lowe
HDFS-11833HDFS architecture documentation describes outdated placement policyMinor.dudChen Liang
HADOOP-14416Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-RangerMajorfs/azure, securitySivaguru SankaridurgSivaguru Sankaridurg
HDFS-11827NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() methodMajor.xupengxupeng
HADOOP-14412HostsFileReader#getHostDetails is very expensive on large clustersMajorutilJason LoweJason Lowe
HADOOP-14427Avoid reloading of Configuration in ViewFileSystem creation.MajorviewfsVinayakumar BVinayakumar B
HDFS-11842TestDataNodeOutlierDetectionViaMetrics UT failsMajor.Yesha VoraHanisha Koneru
YARN-6577Remove unused ContainerLocalization classesMinornodemanagerZhangBing LinZhangBing Lin
YARN-6618TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than onceMinortestJason LoweJason Lowe
YARN-6249TestFairSchedulerPreemption fails inconsistently.Majorfairscheduler, resourcemanagerSean PoTao Jie
YARN-6602Impersonation does not work if standby RM is contacted firstBlockerclientRobert KanterRobert Kanter
HDFS-11863Document missing metrics for blocks count in pending IBRMinordocumentationYiqun LinYiqun Lin
HDFS-11849JournalNode startup failure exception should be logged in log fileMajorjournal-nodeSurendra Singh LilhoreSurendra Singh Lilhore
YARN-6584Correct license headers in hadoop-common, hdfs, yarn and mapreduceTrivial.Yeliang CangYeliang Cang
HDFS-11864Document Metrics to track usage of memory for writesMajordocumentationBrahma Reddy BattulaYiqun Lin
YARN-6615AmIpFilter drops query parameters on redirectMajor.Wilfred SpiegelenburgWilfred Spiegelenburg
HADOOP-14449The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correctMinorcommon, documentationZhangBing LinZhangBing Lin
HADOOP-14166Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not usedMajorcommonSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-11661GetContentSummary uses excessive amounts of memoryBlockernamenodeNathan RobertsWei-Chiu Chuang
YARN-6141ppc64le on Linux doesn't trigger __linux get_executable codepathMajornodemanagerSonia GarudiAyappan
HADOOP-14399Configuration does not correctly XInclude absolute file URIsBlockerconfAndrew WangJonathan Eagles
HADOOP-14430the accessTime of FileStatus returned by SFTPFileSystem's getFileStatus method is always 0TrivialfsHongyuan LiHongyuan Li
HDFS-11445FSCK shows overall health status as corrupt even one replica is corruptCritical.Brahma Reddy BattulaBrahma Reddy Battula
YARN-6643TestRMFailover fails rarely due to port conflictMajortestRobert KanterRobert Kanter
HDFS-11817A faulty node can cause a lease leak and NPE on accessing dataCritical.Kihwal LeeKihwal Lee
YARN-6641Non-public resource localization on a bad disk causes subsequent containers failureMajor.Kuhu ShuklaKuhu Shukla
HADOOP-14431ModifyTime of FileStatus returned by SFTPFileSystem's getFileStatus method is wrongMajorfsHongyuan LiHongyuan Li
HDFS-11078Fix NPE in LazyPersistFileScrubberMajor.Íñigo GoiriÍñigo Goiri
HADOOP-14464hadoop-aws doc header warning #5 line wrappedTrivialdocumentation, fs/s3John ZhugeJohn Zhuge
HDFS-11659TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.MajordatanodeLei (Eddy) XuLei (Eddy) Xu
YARN-6366Refactor the NodeManager DeletionService to support additional DeletionTask types.Majornodemanager, yarnShane KumpfShane Kumpf
HDFS-5042Completed files lost after power failureCritical.Dave LathamVinayakumar B
YARN-6649RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exceptionCritical.Jonathan EaglesJonathan Eagles
HADOOP-9849License information is missing for native CRC32 codeCritical.Timothy St. ClairAndrew Wang
HDFS-11893Fix TestDFSShell.testMoveWithTargetPortEmpty failure.MajortestKonstantin ShvachkoBrahma Reddy Battula
HADOOP-14460Azure: update doc for live and contract testsMajordocumentation, fs/azureMingliang LiuMingliang Liu
HDFS-11741Long running balancer may fail due to expired DataEncryptionKeyMajorbalancer & moverWei-Chiu ChuangWei-Chiu Chuang
HDFS-11856Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updatesMajorhdfs-client, rolling upgradesVinayakumar BVinayakumar B
HDFS-11905Fix license header inconsistency in hdfsTrivial.Yeliang CangYeliang Cang
HADOOP-14436Remove the redundant colon in ViewFs.mdMajordocumentationmaobaolongmaobaolong
HADOOP-14474Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failuresMajorbuildAkira AjisakaAkira Ajisaka
HDFS-11899ASF License warnings generated intermittently in trunkMajor.Yiqun LinYiqun Lin
HADOOP-14428s3a: mkdir appears to be brokenBlockerfs/s3Aaron FabbriMingliang Liu
HDFS-11928Segment overflow in FileDistributionCalculatorMajortoolsLiXin GeLiXin Ge
HDFS-10816TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitorMajor.Eric BadgerEric Badger
HADOOP-14478Optimize NativeAzureFsInputStream for positional readsMajorfs/azureRajesh BalamohanRajesh Balamohan
HADOOP-14472Azure: TestReadAndSeekPageBlobAfterWrite fails intermittentlyMajorfs/azure, testMingliang LiuMingliang Liu
HDFS-11932BPServiceActor thread name is not correctly setMajorhdfsChen LiangChen Liang
HDFS-11708Positional read will fail if replicas moved to different DNs after stream is openedCriticalhdfs-clientVinayakumar BVinayakumar B
HDFS-11929Document missing processor of hdfs oiv_legacy commandMinordocumentation, toolsLiXin GeLiXin Ge
HDFS-11711DN should not delete the block On "Too many open files" ExceptionCriticaldatanodeBrahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6676NNBench should Throw IOException when rename and delete failsMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-14500Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} failsMajorfs/azure, testMingliang LiuRajesh Balamohan
HADOOP-14283Upgrade AWS SDK to 1.11.134Criticalfs/s3Aaron FabbriAaron Fabbri
HADOOP-14511WritableRpcEngine.Invocation#toString NPE on null parametersMinoripcJohn ZhugeJohn Zhuge
YARN-6585RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.Blocker.Eric PayneSunil Govindan
YARN-6703RM startup failure with old state store due to version mismatchCritical.Bibin A ChundattVarun Saxena
HADOOP-14501Switch from aalto-xml to woodstox to handle odd XML featuresBlockerconfAndrew WangJonathan Eagles
HDFS-11967TestJMXGet fails occasionallyMajor.Arpit AgarwalArpit Agarwal
HDFS-11947When constructing a thread name, BPOfferService may print a bogus warning messageMinordatanodeTsz Wo Nicholas SzeWeiwei Yang
MAPREDUCE-6895Job end notification not send due to YarnRuntimeExceptionMajorapplicationmasteryunjiong zhaoyunjiong zhao
HADOOP-14486TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0MajorfsSonia GarudiHongyuan Li
MAPREDUCE-6897Add Unit Test to make sure Job end notification get sent even appMaster stop get YarnRuntimeExceptionMinor.Junping DuGergely Novák
YARN-6517Fix warnings from Spotbugs in hadoop-yarn-commonMajor.Weiwei YangWeiwei Yang
YARN-6719Fix findbugs warnings in SLSCapacityScheduler.javaMajor.Akira AjisakaAkira Ajisaka
HADOOP-14540Replace MRv1 specific terms in HostsFileReaderMinordocumentationAkira Ajisakahu xiaodong
HDFS-11995HDFS Architecture documentation incorrectly describes writing to a local temporary file.MinordocumentationChris NaurothNanda kumar
HDFS-11736OIV tests should not write outside 'target' directory.Major.Konstantin ShvachkoYiqun Lin
YARN-6713Fix dead link in the Javadoc of FairSchedulerEventLog.javaMinordocumentationAkira AjisakaWeiwei Yang
HADOOP-14533Size of args cannot be less than zero in TraceAdmin#run as its linkedlistTrivialcommon, tracingWeisen HanWeisen Han
HDFS-11960Successfully closed files can stay under-replicated.Critical.Kihwal LeeKihwal Lee
HADOOP-14429FTPFileSystem#getFsAction always returns FsAction.NONEMajorfsHongyuan LiHongyuan Li
HDFS-12010TestCopyPreserveFlag fails consistently because of mismatch in access timeMajorhdfs, testMukul Kumar SinghMukul Kumar Singh
HADOOP-14568GenericTestUtils#waitFor missing parameter verificationMajortestYiqun LinYiqun Lin
HADOOP-14146KerberosAuthenticationHandler should authenticate with SPN in AP-REQMajorsecurityDaryn SharpDaryn Sharp
YARN-5876TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunkMajor.Varun SaxenaRobert Kanter
HADOOP-14543ZKFC should use getAversion() while setting the zkaclMajor.Brahma Reddy BattulaBrahma Reddy Battula
YARN-5006ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zkCriticalresourcemanagerdongtingtingBibin A Chundatt
HADOOP-14461Azure: handle failure gracefully in case of missing account access keyMajorfs/azureMingliang LiuMingliang Liu
HDFS-12040TestFsDatasetImpl.testCleanShutdownOfVolume failsMajortestAkira Ajisakahu xiaodong
HADOOP-14594ITestS3AFileOperationCost::testFakeDirectoryDeletion to uncomment metric assertionsMajorfs/s3Mingliang LiuMingliang Liu
YARN-6467CSQueueMetrics needs to update the current metrics for default partition onlyMajorcapacity schedulerNaganarasimha G RManikandan R
HADOOP-14024KMS JMX endpoint throws ClassNotFoundExceptionCriticalkmsAndrew WangJohn Zhuge
HDFS-12043Add counters for block re-replicationMajor.Chen LiangChen Liang
YARN-6344Add parameter for rack locality delay in CapacitySchedulerMajorcapacityschedulerKonstantinos KaranasosKonstantinos Karanasos
MAPREDUCE-6905Fix meaningless operations in TestDFSIO in some situation.Majortools/rumenLiXin GeLiXin Ge
HDFS-12079Description of dfs.block.invalidate.limit is incorrect in hdfs-default.xmlMinordocumentationWeiwei YangWeiwei Yang
MAPREDUCE-6909LocalJobRunner fails when run on a node from multiple usersBlockerclientJason LoweJason Lowe
HADOOP-13414Hide Jetty Server version header in HTTP responsesMajorsecurityVinayakumar BSurendra Singh Lilhore
MAPREDUCE-6911TestMapreduceConfigFields.testCompareXmlAgainstConfigurationClass fails consistentlyMajor.Eric BadgerEric Badger
YARN-6708Nodemanager container crash after ext3 folder limitCritical.Bibin A ChundattBibin A Chundatt
HADOOP-14563LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOExceptionMajor.Rushabh S ShahRushabh S Shah
YARN-6428Queue AM limit is not honored in CS alwaysMajor.Bibin A ChundattBibin A Chundatt
YARN-6770[Docs] A small mistake in the example of TimelineClientTrivialdocsJinjiang LingJinjiang Ling
HADOOP-10829Iteration on CredentialProviderFactory.serviceLoader is thread-unsafeMajorsecurityBenoy AntonyBenoy Antony
HADOOP-14581Restrict setOwner to list of user when security is enabled in wasbMajorfs/azureVarada HemeswariVarada Hemeswari
YARN-6809Fix typo in ResourceManagerHA.mdTrivialdocumentationAkira AjisakaYeliang Cang
YARN-6797TimelineWriter does not fully consume the POST responseMajortimelineclientJason LoweJason Lowe
HDFS-11502Datanode UI should display hostname based on JMX bean instead of window.location.hostnameMajorhdfsJeffrey E RodriguezJeffrey E Rodriguez
HADOOP-14646FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runsMinortestAndras BokorAndras Bokor
HADOOP-14658branch-2 compilation is broken in hadoop-azureBlockerbuild, fs/azureSunil GovindanSunil Govindan
MAPREDUCE-6697Concurrent task limits should only be applied when necessaryMajormrv2Jason LoweNathan Roberts
YARN-6654RollingLevelDBTimelineStore backwards incompatible after fst upgradeBlocker.Jonathan EaglesJonathan Eagles
YARN-6805NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit codeMajornodemanagerJason LoweJason Lowe
YARN-6792Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfoBlockerresourcemanagerGiovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-6769Make schedulables without demand less needy in FairSharePolicy#compareMajorfairschedulerYunFan ZhouYunFan Zhou
YARN-6759Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failureMajor.Naganarasimha G RNaganarasimha G R
YARN-3260AM attempt fail to register before RM processes launch eventCriticalresourcemanagerJason LoweBibin A Chundatt
HDFS-12140Remove BPOfferService lock contention to get block pool idCriticaldatanodeDaryn SharpDaryn Sharp
HDFS-12112TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPEMinor.Wei-Chiu ChuangWei-Chiu Chuang
YARN-6714IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacitySchedulerMajor.Tao YangTao Yang
MAPREDUCE-6889Add Job#close API to shutdown MR client services.Major.Rohith Sharma K SRohith Sharma K S
MAPREDUCE-6910MapReduceTrackingUriPlugin can not return the right URI of history server with HTTPSMajorjobhistoryserverLantao JinLantao Jin
HDFS-12154Incorrect javadoc description in StorageLocationChecker#checkMajor.Nanda kumarNanda kumar
YARN-6798Fix NM startup failure with old state store due to version mismatchMajornodemanagerRay ChiangBotong Huang
HADOOP-14637GenericTestUtils.waitFor needs to check condition again after max wait timeMajor.Daniel TempletonDaniel Templeton
YARN-6819Application report fails if app rejected due to nodesizeMajor.Bibin A ChundattBibin A Chundatt
HADOOP-14669GenericTestUtils.waitFor should use monotonic timeTrivialtestJason LoweDaniel Templeton
HDFS-12158Secondary Namenode's web interface lack configs for X-FRAME-OPTIONS protectionMajornamenodeMukul Kumar SinghMukul Kumar Singh
HDFS-12139HTTPFS liststatus returns incorrect pathSuffix for path of fileMajorhttpfsYongjun ZhangYongjun Zhang
YARN-6837Null LocalResource visibility or resource type can crash the nodemanagerMajor.Jinjiang LingJinjiang Ling
HDFS-11472Fix inconsistent replica size after a data pipeline failureCriticaldatanodeWei-Chiu ChuangErik Krogen
HDFS-11742Improve balancer usability after HDFS-8818Blocker.Kihwal LeeKihwal Lee
HDFS-12176dfsadmin shows DFS Used%: NaN% if the cluster has zero block.Trivial.Wei-Chiu ChuangWeiwei Yang
YARN-6844AMRMClientImpl.checkNodeLabelExpression() has wrong error messageMinor.Daniel TempletonManikandan R
YARN-6150TestContainerManagerSecurity tests for Yarn Server are flakeyMajortestDaniel SturmanDaniel Sturman
YARN-6307Refactor FairShareComparator#compareMajorfairschedulerYufei GuYufei Gu
HADOOP-14578Bind IPC connections to kerberos UPN host for proxy usersMajoripcDaryn SharpDaryn Sharp
HDFS-11896Non-dfsUsed will be doubled on dead node re-registrationBlocker.Brahma Reddy BattulaBrahma Reddy Battula
YARN-6870Fix floating point inaccuracies in resource availability check in AllocationBasedResourceUtilizationTrackerMajorapi, nodemanagerBrook ZhouBrook Zhou
YARN-5728TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeoutMajortestAkira AjisakaAkira Ajisaka
HADOOP-14677mvn clean compile failsMajorbuildAndras BokorAndras Bokor
HDFS-12082BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfiguredMajorhdfs, namenodeWeiwei YangWeiwei Yang
YARN-6628Unexpected jackson-core-2.2.3 dependency introducedBlockertimelineserverJason LoweJonathan Eagles
HADOOP-14644Increase max heap size of Maven javadoc pluginMajortestAndras BokorAndras Bokor
MAPREDUCE-6921TestUmbilicalProtocolWithJobToken#testJobTokenRpc failsMajor.Sonia GarudiSonia Garudi
HADOOP-14676Wrong default value for "fs.df.interval"Majorcommon, conf, fsKonstantin ShvachkoSherwood Zheng
HADOOP-14701Configuration can log misleading warnings about an attempt to override final parameterMajorconfAndrew ShermanAndrew Sherman
YARN-5731Preemption calculation is not accurate when reserved containers are present in queue.Majorcapacity schedulerSunil GovindanWangda Tan
HADOOP-14683FileStatus.compareTo binary compatible issueBlocker.Sergey ShelukhinAkira Ajisaka
HADOOP-14702Fix formatting issue and regression caused by conversion from APT to MarkdownMinordocumentationDoris GuDoris Gu
YARN-6872Ensure apps could run given NodeLabels are disabled post RM switchover/restartMajorresourcemanagerSunil GovindanSunil Govindan
HDFS-12217HDFS snapshots doesn't capture all open files when one of the open files is deletedMajorsnapshotsManoj GovindassamyManoj Govindassamy
YARN-6846Nodemanager can fail to fully delete application local directories when applications are killedCriticalnodemanagerJason LoweJason Lowe
YARN-6678Handle IllegalStateException in Async Scheduling mode of CapacitySchedulerMajorcapacityschedulerTao YangTao Yang
YARN-6895[FairScheduler] Preemption reservation may cause regular reservation leaksBlockerfairschedulerMiklos SzegediMiklos Szegedi
HADOOP-14722Azure: BlockBlobInputStream position incorrect after seekMajorfs/azureThomas MarquardtThomas Marquardt
YARN-6951Fix debug log when Resource Handler chain is enabledMinor.Yang WangYang Wang
HADOOP-14727Socket not closed properly when reading Configurations with BlockReaderRemoteBlockerconfXiao ChenJonathan Eagles
YARN-6920Fix resource leak that happens during container re-initialization.MajornodemanagerArun SureshArun Suresh
HDFS-12198Document missing namenode metrics that were added recentlyMinordocumentationYiqun LinYiqun Lin
HADOOP-14680Azure: IndexOutOfBoundsException in BlockBlobInputStreamMinorfs/azureRajesh BalamohanThomas Marquardt
MAPREDUCE-6927MR job should only set tracking url if history was successfully writtenMajor.Eric BadgerEric Badger
HDFS-10326Disable setting tcp socket send/receive buffers for write pipelinesMajordatanode, hdfsDaryn SharpDaryn Sharp
HADOOP-14598Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactoryMajorfs/azure, testSteve LoughranSteve Loughran
HDFS-12157Do fsyncDirectory(..) outside of FSDataset lockCriticaldatanodeVinayakumar BVinayakumar B
HDFS-12278LeaseManager operations are inefficient in 2.8.BlockernamenodeRushabh S ShahRushabh S Shah
HADOOP-14743CompositeGroupsMapping should not swallow exceptionsMajorsecurityWei-Chiu ChuangWei-Chiu Chuang
HADOOP-14754TestCommonConfigurationFields failed: core-default.xml has 2 wasb properties missing in classesMinorcommon, fs/azureJohn ZhugeJohn Zhuge
YARN-5927BaseContainerManagerTest::waitForNMContainerState timeout accounting is not accurateTrivial.Miklos SzegediKai Sasaki
YARN-6967Limit application attempt's diagnostic message size thoroughlyMajorresourcemanagerChengbing LiuChengbing Liu
HDFS-11303Hedged read might hang infinitely if read data from all DN failedMajorhdfs-clientChen ZhangChen Zhang
YARN-6996Change javax.cache library implementation from JSR107 to Apache GeronimoBlocker.Ray ChiangRay Chiang
YARN-6987Log app attempt during InvalidStateTransitionMajor.Jonathan EaglesJonathan Eagles
HADOOP-14773Extend ZKCuratorManager API for more reusabilityMajor.Íñigo GoiriÍñigo Goiri
YARN-6965Duplicate instantiation in FairSchedulerQueueInfoMinorfairschedulerMasahiro TanakaMasahiro Tanaka
YARN-7020TestAMRMProxy#testAMRMProxyTokenRenewal is flakeyMajor.Robert KanterRobert Kanter
MAPREDUCE-6940Copy-paste error in the TaskAttemptUnsuccessfulCompletionEvent constructorMinor.Oleg DanilovOleg Danilov
MAPREDUCE-6936Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-commonMajormrv2Haibo ChenHaibo Chen
YARN-7007NPE in RM while using YarnClient.getApplications()Major.Lingfeng SuLingfeng Su
HDFS-12325SFTPFileSystem operations should restore cwdMajor.Namit MaheshwariChen Liang
HDFS-11738Hedged pread takes more time when block moved from initial locationsMajorhdfs-clientVinayakumar BVinayakumar B
YARN-2416InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in timeCriticalresourcemanagerJian FangJonathan Eagles
YARN-7048Fix tests faking kerberos to explicitly set ugi auth typeMajoryarnDaryn SharpDaryn Sharp
HADOOP-14687AuthenticatedURL will reuse bad/expired session cookiesCriticalcommonDaryn SharpDaryn Sharp
YARN-6251Do async container release to prevent deadlock during container updatesMajor.Arun SureshArun Suresh
YARN-7090testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configuredMajortestYesha VoraWangda Tan
YARN-7074Fix NM state store update commentMinornodemanagerBotong HuangBotong Huang
YARN-6640AM heartbeat stuck when responseId overflows MAX_INTBlocker.Botong HuangBotong Huang
HDFS-12319DirectoryScanner will throw IllegalStateException when Multiple BP's are presentBlocker.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-12299Race Between update pipeline and DN Re-RegistrationCritical.Brahma Reddy BattulaBrahma Reddy Battula
YARN-7052RM SchedulingMonitor gives no indication why the spawned thread crashed.CriticalyarnEric PayneEric Payne
YARN-7087NM failed to perform log aggregation due to absent containerBlockerlog-aggregationJason LoweJason Lowe
HDFS-12215DataNode#transferBlock does not create its daemon in the xceiver thread groupMajordatanodeLei (Eddy) XuLei (Eddy) Xu
YARN-7051Avoid concurrent modification exception in FifoIntraQueuePreemptionPluginCriticalcapacity scheduler, scheduler preemption, yarnEric PayneEric Payne
YARN-7099ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users.MinornodemanagerMiklos SzegediMiklos Szegedi
YARN-7112TestAMRMProxy is failing with invalid requestMajor.Jason LoweJason Lowe
HDFS-12293DataNode should log file name on disk errorMajordatanodeWei-Chiu ChuangAjay Kumar
YARN-7076yarn application -list -appTypes <appType> is not workingBlocker.Jian HeJian He
YARN-5816TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakeyMinorresourcemanager, testDaniel TempletonRobert Kanter
MAPREDUCE-6641TestTaskAttempt fails in trunkMajortestTsuyoshi OzawaHaibo Chen
YARN-6756ContainerRequest#executionTypeRequest causes NPECritical.Jian HeJian He
HDFS-12191Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this fileMajorhdfs, namenodeYongjun ZhangYongjun Zhang
YARN-6982Potential issue on setting AMContainerSpec#tokenConf to null before app is completedMajor.Rohith Sharma K SManikandan R
HDFS-12336Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directoryMinorencryption, hdfsWellington ChevreuilWellington Chevreuil
HADOOP-14814Fix incompatible API change on FsServerDefaults to HADOOP-14104Blocker.Junping DuJunping Du
MAPREDUCE-6931Remove TestDFSIO "Total Throughput" calculationCriticalbenchmarks, testDennis HuoDennis Huo
YARN-7077TestAMSimulator and TestNMSimulator failMajortestAkira AjisakaAkira Ajisaka
YARN-7116CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage.Majorcapacity scheduler, webappWangda TanWangda Tan
HDFS-12317HDFS metrics render error in the page of GithubMinordocumentation, metricsYiqun LinYiqun Lin
HADOOP-14824Update ADLS SDK to 2.2.2 for MSI fixMajorfs/adlAtul SikariaAtul Sikaria
YARN-7120CapacitySchedulerPage NPE in "Aggregate scheduler counts" sectionMinor.Eric PayneEric Payne
YARN-7023Incorrect ReservationId.compareTo() implementationMinorreservation systemOleg DanilovOleg Danilov
HADOOP-14820Wasb mkdirs security checks inconsistent with HDFSMajorfs/azureSivaguru SankaridurgSivaguru Sankaridurg
YARN-7164TestAMRMClientOnRMRestart fails sporadically with bind address in useMajortestJason LoweJason Lowe
YARN-6992Kill application button is visible even if the application is FINISHED in RM UIMajor.Sumana SathishSuma Shivaprasad
HDFS-12357Let NameNode to bypass external attribute provider for special userMajor.Yongjun ZhangYongjun Zhang
HDFS-12369Edit log corruption due to hard lease recovery of not-closed file which has snapshotsMajornamenodeXiao ChenXiao Chen
HADOOP-14842Hadoop 2.8.2 release build process get stuck due to java issueBlockerbuildJunping DuJunping Du
YARN-6219NM web server related UT fails with "NMWebapps failed to start."Major.Yesha VoraJason Lowe
HDFS-12407Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to startMajor.Ajay KumarAjay Kumar
YARN-7185ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled.BlockeryarnSumana SathishTan, Wangda
HADOOP-14867Update HDFS Federation setup document, for incorrect property name for secondary name node http addressMajor.Bharat ViswanadhamBharat Viswanadham
YARN-4727Unable to override the $HADOOP_CONF_DIR env variable for containerMajornodemanagerTerence YimJason Lowe
MAPREDUCE-6957shuffle hangs after a node manager connection timeoutMajormrv2Jooseong KimJooseong Kim
YARN-7163RMContext need not to be injected to webapp and other Always Running services.BlockerresourcemanagerRohith Sharma K SRohith Sharma K S
HDFS-12424Datatable sorting on the Datanode Information page in the Namenode UI is brokenMajor.Shawna MartellShawna Martell
HDFS-12323NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeoutMajornamenode, qjmErik KrogenErik Krogen
YARN-7149Cross-queue preemption sometimes starves an underserved queueMajorcapacity schedulerEric PayneEric Payne
YARN-7192Add a pluggable StateMachine Listener that is notified of NM Container State changesMajor.Arun SureshArun Suresh
MAPREDUCE-6960Shuffle Handler prints disk error stack traces for every read failure.Major.Kuhu ShuklaKuhu Shukla
HDFS-11799Introduce a config to allow setting up write pipeline with fewer nodes than replication factorMajor.Yongjun ZhangBrahma Reddy Battula
YARN-7196Fix finicky TestContainerManager testsMajor.Arun SureshArun Suresh
YARN-6771Use classloader inside configuration class to make new classesMajor.Jongyoul LeeJongyoul Lee
HDFS-12526FSDirectory should use Time.monotonicNow for durationsMinor.Chetna ChaudhariBharat Viswanadham
YARN-6968Hardcoded absolute pathname in DockerLinuxContainerRuntimeMajornodemanagerMiklos SzegediEric Badger
HDFS-12371"BlockVerificationFailures" and "BlocksVerified" show up as 0 in Datanode JMXMajormetricsSai NukavarapuHanisha Koneru
MAPREDUCE-6964BaileyBorweinPlouffe should use Time.monotonicNow for measuring durationsMinorexamplesChetna ChaudhariChetna Chaudhari
YARN-5195RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacitySchedulerMajorresourcemanagerKaram Singhsandflee
YARN-7034DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executorBlockernodemanagerMiklos SzegediMiklos Szegedi
MAPREDUCE-6966DistSum should use Time.monotonicNow for measuring durationsMinor.Chetna ChaudhariChetna Chaudhari
MAPREDUCE-6965QuasiMonteCarlo should use Time.monotonicNow for measuring durationsMinorexamplesChetna ChaudhariChetna Chaudhari
MAPREDUCE-6967gridmix/SleepReducer should use Time.monotonicNow for measuring durationsMinor.Chetna ChaudhariChetna Chaudhari
HDFS-12531Fix conflict in the javadoc of UnderReplicatedBlocks.java in branch-2MinordocumentationAkira AjisakaBharat Viswanadham
YARN-7153Remove duplicated code in AMRMClientAsyncImpl.javaMinorclientSen ZhaoSen Zhao
HADOOP-14901ReuseObjectMapper in Hadoop CommonMinor.Hanisha KoneruHanisha Koneru
YARN-7118AHS REST API can return NullPointerExceptionMajor.Prabhu JosephBillie Rinaldi
HDFS-12495TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittentlyMajor.Eric BadgerEric Badger
HADOOP-14891Remove references to Guava Objects.toStringHelperMajor.Jonathan EaglesJonathan Eagles
HADOOP-14822hadoop-project/pom.xml is executableMinor.Akira AjisakaAjay Kumar
YARN-7157Add admin configuration to filter per-user's apps in secure clusterMajorwebappSunil GovindanSunil Govindan
YARN-7257AggregatedLogsBlock reports a bad 'end' value as a bad 'start' valueMajorlog-aggregationJason LoweJason Lowe
YARN-7248NM returns new SCHEDULED container status to older clientsBlockernodemanagerJason LoweArun Suresh
HADOOP-14902LoadGenerator#genFile write close timing is incorrectly calculatedMajorfsJason LoweHanisha Koneru
YARN-7260yarn.router.pipeline.cache-max-size is missing in yarn-default.xmlMajor.Rohith Sharma K SJason Lowe
YARN-7084TestSchedulingMonitor#testRMStarts fails sporadicallyMajor.Jason LoweJason Lowe
YARN-6625yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environmentMajoramrmproxyYufei GuYufei Gu
YARN-7044TestContainerAllocation#testAMContainerAllocationWhenDNSUnavailable failsMajorcapacity scheduler, testWangda TanAkira Ajisaka
YARN-7226Whitelisted variables do not support delayed variable expansionMajornodemanagerJason LoweJason Lowe
YARN-7258Add Node and Rack Hints to Opportunistic SchedulerMajor.Arun Sureshkartheek muthyala
YARN-7285ContainerExecutor always launches with priorities due to yarn-default propertyMinornodemanagerJason LoweJason Lowe
YARN-7245Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-userMajorcapacity scheduler, yarnEric PayneEric Payne
YARN-7309TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairSchedulerMajortestRobert KanterRobert Kanter
HADOOP-14912FairCallQueue may defer servicing callsMajoripcDaryn SharpDaryn Sharp
MAPREDUCE-6951Improve exception message when mapreduce.jobhistory.webapp.address is in wrong formatMajorapplicationmasterPrabhu JosephPrabhu Joseph
HADOOP-13556Change Configuration.getPropsWithPrefix to use getProps instead of iteratorMajor.Larry McCayLarry McCay
HADOOP-13102Update GroupsMapping documentation to reflect the new changesMajordocumentationAnu EngineerEsther Kundin
YARN-7270Fix unsafe casting from long to int for class Resource and its sub-classesMajorresourcemanagerYufei GuYufei Gu
YARN-7269Tracking URL in the app state does not get redirected to ApplicationMaster for Running applicationsCritical.Sumana SathishTan, Wangda
YARN-7321Backport container-executor changes from YARN-6852 to branch-2Major.Varun VasudevVarun Vasudev
HDFS-12659Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck intervalMinor.Ajay KumarAjay Kumar
HDFS-12485expunge may fail to remove trash from encryption zoneMajor.Wei-Chiu ChuangWei-Chiu Chuang
HADOOP-14949TestKMS#testACLs fails intermittentlyMajorkms, testXiao ChenXiao Chen
YARN-7124LogAggregationTFileController deletes/renames while file is openCriticalnodemanagerDaryn SharpJason Lowe
YARN-7333container-executor fails to remove entries from a directory that is not writable or executableCritical.Jason LoweJason Lowe
YARN-7341TestRouterWebServiceUtil#testMergeMetrics is flakeyMajorfederationRobert KanterRobert Kanter
HADOOP-14958CLONE - Fix source-level compatibility after HADOOP-11252Blocker.Junping DuJunping Du
YARN-7294TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair schedulerMajor.Miklos SzegediMiklos Szegedi
YARN-7170Improve bower dependencies for YARN UI v2CriticalwebappSunil GovindanSunil Govindan
YARN-7355TestDistributedShell should be scheduler agnosticMajor.Haibo ChenHaibo Chen
HADOOP-14942DistCp#cleanup() should check whether jobFS is nullMinor.Ted YuAndras Bokor
HDFS-12683DFSZKFailOverController re-order logic for logging ExceptionMajor.Bharat ViswanadhamBharat Viswanadham
HADOOP-14966Handle JDK-8071638 for hadoop-commonBlocker.Bibin A ChundattBibin A Chundatt
HDFS-12695Add a link to HDFS router federation document in site.xmlMinordocumentationYiqun LinYiqun Lin
YARN-7382NoSuchElementException in FairScheduler after failover causes RM crashBlockerfairschedulerRobert KanterRobert Kanter
YARN-7385TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPEMajortestRobert KanterYufei Gu
YARN-7339LocalityMulticastAMRMProxyPolicy should handle cancel request properlyMinor.Botong HuangBotong Huang
HDFS-12710HTTPFS HTTP max header size env variable is not respected in branch-2Minor.Istvan FajthIstvan Fajth
HDFS-9914Fix configurable WebhDFS connect/read timeoutBlockerhdfs-client, webhdfsXiaoyu YaoXiaoyu Yao
YARN-7375Possible NPE in RMWebapp when HA is enabled and the active RM failsMajor.Chandni SinghChandni Singh
HADOOP-14986Enforce JDK limitationsMajorbuildChris DouglasChris Douglas
HADOOP-14991Add missing figures to Resource Estimator toolMajor.Subru KrishnanRui Li
YARN-7299Fix TestDistributedSchedulerMajor.Jason LoweArun Suresh
YARN-6747TestFSAppStarvation.testPreemptionEnable fails intermittentlyMajor.Sunil GovindanMiklos Szegedi
YARN-7244ShuffleHandler is not aware of disks that are addedMajor.Kuhu ShuklaKuhu Shukla
HADOOP-14990Clean up jdiff xml files added for 2.8.2 releaseBlocker.Subru KrishnanJunping Du
HADOOP-14919BZip2 drops records when reading data in splitsCritical.Aki TanakaJason Lowe
HDFS-12699TestMountTable fails with Java 7Major.Íñigo GoiriÍñigo Goiri
YARN-7146Many RM unit tests failing with FairSchedulerMajortestRobert KanterRobert Kanter
MAPREDUCE-6999Fix typo "onf" in DynamicInputChunk.javaTrivial.fang zhenyifang zhenyi
YARN-7364Queue dash board in new YARN UI has incorrect valuesCriticalwebappSunil GovindanSunil Govindan
YARN-7370Preemption properties should be refreshableMajorcapacity scheduler, scheduler preemptionEric PayneGergely Novák
YARN-7400incorrect log preview displayed in jobhistory server uiMajoryarnSanthosh B GowdaXuan Gong
HADOOP-15013Fix ResourceEstimator findbugs issuesBlocker.Allen WittenauerArun Suresh
YARN-7432Fix DominantResourceFairnessPolicy serializable findbugs issuesBlocker.Allen WittenauerDaniel Templeton
YARN-7434Router getApps REST invocation fails with multiple RMsCritical.Subru KrishnanÍñigo Goiri
YARN-4742[Umbrella] Enhancements to Distributed SchedulingMajor.Arun SureshArun Suresh
YARN-5085Add support for change of container ExecutionTypeMajor.Arun SureshArun Suresh
HDFS-12783[branch-2] "dfsrouter" should use hdfsScriptMajor.Brahma Reddy BattulaBrahma Reddy Battula
YARN-7453Fix issue where RM fails to switch to active after first successful startBlockerresourcemanagerRohith Sharma K SRohith Sharma K S
HADOOP-15025Ensure singleton for ResourceEstimatorServiceMajor.Subru KrishnanRui Li
HADOOP-15026Rebase ResourceEstimator start/stop scripts for branch-2Major.Subru KrishnanRui Li
YARN-6102RMActiveService context to be updated with new RMContext on failoverCritical.Ajith SRohith Sharma K S
HADOOP-15030[branch-2] Include hadoop-cloud-storage-project in the main hadoop pom modulesCritical.Subru KrishnanSubru Krishnan
YARN-7475Fix Container log link in new YARN UIMajor.Sunil GovindanSunil Govindan
YARN-7476Fix miscellaneous issues in ATSv2 after merge to branch-2Major.Varun SaxenaVarun Saxena
HADOOP-15036Update LICENSE.txt for HADOOP-14840Major.Arun SureshArun Suresh
HDFS-13054Handling PathIsNotEmptyDirectoryException in DFSClient delete callMajorhdfs-clientNanda kumarNanda kumar

TESTS:

JIRASummaryPriorityComponentReporterContributor
HDFS-9153Pretty-format the output for DFSIOMajor.Kai ZhengKai Zheng
HDFS-9300TestDirectoryScanner.testThrottle() is still a little flakeyMajorbalancer & mover, testDaniel TempletonDaniel Templeton
YARN-4704TestResourceManager#testResourceAllocation() fails when using FairSchedulerMajorfairscheduler, testRay ChiangYufei Gu
HADOOP-12701Run checkstyle on test source filesMinor.John ZhugeJohn Zhuge
HADOOP-13178TestShellBasedIdMapping.testStaticMapUpdate doesn't work on OS XMajortestAllen WittenauerKai Sasaki
YARN-5024TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failureMajortestBibin A ChundattBibin A Chundatt
YARN-5005TestRMWebServices#testDumpingSchedulerLogs fails randomlyMajor.Bibin A ChundattBibin A Chundatt
YARN-5118Tests fails with localizer port bind exception.MajortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-4989TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittentlyMajortestRohith Sharma K SAjith S
YARN-5208Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabledBlockertestRohith Sharma K SRohith Sharma K S
YARN-5343TestContinuousScheduling#testSortedNodes fails intermittentlyMinor.sandfleeYufei Gu
YARN-2398TestResourceTrackerOnHA crashesMajortestJason LoweAjith S
YARN-5656Fix ReservationACLsTestBaseMajor.Sean PoSean Po
YARN-4555TestDefaultContainerExecutor#testContainerLaunchError fails on non-english locale environmentMinornodemanager, testTakashi OhnishiTakashi Ohnishi
YARN-4363In TestFairScheduler, testcase should not create FairScheduler redundantlyTrivialfairschedulerTao JieTao Jie
MAPREDUCE-6831Flaky test TestJobImpl.testKilledDuringKillAbortMajormrv2Peter BacskoPeter Bacsko
HDFS-11290TestFSNameSystemMBean should wait until JMX cache is clearedMajortestAkira AjisakaErik Krogen
HDFS-11570Unit test for NameNodeStatusMXBeanMajorhdfs, testHanisha KoneruHanisha Koneru
HADOOP-14218Replace assertThat with assertTrue in MetricsAssertsMinor.Akira AjisakaAkira Ajisaka
YARN-5548Use MockRMMemoryStateStore to reduce test failuresMajor.Bibin A ChundattBibin A Chundatt
HADOOP-14245Use Mockito.when instead of Mockito.stubMinortestAkira AjisakaAndras Bokor
YARN-5349TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittentlyMinor.sandfleeJason Lowe
YARN-6240TestCapacityScheduler.testRefreshQueuesWithQueueDelete fails randomlyMajortestSunil GovindanNaganarasimha G R
HDFS-11988Verify HDFS Snapshots with open files captured are safe across truncates and appends on current version fileMajorhdfs, snapshotsManoj GovindassamyManoj Govindassamy
MAPREDUCE-6953Skip the testcase testJobWithChangePriority if FairScheduler is usedMajorclientPeter BacskoPeter Bacsko

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
YARN-3063Bootstrap TimelineServer Next Gen ModuleMajortimelineserverZhijie ShenZhijie Shen
YARN-3030[Collector wireup] Set up timeline collector with basic request serving structure and lifecycleMajortimelineserverSangjin LeeSangjin Lee
YARN-3041[Data Model] create overall data objects of TS next genMajortimelineserverSangjin LeeZhijie Shen
YARN-3240[Data Mode] Implement client API to put generic entitiesMajortimelineserverZhijie ShenZhijie Shen
YARN-3087[Collector implementation] the REST server (web server) for per-node collector does not work if it runs inside node managerMajortimelineserverSangjin LeeLi Lu
YARN-3125[Event producers] Change distributed shell to use new timeline serviceMajortimelineserverZhijie ShenJunping Du
YARN-3210[Source organization] Refactor timeline collector according to new code organizationMajortimelineserverLi LuLi Lu
YARN-3264[Storage implementation] Create backing storage write interface and a POC only file based storage implementationMajortimelineserverVrushali CVrushali C
YARN-3039[Collector wireup] Implement timeline app-level collector service discoveryMajortimelineserverSangjin LeeJunping Du
YARN-3333rename TimelineAggregator etc. to TimelineCollectorMajortimelineserverSangjin LeeSangjin Lee
YARN-3377TestTimelineServiceClientIntegration failsMinortimelineserverSangjin LeeSangjin Lee
YARN-3034[Collector wireup] Implement RM starting its timeline collectorMajortimelineserverSangjin LeeNaganarasimha G R
YARN-3040[Data Model] Make putEntities operation be aware of the app's contextMajortimelineserverSangjin LeeZhijie Shen
YARN-3374Collector's web server should randomly bind an available portMajortimelineserverZhijie ShenZhijie Shen
YARN-3334[Event Producers] NM TimelineClient container metrics posting to new timeline service.MajornodemanagerJunping DuJunping Du
YARN-3391Clearly define flow ID/ flow run / flow version in API and storageMajortimelineserverZhijie ShenZhijie Shen
MAPREDUCE-6327[Event producers] Implement MapReduce AM writing MR events/counters to v2 ATSMajor.Sangjin LeeJunping Du
YARN-3390Reuse TimelineCollectorManager for RMMajortimelineserverZhijie ShenZhijie Shen
YARN-3431Sub resources of timeline entity needs to be passed to a separate endpoint.MajortimelineserverZhijie ShenZhijie Shen
MAPREDUCE-6335convert load test driver to timeline service v.2Major.Sangjin LeeSangjin Lee
YARN-3551Consolidate data model change according to the backend implementationMajortimelineserverZhijie ShenZhijie Shen
YARN-3562unit tests failures and issues found from findbug from earlier ATS checkinsMinortimelineserverSangjin LeeNaganarasimha G R
YARN-3134[Storage implementation] Exploiting the option of using Phoenix to access HBase backendMajortimelineserverZhijie ShenLi Lu
YARN-3529Add miniHBase cluster and Phoenix support to ATS v2 unit testsMajortimelineserverLi LuLi Lu
YARN-3634TestMRTimelineEventHandling and TestApplication are brokenMajortimelineserverSangjin LeeSangjin Lee
MAPREDUCE-6337add a mode to replay MR job history files to the timeline serviceMajor.Sangjin LeeSangjin Lee
YARN-3411[Storage implementation] explore & create the native HBase schema for writesCriticaltimelineserverSangjin LeeVrushali C
MAPREDUCE-6370Timeline service v2 load generator needs to write event idMajor.Li LuLi Lu
YARN-3726Fix TestHBaseTimelineWriterImpl unit test failure by fixing it's test dataMajortimelineserverVrushali CVrushali C
YARN-3721build is broken on YARN-2928 branch due to possible dependency cycleBlockertimelineserverSangjin LeeLi Lu
YARN-3276Refactor and fix null casting in some map cast for TimelineEntity (old and new) and fix findbug warningsMajortimelineserverJunping DuJunping Du
YARN-3044[Event producers] Implement RM writing app lifecycle events to ATSMajortimelineserverSangjin LeeNaganarasimha G R
YARN-3801[JDK-8][YARN-2928] Exclude jdk.tools from hbase-client and hbase-testing-utilMajortimelineserverTsuyoshi OzawaTsuyoshi Ozawa
YARN-3706Generalize native HBase writer for additional tablesMinortimelineserverJoep RottinghuisJoep Rottinghuis
YARN-3792Test case failures in TestDistributedShell and some issue fixes related to ATSV2MajortimelineserverNaganarasimha G RNaganarasimha G R
YARN-3051[Storage abstraction] Create backing storage read interface for ATS readersMajortimelineserverSangjin LeeVarun Saxena
YARN-3047[Data Serving] Set up ATS reader with basic request serving structure and lifecycleMajortimelineserverSangjin LeeVarun Saxena
YARN-3836add equals and hashCode to TimelineEntity and other classes in the data modelMajortimelineserverSangjin LeeLi Lu
YARN-3445Cache runningApps in RMNode for getting running apps on given NodeIdMajornodemanager, resourcemanagerJunping DuJunping Du
YARN-3116[Collector wireup] We need an assured way to determine if a container is an AM container on NMMajornodemanager, timelineserverZhijie ShenGiovanni Matteo Fumarola
YARN-3949ensure timely flush of timeline writesMajortimelineserverSangjin LeeSangjin Lee
YARN-3908Bugs in HBaseTimelineWriterImplMajortimelineserverZhijie ShenVrushali C
YARN-3993Change to use the AM flag in ContainerContext determine AM containerMajortimelineserverZhijie ShenSunil Govindan
YARN-3984Rethink event column key issueMajortimelineserverZhijie ShenVrushali C
YARN-3049[Storage Implementation] Implement storage reader interface to fetch raw data from HBase backendMajortimelineserverSangjin LeeZhijie Shen
YARN-3906split the application table from the entity tableMajortimelineserverSangjin LeeSangjin Lee
YARN-3904Refactor timelineservice.storage to add support to online and offline aggregation writersMajortimelineserverLi LuLi Lu
YARN-3045[Event producers] Implement NM writing container lifecycle events to ATSMajortimelineserverSangjin LeeNaganarasimha G R
YARN-4025Deal with byte representations of Longs in writer codeMajortimelineserverVrushali CSangjin Lee
YARN-4064build is broken at TestHBaseTimelineWriterImpl.javaBlockertimelineserverSangjin LeeSangjin Lee
YARN-3814REST API implementation for getting raw entities in TimelineReaderMajortimelineserverVarun SaxenaVarun Saxena
YARN-4058Miscellaneous issues in NodeManager projectMinortimelineserverNaganarasimha G RNaganarasimha G R
YARN-2884Proxying all AM-RM communicationsMajornodemanager, resourcemanagerCarlo CurinoKishore Chaliparambil
YARN-4102Add a "skip existing table" mode for timeline schema creatorMajortimelineserverLi LuLi Lu
YARN-3901Populate flow run data in the flow_run & flow activity tablesMajortimelineserverVrushali CVrushali C
YARN-4074[timeline reader] implement support for querying for flows and flow runsMajortimelineserverSangjin LeeSangjin Lee
YARN-4075[reader REST API] implement support for querying for flows and flow runsMajortimelineserverSangjin LeeVarun Saxena
YARN-4203Add request/response logging & timing for each REST endpoint callMinortimelineserverVrushali CVarun Saxena
YARN-4210HBase reader throws NPE if Get returns no rowsMajortimelineserverVarun SaxenaVarun Saxena
YARN-3864Implement support for querying single app and all apps for a flow runBlockertimelineserverVarun SaxenaVarun Saxena
YARN-4178[storage implementation] app id as string in row keys can cause incorrect orderingMajortimelineserverSangjin LeeVarun Saxena
YARN-4237Support additional queries for ATSv2 Web UIMajor.Varun SaxenaVarun Saxena
YARN-4179[reader implementation] support flow activity queries based on timeMinortimelineserverSangjin LeeVarun Saxena
YARN-4129Refactor the SystemMetricPublisher in RM to better support newer eventsMajorresourcemanagerNaganarasimha G RNaganarasimha G R
YARN-4221Store user in app to flow tableMajortimelineserverVarun SaxenaVarun Saxena
YARN-4053Change the way metric values are stored in HBase StorageMajortimelineserverVarun SaxenaVarun Saxena
YARN-4297TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branchMajor.Varun SaxenaVarun Saxena
YARN-3862Support for fetching specific configs and metrics based on prefixesMajortimelineserverVarun SaxenaVarun Saxena
HDFS-9129Move the safemode block count into BlockManagerMajornamenodeHaohui MaiMingliang Liu
HDFS-9414Refactor reconfiguration of ClientDatanodeProtocol for reusabilityMajor.Xiaobing ZhouXiaobing Zhou
YARN-4356ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned offCriticaltimelineserverSangjin LeeSangjin Lee
YARN-4450TestTimelineAuthenticationFilter and TestYarnConfigurationFields failMajortimelineserverSangjin LeeSangjin Lee
HDFS-9371Code cleanup for DatanodeManagerMajornamenodeJing ZhaoJing Zhao
YARN-4460[Bug fix] RM fails to start when SMP is enabledMajortimelineserverLi LuLi Lu
YARN-4445Unify the term flowId and flowName in timeline v2 codebaseMajortimelineserverLi LuZhan Zhang
YARN-1856cgroups based memory monitoring for containersMajornodemanagerKarthik KambatlaVarun Vasudev
YARN-4350TestDistributedShell fails for V2 scenariosMajortimelineserverSangjin LeeNaganarasimha G R
YARN-3586RM only get back addresses of Collectors that NM needs to know.Criticalresourcemanager, timelineserverJunping DuJunping Du
YARN-2882Add an OPPORTUNISTIC ExecutionTypeMajornodemanagerKonstantinos KaranasosKonstantinos Karanasos
YARN-3480Recovery may get very slow with lots of services with lots of app-attemptsMajorresourcemanagerJun GongJun Gong
HDFS-9498Move code that tracks blocks with future generation stamps to BlockManagerSafeModeMajornamenodeMingliang LiuMingliang Liu
YARN-4550some tests in TestContainerLanch fails on non-english locale environmentMinornodemanager, testTakashi OhnishiTakashi Ohnishi
YARN-4335Allow ResourceRequests to specify ExecutionType of a request askMajornodemanager, resourcemanagerKonstantinos KaranasosKonstantinos Karanasos
YARN-3995Some of the NM events are not getting published due race condition when AM container finishes in NMMajornodemanager, timelineserverNaganarasimha G RNaganarasimha G R
YARN-4200Refactor reader classes in storage to nest under hbase specific package nameMinortimelineserverVrushali CLi Lu
YARN-4553Add cgroups support for docker containersMajoryarnSidharta SeethanaSidharta Seethana
YARN-4526Make SystemClock singleton so AppSchedulingInfo could use itMajorschedulerKarthik KambatlaKarthik Kambatla
HDFS-9542Move BlockIdManager from FSNamesystem to BlockManagerMajornamenodeJing ZhaoJing Zhao
YARN-4622TestDistributedShell fails for v2 test cases after modifications for 1.5MajortimelineserverNaganarasimha G RNaganarasimha G R
YARN-4578Directories that are mounted in docker containers need to be more restrictive/container-specificMajoryarnSidharta SeethanaSidharta Seethana
YARN-4574TestAMRMClientOnRMRestart fails on trunkMajorclient, testTakashi OhnishiTakashi Ohnishi
YARN-4613TestClientRMService#testGetClusterNodes fails occasionallyMajortestJason LoweTakashi Ohnishi
HDFS-9094Add command line option to ask NameNode reload configuration.MajornamenodeXiaobing ZhouXiaobing Zhou
YARN-4238correctly set createdTime and remove modifiedTime when publishing entitiesMajortimelineserverVarun SaxenaVarun Saxena
YARN-4224Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARNMajortimelineserverVarun SaxenaVarun Saxena
YARN-4644TestRMRestart fails and findbugs issue in YARN-2928 branchMajortimelineserverVarun SaxenaVarun Saxena
YARN-4633TestRMRestart.testRMRestartAfterPreemption fails intermittently in trunkMajortestRohith Sharma K SBibin A Chundatt
YARN-4615TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt fails occasionallyMajortestJason LoweSunil Govindan
YARN-4446Refactor reader API for better extensibilityMajortimelineserverVarun SaxenaVarun Saxena
YARN-4409Fix javadoc and checkstyle issues in timelineservice codeMajortimelineserverVarun SaxenaVarun Saxena
YARN-3367Replace starting a separate thread for post entity with event loop in TimelineClientMajortimelineserverJunping DuNaganarasimha G R
YARN-4684TestYarnCLI#testGetContainers failing in CN localeMajoryarnBibin A ChundattBibin A Chundatt
HDFS-9691TestBlockManagerSafeMode#testCheckSafeMode fails intermittentlyMajortestMingliang LiuMingliang Liu
HADOOP-12710Remove dependency on commons-httpclient for TestHttpServerLogsMajor.Wei-Chiu ChuangWei-Chiu Chuang
YARN-4700ATS storage has one extra record each time the RM got restartedMajortimelineserverLi LuNaganarasimha G R
MAPREDUCE-6546reconcile the two versions of the timeline service performance testsMinor.Sangjin LeeSangjin Lee
HDFS-1477Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restartMajornamenodePatrick KlingXiaobing Zhou
YARN-4062Add the flush and compaction functionality via coprocessors and scanners for flow run tableMajortimelineserverVrushali CVrushali C
YARN-4712CPU Usage Metric is not captured properly in YARN-2928MajortimelineserverNaganarasimha G RNaganarasimha G R
HADOOP-12926lz4.c does not detect 64-bit mode properlyMajornativeAlan BurlisonAlan Burlison
YARN-4687Document Reservation ACLsMinor.Sean PoSean Po
YARN-4805Don't go through all schedulers in ParameterizedTestBaseMajor.Karthik KambatlaKarthik Kambatla
YARN-4711NM is going down with NPE's due to single thread processing of events by Timeline clientCriticaltimelineserverNaganarasimha G RNaganarasimha G R
HDFS-9349Support reconfiguring fs.protected.directories without NN restartMajornamenodeXiaobing ZhouXiaobing Zhou
YARN-4811Generate histograms in ContainerMetrics for actual container resource usageMajor.Varun VasudevVarun Vasudev
YARN-3461Consolidate flow name/version/run defaultsMajortimelineserverZhijie ShenSangjin Lee
HADOOP-12753S3A JUnit tests failing if using HTTP proxyMinorfs/s3Zoran RajicZoran Rajic
YARN-3863Support complex filters in TimelineReaderMajor.Varun SaxenaVarun Saxena
HDFS-10209Support enable caller context in HDFS namenode audit log without restart namenodeMajor.Xiaoyu YaoXiaobing Zhou
HDFS-10286Fix TestDFSAdmin#testNameNodeGetReconfigurablePropertiesMajor.Xiaoyu YaoXiaobing Zhou
HDFS-10284o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittentlyMajortestMingliang LiuMingliang Liu
YARN-2883Queuing of container requests in the NMMajornodemanager, resourcemanagerKonstantinos KaranasosKonstantinos Karanasos
YARN-4890Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdateMajor.Wangda TanSunil Govindan
HDFS-10207Support enable Hadoop IPC backoff without namenode restartMajor.Xiaoyu YaoXiaobing Zhou
YARN-4968A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped.Major.Wangda TanWangda Tan
YARN-3816[Aggregation] App-level aggregation and accumulation for YARN system metricsMajortimelineserverJunping DuLi Lu
YARN-4846Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainersMajor.Bibin A ChundattBibin A Chundatt
YARN-2885Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containersMajornodemanager, resourcemanagerKonstantinos KaranasosArun Suresh
YARN-4991Fix ContainerRequest Constructor to set nodelabelExpression correctlyMajortestBibin A ChundattBibin A Chundatt
YARN-4966Improve yarn logs to fetch container logs without specifying nodeIdMajor.Xuan GongXuan Gong
YARN-4807MockAM#waitForState sleep duration is too longMajor.Karthik KambatlaYufei Gu
YARN-3998Add support in the NodeManager to re-launch containersMajor.Jun GongJun Gong
YARN-4986Add a check in the coprocessor for table to operated onMajortimelineserverVrushali CVrushali C
YARN-5014Ensure non-metric values are returned as is for flow run table from the coprocessorMajortimelineserverVrushali CVrushali C
YARN-3150[Documentation] Documenting the timeline service v2Major.Zhijie ShenSangjin Lee
MAPREDUCE-6424Store MR counters as timeline metrics instead of eventMajor.Junping DuNaganarasimha G R
YARN-4447Provide a mechanism to represent complex filters and parse them at the REST layerMajortimelineserverVarun SaxenaVarun Saxena
MAPREDUCE-6688Store job configurations in Timeline Service v2MajorapplicationmasterJunping DuVarun Saxena
YARN-4920ATS/NM should support a link to dowload/get the logs in text formatMajoryarnXuan GongXuan Gong
YARN-4905Improve "yarn logs" command-line to optionally show log metadata alsoMajor.Xuan GongXuan Gong
YARN-4595Add support for configurable read-only mounts when launching Docker containersMajoryarnBillie RinaldiBillie Rinaldi
YARN-5045hbase unit tests fail due to dependency issuesBlockertimelineserverSangjin LeeSangjin Lee
YARN-4778Support specifying resources for task containers in SLSMajor.Wangda TanWangda Tan
YARN-4842"yarn logs" command should not require the appOwner argumentMajor.Ram VenkateshXuan Gong
YARN-5073Refactor startContainerInternal() in ContainerManager to remove unused parameterMinornodemanager, resourcemanagerKonstantinos KaranasosKonstantinos Karanasos
HDFS-9389Add maintenance states to AdminStatesMajor.Ming MaMing Ma
YARN-2888Corrective mechanisms for rebalancing NM container queuesMajornodemanager, resourcemanagerKonstantinos KaranasosArun Suresh
YARN-4738Notify the RM about the status of OPPORTUNISTIC containersMajornodemanager, resourcemanagerKonstantinos KaranasosKonstantinos Karanasos
YARN-5075Fix findbugs warning in hadoop-yarn-common moduleMajor.Akira AjisakaArun Suresh
YARN-4412Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containersMajornodemanager, resourcemanagerArun SureshArun Suresh
YARN-5102timeline service build fails with java 8BlockertimelineserverSangjin LeeSangjin Lee
YARN-5090Add End-to-End test-cases for DistributedScheduling using MiniYarnClusterMajor.Arun SureshArun Suresh
YARN-5096timelinereader has a lot of logging that's not usefulMinortimelineserverSangjin LeeSangjin Lee
YARN-4913Yarn logs should take a -out option to write to a directoryMajor.Xuan GongXuan Gong
HDFS-2173saveNamespace should not throw IOE when only one storage directory fails to write VERSION fileMajor.Todd LipconAndras Bokor
YARN-5110Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIdsMajor.Arun SureshKonstantinos Karanasos
YARN-5050Code cleanup for TestDistributedShellMajortimelineserverLi LuLi Lu
YARN-5016Add support for a minimum retry interval for container retriesMajor.Varun VasudevJun Gong
HDFS-7766Add a flag to WebHDFS op=CREATE to not respond with a 307 redirectMajorui, webhdfsRavi PrakashRavi Prakash
YARN-5093created time shows 0 in most REST outputCriticaltimelineserverSangjin LeeVarun Saxena
YARN-5018Online aggregation logic should not run immediately after collectors got startedMajortimelineserverLi LuLi Lu
YARN-5115Avoid setting CONTENT-DISPOSITION header in the container-logs web-serviceMajor.Xuan GongXuan Gong
YARN-5097NPE in Separator.joinEncoded()CriticaltimelineserverSangjin LeeVrushali C
YARN-5095flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabledCriticaltimelineserverSangjin LeeVarun Saxena
YARN-5138fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-testsMajortimelineserverVrushali CVrushali C
YARN-5109timestamps are stored unencoded causing parse errorsBlockertimelineserverSangjin LeeVarun Saxena
YARN-5089Improve "yarn log" command-line "logFiles" option to support regexMajor.Xuan GongXuan Gong
YARN-5127Expose ExecutionType in Container api recordMajor.Arun SureshHitesh Sharma
YARN-5117QueuingContainerManager does not start GUARANTEED Container even if Resources are availableMajor.Arun SureshKonstantinos Karanasos
YARN-5111YARN container system metrics are not aggregated to applicationCriticaltimelineserverSangjin LeeNaganarasimha G R
YARN-4007Add support for different network setups when launching the docker containerMajornodemanagerVarun VasudevSidharta Seethana
YARN-5141Get Container logs for the Running application from Yarn Logs CommandLineMajor.Xuan GongXuan Gong
YARN-5105entire time series is returned for YARN container system metrics (CPU and memory)MajortimelineserverSangjin LeeVarun Saxena
YARN-5088Improve "yarn log" command-line to read the last K bytes for the log filesMajor.Xuan GongXuan Gong
YARN-5162Fix Exceptions thrown during registerAM call when Distributed Scheduling is EnabledMajor.Arun SureshHitesh Sharma
YARN-5189Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*ImplMajortimelineserverJoep RottinghuisJoep Rottinghuis
HDFS-9877HDFS Namenode UI: Fix browsing directories that need to be encodedMajoruiRavi PrakashRavi Prakash
HDFS-7767Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UIMajorui, webhdfsRavi PrakashRavi Prakash
YARN-5142fix findbugs warnings/errors for hadoop-yarn-server-timelineservice-hbase-testsMajortimelineserverVrushali CVrushali C
YARN-5167Escaping occurences of encodedValuesCriticaltimelineserverJoep RottinghuisSangjin Lee
YARN-5180Allow ResourceRequest to specify an enforceExecutionType flagMajor.Arun SureshArun Suresh
YARN-5176More test cases for queuing of containers at the NMMajor.Konstantinos KaranasosKonstantinos Karanasos
YARN-5204Properly report status of killed/stopped queued containersMajor.Konstantinos KaranasosKonstantinos Karanasos
YARN-5210NPE in Distributed Shell while publishing DS_CONTAINER_START event and other miscellaneous issuesMajortimelineserverVarun SaxenaVarun Saxena
YARN-5191Rename the “download=true” option for getLogs in NMWebServices and AHSWebServicesMajor.Xuan GongXuan Gong
YARN-5170Eliminate singleton converters and static method accessMajortimelineserverJoep RottinghuisJoep Rottinghuis
HDFS-7987Allow files / directories to be movedMajoruiRavi PrakashRavi Prakash
YARN-5052[Documentation] Update timeline service v2 documentation to capture information about filtersMajortimelineserverVarun SaxenaVarun Saxena
YARN-5124Modify AMRMClient to set the ExecutionType in the ResourceRequestMajor.Arun SureshArun Suresh
YARN-5212Run existing ContainerManager tests using QueuingContainerManagerImplMajor.Konstantinos KaranasosKonstantinos Karanasos
YARN-4887AM-RM protocol changes for identifying resource-requests explicitlyMajorapplications, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5223Container line in yarn logs output for a live application should include the hostname for the containerMajor.Siddharth SethXuan Gong
YARN-5122"yarn logs" for running containers should print an explicit footer saying that the log may be incompleteMajor.Vinod Kumar VavilapalliJian He
YARN-5243fix several rebase and other miscellaneous issues before mergeMajortimelineserverSangjin LeeSangjin Lee
YARN-5070upgrade HBase version for first mergeCriticaltimelineserverSangjin LeeVrushali C
YARN-5251Yarn CLI to obtain App logs for last 'n' bytes fails with 'java.io.IOException' and for 'n' bytes fails with NumberFormatExceptionBlocker.Sumana SathishXuan Gong
HDFS-10328Add per-cache-pool default replication num configurationMinorcachingxupengxupeng
YARN-5171Extend DistributedSchedulerProtocol to notify RM of containers allocated by the NodeMajor.Arun SureshÍñigo Goiri
MAPREDUCE-6720Inconsistent values of counters across tasks and job reported to timeline service.MajorapplicationmasterVarun SaxenaVarun Saxena
YARN-5300Exclude generated federation protobuf sources from YARN Javadoc/findbugs buildMinornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5174[documentation] several updates/corrections to timeline service documentationMajortimelineserverSangjin LeeSangjin Lee
YARN-5227yarn logs command: no need to specify -applicationId when specifying containerIdMajor.Jian HeGergely Novák
YARN-5224Logs for a completed container are not available in the yarn logs output for a live applicationMajor.Siddharth SethXuan Gong
YARN-5316fix hadoop-aws pom not to do the exclusionMajortimelineserverSangjin LeeSangjin Lee
YARN-5233Support for specifying a path for ATS plugin jarsMajortimelineserverLi LuLi Lu
YARN-5200Improve yarn logs to get Container ListMajor.Xuan GongXuan Gong
YARN-5299Log Docker run command when container failsMajoryarnVarun VasudevVarun Vasudev
YARN-4759Fix signal handling for docker containersMajoryarnSidharta SeethanaShane Kumpf
YARN-5363For AM containers, or for containers of running-apps, "yarn logs" incorrectly only (tries to) shows syslog file-type by defaultMajorlog-aggregationVinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-5298Mount usercache and NM filecache directories into Docker containerMajoryarnVarun VasudevSidharta Seethana
YARN-5361Obtaining logs for completed container says 'file belongs to a running container ' at the endCritical.Sumana SathishXuan Gong
YARN-5156YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running stateMajortimelineserverLi LuVrushali C
YARN-5350Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lostMajor.Arun SureshArun Suresh
YARN-5392Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerRequestKeyMajor.Arun SureshArun Suresh
YARN-5351ResourceRequest should take ExecutionType into account during comparisonMajor.Konstantinos KaranasosKonstantinos Karanasos
YARN-3662Federation Membership State Store internal APIsMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5229Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImplMinortimelineserverJoep RottinghuisVrushali C
YARN-5113Refactoring and other clean-up for distributed schedulingMajor.Arun SureshKonstantinos Karanasos
YARN-5458Rename DockerStopCommandTest to TestDockerStopCommandTrivial.Shane KumpfShane Kumpf
YARN-5443Add support for docker inspect commandMajoryarnShane KumpfShane Kumpf
YARN-5226remove AHS enable check from LogsCLI#fetchAMContainerLogsMajor.Xuan GongXuan Gong
YARN-5459Add support for docker rmMinoryarnShane KumpfShane Kumpf
YARN-5406In-memory based implementation of the FederationMembershipStateStoreMajornodemanager, resourcemanagerSubru KrishnanEllen Hui
YARN-5390Federation Subcluster ResolverMajornodemanager, resourcemanagerCarlo CurinoEllen Hui
YARN-5429Fix @return related javadoc warnings in yarn-apiMajor.Vrushali CVrushali C
YARN-4888Changes in scheduler to identify resource-requests explicitly by allocation-idMajorresourcemanagerSubru KrishnanSubru Krishnan
YARN-5307Federation Application State Store internal APIsMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-3664Federation PolicyStore internal APIsMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5470Differentiate exactly match with regex in yarn log CLIMajor.Xuan GongXuan Gong
YARN-5408Compose Federation membership/application/policy APIs into an uber FederationStateStore APIMajornodemanager, resourcemanagerSubru KrishnanEllen Hui
YARN-5394Remove bind-mount /etc/passwd for Docker containersMajoryarnZhankun TangZhankun Tang
YARN-5407In-memory based implementation of the FederationApplicationStateStore, FederationPolicyStateStoreMajornodemanager, resourcemanagerSubru KrishnanEllen Hui
YARN-5137Make DiskChecker pluggable in NodeManagerMajornodemanagerRay ChiangYufei Gu
YARN-5519Add SubClusterId in AddApplicationHomeSubClusterResponse for Router FailoverMajornodemanager, resourcemanagerGiovanni Matteo FumarolaEllen Hui
YARN-5514Clarify DecommissionType.FORCEFUL commentMinordocumentationRobert KanterVrushali C
YARN-3672Create Facade for Federation State and Policy StoreMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5467InputValidator for the FederationStateStore internal APIsMajornodemanager, resourcemanagerSubru KrishnanGiovanni Matteo Fumarola
YARN-4676Automatic and Asynchronous Decommissioning Nodes Status TrackingMajorresourcemanagerDaniel ZhiDaniel Zhi
YARN-3673Create a FailoverProxy for Federation servicesMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5457Refactor DistributedScheduling framework to pull out common functionalityMajorresourcemanagerArun SureshArun Suresh
YARN-5042Mount /sys/fs/cgroup into Docker containers as read only mountMajoryarnVarun Vasudevluhuichun
YARN-5564Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLETrivialfairschedulerRay ChiangRay Chiang
YARN-5557Add localize API to the ContainerManagementProtocolMajor.Jian HeJian He
YARN-5327API changes required to support recurring reservations in the YARN ReservationSystemMajorresourcemanagerSubru KrishnanSangeetha Abdu Jyothi
YARN-4889Changes in AMRMClient for identifying resource-requests explicitlyMajorresourcemanagerSubru KrishnanArun Suresh
YARN-3671Integrate Federation services with ResourceManagerMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
HDFS-9392Admins support for maintenance stateMajor.Ming MaMing Ma
HDFS-10813DiskBalancer: Add the getNodeList method in CommandMinorbalancer & moverYiqun LinYiqun Lin
YARN-5221Expose UpdateResourceRequest API to allow AM to request for change in container propertiesMajor.Arun SureshArun Suresh
YARN-5596Fix failing unit test in TestDockerContainerRuntimeMinornodemanager, yarnSidharta SeethanaSidharta Seethana
YARN-5612Return SubClusterId in FederationStateStoreFacade#addApplicationHomeSubCluster for Router FailoverMajornodemanager, resourcemanagerGiovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-5601Make the RM epoch base value configurableMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5264Store all queue-specific information in FSQueueMajorfairschedulerYufei GuYufei Gu
YARN-5576Allow resource localization while container is runningMajor.Jian HeJian He
YARN-5323Policies APIs (for Router and AMRMProxy policies)Majornodemanager, resourcemanagerCarlo CurinoCarlo Curino
YARN-5620Core changes in NodeManager to support re-initialization of Containers with new launchContextMajor.Arun SureshArun Suresh
YARN-4091Add REST API to retrieve scheduler activityMajorcapacity scheduler, resourcemanagerSunil GovindanChen Ge
YARN-5637Changes in NodeManager to support Container rollback and commitMajor.Arun SureshArun Suresh
YARN-3140Improve locks in AbstractCSQueue/LeafQueue/ParentQueueMajorresourcemanager, schedulerWangda TanWangda Tan
YARN-3141Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerAppMajorresourcemanager, schedulerWangda TanWangda Tan
YARN-5324Stateless Federation router policies implementationMajornodemanager, resourcemanagerCarlo CurinoCarlo Curino
YARN-5609Expose upgrade and restart API in ContainerManagementProtocolMajor.Arun SureshArun Suresh
HDFS-9895Remove unnecessary conf cache from DataNodeMajordatanodeXiaobing ZhouXiaobing Zhou
YARN-3142Improve locks in AppSchedulingInfoMajorresourcemanager, schedulerWangda TanVarun Saxena
YARN-4205Add a service for monitoring application life time outMajorschedulernijelRohith Sharma K S
YARN-5486Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requestsMajorresourcemanagerArun SureshKonstantinos Karanasos
YARN-5384Expose priority in ReservationSystem submission APIsMajorcapacity scheduler, fairscheduler, resourcemanagerSean PoSean Po
YARN-5702Refactor TestPBImplRecords so that we can reuse for testing protocol records in other YARN modulesMajor.Subru KrishnanSubru Krishnan
YARN-3139Improve locks in AbstractYarnScheduler/CapacityScheduler/FairSchedulerMajorresourcemanager, schedulerWangda TanWangda Tan
HDFS-10893Refactor TestDFSShell by setting up MiniDFSCluser once for all commands testMajortestMingliang LiuMingliang Liu
HADOOP-13627Have an explicit KerberosAuthException for UGI to throw, text from public constantsMajorsecuritySteve LoughranXiao Chen
YARN-5325Stateless ARMRMProxy policies implementationMajornodemanager, resourcemanagerCarlo CurinoCarlo Curino
YARN-5638Introduce a collector timestamp to uniquely identify collectors creation order in collector discoveryMajortimelineserverLi LuLi Lu
YARN-5699Retrospect yarn entity fields which are publishing in events info fields.Major.Rohith Sharma K SRohith Sharma K S
HDFS-9390Block management for maintenance statesMajor.Ming MaMing Ma
YARN-5561[Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via RESTMajortimelinereaderRohith Sharma K SRohith Sharma K S
YARN-4911Bad placement policy in FairScheduler causes the RM to crashMajorfairschedulerRay ChiangRay Chiang
YARN-5047Refactor nodeUpdate across schedulersMajorcapacityscheduler, fairscheduler, schedulerRay ChiangRay Chiang
YARN-3649Allow configurable prefix for hbase table names (like prod, exp, test etc)MajortimelineserverVrushali CVrushali C
YARN-5715introduce entity prefix for return and sort orderCriticaltimelineserverSangjin LeeRohith Sharma K S
YARN-4097Create POC timeline web UI with new YARN web UI frameworkMajortimelineserverLi LuLi Lu
YARN-5799Fix Opportunistic Allocation to set the correct value of Node Http AddressMajorresourcemanagerArun SureshArun Suresh
YARN-4765Split TestHBaseTimelineStorage into multiple test classesMajortimelineserverVarun SaxenaVarun Saxena
YARN-5793Trim configuration values in DockerLinuxContainerRuntimeMinornodemanagerTianyin XuTianyin Xu
YARN-5391PolicyManager to tie together Router/AMRM Federation policiesMajornodemanager, resourcemanagerCarlo CurinoCarlo Curino
YARN-5265Make HBase configuration for the timeline service configurableMajortimelineserverJoep RottinghuisJoep Rottinghuis
YARN-2995Enhance UI to show cluster resource utilization of various container Execution typesBlockerresourcemanagerSriram RaoKonstantinos Karanasos
YARN-3359Recover collector list when RM fails overMajorresourcemanagerJunping DuLi Lu
YARN-5716Add global scheduler interface definition and update CapacityScheduler to use it.MajorcapacityschedulerWangda TanWangda Tan
YARN-5833Add validation to ensure default ports are unique in ConfigurationMajoryarnKonstantinos KaranasosKonstantinos Karanasos
YARN-4329Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair SchedulerMajorfairscheduler, resourcemanagerNaganarasimha G RYufei Gu
YARN-5611Provide an API to update lifetime of an application.MajorresourcemanagerRohith Sharma K SRohith Sharma K S
HDFS-11119Support for parallel checking of StorageLocations on DataNode startupMajordatanodeArpit AgarwalArpit Agarwal
HDFS-11114Support for running async disk checks in DataNodeMajordatanodeArpit AgarwalArpit Agarwal
YARN-5634Simplify initialization/use of RouterPolicy via a RouterPolicyFacadeMajornodemanager, resourcemanagerCarlo CurinoCarlo Curino
YARN-5792adopt the id prefix for YARN, MR, and DS entitiesMajortimelineserverSangjin LeeVarun Saxena
HDFS-11148Update DataNode to use StorageLocationChecker at startupMajordatanodeArpit AgarwalArpit Agarwal
YARN-5676Add a HashBasedRouterPolicy, and small policies and test refactoring.Majornodemanager, resourcemanagerCarlo CurinoCarlo Curino
YARN-5872Add AlwayReject policies for router and amrmproxy.Majornodemanager, resourcemanagerCarlo CurinoCarlo Curino
YARN-5905Update the RM webapp host that is reported as part of Federation membership to current primary RM's IPMinorfederation, resourcemanagerSubru KrishnanSubru Krishnan
YARN-5865Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611Major.Sunil GovindanSunil Govindan
YARN-5649Add REST endpoints for updating application timeoutsMajorschedulerRohith Sharma K SRohith Sharma K S
YARN-4206Add Application timeouts in Application report and CLIMajorschedulernijelRohith Sharma K S
HDFS-11149Support for parallel checking of FsVolumesMajordatanodeArpit AgarwalArpit Agarwal
HDFS-8678Bring back the feature to view chunks of files in the HDFS file browserMajoruiRavi PrakashRavi Prakash
YARN-5761Separate QueueManager from SchedulerMajorcapacityschedulerXuan GongXuan Gong
YARN-5746The state of the parentQueue and its childQueues should be synchronized.Majorcapacity scheduler, resourcemanagerXuan GongXuan Gong
YARN-5965Retrospect ApplicationReport#getApplicationTimeoutsMajorschedulerJian HeRohith Sharma K S
YARN-5739Provide timeline reader API to list available timeline entity types for one applicationMajortimelinereaderLi LuLi Lu
MAPREDUCE-6818Remove direct reference to TimelineClientImplMajor.Li LuLi Lu
YARN-5982Simplify opportunistic container parameters and metricsMajor.Konstantinos KaranasosKonstantinos Karanasos
YARN-5970Validate application update timeout request parametersMajorschedulerRohith Sharma K SRohith Sharma K S
YARN-5524Yarn live log aggregation does not throw if command line arg is wrongMajorlog-aggregationPrasanth JayachandranXuan Gong
YARN-5650Render Application Timeout value in web UIMajorschedulerRohith Sharma K SAkhil PB
HDFS-11182Update DataNode to use DatasetVolumeCheckerMajordatanodeArpit AgarwalArpit Agarwal
YARN-5976Update hbase version to 1.2 (removes phoenix dependencies)Major.Vrushali CVrushali C
YARN-5216Expose configurable preemption policy for OPPORTUNISTIC containers running on the NMMajordistributed-schedulingArun SureshHitesh Sharma
YARN-5938Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixesMajor.Arun SureshArun Suresh
YARN-5756Add state-machine implementation for scheduler queuesMajor.Xuan GongXuan Gong
YARN-5931Document timeout interfaces CLI and REST APIsMajorschedulerRohith Sharma K SRohith Sharma K S
YARN-5529Create new DiskValidator class with metricsMajornodemanagerRay ChiangYufei Gu
YARN-6025Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementationsMajorcapacity scheduler, schedulerNaganarasimha G RNaganarasimha G R
YARN-5923Unable to access logs for a running application if YARN_ACL_ENABLE is enabledMajor.Xuan GongXuan Gong
YARN-5906Update AppSchedulingInfo to use SchedulingPlacementSetMajor.Wangda TanWangda Tan
YARN-6009RM fails to start during an upgrade - Failed to load/recover state (YarnException: Invalid application timeout, value=0 for type=LIFETIME)CriticalresourcemanagerGour SahaRohith Sharma K S
YARN-5585[Atsv2] Reader side changes for entity prefix and support for pagination via additional filtersCriticaltimelinereaderRohith Sharma K SRohith Sharma K S
YARN-6074FlowRunEntity does not deserialize long values correctlyMajortimelinereaderRohith Sharma K SRohith Sharma K S
YARN-3955Support for application priority ACLs in queues of CapacitySchedulerMajorcapacityschedulerSunil GovindanSunil Govindan
HDFS-9391Update webUI/JMX to display maintenance state infoMajor.Ming MaManoj Govindassamy
YARN-5416TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stoppedMinortest, yarnJunping DuJunping Du
YARN-5980Update documentation for single node hbase deployMajortimelineserverVrushali CVrushali C
YARN-6011Add a new web service to list the files on a container in AHSWebServiceMajor.Xuan GongXuan Gong
YARN-5378Accommodate app-id->cluster mappingMajortimelineserverJoep RottinghuisSangjin Lee
YARN-6016Fix minor bugs in handling of local AMRMToken in AMRMProxyMinorfederationBotong HuangBotong Huang
YARN-5556CapacityScheduler: Support deleting queues without requiring a RM restartMajorcapacity schedulerXuan GongNaganarasimha G R
YARN-6064Support fromId for flowRuns and flow/flowRun apps REST API'sMajortimelinereaderRohith Sharma K SRohith Sharma K S
HDFS-11259Update fsck to display maintenance state infoMajordatanode, namenodeManoj GovindassamyManoj Govindassamy
YARN-6094Update the coprocessor to be a dynamically loaded oneMajortimelineserverVrushali CVrushali C
YARN-5831Propagate allowPreemptionFrom flag all the way down to the appMajorfairschedulerKarthik KambatlaYufei Gu
HDFS-11296Maintenance state expiry should be an epoch time and not jvm monotonicMajor.Manoj GovindassamyManoj Govindassamy
YARN-6099Improve webservice to list aggregated log filesMajor.Xuan GongXuan Gong
YARN-5830FairScheduler: Avoid preempting AM containersMajorfairschedulerKarthik KambatlaYufei Gu
YARN-3637Handle localization sym-linking correctly at the YARN levelMajor.Chris TrezzoChris Trezzo
YARN-6126Obtaining app logs for Running application fails with "Unable to parse json from webservice. Error:"Major.Sumana SathishXuan Gong
YARN-6100improve YARN webservice to output aggregated container logsMajor.Xuan GongXuan Gong
YARN-5951Changes to allow CapacityScheduler to use configuration storeMajor.Jonathan HungJonathan Hung
YARN-6108Improve AHS webservice to accept NM address as a parameter to get container logsMajor.Xuan GongXuan Gong
YARN-5258Document Use of Docker with LinuxContainerExecutorCriticaldocumentationDaniel TempletonDaniel Templeton
HADOOP-14032Reduce fair call queue priority inversionMajoripcDaryn SharpDaryn Sharp
HADOOP-14034Allow ipc layer exceptions to selectively close connectionsMajoripcDaryn SharpDaryn Sharp
HADOOP-14033Reduce fair call queue lock contentionMajoripcDaryn SharpDaryn Sharp
YARN-6170TimelineReaderServer should wait to join with HttpServer2MinortimelinereaderSangjin LeeSangjin Lee
HADOOP-13075Add support for SSE-KMS and SSE-C in s3a filesystemMajorfs/s3Andrew OlsonSteve Moist
YARN-6113re-direct NM Web Service to get container logs for finished applicationsMajor.Xuan GongXuan Gong
YARN-5966AMRMClient changes to support ExecutionType updateMajor.Arun SureshArun Suresh
YARN-6156AM blacklisting to consider node label partitionMajor.Bibin A ChundattBibin A Chundatt
HDFS-11265Extend visualization for Maintenance Mode under Datanode tab in the NameNode UIMajordatanode, namenodeManoj GovindassamyElek, Marton
YARN-6163FS Preemption is a trickle for severely starved applicationsMajorfairschedulerKarthik KambatlaKarthik Kambatla
YARN-5798Set UncaughtExceptionHandler for all FairScheduler threadsMajorfairschedulerKarthik KambatlaYufei Gu
YARN-4675Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2MajortimelineserverNaganarasimha G RNaganarasimha G R
HADOOP-14040Use shaded aws-sdk uber-JAR 1.11.86Majorbuild, fs/s3Steve LoughranSteve Loughran
YARN-6193FairScheduler might not trigger preemption when using DRFMajorfairschedulerKarthik KambatlaKarthik Kambatla
YARN-6159Documentation changes for TimelineV2ClientMinordocumentationVarun SaxenaNaganarasimha G R
HDFS-11430Separate class InnerNode from class NetworkTopology and make it extendableMajornamenodeChen LiangTsz Wo Nicholas Sze
HADOOP-14099Split S3 testing documentation out into its own fileMinordocumentation, fs/s3Steve LoughranSteve Loughran
HDFS-11411Avoid OutOfMemoryError in TestMaintenanceState test runsMajordatanode, namenodeManoj GovindassamyManoj Govindassamy
HADOOP-14102Relax error message assertion in S3A test ITestS3AEncryptionSSECMinorfs/s3Mingliang LiuMingliang Liu
YARN-6069CORS support in timeline v2MajortimelinereaderSreenath SomarajapuramRohith Sharma K S
YARN-5959RM changes to support change of container ExecutionTypeMajor.Arun SureshArun Suresh
YARN-6228EntityGroupFSTimelineStore should allow configurable cache stores.MajortimelineserverLi LuLi Lu
YARN-5410Bootstrap Router server moduleMajornodemanager, resourcemanagerSubru KrishnanGiovanni Matteo Fumarola
YARN-5946Create YarnConfigurationStore interface and InMemoryConfigurationStore classMajor.Jonathan HungJonathan Hung
YARN-6215FairScheduler preemption and update should not run concurrentlyMajorfairscheduler, testSunil GovindanTao Jie
YARN-6123[YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed.Major.Wangda TanWangda Tan
YARN-6253FlowAcitivityColumnPrefix.store(byte[] rowKey, ...) drops timestampMajor.Haibo ChenHaibo Chen
YARN-6190Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicyMinorfederationBotong HuangBotong Huang
YARN-6027Support fromid(offset) filter for /flows APIMajortimelineserverRohith Sharma K SRohith Sharma K S
HDFS-11450HDFS specific network topology classes with storage type info includedMajornamenodeChen LiangChen Liang
HDFS-11412Maintenance minimum replication config value allowable range should be [0, DefaultReplication]Majordatanode, namenodeManoj GovindassamyManoj Govindassamy
YARN-6247Share a single instance of SubClusterResolver instead of instantiating one per AMMinor.Botong HuangBotong Huang
YARN-6256Add FROM_ID info key for timeline entities in reader response.MajortimelineserverRohith Sharma K SRohith Sharma K S
YARN-6237Move UID constant to TimelineReaderUtilsMajortimelinereaderRohith Sharma K SRohith Sharma K S
YARN-5669Add support for Docker pullMajoryarnZhankun Tangluhuichun
YARN-5948Implement MutableConfigurationManager for handling storage into configuration storeMajor.Jonathan HungJonathan Hung
YARN-1047Expose # of pre-emptions as a queue counterMajorfairschedulerPhilip ZeyligerKarthik Kambatla
YARN-6281Cleanup when AMRMProxy fails to initialize a new interceptor chainMinor.Botong HuangBotong Huang
YARN-6318timeline service schema creator fails if executed from a remote machineMinortimelineserverSangjin LeeSangjin Lee
HDFS-11482Add storage type demand to into DFSNetworkTopology#chooseRandomMajornamenodeChen LiangChen Liang
YARN-6314Potential infinite redirection on YARN log redirection web serviceMajor.Xuan GongXuan Gong
YARN-6313yarn logs cli should provide logs for a completed container even when application is still runningMajor.Siddharth SethXuan Gong
HDFS-11514DFSTopologyNodeImpl#chooseRandom optimizationsMajornamenodeChen LiangChen Liang
YARN-6367YARN logs CLI needs alway check containerLogsInfo/containerLogInfo before parse the JSON object from NMWebServiceMajor.Siddharth SethXuan Gong
YARN-6146Add Builder methods for TimelineEntityFiltersMajortimelineserverRohith Sharma K SHaibo Chen
HADOOP-14120needless S3AFileSystem.setOptionalPutRequestParameters in S3ABlockOutputStream putObject()Minorfs/s3Steve LoughranYuanbo Liu
HADOOP-14135Remove URI parameter in AWSCredentialProvider constructorsMajorfs/s3Mingliang LiuMingliang Liu
HADOOP-14196Azure Data Lake doc is missing required config entryMajorfs/adlAtul SikariaAtul Sikaria
HADOOP-14197Fix ADLS doc for credential providerMajordocumentation, fs/adlJohn ZhugeJohn Zhuge
HADOOP-14230TestAdlFileSystemContractLive fails to clean upMinorfs/adl, testJohn ZhugeJohn Zhuge
HADOOP-14038Rename ADLS credential propertiesMinorfs/adlJohn ZhugeJohn Zhuge
HDFS-11577Combine the old and the new chooseRandom for better performanceMajornamenodeChen LiangChen Liang
YARN-6357Implement putEntitiesAsync API in TimelineCollectorMajorATSv2, timelineserverJoep RottinghuisHaibo Chen
YARN-6342Make TimelineV2Client's drain timeout after stop configurableMajor.Jian HeHaibo Chen
YARN-6376Exceptions caused by synchronous putEntities requests can be swallowedCriticalATSv2Haibo ChenHaibo Chen
YARN-6414ATSv2 HBase related tests fail due to guava version upgradeMajortimelineserverSonia GarudiHaibo Chen
YARN-6377NMTimelinePublisher#serviceStop does not stop timeline clientsMajoryarnHaibo ChenHaibo Chen
YARN-5952Create REST API for changing YARN scheduler configurationsMajor.Jonathan HungJonathan Hung
YARN-6109Add an ability to convert ChildQueue to ParentQueueMajorcapacity schedulerXuan GongXuan Gong
YARN-6424TimelineCollector is not stopped when an app finishes in RMCriticaltimelineserverVarun SaxenaVarun Saxena
YARN-5602Utils for Federation State and Policy StoreMajornodemanager, resourcemanagerGiovanni Matteo FumarolaGiovanni Matteo Fumarola
HDFS-10882Federation State Store Interface APIMajorfsJason KaceJason Kace
HADOOP-14290Update SLF4J from 1.7.10 to 1.7.25Major.Akira AjisakaAkira Ajisaka
YARN-6372Add default value for NM disk validatorMajornodemanagerYufei GuYufei Gu
HADOOP-14301Deprecate SharedInstanceProfileCredentialsProvider in branch-2.Majorfs/s3Mingliang LiuMingliang Liu
HADOOP-14255S3A to delete unnecessary fake directory objects in mkdirs()Majorfs/s3Mingliang LiuMingliang Liu
YARN-6040Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classesMajor.Wangda TanWangda Tan
YARN-6203Occasional test failure in TestWeightedRandomRouterPolicyMinorfederationBotong HuangCarlo Curino
YARN-6432FairScheduler: Reserve preempted resources for corresponding applicationsMajor.Miklos SzegediMiklos Szegedi
HADOOP-14321Explicitly exclude S3A root dir ITests from parallel runsMinorfs/s3, testSteve LoughranSteve Loughran
HADOOP-14241Add ADLS sensitive config keys to default listMinorfs, fs/adl, securityJohn ZhugeJohn Zhuge
HADOOP-14324Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnosticsBlockerfs/s3Steve LoughranSteve Loughran
HADOOP-14305S3A SSE tests won't run in parallel: Bad request in directory GetFileStatusMinorfs/s3, testSteve LoughranSteve Moist
YARN-3663Federation State and Policy Store (DBMS implementation)Majornodemanager, resourcemanagerGiovanni Matteo FumarolaGiovanni Matteo Fumarola
HADOOP-14349Rename ADLS CONTRACT_ENABLE_KEYMinorfs/adlMingliang LiuMingliang Liu
YARN-6455Enhance the timelinewriter.flush() race condition fixMajoryarnHaibo ChenHaibo Chen
HDFS-7964Add support for async edit loggingMajornamenodeDaryn SharpDaryn Sharp
YARN-4359Update LowCost agents logic to take advantage of YARN-4358Majorcapacityscheduler, fairscheduler, resourcemanagerCarlo CurinoIshai Menache
YARN-6542Fix the logger in TestAlignedPlanner and TestGreedyReservationAgentMajorreservation systemSubru KrishnanSubru Krishnan
YARN-5331Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystemMajorresourcemanagerSubru KrishnanSangeetha Abdu Jyothi
HDFS-9005Provide configuration support for upgrade domainMajor.Ming MaMing Ma
HDFS-9016Display upgrade domain information in fsckMajor.Ming MaMing Ma
HDFS-9922Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodesMinor.Chris TrezzoChris Trezzo
HDFS-10630Federation State Store FS ImplementationMajorhdfsÍñigo GoiriJason Kace
YARN-5411Create a proxy chain for ApplicationClientProtocol in the RouterMajornodemanager, resourcemanagerSubru KrishnanGiovanni Matteo Fumarola
YARN-6374Improve test coverage and add utility classes for common Docker operationsMajornodemanager, yarnShane KumpfShane Kumpf
YARN-6375App level aggregation should not consider metric values reported in the previous aggregation cycleMajortimelineserverVarun SaxenaVarun Saxena
HDFS-11530Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefaultMajornamenodeYiqun LinYiqun Lin
YARN-6565Fix memory leak and finish app trigger in AMRMProxyCritical.Botong HuangBotong Huang
YARN-6234Support multiple attempts on the node when AMRMProxy is enabledMajoramrmproxy, federation, nodemanagerSubru KrishnanGiovanni Matteo Fumarola
HADOOP-14384Reduce the visibility of FileSystem#newFSDataOutputStreamBuilder before the API becomes stableBlockerfsLei (Eddy) XuLei (Eddy) Xu
YARN-6563ConcurrentModificationException in TimelineCollectorManager while stopping RMMajorresourcemanagerRohith Sharma K SHaibo Chen
YARN-5413Create a proxy chain for ResourceManager Admin API in the RouterMajornodemanager, resourcemanagerSubru KrishnanGiovanni Matteo Fumarola
YARN-6435[ATSv2] Can't retrieve more than 1000 versions of metrics in time seriesCriticaltimelineserverRohith Sharma K SVrushali C
YARN-6561Update exception message during timeline collector aux service initializationMinortimelineserverVrushali CVrushali C
YARN-6306NMClient API change for container upgradeMajor.Jian HeArun Suresh
HADOOP-11572s3a delete() operation fails during a concurrent delete of child entriesMajorfs/s3Steve LoughranSteve Loughran
YARN-5949Add pluggable configuration ACL policy interface and implementationMajor.Jonathan HungJonathan Hung
YARN-6587Refactor of ResourceManager#startWebApp in a Util classMajornodemanager, resourcemanagerGiovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-6555Store application flow context in NM state store for work-preserving restartMajortimelineserverVrushali CRohith Sharma K S
YARN-5531UnmanagedAM pool manager for federating application across clustersMajornodemanager, resourcemanagerSubru KrishnanBotong Huang
HDFS-11446TestMaintenanceState#testWithNNAndDNRestart fails intermittentlyMajor.Yiqun LinYiqun Lin
YARN-6666Fix unit test failure in TestRouterClientRMServiceMinor.Botong HuangBotong Huang
YARN-6484[Documentation] Documenting the YARN Federation featureMajornodemanager, resourcemanagerSubru KrishnanCarlo Curino
YARN-6658Remove columnFor() methods of Columns in HBaseTimeline backendMajor.Haibo ChenHaibo Chen
YARN-3666Federation Intercepting and propagating AM- home RM communicationsMajornodemanager, resourcemanagerKishore ChaliparambilBotong Huang
YARN-6246Identifying starved apps does not need the scheduler writelockMajorfairschedulerKarthik KambatlaKarthik Kambatla
HDFS-11904Reuse iip in unprotectedRemoveXAttrs callsMajor.Xiao ChenXiao Chen
HDFS-11359DFSAdmin report command supports displaying maintenance state datanodesMajordatanode, namenodeYiqun LinYiqun Lin
YARN-6316Provide help information and documentation for TimelineSchemaCreatorMajortimelineserverLi LuHaibo Chen
YARN-6575Support global configuration mutation in MutableConfProviderMajor.Jonathan HungJonathan Hung
HADOOP-14035Reduce fair call queue backoff's impact on clientsMajoripcDaryn SharpDaryn Sharp
YARN-6604Allow metric TTL for Application table to be specified through cmdMajorATSv2Haibo ChenHaibo Chen
YARN-5647[ATSv2 Security] Collector side changes for loading auth filters and principalsMajortimelineserverVarun SaxenaVarun Saxena
YARN-6511Federation: transparently spanning application across multiple sub-clustersMajor.Botong HuangBotong Huang
YARN-6679Reduce Resource instance overhead via non-PBImplMajorresourcemanagerDaryn SharpDaryn Sharp
HADOOP-13174Add more debug logs for delegation tokens and authenticationMinorsecurityXiao ChenXiao Chen
HADOOP-13854KMS should log error details in KMSExceptionsProviderMajorkmsXiao ChenXiao Chen
YARN-6682Improve performance of AssignmentInformation datastructuresMajor.Daryn SharpDaryn Sharp
YARN-6638[ATSv2 Security] Timeline reader side changes for loading auth filters and principalsMajortimelineserverVarun SaxenaVarun Saxena
YARN-6707[ATSv2] Update HBase version to 1.2.6MajortimelineserverVarun SaxenaVrushali C
HADOOP-14394Provide Builder pattern for DistributedFileSystem.createMajorfsLei (Eddy) XuLei (Eddy) Xu
HADOOP-14289Move log4j APIs over to slf4j in hadoop-commonMajor.Akira AjisakaAkira Ajisaka
HADOOP-14395Provide Builder pattern for DistributedFileSystem.appendMajorfsLei (Eddy) XuLei (Eddy) Xu
HADOOP-14538Fix TestFilterFileSystem and TestHarFileSystem failures after DistributedFileSystem.append APIMajorfsLei (Eddy) XuLei (Eddy) Xu
YARN-6680Avoid locking overhead for NO_LABEL lookupsMajorresourcemanagerDaryn SharpDaryn Sharp
HADOOP-14296Move logging APIs over to slf4j in hadoop-toolsMajor.Akira AjisakaAkira Ajisaka
YARN-6724Add ability to blacklist sub-clusters when invoking Routing policiesMajorrouterSubru KrishnanGiovanni Matteo Fumarola
HDFS-11998Enable DFSNetworkTopology as defaultMajornamenodeChen LiangChen Liang
HADOOP-14542Add IOUtils.cleanupWithLogger that accepts slf4j logger APIMajor.Akira AjisakaChen Liang
HADOOP-14547[WASB] the configured retry policy is not used for all storage operations.Majorfs/azureThomas MarquardtThomas Marquardt
YARN-5648[ATSv2 Security] Client side changes for authenticationMajortimelineserverVarun SaxenaVarun Saxena
HADOOP-14549Use GenericTestUtils.setLogLevel when available in hadoop-toolsMajor.Akira AjisakaWenxin He
YARN-3659Federation: routing client invocations transparently to multiple RMsMajorclient, resourcemanager, routerGiovanni Matteo FumarolaGiovanni Matteo Fumarola
HADOOP-14573regression: Azure tests which capture logs failing with move to SLF4JMajorfs/azure, testSteve LoughranSteve Loughran
HADOOP-14546Azure: Concurrent I/O does not work when secure.mode is enabledMajorfs/azureThomas MarquardtThomas Marquardt
HADOOP-14190add more on s3 regions to the s3a documentationMinordocumentation, fs/s3Steve LoughranSteve Loughran
HADOOP-14609NPE in AzureNativeFileSystemStore.checkContainer() if StorageException lacks an error codeMajorfs/azureSteve LoughranSteve Loughran
YARN-5311Document graceful decommission CLI and usageMajordocumentationJunping DuElek, Marton
HADOOP-14596AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs errorBlockerfs/s3Steve LoughranSteve Loughran
YARN-6681Eliminate double-copy of child queues in canAssignToThisQueueMajorresourcemanagerDaryn SharpDaryn Sharp
HADOOP-14615Add ServiceOperations.stopQuietly that accept slf4j logger APIMajor.Wenxin HeWenxin He
HADOOP-14617Add ReflectionUtils.logThreadInfo that accept slf4j logger APIMajor.Wenxin HeWenxin He
HADOOP-14571Deprecate public APIs relate to log4j1Major.Akira AjisakaWenxin He
HADOOP-14587Use GenericTestUtils.setLogLevel when available in hadoop-commonMajor.Wenxin HeWenxin He
YARN-5953Create CLI for changing YARN configurationsMajor.Jonathan HungJonathan Hung
YARN-6776Refactor ApplicaitonMasterService to move actual processing logic to a separate classMinor.Arun SureshArun Suresh
HADOOP-14638Replace commons-logging APIs with slf4j in StreamPumperMajor.Wenxin HeWenxin He
YARN-6801NPE in RM while setting collectors map in NodeHeartbeatResponseMajortimelineserverVrushali CVrushali C
YARN-6807Adding required missing configs to Federation configuration guide based on e2e testingMajordocumentation, federationSubru KrishnanTanuj Nayak
YARN-6815[Bug] FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or notMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-6821Move FederationStateStore SQL DDL files from test resource to sbinMajornodemanager, resourcemanagerSubru KrishnanSubru Krishnan
YARN-2113Add cross-user preemption within CapacityScheduler's leaf-queueMajorcapacity schedulerVinod Kumar VavilapalliSunil Govindan
YARN-5292NM Container lifecycle and state transitions to support for PAUSED container state.Major.Hitesh SharmaHitesh Sharma
HADOOP-14642wasb: add support for caching Authorization and SASKeysMajorfs/azureSivaguru SankaridurgSivaguru Sankaridurg
YARN-6777Support for ApplicationMasterService processing chain of interceptorsMajor.Arun SureshArun Suresh
YARN-6775CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue callsMajorcapacityschedulerNathan RobertsNathan Roberts
YARN-4455Support fetching metrics by time rangeMajortimelineserverVarun SaxenaVarun Saxena
YARN-6850Ensure that supplemented timestamp is stored only for flow run metricsMajortimelineserverVrushali CVarun Saxena
YARN-6733Add table for storing sub-application entitiesMajortimelineserverVrushali CVrushali C
HADOOP-14518Customize User-Agent header sent in HTTP/HTTPS requests by WASB.Minorfs/azureGeorgi ChalakovGeorgi Chalakov
YARN-6804Allow custom hostname for docker containers in native servicesMajoryarn-native-servicesBillie RinaldiBillie Rinaldi
YARN-6866Minor clean-up and fixes in anticipation of YARN-2915 merge with trunkMajorfederationSubru KrishnanBotong Huang
YARN-5412Create a proxy chain for ResourceManager REST API in the RouterMajornodemanager, resourcemanagerSubru KrishnanGiovanni Matteo Fumarola
YARN-6888Refactor AppLevelTimelineCollector such that RM does not have aggregator threads createdMajortimelineserverVrushali CVrushali C
HADOOP-14678AdlFilesystem#initialize swallows exception when getting user nameMinorfs/adlJohn ZhugeJohn Zhuge
YARN-6734Ensure sub-application user is extracted & sent to timeline serviceMajortimelineserverVrushali CRohith Sharma K S
HDFS-12223Rebasing HDFS-10467MajorfsÍñigo GoiriÍñigo Goiri
YARN-6902Update Microsoft JDBC Driver for SQL Server version in License.txtMinorfederationBotong HuangBotong Huang
HDFS-10687Federation Membership State Store internal APIMajorhdfsÍñigo GoiriJason Kace
YARN-5947Create LeveldbConfigurationStore class using Leveldb as backing storeMajor.Jonathan HungJonathan Hung
HADOOP-14397Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for itMajorcommon, fs, hdfs-clientLei (Eddy) XuLei (Eddy) Xu
YARN-6322Disable queue refresh when configuration mutation is enabledMajor.Jonathan HungJonathan Hung
HDFS-11826Federation Namenode HeartbeatMajorfsÍñigo GoiriÍñigo Goiri
YARN-6853Add MySql Scripts for FederationStateStoreMajor.Giovanni Matteo FumarolaGiovanni Matteo Fumarola
HDFS-9388Refactor decommission related code to support maintenance state for datanodesMajor.Ming MaManoj Govindassamy
YARN-5977ContainerManagementProtocol changes to support change of container ExecutionTypeMajor.Arun Sureshkartheek muthyala
HADOOP-14126remove jackson, joda and other transient aws SDK dependencies from hadoop-awsMinorbuild, fs/s3Steve LoughranSteve Loughran
HDFS-10880Federation Mount Table State Store internal APIMajorfsJason KaceÍñigo Goiri
YARN-6957Moving logging APIs over to slf4j in hadoop-yarn-server-sharedcachemanagerMajor.Yeliang CangYeliang Cang
YARN-6955Handle concurrent register AM requests in FederationInterceptorMinor.Botong HuangBotong Huang
YARN-6873Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryserviceMajor.Yeliang CangYeliang Cang
YARN-6897Refactoring RMWebServices by moving some util methods to RMWebAppUtilMajor.Giovanni Matteo FumarolaGiovanni Matteo Fumarola
HDFS-10646Federation admin toolMajorfsÍñigo GoiriÍñigo Goiri
HADOOP-14715TestWasbRemoteCallHelper failingMajorfs/azure, testSteve LoughranEsfandiar Manii
YARN-6970Add PoolInitializationException as retriable exception in FederationFacadeMajorfederationGiovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-6874Supplement timestamp for min start/max end time columns in flow run table to avoid overwriteMajortimelineserverVarun SaxenaVrushali C
YARN-6958Moving logging APIs over to slf4j in hadoop-yarn-server-timelineserviceMajor.Yeliang CangYeliang Cang
HADOOP-14183Remove service loader config file for wasb fsMinorfs/azureJohn ZhugeEsfandiar Manii
YARN-6130[ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RMMajortimelineserverVarun SaxenaVarun Saxena
YARN-6133[ATSv2 Security] Renew delegation token for app automatically if an app collector is activeMajortimelineserverVarun SaxenaVarun Saxena
YARN-6820Restrict read access to timelineservice v2 dataMajortimelinereaderVrushali CVrushali C
YARN-6896Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)Major.Giovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-6687Validate that the duration of the periodic reservation is less than the periodicityMajorreservation systemSubru KrishnanSubru Krishnan
YARN-6905Multiple HBaseTimelineStorage test failures due to missing FastNumberFormatMajortimelineserverSonia GarudiHaibo Chen
YARN-5978ContainerScheduler and ContainerManager changes to support ExecType updateMajor.Arun Sureshkartheek muthyala
YARN-6741Deleting all children of a Parent Queue on refresh throws exceptionMajorcapacity schedulerNaganarasimha G RNaganarasimha G R
HADOOP-14660wasb: improve throughput by 34% when account limit exceededMajorfs/azureThomas MarquardtThomas Marquardt
YARN-7006[ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocolMajortimelineserverVarun SaxenaVarun Saxena
YARN-6900ZooKeeper based implementation of the FederationStateStoreMajorfederation, nodemanager, resourcemanagerSubru KrishnanÍñigo Goiri
HDFS-11554[Documentation] Router-based federation documentationMinorfsÍñigo GoiriÍñigo Goiri
HDFS-12312Rebasing HDFS-10467 (2)Major.Íñigo GoiriÍñigo Goiri
YARN-7028Backport HADOOP-14386 to YARN-5355 branchMajortimelineserverVrushali CVrushali C
YARN-6988container-executor fails for docker when command length > 4096 BMajoryarnEric BadgerEric Badger
YARN-7038[Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabledMajor.Rohith Sharma K SVarun Saxena
HADOOP-14769WASB: delete recursive should not fail if a file is deletedMajorfs/azureThomas MarquardtThomas Marquardt
YARN-7041Nodemanager NPE running jobs with security offMajortimelineserverAaron GreschVarun Saxena
YARN-6134[ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is activeMajortimelineserverVarun SaxenaVarun Saxena
YARN-6979Add flag to notify all types of container updates to NM via NodeHeartbeatResponseMajor.Arun Sureshkartheek muthyala
YARN-6861Reader API for sub application entitiesMajortimelinereaderRohith Sharma K SRohith Sharma K S
YARN-6323Rolling upgrade/config change is broken on timeline v2.MajortimelineserverLi LuVrushali C
HDFS-10631Federation State Store ZooKeeper implementationMajorfsÍñigo GoiriJason Kace
YARN-6047Documentation updates for TimelineService v2Majordocumentation, timelineserverVarun SaxenaRohith Sharma K S
MAPREDUCE-6838[ATSv2 Security] Add timeline delegation token received in allocate response to UGIMajor.Varun SaxenaVarun Saxena
YARN-3053[Security] Review and implement authentication in ATS v.2MajortimelineserverSangjin LeeVarun Saxena
YARN-5603Metrics for Federation StateStoreMajor.Subru KrishnanEllen Hui
YARN-6923Metrics for Federation RouterMajor.Giovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-7024Fix issues on recovery in LevelDB storeMajor.Jonathan HungJonathan Hung
YARN-7047Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanagerMajor.Yeliang CangYeliang Cang
YARN-6876Create an abstract log writer for extendabilityMajor.Xuan GongXuan Gong
YARN-7010Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)Major.Giovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-5219When an export var command fails in launch_container.sh, the full container launch should failMajor.Hitesh ShahSunil Govindan
HADOOP-14802Add support for using container saskeys for all accessesMajorfs/azureSivaguru SankaridurgSivaguru Sankaridurg
YARN-7094Document the current known issue with server-side NM graceful decomBlockergracefulRobert KanterRobert Kanter
YARN-7095Federation: routing getNode/getNodes/getMetrics REST invocations transparently to multiple RMsMajor.Giovanni Matteo FumarolaGiovanni Matteo Fumarola
YARN-6726Fix issues with docker commands executed by container-executorMajornodemanagerShane KumpfShane Kumpf
YARN-6877Create an abstract log reader for extendabilityMajor.Xuan GongXuan Gong
HADOOP-14103Sort out hadoop-aws contract-test-options.xmlMinorfs/s3, testSteve LoughranJohn Zhuge
YARN-7148TestLogsCLI fails in trunk and branch-2 and javadoc errorMajor.Xuan GongXuan Gong
YARN-5328Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystemMajorresourcemanagerSubru KrishnanSubru Krishnan
YARN-6978Add updateContainer API to NMClient.Major.Arun Sureshkartheek muthyala
HADOOP-14774S3A case "testRandomReadOverBuffer" failed due to improper range parameterMinorfs/s3YongerYonger
YARN-7144Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader.Major.Xuan GongXuan Gong
HDFS-12384Fixing compilation issue with BanDuplicateClassesMajorfsÍñigo GoiriÍñigo Goiri
YARN-6600Introduce default and max lifetime of application at LeafQueue levelMajorcapacity schedulerRohith Sharma K SRohith Sharma K S
YARN-6849NMContainerStatus should have the Container ExecutionType.Major.Arun Sureshkartheek muthyala
HDFS-12335Federation MetricsMajorfsGiovanni Matteo FumarolaÍñigo Goiri
YARN-5330SharingPolicy enhancements required to support recurring reservations in ReservationSystemMajorresourcemanagerSubru KrishnanCarlo Curino
YARN-7072Add a new log aggregation file format controllerMajor.Xuan GongXuan Gong
YARN-7173Container update RM-NM communication fix for backward compatibilityMajor.Arun SureshArun Suresh
YARN-7063TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2MajortimelineserverVrushali CVarun Saxena
YARN-6059Update paused container state in the NM state storeBlocker.Hitesh SharmaHitesh Sharma
HDFS-12430Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218MajorfsÍñigo GoiriÍñigo Goiri
YARN-7194Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormatMajor.Xuan GongXuan Gong
YARN-7162Remove XML excludes file formatBlockergracefulRobert KanterRobert Kanter
YARN-7174Add retry logic in LogsCLI when fetch running application logsMajor.Xuan GongXuan Gong
HDFS-12450Fixing TestNamenodeHeartbeat and support non-HAMajorfsÍñigo GoiriÍñigo Goiri
YARN-6840Implement zookeeper based store for scheduler configuration updatesMajor.Wangda TanJonathan Hung
HADOOP-14583wasb throws an exception if you try to create a file and there's no parent directoryMinorfs/azureSteve LoughranEsfandiar Manii
HDFS-12473Change hosts JSON file formatMajor.Ming MaMing Ma
HDFS-11035Better documentation for maintenace mode and upgrade domainMajordatanode, documentationWei-Chiu ChuangMing Ma
YARN-7046Add closing logic to configuration storeMajor.Jonathan HungJonathan Hung
YARN-4266Allow users to enter containers as UID:GID pair instead of by usernameMajoryarnSidharta Seethanaluhuichun
MAPREDUCE-6947Moving logging APIs over to slf4j in hadoop-mapreduce-examplesMajor.Gergely NovákGergely Novák
HDFS-12381[Documentation] Adding configuration keys for the RouterMinorfsÍñigo GoiriÍñigo Goiri
HADOOP-14892MetricsSystemImpl should use Time.monotonicNow for measuring durationsMinor.Chetna ChaudhariChetna Chaudhari
HADOOP-14881LoadGenerator should use Time.monotonicNow() to measure durationsMajor.Chetna ChaudhariBharat Viswanadham
YARN-7238Documentation for API based scheduler configuration managementMajor.Jonathan HungJonathan Hung
HADOOP-14893WritableRpcEngine should use Time.monotonicNowMinor.Chetna ChaudhariChetna Chaudhari
HADOOP-14890Move up to AWS SDK 1.11.199Blockerbuild, fs/s3Steve LoughranSteve Loughran
HDFS-12386Add fsserver defaults call to WebhdfsFileSystem.MinorwebhdfsRushabh S ShahRushabh S Shah
YARN-7252Removing queue then failing over results in exceptionCritical.Jonathan HungJonathan Hung
YARN-7251Misc changes to YARN-5734Major.Jonathan HungJonathan Hung
YARN-6691Update YARN daemon startup/shutdown scripts to include Router serviceMajornodemanager, resourcemanagerSubru KrishnanGiovanni Matteo Fumarola
YARN-6962Add support for updateContainers when allocating using FederationInterceptorMinor.Botong HuangBotong Huang
YARN-7250Update Shared cache client api to use URLsMinor.Chris TrezzoChris Trezzo
YARN-6509Add a size threshold beyond which yarn logs will require a force optionMajor.Siddharth SethXuan Gong
HADOOP-14768Honoring sticky bit during Deletion when authorization is enabled in WASBMajorfs/azureVarada HemeswariVarada Hemeswari
YARN-7259Add size-based rolling policy to LogAggregationIndexedFileControllerMajor.Xuan GongXuan Gong
YARN-6550Capture launch_container.sh logs to a separate log fileMajor.Wangda TanSuma Shivaprasad
HDFS-12580Rebasing HDFS-10467 after HDFS-12447MajorfsÍñigo GoiriÍñigo Goiri
HADOOP-14220Enhance S3GuardTool with bucket-info and set-capacity commands, testsMajorfs/s3Steve LoughranSteve Loughran
YARN-2037Add work preserving restart support for Unmanaged AMsMajorresourcemanagerKarthik KambatlaBotong Huang
YARN-5329Placement Agent enhancements required to support recurring reservations in ReservationSystemBlockerresourcemanagerSubru KrishnanCarlo Curino
HADOOP-14845Azure wasb: getFileStatus not making any auth checksMajorfs/azure, securitySivaguru SankaridurgSivaguru Sankaridurg
YARN-2960Add documentation for the YARN shared cacheMajor.Chris TrezzoChris Trezzo
HDFS-12273Federation UIMajorfsÍñigo GoiriÍñigo Goiri
HDFS-12577Rename Router toolingMajorfsÍñigo GoiriÍñigo Goiri
HADOOP-14899Restrict Access to setPermission operation when authorization is enabled in WASBMajorfs/azureKannapiran SrinivasanKannapiran Srinivasan
YARN-7305Merge YARN-5734 branch to branch-2Major.Xuan GongXuan Gong
HADOOP-14913Sticky bit implementation for rename() operation in Azure WASBMajorfs, fs/azureVarada HemeswariVarada Hemeswari
YARN-6033Add support for sections in container-executor configuration fileMajornodemanagerVarun VasudevVarun Vasudev
HADOOP-14935Azure: POSIX permissions are taking effect in access() method even when authorization is enabledMajorfs/azureSanthosh G NayakSanthosh G Nayak
YARN-7275NM Statestore cleanup for Container updatesBlocker.Arun Sureshkartheek muthyala
YARN-7311Fix TestRMWebServicesReservation parametrization for fair schedulerBlockerfairscheduler, reservation systemYufei GuYufei Gu
YARN-7295Backport ATSv2 to branch-2Critical.Varun SaxenaVarun Saxena
YARN-7338Support same origin policy for cross site scripting prevention.Majoryarn-ui-v2Vrushali CSunil Govindan
HDFS-12620Backporting HDFS-10467 to branch-2Major.Íñigo GoiriÍñigo Goiri
YARN-4090Make Collections.sort() more efficient by caching resource usageMajorfairschedulerXianyin XinYufei Gu
YARN-7353Docker permitted volumes don't properly check for directoriesMajoryarnEric BadgerEric Badger
YARN-7169Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)Criticaltimelineclient, timelinereader, timelineserverVrushali CVrushali C
YARN-3661Basic Federation UIMajornodemanager, resourcemanagerGiovanni Matteo FumarolaÍñigo Goiri
YARN-4827Document configuration of ReservationSystem for FairSchedulerBlockercapacity schedulerSubru KrishnanYufei Gu
YARN-5516Add REST API for supporting recurring reservationsMajorresourcemanagerSangeetha Abdu JyothiSean Po
YARN-7178Add documentation for Container Update APIBlocker.Arun SureshArun Suresh
YARN-7380Fix findbugs warning in timeline service on branch-2Majortimelineclient, timelinereader, timelineserverVrushali CVrushali C
YARN-7378Documentation changes post branch-2 mergeMajortimelineclient, timelinereader, timelineserverVarun SaxenaVrushali C
YARN-7398Update LICENSE.txt with respect to new YARN UI mergeBlocker.Subru KrishnanVarun Saxena
YARN-7276Federation Router Web Service fixesMajor.Íñigo GoiriÍñigo Goiri
YARN-7289Application lifetime does not work with FairSchedulerMajorresourcemanagerMiklos SzegediMiklos Szegedi
YARN-7286Add support for docker to have no capabilitiesMajoryarnEric BadgerEric Badger
YARN-6627Use deployed webapp folder to launch new YARN UIMajoryarn-ui-v2Sunil GovindanSunil Govindan
HDFS-9754Avoid unnecessary getBlockCollection calls in BlockManagerMajornamenodeJing ZhaoJing Zhao

OTHER:

JIRASummaryPriorityComponentReporterContributor
YARN-4535Fix checkstyle error in CapacityScheduler.javaTrivial.Rohith Sharma K SNaganarasimha G R
YARN-5297Avoid printing a stack trace when recovering an app after the RM restartsMajor.Siddharth SethJunping Du
YARN-5717Add tests for container-executor's is_feature_enabled functionMajoryarnSidharta SeethanaSidharta Seethana
YARN-5308FairScheduler: Move continuous scheduling related tests to TestContinuousSchedulingMajorfairscheduler, testKarthik KambatlaKai Sasaki
YARN-5822Log ContainerRuntime initialization error in LinuxContainerExecutorTrivialnodemanagerSidharta SeethanaSidharta Seethana
YARN-5646Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containersBlocker.Konstantinos KaranasosKonstantinos Karanasos
YARN-6411Clean up the overwrite of createDispatcher() in subclass of MockRMMinorresourcemanagerYufei GuYufei Gu
HADOOP-14344Revert HADOOP-13606 swift FS to add a service load metadata fileMajor.John ZhugeJohn Zhuge
HDFS-11717Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefullyMinorha, namenodeErik KrogenErik Krogen
YARN-6969Clean up unused code in class FairSchedulerQueueInfoTrivialfairschedulerYufei GuLarry Lo
YARN-6622Document Docker work as experimentalBlockerdocumentationVarun VasudevVarun Vasudev
YARN-7203Add container ExecutionType into ContainerReportMinor.Botong HuangBotong Huang
YARN-6499Remove the doc about Schedulable#redistributeShare()TrivialfairschedulerYufei GuChetna Chaudhari
HADOOP-13835Move Google Test Framework code from mapreduce to hadoop-commonMajortestVarun VasudevVarun Vasudev
YARN-7317Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicyMinor.Botong HuangBotong Huang