Apache Hadoop Main 3.5.0-SNAPSHOT API

Package
Description
 
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Benchmark for Vectored Read IO operations.
 
 
Configuration of system parameters.
 
Crypto related classes.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
 
 
Hadoop example code.
This package is a distributed implementation of Knuth's dancing links algorithm that can run under Hadoop.
This package consists of a map/reduce application, distbbp, which computes exact binary digits of the mathematical constant π.
This package provides useful mathematical library classes for the distbbp program.
This package consists of 3 map/reduce applications for Hadoop to compete in the annual terabyte sort competition.
 
Implementations of AbstractFileSystem for hdfs over rpc and hdfs over web.
Supporting classes for metrics instrumentation.
public interface to expose OAuth2 authentication related features.
Aliyun OSS Filesystem.
Public classes for adding information to any auditing information picked up by filesystem clients.
A distributed implementation of FileSystem for reading and writing files on Azure Block Storage.
Infrastructure for a Metrics2 source that provides information on Windows Azure Filesystem for Hadoop instances.
A distributed implementation of FileSystem for reading and writing files on Azure Storage.
 
 
 
 
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
HdfsCompatibility is a benchmark tool to quickly assess availabilities of Hadoop-Compatible File System APIs defined in FileSystem for a specific FS implementation.
This contains default cases for FileSystem APIs.
This contains the main code and definitions of the tool HdfsCompatTool.
This contains default suites for HdfsCompatTool command.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
 
Google Cloud Storage Filesystem.
Filesystem implementations that allow Hadoop to read directly from HTTP / HTTPS endpoints.
 
 
A package to implement metrics for the HttpFS Server.
Package for supporting HuaweiCloud Object Storage Service (OBS) as a backend filesystem in Hadoop.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Classes related to writing objects.
A distributed implementation of FileSystem for reading and writing files on Amazon S3.
SFTP FileSystem package.
 
This package contains support for statistic collection and reporting.
 
 
 
A distributed implementation of FileSystem.
This package provides the administrative APIs for HDFS.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
 
 
 
 
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
This package contains classes related to hdfs data transfer protocol.
Classes for data transfer SASL implementation.
 
 
 
 
 
FedBalance is a tool for balancing data across federation clusters.
 
 
 
The Balancer is a tool for balancing the data across the storage devices of an HDFS cluster.
 
 
The AliasMap defines mapping of PROVIDED HDFS blocks to data in remote storage systems.
 
 
 
 
 
Data node HTTP classes.
 
Disk Balancer connects to a .DataNode and attempts to spread data across all volumes evenly.
Commands for disk balancer command line tool.
Connectors package is a set of logical connectors that connect to various data sources to read the hadoop cluster information.
Disk Balancer Data Model is the Data Model for the cluster that Disk Balancer is working against.
Planner takes a DiskBalancerVolumeSet, threshold and computes a series of steps that lead to an even data distribution between volumes of this DiskBalancerVolumeSet.
Mover is a data migration tool for tiered storage.
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
 
 
 
 
 
 
Use the visitor pattern to visit namespace tree.
 
This package provides the ability to expose external SPS metrics to JMX.
 
 
It includes the tools to manage the Router-based federation.
 
 
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
OAuth2-based WebHDFS authentication.
 
This package provides user-selectable (via configuration) classes that add functionality to the web UI.
Generic i/o code for use when reading and writing data to the network, to databases, and to files.
 
 
 
 
 
This package provides a mechanism for using different serialization frameworks in Hadoop.
This package provides Avro serialization in Hadoop.
Support for dynamic access to filesystem operations which are not available in older hadoop releases.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Command-line tools associated with MapReduce.
Package org.apache.hadoop.mapred.uploader contains classes related to the MapReduce framework upload tool.
 
 
This package contains the implementations of different types of map-reduce counters.
 
 
 
 
 
 
 
 
 
Persistence formats.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Plugins to generate Java files based on protocol buffers with the protoc command.
 
 
 
Metrics 2.0
Annotation interfaces for metrics instrumentation
Builtin metrics filters (to be used in metrics config files)
A collection of library classes for implementing metrics sources
Builtin metrics sinks
 
 
General helpers for implementing source and sinks
 
 
Network-related classes.
 
 
 
 
 
(DEPRECATED) Hadoop record I/O contains classes and a record description language translator for simplifying serialization and deserialization of records in a language-neutral manner.
 
YARN Registry Client API.
Registry binding utility classes.
Registry Service Exceptions
Registry client services
Core Zookeeper support.
This package contains all the data types which can be saved to the registry and/or marshalled to and from JSON.
 
Configuration for the Hadoop Service Registry.
Server-side classes for the registry
DNS Server classes.
This package contains the classes which integrate with the YARN resource manager.
Basic services for the YARN registry The RegistryAdminService extends the shared YARN Registry client with registry setup and (potentially asynchronous) administrative actions.
The common APIs for the resource estimator.
The common configuration for the resource estimator.
The common exception for the resource estimator.
SkylineStore serialization module.
Resource estimator service.
APIs for the SkylineStore.
SkylineStore exception module.
Implementation for SkylineStore.
Validator for SkylineStore.
API for Solver.
Exception module.
Implementation for Solver.
Preprocessor for Solver.
API for Translator.
Exception for Translator.
Implementation for Translator.
Validator for Translator.
Provides the hadoop credential provider API.
 
 
 
Support for service-level authorization.
Filters for HTTP service security.
 
 
 
Support for delegation tokens.
 
Support for services.
This package contains classes, interfaces and exceptions to launch YARN services from the command line.
Hadoop Streaming is a utility which allows users to create and run Map-Reduce jobs with any executables (e.g.
 
 
Command-line tools for MapReduce.
FedBalance is a tool for balancing data across federation clusters.
 
 
 
 
Rumen is a data extraction and analysis tool built for Apache Hadoop.
 
 
 
 
 
 
 
Typed bytes are sequences of bytes in which the first byte is a type code.
Common utilities.
 
This package provides utilities to interact with Curator ZooKeeper.
Support for functional programming within the Hadoop APIs.
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Public api for Application Master Service interceptors.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Package org.apache.hadoop.yarn.api.records.impl contains classes which define basic resources.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Package org.apache.hadoop.yarn.api.records.timelineservice contains classes which define the data model for ATSv2.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Application Catalog.
Application Catalog controllers.
Application Catalog Data Models.
Application Catalog Utilities classes.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
 
 
 
 
 
 
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
This package contains classes for CSI.
This package contains CSI adaptor classes.
This package contains CSI client classes.
This package contains classes for protocol translation between YARN and CSI.
This package contains utility classes for CSI.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Application Master simulators for the SLS.
 
 
 
 
Classes comprising the synthetic load generator for SLS.
Utility classes for SLS.
 
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.
Package org.apache.hadoop.yarn.util.constraint contains classes which is used as utility class for placement constraints.
Package that includes some CSI utility classes.
Package org.apache.hadoop.yarn.util.resource contains classes which is used as utility class for resource profile computations.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.