- ABFS_BLOB_DOMAIN_NAME - Static variable in class org.apache.hadoop.fs.azurebfs.constants.FileSystemUriSchemes
-
- ABFS_DFS_DOMAIN_NAME - Static variable in class org.apache.hadoop.fs.azurebfs.constants.FileSystemUriSchemes
-
- ABFS_DNS_PREFIX - Static variable in class org.apache.hadoop.fs.azurebfs.constants.FileSystemUriSchemes
-
- ABFS_SCHEME - Static variable in class org.apache.hadoop.fs.azurebfs.constants.FileSystemUriSchemes
-
- ABFS_SECURE_SCHEME - Static variable in class org.apache.hadoop.fs.azurebfs.constants.FileSystemUriSchemes
-
- AbfsDriverException - Exception in org.apache.hadoop.fs.azurebfs.contracts.exceptions
-
Exception to be thrown if any Runtime Exception occurs.
- AbfsDriverException(Exception) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsDriverException
-
- AbfsDriverException(Exception, String) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsDriverException
-
- AbfsErrors - Class in org.apache.hadoop.fs.azurebfs.services
-
ABFS error constants.
- AbfsHttpConstants - Class in org.apache.hadoop.fs.azurebfs.constants
-
Responsible to keep all constant keys used in abfs rest client here.
- AbfsInvalidChecksumException - Exception in org.apache.hadoop.fs.azurebfs.contracts.exceptions
-
Exception to wrap invalid checksum verification on client side.
- AbfsInvalidChecksumException(AbfsRestOperationException) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsInvalidChecksumException
-
- AbfsInvalidChecksumException(String) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsInvalidChecksumException
-
- AbfsRestOperationException - Exception in org.apache.hadoop.fs.azurebfs.contracts.exceptions
-
Exception to wrap Azure service error responses.
- AbfsRestOperationException(int, String, String, Exception) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsRestOperationException
-
- AbfsRestOperationException(int, String, String, Exception, AbfsHttpOperation) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsRestOperationException
-
- AbfsRestOperationException(AzureADAuthenticator.HttpException) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsRestOperationException
-
- abort() - Method in interface org.apache.hadoop.fs.Abortable
-
Abort the active operation without the output becoming visible.
- abort() - Method in class org.apache.hadoop.fs.FSDataOutputStream
-
Invoke abort()
on the wrapped stream if it
is Abortable, otherwise raise an
UnsupportedOperationException
.
- abort(UploadHandle, Path) - Method in interface org.apache.hadoop.fs.MultipartUploader
-
Aborts a multipart upload.
- Abortable - Interface in org.apache.hadoop.fs
-
Abort data being written to a stream, so that close() does
not write the data.
- ABORTABLE_STREAM - Static variable in interface org.apache.hadoop.fs.StreamCapabilities
-
- ABORTED - Static variable in class org.apache.hadoop.yarn.api.records.ContainerExitStatus
-
Containers killed by the framework, either due to being released by
the application or being 'lost' due to node failures etc.
- abortJob(JobContext, int) - Method in class org.apache.hadoop.mapred.FileOutputCommitter
-
- abortJob(JobContext, int) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
For aborting an unsuccessful job's output.
- abortJob(JobContext, JobStatus.State) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
This method implements the new interface by calling the old method.
- abortJob(JobContext, JobStatus.State) - Method in class org.apache.hadoop.mapreduce.lib.output.BindingPathOutputCommitter
-
- abortJob(JobContext, JobStatus.State) - Method in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitter
-
Abort the job.
- abortJob(JobContext, JobStatus.State) - Method in class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
-
Delete the temporary directory, including all of the work directories.
- abortJob(JobContext, JobStatus.State) - Method in class org.apache.hadoop.mapreduce.OutputCommitter
-
For aborting an unsuccessful job's output.
- abortTask(TaskAttemptContext) - Method in class org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter
-
Abort a task.
- abortTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapred.FileOutputCommitter
-
- abortTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
Discard the task output.
- abortTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
This method implements the new interface by calling the old method.
- abortTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.BindingPathOutputCommitter
-
- abortTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitter
-
Abort a task.
- abortTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
-
Delete the work directory
- abortTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.OutputCommitter
-
Discard the task output.
- abortUploadsUnderPath(Path) - Method in interface org.apache.hadoop.fs.MultipartUploader
-
Best effort attempt to aborts multipart uploads under a path.
- AbstractCounters<C extends Counter,G extends CounterGroupBase<C>> - Class in org.apache.hadoop.mapreduce.counters
-
An abstract class to provide common implementation for the Counters
container in both mapred and mapreduce packages.
- AbstractCounters(CounterGroupFactory<C, G>) - Constructor for class org.apache.hadoop.mapreduce.counters.AbstractCounters
-
- AbstractCounters(AbstractCounters<C1, G1>, CounterGroupFactory<C, G>) - Constructor for class org.apache.hadoop.mapreduce.counters.AbstractCounters
-
Construct from another counters object.
- AbstractDelegationTokenIdentifier - Class in org.apache.hadoop.security.token.delegation
-
- AbstractDelegationTokenIdentifier() - Constructor for class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenIdentifier
-
- AbstractDelegationTokenIdentifier(Text, Text, Text) - Constructor for class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenIdentifier
-
- AbstractDelegationTokenSecretManager<TokenIdent extends AbstractDelegationTokenIdentifier> - Class in org.apache.hadoop.security.token.delegation
-
- AbstractDelegationTokenSecretManager(long, long, long, long) - Constructor for class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Create a secret manager
- AbstractDNSToSwitchMapping - Class in org.apache.hadoop.net
-
This is a base class for DNS to Switch mappings.
- AbstractDNSToSwitchMapping() - Constructor for class org.apache.hadoop.net.AbstractDNSToSwitchMapping
-
Create an unconfigured instance
- AbstractDNSToSwitchMapping(Configuration) - Constructor for class org.apache.hadoop.net.AbstractDNSToSwitchMapping
-
Create an instance, caching the configuration file.
- AbstractEvent<TYPE extends Enum<TYPE>> - Class in org.apache.hadoop.yarn.event
-
Parent class of all the events.
- AbstractEvent(TYPE) - Constructor for class org.apache.hadoop.yarn.event.AbstractEvent
-
- AbstractEvent(TYPE, long) - Constructor for class org.apache.hadoop.yarn.event.AbstractEvent
-
- AbstractFileSystem - Class in org.apache.hadoop.fs
-
This class provides an interface for implementors of a Hadoop file system
(analogous to the VFS of Unix).
- AbstractFileSystem(URI, String, boolean, int) - Constructor for class org.apache.hadoop.fs.AbstractFileSystem
-
Constructor to be called by subclasses.
- AbstractFSBuilderImpl<S,B extends FSBuilder<S,B>> - Class in org.apache.hadoop.fs.impl
-
Builder for filesystem/filecontext operations of various kinds,
with option support.
- AbstractFSBuilderImpl(Optional<Path>, Optional<PathHandle>) - Constructor for class org.apache.hadoop.fs.impl.AbstractFSBuilderImpl
-
Constructor with both optional path and path handle.
- AbstractFSBuilderImpl(Path) - Constructor for class org.apache.hadoop.fs.impl.AbstractFSBuilderImpl
-
- AbstractFSBuilderImpl(PathHandle) - Constructor for class org.apache.hadoop.fs.impl.AbstractFSBuilderImpl
-
- AbstractLaunchableService - Class in org.apache.hadoop.service.launcher
-
- AbstractLaunchableService(String) - Constructor for class org.apache.hadoop.service.launcher.AbstractLaunchableService
-
Construct an instance with the given name.
- AbstractLivelinessMonitor<O> - Class in org.apache.hadoop.yarn.util
-
A simple liveliness monitor with which clients can register, trust the
component to monitor liveliness, get a call-back on expiry and then finally
unregister.
- AbstractLivelinessMonitor(String, Clock) - Constructor for class org.apache.hadoop.yarn.util.AbstractLivelinessMonitor
-
- AbstractLivelinessMonitor(String) - Constructor for class org.apache.hadoop.yarn.util.AbstractLivelinessMonitor
-
- AbstractMapWritable - Class in org.apache.hadoop.io
-
Abstract base class for MapWritable and SortedMapWritable
Unlike org.apache.nutch.crawl.MapWritable, this class allows creation of
MapWritable<Writable, MapWritable> so the CLASS_TO_ID and ID_TO_CLASS
maps travel with the class instead of being static.
- AbstractMapWritable() - Constructor for class org.apache.hadoop.io.AbstractMapWritable
-
constructor.
- AbstractMetric - Class in org.apache.hadoop.metrics2
-
The immutable metric
- AbstractMetric(MetricsInfo) - Constructor for class org.apache.hadoop.metrics2.AbstractMetric
-
Construct the metric
- AbstractService - Class in org.apache.hadoop.service
-
This is the base implementation class for services.
- AbstractService(String) - Constructor for class org.apache.hadoop.service.AbstractService
-
Construct the service.
- ACCEPT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.HttpHeaderConfigurations
-
- accept(Path) - Method in class org.apache.hadoop.fs.GlobFilter
-
- accept(Path) - Method in interface org.apache.hadoop.fs.PathFilter
-
Tests whether or not the specified abstract pathname should be
included in a pathname list.
- accept(long) - Method in class org.apache.hadoop.hdfs.server.namenode.TreePath
-
- accept(CompositeRecordReader.JoinCollector, K) - Method in interface org.apache.hadoop.mapred.join.ComposableRecordReader
-
While key-value pairs from this RecordReader match the given key, register
them with the JoinCollector provided.
- accept(CompositeRecordReader.JoinCollector, K) - Method in class org.apache.hadoop.mapred.join.CompositeRecordReader
-
If key provided matches that of this Composite, give JoinCollector
iterator over values it may emit.
- accept(CompositeRecordReader.JoinCollector, K) - Method in class org.apache.hadoop.mapred.join.WrappedRecordReader
-
Add an iterator to the collector at the position occupied by this
RecordReader over the values in this stream paired with the key
provided (ie register a stream of values from this source matching K
with a collector).
- accept(Path) - Method in class org.apache.hadoop.mapred.OutputLogFilter
-
- accept(CompositeRecordReader.JoinCollector, K) - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
If key provided matches that of this Composite, give JoinCollector
iterator over values it may emit.
- accept(CompositeRecordReader.JoinCollector, K) - Method in class org.apache.hadoop.mapreduce.lib.join.WrappedRecordReader
-
Add an iterator to the collector at the position occupied by this
RecordReader over the values in this stream paired with the key
provided (ie register a stream of values from this source matching K
with a collector).
- ACCEPT_CHARSET - Static variable in class org.apache.hadoop.fs.azurebfs.constants.HttpHeaderConfigurations
-
- accepts(String) - Method in class org.apache.hadoop.metrics2.MetricsFilter
-
Whether to accept the name
- accepts(MetricsTag) - Method in class org.apache.hadoop.metrics2.MetricsFilter
-
Whether to accept the tag
- accepts(Iterable<MetricsTag>) - Method in class org.apache.hadoop.metrics2.MetricsFilter
-
Whether to accept the tags
- accepts(MetricsRecord) - Method in class org.apache.hadoop.metrics2.MetricsFilter
-
Whether to accept the record
- access(Path, FsAction) - Method in class org.apache.hadoop.fs.adl.AdlFileSystem
-
Checks if the user can access a path.
- access(Path, FsAction) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
- access(Path, FsAction, TracingContext) - Method in class org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore
-
- access(Path, FsAction) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- access(Path, FsAction) - Method in class org.apache.hadoop.fs.viewfs.ViewFileSystem
-
- access(Path, FsAction) - Method in class org.apache.hadoop.fs.viewfs.ViewFs
-
- ACCESS_DENIED - Static variable in exception org.apache.hadoop.fs.s3a.impl.MultiObjectDeleteException
-
This is the exception exit code if access was denied on a delete.
- ACCESS_DENIED - Static variable in class org.apache.hadoop.yarn.api.records.timeline.TimelinePutResponse.TimelinePutError
-
Error code returned if the user is denied to access the timeline data
- ACCESS_GROUP - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- ACCESS_KEY - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
- ACCESS_MASK - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- ACCESS_OTHER - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- ACCESS_TOKEN - Static variable in class org.apache.hadoop.hdfs.web.oauth2.OAuth2Constants
-
- ACCESS_USER - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- AccessControlException - Exception in org.apache.hadoop.security
-
An exception class for access control related issues.
- AccessControlException() - Constructor for exception org.apache.hadoop.security.AccessControlException
-
Default constructor is needed for unwrapping from
RemoteException
.
- AccessControlException(String) - Constructor for exception org.apache.hadoop.security.AccessControlException
-
- AccessControlException(Throwable) - Constructor for exception org.apache.hadoop.security.AccessControlException
-
Constructs a new exception with the specified cause and a detail
message of (cause==null ? null : cause.toString())
(which
typically contains the class and detail message of cause
).
- AccessControlList - Class in org.apache.hadoop.security.authorize
-
Class representing a configured access control list.
- AccessControlList() - Constructor for class org.apache.hadoop.security.authorize.AccessControlList
-
This constructor exists primarily for AccessControlList to be Writable.
- AccessControlList(String) - Constructor for class org.apache.hadoop.security.authorize.AccessControlList
-
Construct a new ACL from a String representation of the same.
- AccessControlList(String, String) - Constructor for class org.apache.hadoop.security.authorize.AccessControlList
-
Construct a new ACL from String representation of users and groups
The arguments are comma separated lists
- AccessRequest - Class in org.apache.hadoop.yarn.security
-
This request object contains all the context information to determine whether
a user has permission to access the target entity.
- AccessRequest(PrivilegedEntity, UserGroupInformation, AccessType, String, String, String, List<String>) - Constructor for class org.apache.hadoop.yarn.security.AccessRequest
-
- AccessTokenProvider - Class in org.apache.hadoop.hdfs.web.oauth2
-
Provide an OAuth2 access token to be used to authenticate http calls in
WebHDFS.
- AccessTokenProvider() - Constructor for class org.apache.hadoop.hdfs.web.oauth2.AccessTokenProvider
-
- AccessTokenTimer - Class in org.apache.hadoop.hdfs.web.oauth2
-
Access tokens generally expire.
- AccessTokenTimer() - Constructor for class org.apache.hadoop.hdfs.web.oauth2.AccessTokenTimer
-
- AccessTokenTimer(Timer) - Constructor for class org.apache.hadoop.hdfs.web.oauth2.AccessTokenTimer
-
- accountProperty(String, String) - Static method in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AclEntry - Class in org.apache.hadoop.fs.permission
-
Defines a single entry in an ACL.
- AclEntryScope - Enum in org.apache.hadoop.fs.permission
-
Specifies the scope or intended usage of an ACL entry.
- AclEntryType - Enum in org.apache.hadoop.fs.permission
-
Specifies the type of an ACL entry.
- aclSpecToString(List<AclEntry>) - Static method in class org.apache.hadoop.fs.permission.AclEntry
-
Convert a List of AclEntries into a string - the reverse of parseAclSpec.
- AclStatus - Class in org.apache.hadoop.fs.permission
-
An AclStatus contains the ACL information of a specific file.
- ACQUIRE_LEASE_ACTION - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- acquireLease(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
Get a self-renewing lease on the specified file.
- ACTION_EXECUTOR_ACQUIRED - Static variable in class org.apache.hadoop.fs.statistics.StoreStatisticNames
-
The name of the statistic collected for executor acquisition if
a duration tracker factory is passed in to the constructor.
- ACTION_FILE_OPENED - Static variable in class org.apache.hadoop.fs.statistics.StoreStatisticNames
-
A file was opened: "action_file_opened".
- ACTION_HTTP_DELETE_REQUEST - Static variable in class org.apache.hadoop.fs.statistics.StoreStatisticNames
-
An HTTP DELETE request was made: "action_http_delete_request".
- ACTION_HTTP_GET_REQUEST - Static variable in class org.apache.hadoop.fs.statistics.StoreStatisticNames
-
An HTTP GET request was made: "action_http_get_request".
- ACTION_HTTP_HEAD_REQUEST - Static variable in class org.apache.hadoop.fs.statistics.StoreStatisticNames
-
An HTTP HEAD request was made: "action_http_head_request".
- ACTION_HTTP_PATCH_REQUEST - Static variable in class org.apache.hadoop.fs.statistics.StoreStatisticNames
-
An HTTP PATCH request was made: "action_http_patch_request".
- ACTION_HTTP_POST_REQUEST - Static variable in class org.apache.hadoop.fs.statistics.StoreStatisticNames
-
An HTTP POST request was made: "action_http_post_request".
- ACTION_HTTP_PUT_REQUEST - Static variable in class org.apache.hadoop.fs.statistics.StoreStatisticNames
-
An HTTP PUT request was made: "action_http_put_request".
- actionBuild(Service) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionCancelUpgrade(String) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Cancels the upgrade of the service.
- actionCancelUpgrade(String) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionCleanUp(String, String) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Operation to be performed by the RM after an application has completed.
- actionCleanUp(String, String) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionCreate(Service) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionDecommissionInstances(String, List<String>) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Decommission component instances of a long running service.
- actionDecommissionInstances(String, List<String>) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionDependency(String, boolean) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionDestroy(String) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Remove the specification and all application data for a YARN application.
- actionDestroy(String) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionFlex(String, Map<String, String>) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Change the number of running containers for a component of a YARN
application / long-running service.
- actionFlex(String, Map<String, String>) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionLaunch(String, String, Long, String) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Launch a new YARN application.
- actionLaunch(String, String, Long, String) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionSave(String, String, Long, String) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Save the specification for a YARN application / long-running service.
- actionSave(String, String, Long, String) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionStart(String) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Start a YARN application from a previously saved specification.
- actionStart(String) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionStartAndGetId(String) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionStop(String) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Stop a YARN application (attempt to stop gracefully before killing the
application).
- actionStop(String) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionStop(String, boolean) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionUpgrade(Service, List<Container>) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionUpgradeComponents(String, List<String>) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Upgrade components of a long running service.
- actionUpgradeComponents(String, List<String>) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionUpgradeExpress(String, File) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Express upgrade a long running service.
- actionUpgradeExpress(String, File) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionUpgradeExpress(Service) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- actionUpgradeInstances(String, List<String>) - Method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Upgrade component instances of a long running service.
- actionUpgradeInstances(String, List<String>) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- activateOptions() - Method in class org.apache.hadoop.yarn.ContainerLogAppender
-
- activateOptions() - Method in class org.apache.hadoop.yarn.ContainerRollingLogAppender
-
- add(MeanStatistic) - Method in class org.apache.hadoop.fs.statistics.MeanStatistic
-
Add another MeanStatistic.
- add(E) - Method in class org.apache.hadoop.io.EnumSetWritable
-
- add(InputSplit) - Method in class org.apache.hadoop.mapred.join.CompositeInputSplit
-
Add an InputSplit to this collection.
- add(ComposableRecordReader<K, ? extends V>) - Method in class org.apache.hadoop.mapred.join.CompositeRecordReader
-
Add a RecordReader to this collection.
- add(X) - Method in class org.apache.hadoop.mapreduce.lib.join.ArrayListBackedIterator
-
- add(InputSplit) - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeInputSplit
-
Add an InputSplit to this collection.
- add(ComposableRecordReader<K, ? extends V>) - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
Add a RecordReader to this collection.
- add(T) - Method in interface org.apache.hadoop.mapreduce.lib.join.ResetableIterator
-
Add an element to the collection of elements to iterate over.
- add(X) - Method in class org.apache.hadoop.mapreduce.lib.join.StreamBackedIterator
-
- add(String, long) - Method in class org.apache.hadoop.metrics2.lib.MetricsRegistry
-
Add sample to a stat metric by name.
- add(long) - Method in class org.apache.hadoop.metrics2.lib.MutableQuantiles
-
- add(String, long) - Method in class org.apache.hadoop.metrics2.lib.MutableRates
-
Add a rate sample for a rate metric
- add(String, long) - Method in class org.apache.hadoop.metrics2.lib.MutableRatesWithAggregation
-
Add a rate sample for a rate metric.
- add(String, long) - Method in class org.apache.hadoop.metrics2.lib.MutableRollingAverages
-
- add(long, long) - Method in class org.apache.hadoop.metrics2.lib.MutableStat
-
Add a number of samples and their sum to the running stat
Note that although use of this method will preserve accurate mean values,
large values for numSamples may result in inaccurate variance values due
to the use of a single step of the Welford method for variance calculation.
- add(long) - Method in class org.apache.hadoop.metrics2.lib.MutableStat
-
Add a snapshot to the metric.
- add(MetricsTag) - Method in class org.apache.hadoop.metrics2.MetricsJsonBuilder
-
- add(AbstractMetric) - Method in class org.apache.hadoop.metrics2.MetricsJsonBuilder
-
- add(MetricsTag) - Method in class org.apache.hadoop.metrics2.MetricsRecordBuilder
-
Add an immutable metrics tag object
- add(AbstractMetric) - Method in class org.apache.hadoop.metrics2.MetricsRecordBuilder
-
Add a pre-made immutable metric object
- add(MetricsInfo, Object) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- add(MetricsTag) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- add(AbstractMetric) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- add(Key) - Method in class org.apache.hadoop.util.bloom.BloomFilter
-
- add(Key) - Method in class org.apache.hadoop.util.bloom.CountingBloomFilter
-
- add(Key) - Method in class org.apache.hadoop.util.bloom.DynamicBloomFilter
-
- add(Key) - Method in class org.apache.hadoop.util.bloom.RetouchedBloomFilter
-
- addAll(Credentials) - Method in class org.apache.hadoop.security.Credentials
-
Copy all of the credentials from one credential object into another.
- addAMEnv() - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- addArchiveToClassPath(Path) - Method in class org.apache.hadoop.mapreduce.Job
-
Add an archive path to the current set of classpath entries.
- addArchiveToClassPath(Path, Configuration, FileSystem) - Static method in class org.apache.hadoop.mapreduce.Job
-
Add an archive path to the current set of classpath entries.
- addArchiveToSharedCache(URI, Configuration) - Static method in class org.apache.hadoop.mapreduce.Job
-
Add an archive to job config for shared cache processing.
- addAuxiliaryListener(int) - Method in class org.apache.hadoop.ipc.Server
-
- addCacheArchive(URI) - Method in class org.apache.hadoop.mapreduce.Job
-
Add a archives to be localized
- addCacheArchive(URI, Configuration) - Static method in class org.apache.hadoop.mapreduce.Job
-
Add an archives to be localized to the conf.
- addCacheDirective(CacheDirectiveInfo, EnumSet<CacheFlag>) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Add a new CacheDirectiveInfo.
- addCacheFile(URI) - Method in class org.apache.hadoop.mapreduce.Job
-
Add a file to be localized
- addCacheFile(URI, Configuration) - Static method in class org.apache.hadoop.mapreduce.Job
-
Add a file to be localized to the conf.
- addCachePool(CachePoolInfo) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Add a cache pool.
- addChild(TimelineEntity.Identifier) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.HierarchicalTimelineEntity
-
- addChild(String, String) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.HierarchicalTimelineEntity
-
- addChildren(Set<TimelineEntity.Identifier>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.HierarchicalTimelineEntity
-
- addComponent(Component) - Method in class org.apache.hadoop.yarn.service.api.records.Service
-
- addConfig(String, String) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addConfigs(Map<String, String>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addContainer(Container) - Method in class org.apache.hadoop.yarn.service.api.records.Component
-
- addContainer(Container) - Method in class org.apache.hadoop.yarn.service.api.records.ComponentContainers
-
Add a container.
- addContainerRequest(T) - Method in class org.apache.hadoop.yarn.client.api.AMRMClient
-
Request containers for resources before calling allocate
- addContainerRequest(T) - Method in class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
Request containers for resources before calling allocate
- addCounter(Counters.Counter) - Method in class org.apache.hadoop.mapred.Counters.Group
-
- addCounter(String, String, long) - Method in class org.apache.hadoop.mapred.Counters.Group
-
- addCounter(T) - Method in interface org.apache.hadoop.mapreduce.counters.CounterGroupBase
-
Add a counter to this group.
- addCounter(String, String, long) - Method in interface org.apache.hadoop.mapreduce.counters.CounterGroupBase
-
Add a counter to this group
- addCounter(MetricsInfo, int) - Method in class org.apache.hadoop.metrics2.MetricsJsonBuilder
-
- addCounter(MetricsInfo, long) - Method in class org.apache.hadoop.metrics2.MetricsJsonBuilder
-
- addCounter(MetricsInfo, int) - Method in class org.apache.hadoop.metrics2.MetricsRecordBuilder
-
Add an integer metric
- addCounter(MetricsInfo, long) - Method in class org.apache.hadoop.metrics2.MetricsRecordBuilder
-
Add an long metric
- addCounter(MetricsInfo, int) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- addCounter(MetricsInfo, long) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- addCredentials(Credentials) - Method in class org.apache.hadoop.security.UserGroupInformation
-
Add the given Credentials to this user.
- addDecommissionedInstance(String) - Method in class org.apache.hadoop.yarn.service.api.records.Component
-
- addDefaultResource(String) - Static method in class org.apache.hadoop.conf.Configuration
-
Add a default resource.
- addDefaults() - Method in class org.apache.hadoop.mapred.join.CompositeInputFormat
-
Adds the default set of identifiers to the parser.
- addDefaults() - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeInputFormat
-
Adds the default set of identifiers to the parser.
- addDependingJob(Job) - Method in class org.apache.hadoop.mapred.jobcontrol.Job
-
Add a job to this jobs' dependency list.
- addDependingJob(ControlledJob) - Method in class org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob
-
Add a job to this jobs' dependency list.
- addDeprecatedKeys() - Static method in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- addDeprecation(String, String[], String) - Static method in class org.apache.hadoop.conf.Configuration
-
- addDeprecation(String, String, String) - Static method in class org.apache.hadoop.conf.Configuration
-
Adds the deprecated key to the global deprecation map.
- addDeprecation(String, String[]) - Static method in class org.apache.hadoop.conf.Configuration
-
- addDeprecation(String, String) - Static method in class org.apache.hadoop.conf.Configuration
-
Adds the deprecated key to the global deprecation map when no custom
message is provided.
- addDeprecations(Configuration.DeprecationDelta[]) - Static method in class org.apache.hadoop.conf.Configuration
-
Adds a set of deprecated keys to the global deprecations.
- addDomain(TimelineDomain) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineDomains
-
Add a single domain into the existing domain list
- addDomains(List<TimelineDomain>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineDomains
-
All a list of domains into the existing domain list
- addEntities(List<TimelineEntity>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntities
-
All a list of entities into the existing entity list
- addEntities(List<TimelineEntity>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntities
-
- addEntity(TimelineEntity) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntities
-
Add a single entity into the existing entity list
- addEntity(TimelineEntity) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntities
-
- addErasureCodingPolicies(ErasureCodingPolicy[]) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Add Erasure coding policies to HDFS.
- addError(TimelinePutResponse.TimelinePutError) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelinePutResponse
-
- addError(TimelineWriteResponse.TimelineWriteError) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineWriteResponse
-
- addErrors(List<TimelinePutResponse.TimelinePutError>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelinePutResponse
-
- addErrors(List<TimelineWriteResponse.TimelineWriteError>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineWriteResponse
-
- addEvent(TimelineEvent) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
Add a single event related to the entity to the existing event list
- addEvent(TimelineEvents.EventsOfOneEntity) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEvents
-
- addEvent(TimelineEvent) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEvents.EventsOfOneEntity
-
Add a single event to the existing event list
- addEvent(TimelineEvent) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addEventInfo(String, Object) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEvent
-
Add one piece of the information of the event to the existing information
map
- addEventInfo(Map<String, Object>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEvent
-
Add a map of the information of the event to the existing information map
- addEvents(List<TimelineEvent>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
Add a list of events related to the entity to the existing event list
- addEvents(List<TimelineEvents.EventsOfOneEntity>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEvents
-
- addEvents(List<TimelineEvent>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEvents.EventsOfOneEntity
-
Add a list of event to the existing event list
- addEvents(Set<TimelineEvent>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addExternalEndpoint(Endpoint) - Method in class org.apache.hadoop.registry.client.types.ServiceRecord
-
Add an external endpoint
- addFalsePositive(Key) - Method in class org.apache.hadoop.util.bloom.RetouchedBloomFilter
-
Adds a false positive information to this retouched Bloom filter.
- addFalsePositive(Collection<Key>) - Method in class org.apache.hadoop.util.bloom.RetouchedBloomFilter
-
Adds a collection of false positive information to this retouched Bloom filter.
- addFalsePositive(List<Key>) - Method in class org.apache.hadoop.util.bloom.RetouchedBloomFilter
-
Adds a list of false positive information to this retouched Bloom filter.
- addFalsePositive(Key[]) - Method in class org.apache.hadoop.util.bloom.RetouchedBloomFilter
-
Adds an array of false positive information to this retouched Bloom filter.
- addFencingParameters(Map<String, String>) - Method in class org.apache.hadoop.ha.HAServiceTarget
-
Hook to allow subclasses to add any parameters they would like to
expose to fencing implementations/scripts.
- addFileToClassPath(Path) - Method in class org.apache.hadoop.mapreduce.Job
-
Add an file path to the current set of classpath entries It adds the file
to cache as well.
- addFileToClassPath(Path, Configuration, FileSystem) - Static method in class org.apache.hadoop.mapreduce.Job
-
Add a file path to the current set of classpath entries.
- addFileToClassPath(Path, Configuration, FileSystem, boolean) - Static method in class org.apache.hadoop.mapreduce.Job
-
Add a file path to the current set of classpath entries.
- addFileToSharedCache(URI, Configuration) - Static method in class org.apache.hadoop.mapreduce.Job
-
Add a file to job config for shared cache processing.
- addFileToSharedCacheAndClasspath(URI, Configuration) - Static method in class org.apache.hadoop.mapreduce.Job
-
Add a file to job config for shared cache processing.
- addFlowRun(FlowRunEntity) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.FlowActivityEntity
-
- addFlowRuns(Collection<FlowRunEntity>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.FlowActivityEntity
-
- addGauge(MetricsInfo, int) - Method in class org.apache.hadoop.metrics2.MetricsJsonBuilder
-
- addGauge(MetricsInfo, long) - Method in class org.apache.hadoop.metrics2.MetricsJsonBuilder
-
- addGauge(MetricsInfo, float) - Method in class org.apache.hadoop.metrics2.MetricsJsonBuilder
-
- addGauge(MetricsInfo, double) - Method in class org.apache.hadoop.metrics2.MetricsJsonBuilder
-
- addGauge(MetricsInfo, int) - Method in class org.apache.hadoop.metrics2.MetricsRecordBuilder
-
Add a integer gauge metric
- addGauge(MetricsInfo, long) - Method in class org.apache.hadoop.metrics2.MetricsRecordBuilder
-
Add a long gauge metric
- addGauge(MetricsInfo, float) - Method in class org.apache.hadoop.metrics2.MetricsRecordBuilder
-
Add a float gauge metric
- addGauge(MetricsInfo, double) - Method in class org.apache.hadoop.metrics2.MetricsRecordBuilder
-
Add a double gauge metric
- addGauge(MetricsInfo, int) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- addGauge(MetricsInfo, long) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- addGauge(MetricsInfo, float) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- addGauge(MetricsInfo, double) - Method in class org.apache.hadoop.metrics2.MetricStringBuilder
-
- addGroup(String) - Method in class org.apache.hadoop.hdfs.server.namenode.FsUGIResolver
-
- addGroup(String) - Method in class org.apache.hadoop.hdfs.server.namenode.SingleUGIResolver
-
- addGroup(String) - Method in class org.apache.hadoop.hdfs.server.namenode.UGIResolver
-
- addGroup(String, int) - Method in class org.apache.hadoop.hdfs.server.namenode.UGIResolver
-
- addGroup(String) - Method in class org.apache.hadoop.security.authorize.AccessControlList
-
Add group to the names of groups allowed for this service.
- addIdentifier(String, Class<?>[], Class<? extends Parser.Node>, Class<? extends ComposableRecordReader>) - Static method in class org.apache.hadoop.mapred.join.Parser.Node
-
For a given identifier, add a mapping to the nodetype for the parse
tree and to the ComposableRecordReader to be created, including the
formals required to invoke the constructor.
- addIdentifier(String, Class<?>[], Class<? extends Parser.Node>, Class<? extends ComposableRecordReader>) - Static method in class org.apache.hadoop.mapreduce.lib.join.Parser.Node
-
For a given identifier, add a mapping to the nodetype for the parse
tree and to the ComposableRecordReader to be created, including the
formals required to invoke the constructor.
- addIfService(Object) - Method in class org.apache.hadoop.service.CompositeService
-
- addInfo(Map<String, Object>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addInfo(String, Object) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addInfo(Map<String, Object>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEvent
-
- addInfo(String, Object) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEvent
-
- AddingCompositeService - Class in org.apache.hadoop.registry.server.services
-
Composite service that exports the add/remove methods.
- AddingCompositeService(String) - Constructor for class org.apache.hadoop.registry.server.services.AddingCompositeService
-
- addInputPath(JobConf, Path) - Static method in class org.apache.hadoop.mapred.FileInputFormat
-
Add a
Path
to the list of inputs for the map-reduce job.
- addInputPath(JobConf, Path, Class<? extends InputFormat>) - Static method in class org.apache.hadoop.mapred.lib.MultipleInputs
-
Add a
Path
with a custom
InputFormat
to the list of
inputs for the map-reduce job.
- addInputPath(JobConf, Path, Class<? extends InputFormat>, Class<? extends Mapper>) - Static method in class org.apache.hadoop.mapred.lib.MultipleInputs
-
- addInputPath(Job, Path) - Static method in class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
-
Add a
Path
to the list of inputs for the map-reduce job.
- addInputPath(Job, Path, Class<? extends InputFormat>) - Static method in class org.apache.hadoop.mapreduce.lib.input.MultipleInputs
-
Add a
Path
with a custom
InputFormat
to the list of
inputs for the map-reduce job.
- addInputPath(Job, Path, Class<? extends InputFormat>, Class<? extends Mapper>) - Static method in class org.apache.hadoop.mapreduce.lib.input.MultipleInputs
-
- addInputPathRecursively(List<FileStatus>, FileSystem, Path, PathFilter) - Method in class org.apache.hadoop.mapred.FileInputFormat
-
Add files in the input path recursively into the results.
- addInputPathRecursively(List<FileStatus>, FileSystem, Path, PathFilter) - Method in class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
-
Add files in the input path recursively into the results.
- addInputPaths(JobConf, String) - Static method in class org.apache.hadoop.mapred.FileInputFormat
-
Add the given comma separated paths to the list of inputs for
the map-reduce job.
- addInputPaths(Job, String) - Static method in class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
-
Add the given comma separated paths to the list of inputs for
the map-reduce job.
- addInternalEndpoint(Endpoint) - Method in class org.apache.hadoop.registry.client.types.ServiceRecord
-
Add an internal endpoint
- addIsRelatedToEntities(Map<String, Set<String>>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addIsRelatedToEntity(String, String) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addJarResource(String, Map<String, LocalResource>) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- addJob(ControlledJob) - Method in class org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl
-
Add a new controlled job.
- addJob(Job) - Method in class org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl
-
Add a new job.
- addJobCollection(Collection<ControlledJob>) - Method in class org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl
-
Add a collection of jobs
- addJobs(Collection<Job>) - Method in class org.apache.hadoop.mapred.jobcontrol.JobControl
-
Add a collection of jobs
- addKey(DelegationKey) - Method in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Add a previously used master key to cache (when NN restarts),
should be called before activate().
- addLocalArchives(Configuration, String) - Static method in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- addLocalFiles(Configuration, String) - Static method in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- addMapper(JobConf, Class<? extends Mapper<K1, V1, K2, V2>>, Class<? extends K1>, Class<? extends V1>, Class<? extends K2>, Class<? extends V2>, boolean, JobConf) - Static method in class org.apache.hadoop.mapred.lib.ChainMapper
-
Adds a Mapper class to the chain job's JobConf.
- addMapper(JobConf, Class<? extends Mapper<K1, V1, K2, V2>>, Class<? extends K1>, Class<? extends V1>, Class<? extends K2>, Class<? extends V2>, boolean, JobConf) - Static method in class org.apache.hadoop.mapred.lib.ChainReducer
-
Adds a Mapper class to the chain job's JobConf.
- addMapper(Job, Class<? extends Mapper>, Class<?>, Class<?>, Class<?>, Class<?>, Configuration) - Static method in class org.apache.hadoop.mapreduce.lib.chain.ChainMapper
-
Adds a
Mapper
class to the chain mapper.
- addMapper(Job, Class<? extends Mapper>, Class<?>, Class<?>, Class<?>, Class<?>, Configuration) - Static method in class org.apache.hadoop.mapreduce.lib.chain.ChainReducer
-
Adds a
Mapper
class to the chain reducer.
- addMetric(TimelineMetric) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addMetrics(Set<TimelineMetric>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addMetrics(EventTypeMetrics, Class<? extends Enum>) - Method in class org.apache.hadoop.yarn.event.AsyncDispatcher
-
- addMultiNamedOutput(JobConf, String, Class<? extends OutputFormat>, Class<?>, Class<?>) - Static method in class org.apache.hadoop.mapred.lib.MultipleOutputs
-
Adds a multi named output for the job.
- addNamedOutput(JobConf, String, Class<? extends OutputFormat>, Class<?>, Class<?>) - Static method in class org.apache.hadoop.mapred.lib.MultipleOutputs
-
Adds a named output for the job.
- addNamedOutput(Job, String, Class<? extends OutputFormat>, Class<?>, Class<?>) - Static method in class org.apache.hadoop.mapreduce.lib.output.MultipleOutputs
-
Adds a named output for the job.
- addNextValue(Object) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.DoubleValueSum
-
add a value to the aggregator
- addNextValue(double) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.DoubleValueSum
-
add a value to the aggregator
- addNextValue(Object) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.LongValueMax
-
add a value to the aggregator
- addNextValue(long) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.LongValueMax
-
add a value to the aggregator
- addNextValue(Object) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.LongValueMin
-
add a value to the aggregator
- addNextValue(long) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.LongValueMin
-
add a value to the aggregator
- addNextValue(Object) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.LongValueSum
-
add a value to the aggregator
- addNextValue(long) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.LongValueSum
-
add a value to the aggregator
- addNextValue(Object) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.StringValueMax
-
add a value to the aggregator
- addNextValue(Object) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.StringValueMin
-
add a value to the aggregator
- addNextValue(Object) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.UniqValueCount
-
add a value to the aggregator
- addNextValue(Object) - Method in interface org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregator
-
add a value to the aggregator
- addNextValue(Object) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.ValueHistogram
-
add the given val to the aggregator.
- addOtherInfo(String, Object) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
Add one piece of other information of the entity to the existing other info
map
- addOtherInfo(Map<String, Object>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
Add a map of other information of the entity to the existing other info map
- addPersistedDelegationToken(TokenIdent, long) - Method in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
This method is intended to be used for recovering persisted delegation
tokens.
- addPrimaryFilter(String, Object) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
Add a single piece of primary filter to the existing primary filter map
- addPrimaryFilters(Map<String, Set<Object>>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
Add a map of primary filters to the existing primary filter map
- addQuantileInfo(int, MetricsInfo) - Method in class org.apache.hadoop.metrics2.lib.MutableQuantiles
-
Add entry to quantileInfos array.
- addRecord(String) - Method in interface org.apache.hadoop.metrics2.MetricsCollector
-
Add a metrics record
- addRecord(MetricsInfo) - Method in interface org.apache.hadoop.metrics2.MetricsCollector
-
Add a metrics record
- addRelatedEntities(Map<String, Set<String>>) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
Add a map of related entities to the existing related entity map
- addRelatedEntity(String, String) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
Add an entity to the existing related entity map
- addRelatesToEntities(Map<String, Set<String>>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addRelatesToEntity(String, String) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- addResource(String) - Method in class org.apache.hadoop.conf.Configuration
-
Add a configuration resource.
- addResource(String, boolean) - Method in class org.apache.hadoop.conf.Configuration
-
- addResource(URL) - Method in class org.apache.hadoop.conf.Configuration
-
Add a configuration resource.
- addResource(URL, boolean) - Method in class org.apache.hadoop.conf.Configuration
-
- addResource(Path) - Method in class org.apache.hadoop.conf.Configuration
-
Add a configuration resource.
- addResource(Path, boolean) - Method in class org.apache.hadoop.conf.Configuration
-
- addResource(InputStream) - Method in class org.apache.hadoop.conf.Configuration
-
Add a configuration resource.
- addResource(InputStream, boolean) - Method in class org.apache.hadoop.conf.Configuration
-
- addResource(InputStream, String) - Method in class org.apache.hadoop.conf.Configuration
-
Add a configuration resource.
- addResource(InputStream, String, boolean) - Method in class org.apache.hadoop.conf.Configuration
-
- addResource(Configuration) - Method in class org.apache.hadoop.conf.Configuration
-
Add a configuration resource.
- ADDRESS_HOSTNAME_AND_PORT - Static variable in interface org.apache.hadoop.registry.client.types.AddressTypes
-
hostname/FQDN and port pair: "host/port".
- ADDRESS_HOSTNAME_FIELD - Static variable in interface org.apache.hadoop.registry.client.types.AddressTypes
-
- ADDRESS_OTHER - Static variable in interface org.apache.hadoop.registry.client.types.AddressTypes
-
Any other address: "".
- ADDRESS_PATH - Static variable in interface org.apache.hadoop.registry.client.types.AddressTypes
-
Path /a/b/c
style: "path".
- ADDRESS_PORT_FIELD - Static variable in interface org.apache.hadoop.registry.client.types.AddressTypes
-
- ADDRESS_URI - Static variable in interface org.apache.hadoop.registry.client.types.AddressTypes
-
URI entries: "uri".
- ADDRESS_ZOOKEEPER - Static variable in interface org.apache.hadoop.registry.client.types.AddressTypes
-
Zookeeper addresses as a triple : "zktriple".
- addresses - Variable in class org.apache.hadoop.registry.client.types.Endpoint
-
a list of address tuples —tuples whose format depends on the address type
- addressType - Variable in class org.apache.hadoop.registry.client.types.Endpoint
-
Type of address.
- AddressTypes - Interface in org.apache.hadoop.registry.client.types
-
Enum of address types -as integers.
- addSample(long) - Method in class org.apache.hadoop.fs.statistics.MeanStatistic
-
Add a sample.
- addSchedulingRequests(Collection<SchedulingRequest>) - Method in class org.apache.hadoop.yarn.client.api.AMRMClient
-
Add a Collection of SchedulingRequests.
- addSchedulingRequests(Collection<SchedulingRequest>) - Method in class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
Add a Collection of SchedulingRequests.
- addSecretKey(Text, byte[]) - Method in class org.apache.hadoop.security.Credentials
-
Set the key for an alias.
- addService(Service) - Method in class org.apache.hadoop.registry.server.services.AddingCompositeService
-
- addService(Service) - Method in class org.apache.hadoop.service.CompositeService
-
- addShutdownHook(Runnable, int) - Method in class org.apache.hadoop.util.ShutdownHookManager
-
Adds a shutdownHook with a priority, the higher the priority
the earlier will run.
- addShutdownHook(Runnable, int, long, TimeUnit) - Method in class org.apache.hadoop.util.ShutdownHookManager
-
Adds a shutdownHook with a priority and timeout the higher the priority
the earlier will run.
- addSuppressedLoggingExceptions(Class<?>...) - Method in class org.apache.hadoop.ipc.Server
-
Add exception classes which server won't log at all.
- addTags(Properties) - Method in class org.apache.hadoop.conf.Configuration
-
Add tags defined in HADOOP_TAGS_SYSTEM, HADOOP_TAGS_CUSTOM.
- addTerseExceptions(Class<?>...) - Method in class org.apache.hadoop.ipc.Server
-
Add exception classes for which server won't log stack traces.
- addTo(int, int, float) - Method in class org.apache.hadoop.yarn.api.records.ResourceUtilization
-
Add utilization to the current one.
- addTo(int, int, float, String, float) - Method in class org.apache.hadoop.yarn.api.records.ResourceUtilization
-
Add utilization to the current one.
- addToken(Text, Token<? extends TokenIdentifier>) - Method in class org.apache.hadoop.security.Credentials
-
Add a token in the storage (in memory).
- addToken(Token<? extends TokenIdentifier>) - Method in class org.apache.hadoop.security.UserGroupInformation
-
Add a token to this UGI
- addToken(Text, Token<? extends TokenIdentifier>) - Method in class org.apache.hadoop.security.UserGroupInformation
-
Add a named token to this UGI
- addTokenForOwnerStats(TokenIdent) - Method in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Add token stats to the owner to token count mapping.
- addTokenIdentifier(TokenIdentifier) - Method in class org.apache.hadoop.security.UserGroupInformation
-
Add a TokenIdentifier to this UGI.
- addToMap(Class<?>) - Method in class org.apache.hadoop.io.AbstractMapWritable
-
Add a Class to the maps if it is not already present.
- addTransition(STATE, STATE, EVENTTYPE) - Method in class org.apache.hadoop.yarn.state.StateMachineFactory
-
- addTransition(STATE, STATE, Set<EVENTTYPE>) - Method in class org.apache.hadoop.yarn.state.StateMachineFactory
-
- addTransition(STATE, STATE, Set<EVENTTYPE>, SingleArcTransition<OPERAND, EVENT>) - Method in class org.apache.hadoop.yarn.state.StateMachineFactory
-
- addTransition(STATE, STATE, EVENTTYPE, SingleArcTransition<OPERAND, EVENT>) - Method in class org.apache.hadoop.yarn.state.StateMachineFactory
-
- addTransition(STATE, Set<STATE>, EVENTTYPE, MultipleArcTransition<OPERAND, EVENT, STATE>) - Method in class org.apache.hadoop.yarn.state.StateMachineFactory
-
- addUser(String) - Method in class org.apache.hadoop.hdfs.server.namenode.FsUGIResolver
-
- addUser(String) - Method in class org.apache.hadoop.hdfs.server.namenode.SingleUGIResolver
-
- addUser(String) - Method in class org.apache.hadoop.hdfs.server.namenode.UGIResolver
-
- addUser(String, int) - Method in class org.apache.hadoop.hdfs.server.namenode.UGIResolver
-
- addUser(String) - Method in class org.apache.hadoop.security.authorize.AccessControlList
-
Add user to the names of users allowed for this service.
- addValue(long, Number) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineMetric
-
- addValues(Map<Long, Number>) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineMetric
-
- addWriteAccessor(String, String) - Method in interface org.apache.hadoop.registry.client.api.RegistryOperations
-
Add a new write access entry to be added to node permissions in all
future write operations of a session connected to a secure registry.
- Adl - Class in org.apache.hadoop.fs.adl
-
Expose adl:// scheme to access ADL file system.
- ADL_HTTP_TIMEOUT - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- ADL_SSL_CHANNEL_MODE - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AdlConfKeys - Class in org.apache.hadoop.fs.adl
-
Constants.
- AdlFileSystem - Class in org.apache.hadoop.fs.adl
-
A FileSystem to access Azure Data Lake Store.
- AdlFileSystem() - Constructor for class org.apache.hadoop.fs.adl.AdlFileSystem
-
- AdminSecurityInfo - Class in org.apache.hadoop.yarn.security.admin
-
- AdminSecurityInfo() - Constructor for class org.apache.hadoop.yarn.security.admin.AdminSecurityInfo
-
- aggregate(IOStatistics) - Method in interface org.apache.hadoop.fs.statistics.IOStatisticsAggregator
-
Aggregate the supplied statistics into the current
set.
- aggregate(IOStatistics) - Method in class org.apache.hadoop.fs.statistics.IOStatisticsSnapshot
-
Aggregate the current statistics with the
source reference passed in.
- AggregatedLogFormat - Class in org.apache.hadoop.yarn.logaggregation
-
- AggregatedLogFormat() - Constructor for class org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat
-
- AggregatedLogFormat.LogKey - Class in org.apache.hadoop.yarn.logaggregation
-
- AggregatedLogFormat.LogReader - Class in org.apache.hadoop.yarn.logaggregation
-
- aggregatedLogSuffix(String) - Method in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
Create the aggregated log suffix.
- aggregateTo(TimelineMetric, TimelineMetric) - Static method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineMetric
-
Aggregate an incoming metric to the base aggregated metric with the given
operation state in a stateless fashion.
- aggregateTo(TimelineMetric, TimelineMetric, Map<Object, Object>) - Static method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineMetric
-
Aggregate an incoming metric to the base aggregated metric with the given
operation state.
- aggregatorDescriptorList - Variable in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase
-
- aggregatorDescriptorList - Static variable in class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorJobBase
-
- AHSClient - Class in org.apache.hadoop.yarn.client.api
-
- AHSClient(String) - Constructor for class org.apache.hadoop.yarn.client.api.AHSClient
-
- AHSProxy<T> - Class in org.apache.hadoop.yarn.client
-
- AHSProxy() - Constructor for class org.apache.hadoop.yarn.client.AHSProxy
-
- allFinished() - Method in class org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl
-
- allKeys - Variable in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Access to allKeys is protected by this object lock
- allocate(AllocateRequest) - Method in interface org.apache.hadoop.yarn.api.ApplicationMasterProtocol
-
The main interface between an ApplicationMaster
and the
ResourceManager
.
- allocate(float) - Method in class org.apache.hadoop.yarn.client.api.AMRMClient
-
Request additional containers and receive new container allocations.
- AllocateRequest - Class in org.apache.hadoop.yarn.api.protocolrecords
-
The core request sent by the ApplicationMaster
to the
ResourceManager
to obtain resources in the cluster.
- AllocateRequest() - Constructor for class org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest
-
- AllocateRequest.AllocateRequestBuilder - Class in org.apache.hadoop.yarn.api.protocolrecords
-
- AllocateResponse - Class in org.apache.hadoop.yarn.api.protocolrecords
-
The response sent by the ResourceManager
the
ApplicationMaster
during resource negotiation.
- AllocateResponse() - Constructor for class org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse
-
- allocationRequestId(long) - Method in class org.apache.hadoop.yarn.api.records.ResourceRequest.ResourceRequestBuilder
-
Set the allocationRequestId
of the request.
- allocationRequestId(long) - Method in class org.apache.hadoop.yarn.api.records.SchedulingRequest.SchedulingRequestBuilder
-
Set the allocationRequestId
of the request.
- allocationTags(Set<String>) - Method in class org.apache.hadoop.yarn.api.records.SchedulingRequest.SchedulingRequestBuilder
-
Set the allocationTags
of the request.
- ALLOW_REQUESTER_PAYS - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Configuration option for S3 Requester Pays feature: "fs.s3a.requester.pays.enabled".
- allowAppend - Variable in class org.apache.hadoop.metrics2.sink.RollingFileSystemSink
-
- allowSameDiskTiering(StorageType) - Static method in enum org.apache.hadoop.fs.StorageType
-
- allowSnapshot(Path) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Allow snapshot on a directory.
- AM_ALLOW_NON_EXCLUSIVE_ALLOCATION - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AM_DEFAULT_NODE_LABEL - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AM_SCHEDULING_NODE_BLACKLISTING_DISABLE_THRESHOLD - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AM_SCHEDULING_NODE_BLACKLISTING_ENABLED - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AMCommand - Enum in org.apache.hadoop.yarn.api.records
-
Command sent by the Resource Manager to the Application Master in the
AllocateResponse
- AMRM_PROXY_ADDRESS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AMRM_PROXY_CLIENT_THREAD_COUNT - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AMRM_PROXY_ENABLED - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
The setting that controls whether AMRMProxy is enabled or not.
- AMRM_PROXY_HA_ENABLED - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AMRM_PROXY_INTERCEPTOR_CLASS_PIPELINE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AMRM_PROXY_WAIT_UAM_REGISTER_DONE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AMRMClient<T extends org.apache.hadoop.yarn.client.api.AMRMClient.ContainerRequest> - Class in org.apache.hadoop.yarn.client.api
-
- AMRMClient(String) - Constructor for class org.apache.hadoop.yarn.client.api.AMRMClient
-
- AMRMClientAsync<T extends org.apache.hadoop.yarn.client.api.AMRMClient.ContainerRequest> - Class in org.apache.hadoop.yarn.client.api.async
-
AMRMClientAsync
handles communication with the ResourceManager
and provides asynchronous updates on events such as container allocations and
completions.
- AMRMClientAsync(int, AMRMClientAsync.AbstractCallbackHandler) - Constructor for class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
- AMRMClientAsync(AMRMClient<T>, int, AMRMClientAsync.AbstractCallbackHandler) - Constructor for class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
- AMRMClientAsync(int, AMRMClientAsync.CallbackHandler) - Constructor for class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
Deprecated.
- AMRMClientAsync(AMRMClient<T>, int, AMRMClientAsync.CallbackHandler) - Constructor for class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
Deprecated.
- AMRMTokenIdentifier - Class in org.apache.hadoop.yarn.security
-
AMRMTokenIdentifier is the TokenIdentifier to be used by
ApplicationMasters to authenticate to the ResourceManager.
- AMRMTokenIdentifier() - Constructor for class org.apache.hadoop.yarn.security.AMRMTokenIdentifier
-
- AMRMTokenIdentifier(ApplicationAttemptId, int) - Constructor for class org.apache.hadoop.yarn.security.AMRMTokenIdentifier
-
- AMRMTokenSelector - Class in org.apache.hadoop.yarn.security
-
- AMRMTokenSelector() - Constructor for class org.apache.hadoop.yarn.security.AMRMTokenSelector
-
- and(FsAction) - Method in enum org.apache.hadoop.fs.permission.FsAction
-
AND operation.
- and(Filter) - Method in class org.apache.hadoop.util.bloom.BloomFilter
-
- and(Filter) - Method in class org.apache.hadoop.util.bloom.CountingBloomFilter
-
- and(Filter) - Method in class org.apache.hadoop.util.bloom.DynamicBloomFilter
-
- and(PlacementConstraint.AbstractConstraint...) - Static method in class org.apache.hadoop.yarn.api.resource.PlacementConstraints
-
A conjunction of constraints.
- AND_MARK - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- ANY - Static variable in class org.apache.hadoop.yarn.api.records.ResourceRequest
-
The constant string representing no locality.
- APACHE_IMPL - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- api - Variable in class org.apache.hadoop.registry.client.types.Endpoint
-
API implemented at the end of the binding
- APN_VERSION - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- APP_ATTEMPT_DIAGNOSTICS_LIMIT_KC - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- APP_DIR_PERMISSIONS - Static variable in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
Permissions for the Application directory.
- APP_FINAL_VALUE_RETENTION_THRESHOLD - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
The name for setting that controls how long the final value of
a metric of a completed app is retained before merging
into the flow sum.
- APP_LOG_FILE_UMASK - Static variable in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
Umask for the log file.
- APP_NAME_PLACEMENT_RULE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- APP_SUBMIT_TIME_ENV - Static variable in interface org.apache.hadoop.yarn.api.ApplicationConstants
-
The environment variable for APP_SUBMIT_TIME.
- AppAdminClient - Class in org.apache.hadoop.yarn.client.api
-
Client for managing applications.
- AppAdminClient() - Constructor for class org.apache.hadoop.yarn.client.api.AppAdminClient
-
- appAttemptID - Variable in class org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster
-
- appAttemptIdStrPrefix - Static variable in class org.apache.hadoop.yarn.api.records.ApplicationAttemptId
-
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.adl.AdlFileSystem
-
Append to an existing file (optional operation).
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
This optional operation is not yet supported.
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
- append(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Append to an existing file (optional operation).
- append(Path, int) - Method in class org.apache.hadoop.fs.FileSystem
-
Append to an existing file (optional operation).
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Append to an existing file (optional operation).
- append(Path, boolean) - Method in class org.apache.hadoop.fs.FileSystem
-
Append to an existing file (optional operation).
- append(Path, int, Progressable, boolean) - Method in class org.apache.hadoop.fs.FileSystem
-
Append to an existing file (optional operation).
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- append() - Method in class org.apache.hadoop.fs.FSDataOutputStreamBuilder
-
Append to an existing file (optional operation).
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.ftp.FTPFileSystem
-
This optional operation is not yet supported.
- append() - Method in class org.apache.hadoop.fs.impl.MultipartUploaderBuilderImpl
-
Append to an existing file (optional operation).
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
-
Deprecated.
- append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.viewfs.ViewFileSystem
-
- append(byte[], int, int) - Method in class org.apache.hadoop.io.Text
-
Append a range of bytes to the end of the given text.
- append(byte[], int, int) - Method in class org.apache.hadoop.record.Buffer
-
Deprecated.
Append specified bytes to the buffer.
- append(byte[]) - Method in class org.apache.hadoop.record.Buffer
-
Deprecated.
Append specified bytes to the buffer
- append(LoggingEvent) - Method in class org.apache.hadoop.yarn.ContainerLogAppender
-
- append(CharSequence) - Method in class org.apache.hadoop.yarn.util.BoundedAppender
-
- APPEND_ACTION - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- APPEND_BLOB_TYPE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- APPEND_SUPPORT_ENABLE_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
- APPENDBLOB_MAX_WRITE_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.FileSystemConfigurations
-
- appendFile(Path) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
This is overridden to ensure that this class's create() method is
ultimately called.
- appendFile(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Create a Builder to append a file.
- appendFile(Path) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- appendScriptExtension(File, String) - Static method in class org.apache.hadoop.util.Shell
-
Returns a File referencing a script with the given basename, inside the
given parent directory.
- appendScriptExtension(String) - Static method in class org.apache.hadoop.util.Shell
-
Returns a script file name with the given basename.
- appendTo(StringBuilder) - Method in class org.apache.hadoop.mapreduce.JobID
-
Add the stuff after the "job" prefix to the given builder.
- appendTo(StringBuilder) - Method in class org.apache.hadoop.mapreduce.TaskAttemptID
-
Add the unique string to the StringBuilder
- appendTo(StringBuilder) - Method in class org.apache.hadoop.mapreduce.TaskID
-
Add the unique string to the given builder.
- appendToConf(Configuration) - Method in class org.apache.hadoop.tools.DistCpOptions
-
Add options to configuration.
- appIdStrPrefix - Static variable in class org.apache.hadoop.yarn.api.records.ApplicationId
-
- APPLICATION_ATTEMPT_PREFIX - Static variable in class org.apache.hadoop.yarn.util.ConverterUtils
-
- APPLICATION_HISTORY_ENABLED - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
The setting that controls whether application history service is
enabled or not.
- APPLICATION_HISTORY_MAX_APPS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
Defines the max number of applications could be fetched using
REST API or application history protocol and shown in timeline
server web ui.
- APPLICATION_HISTORY_PREFIX - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- APPLICATION_HISTORY_SAVE_NON_AM_CONTAINER_META_INFO - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
Save container meta-info in the application history store.
- APPLICATION_HISTORY_STORE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
Application history store class
- APPLICATION_JSON - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- APPLICATION_OCTET_STREAM - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- APPLICATION_PLACEMENT_TYPE_CLASS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
Configure default application placement allocator.
- APPLICATION_PREFIX - Static variable in class org.apache.hadoop.yarn.util.ConverterUtils
-
- APPLICATION_TAG_BASED_PLACEMENT_ENABLED - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- APPLICATION_TAG_BASED_PLACEMENT_USER_WHITELIST - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- APPLICATION_TAG_FORCE_LOWERCASE_CONVERSION - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- APPLICATION_TYPE_LENGTH - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
Default application type length
- APPLICATION_WEB_PROXY_BASE_ENV - Static variable in interface org.apache.hadoop.yarn.api.ApplicationConstants
-
The environmental variable for APPLICATION_WEB_PROXY_BASE.
- ApplicationAccessType - Enum in org.apache.hadoop.yarn.api.records
-
Application access types.
- ApplicationAttemptEntity - Class in org.apache.hadoop.yarn.api.records.timelineservice
-
This entity represents an application attempt.
- ApplicationAttemptEntity() - Constructor for class org.apache.hadoop.yarn.api.records.timelineservice.ApplicationAttemptEntity
-
- ApplicationAttemptEntity(TimelineEntity) - Constructor for class org.apache.hadoop.yarn.api.records.timelineservice.ApplicationAttemptEntity
-
- ApplicationAttemptId - Class in org.apache.hadoop.yarn.api.records
-
ApplicationAttemptId
denotes the particular
attempt
of an
ApplicationMaster
for a given
ApplicationId
.
- ApplicationAttemptId() - Constructor for class org.apache.hadoop.yarn.api.records.ApplicationAttemptId
-
- ApplicationAttemptNotFoundException - Exception in org.apache.hadoop.yarn.exceptions
-
- ApplicationAttemptNotFoundException(Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationAttemptNotFoundException
-
- ApplicationAttemptNotFoundException(String) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationAttemptNotFoundException
-
- ApplicationAttemptNotFoundException(String, Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationAttemptNotFoundException
-
- ApplicationAttemptReport - Class in org.apache.hadoop.yarn.api.records
-
ApplicationAttemptReport
is a report of an application attempt.
- ApplicationAttemptReport() - Constructor for class org.apache.hadoop.yarn.api.records.ApplicationAttemptReport
-
- ApplicationClassLoader - Class in org.apache.hadoop.util
-
- ApplicationClassLoader(URL[], ClassLoader, List<String>) - Constructor for class org.apache.hadoop.util.ApplicationClassLoader
-
- ApplicationClassLoader(String, ClassLoader, List<String>) - Constructor for class org.apache.hadoop.util.ApplicationClassLoader
-
- ApplicationClassLoader - Class in org.apache.hadoop.yarn.util
-
Deprecated.
- ApplicationClassLoader(URL[], ClassLoader, List<String>) - Constructor for class org.apache.hadoop.yarn.util.ApplicationClassLoader
-
Deprecated.
- ApplicationClassLoader(String, ClassLoader, List<String>) - Constructor for class org.apache.hadoop.yarn.util.ApplicationClassLoader
-
Deprecated.
- ApplicationClientProtocol - Interface in org.apache.hadoop.yarn.api
-
The protocol between clients and the ResourceManager
to submit/abort jobs and to get information on applications, cluster metrics,
nodes, queues and ACLs.
- ApplicationConstants - Interface in org.apache.hadoop.yarn.api
-
This is the API for the applications comprising of constants that YARN sets
up for the applications and the containers.
- ApplicationConstants.ContainerLaunchType - Enum in org.apache.hadoop.yarn.api
-
The type of launch for the container.
- ApplicationEntity - Class in org.apache.hadoop.yarn.api.records.timelineservice
-
This entity represents an application.
- ApplicationEntity() - Constructor for class org.apache.hadoop.yarn.api.records.timelineservice.ApplicationEntity
-
- ApplicationEntity(TimelineEntity) - Constructor for class org.apache.hadoop.yarn.api.records.timelineservice.ApplicationEntity
-
- ApplicationHistoryProtocol - Interface in org.apache.hadoop.yarn.api
-
The protocol between clients and the ApplicationHistoryServer
to
get the information of completed applications etc.
- ApplicationId - Class in org.apache.hadoop.yarn.api.records
-
ApplicationId
represents the globally unique
identifier for an application.
- ApplicationId() - Constructor for class org.apache.hadoop.yarn.api.records.ApplicationId
-
- ApplicationIdNotProvidedException - Exception in org.apache.hadoop.yarn.exceptions
-
- ApplicationIdNotProvidedException(Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationIdNotProvidedException
-
- ApplicationIdNotProvidedException(String) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationIdNotProvidedException
-
- ApplicationIdNotProvidedException(String, Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationIdNotProvidedException
-
- ApplicationMaster - Class in org.apache.hadoop.tools.dynamometer
-
The ApplicationMaster for Dynamometer.
- ApplicationMaster() - Constructor for class org.apache.hadoop.tools.dynamometer.ApplicationMaster
-
- ApplicationMaster - Class in org.apache.hadoop.yarn.applications.distributedshell
-
An ApplicationMaster for executing shell commands on a set of launched
containers using the YARN framework.
- ApplicationMaster() - Constructor for class org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster
-
- ApplicationMasterProtocol - Interface in org.apache.hadoop.yarn.api
-
The protocol between a live instance of ApplicationMaster
and the ResourceManager
.
- ApplicationNotFoundException - Exception in org.apache.hadoop.yarn.exceptions
-
This exception is thrown on
(GetApplicationReportRequest)
API
when the Application doesn't exist in RM and AHS
- ApplicationNotFoundException(Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException
-
- ApplicationNotFoundException(String) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException
-
- ApplicationNotFoundException(String, Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ApplicationNotFoundException
-
- ApplicationReport - Class in org.apache.hadoop.yarn.api.records
-
ApplicationReport
is a report of an application.
- ApplicationReport() - Constructor for class org.apache.hadoop.yarn.api.records.ApplicationReport
-
- ApplicationResourceUsageReport - Class in org.apache.hadoop.yarn.api.records
-
Contains various scheduling metrics to be reported by UI and CLI.
- ApplicationResourceUsageReport() - Constructor for class org.apache.hadoop.yarn.api.records.ApplicationResourceUsageReport
-
- ApplicationsRequestScope - Enum in org.apache.hadoop.yarn.api.protocolrecords
-
Enumeration that controls the scope of applications fetched
- ApplicationSubmissionContext - Class in org.apache.hadoop.yarn.api.records
-
ApplicationSubmissionContext
represents all of the
information needed by the ResourceManager
to launch
the ApplicationMaster
for an application.
- ApplicationSubmissionContext() - Constructor for class org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext
-
- ApplicationTimeout - Class in org.apache.hadoop.yarn.api.records
-
ApplicationTimeout
is a report for configured application timeouts.
- ApplicationTimeout() - Constructor for class org.apache.hadoop.yarn.api.records.ApplicationTimeout
-
- ApplicationTimeoutType - Enum in org.apache.hadoop.yarn.api.records
-
Application timeout type.
- applyToIOStatisticsSnapshot(Serializable, FunctionRaisingIOE<IOStatisticsSnapshot, T>) - Static method in class org.apache.hadoop.io.wrappedio.WrappedStatistics
-
Apply a function to an object which may be an IOStatisticsSnapshot.
- applyUMask(FsPermission, FsPermission) - Static method in class org.apache.hadoop.fs.permission.FsCreateModes
-
Create from unmasked mode and umask.
- applyUMask(FsPermission) - Method in class org.apache.hadoop.fs.permission.FsPermission
-
Apply a umask to this permission and return a new one.
- APPNAME_ARG - Static variable in class org.apache.hadoop.tools.dynamometer.Client
-
- APPNAME_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.Client
-
- approximateCount(Key) - Method in class org.apache.hadoop.util.bloom.CountingBloomFilter
-
This method calculates an approximate count of the key, i.e.
- APPS_CACHE_ENABLE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- APPS_CACHE_EXPIRE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- APPS_CACHE_SIZE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- areSymlinksEnabled() - Static method in class org.apache.hadoop.fs.FileSystem
-
- ArrayFile - Class in org.apache.hadoop.io
-
A dense file-based mapping from integers to values.
- ArrayFile() - Constructor for class org.apache.hadoop.io.ArrayFile
-
- ArrayListBackedIterator<X extends Writable> - Class in org.apache.hadoop.mapred.join
-
This class provides an implementation of ResetableIterator.
- ArrayListBackedIterator() - Constructor for class org.apache.hadoop.mapred.join.ArrayListBackedIterator
-
- ArrayListBackedIterator(ArrayList<X>) - Constructor for class org.apache.hadoop.mapred.join.ArrayListBackedIterator
-
- ArrayListBackedIterator<X extends Writable> - Class in org.apache.hadoop.mapreduce.lib.join
-
This class provides an implementation of ResetableIterator.
- ArrayListBackedIterator() - Constructor for class org.apache.hadoop.mapreduce.lib.join.ArrayListBackedIterator
-
- ArrayListBackedIterator(ArrayList<X>) - Constructor for class org.apache.hadoop.mapreduce.lib.join.ArrayListBackedIterator
-
- ArrayPrimitiveWritable - Class in org.apache.hadoop.io
-
This is a wrapper class.
- ArrayPrimitiveWritable() - Constructor for class org.apache.hadoop.io.ArrayPrimitiveWritable
-
Construct an empty instance, for use during Writable read
- ArrayPrimitiveWritable(Class<?>) - Constructor for class org.apache.hadoop.io.ArrayPrimitiveWritable
-
Construct an instance of known type but no value yet
for use with type-specific wrapper classes.
- ArrayPrimitiveWritable(Object) - Constructor for class org.apache.hadoop.io.ArrayPrimitiveWritable
-
Wrap an existing array of primitives
- ArrayWritable - Class in org.apache.hadoop.io
-
A Writable for arrays containing instances of a class.
- ArrayWritable(Class<? extends Writable>) - Constructor for class org.apache.hadoop.io.ArrayWritable
-
- ArrayWritable(Class<? extends Writable>, Writable[]) - Constructor for class org.apache.hadoop.io.ArrayWritable
-
- ArrayWritable(String[]) - Constructor for class org.apache.hadoop.io.ArrayWritable
-
- Artifact - Class in org.apache.hadoop.yarn.service.api.records
-
Artifact of an service component.
- Artifact() - Constructor for class org.apache.hadoop.yarn.service.api.records.Artifact
-
- artifact(Artifact) - Method in class org.apache.hadoop.yarn.service.api.records.Component
-
Artifact of the component (optional).
- artifact(Artifact) - Method in class org.apache.hadoop.yarn.service.api.records.Container
-
Artifact used for this container.
- artifact(Artifact) - Method in class org.apache.hadoop.yarn.service.api.records.ReadinessCheck
-
Artifact of the pluggable readiness check helper container (optional).
- artifact(Artifact) - Method in class org.apache.hadoop.yarn.service.api.records.Service
-
Artifact of single-component services.
- asDuration() - Method in class org.apache.hadoop.util.OperationDuration
-
Get the duration of an operation as a java Duration
instance.
- askList(List<ResourceRequest>) - Method in class org.apache.hadoop.yarn.api.protocolrecords.AllocateRequest.AllocateRequestBuilder
-
Set the askList
of the request.
- asList() - Static method in enum org.apache.hadoop.fs.StorageType
-
- ASSUMED_ROLE_ARN - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
ARN of AWS Role to request: "fs.s3a.assumed.role.arn".
- ASSUMED_ROLE_CREDENTIALS_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
- ASSUMED_ROLE_CREDENTIALS_PROVIDER - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
List of providers to authenticate for the assumed role: "fs.s3a.assumed.role.credentials.provider".
- ASSUMED_ROLE_EXTERNAL_ID - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
external id for assume role request: "fs.s3a.assumed.role.external.id".
- ASSUMED_ROLE_POLICY - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
JSON policy containing the policy to apply to the role: "fs.s3a.assumed.role.policy".
- ASSUMED_ROLE_SESSION_DURATION - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Duration of assumed roles before a refresh is attempted.
- ASSUMED_ROLE_SESSION_DURATION_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Default duration of an assumed role: "1h".
- ASSUMED_ROLE_SESSION_NAME - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Session name for the assumed role, must be valid characters according
to the AWS APIs: "fs.s3a.assumed.role.session.name".
- ASSUMED_ROLE_STS_ENDPOINT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Security Token Service Endpoint: "fs.s3a.assumed.role.sts.endpoint".
- ASSUMED_ROLE_STS_ENDPOINT_REGION - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Region for the STS endpoint; needed if the endpoint
is set to anything other then the central one.: "fs.s3a.assumed.role.sts.endpoint.region".
- ASSUMED_ROLE_STS_ENDPOINT_REGION_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Default value for the STS endpoint region; needed for
v4 signing: "".
- AssumedRoleCredentialProvider - Class in org.apache.hadoop.fs.s3a.auth
-
Support IAM Assumed roles by instantiating an instance of
STSAssumeRoleSessionCredentialsProvider
from configuration
properties, including wiring up the inner authenticator, and,
unless overridden, creating a session name from the current user.
- AssumedRoleCredentialProvider(URI, Configuration) - Constructor for class org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider
-
Instantiate.
- ASYNC_DRAIN_THRESHOLD - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
The threshold at which drain operations switch
to being asynchronous with the schedule/wait overhead
compared to synchronous.
- AsyncDispatcher - Class in org.apache.hadoop.yarn.event
-
Dispatches
Event
s in a separate thread.
- AsyncDispatcher() - Constructor for class org.apache.hadoop.yarn.event.AsyncDispatcher
-
- AsyncDispatcher(BlockingQueue<Event>) - Constructor for class org.apache.hadoop.yarn.event.AsyncDispatcher
-
- AsyncDispatcher(String) - Constructor for class org.apache.hadoop.yarn.event.AsyncDispatcher
-
Set a name for this dispatcher thread.
- AT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- ATS_APP_COLLECTOR_LINGER_PERIOD_IN_MS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- ATTEMPT - Static variable in class org.apache.hadoop.mapreduce.TaskAttemptID
-
- attemptCleanup() - Method in class org.apache.hadoop.tools.dynamometer.Client
-
Best-effort attempt to clean up any remaining applications (infrastructure
or workload).
- attributes(boolean, boolean, boolean, boolean) - Static method in class org.apache.hadoop.fs.FileStatus
-
Convert boolean attributes to a set of flags.
- attributes() - Method in class org.apache.hadoop.registry.client.types.ServiceRecord
-
The map of "other" attributes set when parsing.
- AUDITLOG - Static variable in class org.apache.hadoop.ipc.Server
-
- AuditLogger - Interface in org.apache.hadoop.hdfs.server.namenode
-
Interface defining an audit logger.
- AUTH_GROUP - Static variable in class org.apache.hadoop.fs.s3a.audit.S3LogParser
-
Log group "auth".
- AuthConfigurations - Class in org.apache.hadoop.fs.azurebfs.constants
-
Responsible to keep all the Azure Blob File System auth related
configurations.
- authenticate(URL, AuthenticatedURL.Token) - Method in class org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator
-
- AUTHORITATIVE_PATH - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Paths considered "authoritative".
- AUTHORIZATION - Static variable in class org.apache.hadoop.fs.azurebfs.constants.HttpHeaderConfigurations
-
- AuthorizationException - Exception in org.apache.hadoop.security.authorize
-
An exception class for authorization-related issues.
- AuthorizationException() - Constructor for exception org.apache.hadoop.security.authorize.AuthorizationException
-
- AuthorizationException(String) - Constructor for exception org.apache.hadoop.security.authorize.AuthorizationException
-
- AuthorizationException(Throwable) - Constructor for exception org.apache.hadoop.security.authorize.AuthorizationException
-
Constructs a new exception with the specified cause and a detail
message of (cause==null ? null : cause.toString())
(which
typically contains the class and detail message of cause
).
- authorize(UserGroupInformation, InetAddress) - Method in class org.apache.hadoop.security.authorize.DefaultImpersonationProvider
-
- authorize(UserGroupInformation, String) - Method in interface org.apache.hadoop.security.authorize.ImpersonationProvider
-
Authorize the superuser which is doing doAs.
- authorize(UserGroupInformation, InetAddress) - Method in interface org.apache.hadoop.security.authorize.ImpersonationProvider
-
Authorize the superuser which is doing doAs.
- AUTO_FAILOVER_EMBEDDED - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AUTO_FAILOVER_ENABLED - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AUTO_FAILOVER_PREFIX - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AUTO_FAILOVER_ZK_BASE_PATH - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- AUTOMATICALLY_DISCOVER_GPU_DEVICES - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- available() - Method in class org.apache.hadoop.io.compress.DecompressorStream
-
- AVRO_REFLECT_PACKAGES - Static variable in class org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
-
Key to configure packages that contain classes to be serialized and
deserialized using this class.
- AVRO_SCHEMA_KEY - Static variable in class org.apache.hadoop.io.serializer.avro.AvroSerialization
-
- AvroFSInput - Class in org.apache.hadoop.fs
-
- AvroFSInput(FSDataInputStream, long) - Constructor for class org.apache.hadoop.fs.AvroFSInput
-
- AvroFSInput(FileContext, Path) - Constructor for class org.apache.hadoop.fs.AvroFSInput
-
- AvroReflectSerializable - Interface in org.apache.hadoop.io.serializer.avro
-
Tag interface for Avro 'reflect' serializable classes.
- AvroReflectSerialization - Class in org.apache.hadoop.io.serializer.avro
-
Serialization for Avro Reflect classes.
- AvroReflectSerialization() - Constructor for class org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
-
- AvroSerialization<T> - Class in org.apache.hadoop.io.serializer.avro
-
Base class for providing serialization to Avro types.
- AvroSerialization() - Constructor for class org.apache.hadoop.io.serializer.avro.AvroSerialization
-
- AvroSpecificSerialization - Class in org.apache.hadoop.io.serializer.avro
-
Serialization for Avro Specific classes.
- AvroSpecificSerialization() - Constructor for class org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization
-
- awaitAllFutures(Collection<Future<T>>) - Static method in class org.apache.hadoop.util.functional.FutureIO
-
Evaluates a collection of futures and returns their results as a list.
- awaitAllFutures(Collection<Future<T>>, Duration) - Static method in class org.apache.hadoop.util.functional.FutureIO
-
Evaluates a collection of futures and returns their results as a list,
but only waits up to the specified timeout for each future to complete.
- awaitFuture(Future<T>) - Static method in class org.apache.hadoop.util.functional.FutureIO
-
Given a future, evaluate it.
- awaitFuture(Future<T>, long, TimeUnit) - Static method in class org.apache.hadoop.util.functional.FutureIO
-
Given a future, evaluate it.
- AWS_AUTH_CLASS_PREFIX - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Prefix of auth classes in AWS SDK V1.
- AWS_CREDENTIALS_PROVIDER - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
- AWS_CREDENTIALS_PROVIDER_MAPPING - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
AWS credentials providers mapping with key/value pairs.
- AWS_LOG_REGEXP_GROUPS - Static variable in class org.apache.hadoop.fs.s3a.audit.S3LogParser
-
Ordered list of regular expression group names.
- AWS_REGION - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
AWS S3 region for the bucket.
- AWS_S3_ACCESS_GRANTS_ENABLED - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Flag "fs.s3a.access.grants.enabled"
to enable S3 Access Grants to control authorization to S3 data.
- AWS_S3_ACCESS_GRANTS_FALLBACK_TO_IAM_ENABLED - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Flag "fs.s3a.access.grants.fallback.to.iam" to enable jobs fall back to the Job Execution IAM role in
case they get Access Denied from the S3 Access Grants call.
- AWS_S3_ACCESSPOINT_REQUIRED - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Require that all S3 access is made through Access Points.
- AWS_S3_CENTRAL_REGION - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
The special S3 region which can be used to talk to any bucket.
- AWS_S3_CLASSLOADER_ISOLATION - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Are extensions classes, such as fs.s3a.aws.credentials.provider
,
going to be loaded from the same classloader that loaded
the S3AFileSystem
?
It is useful to turn classloader isolation off for Apache Spark applications
that might load S3AFileSystem
from the Spark distribution (Launcher classloader)
while users might want to provide custom extensions (loaded by Spark MutableClassloader).
- AWS_S3_CROSS_REGION_ACCESS_ENABLED - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
S3 cross region access enabled ?
Value: "fs.s3a.cross.region.access.enabled".
- AWS_S3_CROSS_REGION_ACCESS_ENABLED_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Default value for S3 cross region access enabled: true.
- AWS_S3_DEFAULT_REGION - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
The default S3 region when using cross region client.
- AWS_S3_VECTOR_ACTIVE_RANGE_READS - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Maximum number of range reads a single input stream can have
active (downloading, or queued) to the central FileSystem
instance's pool of queued operations.
- AWS_S3_VECTOR_READS_MAX_MERGED_READ_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
What is the largest merged read size in bytes such
that we group ranges together during vectored read.
- AWS_S3_VECTOR_READS_MIN_SEEK_SIZE - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
What is the smallest reasonable seek in bytes such
that we group ranges together during vectored read operation.
- AWS_SERVICE_IDENTIFIER_DDB - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Deprecated.
- AWS_SERVICE_IDENTIFIER_S3 - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
- AWS_SERVICE_IDENTIFIER_STS - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
- AWSERRORCODE_GROUP - Static variable in class org.apache.hadoop.fs.s3a.audit.S3LogParser
-
Log group "awserrorcode".
- awsErrorDetails() - Method in exception org.apache.hadoop.fs.s3a.AWSServiceIOException
-
- AWSS3IOException - Exception in org.apache.hadoop.fs.s3a
-
Wrap a S3Exception
as an IOE, relaying all
getters.
- AWSS3IOException(String, S3Exception) - Constructor for exception org.apache.hadoop.fs.s3a.AWSS3IOException
-
Instantiate.
- AWSServiceIOException - Exception in org.apache.hadoop.fs.s3a
-
A specific exception from AWS operations.
- AWSServiceIOException(String, AwsServiceException) - Constructor for exception org.apache.hadoop.fs.s3a.AWSServiceIOException
-
Instantiate.
- AZURE_ABFS_ENDPOINT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
End point of ABFS account: "fs.azure.abfs.endpoint".
- AZURE_AD_ACCOUNT_PREFIX - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_AD_CLIENT_ID_KEY - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_AD_CLIENT_SECRET_KEY - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_AD_PREFIX - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_AD_REFRESH_TOKEN_KEY - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_AD_REFRESH_URL_KEY - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_AD_TOKEN_PROVIDER_CLASS_KEY - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_AD_TOKEN_PROVIDER_TYPE_DEFAULT - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_AD_TOKEN_PROVIDER_TYPE_KEY - Static variable in class org.apache.hadoop.fs.adl.AdlConfKeys
-
- AZURE_BACKOFF_INTERVAL - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_BLOCK_LOCATION_HOST_DEFAULT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.FileSystemConfigurations
-
- AZURE_BLOCK_LOCATION_HOST_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_BLOCK_SIZE_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_CHMOD_USERLIST_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
Configuration property used to specify list of users that can perform
chmod operation when authorization is enabled in WASB.
- AZURE_CHOWN_USERLIST_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
Configuration property used to specify list of users that can perform
chown operation when authorization is enabled in WASB.
- AZURE_CONCURRENT_CONNECTION_VALUE_IN - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_CONCURRENT_CONNECTION_VALUE_OUT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_CUSTOM_TOKEN_FETCH_RETRY_COUNT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_DAEMON_USERLIST_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
Configuration property used to specify list of daemon users that can
perform chmod operation when authorization is enabled in WASB.
- AZURE_DELETE_THREADS - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
The configuration property to set number of threads to be used for delete operation.
- AZURE_DISTRIBUTED_FILE_SYSTEM_AUTHORITY_DELIMITER - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- AZURE_ENABLE_SMALL_WRITE_OPTIMIZATION - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
If the data size written by Hadoop app is small, i.e.
- AZURE_FOOTER_READ_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
In case of footer reads it was not required to read full buffer size.
- AZURE_HTTP_CONNECTION_TIMEOUT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
Config to set HTTP Connection Timeout Value for Rest Operations.
- AZURE_HTTP_READ_TIMEOUT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
Config to set HTTP Read Timeout Value for Rest Operations.
- AZURE_KEY_ACCOUNT_KEYPROVIDER - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_KEY_ACCOUNT_SHELLKEYPROVIDER_SCRIPT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_LIST_MAX_RESULTS - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_MAX_BACKOFF_INTERVAL - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_MAX_IO_RETRIES - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_MIN_BACKOFF_INTERVAL - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_OAUTH_TOKEN_FETCH_RETRY_COUNT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_OAUTH_TOKEN_FETCH_RETRY_DELTA_BACKOFF - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_OAUTH_TOKEN_FETCH_RETRY_MAX_BACKOFF - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_OAUTH_TOKEN_FETCH_RETRY_MIN_BACKOFF - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_READ_AHEAD_RANGE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
Read ahead range parameter which can be set by user.
- AZURE_READ_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_READ_OPTIMIZE_FOOTER_READ - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
When parquet files are read, first few read are metadata reads before
reading the actual data.
- AZURE_READ_SMALL_FILES_COMPLETELY - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_RENAME_THREADS - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
The configuration property to set number of threads to be used for rename operation.
- AZURE_SKIP_USER_GROUP_METADATA_DURING_INITIALIZATION - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_STATIC_RETRY_FOR_CONNECTION_TIMEOUT_ENABLED - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_STATIC_RETRY_INTERVAL - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_TOLERATE_CONCURRENT_APPEND - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_WRITE_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_WRITE_MAX_CONCURRENT_REQUESTS - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AZURE_WRITE_MAX_REQUESTS_TO_QUEUE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.ConfigurationKeys
-
- AzureADTokenProvider - Class in org.apache.hadoop.fs.adl.oauth2
-
Provide an Azure Active Directory supported
OAuth2 access token to be used to authenticate REST calls against Azure data
lake file system
AdlFileSystem
.
- AzureADTokenProvider() - Constructor for class org.apache.hadoop.fs.adl.oauth2.AzureADTokenProvider
-
- AzureBlobFileSystemException - Exception in org.apache.hadoop.fs.azurebfs.contracts.exceptions
-
Base exception for any Azure Blob File System driver exceptions.
- AzureBlobFileSystemException(String) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AzureBlobFileSystemException
-
- AzureBlobFileSystemException(String, Exception) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AzureBlobFileSystemException
-
- AzureBlobFileSystemException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.AzureBlobFileSystemException
-
- AzureBlobFileSystemStore - Class in org.apache.hadoop.fs.azurebfs
-
Provides the bridging logic between Hadoop's abstract filesystem and Azure Storage.
- AzureBlobFileSystemStore(AzureBlobFileSystemStore.AzureBlobFileSystemStoreBuilder) - Constructor for class org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore
-
FileSystem Store for AzureBlobFileSystem
for Abfs operations.
- AzureException - Exception in org.apache.hadoop.fs.azure
-
Thrown if there is a problem communicating with Azure Storage service.
- AzureException(String) - Constructor for exception org.apache.hadoop.fs.azure.AzureException
-
- AzureException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.azure.AzureException
-
- AzureException(Throwable) - Constructor for exception org.apache.hadoop.fs.azure.AzureException
-
- AzureFileSystemInstrumentation - Class in org.apache.hadoop.fs.azure.metrics
-
A metrics source for the WASB file system to track all the metrics we care
about for getting a clear picture of the performance/reliability/interaction
of the Hadoop cluster with Azure Storage.
- AzureFileSystemInstrumentation(Configuration) - Constructor for class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation
-
- AzureManifestCommitterFactory - Class in org.apache.hadoop.fs.azurebfs.commit
-
A Committer for the manifest committer which performs all bindings needed
to work best with abfs.
- AzureManifestCommitterFactory() - Constructor for class org.apache.hadoop.fs.azurebfs.commit.AzureManifestCommitterFactory
-
- AzureServiceErrorCode - Enum in org.apache.hadoop.fs.azurebfs.contracts.services
-
Azure service error codes.
- CACHE_ARCHIVES - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CACHE_ARCHIVES_SIZES - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CACHE_ARCHIVES_TIMESTAMPS - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CACHE_FILES - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CACHE_FILES_SIZES - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CACHE_FILES_TIMESTAMPS - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CACHE_LOCALARCHIVES - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CACHE_LOCALFILES - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CACHE_SYMLINK - Static variable in class org.apache.hadoop.filecache.DistributedCache
-
Deprecated.
- CachedDNSToSwitchMapping - Class in org.apache.hadoop.net
-
A cached implementation of DNSToSwitchMapping that takes an
raw DNSToSwitchMapping and stores the resolved network location in
a cache.
- CachedDNSToSwitchMapping(DNSToSwitchMapping) - Constructor for class org.apache.hadoop.net.CachedDNSToSwitchMapping
-
cache a raw DNS mapping
- CacheDirectiveEntry - Class in org.apache.hadoop.hdfs.protocol
-
Describes a path-based cache directive entry.
- CacheDirectiveEntry(CacheDirectiveInfo, CacheDirectiveStats) - Constructor for class org.apache.hadoop.hdfs.protocol.CacheDirectiveEntry
-
- CacheDirectiveInfo - Class in org.apache.hadoop.hdfs.protocol
-
Describes a path-based cache directive.
- CacheDirectiveStats - Class in org.apache.hadoop.hdfs.protocol
-
Describes a path-based cache directive.
- CacheFlag - Enum in org.apache.hadoop.fs
-
Specifies semantics for CacheDirective operations.
- cacheGroupsAdd(List<String>) - Method in interface org.apache.hadoop.security.GroupMappingServiceProvider
-
Caches the group user information
- cacheGroupsRefresh() - Method in interface org.apache.hadoop.security.GroupMappingServiceProvider
-
Refresh the cache of groups and user mapping
- CachePoolEntry - Class in org.apache.hadoop.hdfs.protocol
-
Describes a Cache Pool entry.
- CachePoolEntry(CachePoolInfo, CachePoolStats) - Constructor for class org.apache.hadoop.hdfs.protocol.CachePoolEntry
-
- CachePoolInfo - Class in org.apache.hadoop.hdfs.protocol
-
CachePoolInfo describes a cache pool.
- CachePoolInfo(String) - Constructor for class org.apache.hadoop.hdfs.protocol.CachePoolInfo
-
- CachePoolStats - Class in org.apache.hadoop.hdfs.protocol
-
CachePoolStats describes cache pool statistics.
- calcMemoryMB() - Method in class org.apache.hadoop.yarn.service.api.records.Resource
-
- call(RPC.RpcKind, Writable, Client.ConnectionId, AtomicBoolean) - Method in class org.apache.hadoop.ipc.Client
-
Make a call, passing rpcRequest
, to the IPC server defined by
remoteId
, returning the rpc respond.
- call(RPC.RpcKind, Writable, Client.ConnectionId, AtomicBoolean, AlignmentContext) - Method in class org.apache.hadoop.ipc.Client
-
- call(Writable, long) - Method in class org.apache.hadoop.ipc.Server
-
- call(RPC.RpcKind, String, Writable, long) - Method in class org.apache.hadoop.ipc.Server
-
Called for each call.
- callbackHandler - Variable in class org.apache.hadoop.yarn.client.api.async.NMClientAsync
-
- CallerContext - Class in org.apache.hadoop.ipc
-
A class defining the caller context for auditing coarse granularity
operations.
- callerContextMaxLen - Variable in class org.apache.hadoop.hdfs.server.namenode.DefaultAuditLogger
-
The maximum bytes a caller context string can have.
- callerSignatureMaxLen - Variable in class org.apache.hadoop.hdfs.server.namenode.DefaultAuditLogger
-
- CAN_UNBUFFER_NOT_IMPLEMENTED_MESSAGE - Static variable in class org.apache.hadoop.fs.StreamCapabilitiesPolicy
-
- cancel(Configuration) - Method in class org.apache.hadoop.security.token.Token
-
Cancel this delegation token.
- cancel(Token<?>, Configuration) - Method in class org.apache.hadoop.security.token.Token.TrivialRenewer
-
- cancel(Token<?>, Configuration) - Method in class org.apache.hadoop.security.token.TokenRenewer
-
Cancel the given token.
- cancelAllFuturesAndAwaitCompletion(Collection<Future<T>>, boolean, Duration) - Static method in class org.apache.hadoop.util.functional.FutureIO
-
Cancels a collection of futures and awaits the specified duration for their completion.
- cancelDelegationToken(Token<DelegationTokenIdentifier>) - Method in class org.apache.hadoop.mapred.JobClient
-
- cancelDelegationToken(Token<DelegationTokenIdentifier>) - Method in class org.apache.hadoop.mapreduce.Cluster
-
- cancelDelegationToken(URL, DelegationTokenAuthenticatedURL.Token) - Method in class org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticatedURL
-
Cancels a delegation token from the server end-point.
- cancelDelegationToken(URL, DelegationTokenAuthenticatedURL.Token, String) - Method in class org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticatedURL
-
Cancels a delegation token from the server end-point.
- cancelDelegationToken(URL, AuthenticatedURL.Token, Token<AbstractDelegationTokenIdentifier>) - Method in class org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator
-
Cancels a delegation token from the server end-point.
- cancelDelegationToken(URL, AuthenticatedURL.Token, Token<AbstractDelegationTokenIdentifier>, String) - Method in class org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator
-
Cancels a delegation token from the server end-point.
- cancelDelegationToken(Token<TimelineDelegationTokenIdentifier>) - Method in class org.apache.hadoop.yarn.client.api.TimelineClient
-
Cancel a timeline delegation token.
- CancelDelegationTokenRequest - Interface in org.apache.hadoop.mapreduce.v2.api.protocolrecords
-
The request issued by the client to the ResourceManager
to cancel a
delegation token.
- CancelDelegationTokenResponse - Interface in org.apache.hadoop.mapreduce.v2.api.protocolrecords
-
The response from the ResourceManager
to a cancelDelegationToken
request.
- cancelDeleteOnExit(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Cancel the scheduled deletion of the path when the FileSystem is closed.
- cancelToken(Token<TokenIdent>, String) - Method in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Cancel a token by removing it from cache.
- canExecute(File) - Static method in class org.apache.hadoop.fs.FileUtil
-
- CANNED_ACL - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
- CannotObtainBlockLengthException - Exception in org.apache.hadoop.hdfs
-
This exception is thrown when the length of a LocatedBlock instance
can not be obtained.
- CannotObtainBlockLengthException() - Constructor for exception org.apache.hadoop.hdfs.CannotObtainBlockLengthException
-
- CannotObtainBlockLengthException(String) - Constructor for exception org.apache.hadoop.hdfs.CannotObtainBlockLengthException
-
- CannotObtainBlockLengthException(LocatedBlock) - Constructor for exception org.apache.hadoop.hdfs.CannotObtainBlockLengthException
-
Constructs an CannotObtainBlockLengthException
with the
specified LocatedBlock that failed to obtain block length.
- CannotObtainBlockLengthException(LocatedBlock, String) - Constructor for exception org.apache.hadoop.hdfs.CannotObtainBlockLengthException
-
Constructs an CannotObtainBlockLengthException
with the
specified LocatedBlock and file that failed to obtain block length.
- canonicalizeUri(URI) - Method in class org.apache.hadoop.fs.FileSystem
-
Canonicalize the given URI.
- canonicalizeUri(URI) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- canRead(File) - Static method in class org.apache.hadoop.fs.FileUtil
-
- CanSetDropBehind - Interface in org.apache.hadoop.fs
-
- CanSetReadahead - Interface in org.apache.hadoop.fs
-
- CanUnbuffer - Interface in org.apache.hadoop.fs
-
FSDataInputStreams implement this interface to indicate that they can clear
their buffers on request.
- canWrite(File) - Static method in class org.apache.hadoop.fs.FileUtil
-
- capability(Resource) - Method in class org.apache.hadoop.yarn.api.records.ResourceRequest.ResourceRequestBuilder
-
Set the capability
of the request.
- CAPABILITY_DYNAMIC_PARTITIONING - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterConstants
-
Stream Capabilities probe for spark dynamic partitioning compatibility.
- cardinality(String, int, int, String...) - Static method in class org.apache.hadoop.yarn.api.resource.PlacementConstraints
-
Creates a constraint that restricts the number of allocations within a
given scope (e.g., node or rack).
- cardinality(String, String, int, int, String...) - Static method in class org.apache.hadoop.yarn.api.resource.PlacementConstraints
-
- castToIntSafely(long) - Static method in class org.apache.hadoop.yarn.api.records.Resource
-
Convert long to int for a resource value safely.
- CENTRAL_ENDPOINT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
The central endpoint :"s3.amazonaws.com".
- CENTRALIZED_NODELABEL_CONFIGURATION_TYPE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- ChainMapper - Class in org.apache.hadoop.mapred.lib
-
The ChainMapper class allows to use multiple Mapper classes within a single
Map task.
- ChainMapper() - Constructor for class org.apache.hadoop.mapred.lib.ChainMapper
-
Constructor.
- ChainMapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT> - Class in org.apache.hadoop.mapreduce.lib.chain
-
The ChainMapper class allows to use multiple Mapper classes within a single
Map task.
- ChainMapper() - Constructor for class org.apache.hadoop.mapreduce.lib.chain.ChainMapper
-
- ChainReducer - Class in org.apache.hadoop.mapred.lib
-
The ChainReducer class allows to chain multiple Mapper classes after a
Reducer within the Reducer task.
- ChainReducer() - Constructor for class org.apache.hadoop.mapred.lib.ChainReducer
-
Constructor.
- ChainReducer<KEYIN,VALUEIN,KEYOUT,VALUEOUT> - Class in org.apache.hadoop.mapreduce.lib.chain
-
The ChainReducer class allows to chain multiple Mapper classes after a
Reducer within the Reducer task.
- ChainReducer() - Constructor for class org.apache.hadoop.mapreduce.lib.chain.ChainReducer
-
- CHANGE_DETECT_MODE - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Mode to run change detection in.
- CHANGE_DETECT_MODE_CLIENT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Change is detected on the client side by comparing the returned id with the
expected id.
- CHANGE_DETECT_MODE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Default change detection mode: server.
- CHANGE_DETECT_MODE_NONE - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Change detection is turned off.
- CHANGE_DETECT_MODE_SERVER - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Change is detected by passing the expected value in the GetObject request.
- CHANGE_DETECT_MODE_WARN - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Change is detected on the client side by comparing the returned id with the
expected id.
- CHANGE_DETECT_REQUIRE_VERSION - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
If true, raises a
RemoteFileChangedException
exception when S3
doesn't provide the attribute defined by fs.s3a.change.detection.source.
- CHANGE_DETECT_REQUIRE_VERSION_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Default change detection require version: true.
- CHANGE_DETECT_SOURCE - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Where to get the value to use in change detection.
- CHANGE_DETECT_SOURCE_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Default change detection mechanism: eTag.
- CHANGE_DETECT_SOURCE_ETAG - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
eTag as the change detection mechanism.
- CHANGE_DETECT_SOURCE_VERSION_ID - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Object versionId as the change detection mechanism.
- changed() - Method in class org.apache.hadoop.metrics2.lib.MutableMetric
-
- CHAR_EQUALS - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- CHAR_EXCLAMATION_POINT - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- CHAR_FORWARD_SLASH - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- CHAR_HYPHEN - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- CHAR_PLUS - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- CHAR_STAR - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- CHAR_UNDERSCORE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- charAt(int) - Method in class org.apache.hadoop.io.Text
-
Returns the Unicode Scalar Value (32-bit integer value)
for the character at position
.
- CHECK_ACCESS - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- checkArgs(String) - Method in interface org.apache.hadoop.ha.FenceMethod
-
Verify that the given fencing method's arguments are valid.
- checkAvailableForRead() - Method in class org.apache.hadoop.security.token.SecretManager
-
No-op if the secret manager is available for reading tokens, throw a
StandbyException otherwise.
- checkExists(FileSystem, Path, FsPermission) - Method in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
- checkFencingConfigured() - Method in class org.apache.hadoop.ha.HAServiceTarget
-
- checkFSSupportsEC(FileSystem, Path) - Static method in class org.apache.hadoop.fs.FileUtil
-
- checkIsBashSupported() - Static method in class org.apache.hadoop.util.Shell
-
- checkOutputSpecs(FileSystem, JobConf) - Method in class org.apache.hadoop.mapred.FileOutputFormat
-
- checkOutputSpecs(FileSystem, JobConf) - Method in class org.apache.hadoop.mapred.lib.db.DBOutputFormat
-
Check for validity of the output-specification for the job.
- checkOutputSpecs(FileSystem, JobConf) - Method in class org.apache.hadoop.mapred.lib.FilterOutputFormat
-
- checkOutputSpecs(FileSystem, JobConf) - Method in class org.apache.hadoop.mapred.lib.LazyOutputFormat
-
- checkOutputSpecs(FileSystem, JobConf) - Method in class org.apache.hadoop.mapred.lib.NullOutputFormat
-
- checkOutputSpecs(FileSystem, JobConf) - Method in interface org.apache.hadoop.mapred.OutputFormat
-
Check for validity of the output-specification for the job.
- checkOutputSpecs(FileSystem, JobConf) - Method in class org.apache.hadoop.mapred.SequenceFileAsBinaryOutputFormat
-
- checkOutputSpecs(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.db.DBOutputFormat
-
- checkOutputSpecs(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
-
- checkOutputSpecs(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.FilterOutputFormat
-
- checkOutputSpecs(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.LazyOutputFormat
-
- checkOutputSpecs(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.NullOutputFormat
-
- checkOutputSpecs(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.SequenceFileAsBinaryOutputFormat
-
- checkOutputSpecs(JobContext) - Method in class org.apache.hadoop.mapreduce.OutputFormat
-
Check for validity of the output-specification for the job.
- checkPath(Path) - Method in class org.apache.hadoop.fs.AbstractFileSystem
-
Check that a Path belongs to this FileSystem.
- checkPath(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
- checkPath(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Check that a Path belongs to this FileSystem.
- checkPath(Path) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
Check that a Path belongs to this FileSystem.
- checkPidPgrpidForMatch() - Method in class org.apache.hadoop.yarn.util.ResourceCalculatorProcessTree
-
Verify that the tree process id is same as its process group id.
- checkpoint() - Method in class org.apache.hadoop.fs.Trash
-
Create a trash checkpoint.
- Checkpointable - Annotation Type in org.apache.hadoop.mapreduce.task.annotation
-
Contract representing to the framework that the task can be safely preempted
and restarted between invocations of the user-defined function.
- checkScheme(URI, String) - Method in class org.apache.hadoop.fs.AbstractFileSystem
-
Check that the Uri's scheme matches.
- checkStateTransition(String, Service.STATE, Service.STATE) - Static method in class org.apache.hadoop.service.ServiceStateModel
-
Check that a state tansition is valid and
throw an exception if not
- checkStream() - Method in class org.apache.hadoop.io.compress.DecompressorStream
-
- CHECKSUM_VALIDATION - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Should checksums be validated on download?
This is slower and not needed on TLS connections.
- CHECKSUM_VALIDATION_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
- ChecksumException - Exception in org.apache.hadoop.fs
-
Thrown for checksum errors.
- ChecksumException(String, long) - Constructor for exception org.apache.hadoop.fs.ChecksumException
-
- ChecksumFileSystem - Class in org.apache.hadoop.fs
-
Abstract Checksumed FileSystem.
- ChecksumFileSystem(FileSystem) - Constructor for class org.apache.hadoop.fs.ChecksumFileSystem
-
- checksumOpt(Options.ChecksumOpt) - Method in class org.apache.hadoop.fs.FSDataOutputStreamBuilder
-
Set checksum opt.
- checksumOpt(Options.ChecksumOpt) - Method in class org.apache.hadoop.fs.impl.MultipartUploaderBuilderImpl
-
Set checksum opt.
- checkTGTAndReloginFromKeytab() - Method in class org.apache.hadoop.security.UserGroupInformation
-
Re-login a user from keytab if TGT is expired or is close to expiry.
- checkToken(TokenIdent) - Method in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Find the DelegationTokenInformation for the given token id, and verify that
if the token is expired.
- checkWindowsCommandLineLength(String...) - Static method in class org.apache.hadoop.util.Shell
-
Checks if a given command (String[]) fits in the Windows maximum command
line length Note that the input is expected to already include space
delimiters, no extra count will be added for delimiters.
- children - Variable in class org.apache.hadoop.registry.client.types.RegistryPathStatus
-
Number of child nodes
- CHILDREN_INFO_KEY - Static variable in class org.apache.hadoop.yarn.api.records.timelineservice.HierarchicalTimelineEntity
-
- chmod(String, String) - Static method in class org.apache.hadoop.fs.FileUtil
-
Change the permissions on a filename.
- chmod(String, String, boolean) - Static method in class org.apache.hadoop.fs.FileUtil
-
Change the permissions on a file / directory, recursively, if
needed.
- CLASS_PATH_SEPARATOR - Static variable in interface org.apache.hadoop.yarn.api.ApplicationConstants
-
This constant is used to construct class path and it will be replaced with
real class path separator(':' for Linux and ';' for Windows) by
NodeManager on container launch.
- CLASSNAME - Static variable in class org.apache.hadoop.io.compress.PassthroughCodec
-
Classname of the codec: "org.apache.hadoop.io.compress.PassthroughCodec".
- cleanOldLogs(Path, NodeId, UserGroupInformation) - Method in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
- cleanup(Mapper<KEYIN, VALUEIN, KEYOUT, VALUEOUT>.Context) - Method in class org.apache.hadoop.mapreduce.Mapper
-
Called once at the end of the task.
- cleanup(Reducer<KEYIN, VALUEIN, KEYOUT, VALUEOUT>.Context) - Method in class org.apache.hadoop.mapreduce.Reducer
-
Called once at the end of the task.
- cleanup() - Method in class org.apache.hadoop.tools.DistCp
-
Clean the staging folder created by distcp.
- cleanup() - Method in class org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster
-
- cleanupJob(JobContext) - Method in class org.apache.hadoop.mapred.FileOutputCommitter
-
Deprecated.
- cleanupJob(JobContext) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
- cleanupJob(JobContext) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
- cleanupJob(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.BindingPathOutputCommitter
-
- cleanupJob(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitter
-
Execute the CleanupJobStage
to remove the job attempt dir.
- cleanupJob(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
-
Deprecated.
- cleanupJob(JobContext) - Method in class org.apache.hadoop.mapreduce.OutputCommitter
-
- cleanUpPartialOutputForTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.PartialFileOutputCommitter
-
- cleanUpPartialOutputForTask(TaskAttemptContext) - Method in interface org.apache.hadoop.mapreduce.lib.output.PartialOutputCommitter
-
Remove all previously committed outputs from prior executions of this task.
- cleanupProgress() - Method in class org.apache.hadoop.mapred.JobStatus
-
- cleanupProgress() - Method in interface org.apache.hadoop.mapred.RunningJob
-
Get the progress of the job's cleanup-tasks, as a float between 0.0
and 1.0.
- cleanupProgress() - Method in class org.apache.hadoop.mapreduce.Job
-
Get the progress of the job's cleanup-tasks, as a float between 0.0
and 1.0.
- cleanupRemoteIterator(RemoteIterator<T>) - Static method in class org.apache.hadoop.util.functional.RemoteIterators
-
Clean up after an iteration.
- cleanupRunningContainersOnStop(boolean) - Method in class org.apache.hadoop.yarn.client.api.NMClient
-
Set whether the containers that are started by this client, and are
still running should be stopped when the client stops.
- cleanupStagingDirs() - Method in class org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter
-
Delete the magic directory.
- cleanUpTokenReferral(Configuration) - Static method in class org.apache.hadoop.mapreduce.security.TokenCache
-
Remove jobtoken referrals which don't make sense in the context
of the task execution.
- cleanupWithLogger(Logger, Closeable...) - Static method in class org.apache.hadoop.io.IOUtils
-
Close the Closeable objects and
ignore any
Throwable
or
null pointers.
- clear() - Method in class org.apache.hadoop.conf.Configuration
-
Clears all keys from the configuration.
- clear() - Method in class org.apache.hadoop.fs.statistics.IOStatisticsSnapshot
-
Clear all the maps.
- clear() - Method in class org.apache.hadoop.fs.statistics.MeanStatistic
-
Set the values to 0.
- clear() - Method in class org.apache.hadoop.io.MapWritable
-
- clear() - Method in class org.apache.hadoop.io.SortedMapWritable
-
- clear() - Method in class org.apache.hadoop.io.Text
-
Clear the string to empty.
- clear() - Method in class org.apache.hadoop.mapreduce.lib.join.ArrayListBackedIterator
-
- clear() - Method in interface org.apache.hadoop.mapreduce.lib.join.ResetableIterator
-
Close datasources, but do not release internal resources.
- clear() - Method in class org.apache.hadoop.mapreduce.lib.join.StreamBackedIterator
-
- clear() - Method in class org.apache.hadoop.util.bloom.HashFunction
-
Clears this hash function.
- CLEAR_TEXT_FALLBACK - Static variable in class org.apache.hadoop.security.alias.CredentialProvider
-
- clearChanged() - Method in class org.apache.hadoop.metrics2.lib.MutableMetric
-
Clear the changed flag in the snapshot operations
- clearMark() - Method in class org.apache.hadoop.mapreduce.MarkableIterator
-
- clearQuota(Path) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Clear the namespace quota (count of files, directories and sym links) for a
directory.
- clearQuotaByStorageType(Path, StorageType) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Clear the space quota by storage type for a directory.
- clearReadStatistics() - Method in class org.apache.hadoop.hdfs.client.HdfsDataInputStream
-
- clearShutdownHooks() - Method in class org.apache.hadoop.util.ShutdownHookManager
-
clear all registered shutdownHooks.
- clearSpaceQuota(Path) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Clear the storage space quota (size of files) for a directory.
- clearStatistics() - Static method in class org.apache.hadoop.fs.AbstractFileSystem
-
- clearStatistics() - Static method in class org.apache.hadoop.fs.FileContext
-
Clears all the statistics stored in AbstractFileSystem, for all the file
systems.
- clearStatistics() - Static method in class org.apache.hadoop.fs.FileSystem
-
Reset all statistics for all file systems.
- clearWriteAccessors() - Method in interface org.apache.hadoop.registry.client.api.RegistryOperations
-
Clear all write accessors.
- CLI - Class in org.apache.hadoop.mapreduce.tools
-
Interprets the map reduce cli options
- CLI() - Constructor for class org.apache.hadoop.mapreduce.tools.CLI
-
- CLI(Configuration) - Constructor for class org.apache.hadoop.mapreduce.tools.CLI
-
- Client - Class in org.apache.hadoop.ipc
-
A client for an IPC service.
- Client(Class<? extends Writable>, Configuration, SocketFactory) - Constructor for class org.apache.hadoop.ipc.Client
-
Construct an IPC client whose values are of the given
Writable
class.
- Client(Class<? extends Writable>, Configuration) - Constructor for class org.apache.hadoop.ipc.Client
-
Construct an IPC client with the default SocketFactory.
- Client - Class in org.apache.hadoop.tools.dynamometer
-
Client for submitting a Dynamometer YARN application, and optionally, a
workload MapReduce job.
- Client(String...) - Constructor for class org.apache.hadoop.tools.dynamometer.Client
-
- Client - Class in org.apache.hadoop.yarn.applications.distributedshell
-
Client for Distributed Shell application submission to YARN.
- Client(Configuration) - Constructor for class org.apache.hadoop.yarn.applications.distributedshell.Client
-
- Client() - Constructor for class org.apache.hadoop.yarn.applications.distributedshell.Client
-
- client - Variable in class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
- client - Variable in class org.apache.hadoop.yarn.client.api.async.NMClientAsync
-
- CLIENT_CALL_ID_STR - Static variable in class org.apache.hadoop.ipc.CallerContext
-
- CLIENT_CREDENTIALS - Static variable in class org.apache.hadoop.hdfs.web.oauth2.OAuth2Constants
-
- CLIENT_FAILOVER_MAX_ATTEMPTS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- CLIENT_FAILOVER_NO_HA_PROXY_PROVIDER - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- CLIENT_FAILOVER_PREFIX - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- CLIENT_FAILOVER_PROXY_PROVIDER - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- CLIENT_FAILOVER_RETRIES - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- CLIENT_FAILOVER_RETRIES_ON_SOCKET_TIMEOUTS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- CLIENT_FAILOVER_SLEEPTIME_BASE_MS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- CLIENT_FAILOVER_SLEEPTIME_MAX_MS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- CLIENT_ID - Static variable in class org.apache.hadoop.hdfs.web.oauth2.OAuth2Constants
-
- CLIENT_ID_STR - Static variable in class org.apache.hadoop.ipc.CallerContext
-
- CLIENT_IP_STR - Static variable in class org.apache.hadoop.ipc.CallerContext
-
- CLIENT_NM_CONNECT_MAX_WAIT_MS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
Max time to wait to establish a connection to NM
- CLIENT_NM_CONNECT_RETRY_INTERVAL_MS - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
Time interval between each attempt to connect to NM
- CLIENT_PORT_STR - Static variable in class org.apache.hadoop.ipc.CallerContext
-
- CLIENT_SECRET - Static variable in class org.apache.hadoop.hdfs.web.oauth2.OAuth2Constants
-
- CLIENT_VERSION - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- clientErrorEncountered() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation
-
Indicate that we just encountered a client-side error.
- ClientRMProxy<T> - Class in org.apache.hadoop.yarn.client
-
- ClientRMSecurityInfo - Class in org.apache.hadoop.yarn.security.client
-
- ClientRMSecurityInfo() - Constructor for class org.apache.hadoop.yarn.security.client.ClientRMSecurityInfo
-
- ClientSCMProtocol - Interface in org.apache.hadoop.yarn.api
-
The protocol between clients and the SharedCacheManager
to claim
and release resources in the shared cache.
- ClientTimelineSecurityInfo - Class in org.apache.hadoop.yarn.security.client
-
- ClientTimelineSecurityInfo() - Constructor for class org.apache.hadoop.yarn.security.client.ClientTimelineSecurityInfo
-
- ClientToAMTokenIdentifier - Class in org.apache.hadoop.yarn.security.client
-
- ClientToAMTokenIdentifier() - Constructor for class org.apache.hadoop.yarn.security.client.ClientToAMTokenIdentifier
-
- ClientToAMTokenIdentifier(ApplicationAttemptId, String) - Constructor for class org.apache.hadoop.yarn.security.client.ClientToAMTokenIdentifier
-
- ClientToAMTokenSecretManager - Class in org.apache.hadoop.yarn.security.client
-
A simple
SecretManager
for AMs to validate Client-RM tokens issued to
clients by the RM using the underlying master-key shared by RM to the AMs on
their launch.
- ClientToAMTokenSecretManager(ApplicationAttemptId, byte[]) - Constructor for class org.apache.hadoop.yarn.security.client.ClientToAMTokenSecretManager
-
- Clock - Interface in org.apache.hadoop.yarn.util
-
A simple clock interface that gives you time.
- clone() - Method in class org.apache.hadoop.fs.statistics.MeanStatistic
-
- clone(T, Configuration) - Static method in class org.apache.hadoop.io.WritableUtils
-
Make a copy of a writable object using serialization to a buffer.
- clone() - Method in class org.apache.hadoop.mapreduce.JobStatus
-
- clone() - Method in class org.apache.hadoop.record.Buffer
-
Deprecated.
- clone() - Method in class org.apache.hadoop.registry.client.types.Endpoint
-
Shallow clone: the lists of addresses are shared
- clone() - Method in class org.apache.hadoop.registry.client.types.ServiceRecord
-
Shallow clone: all endpoints will be shared across instances
- clone(ResourceRequest) - Static method in class org.apache.hadoop.yarn.api.records.ResourceRequest
-
Clone a ResourceRequest object (shallow copy).
- clone() - Method in class org.apache.hadoop.yarn.service.api.records.Resource
-
- cloneInto(Writable, Writable) - Static method in class org.apache.hadoop.io.WritableUtils
-
- cloneWritableInto(Writable, Writable) - Static method in class org.apache.hadoop.util.ReflectionUtils
-
Deprecated.
- close() - Method in class org.apache.hadoop.crypto.key.KeyProvider
-
Can be used by implementing classes to close any resources
that require closing
- close() - Method in class org.apache.hadoop.fs.AvroFSInput
-
- close() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
- close() - Method in class org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore
-
- close() - Method in class org.apache.hadoop.fs.FileSystem
-
Close this FileSystem instance.
- close() - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- close() - Method in class org.apache.hadoop.fs.FSDataOutputStream
-
Close the underlying output stream.
- close() - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- close() - Method in class org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider
-
Propagate the close() call to the inner stsProvider.
- close() - Method in class org.apache.hadoop.fs.s3a.auth.IAMInstanceCredentialsProvider
-
- close() - Method in class org.apache.hadoop.fs.viewfs.ViewFileSystem
-
- close() - Method in class org.apache.hadoop.hdfs.ReplicaAccessor
-
Release the resources associated with the ReplicaAccessor.
- close() - Method in class org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMap
-
- close() - Method in class org.apache.hadoop.hdfs.server.common.blockaliasmap.BlockAliasMap
-
- close() - Method in class org.apache.hadoop.hdfs.server.common.blockaliasmap.impl.LevelDBFileRegionAliasMap
-
- close() - Method in class org.apache.hadoop.hdfs.server.common.blockaliasmap.impl.TextFileRegionAliasMap
-
- close() - Method in class org.apache.hadoop.hdfs.server.federation.store.driver.StateStoreDriver
-
Close the State Store driver connection.
- close() - Method in class org.apache.hadoop.hdfs.server.namenode.NullBlockAliasMap
-
- close() - Method in class org.apache.hadoop.io.compress.CompressionInputStream
-
- close() - Method in class org.apache.hadoop.io.compress.CompressionOutputStream
-
- close() - Method in class org.apache.hadoop.io.compress.CompressorStream
-
- close() - Method in class org.apache.hadoop.io.compress.DecompressorStream
-
- close() - Method in class org.apache.hadoop.io.DefaultStringifier
-
- close() - Method in interface org.apache.hadoop.io.Stringifier
-
Closes this object.
- close() - Method in class org.apache.hadoop.ipc.Client
-
- close() - Method in class org.apache.hadoop.mapred.JobClient
-
Close the JobClient
.
- close() - Method in class org.apache.hadoop.mapred.join.CompositeRecordReader
-
Close all child RRs.
- close() - Method in class org.apache.hadoop.mapred.join.WrappedRecordReader
-
Forward close request to proxied RR.
- close() - Method in class org.apache.hadoop.mapred.KeyValueLineRecordReader
-
- close() - Method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorCombiner
-
Do nothing.
- close() - Method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase
-
- close() - Method in class org.apache.hadoop.mapred.lib.ChainMapper
-
Closes the ChainMapper and all the Mappers in the chain.
- close() - Method in class org.apache.hadoop.mapred.lib.ChainReducer
-
Closes the ChainReducer, the Reducer and all the Mappers in the chain.
- close() - Method in class org.apache.hadoop.mapred.lib.CombineFileRecordReader
-
- close() - Method in class org.apache.hadoop.mapred.lib.CombineFileRecordReaderWrapper
-
- close() - Method in class org.apache.hadoop.mapred.lib.FieldSelectionMapReduce
-
- close() - Method in class org.apache.hadoop.mapred.lib.MultipleOutputs
-
Closes all the opened named outputs.
- close() - Method in class org.apache.hadoop.mapred.MapReduceBase
-
Default implementation that does nothing.
- close() - Method in interface org.apache.hadoop.mapred.RecordReader
-
- close(Reporter) - Method in interface org.apache.hadoop.mapred.RecordWriter
-
Close this RecordWriter
to future operations.
- close() - Method in class org.apache.hadoop.mapred.SequenceFileAsTextRecordReader
-
- close() - Method in class org.apache.hadoop.mapred.SequenceFileRecordReader
-
- close() - Method in class org.apache.hadoop.mapreduce.Cluster
-
Close the Cluster
.
- close() - Method in class org.apache.hadoop.mapreduce.Job
-
Close the Job
.
- close() - Method in class org.apache.hadoop.mapreduce.lib.db.DBRecordReader
-
Close the record reader.
- close() - Method in class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader
-
- close() - Method in class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReaderWrapper
-
- close() - Method in class org.apache.hadoop.mapreduce.lib.input.KeyValueLineRecordReader
-
- close() - Method in class org.apache.hadoop.mapreduce.lib.input.SequenceFileAsTextRecordReader
-
- close() - Method in class org.apache.hadoop.mapreduce.lib.input.SequenceFileRecordReader
-
- close() - Method in class org.apache.hadoop.mapreduce.lib.join.ArrayListBackedIterator
-
- close() - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
Close all child RRs.
- close() - Method in interface org.apache.hadoop.mapreduce.lib.join.ResetableIterator
-
Close datasources and release resources.
- close() - Method in class org.apache.hadoop.mapreduce.lib.join.StreamBackedIterator
-
- close() - Method in class org.apache.hadoop.mapreduce.lib.join.WrappedRecordReader
-
Forward close request to proxied RR.
- close() - Method in class org.apache.hadoop.mapreduce.lib.output.MultipleOutputs
-
Closes all the opened outputs.
- close() - Method in class org.apache.hadoop.mapreduce.RecordReader
-
Close the record reader.
- close(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.RecordWriter
-
Close this RecordWriter
to future operations.
- close() - Method in class org.apache.hadoop.metrics2.lib.MutableRollingAverages
-
- close() - Method in class org.apache.hadoop.metrics2.sink.FileSink
-
- close() - Method in class org.apache.hadoop.metrics2.sink.GraphiteSink
-
- close() - Method in class org.apache.hadoop.metrics2.sink.KafkaSink
-
- close() - Method in class org.apache.hadoop.metrics2.sink.RollingFileSystemSink
-
- close() - Method in class org.apache.hadoop.metrics2.sink.StatsDSink
-
- close() - Method in class org.apache.hadoop.service.AbstractService
-
- close() - Method in interface org.apache.hadoop.service.Service
-
A version of stop() that is designed to be usable in Java7 closure
clauses.
- close() - Method in class org.apache.hadoop.util.DurationInfo
-
- close() - Method in class org.apache.hadoop.util.functional.CloseableTaskPoolSubmitter
-
Shut down the pool.
- close() - Method in class org.apache.hadoop.yarn.ContainerLogAppender
-
- close() - Method in class org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat.LogReader
-
- Closeable - Interface in org.apache.hadoop.io
-
- CloseableTaskPoolSubmitter - Class in org.apache.hadoop.util.functional
-
A task submitter which is closeable, and whose close() call
shuts down the pool.
- CloseableTaskPoolSubmitter(ExecutorService) - Constructor for class org.apache.hadoop.util.functional.CloseableTaskPoolSubmitter
-
Constructor.
- closeAll() - Static method in class org.apache.hadoop.fs.FileSystem
-
Close all cached FileSystem instances.
- closeAllForUGI(UserGroupInformation) - Static method in class org.apache.hadoop.fs.FileSystem
-
Close all cached FileSystem instances for a given UGI.
- closeConnection() - Method in class org.apache.hadoop.mapreduce.lib.db.DBInputFormat
-
- closed - Variable in class org.apache.hadoop.io.compress.CompressorStream
-
- closed - Variable in class org.apache.hadoop.io.compress.DecompressorStream
-
- ClosedIOException - Exception in org.apache.hadoop.fs
-
Exception to denote if the underlying stream, cache or other closable resource
is closed.
- ClosedIOException(String, String) - Constructor for exception org.apache.hadoop.fs.ClosedIOException
-
Appends the custom error-message to the default error message.
- CloseEvent(String, long, long) - Constructor for class org.apache.hadoop.hdfs.inotify.Event.CloseEvent
-
- closePrintStream(OutputStream) - Method in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
- closeSocket(Socket) - Static method in class org.apache.hadoop.io.IOUtils
-
- closeStream(Closeable) - Static method in class org.apache.hadoop.io.IOUtils
-
- closeStreams(Closeable...) - Static method in class org.apache.hadoop.io.IOUtils
-
- closeWriter() - Method in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
Close the writer.
- closingRemoteIterator(RemoteIterator<S>, Closeable) - Static method in class org.apache.hadoop.util.functional.RemoteIterators
-
This adds an extra close operation alongside the passthrough
to any Closeable.close() method supported by the source iterator.
- Cluster - Class in org.apache.hadoop.mapreduce
-
Provides a way to access information about the map/reduce cluster.
- Cluster(Configuration) - Constructor for class org.apache.hadoop.mapreduce.Cluster
-
- Cluster(InetSocketAddress, Configuration) - Constructor for class org.apache.hadoop.mapreduce.Cluster
-
- cluster - Variable in class org.apache.hadoop.mapreduce.tools.CLI
-
- CLUSTER_FS_HOST - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- CLUSTER_FS_URI - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- CLUSTER_INFO_KEY - Static variable in class org.apache.hadoop.yarn.api.records.timelineservice.FlowActivityEntity
-
- CLUSTER_ZK_QUORUM - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- ClusterEntity - Class in org.apache.hadoop.yarn.api.records.timelineservice
-
This entity represents a YARN cluster.
- ClusterEntity() - Constructor for class org.apache.hadoop.yarn.api.records.timelineservice.ClusterEntity
-
- ClusterEntity(TimelineEntity) - Constructor for class org.apache.hadoop.yarn.api.records.timelineservice.ClusterEntity
-
- ClusterMetrics - Class in org.apache.hadoop.mapreduce
-
Status information on the current state of the Map-Reduce cluster.
- ClusterMetrics() - Constructor for class org.apache.hadoop.mapreduce.ClusterMetrics
-
- ClusterMetrics(int, int, int, int, int, int, int, int, int, int, int, int) - Constructor for class org.apache.hadoop.mapreduce.ClusterMetrics
-
- ClusterMetrics(int, int, int, int, int, int, int, int, int, int, int, int, int) - Constructor for class org.apache.hadoop.mapreduce.ClusterMetrics
-
- ClusterStatus - Class in org.apache.hadoop.mapred
-
Status information on the current state of the Map-Reduce cluster.
- ClusterStorageCapacityExceededException - Exception in org.apache.hadoop.fs
-
Exception raised by HDFS indicating that storage capacity in the
cluster filesystem is exceeded.
- ClusterStorageCapacityExceededException() - Constructor for exception org.apache.hadoop.fs.ClusterStorageCapacityExceededException
-
- ClusterStorageCapacityExceededException(String) - Constructor for exception org.apache.hadoop.fs.ClusterStorageCapacityExceededException
-
- ClusterStorageCapacityExceededException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.ClusterStorageCapacityExceededException
-
- ClusterStorageCapacityExceededException(Throwable) - Constructor for exception org.apache.hadoop.fs.ClusterStorageCapacityExceededException
-
- clusterTimestamp - Variable in class org.apache.hadoop.yarn.api.records.ReservationId
-
- cmp - Variable in class org.apache.hadoop.mapreduce.lib.join.WrappedRecordReader
-
- cmpcl - Variable in class org.apache.hadoop.mapred.join.Parser.Node
-
- cmpcl - Variable in class org.apache.hadoop.mapreduce.lib.join.Parser.Node
-
- code(Integer) - Method in class org.apache.hadoop.yarn.service.api.records.Error
-
- code(Integer) - Method in class org.apache.hadoop.yarn.service.api.records.ServiceStatus
-
An error code specific to a scenario which service owners should be able to
use to understand the failure in addition to the diagnostic information.
- CODEC_NAME_KEY - Static variable in class org.apache.hadoop.io.erasurecode.ECSchema
-
- CodecConstants - Class in org.apache.hadoop.io.compress
-
Codec related constants.
- CodecPool - Class in org.apache.hadoop.io.compress
-
A global compressor/decompressor pool used to save and reuse
(possibly native) compression/decompression codecs.
- CodecPool() - Constructor for class org.apache.hadoop.io.compress.CodecPool
-
- collect(K, V) - Method in interface org.apache.hadoop.mapred.OutputCollector
-
Adds a key/value pair to the output.
- CollectorInfo - Class in org.apache.hadoop.yarn.api.records
-
Collector info containing collector address and collector token passed from
RM to AM in Allocate Response.
- CollectorInfo() - Constructor for class org.apache.hadoop.yarn.api.records.CollectorInfo
-
- collectThreadLocalStates() - Method in class org.apache.hadoop.metrics2.lib.MutableRollingAverages
-
- COLON - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- COLON_MARK - Static variable in class org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializableImpl
-
Mark for colon in path names.
- combine(Object[], TupleWritable) - Method in class org.apache.hadoop.mapred.join.CompositeRecordReader
-
- combine(Object[], TupleWritable) - Method in class org.apache.hadoop.mapred.join.InnerJoinRecordReader
-
Return true iff the tuple is full (all data sources contain this key).
- combine(Object[], TupleWritable) - Method in class org.apache.hadoop.mapred.join.MultiFilterRecordReader
-
- combine(Object[], TupleWritable) - Method in class org.apache.hadoop.mapred.join.OuterJoinRecordReader
-
Emit everything from the collector.
- combine(Object[], TupleWritable) - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
- combine(Object[], TupleWritable) - Method in class org.apache.hadoop.mapreduce.lib.join.InnerJoinRecordReader
-
Return true iff the tuple is full (all data sources contain this key).
- combine(Object[], TupleWritable) - Method in class org.apache.hadoop.mapreduce.lib.join.MultiFilterRecordReader
-
- combine(Object[], TupleWritable) - Method in class org.apache.hadoop.mapreduce.lib.join.OuterJoinRecordReader
-
Emit everything from the collector.
- CombineFileInputFormat<K,V> - Class in org.apache.hadoop.mapred.lib
-
- CombineFileInputFormat() - Constructor for class org.apache.hadoop.mapred.lib.CombineFileInputFormat
-
default constructor
- CombineFileInputFormat<K,V> - Class in org.apache.hadoop.mapreduce.lib.input
-
- CombineFileInputFormat() - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat
-
default constructor
- CombineFileRecordReader<K,V> - Class in org.apache.hadoop.mapred.lib
-
A generic RecordReader that can hand out different recordReaders
for each chunk in a
CombineFileSplit
.
- CombineFileRecordReader(JobConf, CombineFileSplit, Reporter, Class<RecordReader<K, V>>) - Constructor for class org.apache.hadoop.mapred.lib.CombineFileRecordReader
-
A generic RecordReader that can hand out different recordReaders
for each chunk in the CombineFileSplit.
- CombineFileRecordReader<K,V> - Class in org.apache.hadoop.mapreduce.lib.input
-
A generic RecordReader that can hand out different recordReaders
for each chunk in a
CombineFileSplit
.
- CombineFileRecordReader(CombineFileSplit, TaskAttemptContext, Class<? extends RecordReader<K, V>>) - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader
-
A generic RecordReader that can hand out different recordReaders
for each chunk in the CombineFileSplit.
- CombineFileRecordReaderWrapper<K,V> - Class in org.apache.hadoop.mapred.lib
-
A wrapper class for a record reader that handles a single file split.
- CombineFileRecordReaderWrapper(FileInputFormat<K, V>, CombineFileSplit, Configuration, Reporter, Integer) - Constructor for class org.apache.hadoop.mapred.lib.CombineFileRecordReaderWrapper
-
- CombineFileRecordReaderWrapper<K,V> - Class in org.apache.hadoop.mapreduce.lib.input
-
A wrapper class for a record reader that handles a single file split.
- CombineFileRecordReaderWrapper(FileInputFormat<K, V>, CombineFileSplit, TaskAttemptContext, Integer) - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReaderWrapper
-
- CombineFileSplit - Class in org.apache.hadoop.mapred.lib
-
- CombineFileSplit() - Constructor for class org.apache.hadoop.mapred.lib.CombineFileSplit
-
- CombineFileSplit(JobConf, Path[], long[], long[], String[]) - Constructor for class org.apache.hadoop.mapred.lib.CombineFileSplit
-
- CombineFileSplit(JobConf, Path[], long[]) - Constructor for class org.apache.hadoop.mapred.lib.CombineFileSplit
-
- CombineFileSplit(CombineFileSplit) - Constructor for class org.apache.hadoop.mapred.lib.CombineFileSplit
-
Copy constructor
- CombineFileSplit - Class in org.apache.hadoop.mapreduce.lib.input
-
A sub-collection of input files.
- CombineFileSplit() - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit
-
default constructor
- CombineFileSplit(Path[], long[], long[], String[]) - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit
-
- CombineFileSplit(Path[], long[]) - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit
-
- CombineFileSplit(CombineFileSplit) - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineFileSplit
-
Copy constructor
- CombineSequenceFileInputFormat<K,V> - Class in org.apache.hadoop.mapred.lib
-
Input format that is a CombineFileInputFormat
-equivalent for
SequenceFileInputFormat
.
- CombineSequenceFileInputFormat() - Constructor for class org.apache.hadoop.mapred.lib.CombineSequenceFileInputFormat
-
- CombineSequenceFileInputFormat<K,V> - Class in org.apache.hadoop.mapreduce.lib.input
-
Input format that is a CombineFileInputFormat
-equivalent for
SequenceFileInputFormat
.
- CombineSequenceFileInputFormat() - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineSequenceFileInputFormat
-
- CombineTextInputFormat - Class in org.apache.hadoop.mapred.lib
-
Input format that is a CombineFileInputFormat
-equivalent for
TextInputFormat
.
- CombineTextInputFormat() - Constructor for class org.apache.hadoop.mapred.lib.CombineTextInputFormat
-
- CombineTextInputFormat - Class in org.apache.hadoop.mapreduce.lib.input
-
Input format that is a CombineFileInputFormat
-equivalent for
TextInputFormat
.
- CombineTextInputFormat() - Constructor for class org.apache.hadoop.mapreduce.lib.input.CombineTextInputFormat
-
- COMMA - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
- CommitConstants - Class in org.apache.hadoop.fs.s3a.commit
-
Constants for working with committers.
- commitJob(JobContext) - Method in class org.apache.hadoop.mapred.FileOutputCommitter
-
- commitJob(JobContext) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
For committing job's output after successful job completion.
- commitJob(JobContext) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
This method implements the new interface by calling the old method.
- commitJob(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.BindingPathOutputCommitter
-
- commitJob(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitter
-
This is the big job commit stage.
- commitJob(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
-
The job has completed, so do works in commitJobInternal().
- commitJob(JobContext) - Method in class org.apache.hadoop.mapreduce.OutputCommitter
-
For committing job's output after successful job completion.
- commitJobInternal(JobContext) - Method in class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
-
The job has completed, so do following commit job, include:
Move all committed tasks to the final output dir (algorithm 1 only).
- commitLastReInitialization(ContainerId) - Method in interface org.apache.hadoop.yarn.api.ContainerManagementProtocol
-
Commit the Last ReInitialization if possible.
- commitLastReInitialization(ContainerId) - Method in class org.apache.hadoop.yarn.client.api.NMClient
-
Commit last reInitialization of the specified container.
- commitLastReInitializationAsync(ContainerId) - Method in class org.apache.hadoop.yarn.client.api.async.NMClientAsync
-
Commit last reInitialization of the specified container.
- CommitResponse - Class in org.apache.hadoop.yarn.api.protocolrecords
-
Response to Commit Container Request.
- CommitResponse() - Constructor for class org.apache.hadoop.yarn.api.protocolrecords.CommitResponse
-
- commitTask(TaskAttemptContext) - Method in class org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter
-
- commitTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapred.FileOutputCommitter
-
- commitTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
To promote the task's temporary output to final output location.
- commitTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapred.OutputCommitter
-
This method implements the new interface by calling the old method.
- commitTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.BindingPathOutputCommitter
-
- commitTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitter
-
Commit the task.
- commitTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
-
Move the files from the work directory to the job output directory
- commitTask(TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.OutputCommitter
-
To promote the task's temporary output to final output location.
- COMMITTER_BYTES_COMMITTED_COUNT - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
Amount of data committed: "committer_bytes_committed".
- COMMITTER_BYTES_COMMITTED_COUNT - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
Amount of data committed: "committer_bytes_committed".
- COMMITTER_COMMIT_JOB - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
Duration Tracking of time to commit an entire job: "committer_commit_job".
- COMMITTER_COMMIT_JOB - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
Duration Tracking of time to commit an entire job: "committer_commit_job".
- COMMITTER_COMMITS_ABORTED_COUNT - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
Count of commits aborted: "committer_commits_aborted".
- COMMITTER_COMMITS_ABORTED_COUNT - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
Count of commits aborted: "committer_commits_aborted".
- COMMITTER_COMMITS_FAILED - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
Count of commits failed: "committer_commits.failures".
- COMMITTER_COMMITS_FAILED - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
Count of commits failed: "committer_commits.failures".
- COMMITTER_COMMITS_REVERTED_COUNT - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
Count of commits reverted: "committer_commits_reverted".
- COMMITTER_COMMITS_REVERTED_COUNT - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
Count of commits reverted: "committer_commits_reverted".
- COMMITTER_FACTORY_CLASS - Static variable in class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory
-
Name of the configuration option used to configure the
output committer factory to use unless there is a specific
one for a schema.
- COMMITTER_FACTORY_DEFAULT - Static variable in class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory
-
Default committer factory name: "org.apache.hadoop.mapreduce.lib.output.FileOutputCommitterFactory".
- COMMITTER_FACTORY_SCHEME - Static variable in class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory
-
Scheme prefix for per-filesystem scheme committers.
- COMMITTER_FACTORY_SCHEME_PATTERN - Static variable in class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory
-
String format pattern for per-filesystem scheme committers.
- COMMITTER_FILE_COUNT_MEAN - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
The number of files in a task.
- COMMITTER_FILE_COUNT_MEAN - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
The number of files in a task.
- COMMITTER_FILE_SIZE_MEAN - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
File Size.
- COMMITTER_FILE_SIZE_MEAN - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
File Size.
- COMMITTER_FILES_COMMITTED_COUNT - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
Number of files committed: "committer_files_committed".
- COMMITTER_FILES_COMMITTED_COUNT - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
Number of files committed: "committer_files_committed".
- COMMITTER_NAME_DIRECTORY - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitConstants
-
- COMMITTER_NAME_FILE - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitConstants
-
- COMMITTER_NAME_MAGIC - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitConstants
-
- COMMITTER_NAME_PARTITIONED - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitConstants
-
- COMMITTER_TASK_DIRECTORY_COUNT_MEAN - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
What is a task attempt's directory count.
- COMMITTER_TASK_DIRECTORY_COUNT_MEAN - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
What is a task attempt's directory count.
- COMMITTER_TASK_DIRECTORY_DEPTH_MEAN - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
What is the depth of a task attempt's directory tree.
- COMMITTER_TASK_DIRECTORY_DEPTH_MEAN - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
What is the depth of a task attempt's directory tree.
- COMMITTER_TASK_FILE_COUNT_MEAN - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
The number of files in a task.
- COMMITTER_TASK_FILE_COUNT_MEAN - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
The number of files in a task.
- COMMITTER_TASK_FILE_SIZE_MEAN - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
The number of files in a task.
- COMMITTER_TASK_FILE_SIZE_MEAN - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
The number of files in a task.
- COMMITTER_TASK_MANIFEST_FILE_SIZE - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
The size of manifest files.
- COMMITTER_TASKS_COMPLETED_COUNT - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
"Count of successful tasks:: "committer_tasks_completed".
- COMMITTER_TASKS_COMPLETED_COUNT - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
"Count of successful tasks:: "committer_tasks_completed".
- COMMITTER_TASKS_FAILED_COUNT - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
-
Count of failed tasks: "committer_tasks_failed".
- COMMITTER_TASKS_FAILED_COUNT - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterStatisticNames
-
Count of failed tasks: "committer_tasks_failed".
- CommitterStatisticNames - Class in org.apache.hadoop.fs.s3a.commit
-
Statistic names for committers.
- CommonAuditContext - Class in org.apache.hadoop.fs.audit
-
The common audit context is a map of common context information
which can be used with any audit span.
- CommonConfigurationKeysPublic - Class in org.apache.hadoop.fs
-
This class contains constants for configuration keys used
in the common code.
- CommonConfigurationKeysPublic() - Constructor for class org.apache.hadoop.fs.CommonConfigurationKeysPublic
-
- comparator() - Method in class org.apache.hadoop.io.SortedMapWritable
-
- COMPARATOR_JCLASS - Static variable in class org.apache.hadoop.io.file.tfile.TFile
-
comparator prefix: java class
- COMPARATOR_MEMCMP - Static variable in class org.apache.hadoop.io.file.tfile.TFile
-
comparator: memcmp
- COMPARATOR_OPTIONS - Static variable in class org.apache.hadoop.mapreduce.lib.partition.KeyFieldBasedComparator
-
- compare(byte[], int, int, byte[], int, int) - Method in interface org.apache.hadoop.io.RawComparator
-
Compare two objects in binary.
- compare(byte[], int, int, byte[], int, int) - Method in class org.apache.hadoop.io.WritableComparator
-
Optimization hook.
- compare(WritableComparable, WritableComparable) - Method in class org.apache.hadoop.io.WritableComparator
-
Compare two WritableComparables.
- compare(Object, Object) - Method in class org.apache.hadoop.io.WritableComparator
-
Compare two Object.
- compare(byte[], int, int, byte[], int, int) - Method in class org.apache.hadoop.mapreduce.lib.partition.KeyFieldBasedComparator
-
- compare(byte[], int, int, byte[], int, int) - Method in class org.apache.hadoop.record.RecordComparator
-
Deprecated.
- compare(ReservationRequest, ReservationRequest) - Method in class org.apache.hadoop.yarn.api.records.ReservationRequest.ReservationRequestComparator
-
- compare(ResourceRequest, ResourceRequest) - Method in class org.apache.hadoop.yarn.api.records.ResourceRequest.ResourceRequestComparator
-
- compareBytes(byte[], int, int, byte[], int, int) - Static method in class org.apache.hadoop.io.WritableComparator
-
Lexicographic order of binary data.
- compareBytes(byte[], int, int, byte[], int, int) - Static method in class org.apache.hadoop.record.Utils
-
Deprecated.
Lexicographic order of binary data.
- compareFs(FileSystem, FileSystem) - Static method in class org.apache.hadoop.fs.FileUtil
-
- compareTo(FileStatus) - Method in class org.apache.hadoop.fs.FileStatus
-
Compare this FileStatus to another FileStatus based on lexicographical
order of path.
- compareTo(Object) - Method in class org.apache.hadoop.fs.FileStatus
-
Compare this FileStatus to another FileStatus based on lexicographical
order of path.
- compareTo(FileStatus) - Method in class org.apache.hadoop.fs.LocatedFileStatus
-
Compare this FileStatus to another FileStatus
- compareTo(Path) - Method in class org.apache.hadoop.fs.Path
-
- compareTo(BinaryComparable) - Method in class org.apache.hadoop.io.BinaryComparable
-
Compare bytes from {#getBytes()}.
- compareTo(byte[], int, int) - Method in class org.apache.hadoop.io.BinaryComparable
-
Compare bytes from {#getBytes()} to those provided.
- compareTo(BooleanWritable) - Method in class org.apache.hadoop.io.BooleanWritable
-
- compareTo(ByteWritable) - Method in class org.apache.hadoop.io.ByteWritable
-
Compares two ByteWritables.
- compareTo(DoubleWritable) - Method in class org.apache.hadoop.io.DoubleWritable
-
- compareTo(FloatWritable) - Method in class org.apache.hadoop.io.FloatWritable
-
Compares two FloatWritables.
- compareTo(IntWritable) - Method in class org.apache.hadoop.io.IntWritable
-
Compares two IntWritables.
- compareTo(LongWritable) - Method in class org.apache.hadoop.io.LongWritable
-
Compares two LongWritables.
- compareTo(MD5Hash) - Method in class org.apache.hadoop.io.MD5Hash
-
Compares this object with the specified object for order.
- compareTo(NullWritable) - Method in class org.apache.hadoop.io.NullWritable
-
- compareTo(ShortWritable) - Method in class org.apache.hadoop.io.ShortWritable
-
Compares two ShortWritable.
- compareTo(VIntWritable) - Method in class org.apache.hadoop.io.VIntWritable
-
Compares two VIntWritables.
- compareTo(VLongWritable) - Method in class org.apache.hadoop.io.VLongWritable
-
Compares two VLongWritables.
- compareTo(ComposableRecordReader<K, ?>) - Method in class org.apache.hadoop.mapred.join.CompositeRecordReader
-
Implement Comparable contract (compare key of join or head of heap
with that of another).
- compareTo(ComposableRecordReader<K, ?>) - Method in class org.apache.hadoop.mapred.join.WrappedRecordReader
-
Implement Comparable contract (compare key at head of proxied RR
with that of another).
- compareTo(ID) - Method in class org.apache.hadoop.mapreduce.ID
-
Compare IDs by associated numbers
- compareTo(ID) - Method in class org.apache.hadoop.mapreduce.JobID
-
Compare JobIds by first jtIdentifiers, then by job numbers
- compareTo(ComposableRecordReader<K, ?>) - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
Implement Comparable contract (compare key of join or head of heap
with that of another).
- compareTo(ComposableRecordReader<K, ?>) - Method in class org.apache.hadoop.mapreduce.lib.join.WrappedRecordReader
-
Implement Comparable contract (compare key at head of proxied RR
with that of another).
- compareTo(ID) - Method in class org.apache.hadoop.mapreduce.TaskAttemptID
-
Compare TaskIds by first tipIds, then by task numbers.
- compareTo(ID) - Method in class org.apache.hadoop.mapreduce.TaskID
-
Compare TaskInProgressIds by first jobIds, then by tip numbers.
- compareTo(Object) - Method in class org.apache.hadoop.record.Buffer
-
Deprecated.
Define the sort order of the Buffer.
- compareTo(Object) - Method in class org.apache.hadoop.record.Record
-
Deprecated.
- compareTo(ApplicationAttemptId) - Method in class org.apache.hadoop.yarn.api.records.ApplicationAttemptId
-
- compareTo(ApplicationId) - Method in class org.apache.hadoop.yarn.api.records.ApplicationId
-
- compareTo(ContainerId) - Method in class org.apache.hadoop.yarn.api.records.ContainerId
-
- compareTo(NodeId) - Method in class org.apache.hadoop.yarn.api.records.NodeId
-
- compareTo(NodeLabel) - Method in class org.apache.hadoop.yarn.api.records.NodeLabel
-
- compareTo(Priority) - Method in class org.apache.hadoop.yarn.api.records.Priority
-
- compareTo(ReservationId) - Method in class org.apache.hadoop.yarn.api.records.ReservationId
-
- compareTo(ReservationRequest) - Method in class org.apache.hadoop.yarn.api.records.ReservationRequest
-
- compareTo(Resource) - Method in class org.apache.hadoop.yarn.api.records.Resource
-
- compareTo(ResourceRequest) - Method in class org.apache.hadoop.yarn.api.records.ResourceRequest
-
- compareTo(TimelineEntity) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntity
-
- compareTo(TimelineEntityGroupId) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEntityGroupId
-
- compareTo(TimelineEvent) - Method in class org.apache.hadoop.yarn.api.records.timeline.TimelineEvent
-
- compareTo(TimelineEntity) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.FlowActivityEntity
-
- compareTo(TimelineEntity) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity
-
- compareTo(TimelineEvent) - Method in class org.apache.hadoop.yarn.api.records.timelineservice.TimelineEvent
-
- compile(String) - Method in class org.apache.hadoop.metrics2.filter.GlobFilter
-
- compile(String) - Method in class org.apache.hadoop.metrics2.filter.RegexFilter
-
- complete(UploadHandle, Path, Map<Integer, PartHandle>) - Method in interface org.apache.hadoop.fs.MultipartUploader
-
Complete a multipart upload.
- completeBootstrapTransfer(File) - Static method in class org.apache.hadoop.hdfs.server.aliasmap.InMemoryAliasMap
-
Extract the aliasmap archive to complete the bootstrap process.
- completeLocalOutput(Path, Path) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
- completeLocalOutput(Path, Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Called when we're all done writing to the target.
- completeLocalOutput(Path, Path) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
Called when we're all done writing to the target.
- completeLocalOutput(Path, Path) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- COMPLETION_POLL_INTERVAL_KEY - Static variable in class org.apache.hadoop.mapreduce.Job
-
Key in mapred-*.xml that sets completionPollInvervalMillis
- COMPONENT - Static variable in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
-
- Component - Class in org.apache.hadoop.yarn.service.api.records
-
One or more components of the service.
- Component() - Constructor for class org.apache.hadoop.yarn.service.api.records.Component
-
- COMPONENT_ID - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- COMPONENT_INSTANCE_HOST - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- COMPONENT_INSTANCE_IP - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- COMPONENT_INSTANCE_NAME - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- COMPONENT_NAME - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- COMPONENT_NAME_LC - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- ComponentContainers - Class in org.apache.hadoop.yarn.service.api.records
-
Containers of a component.
- ComponentContainers() - Constructor for class org.apache.hadoop.yarn.service.api.records.ComponentContainers
-
- componentInstanceName(String) - Method in class org.apache.hadoop.yarn.service.api.records.Container
-
Name of the component instance that this container instance belongs to.
- componentListPath(String, String, String) - Static method in class org.apache.hadoop.registry.client.binding.RegistryUtils
-
Create a path for listing components under a service
- componentPath(String, String, String, String) - Static method in class org.apache.hadoop.registry.client.binding.RegistryUtils
-
Create the path to a service record for a component
- components(List<Component>) - Method in class org.apache.hadoop.yarn.service.api.records.Service
-
Components of an service.
- ComponentState - Enum in org.apache.hadoop.yarn.service.api.records
-
- ComposableInputFormat<K extends WritableComparable,V extends Writable> - Interface in org.apache.hadoop.mapred.join
-
Refinement of InputFormat requiring implementors to provide
ComposableRecordReader instead of RecordReader.
- ComposableInputFormat<K extends WritableComparable<?>,V extends Writable> - Class in org.apache.hadoop.mapreduce.lib.join
-
Refinement of InputFormat requiring implementors to provide
ComposableRecordReader instead of RecordReader.
- ComposableInputFormat() - Constructor for class org.apache.hadoop.mapreduce.lib.join.ComposableInputFormat
-
- ComposableRecordReader<K extends WritableComparable,V extends Writable> - Interface in org.apache.hadoop.mapred.join
-
Additional operations required of a RecordReader to participate in a join.
- ComposableRecordReader<K extends WritableComparable<?>,V extends Writable> - Class in org.apache.hadoop.mapreduce.lib.join
-
Additional operations required of a RecordReader to participate in a join.
- ComposableRecordReader() - Constructor for class org.apache.hadoop.mapreduce.lib.join.ComposableRecordReader
-
- compose(Class<? extends InputFormat>, String) - Static method in class org.apache.hadoop.mapred.join.CompositeInputFormat
-
Convenience method for constructing composite formats.
- compose(String, Class<? extends InputFormat>, String...) - Static method in class org.apache.hadoop.mapred.join.CompositeInputFormat
-
Convenience method for constructing composite formats.
- compose(String, Class<? extends InputFormat>, Path...) - Static method in class org.apache.hadoop.mapred.join.CompositeInputFormat
-
Convenience method for constructing composite formats.
- compose(Class<? extends InputFormat>, String) - Static method in class org.apache.hadoop.mapreduce.lib.join.CompositeInputFormat
-
Convenience method for constructing composite formats.
- compose(String, Class<? extends InputFormat>, String...) - Static method in class org.apache.hadoop.mapreduce.lib.join.CompositeInputFormat
-
Convenience method for constructing composite formats.
- compose(String, Class<? extends InputFormat>, Path...) - Static method in class org.apache.hadoop.mapreduce.lib.join.CompositeInputFormat
-
Convenience method for constructing composite formats.
- CompositeInputFormat<K extends WritableComparable> - Class in org.apache.hadoop.mapred.join
-
An InputFormat capable of performing joins over a set of data sources sorted
and partitioned the same way.
- CompositeInputFormat() - Constructor for class org.apache.hadoop.mapred.join.CompositeInputFormat
-
- CompositeInputFormat<K extends WritableComparable> - Class in org.apache.hadoop.mapreduce.lib.join
-
An InputFormat capable of performing joins over a set of data sources sorted
and partitioned the same way.
- CompositeInputFormat() - Constructor for class org.apache.hadoop.mapreduce.lib.join.CompositeInputFormat
-
- CompositeInputSplit - Class in org.apache.hadoop.mapred.join
-
This InputSplit contains a set of child InputSplits.
- CompositeInputSplit() - Constructor for class org.apache.hadoop.mapred.join.CompositeInputSplit
-
- CompositeInputSplit(int) - Constructor for class org.apache.hadoop.mapred.join.CompositeInputSplit
-
- CompositeInputSplit - Class in org.apache.hadoop.mapreduce.lib.join
-
This InputSplit contains a set of child InputSplits.
- CompositeInputSplit() - Constructor for class org.apache.hadoop.mapreduce.lib.join.CompositeInputSplit
-
- CompositeInputSplit(int) - Constructor for class org.apache.hadoop.mapreduce.lib.join.CompositeInputSplit
-
- CompositeRecordReader<K extends WritableComparable,V extends Writable,X extends Writable> - Class in org.apache.hadoop.mapred.join
-
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
- CompositeRecordReader(int, int, Class<? extends WritableComparator>) - Constructor for class org.apache.hadoop.mapred.join.CompositeRecordReader
-
Create a RecordReader with capacity
children to position
id
in the parent reader.
- CompositeRecordReader<K extends WritableComparable<?>,V extends Writable,X extends Writable> - Class in org.apache.hadoop.mapreduce.lib.join
-
A RecordReader that can effect joins of RecordReaders sharing a common key
type and partitioning.
- CompositeRecordReader(int, int, Class<? extends WritableComparator>) - Constructor for class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
Create a RecordReader with capacity
children to position
id
in the parent reader.
- CompositeService - Class in org.apache.hadoop.service
-
Composition of services.
- CompositeService(String) - Constructor for class org.apache.hadoop.service.CompositeService
-
- compress() - Method in class org.apache.hadoop.io.compress.BlockCompressorStream
-
- compress(byte[], int, int) - Method in interface org.apache.hadoop.io.compress.Compressor
-
Fills specified buffer with compressed data.
- compress() - Method in class org.apache.hadoop.io.compress.CompressorStream
-
- COMPRESS - Static variable in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
-
Configuration option: should output be compressed? "mapreduce.output.fileoutputformat.compress".
- COMPRESS_CODEC - Static variable in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
-
If compression is enabled, name of codec: "mapreduce.output.fileoutputformat.compress.codec".
- COMPRESS_TYPE - Static variable in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
-
Type of compression "mapreduce.output.fileoutputformat.compress.type": NONE, RECORD, BLOCK.
- CompressedWritable - Class in org.apache.hadoop.io
-
A base-class for Writables which store themselves compressed and lazily
inflate on field access.
- CompressedWritable() - Constructor for class org.apache.hadoop.io.CompressedWritable
-
- compressFiles(Collection<File>, File, String) - Static method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
Compress (tar) the input files to the output file.
- COMPRESSION_GZ - Static variable in class org.apache.hadoop.io.file.tfile.TFile
-
compression: gzip
- COMPRESSION_LZO - Static variable in class org.apache.hadoop.io.file.tfile.TFile
-
compression: lzo
- COMPRESSION_NONE - Static variable in class org.apache.hadoop.io.file.tfile.TFile
-
compression: none
- COMPRESSION_OPT_GZIP - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Gzipped.
- COMPRESSION_OPT_NONE - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
No compression.
- CompressionCodec - Interface in org.apache.hadoop.io.compress
-
This class encapsulates a streaming compression/decompression pair.
- CompressionCodecFactory - Class in org.apache.hadoop.io.compress
-
A factory that will find the correct codec for a given filename.
- CompressionCodecFactory(Configuration) - Constructor for class org.apache.hadoop.io.compress.CompressionCodecFactory
-
Find the codecs specified in the config value io.compression.codecs
and register them.
- CompressionInputStream - Class in org.apache.hadoop.io.compress
-
A compression input stream.
- CompressionInputStream(InputStream) - Constructor for class org.apache.hadoop.io.compress.CompressionInputStream
-
Create a compression input stream that reads
the decompressed bytes from the given stream.
- CompressionOutputStream - Class in org.apache.hadoop.io.compress
-
A compression output stream.
- CompressionOutputStream(OutputStream) - Constructor for class org.apache.hadoop.io.compress.CompressionOutputStream
-
Create a compression output stream that writes
the compressed bytes to the given stream.
- Compressor - Interface in org.apache.hadoop.io.compress
-
- compressor - Variable in class org.apache.hadoop.io.compress.CompressorStream
-
- CompressorStream - Class in org.apache.hadoop.io.compress
-
- CompressorStream(OutputStream, Compressor, int) - Constructor for class org.apache.hadoop.io.compress.CompressorStream
-
- CompressorStream(OutputStream, Compressor) - Constructor for class org.apache.hadoop.io.compress.CompressorStream
-
- CompressorStream(OutputStream) - Constructor for class org.apache.hadoop.io.compress.CompressorStream
-
Allow derived classes to directly set the underlying stream.
- computeChecksum(InputStream) - Method in interface org.apache.hadoop.yarn.sharedcache.SharedCacheChecksum
-
Calculate the checksum of the passed input stream.
- computeSplitSize(long, long, long) - Method in class org.apache.hadoop.mapred.FileInputFormat
-
- computeSplitSize(long, long, long) - Method in class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
-
- concat(Path, Path[]) - Method in class org.apache.hadoop.fs.adl.AdlFileSystem
-
Concat existing files together.
- concat(Path, Path[]) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
- concat(Path, Path[]) - Method in class org.apache.hadoop.fs.FileSystem
-
Concat existing files together.
- concat(Path, Path[]) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- concat(Path, Path[]) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- ConcurrentWriteOperationDetectedException - Exception in org.apache.hadoop.fs.azurebfs.contracts.exceptions
-
Thrown when a concurrent write operation is detected.
- ConcurrentWriteOperationDetectedException(String) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.ConcurrentWriteOperationDetectedException
-
- conditions - Variable in class org.apache.hadoop.mapreduce.lib.db.DBInputFormat
-
- conf - Variable in class org.apache.hadoop.mapred.SequenceFileRecordReader
-
- conf - Variable in class org.apache.hadoop.mapreduce.lib.input.SequenceFileRecordReader
-
- conf - Variable in class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
- conf - Variable in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
- CONF_KEY_HEADER - Static variable in enum org.apache.hadoop.fs.StorageType
-
- CONF_PATH_ARG - Static variable in class org.apache.hadoop.tools.dynamometer.Client
-
- ConfCredentialBasedAccessTokenProvider - Class in org.apache.hadoop.hdfs.web.oauth2
-
- ConfCredentialBasedAccessTokenProvider() - Constructor for class org.apache.hadoop.hdfs.web.oauth2.ConfCredentialBasedAccessTokenProvider
-
- ConfCredentialBasedAccessTokenProvider(Timer) - Constructor for class org.apache.hadoop.hdfs.web.oauth2.ConfCredentialBasedAccessTokenProvider
-
- CONFIG_NODE_DESCRIPTOR_PROVIDER - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- ConfigFile - Class in org.apache.hadoop.yarn.service.api.records
-
A config file that needs to be created and made available as a volume in an
service component container.
- ConfigFile() - Constructor for class org.apache.hadoop.yarn.service.api.records.ConfigFile
-
- ConfigFormat - Enum in org.apache.hadoop.yarn.service.api.records
-
- Configurable - Interface in org.apache.hadoop.conf
-
- Configuration - Class in org.apache.hadoop.conf
-
Provides access to configuration parameters.
- Configuration() - Constructor for class org.apache.hadoop.conf.Configuration
-
A new configuration.
- Configuration(boolean) - Constructor for class org.apache.hadoop.conf.Configuration
-
A new configuration where the behavior of reading from the default
resources can be turned off.
- Configuration(Configuration) - Constructor for class org.apache.hadoop.conf.Configuration
-
A new configuration with the same settings cloned from another.
- configuration(Configuration) - Method in class org.apache.hadoop.yarn.service.api.records.Component
-
Config properties for this component.
- Configuration - Class in org.apache.hadoop.yarn.service.api.records
-
Set of configuration properties that can be injected into the service
components via envs, files and custom pluggable helper docker containers.
- Configuration() - Constructor for class org.apache.hadoop.yarn.service.api.records.Configuration
-
- configuration(Configuration) - Method in class org.apache.hadoop.yarn.service.api.records.Service
-
Config properties of an service.
- ConfigurationException - Exception in org.apache.hadoop.yarn.exceptions
-
This exception is thrown on unrecoverable configuration errors.
- ConfigurationException(Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ConfigurationException
-
- ConfigurationException(String) - Constructor for exception org.apache.hadoop.yarn.exceptions.ConfigurationException
-
- ConfigurationException(String, Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ConfigurationException
-
- ConfigurationKeys - Class in org.apache.hadoop.fs.azurebfs.constants
-
Responsible to keep all the Azure Blob File System configurations keys in Hadoop configuration file.
- ConfigurationPropertyNotFoundException - Exception in org.apache.hadoop.fs.azurebfs.contracts.exceptions
-
Thrown when a searched for element is not found
- ConfigurationPropertyNotFoundException(String) - Constructor for exception org.apache.hadoop.fs.azurebfs.contracts.exceptions.ConfigurationPropertyNotFoundException
-
- configure(HttpURLConnection) - Method in class org.apache.hadoop.hdfs.web.oauth2.OAuth2ConnectionConfigurator
-
- configure(HttpURLConnection) - Method in class org.apache.hadoop.hdfs.web.SSLConnectionConfigurator
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.FixedLengthInputFormat
-
- configure(JobConf) - Method in interface org.apache.hadoop.mapred.JobConfigurable
-
Initializes a new instance from a
JobConf
.
- configure(JobConf) - Method in class org.apache.hadoop.mapred.KeyValueTextInputFormat
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor
-
Do nothing.
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorBaseDescriptor
-
get the input file name.
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorCombiner
-
Combiner does not need to configure.
- configure(JobConf) - Method in interface org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorDescriptor
-
Configure the object
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.BinaryPartitioner
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.ChainMapper
-
Configures the ChainMapper and all the Mappers in the chain.
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.ChainReducer
-
Configures the ChainReducer, the Reducer and all the Mappers in the chain.
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.db.DBInputFormat
-
Initializes a new instance from a
JobConf
.
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.FieldSelectionMapReduce
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.HashPartitioner
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.KeyFieldBasedComparator
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.MultithreadedMapRunner
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.NLineInputFormat
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.RegexMapper
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.lib.TotalOrderPartitioner
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.MapReduceBase
-
Default implementation that does nothing.
- configure(JobConf) - Method in class org.apache.hadoop.mapred.MapRunner
-
- configure(JobConf) - Method in class org.apache.hadoop.mapred.TextInputFormat
-
- configure(Configuration) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.UserDefinedValueAggregatorDescriptor
-
Do nothing.
- configure(Configuration) - Method in class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorBaseDescriptor
-
get the input file name.
- configure(Configuration) - Method in interface org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorDescriptor
-
Configure the object
- Configured - Class in org.apache.hadoop.conf
-
Base class for things that may be configured with a
Configuration
.
- Configured() - Constructor for class org.apache.hadoop.conf.Configured
-
Construct a Configured.
- Configured(Configuration) - Constructor for class org.apache.hadoop.conf.Configured
-
Construct a Configured.
- configureDB(JobConf, String, String, String, String) - Static method in class org.apache.hadoop.mapred.lib.db.DBConfiguration
-
Sets the DB access related fields in the JobConf.
- configureDB(JobConf, String, String) - Static method in class org.apache.hadoop.mapred.lib.db.DBConfiguration
-
Sets the DB access related fields in the JobConf.
- configureDB(Configuration, String, String, String, String) - Static method in class org.apache.hadoop.mapreduce.lib.db.DBConfiguration
-
- configureDB(Configuration, String, String) - Static method in class org.apache.hadoop.mapreduce.lib.db.DBConfiguration
-
Sets the DB access related fields in the JobConf.
- confirmPrompt(String) - Static method in class org.apache.hadoop.util.ToolRunner
-
Print out a prompt to the user, and return true if the user
responds with "y" or "yes".
- CONFLICT_MODE_APPEND - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitConstants
-
Conflict mode: "append".
- CONFLICT_MODE_FAIL - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitConstants
-
Conflict mode: "fail".
- CONFLICT_MODE_REPLACE - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitConstants
-
Conflict mode: "replace".
- ConfRefreshTokenBasedAccessTokenProvider - Class in org.apache.hadoop.hdfs.web.oauth2
-
- ConfRefreshTokenBasedAccessTokenProvider() - Constructor for class org.apache.hadoop.hdfs.web.oauth2.ConfRefreshTokenBasedAccessTokenProvider
-
- ConfRefreshTokenBasedAccessTokenProvider(Timer) - Constructor for class org.apache.hadoop.hdfs.web.oauth2.ConfRefreshTokenBasedAccessTokenProvider
-
- connection - Variable in class org.apache.hadoop.mapreduce.lib.db.DBInputFormat
-
- CONNECTION_ACQUISITION_TIMEOUT - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Acquisition timeout for connections from the pool:
"fs.s3a.connection.acquisition.timeout".
- CONNECTION_IDLE_TIME - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Maximum idle time for connections in the pool: "fs.s3a.connection.idle.time".
- CONNECTION_KEEPALIVE - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Should TCP Keepalive be enabled on the socket?
This adds some network IO, but finds failures faster.
- CONNECTION_TTL - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Configuration option to configure expiration time of
S3 http connection from the connection pool: "fs.s3a.connection.ttl".
- ConnectTimeoutException - Exception in org.apache.hadoop.net
-
Thrown by NetUtils.connect(java.net.Socket, java.net.SocketAddress, int)
if it times out while connecting to the remote host.
- ConnectTimeoutException(String) - Constructor for exception org.apache.hadoop.net.ConnectTimeoutException
-
- Constants - Class in org.apache.hadoop.fs.s3a
-
Constants used with the S3AFileSystem
.
- constraints(List<PlacementConstraint>) - Method in class org.apache.hadoop.yarn.service.api.records.PlacementPolicy
-
Placement constraint details.
- constructOutputStream(DataOutput) - Static method in class org.apache.hadoop.io.DataOutputOutputStream
-
Construct an OutputStream from the given DataOutput.
- constructQuery(String, String[]) - Method in class org.apache.hadoop.mapreduce.lib.db.DBOutputFormat
-
Constructs the query used as the prepared statement to insert data.
- Container - Class in org.apache.hadoop.yarn.api.records
-
Container
represents an allocated resource in the cluster.
- Container() - Constructor for class org.apache.hadoop.yarn.api.records.Container
-
- Container - Class in org.apache.hadoop.yarn.service.api.records
-
An instance of a running service container.
- Container() - Constructor for class org.apache.hadoop.yarn.service.api.records.Container
-
- CONTAINER_ID - Static variable in interface org.apache.hadoop.yarn.service.api.ServiceApiConstants
-
- CONTAINER_ID_BITMASK - Static variable in class org.apache.hadoop.yarn.api.records.ContainerId
-
- CONTAINER_PREFIX - Static variable in class org.apache.hadoop.yarn.util.ConverterUtils
-
- CONTAINER_TOKEN_FILE_ENV_NAME - Static variable in interface org.apache.hadoop.yarn.api.ApplicationConstants
-
The cache file into which container token is written
- ContainerEntity - Class in org.apache.hadoop.yarn.api.records.timelineservice
-
This entity represents a container belonging to an application attempt.
- ContainerEntity() - Constructor for class org.apache.hadoop.yarn.api.records.timelineservice.ContainerEntity
-
- ContainerEntity(TimelineEntity) - Constructor for class org.apache.hadoop.yarn.api.records.timelineservice.ContainerEntity
-
- ContainerExitStatus - Class in org.apache.hadoop.yarn.api.records
-
Container exit statuses indicating special exit circumstances.
- ContainerExitStatus() - Constructor for class org.apache.hadoop.yarn.api.records.ContainerExitStatus
-
- ContainerId - Class in org.apache.hadoop.yarn.api.records
-
ContainerId
represents a globally unique identifier
for a
Container
in the cluster.
- ContainerId() - Constructor for class org.apache.hadoop.yarn.api.records.ContainerId
-
- ContainerLaunchContext - Class in org.apache.hadoop.yarn.api.records
-
ContainerLaunchContext
represents all of the information
needed by the NodeManager
to launch a container.
- ContainerLaunchContext() - Constructor for class org.apache.hadoop.yarn.api.records.ContainerLaunchContext
-
- ContainerLogAppender - Class in org.apache.hadoop.yarn
-
A simple log4j-appender for container's logs.
- ContainerLogAppender() - Constructor for class org.apache.hadoop.yarn.ContainerLogAppender
-
- ContainerManagementProtocol - Interface in org.apache.hadoop.yarn.api
-
The protocol between an ApplicationMaster
and a
NodeManager
to start/stop and increase resource of containers
and to get status of running containers.
- ContainerManagerSecurityInfo - Class in org.apache.hadoop.yarn.security
-
- ContainerManagerSecurityInfo() - Constructor for class org.apache.hadoop.yarn.security.ContainerManagerSecurityInfo
-
- ContainerNotFoundException - Exception in org.apache.hadoop.yarn.exceptions
-
This exception is thrown on
(GetContainerReportRequest)
API when the container doesn't exist in AHS
- ContainerNotFoundException(Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ContainerNotFoundException
-
- ContainerNotFoundException(String) - Constructor for exception org.apache.hadoop.yarn.exceptions.ContainerNotFoundException
-
- ContainerNotFoundException(String, Throwable) - Constructor for exception org.apache.hadoop.yarn.exceptions.ContainerNotFoundException
-
- ContainerReport - Class in org.apache.hadoop.yarn.api.records
-
ContainerReport
is a report of an container.
- ContainerReport() - Constructor for class org.apache.hadoop.yarn.api.records.ContainerReport
-
- ContainerRetryContext - Class in org.apache.hadoop.yarn.api.records
-
ContainerRetryContext
indicates how container retry after it fails
to run.
- ContainerRetryContext() - Constructor for class org.apache.hadoop.yarn.api.records.ContainerRetryContext
-
- ContainerRetryPolicy - Enum in org.apache.hadoop.yarn.api.records
-
Retry policy for relaunching a Container
.
- ContainerRollingLogAppender - Class in org.apache.hadoop.yarn
-
A simple log4j-appender for container's logs.
- ContainerRollingLogAppender() - Constructor for class org.apache.hadoop.yarn.ContainerRollingLogAppender
-
- containers(List<Container>) - Method in class org.apache.hadoop.yarn.service.api.records.ComponentContainers
-
Sets the containers.
- ContainerState - Enum in org.apache.hadoop.yarn.api.records
-
State of a Container
.
- ContainerState - Enum in org.apache.hadoop.yarn.service.api.records
-
The current state of the container of an application.
- ContainerStatus - Class in org.apache.hadoop.yarn.api.records
-
ContainerStatus
represents the current status of a
Container
.
- ContainerStatus() - Constructor for class org.apache.hadoop.yarn.api.records.ContainerStatus
-
- ContainerSubState - Enum in org.apache.hadoop.yarn.api.records
-
Container Sub-State.
- ContainerTokenIdentifier - Class in org.apache.hadoop.yarn.security
-
TokenIdentifier for a container.
- ContainerTokenIdentifier(ContainerId, String, String, Resource, long, int, long, Priority, long) - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenIdentifier
-
- ContainerTokenIdentifier(ContainerId, String, String, Resource, long, int, long, Priority, long, LogAggregationContext) - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenIdentifier
-
- ContainerTokenIdentifier(ContainerId, String, String, Resource, long, int, long, Priority, long, LogAggregationContext, String) - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenIdentifier
-
- ContainerTokenIdentifier(ContainerId, String, String, Resource, long, int, long, Priority, long, LogAggregationContext, String, ContainerType) - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenIdentifier
-
- ContainerTokenIdentifier(ContainerId, int, String, String, Resource, long, int, long, Priority, long, LogAggregationContext, String, ContainerType, ExecutionType) - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenIdentifier
-
- ContainerTokenIdentifier(ContainerId, int, String, String, Resource, long, int, long, Priority, long, LogAggregationContext, String, ContainerType, ExecutionType, long) - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenIdentifier
-
Convenience Constructor for existing clients.
- ContainerTokenIdentifier(ContainerId, int, String, String, Resource, long, int, long, Priority, long, LogAggregationContext, String, ContainerType, ExecutionType, long, Set<String>) - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenIdentifier
-
Create a Container Token Identifier.
- ContainerTokenIdentifier() - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenIdentifier
-
Default constructor needed by RPC layer/SecretManager.
- ContainerTokenSelector - Class in org.apache.hadoop.yarn.security
-
- ContainerTokenSelector() - Constructor for class org.apache.hadoop.yarn.security.ContainerTokenSelector
-
- ContainerUpdateRequest - Class in org.apache.hadoop.yarn.api.protocolrecords
-
The request sent by Application Master
to the
Node Manager
to change the resource quota of a container.
- ContainerUpdateRequest() - Constructor for class org.apache.hadoop.yarn.api.protocolrecords.ContainerUpdateRequest
-
- ContainerUpdateResponse - Class in org.apache.hadoop.yarn.api.protocolrecords
-
The response sent by the NodeManager
to the
ApplicationMaster
when asked to update container resource.
- ContainerUpdateResponse() - Constructor for class org.apache.hadoop.yarn.api.protocolrecords.ContainerUpdateResponse
-
- ContainerUpdateType - Enum in org.apache.hadoop.yarn.api.records
-
Encodes the type of Container Update.
- containsKey(String) - Method in class org.apache.hadoop.fs.audit.CommonAuditContext
-
Does the context contain a specific key?
- containsKey(Object) - Method in class org.apache.hadoop.io.MapWritable
-
- containsKey(Object) - Method in class org.apache.hadoop.io.SortedMapWritable
-
- containsValue(Object) - Method in class org.apache.hadoop.io.MapWritable
-
- containsValue(Object) - Method in class org.apache.hadoop.io.SortedMapWritable
-
- CONTENT_ENCODING - Static variable in class org.apache.hadoop.fs.azurebfs.constants.HttpHeaderConfigurations
-
- CONTENT_ENCODING - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
Content encoding: gzip, deflate, compress, br, etc.
- CONTENT_LANGUAGE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.HttpHeaderConfigurations
-
- CONTENT_LENGTH - Static variable in class org.apache.hadoop.fs.azurebfs.constants.HttpHeaderConfigurations
-
- CONTENT_MD5 - Static variable in class org.apache.hadoop.fs.azurebfs.constants.HttpHeaderConfigurations
-
- CONTENT_TYPE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.HttpHeaderConfigurations
-
- contentEquals(Counters.Counter) - Method in class org.apache.hadoop.mapred.Counters.Counter
-
Deprecated.
- ContentSummary - Class in org.apache.hadoop.fs
-
Store the summary of a content (a directory or a file).
- ContentSummary() - Constructor for class org.apache.hadoop.fs.ContentSummary
-
Deprecated.
- ContentSummary(long, long, long) - Constructor for class org.apache.hadoop.fs.ContentSummary
-
Deprecated.
- ContentSummary(long, long, long, long, long, long) - Constructor for class org.apache.hadoop.fs.ContentSummary
-
Deprecated.
- context - Variable in class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader
-
- context() - Method in interface org.apache.hadoop.metrics2.MetricsRecord
-
- CONTEXT_ATTR_STAGE - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterConstants
-
Stage attribute in audit context: "st".
- CONTEXT_ATTR_TASK_ATTEMPT_ID - Static variable in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterConstants
-
Task ID attribute in audit context: "ta".
- ControlledJob - Class in org.apache.hadoop.mapreduce.lib.jobcontrol
-
This class encapsulates a MapReduce job and its dependency.
- ControlledJob(Job, List<ControlledJob>) - Constructor for class org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob
-
Construct a job.
- ControlledJob(Configuration) - Constructor for class org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob
-
Construct a job.
- convert(Throwable) - Static method in exception org.apache.hadoop.service.ServiceStateException
-
- convert(String, Throwable) - Static method in exception org.apache.hadoop.service.ServiceStateException
-
- ConverterUtils - Class in org.apache.hadoop.yarn.util
-
This class contains a set of utilities which help converting data structures
from/to 'serializableFormat' to/from hadoop/nativejava data structures.
- ConverterUtils() - Constructor for class org.apache.hadoop.yarn.util.ConverterUtils
-
- convertFromYarn(Token, InetSocketAddress) - Static method in class org.apache.hadoop.yarn.util.ConverterUtils
-
Convert a protobuf token into a rpc token and set its service.
- convertFromYarn(Token, Text) - Static method in class org.apache.hadoop.yarn.util.ConverterUtils
-
Convert a protobuf token into a rpc token and set its service.
- convertState(YarnApplicationState) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- convertUsername(String) - Static method in class org.apache.hadoop.registry.client.binding.RegistryUtils
-
Convert the username to that which can be used for registry
entries.
- copy(FileSystem, Path, FileSystem, Path, boolean, Configuration) - Static method in class org.apache.hadoop.fs.FileUtil
-
Copy files between FileSystems.
- copy(FileSystem, Path[], FileSystem, Path, boolean, boolean, Configuration) - Static method in class org.apache.hadoop.fs.FileUtil
-
- copy(FileSystem, Path, FileSystem, Path, boolean, boolean, Configuration) - Static method in class org.apache.hadoop.fs.FileUtil
-
Copy files between FileSystems.
- copy(FileSystem, FileStatus, FileSystem, Path, boolean, boolean, Configuration) - Static method in class org.apache.hadoop.fs.FileUtil
-
Copy a file/directory tree within/between filesystems.
- copy(File, FileSystem, Path, boolean, Configuration) - Static method in class org.apache.hadoop.fs.FileUtil
-
Copy local files to a FileSystem.
- copy(FileSystem, Path, File, boolean, Configuration) - Static method in class org.apache.hadoop.fs.FileUtil
-
Copy FileSystem files to local files.
- copy() - Method in class org.apache.hadoop.fs.statistics.MeanStatistic
-
Create a copy of this instance.
- copy(Writable) - Method in class org.apache.hadoop.io.AbstractMapWritable
-
Used by child copy constructors.
- copy(byte[], int, int) - Method in class org.apache.hadoop.record.Buffer
-
Deprecated.
Copy the specified byte array to the Buffer.
- copy(Configuration, T, T) - Static method in class org.apache.hadoop.util.ReflectionUtils
-
Make a copy of the writable object using serialization to a buffer.
- copy() - Method in class org.apache.hadoop.yarn.service.api.records.ConfigFile
-
- copyBytes() - Method in class org.apache.hadoop.io.BytesWritable
-
Get a copy of the bytes that is exactly the length of the data.
- copyBytes(InputStream, OutputStream, int, boolean) - Static method in class org.apache.hadoop.io.IOUtils
-
Copies from one stream to another.
- copyBytes(InputStream, OutputStream, int) - Static method in class org.apache.hadoop.io.IOUtils
-
Copies from one stream to another.
- copyBytes(InputStream, OutputStream, Configuration) - Static method in class org.apache.hadoop.io.IOUtils
-
Copies from one stream to another.
- copyBytes(InputStream, OutputStream, Configuration, boolean) - Static method in class org.apache.hadoop.io.IOUtils
-
Copies from one stream to another.
- copyBytes(InputStream, OutputStream, long, boolean) - Static method in class org.apache.hadoop.io.IOUtils
-
Copies count bytes from one stream to another.
- copyBytes() - Method in class org.apache.hadoop.io.Text
-
- copyFromLocalFile(boolean, Path, Path) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
- copyFromLocalFile(Path, Path) - Method in class org.apache.hadoop.fs.FileSystem
-
The src file is on the local disk.
- copyFromLocalFile(boolean, Path, Path) - Method in class org.apache.hadoop.fs.FileSystem
-
The src file is on the local disk.
- copyFromLocalFile(boolean, boolean, Path[], Path) - Method in class org.apache.hadoop.fs.FileSystem
-
The src files are on the local disk.
- copyFromLocalFile(boolean, boolean, Path, Path) - Method in class org.apache.hadoop.fs.FileSystem
-
The src file is on the local disk.
- copyFromLocalFile(boolean, Path, Path) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
The src file is on the local disk.
- copyFromLocalFile(boolean, boolean, Path[], Path) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
The src files are on the local disk.
- copyFromLocalFile(boolean, boolean, Path, Path) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
The src file is on the local disk.
- copyFromLocalFile(boolean, Path, Path) - Method in class org.apache.hadoop.fs.LocalFileSystem
-
- copyToken() - Method in class org.apache.hadoop.security.token.Token
-
- copyToLocalFile(boolean, Path, Path) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
The src file is under FS, and the dst is on the local disk.
- copyToLocalFile(Path, Path, boolean) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
The src file is under FS, and the dst is on the local disk.
- copyToLocalFile(Path, Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Copy it a file from the remote filesystem to the local one.
- copyToLocalFile(boolean, Path, Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Copy it a file from a remote filesystem to the local one.
- copyToLocalFile(boolean, Path, Path, boolean) - Method in class org.apache.hadoop.fs.FileSystem
-
The src file is under this filesystem, and the dst is on the local disk.
- copyToLocalFile(boolean, Path, Path) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
The src file is under FS, and the dst is on the local disk.
- copyToLocalFile(boolean, Path, Path) - Method in class org.apache.hadoop.fs.LocalFileSystem
-
- CORE_SITE_CONFIGURATION_FILE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- count - Variable in exception org.apache.hadoop.hdfs.protocol.QuotaExceededException
-
- countCounters() - Method in class org.apache.hadoop.mapreduce.counters.AbstractCounters
-
Returns the total number of counters, by summing the number of counters
in each group.
- Counter() - Constructor for class org.apache.hadoop.mapred.Counters.Counter
-
- Counter - Interface in org.apache.hadoop.mapreduce
-
A named counter that tracks the progress of a map/reduce job.
- counter(MetricsInfo, int) - Method in interface org.apache.hadoop.metrics2.MetricsVisitor
-
Callback for integer value counters
- counter(MetricsInfo, long) - Method in interface org.apache.hadoop.metrics2.MetricsVisitor
-
Callback for long value counters
- COUNTER_GROUP - Static variable in class org.apache.hadoop.mapred.SkipBadRecords
-
Special counters which are written by the application and are
used by the framework for detecting bad records.
- COUNTER_MAP_PROCESSED_RECORDS - Static variable in class org.apache.hadoop.mapred.SkipBadRecords
-
Number of processed map records.
- COUNTER_REDUCE_PROCESSED_GROUPS - Static variable in class org.apache.hadoop.mapred.SkipBadRecords
-
Number of processed reduce groups.
- CounterGroup - Interface in org.apache.hadoop.mapreduce
-
A group of
Counter
s that logically belong together.
- CounterGroupBase<T extends Counter> - Interface in org.apache.hadoop.mapreduce.counters
-
The common counter group interface.
- counters() - Method in interface org.apache.hadoop.fs.statistics.IOStatistics
-
Map of counters.
- counters() - Method in class org.apache.hadoop.fs.statistics.IOStatisticsSnapshot
-
- Counters - Class in org.apache.hadoop.mapred
-
A set of named counters.
- Counters() - Constructor for class org.apache.hadoop.mapred.Counters
-
- Counters(Counters) - Constructor for class org.apache.hadoop.mapred.Counters
-
- Counters - Class in org.apache.hadoop.mapreduce
-
Counters
holds per job/task counters, defined either by the
Map-Reduce framework or applications.
- Counters() - Constructor for class org.apache.hadoop.mapreduce.Counters
-
Default constructor
- Counters(AbstractCounters<C, G>) - Constructor for class org.apache.hadoop.mapreduce.Counters
-
Construct the Counters object from the another counters object
- Counters.Counter - Class in org.apache.hadoop.mapred
-
A counter record, comprising its name and value.
- Counters.Group - Class in org.apache.hadoop.mapred
-
Group
of counters, comprising of counters from a particular
counter
Enum
class.
- CountingBloomFilter - Class in org.apache.hadoop.util.bloom
-
Implements a counting Bloom filter, as defined by Fan et al.
- CountingBloomFilter() - Constructor for class org.apache.hadoop.util.bloom.CountingBloomFilter
-
Default constructor - use with readFields
- CountingBloomFilter(int, int, int) - Constructor for class org.apache.hadoop.util.bloom.CountingBloomFilter
-
Constructor
- CPK_IN_NON_HNS_ACCOUNT_ERROR_MESSAGE - Static variable in class org.apache.hadoop.fs.azurebfs.constants.AbfsHttpConstants
-
Exception message on filesystem init if customer-provided-keys configs are provided
for a non-hierarchical-namespace account: "Non hierarchical-namespace account can not have configs enabled for Customer Provided Keys. Following configs can not be given with non-hierarchical-namespace account:fs.azure.encryption.context.provider.type, fs.azure.encryption.encoded.client-provided-key, fs.azure.encryption.encoded.client-provided-key-sha"
- cpus(Integer) - Method in class org.apache.hadoop.yarn.service.api.records.Resource
-
Amount of vcores allocated to each container (optional but overrides cpus
in profile if specified).
- create(Path, EnumSet<CreateFlag>, Options.CreateOpts...) - Method in class org.apache.hadoop.fs.AbstractFileSystem
-
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.adl.AdlFileSystem
-
Create call semantic is handled differently in case of ADL.
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
- create(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable, Options.ChecksumOpt) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
- create(Path, EnumSet<CreateFlag>, Options.CreateOpts...) - Method in class org.apache.hadoop.fs.FileContext
-
Create or overwrite file on indicated path and returns an output stream for
writing into the file.
- create(Path) - Method in class org.apache.hadoop.fs.FileContext
-
- create(FileSystem, Path, FsPermission) - Static method in class org.apache.hadoop.fs.FileSystem
-
Create a file with the provided permission.
- create(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path.
- create(Path, boolean) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path.
- create(Path, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
- create(Path, short) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path.
- create(Path, short, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
- create(Path, boolean, int) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path.
- create(Path, boolean, int, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
- create(Path, boolean, int, short, long) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path.
- create(Path, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
- create(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path with write-progress
reporting.
- create(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable, Options.ChecksumOpt) - Method in class org.apache.hadoop.fs.FileSystem
-
Create an FSDataOutputStream at the indicated Path with a custom
checksum option.
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- create(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable, Options.ChecksumOpt) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- create() - Method in class org.apache.hadoop.fs.FSDataOutputStreamBuilder
-
Create an FSDataOutputStream at the specified path.
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.ftp.FTPFileSystem
-
A stream obtained via this call must be closed before using other APIs of
this class or else the invocation will block.
- create() - Method in class org.apache.hadoop.fs.impl.MultipartUploaderBuilderImpl
-
Create an FSDataOutputStream at the specified path.
- create(FsPermission, FsPermission) - Static method in class org.apache.hadoop.fs.permission.FsCreateModes
-
Create from masked and unmasked modes.
- create(Path, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.s3native.NativeS3FileSystem
-
Deprecated.
- create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.viewfs.ViewFileSystem
-
- CREATE - Static variable in interface org.apache.hadoop.registry.client.api.BindFlags
-
Create the entry..
- CREATE_DIR - Static variable in class org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob
-
- CREATE_SUCCESSFUL_JOB_OUTPUT_DIR_MARKER - Static variable in class org.apache.hadoop.fs.s3a.commit.CommitConstants
-
Flag to trigger creation of a marker file on job completion.
- createAHSClient() - Static method in class org.apache.hadoop.yarn.client.api.AHSClient
-
Create a new instance of AHSClient.
- createAHSProxy(Configuration, Class<T>, InetSocketAddress) - Static method in class org.apache.hadoop.yarn.client.AHSProxy
-
- createAHSv2Client() - Static method in class org.apache.hadoop.yarn.client.api.AHSClient
-
- createAllSymlink(Configuration, File, File) - Static method in class org.apache.hadoop.filecache.DistributedCache
-
- createAMProxy(String, ApplicationReport) - Method in class org.apache.hadoop.yarn.service.client.ServiceClient
-
- createAMRMClient() - Static method in class org.apache.hadoop.yarn.client.api.AMRMClient
-
Create a new instance of AMRMClient.
- createAMRMClientAsync(int, AMRMClientAsync.AbstractCallbackHandler) - Static method in class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
Create a new instance of AMRMClientAsync.
- createAMRMClientAsync(AMRMClient<T>, int, AMRMClientAsync.AbstractCallbackHandler) - Static method in class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
Create a new instance of AMRMClientAsync.
- createAMRMClientAsync(int, AMRMClientAsync.CallbackHandler) - Static method in class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
- createAMRMClientAsync(AMRMClient<T>, int, AMRMClientAsync.CallbackHandler) - Static method in class org.apache.hadoop.yarn.client.api.async.AMRMClientAsync
-
- createAndSubmitJob() - Method in class org.apache.hadoop.tools.DistCp
-
Create and submit the mapreduce job.
- createAppAdminClient(String, Configuration) - Static method in class org.apache.hadoop.yarn.client.api.AppAdminClient
-
Create a new instance of AppAdminClient.
- createAppDir(String, ApplicationId, UserGroupInformation) - Method in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
Create remote Application directory for log aggregation.
- createApplication() - Method in class org.apache.hadoop.yarn.client.api.YarnClient
-
- createBulkDelete(Path) - Method in interface org.apache.hadoop.fs.BulkDeleteSource
-
Create a bulk delete operation.
- createBulkDelete(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Create a bulk delete operation.
- createCheckpoint() - Method in class org.apache.hadoop.fs.TrashPolicy
-
Create a trash checkpoint.
- createCommitter(Path, TaskAttemptContext) - Static method in class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory
-
Create the committer factory for a task attempt and destination, then
create the committer from it.
- createCompressor() - Method in class org.apache.hadoop.io.compress.BZip2Codec
-
- createCompressor() - Method in interface org.apache.hadoop.io.compress.CompressionCodec
-
- createCompressor() - Method in class org.apache.hadoop.io.compress.DefaultCodec
-
- createCompressor() - Method in class org.apache.hadoop.io.compress.GzipCodec
-
- createCompressor() - Method in class org.apache.hadoop.io.compress.PassthroughCodec
-
- createConnection() - Method in class org.apache.hadoop.mapreduce.lib.db.DBInputFormat
-
- createCredentialEntry(String, char[]) - Method in class org.apache.hadoop.security.alias.CredentialProvider
-
Create a new credential.
- createCredentials(Configuration) - Method in class org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
-
The credentials here must include a session token, else this operation
will raise an exception.
- createDataOutputStreamBuilder(FileSystem, Path) - Static method in class org.apache.hadoop.fs.FileSystem
-
Create instance of the standard FSDataOutputStreamBuilder for the
given filesystem and path.
- createDBRecordReader(DBInputFormat.DBInputSplit, Configuration) - Method in class org.apache.hadoop.mapreduce.lib.db.DataDrivenDBInputFormat
-
- createDBRecordReader(DBInputFormat.DBInputSplit, Configuration) - Method in class org.apache.hadoop.mapreduce.lib.db.DBInputFormat
-
- createDBRecordReader(DBInputFormat.DBInputSplit, Configuration) - Method in class org.apache.hadoop.mapreduce.lib.db.OracleDataDrivenDBInputFormat
-
- createDecompressor() - Method in class org.apache.hadoop.io.compress.BZip2Codec
-
- createDecompressor() - Method in interface org.apache.hadoop.io.compress.CompressionCodec
-
- createDecompressor() - Method in class org.apache.hadoop.io.compress.DefaultCodec
-
- createDecompressor() - Method in class org.apache.hadoop.io.compress.GzipCodec
-
- createDecompressor() - Method in class org.apache.hadoop.io.compress.PassthroughCodec
-
- createDir(FileSystem, Path, FsPermission) - Method in class org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController
-
- createDirectDecompressor() - Method in class org.apache.hadoop.io.compress.DefaultCodec
-
- createDirectDecompressor() - Method in interface org.apache.hadoop.io.compress.DirectDecompressionCodec
-
- createDirectDecompressor() - Method in class org.apache.hadoop.io.compress.GzipCodec
-
- createDirectory(Path, FsPermission, FsPermission, TracingContext) - Method in class org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore
-
- createEncryptionZone(Path, String) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Deprecated.
- createEncryptionZone(Path, String, EnumSet<CreateEncryptionZoneFlag>) - Method in class org.apache.hadoop.hdfs.client.HdfsAdmin
-
Create an encryption zone rooted at an empty existing directory, using the
specified encryption key.
- CreateEncryptionZoneFlag - Enum in org.apache.hadoop.hdfs.client
-
- createFile(Path, FileSystem.Statistics, boolean, FsPermission, FsPermission, TracingContext) - Method in class org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore
-
- createFile(Path) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
This is overridden to ensure that this class's create() method is
ultimately called.
- createFile(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Create a new FSDataOutputStreamBuilder for the file with path.
- createFile(Path) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- createFileOutputCommitter(Path, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory
-
- createFileSplit(Path, long, long) - Static method in class org.apache.hadoop.mapred.lib.NLineInputFormat
-
NLineInputFormat uses LineRecordReader, which always reads
(and consumes) at least one character out of its upper split
boundary.
- createFileSplit(Path, long, long) - Static method in class org.apache.hadoop.mapreduce.lib.input.NLineInputFormat
-
NLineInputFormat uses LineRecordReader, which always reads
(and consumes) at least one character out of its upper split
boundary.
- createFileSystem(URI, Configuration) - Static method in class org.apache.hadoop.fs.AbstractFileSystem
-
Create a file system instance for the specified uri using the conf.
- createFilesystem(TracingContext) - Method in class org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore
-
- CreateFlag - Enum in org.apache.hadoop.fs
-
CreateFlag specifies the file create semantic.
- createHistoryFileInfo(Path, Path, Path, JobIndexInfo, boolean) - Method in class org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager
-
- createIdentifier() - Method in class org.apache.hadoop.security.token.SecretManager
-
Create an empty token identifier.
- createImmutable(short) - Static method in class org.apache.hadoop.fs.permission.FsPermission
-
- createInputFileListing(Job) - Method in class org.apache.hadoop.tools.DistCp
-
Create input listing by invoking an appropriate copy listing
implementation.
- createInputStream(InputStream) - Method in class org.apache.hadoop.io.compress.BZip2Codec
-
Create a
CompressionInputStream
that will read from the given
input stream and return a stream for uncompressed data.
- createInputStream(InputStream, Decompressor) - Method in class org.apache.hadoop.io.compress.BZip2Codec
-
- createInputStream(InputStream, Decompressor, long, long, SplittableCompressionCodec.READ_MODE) - Method in class org.apache.hadoop.io.compress.BZip2Codec
-
Creates CompressionInputStream to be used to read off uncompressed data
in one of the two reading modes.
- createInputStream(InputStream) - Method in interface org.apache.hadoop.io.compress.CompressionCodec
-
- createInputStream(InputStream, Decompressor) - Method in interface org.apache.hadoop.io.compress.CompressionCodec
-
- createInputStream(InputStream) - Method in class org.apache.hadoop.io.compress.DefaultCodec
-
- createInputStream(InputStream, Decompressor) - Method in class org.apache.hadoop.io.compress.DefaultCodec
-
- createInputStream(InputStream) - Method in class org.apache.hadoop.io.compress.GzipCodec
-
- createInputStream(InputStream, Decompressor) - Method in class org.apache.hadoop.io.compress.GzipCodec
-
- createInputStream(InputStream) - Method in class org.apache.hadoop.io.compress.PassthroughCodec
-
- createInputStream(InputStream, Decompressor) - Method in class org.apache.hadoop.io.compress.PassthroughCodec
-
- createInputStream(InputStream, Decompressor, long, long, SplittableCompressionCodec.READ_MODE) - Method in interface org.apache.hadoop.io.compress.SplittableCompressionCodec
-
Create a stream as dictated by the readMode.
- createInstance(String) - Static method in class org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor
-
Create an instance of the given class
- createInstance(String) - Static method in class org.apache.hadoop.mapreduce.lib.aggregate.UserDefinedValueAggregatorDescriptor
-
Create an instance of the given class
- createInternal(Path, EnumSet<CreateFlag>, FsPermission, int, short, long, Progressable, Options.ChecksumOpt, boolean) - Method in class org.apache.hadoop.fs.AbstractFileSystem
-
- createInternal(Path, FsPermission, boolean, SelfRenewingLease) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
This is the version of the create call that is meant for internal usage.
- createInternal(Path, EnumSet<CreateFlag>, FsPermission, int, short, long, Progressable, Options.ChecksumOpt, boolean) - Method in class org.apache.hadoop.fs.viewfs.ViewFs
-
- createInternalValue() - Method in class org.apache.hadoop.mapred.join.CompositeRecordReader
-
Create a value to be used internally for joins.
- createIOException(List<IOException>) - Static method in exception org.apache.hadoop.io.MultipleIOException
-
- createJarWithClassPath(String, Path, Map<String, String>) - Static method in class org.apache.hadoop.fs.FileUtil
-
- createJarWithClassPath(String, Path, Path, Map<String, String>) - Static method in class org.apache.hadoop.fs.FileUtil
-
Create a jar file at the given path, containing a manifest with a classpath
that references all specified entries.
- createJobListCache() - Method in class org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager
-
- createKey(String, byte[], KeyProvider.Options) - Method in class org.apache.hadoop.crypto.key.KeyProvider
-
Create a new key.
- createKey(String, KeyProvider.Options) - Method in class org.apache.hadoop.crypto.key.KeyProvider
-
Create a new key generating the material for it.
- createKey() - Method in class org.apache.hadoop.mapred.join.CompositeRecordReader
-
Create a new key value common to all child RRs.
- createKey() - Method in class org.apache.hadoop.mapred.join.WrappedRecordReader
-
Request new key from proxied RR.
- createKey() - Method in class org.apache.hadoop.mapred.KeyValueLineRecordReader
-
- createKey() - Method in class org.apache.hadoop.mapred.lib.CombineFileRecordReader
-
- createKey() - Method in class org.apache.hadoop.mapred.lib.CombineFileRecordReaderWrapper
-
- createKey() - Method in interface org.apache.hadoop.mapred.RecordReader
-
Create an object of the appropriate type to be used as a key.
- createKey() - Method in class org.apache.hadoop.mapred.SequenceFileAsTextRecordReader
-
- createKey() - Method in class org.apache.hadoop.mapred.SequenceFileRecordReader
-
- createKey() - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
Create a new key common to all child RRs.
- createKey() - Method in class org.apache.hadoop.mapreduce.lib.join.WrappedRecordReader
-
Request new key from proxied RR.
- createLocalTempFile(File, String, boolean) - Static method in class org.apache.hadoop.fs.FileUtil
-
Create a tmp file for a base file.
- createManifestStoreOperations() - Method in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitter
-
Create manifest store operations for the destination store.
- createMoveToDoneThreadPool(int) - Method in class org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager
-
- createMultipartUploader(Path) - Method in class org.apache.hadoop.fs.AbstractFileSystem
-
Create a multipart uploader.
- createMultipartUploader(Path) - Method in class org.apache.hadoop.fs.FileContext
-
Create a multipart uploader.
- createMultipartUploader(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Create a multipart uploader.
- createNewFile(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Creates the given Path as a brand-new zero-length file.
- createNMClient() - Static method in class org.apache.hadoop.yarn.client.api.NMClient
-
Create a new instance of NMClient.
- createNMClient(String) - Static method in class org.apache.hadoop.yarn.client.api.NMClient
-
Create a new instance of NMClient.
- createNMClientAsync(NMClientAsync.AbstractCallbackHandler) - Static method in class org.apache.hadoop.yarn.client.api.async.NMClientAsync
-
- createNMClientAsync(NMClientAsync.CallbackHandler) - Static method in class org.apache.hadoop.yarn.client.api.async.NMClientAsync
-
- createNMProxy(Configuration, Class<T>, UserGroupInformation, YarnRPC, InetSocketAddress) - Static method in class org.apache.hadoop.yarn.client.NMProxy
-
- createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.adl.AdlFileSystem
-
- createNonRecursive(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
- createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
- createNonRecursive(Path, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem
-
- createNonRecursive(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
- createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.ChecksumFileSystem
-
- createNonRecursive(Path, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
- createNonRecursive(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
- createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.FileSystem
-
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
- createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- createNonRecursive(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.viewfs.ViewFileSystem
-
- createOutputCommitter(Path, TaskAttemptContext) - Method in class org.apache.hadoop.fs.azurebfs.commit.AzureManifestCommitterFactory
-
- createOutputCommitter(Path, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterFactory
-
- createOutputCommitter(Path, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory
-
Create an output committer for a task attempt.
- createOutputStream(Path, boolean) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- createOutputStream(OutputStream) - Method in class org.apache.hadoop.io.compress.BZip2Codec
-
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.hadoop.io.compress.BZip2Codec
-
- createOutputStream(OutputStream) - Method in interface org.apache.hadoop.io.compress.CompressionCodec
-
- createOutputStream(OutputStream, Compressor) - Method in interface org.apache.hadoop.io.compress.CompressionCodec
-
- createOutputStream(OutputStream) - Method in class org.apache.hadoop.io.compress.DefaultCodec
-
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.hadoop.io.compress.DefaultCodec
-
- createOutputStream(OutputStream) - Method in class org.apache.hadoop.io.compress.GzipCodec
-
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.hadoop.io.compress.GzipCodec
-
- createOutputStream(OutputStream) - Method in class org.apache.hadoop.io.compress.PassthroughCodec
-
- createOutputStream(OutputStream, Compressor) - Method in class org.apache.hadoop.io.compress.PassthroughCodec
-
- createOutputStreamWithMode(Path, boolean, FsPermission) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- createPassword(TokenIdent) - Method in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
- createPassword(T) - Method in class org.apache.hadoop.security.token.SecretManager
-
Create the password for the given identifier.
- createPassword(byte[], SecretKey) - Static method in class org.apache.hadoop.security.token.SecretManager
-
Compute HMAC of the identifier using the secret key and return the
output as password
- createPathHandle(FileStatus, Options.HandleOpt...) - Method in class org.apache.hadoop.fs.FileSystem
-
Hook to implement support for
PathHandle
operations.
- createPathHandle(FileStatus, Options.HandleOpt...) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- createPathHandle(FileStatus, Options.HandleOpt...) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
Hook to implement support for
PathHandle
operations.
- createPool(JobConf, List<PathFilter>) - Method in class org.apache.hadoop.mapred.lib.CombineFileInputFormat
-
- createPool(JobConf, PathFilter...) - Method in class org.apache.hadoop.mapred.lib.CombineFileInputFormat
-
- createPool(List<PathFilter>) - Method in class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat
-
Create a new pool and add the filters to it.
- createPool(PathFilter...) - Method in class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat
-
Create a new pool and add the filters to it.
- createProvider(URI, Configuration) - Method in class org.apache.hadoop.crypto.key.KeyProviderFactory
-
- createProvider(URI, Configuration) - Method in class org.apache.hadoop.security.alias.CredentialProviderFactory
-
- createProxyUser(String, UserGroupInformation) - Static method in class org.apache.hadoop.security.UserGroupInformation
-
Create a proxy user using username of the effective user and the ugi of the
real user.
- createProxyUserForTesting(String, UserGroupInformation, String[]) - Static method in class org.apache.hadoop.security.UserGroupInformation
-
Create a proxy user UGI for testing HDFS and MapReduce
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapred.lib.CombineFileInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.InputFormat
-
Create a record reader for a given split.
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.db.DBInputFormat
-
Create a record reader for a given split.
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat
-
This is not implemented yet.
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.CombineSequenceFileInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.CombineTextInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.FixedLengthInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.KeyValueTextInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.NLineInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.SequenceFileAsBinaryInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.SequenceFileAsTextInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFilter
-
Create a record reader for the given split
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.input.TextInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.join.ComposableInputFormat
-
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeInputFormat
-
Construct a CompositeRecordReader for the children of this InputFormat
as defined in the init expression.
- createRemoteUser(String) - Static method in class org.apache.hadoop.security.UserGroupInformation
-
Create a user from a login name.
- createRemoteUser(String, SaslRpcServer.AuthMethod) - Static method in class org.apache.hadoop.security.UserGroupInformation
-
Create a user from a login name.
- createReservation() - Method in class org.apache.hadoop.yarn.client.api.YarnClient
-
- createRetriableProxy(Configuration, Class<T>, UserGroupInformation, YarnRPC, InetSocketAddress, RetryPolicy) - Static method in class org.apache.hadoop.yarn.client.ServerProxy
-
- createRetryPolicy(Configuration, long, long, boolean) - Static method in class org.apache.hadoop.yarn.client.RMProxy
-
Fetch retry policy from Configuration and create the
retry policy with specified retryTime and retry interval.
- createRetryPolicy(Configuration, String, long, String, long) - Static method in class org.apache.hadoop.yarn.client.ServerProxy
-
- createRMProxy(Configuration, Class<T>) - Static method in class org.apache.hadoop.yarn.client.ClientRMProxy
-
Create a proxy to the ResourceManager for the specified protocol.
- createRMProxyFederation(Configuration, Class<T>) - Static method in class org.apache.hadoop.yarn.client.ClientRMProxy
-
Create a proxy to the ResourceManager for the specified protocol.
- createRMProxyFederation(Configuration, Class<T>, RMProxy<T>) - Static method in class org.apache.hadoop.yarn.client.RMProxy
-
This functionality is only used for NodeManager and only in non-HA mode.
- createSecretKey(byte[]) - Static method in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Convert the byte[] to a secret key
- createSecretKey(byte[]) - Static method in class org.apache.hadoop.security.token.SecretManager
-
Convert the byte[] to a secret key
- createSerializer() - Method in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.files.ManifestSuccessData
-
- createSharedCacheClient() - Static method in class org.apache.hadoop.yarn.client.api.SharedCacheClient
-
- createSnapshot(Path, String) - Method in class org.apache.hadoop.fs.AbstractFileSystem
-
- createSnapshot(Path) - Method in class org.apache.hadoop.fs.FileContext
-
Create a snapshot with a default name.
- createSnapshot(Path, String) - Method in class org.apache.hadoop.fs.FileContext
-
Create a snapshot.
- createSnapshot(Path) - Method in class org.apache.hadoop.fs.FileSystem
-
Create a snapshot with a default name.
- createSnapshot(Path, String) - Method in class org.apache.hadoop.fs.FileSystem
-
Create a snapshot.
- createSnapshot(Path, String) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- createSnapshot(Path, String) - Method in class org.apache.hadoop.fs.viewfs.ViewFileSystem
-
- createSnapshot(Path, String) - Method in class org.apache.hadoop.fs.viewfs.ViewFs
-
- createSocket() - Method in class org.apache.hadoop.net.SocksSocketFactory
-
- createSocket(InetAddress, int) - Method in class org.apache.hadoop.net.SocksSocketFactory
-
- createSocket(InetAddress, int, InetAddress, int) - Method in class org.apache.hadoop.net.SocksSocketFactory
-
- createSocket(String, int) - Method in class org.apache.hadoop.net.SocksSocketFactory
-
- createSocket(String, int, InetAddress, int) - Method in class org.apache.hadoop.net.SocksSocketFactory
-
- createSocket() - Method in class org.apache.hadoop.net.StandardSocketFactory
-
- createSocket(InetAddress, int) - Method in class org.apache.hadoop.net.StandardSocketFactory
-
- createSocket(InetAddress, int, InetAddress, int) - Method in class org.apache.hadoop.net.StandardSocketFactory
-
- createSocket(String, int) - Method in class org.apache.hadoop.net.StandardSocketFactory
-
- createSocket(String, int, InetAddress, int) - Method in class org.apache.hadoop.net.StandardSocketFactory
-
- createSymlink(Path, Path, boolean) - Method in class org.apache.hadoop.fs.AbstractFileSystem
-
- createSymlink(Path, Path, boolean) - Method in class org.apache.hadoop.fs.FileContext
-
Creates a symbolic link to an existing file.
- createSymlink(Path, Path, boolean) - Method in class org.apache.hadoop.fs.FileSystem
-
- createSymlink(Path, Path, boolean) - Method in class org.apache.hadoop.fs.FilterFileSystem
-
- createSymlink(Path, Path, boolean) - Method in class org.apache.hadoop.fs.LocalFileSystem
-
- createSymlink(Path, Path, boolean) - Method in class org.apache.hadoop.fs.RawLocalFileSystem
-
- createSymlink(Path, Path, boolean) - Method in class org.apache.hadoop.fs.viewfs.ViewFs
-
- createSymlink() - Method in class org.apache.hadoop.mapreduce.Job
-
Deprecated.
- createTimelineAbout(String) - Static method in class org.apache.hadoop.yarn.util.timeline.TimelineUtils
-
- createTimelineClient() - Static method in class org.apache.hadoop.yarn.client.api.TimelineClient
-
Creates an instance of the timeline v.1.x client.
- createTimelineReaderClient() - Static method in class org.apache.hadoop.yarn.client.api.TimelineReaderClient
-
Create a new instance of Timeline Reader Client.
- createTupleWritable() - Method in class org.apache.hadoop.mapreduce.lib.join.CompositeRecordReader
-
Create a value to be used internally for joins.
- createUserForTesting(String, String[]) - Static method in class org.apache.hadoop.security.UserGroupInformation
-
Create a UGI for testing HDFS and MapReduce
- createValue() - Method in class org.apache.hadoop.mapred.join.JoinRecordReader
-
Create an object of the appropriate type to be used as a value.
- createValue() - Method in class org.apache.hadoop.mapred.join.MultiFilterRecordReader
-
Create an object of the appropriate type to be used as a value.
- createValue() - Method in class org.apache.hadoop.mapred.join.WrappedRecordReader
-
Request new value from proxied RR.
- createValue() - Method in class org.apache.hadoop.mapred.KeyValueLineRecordReader
-
- createValue() - Method in class org.apache.hadoop.mapred.lib.CombineFileRecordReader
-
- createValue() - Method in class org.apache.hadoop.mapred.lib.CombineFileRecordReaderWrapper
-
- createValue() - Method in interface org.apache.hadoop.mapred.RecordReader
-
Create an object of the appropriate type to be used as a value.
- createValue() - Method in class org.apache.hadoop.mapred.SequenceFileAsTextRecordReader
-
- createValue() - Method in class org.apache.hadoop.mapred.SequenceFileRecordReader
-
- createValue() - Method in class org.apache.hadoop.mapreduce.lib.db.DBRecordReader
-
Deprecated.
- createValue() - Method in class org.apache.hadoop.mapreduce.lib.join.JoinRecordReader
-
- createValue() - Method in class org.apache.hadoop.mapreduce.lib.join.OverrideRecordReader
-
- createValue() - Method in class org.apache.hadoop.mapreduce.lib.join.WrappedRecordReader
-
- createValueAggregatorJob(String[], Class<?>) - Static method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJob
-
Create an Aggregate based map/reduce job.
- createValueAggregatorJob(String[]) - Static method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJob
-
Create an Aggregate based map/reduce job.
- createValueAggregatorJob(String[], Class<? extends ValueAggregatorDescriptor>[]) - Static method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJob
-
- createValueAggregatorJob(String[], Class<? extends ValueAggregatorDescriptor>[], Class<?>) - Static method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJob
-
- createValueAggregatorJob(Configuration, String[]) - Static method in class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorJob
-
Create an Aggregate based map/reduce job.
- createValueAggregatorJob(String[], Class<? extends ValueAggregatorDescriptor>[]) - Static method in class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorJob
-
- createValueAggregatorJobs(String[], Class<? extends ValueAggregatorDescriptor>[]) - Static method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJob
-
- createValueAggregatorJobs(String[]) - Static method in class org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJob
-
- createValueAggregatorJobs(String[], Class<? extends ValueAggregatorDescriptor>[]) - Static method in class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorJob
-
- createValueAggregatorJobs(String[]) - Static method in class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorJob
-
- createWriter(Configuration, SequenceFile.Writer.Option...) - Static method in class org.apache.hadoop.io.SequenceFile
-
Create a new Writer with the given options.
- createWriter(FileSystem, Configuration, Path, Class, Class) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createWriter(FileSystem, Configuration, Path, Class, Class, SequenceFile.CompressionType) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createWriter(FileSystem, Configuration, Path, Class, Class, SequenceFile.CompressionType, Progressable) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createWriter(FileSystem, Configuration, Path, Class, Class, SequenceFile.CompressionType, CompressionCodec) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createWriter(FileSystem, Configuration, Path, Class, Class, SequenceFile.CompressionType, CompressionCodec, Progressable, SequenceFile.Metadata) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createWriter(FileSystem, Configuration, Path, Class, Class, int, short, long, SequenceFile.CompressionType, CompressionCodec, Progressable, SequenceFile.Metadata) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createWriter(FileSystem, Configuration, Path, Class, Class, int, short, long, boolean, SequenceFile.CompressionType, CompressionCodec, SequenceFile.Metadata) - Static method in class org.apache.hadoop.io.SequenceFile
-
Deprecated.
- createWriter(FileContext, Configuration, Path, Class, Class, SequenceFile.CompressionType, CompressionCodec, SequenceFile.Metadata, EnumSet<CreateFlag>, Options.CreateOpts...) - Static method in class org.apache.hadoop.io.SequenceFile
-
Construct the preferred type of SequenceFile Writer.
- createWriter(FileSystem, Configuration, Path, Class, Class, SequenceFile.CompressionType, CompressionCodec, Progressable) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createWriter(Configuration, FSDataOutputStream, Class, Class, SequenceFile.CompressionType, CompressionCodec, SequenceFile.Metadata) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createWriter(Configuration, FSDataOutputStream, Class, Class, SequenceFile.CompressionType, CompressionCodec) - Static method in class org.apache.hadoop.io.SequenceFile
-
- createYarnClient() - Static method in class org.apache.hadoop.yarn.client.api.YarnClient
-
Create a new instance of YarnClient.
- createYarnClient() - Method in class org.apache.hadoop.yarn.client.cli.LogsCLI
-
- CREDENTIAL_PROVIDER_PATH - Static variable in class org.apache.hadoop.security.alias.CredentialProviderFactory
-
- CredentialBasedAccessTokenProvider - Class in org.apache.hadoop.hdfs.web.oauth2
-
Obtain an access token via the credential-based OAuth2 workflow.
- CredentialInitializationException - Exception in org.apache.hadoop.fs.s3a
-
Exception which Hadoop's AWSCredentialsProvider implementations should
throw when there is a problem with the credential setup.
- CredentialInitializationException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.s3a.CredentialInitializationException
-
- CredentialInitializationException(String) - Constructor for exception org.apache.hadoop.fs.s3a.CredentialInitializationException
-
- CredentialProvider - Class in org.apache.hadoop.security.alias
-
A provider of credentials or password for Hadoop applications.
- CredentialProvider() - Constructor for class org.apache.hadoop.security.alias.CredentialProvider
-
- CredentialProviderFactory - Class in org.apache.hadoop.security.alias
-
A factory to create a list of CredentialProvider based on the path given in a
Configuration.
- CredentialProviderFactory() - Constructor for class org.apache.hadoop.security.alias.CredentialProviderFactory
-
- Credentials - Class in org.apache.hadoop.security
-
A class that provides the facilities of reading and writing
secret keys and Tokens.
- Credentials() - Constructor for class org.apache.hadoop.security.Credentials
-
Create an empty credentials instance.
- Credentials(Credentials) - Constructor for class org.apache.hadoop.security.Credentials
-
Create a copy of the given credentials.
- CS_CONFIGURATION_FILE - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- csi.v0 - package csi.v0
-
- CSV_HEADER_OPT_IGNORE - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Ignore the header.
- CSV_HEADER_OPT_NONE - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
No header: first row is data.
- CSV_HEADER_OPT_USE - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Use the header.
- CSV_INPUT_COMMENT_MARKER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
String which indicates the row is actually a comment.
- CSV_INPUT_COMMENT_MARKER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default marker.
- CSV_INPUT_FIELD_DELIMITER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default field delimiter.
- CSV_INPUT_HEADER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
How should headers be used?
Value: "fs.s3a.select.input.csv.header".
- CSV_INPUT_HEADER_OPT_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default header mode: "ignore".
- CSV_INPUT_INPUT_FIELD_DELIMITER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Field delimiter.
- CSV_INPUT_QUOTE_CHARACTER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Quote Character.
- CSV_INPUT_QUOTE_CHARACTER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default Quote Character.
- CSV_INPUT_QUOTE_ESCAPE_CHARACTER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Character to escape quotes.
- CSV_INPUT_QUOTE_ESCAPE_CHARACTER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default quote escape character.
- CSV_INPUT_RECORD_DELIMITER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Record delimiter.
- CSV_INPUT_RECORD_DELIMITER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default delimiter
Value: "\n".
- CSV_OUTPUT_FIELD_DELIMITER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Field delimiter.
- CSV_OUTPUT_FIELD_DELIMITER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default field delimiter.
- CSV_OUTPUT_QUOTE_CHARACTER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Quote Character.
- CSV_OUTPUT_QUOTE_CHARACTER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default Quote Character.
- CSV_OUTPUT_QUOTE_ESCAPE_CHARACTER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Character to escape quotes.
- CSV_OUTPUT_QUOTE_ESCAPE_CHARACTER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default quote escape character.
- CSV_OUTPUT_QUOTE_FIELDS - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Should CSV fields be quoted?
One of : ALWAYS, ASNEEDED
Value: "fs.s3a.select.output.csv.quote.fields".
- CSV_OUTPUT_QUOTE_FIELDS_ALWAYS - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Output quotation policy (default): "always".
- CSV_OUTPUT_QUOTE_FIELDS_AS_NEEEDED - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Output quotation policy: "asneeded".
- CSV_OUTPUT_RECORD_DELIMITER - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Record delimiter.
- CSV_OUTPUT_RECORD_DELIMITER_DEFAULT - Static variable in class org.apache.hadoop.fs.s3a.select.SelectConstants
-
Deprecated.
Default delimiter
Value: "\n".
- CsvRecordOutput - Class in org.apache.hadoop.record
-
- CsvRecordOutput(OutputStream) - Constructor for class org.apache.hadoop.record.CsvRecordOutput
-
Deprecated.
Creates a new instance of CsvRecordOutput
- CUR_DIR - Static variable in class org.apache.hadoop.fs.Path
-
The current directory, ".".
- CURATOR_LEADER_ELECTOR - Static variable in class org.apache.hadoop.yarn.conf.YarnConfiguration
-
- curReader - Variable in class org.apache.hadoop.mapred.lib.CombineFileRecordReader
-
- curReader - Variable in class org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader
-
- currentAuditContext() - Static method in class org.apache.hadoop.fs.audit.CommonAuditContext
-
Get the current common audit context.
- currentConfig() - Method in interface org.apache.hadoop.metrics2.MetricsSystemMXBean
-
- currentDownloadBytesPerSecond(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation
-
Record the current bytes-per-second download rate seen.
- currentId - Variable in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Access to currentId is protected by this object lock.
- currentThreadID() - Static method in class org.apache.hadoop.fs.audit.CommonAuditContext
-
A thread ID which is unique for this process and shared across all
S3A clients on the same thread, even those using different FS instances.
- currentTokens - Variable in class org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager
-
Cache of currently valid tokens, mapping from DelegationTokenIdentifier
to DelegationTokenInformation.
- currentUploadBytesPerSecond(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation
-
Record the current bytes-per-second upload rate seen.
- currentUser() - Static method in class org.apache.hadoop.registry.client.binding.RegistryUtils
-
Get the current user path formatted for the registry
- CUSTOM_HEADER_PARAM - Static variable in class org.apache.hadoop.security.http.RestCsrfPreventionFilter
-
- CUSTOM_HEADER_PARAM - Static variable in class org.apache.hadoop.security.http.XFrameOptionsFilter
-
- CUSTOM_METHODS_TO_IGNORE_PARAM - Static variable in class org.apache.hadoop.security.http.RestCsrfPreventionFilter
-
- CUSTOM_SIGNERS - Static variable in class org.apache.hadoop.fs.s3a.Constants
-
List of custom Signers.
- CYPHER_GROUP - Static variable in class org.apache.hadoop.fs.s3a.audit.S3LogParser
-
Log group "cypher".