Package | Description |
---|---|
org.apache.hadoop.fs |
Implementations of
AbstractFileSystem for hdfs
over rpc and hdfs over web. |
org.apache.hadoop.fs.viewfs |
ViewFileSystem and ViewFileSystemOverloadScheme classes.
|
org.apache.hadoop.mapred | |
org.apache.hadoop.mapred.lib | |
org.apache.hadoop.mapreduce.lib.input | |
org.apache.hadoop.mapreduce.v2.hs |
Modifier and Type | Class and Description |
---|---|
class |
GlobFilter
A filter for POSIX glob pattern with brace expansions.
|
Modifier and Type | Method and Description |
---|---|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of
FileStatus objects whose path names match
pathPattern and is accepted by the user-supplied path filter. |
protected org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f,
PathFilter filter)
List a directory.
|
protected org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
FilterFileSystem.listLocatedStatus(Path f,
PathFilter filter) |
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
Constructor and Description |
---|
GlobFilter(String filePattern,
PathFilter filter)
Creates a glob filter with the specified file pattern and an user filter.
|
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.fs.RemoteIterator<LocatedFileStatus> |
ViewFileSystem.listLocatedStatus(Path f,
PathFilter filter) |
Modifier and Type | Class and Description |
---|---|
class |
OutputLogFilter
This class filters log files from directory given
It doesnt accept paths having _logs.
|
Modifier and Type | Method and Description |
---|---|
static PathFilter |
FileInputFormat.getInputPathFilter(JobConf conf)
Get a PathFilter instance of the filter set for the input paths.
|
Modifier and Type | Method and Description |
---|---|
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results.
|
Modifier and Type | Method and Description |
---|---|
static void |
FileInputFormat.setInputPathFilter(JobConf conf,
Class<? extends PathFilter> filter)
Set a PathFilter to be applied to the input paths for the map-reduce job.
|
Modifier and Type | Method and Description |
---|---|
protected void |
CombineFileInputFormat.createPool(JobConf conf,
PathFilter... filters)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
protected void |
CombineFileInputFormat.createPool(JobConf conf,
List<PathFilter> filters)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
static PathFilter |
FileInputFormat.getInputPathFilter(JobContext context)
Get a PathFilter instance of the filter set for the input paths.
|
Modifier and Type | Method and Description |
---|---|
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results.
|
protected void |
CombineFileInputFormat.createPool(PathFilter... filters)
Create a new pool and add the filters to it.
|
Modifier and Type | Method and Description |
---|---|
protected void |
CombineFileInputFormat.createPool(List<PathFilter> filters)
Create a new pool and add the filters to it.
|
static void |
FileInputFormat.setInputPathFilter(Job job,
Class<? extends PathFilter> filter)
Set a PathFilter to be applied to the input paths for the map-reduce job.
|
Modifier and Type | Method and Description |
---|---|
protected static List<FileStatus> |
HistoryFileManager.scanDirectory(Path path,
FileContext fc,
PathFilter pathFilter) |
Copyright © 2024 Apache Software Foundation. All rights reserved.