Uses of Interface
org.apache.hadoop.mapreduce.TaskAttemptContext
Packages that use TaskAttemptContext
Package
Description
Support for manifest committer.
This is the "Magic" committer and support.
Intermediate manifest committer.
-
Uses of TaskAttemptContext in org.apache.hadoop.fs.azurebfs.commit
Methods in org.apache.hadoop.fs.azurebfs.commit with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionAzureManifestCommitterFactory.createOutputCommitter(Path outputPath, TaskAttemptContext context) -
Uses of TaskAttemptContext in org.apache.hadoop.fs.s3a.commit.magic
Methods in org.apache.hadoop.fs.s3a.commit.magic with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionvoidMagicS3GuardCommitter.abortTask(TaskAttemptContext context) Abort a task.voidMagicS3GuardCommitter.commitTask(TaskAttemptContext context) protected final PathMagicS3GuardCommitter.getBaseTaskAttemptPath(TaskAttemptContext context) final PathMagicS3GuardCommitter.getTaskAttemptPath(TaskAttemptContext context) Compute the path where the output of a task attempt is stored until that task is committed.MagicS3GuardCommitter.getTempTaskAttemptPath(TaskAttemptContext context) Get a temporary directory for data.protected org.apache.hadoop.fs.s3a.commit.files.PendingSetMagicS3GuardCommitter.loadPendingCommits(TaskAttemptContext context) Loads pending commits from either memory or from the remote store (S3) based on the config.booleanMagicS3GuardCommitter.needsTaskCommit(TaskAttemptContext context) Did this task write any files in the work directory?Constructors in org.apache.hadoop.fs.s3a.commit.magic with parameters of type TaskAttemptContextModifierConstructorDescriptionMagicS3GuardCommitter(Path outputPath, TaskAttemptContext context) Create a task committer. -
Uses of TaskAttemptContext in org.apache.hadoop.mapred
Subinterfaces of TaskAttemptContext in org.apache.hadoop.mapredMethods in org.apache.hadoop.mapred with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionfinal voidOutputCommitter.abortTask(TaskAttemptContext taskContext) This method implements the new interface by calling the old method.final voidOutputCommitter.commitTask(TaskAttemptContext taskContext) This method implements the new interface by calling the old method.final booleanOutputCommitter.needsTaskCommit(TaskAttemptContext taskContext) This method implements the new interface by calling the old method.final voidOutputCommitter.recoverTask(TaskAttemptContext taskContext) This method implements the new interface by calling the old method.final voidOutputCommitter.setupTask(TaskAttemptContext taskContext) This method implements the new interface by calling the old method. -
Uses of TaskAttemptContext in org.apache.hadoop.mapred.lib
Methods in org.apache.hadoop.mapred.lib with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionCombineFileInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) -
Uses of TaskAttemptContext in org.apache.hadoop.mapreduce
Subinterfaces of TaskAttemptContext in org.apache.hadoop.mapreduceModifier and TypeInterfaceDescriptioninterfaceMapContext<KEYIN,VALUEIN, KEYOUT, VALUEOUT> The context that is given to theMapper.interfaceReduceContext<KEYIN,VALUEIN, KEYOUT, VALUEOUT> The context passed to theReducer.interfaceTaskInputOutputContext<KEYIN,VALUEIN, KEYOUT, VALUEOUT> A context object that allows input and output from the task.Methods in org.apache.hadoop.mapreduce with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionabstract voidOutputCommitter.abortTask(TaskAttemptContext taskContext) Discard the task output.abstract voidRecordWriter.close(TaskAttemptContext context) Close thisRecordWriterto future operations.abstract voidOutputCommitter.commitTask(TaskAttemptContext taskContext) To promote the task's temporary output to final output location.abstract RecordReader<K,V> InputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) Create a record reader for a given split.abstract OutputCommitterOutputFormat.getOutputCommitter(TaskAttemptContext context) Get the output committer for this output format.abstract RecordWriter<K,V> OutputFormat.getRecordWriter(TaskAttemptContext context) Get theRecordWriterfor the given task.abstract voidRecordReader.initialize(InputSplit split, TaskAttemptContext context) Called once at initialization.abstract booleanOutputCommitter.needsTaskCommit(TaskAttemptContext taskContext) Check whether task needs a commit.voidOutputCommitter.recoverTask(TaskAttemptContext taskContext) Recover the task output.abstract voidOutputCommitter.setupTask(TaskAttemptContext taskContext) Sets up output for the task. -
Uses of TaskAttemptContext in org.apache.hadoop.mapreduce.lib.db
Methods in org.apache.hadoop.mapreduce.lib.db with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionDBInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) Create a record reader for a given split.DBOutputFormat.getOutputCommitter(TaskAttemptContext context) DBOutputFormat.getRecordWriter(TaskAttemptContext context) Get theRecordWriterfor the given task.voidDBRecordReader.initialize(InputSplit split, TaskAttemptContext context) -
Uses of TaskAttemptContext in org.apache.hadoop.mapreduce.lib.input
Fields in org.apache.hadoop.mapreduce.lib.input declared as TaskAttemptContextMethods in org.apache.hadoop.mapreduce.lib.input with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionabstract RecordReader<K,V> CombineFileInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) This is not implemented yet.CombineSequenceFileInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) CombineTextInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) FixedLengthInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) KeyValueTextInputFormat.createRecordReader(InputSplit genericSplit, TaskAttemptContext context) NLineInputFormat.createRecordReader(InputSplit genericSplit, TaskAttemptContext context) SequenceFileAsBinaryInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) SequenceFileAsTextInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) SequenceFileInputFilter.createRecordReader(InputSplit split, TaskAttemptContext context) Create a record reader for the given splitSequenceFileInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) TextInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) voidCombineFileRecordReader.initialize(InputSplit split, TaskAttemptContext context) voidCombineFileRecordReaderWrapper.initialize(InputSplit split, TaskAttemptContext context) voidKeyValueLineRecordReader.initialize(InputSplit genericSplit, TaskAttemptContext context) voidSequenceFileAsTextRecordReader.initialize(InputSplit split, TaskAttemptContext context) voidSequenceFileRecordReader.initialize(InputSplit split, TaskAttemptContext context) Constructors in org.apache.hadoop.mapreduce.lib.input with parameters of type TaskAttemptContextModifierConstructorDescriptionCombineFileRecordReader(CombineFileSplit split, TaskAttemptContext context, Class<? extends RecordReader<K, V>> rrClass) A generic RecordReader that can hand out different recordReaders for each chunk in the CombineFileSplit.protectedCombineFileRecordReaderWrapper(FileInputFormat<K, V> inputFormat, CombineFileSplit split, TaskAttemptContext context, Integer idx) -
Uses of TaskAttemptContext in org.apache.hadoop.mapreduce.lib.join
Methods in org.apache.hadoop.mapreduce.lib.join with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionabstract ComposableRecordReader<K,V> ComposableInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) CompositeInputFormat.createRecordReader(InputSplit split, TaskAttemptContext taskContext) Construct a CompositeRecordReader for the children of this InputFormat as defined in the init expression.voidCompositeRecordReader.initialize(InputSplit split, TaskAttemptContext context) voidMultiFilterRecordReader.initialize(InputSplit split, TaskAttemptContext context) voidWrappedRecordReader.initialize(InputSplit split, TaskAttemptContext context) -
Uses of TaskAttemptContext in org.apache.hadoop.mapreduce.lib.output
Methods in org.apache.hadoop.mapreduce.lib.output with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionvoidBindingPathOutputCommitter.abortTask(TaskAttemptContext taskContext) voidFileOutputCommitter.abortTask(TaskAttemptContext context) Delete the work directoryvoidFileOutputCommitter.abortTask(TaskAttemptContext context, Path taskAttemptPath) voidPartialFileOutputCommitter.cleanUpPartialOutputForTask(TaskAttemptContext context) voidPartialOutputCommitter.cleanUpPartialOutputForTask(TaskAttemptContext context) Remove all previously committed outputs from prior executions of this task.voidBindingPathOutputCommitter.commitTask(TaskAttemptContext taskContext) voidFileOutputCommitter.commitTask(TaskAttemptContext context) Move the files from the work directory to the job output directoryvoidFileOutputCommitter.commitTask(TaskAttemptContext context, Path taskAttemptPath) static PathOutputCommitterPathOutputCommitterFactory.createCommitter(Path outputPath, TaskAttemptContext context) Create the committer factory for a task attempt and destination, then create the committer from it.protected final PathOutputCommitterPathOutputCommitterFactory.createFileOutputCommitter(Path outputPath, TaskAttemptContext context) Create an instance of the default committer, aFileOutputCommitterfor a task.PathOutputCommitterFactory.createOutputCommitter(Path outputPath, TaskAttemptContext context) Create an output committer for a task attempt.protected PathFileOutputCommitter.getCommittedTaskPath(int appAttemptId, TaskAttemptContext context) Compute the path where the output of a committed task is stored until the entire job is committed for a specific application attempt.FileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context) Compute the path where the output of a committed task is stored until the entire job is committed.static PathFileOutputCommitter.getCommittedTaskPath(TaskAttemptContext context, Path out) PartialFileOutputCommitter.getCommittedTaskPath(int appAttemptId, TaskAttemptContext context) FileOutputFormat.getDefaultWorkFile(TaskAttemptContext context, String extension) Get the default path and filename for the output format.FileOutputFormat.getOutputCommitter(TaskAttemptContext context) FilterOutputFormat.getOutputCommitter(TaskAttemptContext context) LazyOutputFormat.getOutputCommitter(TaskAttemptContext context) NullOutputFormat.getOutputCommitter(TaskAttemptContext context) abstract RecordWriter<K,V> FileOutputFormat.getRecordWriter(TaskAttemptContext job) FilterOutputFormat.getRecordWriter(TaskAttemptContext context) LazyOutputFormat.getRecordWriter(TaskAttemptContext context) MapFileOutputFormat.getRecordWriter(TaskAttemptContext context) NullOutputFormat.getRecordWriter(TaskAttemptContext context) SequenceFileAsBinaryOutputFormat.getRecordWriter(TaskAttemptContext context) SequenceFileOutputFormat.getRecordWriter(TaskAttemptContext context) TextOutputFormat.getRecordWriter(TaskAttemptContext job) protected org.apache.hadoop.io.SequenceFile.WriterSequenceFileOutputFormat.getSequenceWriter(TaskAttemptContext context, Class<?> keyClass, Class<?> valueClass) FileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context) Compute the path where the output of a task attempt is stored until that task is committed.static PathFileOutputCommitter.getTaskAttemptPath(TaskAttemptContext context, Path out) Compute the path where the output of a task attempt is stored until that task is committed.static StringFileOutputFormat.getUniqueFile(TaskAttemptContext context, String name, String extension) Generate a unique filename, based on the task id, name, and extensionbooleanBindingPathOutputCommitter.needsTaskCommit(TaskAttemptContext taskContext) booleanFileOutputCommitter.needsTaskCommit(TaskAttemptContext context) Did this task write any files in the work directory?booleanFileOutputCommitter.needsTaskCommit(TaskAttemptContext context, Path taskAttemptPath) voidBindingPathOutputCommitter.recoverTask(TaskAttemptContext taskContext) voidFileOutputCommitter.recoverTask(TaskAttemptContext context) voidBindingPathOutputCommitter.setupTask(TaskAttemptContext taskContext) voidFileOutputCommitter.setupTask(TaskAttemptContext context) No task setup required.Constructors in org.apache.hadoop.mapreduce.lib.output with parameters of type TaskAttemptContextModifierConstructorDescriptionBindingPathOutputCommitter(Path outputPath, TaskAttemptContext context) Instantiate.FileOutputCommitter(Path outputPath, TaskAttemptContext context) Create a file output committerPartialFileOutputCommitter(Path outputPath, TaskAttemptContext context) protectedPathOutputCommitter(Path outputPath, TaskAttemptContext context) Constructor for a task attempt. -
Uses of TaskAttemptContext in org.apache.hadoop.mapreduce.lib.output.committer.manifest
Methods in org.apache.hadoop.mapreduce.lib.output.committer.manifest with parameters of type TaskAttemptContextModifier and TypeMethodDescriptionvoidManifestCommitter.abortTask(TaskAttemptContext context) Abort a task.voidManifestCommitter.commitTask(TaskAttemptContext context) Commit the task.ManifestCommitterFactory.createOutputCommitter(Path outputPath, TaskAttemptContext context) ManifestCommitter.getTaskAttemptPath(TaskAttemptContext context) Compute the path where the output of a task attempt is stored until that task is committed.ManifestCommitter.getTaskManifestPath(TaskAttemptContext context) The path to where the manifest file of a task attempt will be saved when the task is committed.booleanManifestCommitter.needsTaskCommit(TaskAttemptContext context) Always return true.voidManifestCommitter.recoverTask(TaskAttemptContext taskContext) voidManifestCommitter.setupTask(TaskAttemptContext context) Set up a task through aSetupTaskStage.Constructors in org.apache.hadoop.mapreduce.lib.output.committer.manifest with parameters of type TaskAttemptContextModifierConstructorDescriptionManifestCommitter(Path outputPath, TaskAttemptContext context) Create a committer.