org.apache.ignite.internal.processors.hadoop.impl.v2

Class HadoopV2TaskContext

java.lang.Object

org.apache.ignite.internal.processors.hadoop.HadoopTaskContext

org.apache.ignite.internal.processors.hadoop.impl.v2.HadoopV2TaskContext

public class HadoopV2TaskContext
extends HadoopTaskContext

Context for task execution.

Field Summary

Fields inherited from class org.apache.ignite.internal.processors.hadoop.HadoopTaskContext

job

Constructor Summary

Constructors

Constructor and Description
HadoopV2TaskContext(HadoopTaskInfo taskInfo, HadoopJobEx job, HadoopJobId jobId, UUID locNodeId, DataInput jobConfDataInput)

Method Summary

Modifier and Type	Method and Description
TaskAttemptID	attemptId() Creates Hadoop attempt ID.
void	cancel()
void	cleanupTaskEnvironment()
static void	close() This method is called with reflection upon Job finish with class loader of each task.
<T extends HadoopCounter> T	counter(String grp, String name, Class<T> cls)
HadoopCounters	counters()
Object	getNativeSplit(HadoopInputSplit split)
Comparator<Object>	groupComparator()
JobConf	jobConf() Gets job configuration of the task.
JobContextImpl	jobContext() Gets job context of the task.
HadoopSerialization	keySerialization()
PartiallyOffheapRawComparatorEx<Object>	partialRawSortComparator()
HadoopPartitioner	partitioner()
void	prepareTaskEnvironment()
void	run()
<T> T	runAsJobOwner(Callable<T> c)
Comparator<Object>	sortComparator()
HadoopSerialization	valueSerialization()

Methods inherited from class org.apache.ignite.internal.processors.hadoop.HadoopTaskContext

input, input, job, onMapperFinished, output, output, taskInfo, taskInfo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopV2TaskContext

public HadoopV2TaskContext(HadoopTaskInfo taskInfo,
                           HadoopJobEx job,
                           HadoopJobId jobId,
                           @Nullable
                           UUID locNodeId,
                           DataInput jobConfDataInput)
                    throws IgniteCheckedException

Parameters:

taskInfo - Task info.

job - Job.

jobId - Job ID.

locNodeId - Local node ID.

jobConfDataInput - DataInput for read JobConf.

Throws:

IgniteCheckedException

Method Detail

close

public static void close()
                  throws IgniteCheckedException

This method is called with reflection upon Job finish with class loader of each task. This will clean up all the Fs created for specific task. Each class loader sees uses its own instance of fsMap since the class loaders are different.

Throws:

IgniteCheckedException - On error.

counter

public <T extends HadoopCounter> T counter(String grp,
                                           String name,
                                           Class<T> cls)

Specified by:

counter in class HadoopTaskContext

counters

public HadoopCounters counters()

Specified by:

counters in class HadoopTaskContext

run

public void run()
         throws IgniteCheckedException

Specified by:

run in class HadoopTaskContext

Throws:

IgniteCheckedException

cancel

public void cancel()

Specified by:

cancel in class HadoopTaskContext

prepareTaskEnvironment

public void prepareTaskEnvironment()
                            throws IgniteCheckedException

Specified by:

prepareTaskEnvironment in class HadoopTaskContext

Throws:

IgniteCheckedException

cleanupTaskEnvironment

public void cleanupTaskEnvironment()
                            throws IgniteCheckedException

Specified by:

cleanupTaskEnvironment in class HadoopTaskContext

Throws:

IgniteCheckedException

attemptId

public TaskAttemptID attemptId()

Creates Hadoop attempt ID.

Returns:

Attempt ID.

jobConf

public JobConf jobConf()

Gets job configuration of the task.

Returns:

Job configuration.

jobContext

public JobContextImpl jobContext()

Gets job context of the task.

Returns:

Job context.

partitioner

public HadoopPartitioner partitioner()
                              throws IgniteCheckedException

Specified by:

partitioner in class HadoopTaskContext

Throws:

IgniteCheckedException

keySerialization

public HadoopSerialization keySerialization()
                                     throws IgniteCheckedException

Specified by:

keySerialization in class HadoopTaskContext

Throws:

IgniteCheckedException

valueSerialization

public HadoopSerialization valueSerialization()
                                       throws IgniteCheckedException

Specified by:

valueSerialization in class HadoopTaskContext

Throws:

IgniteCheckedException

sortComparator

public Comparator<Object> sortComparator()

Specified by:

sortComparator in class HadoopTaskContext

partialRawSortComparator

public PartiallyOffheapRawComparatorEx<Object> partialRawSortComparator()

Specified by:

partialRawSortComparator in class HadoopTaskContext

groupComparator

public Comparator<Object> groupComparator()

Specified by:

groupComparator in class HadoopTaskContext

getNativeSplit

public Object getNativeSplit(HadoopInputSplit split)
                      throws IgniteCheckedException

Parameters:

split - Split.

Returns:

Native Hadoop split.

Throws:

IgniteCheckedException - if failed.

runAsJobOwner

public <T> T runAsJobOwner(Callable<T> c)
                    throws IgniteCheckedException

Specified by:

runAsJobOwner in class HadoopTaskContext

Throws:

IgniteCheckedException