org.apache.ignite.internal.processors.hadoop.shuffle.collections

Class HadoopConcurrentHashMultimap

java.lang.Object

org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopMultimapBase

org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopHashMultimapBase

org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopConcurrentHashMultimap

All Implemented Interfaces:

AutoCloseable, HadoopMultimap

public class HadoopConcurrentHashMultimap
extends HadoopHashMultimapBase

Multimap for map reduce intermediate results.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopHashMultimapBase

HadoopHashMultimapBase.Input, HadoopHashMultimapBase.Reader

Nested classes/interfaces inherited from class org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopMultimapBase

HadoopMultimapBase.AdderBase, HadoopMultimapBase.ReaderBase, HadoopMultimapBase.ValueIterator

Nested classes/interfaces inherited from interface org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopMultimap

HadoopMultimap.Adder, HadoopMultimap.Key, HadoopMultimap.Value, HadoopMultimap.Visitor

Field Summary

Fields inherited from class org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopMultimapBase

mem, pageSize

Constructor Summary

Constructors

Constructor and Description
HadoopConcurrentHashMultimap(HadoopJobInfo jobInfo, GridUnsafeMemory mem, int cap)

Method Summary

Modifier and Type	Method and Description
int	capacity()
void	close()
protected long	collision(long meta)
protected void	collision(long meta, long collision)
HadoopTaskInput	input(HadoopTaskContext taskCtx)
long	keys()
protected long	meta(int idx)
HadoopMultimap.Adder	startAdding(HadoopTaskContext ctx)
protected long	value(long meta)
boolean	visit(boolean ignoreLastVisited, HadoopMultimap.Visitor v) Incrementally visits all the keys and values in the map.

Methods inherited from class org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopHashMultimapBase

key, keyHash, keySize, value

Methods inherited from class org.apache.ignite.internal.processors.hadoop.shuffle.collections.HadoopMultimapBase

nextValue, nextValue, valueSize, valueSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopConcurrentHashMultimap

public HadoopConcurrentHashMultimap(HadoopJobInfo jobInfo,
                                    GridUnsafeMemory mem,
                                    int cap)

Parameters:

jobInfo - Job info.

mem - Memory.

cap - Initial capacity.

Method Detail

keys

public long keys()

Returns:

Number of keys.

capacity

public int capacity()

Specified by:

capacity in class HadoopHashMultimapBase

Returns:

Current table capacity.

startAdding

public HadoopMultimap.Adder startAdding(HadoopTaskContext ctx)
                                 throws IgniteCheckedException

Parameters:

ctx - Task context.

Returns:

Adder object.

Throws:

IgniteCheckedException - If failed.

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface HadoopMultimap

Overrides:

close in class HadoopMultimapBase

meta

protected long meta(int idx)

Specified by:

meta in class HadoopHashMultimapBase

Parameters:

idx - Index in hash table.

Returns:

Meta page pointer.

visit

public boolean visit(boolean ignoreLastVisited,
                     HadoopMultimap.Visitor v)
              throws IgniteCheckedException

Incrementally visits all the keys and values in the map.

Specified by:

visit in interface HadoopMultimap

Overrides:

visit in class HadoopHashMultimapBase

Parameters:

ignoreLastVisited - Flag indicating that visiting must be started from the beginning.

v - Visitor.

Returns:

false If visiting was impossible due to rehashing.

Throws:

IgniteCheckedException

input

public HadoopTaskInput input(HadoopTaskContext taskCtx)
                      throws IgniteCheckedException

Specified by:

input in interface HadoopMultimap

Overrides:

input in class HadoopHashMultimapBase

Parameters:

taskCtx - Task context.

Returns:

Task input.

Throws:

IgniteCheckedException - If failed.

value

protected long value(long meta)

Overrides:

value in class HadoopHashMultimapBase

Parameters:

meta - Meta pointer.

Returns:

Value pointer.

collision

protected long collision(long meta)

Overrides:

collision in class HadoopHashMultimapBase

Parameters:

meta - Meta pointer.

Returns:

Collision pointer.

collision

protected void collision(long meta,
                         long collision)

Overrides:

collision in class HadoopHashMultimapBase

Parameters:

meta - Meta pointer.

collision - Collision pointer.