org.apache.ignite.internal.processors.hadoop.impl.igfs

Class HadoopIgfsWrapper

java.lang.Object

org.apache.ignite.internal.processors.hadoop.impl.igfs.HadoopIgfsWrapper

All Implemented Interfaces:

HadoopIgfs

public class HadoopIgfsWrapper
extends Object
implements HadoopIgfs

Wrapper for IGFS server.

Constructor Summary

Constructors

Constructor and Description
HadoopIgfsWrapper(String authority, String logDir, Configuration conf, org.apache.commons.logging.Log log, String user) Constructor.

Method Summary

Modifier and Type	Method and Description
Collection<IgfsBlockLocation>	affinity(IgfsPath path, long start, long len) Command to get affinity for given path, offset and length.
HadoopIgfsStreamDelegate	append(IgfsPath path, boolean create, Map<String,String> props) Open file for output appending data to the end of a file.
void	close(boolean force) Close connection.
IgfsPathSummary	contentSummary(IgfsPath path) Gets path summary.
HadoopIgfsStreamDelegate	create(IgfsPath path, boolean overwrite, boolean colocate, int replication, long blockSize, Map<String,String> props) Command to create file and open it for output.
Boolean	delete(IgfsPath path, boolean recursive) Command to delete given path.
IgfsStatus	fsStatus() Performs status request.
IgfsHandshakeResponse	handshake(String logDir) Perform handshake.
IgfsFile	info(IgfsPath path) Command to retrieve file info for some IGFS path.
Collection<IgfsFile>	listFiles(IgfsPath path) Command to get list of files in directory.
Collection<IgfsPath>	listPaths(IgfsPath path) Command to get directory listing.
Boolean	mkdirs(IgfsPath path, Map<String,String> props) Command to create directories.
IgfsModeResolver	modeResolver()
HadoopIgfsStreamDelegate	open(IgfsPath path) Command to open file for reading.
HadoopIgfsStreamDelegate	open(IgfsPath path, int seqReadsBeforePrefetch) Command to open file for reading.
Boolean	rename(IgfsPath src, IgfsPath dest) Command to rename given path.
Boolean	setTimes(IgfsPath path, long accessTime, long modificationTime) Sets last access time and last modification time for a file.
IgfsFile	update(IgfsPath path, Map<String,String> props) Command to update file properties.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopIgfsWrapper

public HadoopIgfsWrapper(String authority,
                         String logDir,
                         Configuration conf,
                         org.apache.commons.logging.Log log,
                         String user)
                  throws IOException

Constructor.

Parameters:

authority - Authority (connection string).

logDir - Log directory for server.

conf - Configuration.

log - Current logger.

user - User name.

Throws:

IOException - On error.

Method Detail

handshake

public IgfsHandshakeResponse handshake(String logDir)
                                throws IOException

Perform handshake.

Specified by:

handshake in interface HadoopIgfs

Parameters:

logDir - Log directory.

Returns:

Future with handshake result.

Throws:

IOException

close

public void close(boolean force)

Close connection.

Specified by:

close in interface HadoopIgfs

Parameters:

force - Force flag.

info

public IgfsFile info(IgfsPath path)
              throws IOException

Command to retrieve file info for some IGFS path.

Specified by:

info in interface HadoopIgfs

Parameters:

path - Path to get file info for.

Returns:

Future for info operation.

Throws:

IOException

update

public IgfsFile update(IgfsPath path,
                       Map<String,String> props)
                throws IOException

Command to update file properties.

Specified by:

update in interface HadoopIgfs

Parameters:

path - IGFS path to update properties.

props - Properties to update.

Returns:

Future for update operation.

Throws:

IOException

setTimes

public Boolean setTimes(IgfsPath path,
                        long accessTime,
                        long modificationTime)
                 throws IOException

Sets last access time and last modification time for a file.

Specified by:

setTimes in interface HadoopIgfs

Parameters:

path - Path to update times.

accessTime - Last access time to set.

modificationTime - Last modification time to set.

Throws:

IOException

rename

public Boolean rename(IgfsPath src,
                      IgfsPath dest)
               throws IOException

Command to rename given path.

Specified by:

rename in interface HadoopIgfs

Parameters:

src - Source path.

dest - Destination path.

Returns:

Future for rename operation.

Throws:

IOException

delete

public Boolean delete(IgfsPath path,
                      boolean recursive)
               throws IOException

Command to delete given path.

Specified by:

delete in interface HadoopIgfs

Parameters:

path - Path to delete.

recursive - True if deletion is recursive.

Returns:

Future for delete operation.

Throws:

IOException

affinity

public Collection<IgfsBlockLocation> affinity(IgfsPath path,
                                              long start,
                                              long len)
                                       throws IOException

Command to get affinity for given path, offset and length.

Specified by:

affinity in interface HadoopIgfs

Parameters:

path - Path to get affinity for.

start - Start position (offset).

len - Data length.

Returns:

Future for affinity command.

Throws:

IOException

contentSummary

public IgfsPathSummary contentSummary(IgfsPath path)
                               throws IOException

Gets path summary.

Specified by:

contentSummary in interface HadoopIgfs

Parameters:

path - Path to get summary for.

Returns:

Future that will be completed when summary is received.

Throws:

IOException

mkdirs

public Boolean mkdirs(IgfsPath path,
                      Map<String,String> props)
               throws IOException

Command to create directories.

Specified by:

mkdirs in interface HadoopIgfs

Parameters:

path - Path to create.

Returns:

Future for mkdirs operation.

Throws:

IOException

listFiles

public Collection<IgfsFile> listFiles(IgfsPath path)
                               throws IOException

Command to get list of files in directory.

Specified by:

listFiles in interface HadoopIgfs

Parameters:

path - Path to list.

Returns:

Future for listFiles operation.

Throws:

IOException

listPaths

public Collection<IgfsPath> listPaths(IgfsPath path)
                               throws IOException

Command to get directory listing.

Specified by:

listPaths in interface HadoopIgfs

Parameters:

path - Path to list.

Returns:

Future for listPaths operation.

Throws:

IOException

fsStatus

public IgfsStatus fsStatus()
                    throws IOException

Performs status request.

Specified by:

fsStatus in interface HadoopIgfs

Returns:

Status response.

Throws:

IOException

open

public HadoopIgfsStreamDelegate open(IgfsPath path)
                              throws IOException

Command to open file for reading.

Specified by:

open in interface HadoopIgfs

Parameters:

path - File path to open.

Returns:

Future for open operation.

Throws:

IOException

open

public HadoopIgfsStreamDelegate open(IgfsPath path,
                                     int seqReadsBeforePrefetch)
                              throws IOException

Command to open file for reading.

Specified by:

open in interface HadoopIgfs

Parameters:

path - File path to open.

Returns:

Future for open operation.

Throws:

IOException

create

public HadoopIgfsStreamDelegate create(IgfsPath path,
                                       boolean overwrite,
                                       boolean colocate,
                                       int replication,
                                       long blockSize,
                                       @Nullable
                                       Map<String,String> props)
                                throws IOException

Command to create file and open it for output.

Specified by:

create in interface HadoopIgfs

Parameters:

path - Path to file.

overwrite - If true then old file contents will be lost.

colocate - If true and called on data node, file will be written on that node.

replication - Replication factor.

props - File properties for creation.

Returns:

Stream descriptor.

Throws:

IOException

append

public HadoopIgfsStreamDelegate append(IgfsPath path,
                                       boolean create,
                                       @Nullable
                                       Map<String,String> props)
                                throws IOException

Open file for output appending data to the end of a file.

Specified by:

append in interface HadoopIgfs

Parameters:

path - Path to file.

create - If true, file will be created if does not exist.

props - File properties.

Returns:

Stream descriptor.

Throws:

IOException

modeResolver

public IgfsModeResolver modeResolver()
                              throws IOException

Returns:

Mode resolver.

Throws:

IOException - On error.