org.apache.ignite.hadoop.fs

Class IgniteHadoopIgfsSecondaryFileSystem

java.lang.Object

org.apache.ignite.hadoop.fs.IgniteHadoopIgfsSecondaryFileSystem

All Implemented Interfaces:

IgfsSecondaryFileSystem, LifecycleAware

public class IgniteHadoopIgfsSecondaryFileSystem
extends Object
implements IgfsSecondaryFileSystem, LifecycleAware

Secondary file system which delegates calls to Hadoop org.apache.hadoop.fs.FileSystem.

Target FileSystem's are created on per-user basis using passed HadoopFileSystemFactory.

Constructor Summary

Constructors

Constructor and Description
IgniteHadoopIgfsSecondaryFileSystem() Default constructor for Spring.
IgniteHadoopIgfsSecondaryFileSystem(String uri) Deprecated. Use getFileSystemFactory() instead.
IgniteHadoopIgfsSecondaryFileSystem(String uri, String cfgPath) Deprecated. Use getFileSystemFactory() instead.
IgniteHadoopIgfsSecondaryFileSystem(String uri, String cfgPath, String userName) Deprecated. Use getFileSystemFactory() instead.

Method Summary

Modifier and Type	Method and Description
Collection<IgfsBlockLocation>	affinity(IgfsPath path, long start, long len, long maxLen)
OutputStream	append(IgfsPath path, int bufSize, boolean create, Map<String,String> props)
OutputStream	create(IgfsPath path, boolean overwrite)
OutputStream	create(IgfsPath path, int bufSize, boolean overwrite, int replication, long blockSize, Map<String,String> props)
boolean	delete(IgfsPath path, boolean recursive)
boolean	exists(IgfsPath path)
String	getDefaultUserName() Gets default user name.
HadoopFileSystemFactory	getFileSystemFactory() Gets secondary file system factory.
IgfsFile	info(IgfsPath path)
Collection<IgfsFile>	listFiles(IgfsPath path)
Collection<IgfsPath>	listPaths(IgfsPath path)
void	mkdirs(IgfsPath path)
void	mkdirs(IgfsPath path, Map<String,String> props)
IgfsSecondaryFileSystemPositionedReadable	open(IgfsPath path, int bufSize)
void	rename(IgfsPath src, IgfsPath dest)
IgniteHadoopIgfsSecondaryFileSystem	setDefaultUserName(String dfltUsrName) Sets default user name.
IgniteHadoopIgfsSecondaryFileSystem	setFileSystemFactory(HadoopFileSystemFactory factory) Sets secondary file system factory.
void	setIgniteInstance(IgniteEx ignite)
void	setTimes(IgfsPath path, long modificationTime, long accessTime)
void	start()
void	stop()
IgfsFile	update(IgfsPath path, Map<String,String> props)
long	usedSpaceSize()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

IgniteHadoopIgfsSecondaryFileSystem

public IgniteHadoopIgfsSecondaryFileSystem()

Default constructor for Spring.

IgniteHadoopIgfsSecondaryFileSystem

@Deprecated
public IgniteHadoopIgfsSecondaryFileSystem(String uri)
                                                throws IgniteCheckedException

Deprecated. Use getFileSystemFactory() instead.

Simple constructor that is to be used by default.

Parameters:

uri - URI of file system.

Throws:

IgniteCheckedException - In case of error.

IgniteHadoopIgfsSecondaryFileSystem

@Deprecated
public IgniteHadoopIgfsSecondaryFileSystem(@Nullable
                                                       String uri,
                                                       @Nullable
                                                       String cfgPath)
                                                throws IgniteCheckedException

Deprecated. Use getFileSystemFactory() instead.

Constructor.

Parameters:

uri - URI of file system.

cfgPath - Additional path to Hadoop configuration.

Throws:

IgniteCheckedException - In case of error.

IgniteHadoopIgfsSecondaryFileSystem

@Deprecated
public IgniteHadoopIgfsSecondaryFileSystem(@Nullable
                                                       String uri,
                                                       @Nullable
                                                       String cfgPath,
                                                       @Nullable
                                                       String userName)
                                                throws IgniteCheckedException

Deprecated. Use getFileSystemFactory() instead.

Constructor.

Parameters:

uri - URI of file system.

cfgPath - Additional path to Hadoop configuration.

userName - User name.

Throws:

IgniteCheckedException - In case of error.

Method Detail

getDefaultUserName

@Nullable
public String getDefaultUserName()

Gets default user name.

Defines user name which will be used during file system invocation in case no user name is defined explicitly through FileSystem.get(URI, Configuration, String).

Also this name will be used if you manipulate IgniteFileSystem directly and do not set user name explicitly using IgfsUserContext.doAs(String, IgniteOutClosure) or IgfsUserContext.doAs(String, Callable) methods.

If not set value of system property "user.name" will be used. If this property is not set either, "anonymous" will be used.

Returns:

Default user name.

setDefaultUserName

public IgniteHadoopIgfsSecondaryFileSystem setDefaultUserName(@Nullable
                                                              String dfltUsrName)

Sets default user name. See getDefaultUserName() for details.

Parameters:

dfltUsrName - Default user name.

Returns:

this for chaining.

getFileSystemFactory

public HadoopFileSystemFactory getFileSystemFactory()

Gets secondary file system factory.

This factory will be used whenever a call to a target FileSystem is required.

If not set, CachingHadoopFileSystemFactory will be used.

Returns:

Secondary file system factory.

setFileSystemFactory

public IgniteHadoopIgfsSecondaryFileSystem setFileSystemFactory(HadoopFileSystemFactory factory)

Sets secondary file system factory. See getFileSystemFactory() for details.

Parameters:

factory - Secondary file system factory.

Returns:

this for chaining.

exists

public boolean exists(IgfsPath path)

Specified by:

exists in interface IgfsSecondaryFileSystem

update

@Nullable
public IgfsFile update(IgfsPath path,
                                 Map<String,String> props)

Specified by:

update in interface IgfsSecondaryFileSystem

rename

public void rename(IgfsPath src,
                   IgfsPath dest)

Specified by:

rename in interface IgfsSecondaryFileSystem

delete

public boolean delete(IgfsPath path,
                      boolean recursive)

Specified by:

delete in interface IgfsSecondaryFileSystem

mkdirs

public void mkdirs(IgfsPath path)

Specified by:

mkdirs in interface IgfsSecondaryFileSystem

mkdirs

public void mkdirs(IgfsPath path,
                   @Nullable
                   Map<String,String> props)

Specified by:

mkdirs in interface IgfsSecondaryFileSystem

listPaths

public Collection<IgfsPath> listPaths(IgfsPath path)

Specified by:

listPaths in interface IgfsSecondaryFileSystem

listFiles

public Collection<IgfsFile> listFiles(IgfsPath path)

Specified by:

listFiles in interface IgfsSecondaryFileSystem

open

public IgfsSecondaryFileSystemPositionedReadable open(IgfsPath path,
                                                      int bufSize)

Specified by:

open in interface IgfsSecondaryFileSystem

create

public OutputStream create(IgfsPath path,
                           boolean overwrite)

Specified by:

create in interface IgfsSecondaryFileSystem

create

public OutputStream create(IgfsPath path,
                           int bufSize,
                           boolean overwrite,
                           int replication,
                           long blockSize,
                           @Nullable
                           Map<String,String> props)

Specified by:

create in interface IgfsSecondaryFileSystem

append

public OutputStream append(IgfsPath path,
                           int bufSize,
                           boolean create,
                           @Nullable
                           Map<String,String> props)

Specified by:

append in interface IgfsSecondaryFileSystem

info

public IgfsFile info(IgfsPath path)

Specified by:

info in interface IgfsSecondaryFileSystem

usedSpaceSize

public long usedSpaceSize()

Specified by:

usedSpaceSize in interface IgfsSecondaryFileSystem

setTimes

public void setTimes(IgfsPath path,
                     long modificationTime,
                     long accessTime)
              throws IgniteException

Specified by:

setTimes in interface IgfsSecondaryFileSystem

Throws:

IgniteException

affinity

public Collection<IgfsBlockLocation> affinity(IgfsPath path,
                                              long start,
                                              long len,
                                              long maxLen)
                                       throws IgniteException

Specified by:

affinity in interface IgfsSecondaryFileSystem

Throws:

IgniteException

setIgniteInstance

@IgniteInstanceResource
public void setIgniteInstance(IgniteEx ignite)

Parameters:

ignite - Ignite instance.

start

public void start()
           throws IgniteException

Specified by:

start in interface LifecycleAware

Throws:

IgniteException

stop

public void stop()
          throws IgniteException

Specified by:

stop in interface LifecycleAware

Throws:

IgniteException