Hadoop FileSystem interface implemented by DseFileSystem

The DseFileSystem class has partial support of the Hadoop FileSystem interface.

Specify the DSEFS URI by using the following form: dsefs://<host0>[:<port>][,<host1>[:<port>]]/. Multiple contact points can be specified in the URI, separated by commas. For example: dsefs://host1.example.com,host2.example.com/. If host1.example.com is down, a connection to host2.example.com will be attempted.

The following table outlines which methods have been implemented.

Methods of Hadoop FileSystem interface implemented by DseFileSystem
Method	Status	Comment
`getScheme()`	✓	since 5.0.12, 5.1.6
`getURI()`	✓
`getName()`	✓	default, deprecated
`getDefaultPort()`	✓	since 5.0.12, 5.1.6
`makeQualified(Path)`	✓	default
`getDelegationToken(String)`	☓	returns null
`addDelegationTokens(String, Credentials)`	☓
`collectDelegationTokens(...)`	☓
`getChildFileSystems()`	✓	default, returns null
`getFileBlockLocations(FileStatus, long, long)`	✓
`getFileBlockLocations(Path, long, long)`	✓
`getServerDefaults()`	✓	default, deprecated
`getServerDefaults(Path)`	✓	default
`resolvePath(Path)`	✓	default
`open`	✓	all variants, buffer size not supported
`create`	✓	all variants, checksum options, progress reporting and `APPEND`, `NEW_BLOCK` flags not supported
`createNonRecursive`	☓	all variants
`createNewFile`	✓	default
`append`	✓	all variants, progress reporting not supported
`concat`	✓	since 5.0.12, 5.1.6
`getReplication(Path)`	✓
`setReplication(Path, short)`	☓	does nothing
`rename`	✓
`truncate(Path, long)`	✓	since 5.0.12, 5.1.6
`delete(Path)`	✓
`delete(Path, boolean)`	✓
`deleteOnExit(Path)`	✓	default
`cancelDeleteOnExit(Path)`	✓	default
`exists(Path)`	✓
`isDirectory(Path)`	✓
`isFile(Path)`	✓
`getLength(Path)`	✓
`getContentSummary(Path)`	✓	default
`listStatus`	✓	all variants
`listCorruptFileBlocks(Path)`	☓	throws `UnsupportedOperationException`
`globStatus`	✓	default
`listLocatedStatus`	✓	default
`listStatusIterator`	✓	default
`listFiles`	✓	default
`getHomeDirectory()`	✓	default
`getWorkingDirectory()`	✓
`setWorkingDirectory()`	✓
`getInitialWorkingDirectory()`	⚠	default,returns null
`mkdirs`	✓
`copyFromLocalFile`	✓	default
`moveFromLocalFile`	✓	default
`copyToLocalFile`	✓	default
`moveToLocalFile`	✓	default
`startLocalOutput`	✓	default
`close`	✓
`getUsed`	✓	default, slow
`getBlockSize`	✓
`getDefaultBlockSize()`	✓	since 5.0.12, 5.1.6
`getDefaultBlockSize(Path)`	✓	since 5.0.12, 5.1.6
`getDefaultReplication()`	✓	since 5.0.12, 5.1.6
`getDefaultReplication(Path)`	✓	since 5.0.12, 5.1.6
`getFileStatus(Path)`	✓
`access(Path, FsAction)`	✓	default
`createSymLink`	☓	throws `UnsupportedOperationException`
`getFileLinkStatus`	⚠	default, same as `getFileStatus`
`supportsSymLinks`	✓	returns false
`getLinkTarget`	☓	throws `UnsupportedOperationException`
`resolveLink`	☓	throws `UnsupportedOperationException`
`getFileChecksum`	☓	returns null
`setVerifyChecksum`	☓	does nothing
`setWriteChecksum`	☓	does nothing
`getStatus`	☓	default, returns incorrect default data
`setPermission`	✓
`setOwner`	✓
`setTimes`	☓	does nothing
`createSnapshot`	☓	throws `UnsupportedOperationException`
`renameSnapshot`	☓	throws `UnsupportedOperationException`
`deleteSnapshot`	☓	throws `UnsupportedOperationException`
`modifyAclEntries`	☓	throws `UnsupportedOperationException`
`removeAclEntries`	☓	throws `UnsupportedOperationException`
`removeDefaultAcl`	☓	throws `UnsupportedOperationException`
`removeAcl`	☓	throws `UnsupportedOperationException`
`setAcl`	☓	throws `UnsupportedOperationException`
`getAclStatus`	☓	throws `UnsupportedOperationException`
`setXAttr`	☓	throws `UnsupportedOperationException`
`getXAttr`	☓	throws `UnsupportedOperationException`
`getXAttrs`	☓	throws `UnsupportedOperationException`
`listXAttrs`	☓	throws `UnsupportedOperationException`
`removeXAttr`	☓	throws `UnsupportedOperationException`

Hadoop FileSystem interface implemented by DseFileSystem

Was this helpful?

Give Feedback