Hadoop FileSystem interface implemented by DseFileSystem

The DseFileSystem class has partial support of the Hadoop FileSystem interface.

Specify the DSEFS URI by using the following form: dsefs://<host0>[:<port>][,<host1>[:<port>]]/. Multiple contact points can be specified in the URI, separated by commas. For example: dsefs://host1.example.com,host2.example.com/. If host1.example.com is down, a connection to host2.example.com will be attempted.

The following table outlines which methods have been implemented.

Methods of Hadoop FileSystem interface implemented by DseFileSystem
Method Status Comment

getScheme()

since 5.0.12, 5.1.6

getURI()

getName()

default, deprecated

getDefaultPort()

since 5.0.12, 5.1.6

makeQualified(Path)

default

getDelegationToken(String)

returns null

addDelegationTokens(String, Credentials)

collectDelegationTokens(...)

getChildFileSystems()

default, returns null

getFileBlockLocations(FileStatus, long, long)

getFileBlockLocations(Path, long, long)

getServerDefaults()

default, deprecated

getServerDefaults(Path)

default

resolvePath(Path)

default

open

all variants, buffer size not supported

create

all variants, checksum options, progress reporting and APPEND, NEW_BLOCK flags not supported

createNonRecursive

all variants

createNewFile

default

append

all variants, progress reporting not supported

concat

since 5.0.12, 5.1.6

getReplication(Path)

setReplication(Path, short)

does nothing

rename

truncate(Path, long)

since 5.0.12, 5.1.6

delete(Path)

delete(Path, boolean)

deleteOnExit(Path)

default

cancelDeleteOnExit(Path)

default

exists(Path)

isDirectory(Path)

isFile(Path)

getLength(Path)

getContentSummary(Path)

default

listStatus

all variants

listCorruptFileBlocks(Path)

throws UnsupportedOperationException

globStatus

default

listLocatedStatus

default

listStatusIterator

default

listFiles

default

getHomeDirectory()

default

getWorkingDirectory()

setWorkingDirectory()

getInitialWorkingDirectory()

default,returns null

mkdirs

copyFromLocalFile

default

moveFromLocalFile

default

copyToLocalFile

default

moveToLocalFile

default

startLocalOutput

default

close

getUsed

default, slow

getBlockSize

getDefaultBlockSize()

since 5.0.12, 5.1.6

getDefaultBlockSize(Path)

since 5.0.12, 5.1.6

getDefaultReplication()

since 5.0.12, 5.1.6

getDefaultReplication(Path)

since 5.0.12, 5.1.6

getFileStatus(Path)

access(Path, FsAction)

default

createSymLink

throws UnsupportedOperationException

getFileLinkStatus

default, same as getFileStatus

supportsSymLinks

returns false

getLinkTarget

throws UnsupportedOperationException

resolveLink

throws UnsupportedOperationException

getFileChecksum

returns null

setVerifyChecksum

does nothing

setWriteChecksum

does nothing

getStatus

default, returns incorrect default data

setPermission

setOwner

setTimes

does nothing

createSnapshot

throws UnsupportedOperationException

renameSnapshot

throws UnsupportedOperationException

deleteSnapshot

throws UnsupportedOperationException

modifyAclEntries

throws UnsupportedOperationException

removeAclEntries

throws UnsupportedOperationException

removeDefaultAcl

throws UnsupportedOperationException

removeAcl

throws UnsupportedOperationException

setAcl

throws UnsupportedOperationException

getAclStatus

throws UnsupportedOperationException

setXAttr

throws UnsupportedOperationException

getXAttr

throws UnsupportedOperationException

getXAttrs

throws UnsupportedOperationException

listXAttrs

throws UnsupportedOperationException

removeXAttr

throws UnsupportedOperationException

Was this helpful?

Give Feedback

How can we improve the documentation?

© 2024 DataStax | Privacy policy | Terms of use

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Pulsar, Pulsar, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries. Kubernetes is the registered trademark of the Linux Foundation.

General Inquiries: +1 (650) 389-6000, info@datastax.com