[Extra] swift-client list container command makes unnecessary REST calls

[Marc-Alexander Jäger]

Hi,

The "listContainer()" equivalent call in the sahara swift-client makes unnecessary REST calls for each object found in the container which makes it very slow the more files there are in the container. Possible fix in the SwiftNativeFileSystemStore class would be something like:

diff --git a/hadoop-swiftfs/src/main/java/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystemStore.java b/hadoop-swiftfs/src/main/ja
index c2d4f49..b9b08a7 100644
--- a/hadoop-swiftfs/src/main/java/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystemStore.java
+++ b/hadoop-swiftfs/src/main/java/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystemStore.java
@@ -556,7 +556,9 @@ public class SwiftNativeFileSystemStore {

       if (!name.endsWith("/")) {
         final Path filePath = getCorrectSwiftPath(new Path(name));
- files.add(getObjectMetadata(filePath, newest));
+ files.add(
+ new SwiftFileStatus(status.getBytes(), false, 0, 1l,
+ status.getLast_modified().getTime(), filePath));
         prevObjName = name;
       } else {
         if (prevObjName.length() + 1 == name.length() &&

Best regards
Marc

[Marc-Alexander Jäger (marc-alexander-jaeger)]

I am not sure if pseudo directories should be handled separately. I'am working on that as well.