SwiftNativeFileSystem's directory representation is zero-byte file.
But in Swift / Horizon, directory representation is a trailing-slash.
This incompatibility has the following issues.
1. SwiftNativeFileSystem can't see pseudo-directory made by OpenStack Horizon
2. Swift/Horizon can't see pseudo-directory made by SwiftNativeFileSystem. But Swift/Horizon see a zero-byte file instead of that pseudo-directory.
3. SwiftNativeFileSystem can't see a file if there is no intermediate pseudo-directory object.
4. SwiftNativeFileSystem makes two objects when making a single directory (e.g. "hadoop fs -mkdir swift://test.test/dir/" => "dir" and "dir/" created)
I made a patch for fix this problem 3 month ago ( https://issues.apache.org/jira/browse/HADOOP-10948 ).
If fix this problem, break a compatibility. But incompatibility is debris(zero-byte file) remains.
If this problem is bug and needs to fix, I want to update patch.
i have experienced this bug when using Pig jobs writing their output to a Swift container. running the example Pig job from extras with a DataSource output to a container will create an "output" pseudo directory with the true output files in it, and it creates a file named "output" that is zero byte.