[hadoop-swift] Cannot access Swift Static Large Objects
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Sahara |
Confirmed
|
High
|
Unassigned |
Bug Description
When I try to access a file on swift of size 15Gb, Hadoop with swiftfs cannot read it because I think it gets confused because the file is split into segments.
ubuntu@
Account: v1
Container: googlebooks-
Object: eng/googlebooks
Content Type: application/
Content Length: 15339202495
Last Modified: Fri, 17 Jun 2016 05:54:17 GMT
ETag: d41d8cd98f00b20
Manifest: googlebooks%
Meta Mtime: 1448415962
Accept-Ranges: bytes
Keep-Alive: timeout=5, max=100
Server: Apache
Connection: Keep-Alive
X-Timestamp: 1466142857.00000
X-Trans-Id: tx0000000000000
ubuntu@
ubuntu@
16/06/17 08:38:25 INFO Configuration.
16/06/17 08:38:25 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=
16/06/17 08:38:25 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=
16/06/17 08:38:26 INFO Configuration.
16/06/17 08:38:27 INFO mapred.
16/06/17 08:38:27 INFO mapreduce.
16/06/17 08:38:27 ERROR streaming.
Streaming Command Failed!
Changed in sahara: | |
importance: | Undecided → High |
tags: | added: hadoop.swift.lib |
Changed in sahara: | |
status: | New → Confirmed |
summary: |
- [hadoop-swift] Cannot access SWIFT Static Large Objects + [hadoop-swift] Cannot access Swift Static Large Objects |
Changed in sahara: | |
milestone: | none → next |
milestone: | next → none |
tags: | added: sahara-extra |
How can I help diagnose this from the swift side?