[EDP] Improve validation checks for swift data sources
Bug #1315448 reported by
Trevor McKay
This bug affects 2 people
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| Sahara |
Fix Released
|
High
|
Trevor McKay | ||
Bug Description
The scheme that Sahara/Hadoop currently use to match credentials to swift paths at runtime demands that a swift data source URL be in the form
"swift:
But, we don't force that during validation. This can result in a job that is launched and fails at runtime with "KILLED" -- there may or may not be useful error information in the top level Oozie log. A user may have to drill down into task logs to find out what happened.
We need to make sure that swift urls conform:
* require "swift" as the scheme if the data source type is "swift"
* require the ".sahara" suffix on the container
* require a non-zero length object
| summary: |
- [EDP] Add validation check for ".sahara" suffix on swift containers for - data sources + [EDP] Improve validation checks for swift data sources |
| description: | updated |
Revision history for this message
| Openstack Gerrit (openstack-gerrit) wrote Fix merged to sahara (master) | #1 |
| Changed in sahara: | |
| status: | New → Fix Committed |
| Changed in sahara: | |
| importance: | Undecided → High |
| assignee: | nobody → Trevor McKay (tmckay) |
| milestone: | none → juno-1 |
| Changed in sahara: | |
| status: | Fix Committed → Fix Released |
| Changed in sahara: | |
| milestone: | juno-1 → 2014.2 |
To post a comment you must log in.
Reviewed: https:/
Committed: https:/
Submitter: Jenkins
Branch: master
commit 145389f52e004eb
Author: Trevor McKay <email address hidden>
Date: Fri May 2 14:14:09 2014 -0400
Improve validation for swift data source URLs
Closes-Bug: #1315448
Change-Id: I2799eed36c6dd7