[data processing] Add a "swift" toggle to the configure tab on Spark job launch

Bug #1445233 reported by Trevor McKay
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Dashboard (Horizon)
Fix Released
Wishlist
Chad Roberts

Bug Description

The "edp.spark.adapt_for_swift" boolean configuration value may be set on the execution of a Spark job. It causes Sahara to modify the hadoop configuration of a Spark job so that swift urls may be dereferenced through hdfs at runtime.

It would be nice if users could simply check a box to set this config. Currently, a user must add this config on the configure tab by hand.

The label on the box can be something like "Enable Swift paths".

Default should probably be True.

Revision history for this message
Trevor McKay (tmckay) wrote :

"Importance" on this can probably be "wish list". It's a user experience thing -- the functionality is already available

Chad Roberts (croberts)
Changed in horizon:
assignee: nobody → Chad Roberts (croberts)
Chad Roberts (croberts)
Changed in horizon:
status: New → Confirmed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to horizon (master)

Fix proposed to branch: master
Review: https://review.openstack.org/187711

Changed in horizon:
status: Confirmed → In Progress
Changed in horizon:
assignee: Chad Roberts (croberts) → Vitaly Gridnev (vgridnev)
Chad Roberts (croberts)
Changed in horizon:
assignee: Vitaly Gridnev (vgridnev) → Chad Roberts (croberts)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to horizon (master)

Reviewed: https://review.openstack.org/187711
Committed: https://git.openstack.org/cgit/openstack/horizon/commit/?id=7e66a95b4f3914bd5beddbbc72d142fe63f36590
Submitter: Jenkins
Branch: master

commit 7e66a95b4f3914bd5beddbbc72d142fe63f36590
Author: Chad Roberts <email address hidden>
Date: Tue Jun 2 14:11:18 2015 -0400

    Adding option for Spark jobs to use Swift paths

    Adding an option for a Spark job to set the job config
    edp.spark.adapt_for_swift via the job launch form.

    Change-Id: I1fb2a299a9c15a3e312f67e0c1cd41d89f78d217
    Closes-Bug: #1445233

Changed in horizon:
status: In Progress → Fix Committed
Changed in horizon:
importance: Undecided → Low
milestone: none → liberty-rc1
importance: Low → Wishlist
Thierry Carrez (ttx)
Changed in horizon:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in horizon:
milestone: liberty-rc1 → 8.0.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.