[EDP] External HDFS data source doesn't work

Bug #1329079 reported by Andrew Lazarev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Sahara
Fix Released
High
Andrew Lazarev

Bug Description

Steps to reproduce:

1. Configure Job to use external HDFS
2. Run Job

Observed stacktrace:

2014-06-11 14:33:25.171 10332 INFO sahara.cli.sahara_all [-] 127.0.0.1 - - [11/Jun/2014 14:33:25] "GET /v1.1/8e44eb2ce32b4c72b82070abbcd61ba8/job-executions HTTP/1.1" 200 687 0.014070
2014-06-11 14:33:25.219 10332 ERROR sahara.service.edp.job_manager [-] Can't run job execution '4d5bf5a6-ff8f-40d4-aa5f-a80d3cf388f2' (reason: __exit__)
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager Traceback (most recent call last):
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager File "/Users/andrew/Sahara/sahara/sahara/service/edp/job_manager.py", line 121, in run_job
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager _run_job(job_execution_id)
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager File "/Users/andrew/Sahara/sahara/sahara/service/edp/job_manager.py", line 165, in _run_job
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager h.configure_cluster_for_hdfs(cluster, data_source)
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager File "/Users/andrew/Sahara/sahara/sahara/service/edp/hdfs_helper.py", line 100, in configure_cluster_for_hdfs
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager with inst.remote as r:
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager AttributeError: __exit__
2014-06-11 14:33:25.219 10332 TRACE sahara.service.edp.job_manager

Revision history for this message
Andrew Lazarev (alazarev) wrote :

Created BP to create integration test on that

Changed in sahara:
importance: Undecided → High
status: New → Confirmed
assignee: nobody → Andrew Lazarev (alazarev)
milestone: none → juno-2
Revision history for this message
Andrew Lazarev (alazarev) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to sahara (master)

Fix proposed to branch: master
Review: https://review.openstack.org/99491

Changed in sahara:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara (master)

Reviewed: https://review.openstack.org/99491
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=8b732228dc9dba2fee10ddc64a2de88a82440c5f
Submitter: Jenkins
Branch: master

commit 8b732228dc9dba2fee10ddc64a2de88a82440c5f
Author: Andrew Lazarev <email address hidden>
Date: Wed Jun 11 15:07:31 2014 -0700

    Fixed remote call in external HDFS configuration method

    Before the change code was failing with exception. Probably
    parentheses were not added during remote engine refactoring for
    heat engine preparation.

    Blueprint to create integration test: it-external-hdfs

    Change-Id: If9aef3be0cc88133d6e20c9e3ffb1ef75e16443c
    Closes-Bug: #1329079

Changed in sahara:
status: In Progress → Fix Committed
Changed in sahara:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in sahara:
milestone: juno-2 → 2014.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.