Sahara

Vanilla 2 plugin not used cinder/ephemeral drives for storing HDFS data

Bug #1473041 reported by Sergey Reshetnyak
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Sahara
Fix Released
High
Sergey Reshetnyak
Sahara 3.0.0 "liberty"
Juno
Fix Released
High
Vitalii Gridnev
Sahara 2014.2.4
Kilo
Fix Released
High
Vitalii Gridnev
Sahara 2015.1.1
Liberty
Fix Released
High
Sergey Reshetnyak
Sahara 3.0.0 "liberty"

Bug Description

Steps to reproduce:

1. Create cluster with Vanilla 2.x plugin with cinder storage. For example 2 worker with 100GB cinder volume.
2. Run hadoop dfs -df -h on node

Expected result:
Total space in HDFS: 200Gb

Actual result:
Total space: ~75 GB.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to sahara (master)

Fix proposed to branch: master
Review: https://review.openstack.org/200413

Changed in sahara:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara (master)

Reviewed: https://review.openstack.org/200413
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=5a1acb2651b6045bb16eddf96685ba1d38ea5167
Submitter: Jenkins
Branch: master

commit 5a1acb2651b6045bb16eddf96685ba1d38ea5167
Author: Sergey Reshetnyak <email address hidden>
Date: Fri Jul 10 11:04:22 2015 +0300

    Fix problem with using volumes for HDFS data in vanilla plugin

    Using 'dfs.namenode.data.dir' param wrong. Should use
    'dfs'datanode.data.dir' for storing datanode data

    Change-Id: I3e07fcdca34919daad290acb97f9add2a73a6a4e
    Closes-bug: #1473041

Changed in sahara:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara (stable/juno)

Reviewed: https://review.openstack.org/201797
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=9a6b72641f1555bb72dd2d098f2b1c39beb06276
Submitter: Jenkins
Branch: stable/juno

commit 9a6b72641f1555bb72dd2d098f2b1c39beb06276
Author: Sergey Reshetnyak <email address hidden>
Date: Fri Jul 10 11:04:22 2015 +0300

    Fix problem with using volumes for HDFS data in vanilla plugin

    Using 'dfs.namenode.data.dir' param wrong. Should use
    'dfs'datanode.data.dir' for storing datanode data

    Change-Id: I3e07fcdca34919daad290acb97f9add2a73a6a4e
    Closes-bug: #1473041
    (cherry picked from commit 5a1acb2651b6045bb16eddf96685ba1d38ea5167)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara (stable/kilo)

Reviewed: https://review.openstack.org/201799
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=fcd7972dde877ab42924e6f26bcdc28874eebb6b
Submitter: Jenkins
Branch: stable/kilo

commit fcd7972dde877ab42924e6f26bcdc28874eebb6b
Author: Sergey Reshetnyak <email address hidden>
Date: Fri Jul 10 11:04:22 2015 +0300

    Fix problem with using volumes for HDFS data in vanilla plugin

    Using 'dfs.namenode.data.dir' param wrong. Should use
    'dfs'datanode.data.dir' for storing datanode data

    Change-Id: I3e07fcdca34919daad290acb97f9add2a73a6a4e
    Closes-bug: #1473041
    (cherry picked from commit 5a1acb2651b6045bb16eddf96685ba1d38ea5167)

Thierry Carrez (ttx)
Changed in sahara:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in sahara:
milestone: liberty-2 → 3.0.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.