[HDP 2.2] HadoopProvisionError: Failed to Provision Hadoop Cluster: Installation of Hadoop stack failed

[Evgeny Sikachev]

ENVIRONMENT:
       ISO:307

SCENARIO:
clusters:
  - plugin_name: hdp
    plugin_version: 2.2.0
    image: hdp22
    node_group_templates:
      - name: master
        flavor_id: '3'
        node_processes:
          - AMBARI_SERVER
          - GANGLIA_SERVER
          - HISTORYSERVER
          - NAGIOS_SERVER
          - NAMENODE
          - OOZIE_SERVER
          - RESOURCEMANAGER
          - SECONDARY_NAMENODE
          - ZOOKEEPER_SERVER
        auto_security_group: true
      - name: worker
        flavor_id: '3'
        node_processes:
          - DATANODE
          - HDFS_CLIENT
          - MAPREDUCE2_CLIENT
          - NODEMANAGER
          - OOZIE_CLIENT
          - PIG
          - YARN_CLIENT
          - ZOOKEEPER_CLIENT
          - TEZ_CLIENT
        volumes_per_node: 2
        volumes_size: 2
        auto_security_group: true
    cluster_template:
      name: hdp-22
      node_group_templates:
        master: 1
        worker: 3
      cluster_configs:
        YARN:
          yarn.log-aggregation-enable: false
        HDFS:
          datanode_du_reserved: 0
    cluster:
      name: scenario-hdp22

STEPS TO REPRODUCE:
1. Create node group template, cluster template, cluster from SCENARIO

EXPECTED RESULT:
Cluster has "Active" state

ACTUAL RESULT:
2015-04-14 15:43:52.551 19721 CRITICAL sahara.plugins.hdp.versions.version_2_2_0.versionhandler [-] Install command failed.
2015-04-14 15:43:52.596 19721 ERROR sahara.service.ops [-] Error during operating cluster 'scenario-hdp22-79bf7a08' (reason: Failed to Provision Hadoop Cluster: Installation of Hadoop stack failed.)
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops Traceback (most recent call last):
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops File "/usr/lib/python2.6/site-packages/sahara/service/ops.py", line 113, in wrapper
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops f(cluster_id, *args, **kwds)
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops File "/usr/lib/python2.6/site-packages/sahara/service/ops.py", line 202, in _provision_cluster
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops plugin.configure_cluster(cluster)
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops File "/usr/lib/python2.6/site-packages/sahara/plugins/hdp/ambariplugin.py", line 234, in configure_cluster
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops self.create_cluster(cluster)
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops File "/usr/lib/python2.6/site-packages/sahara/plugins/hdp/ambariplugin.py", line 62, in create_cluster
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops cluster.hadoop_version)
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops File "/usr/lib/python2.6/site-packages/sahara/plugins/hdp/ambariplugin.py", line 172, in _provision_cluster
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops cluster_spec, servers, ambari_info, name)
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops File "/usr/lib/python2.6/site-packages/sahara/plugins/hdp/versions/version_2_2_0/versionhandler.py", line 748, in provision_cluster
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops self._install_services(name, ambari_info)
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops File "/usr/lib/python2.6/site-packages/sahara/plugins/hdp/versions/version_2_2_0/versionhandler.py", line 338, in _install_services
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops _('Installation of Hadoop stack failed.'))
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops HadoopProvisionError: Failed to Provision Hadoop Cluster: Installation of Hadoop stack failed.
2015-04-14 15:43:52.596 19721 TRACE sahara.service.ops

LOGS:
http://paste.openstack.org/show/203891/

[Dmitry Mescheryakov (dmitrymex)]

Lowering to High, since that is just a problem in a single Sahara plugin

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Sergey Reshetnyak <email address hidden> on branch: stable/juno
Review: https://review.fuel-infra.org/6151

[Yaroslav Lobankov (ylobankov)]

Verified on

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  openstack_version: "2014.2.2-6.1"
  api: "1.0"
  build_number: "432"
  build_id: "2015-05-18_03-43-53"
  nailgun_sha: "076566b5df37f681c3fd5b139c966d680d81e0a5"
  python-fuelclient_sha: "38765563e1a7f14f45201fd47cf507393ff5d673"
  astute_sha: "cb655a9a9ad26848bcd9d9ace91857b6f4a0ec15"
  fuel-library_sha: "1621cb350af744f497c35f2b3bb889c2041465d8"
  fuel-ostf_sha: "9ce1800749081780b8b2a4a7eab6586583ffaf33"
  fuelmain_sha: "0e970647a83d9a7d336c4cc253606d4dd0d59a60"