Sahara

Impala fails to install on Ubuntu bare images in MapR plugin

Bug #1498479 reported by Artem Osadchiy on 2015-09-22

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Sahara	Fix Released	Medium	Artem Osadchiy	Sahara mitaka-1 "m1"

Bug Description

Impala fails to install on Ubuntu bare images in MapR plugin with the following exception

2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Traceback (most recent call last):
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/service/ops.py", line 164, in wrapper
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] f(cluster_id, *args, **kwds)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/service/ops.py", line 268, in _provision_cluster
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] plugin.configure_cluster(cluster)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/plugins/mapr/plugin.py", line 47, in configure_cluster
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] self._get_handler(cluster.hadoop_version).configure_cluster(cluster)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/plugins/mapr/base/base_version_handler.py", line 94, in configure_cluster
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] self._configurer.configure(cluster_context)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/plugins/mapr/base/base_cluster_configurer.py", line 71, in configure
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] self._install_services(cluster_context, instances)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/plugins/mapr/base/base_cluster_configurer.py", line 101, in _install_services
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] service.install(cluster_context, instances)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/plugins/mapr/domain/service.py", line 82, in install
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] instance)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/context.py", line 245, in __exit__
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] self._wait()
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/context.py", line 238, in _wait
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] self.exc_stacktrace)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] ThreadException: An error occurred in thread 'install-packages-b9ec5da4-94fa-4506-83cf-f6eafa74c34b': RemoteCommandException: Error during command execution: "apt-get install --force-yes -y mapr-hive=0.13* mapr-impala=1.4.1* mapr-impala-catalog=1.4.1* mapr-impala-server=1.4.1* mapr-impala-statestore=1.4.1*"
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Return code: 100
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] STDERR:
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] E: Unable to correct problems, you have held broken packages.
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2]
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] STDOUT:
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Reading package lists...
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Building dependency tree...
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Reading state information...
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] mapr-hive is already the newest version.
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Some packages could not be installed. This may mean that you have
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] requested an impossible situation or if you are using the unstable
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] distribution that some required packages have not yet been created
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] or been moved out of Incoming.
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] The following information may help to resolve the situation:
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2]
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] The following packages have unmet dependencies:
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] mapr-impala : Depends: libicu48 but it is not installable
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2]
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Error ID: cf3e2bc6-17c5-4f8c-9925-098be732d1bb
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Error ID: 19f8a4bc-783c-4be2-9239-458b62b9d263
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Traceback (most recent call last):
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/context.py", line 171, in _wrapper
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] func(*args, **kwargs)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/plugins/mapr/domain/service.py", line 92, in _install_packages_on_instance
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] timeout=_INSTALL_PACKAGES_TIMEOUT)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/utils/ssh_remote.py", line 718, in execute_command
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] get_stderr, raise_when_error)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/utils/ssh_remote.py", line 788, in _run_s
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] return self._run_with_log(func, timeout, *args, **kwargs)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/utils/ssh_remote.py", line 642, in _run_with_log
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] return self._run(func, *args, **kwargs)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/utils/ssh_remote.py", line 785, in _run
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] return procutils.run_in_subprocess(self.proc, func, args, kwargs)
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] File "/sahara/utils/procutils.py", line 53, in run_in_subprocess
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] raise exceptions.SubprocessException(result['exception'])
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] SubprocessException: RemoteCommandException: Error during command execution: "apt-get install --force-yes -y mapr-hive=0.13* mapr-impala=1.4.1* mapr-impala-catalog=1.4.1* mapr-impala-server=1.4.1* mapr-impala-statestore=1.4.1*"
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Return code: 100
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] STDERR:
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] E: Unable to correct problems, you have held broken packages.
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2]
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] STDOUT:
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Reading package lists...
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Building dependency tree...
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Reading state information...
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] mapr-hive is already the newest version.
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Some packages could not be installed. This may mean that you have
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] requested an impossible situation or if you are using the unstable
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] distribution that some required packages have not yet been created
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] or been moved out of Incoming.
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] The following information may help to resolve the situation:
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2]
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] The following packages have unmet dependencies:
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] mapr-impala : Depends: libicu48 but it is not installable
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2]
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Error ID: cf3e2bc6-17c5-4f8c-9925-098be732d1bb
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Error ID: 19f8a4bc-783c-4be2-9239-458b62b9d263
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2]
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2] Error ID: fafd6ccf-86da-42d7-bfa1-b9d0362d2ae7
2015-09-22 16:00:12.317 TRACE sahara.service.ops [instance: none, cluster: 15986807-3f16-4a17-a9fa-2aee50f514c2]

Tags:

Artem Osadchiy (aosadchiy) on 2015-09-22

Changed in sahara:
assignee:	nobody → Artem Osadchiy (aosadchiy)
tags:	added: plugin.mapr

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-09-22: Fix proposed to sahara (master)

Fix proposed to branch: master
Review: https://review.openstack.org/226339

Changed in sahara:
status:	New → In Progress

Sergey Reshetnyak (sreshetniak) on 2015-10-05

Changed in sahara:
milestone:	none → mitaka-1
importance:	Undecided → Medium

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-10-06: Fix merged to sahara (master)

Reviewed: https://review.openstack.org/226339
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=ae3dc6b620975147d754eaa01498c3b1929e44cb
Submitter: Jenkins
Branch: master

commit ae3dc6b620975147d754eaa01498c3b1929e44cb
Author: Artem Osadchyi <email address hidden>
Date: Tue Sep 22 16:52:43 2015 +0300

Update indexes after adding security repo in MapR plugin

    The root cause of the bug is that repo with necessary
    package exists but indexes are not updated so the package
    is not available.

Closes-Bug: #1498479
Change-Id: I38a0291e391057d8111ea304e4d00ad0c194e2e2

Changed in sahara:
status:	In Progress → Fix Committed

Revision history for this message

Doug Hellmann (doug-hellmann) wrote on 2015-12-03: Fix included in openstack/sahara 4.0.0.0b1

This issue was fixed in the openstack/sahara 4.0.0.0b1 development milestone.

Changed in sahara:
status:	Fix Committed → Fix Released

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.