opal-prd occ reset causes hardlockup

Bug #1808498 reported by bugproxy
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
The Ubuntu-power-systems project
Fix Released
High
Unassigned
skiboot (Ubuntu)
Fix Released
High
Canonical Foundations Team
Bionic
Fix Released
High
Manoj Iyer
Cosmic
Fix Released
High
Manoj Iyer
Disco
Fix Released
High
Canonical Foundations Team

Bug Description

[Impact]

- Without the fix, the system will crash on upstream hostboot with NMI enabled systems when opal-prd occ reset is triggered on OpenBMC boxes
- This patch enables HBRT to use HYP special wakeup register in openBMC which until now was only used in FSP based machines

[Testcase]

- opal-prd occ reset

[Regression Potential]
- Failure of OCC reset command

[Other Info]

 * Original bug report.

== Comment: #0 - Shilpasri G. Bhat <email address hidden> - 2018-12-14 00:14:51 ==
On upstream hostboot with NMI enabled, opal-prd occ reset crashes. The following upstream patch needs to be backported to the package to avoid the error.

commit 05dc67bf4f3d85fc6212d1644d46ce6d8bd71140
opal-prd: hservice: Enable hservice->wakeup() in BMC

Contact Information = <email address hidden>

bugproxy (bugproxy)
tags: added: architecture-ppc64le bugnameltc-174097 severity-high targetmilestone-inin---
Changed in ubuntu:
assignee: nobody → Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage)
affects: ubuntu → opal (Ubuntu)
Frank Heimes (fheimes)
Changed in ubuntu-power-systems:
status: New → Triaged
importance: Undecided → High
assignee: nobody → Canonical Foundations Team (canonical-foundations)
Frank Heimes (fheimes)
affects: opal (Ubuntu) → skiboot (Ubuntu)
tags: added: id-5c13daf7de57994a48b6c21d
Manoj Iyer (manjo)
Changed in skiboot (Ubuntu):
assignee: Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage) → Canonical Foundations Team (canonical-foundations)
importance: Undecided → High
Revision history for this message
bugproxy (bugproxy) wrote : Comment bridged from LTC Bugzilla

------- Comment From <email address hidden> 2019-02-14 23:44 EDT-------
Canonical, Could you please pick up those patches ?

Revision history for this message
Dimitri John Ledkov (xnox) wrote :

Disco has skiboot 6.2 and should have this patch in.

Cosmic & Bionic do not, and will need SRU.

Changed in skiboot (Ubuntu Disco):
status: New → Fix Released
Changed in skiboot (Ubuntu Cosmic):
status: New → Confirmed
Changed in skiboot (Ubuntu Bionic):
status: New → Triaged
status: Triaged → Invalid
status: Invalid → Confirmed
description: updated
Changed in skiboot (Ubuntu Cosmic):
assignee: nobody → Manoj Iyer (manjo)
Changed in skiboot (Ubuntu Bionic):
assignee: nobody → Manoj Iyer (manjo)
Revision history for this message
Andrew Cloke (andrew-cloke) wrote :

Next steps: Manoj to fill in SRU template, and transfer ownership back to Foundations to action the SRU.

Revision history for this message
Dimitri John Ledkov (xnox) wrote :

Upload was rejected from the unapproved queue

Rejected:
Rejected by Brian Murray: Missing SRU information in the description

skiboot (6.1-2ubuntu0.1) cosmic; urgency=medium

  * Enable HBRT to use HYP special wakeup register in openBMC. LP:
    #1808498

Date: Thu, 21 Feb 2019 12:20:21 +0100
Changed-By: Dimitri John Ledkov <email address hidden>
Maintainer: Ubuntu Developers <email address hidden>

Changed in skiboot (Ubuntu Cosmic):
status: Confirmed → Incomplete
Changed in skiboot (Ubuntu Bionic):
status: Confirmed → Incomplete
Changed in ubuntu-power-systems:
status: Triaged → Incomplete
assignee: Canonical Foundations Team (canonical-foundations) → nobody
Revision history for this message
bugproxy (bugproxy) wrote :

------- Comment From <email address hidden> 2019-03-07 04:36 EDT-------
(In reply to comment #10)
> Upload was rejected from the unapproved queue
>
> Rejected:
> Rejected by Brian Murray: Missing SRU information in the description
>
> skiboot (6.1-2ubuntu0.1) cosmic; urgency=medium
>
> * Enable HBRT to use HYP special wakeup register in openBMC. LP:
> #1808498

Does this mean its accepted -OR- you need more justification?

-Vasant

>
> Date: Thu, 21 Feb 2019 12:20:21 +0100
> Changed-By: Dimitri John Ledkov <email address hidden>
> Maintainer: Ubuntu Developers <email address hidden>

Revision history for this message
Dimitri John Ledkov (xnox) wrote :

@Vasant

If you can open https://bugs.launchpad.net/ubuntu/+source/skiboot/+bug/1808498 you will see that the bug description is lacking SRU documentation of [Impact], [Test Case], [Regression Potential]. A sample template of what is expected in each section is documented at: https://wiki.ubuntu.com/StableReleaseUpdates#SRU_Bug_Template

Revision history for this message
bugproxy (bugproxy) wrote :

------- Comment From <email address hidden> 2019-03-07 15:16 EDT-------
[Impact]

- Without the fix, the system will crash on upstream hostboot with NMI enabled systems when opal-prd occ reset is triggered on OpenBMC boxes
- This patch enables HBRT to use HYP special wakeup register in openBMC which until now was only used in FSP based machines

[Testcase]

- opal-prd occ reset

[Regression Potential]
- Failure of OCC reset command

description: updated
Revision history for this message
Brian Murray (brian-murray) wrote : Please test proposed package

Hello bugproxy, or anyone else affected,

Accepted skiboot into cosmic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/skiboot/6.1-2ubuntu0.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-cosmic to verification-done-cosmic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-cosmic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in skiboot (Ubuntu Cosmic):
status: Incomplete → Fix Committed
tags: added: verification-needed verification-needed-cosmic
Changed in skiboot (Ubuntu Bionic):
status: Incomplete → Fix Committed
tags: added: verification-needed-bionic
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello bugproxy, or anyone else affected,

Accepted skiboot into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/skiboot/5.10~rc4-1ubuntu1.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in ubuntu-power-systems:
status: Incomplete → Fix Committed
Mathew Hodson (mhodson)
Changed in skiboot (Ubuntu Bionic):
importance: Undecided → High
Changed in skiboot (Ubuntu Cosmic):
importance: Undecided → High
Revision history for this message
bugproxy (bugproxy) wrote : Comment bridged from LTC Bugzilla

------- Comment From <email address hidden> 2019-03-11 05:20 EDT-------
I have verified the patch in source tar file https://launchpad.net/ubuntu/+archive/primary/+sourcefiles/skiboot/5.10~rc4-1ubuntu1.2/skiboot_5.10~rc4.orig.tar.gz

Revision history for this message
Andrew Cloke (andrew-cloke) wrote :

Thanks. I've adjusted the bionic verification tags accordingly.

Are you also able to verify the cosmic candidate package referenced in comment #8, and available from https://launchpad.net/ubuntu/+source/skiboot/6.1-2ubuntu0.1?

tags: added: verification-done-bionic
removed: verification-needed-bionic
Revision history for this message
bugproxy (bugproxy) wrote :

------- Comment From <email address hidden> 2019-03-18 17:58 EDT-------
I checked and the patch is in the package. I also tried this on cosmic and bionic and worked fine. From cosmic:
ubuntu@ltc-boston25:~$ dpkg --list |grep opal-prd
ii opal-prd 6.1-2ubuntu0.1 ppc64el OPAL Processor Recovery Diagnostics daemon
ubuntu@ltc-boston25:~$ sudo opal-prd occ reset 08h
ubuntu@ltc-boston25:~$ cat /etc/*release* |grep VER
VERSION="18.10 (Cosmic Cuttlefish)"
VERSION_ID="18.10"
VERSION_CODENAME=cosmic

tags: added: verification-done-cosmic
removed: verification-needed-cosmic
tags: added: verification-done
removed: verification-needed
bugproxy (bugproxy)
tags: added: targetmilestone-inin18043
removed: targetmilestone-inin---
Revision history for this message
Brian Murray (brian-murray) wrote :

Checking the source package for the patch is not enough for the verification of an SRU. The binary package needs to be tested from the official Ubuntu archive. Subsequently, I am flipping the bionic tags back to verification-needed.

tags: added: verification-need-bionic
removed: verification-done-bionic
tags: added: verification-needed
removed: verification-done
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package skiboot - 6.1-2ubuntu0.1

---------------
skiboot (6.1-2ubuntu0.1) cosmic; urgency=medium

  * Enable HBRT to use HYP special wakeup register in openBMC. LP:
    #1808498

 -- Dimitri John Ledkov <email address hidden> Thu, 21 Feb 2019 12:20:21 +0100

Changed in skiboot (Ubuntu Cosmic):
status: Fix Committed → Fix Released
Revision history for this message
Brian Murray (brian-murray) wrote : Update Released

The verification of the Stable Release Update for skiboot has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
bugproxy (bugproxy) wrote : Comment bridged from LTC Bugzilla

------- Comment From <email address hidden> 2019-03-21 04:54 EDT-------
Hello Canonical,

We have verified/tested the fix and it looks good. It fixes the issue reported in this defect.

Thanks!

-Vasant

tags: added: verification-done verification-done-bionic
removed: verification-need-bionic verification-needed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package skiboot - 5.10~rc4-1ubuntu1.2

---------------
skiboot (5.10~rc4-1ubuntu1.2) bionic; urgency=medium

  * Enable HBRT to use HYP special wakeup register in openBMC. LP:
    #1808498

 -- Dimitri John Ledkov <email address hidden> Thu, 21 Feb 2019 12:23:32 +0100

Changed in skiboot (Ubuntu Bionic):
status: Fix Committed → Fix Released
Changed in ubuntu-power-systems:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.