On Wed, Mar 15, 2017 at 8:05 PM, Michael Hudson-Doyle <
<email address hidden>> wrote:

> Is it easy to filter these out of the curtin log? It would be pretty
> easy to do this from the subiquity side now.
>

curtin reporting[1] will return events as they happen with timestamps;
 However, there are some
*long* poll events that do not have any interactive feedback at this time;
for example, the rsync
(which is done async); as well as any package upgrade/install; if a kernel
package needs updated
this is a bit of a blackhold (curtin will invoke apt or dpkg to do this
which we don't have a mechanism
to bubble an progress there).

w.r.t to filtering, we can re-introduce filtering inside the reporter,
however we may want to
configure subiquity to accept the events and filter itself.

1. http://curtin.readthedocs.io/en/latest/topics/reporting.html

Here's a pretty-print of an install which sent back events via webhook.

% ./tools/curtin-log-print
output/ZestyTestMdadmBcache/logs/webhooks-events.json
The total time elapsed since completing an event is printed after the "@"
character.
The time the event takes is printed after the "+" character.

[00.00000] curtin command install
|`->preparing for installation @00.05052s +00.01165s
|  `->removing previous storage devices @00.57202s +00.15468s
|  `->configuring disk: sda @01.72016s +01.14527s
|  `->configuring partition: bios_boot_partition @03.12751s +01.40073s
|  `->configuring partition: sda1 @04.73120s +01.59648s
|  `->configuring partition: sda2 @06.53184s +01.79702s
|  `->configuring partition: sda3 @08.50274s +01.96819s
|  `->configuring partition: sda4 @10.64785s +02.13898s
|  `->configuring partition: sda5 @12.91095s +02.25991s
|  `->configuring partition: sda6 @15.35934s +02.44189s
|  `->configuring disk: sdb @15.43740s +00.07361s
|  `->configuring disk: sdc @16.57825s +01.13677s
|  `->configuring partition: sdc1 @18.11159s +01.52621s
|  `->configuring raid: mddevice @19.98164s +01.85602s
|  `->configuring bcache: bcache1_raid @20.66754s +00.67885s
|  `->configuring bcache: bcache_normal @22.02653s +01.35241s
|  `->configuring bcache: bcachefoo @22.63083s +00.59545s
|  `->configuring format: sda1_fs @24.02448s +01.38501s
|  `->configuring format: bcache_raid_storage @24.29879s +00.26120s
|  `->configuring format: bcache_normal_storage @24.87102s +00.56441s
|  `->configuring format: bcachefoo_fulldiskascache_storage @25.33135s
+00.45056s
|  `->configuring mount: sda1_mount @25.75830s +00.41929s
|  `->configuring mount: bcache1_raid_mount @25.94002s +00.17267s
|  `->configuring mount: bcache0_mount @26.72055s +00.77280s
|  `->configuring mount: sda1_non_root_mount @27.02695s +00.29974s
|  `->curtin command block-meta @27.03383s +00.30662s
| `->running 'curtin block-meta simple' @27.07044s +27.01338s
|`->configuring storage @27.07817s +27.02310s
|  `->curtin command net-meta @27.46295s +00.01612s
| `->running 'curtin net-meta auto' @27.49044s +00.40116s
|`->configuring network @27.49830s +00.41487s
|  `->acquiring and extracting image from
http://10.245.168.20:21066//vmtest.root-tgz @41.56700s +13.69421s
|  `->curtin command extract @41.57522s +13.70242s
| `->running 'curtin extract' @41.60647s +14.09808s
|`->writing install sources to disk @41.61579s +14.11295s
|   `->writing config files and configuring apt @42.29365s +00.09317s
|   `->installing kernel @103.03017s +60.35821s
|   `->setting up swap @103.04930s +00.01003s
|   `->apply networking config @103.08798s +00.03186s
|   `->writing etc/fstab @103.10156s +00.00650s
|   `->configuring multipath @103.38228s +00.27664s
|   `->installing missing packages @103.43101s +00.03078s
|   `->updating packages on target system @103.44921s +00.01006s
|  `->curtin command curthooks @105.94782s +63.75829s
| `->running 'curtin curthooks' @105.98646s +64.35883s
|`->configuring installed system @105.99721s +64.37579s
|  `->curtin command hook @106.40656s +00.00960s
| `->running 'curtin hook' @106.43445s +00.42448s
|`->finalizing installation @106.44261s +00.43883s
|`->executing late commands @106.45499s +00.00686s
|`->curtin command install @107.49823s +107.49823s
 ---
107.49823 seconds total time



>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1642652
>
> Title:
>   Install progress should display curtin reporter output
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ubuntu/+source/subiquity/+bug/
> 1642652/+subscriptions
>