Set up test EC2 instance to help investigate problems with OE builds by DevPlatform

[Paul Sokolovsky]

There's now OpenEmbeded build from DevPlatform on ci.linaro.org: https://ci.linaro.org/jenkins/job/hrw-image-lamp/ . It is fairly long-running (see lp:1020583) and its first run failed after 14hrs with:

NOTE: package libcheck-0.9.8-r1: task do_compile: Started
ERROR: Build of do_compile failed
ERROR: Traceback (most recent call last):
  File "/mnt/ci_build/workspace/hrw-image-lamp/builddir/openembedded-core/bitbake/lib/bb/build.py", line 431, in exec_task
  File "/mnt/ci_build/workspace/hrw-image-lamp/builddir/openembedded-core/bitbake/lib/bb/build.py", line 385, in _exec_task
  File "/mnt/ci_build/workspace/hrw-image-lamp/builddir/openembedded-core/bitbake/lib/bb/build.py", line 196, in exec_func
  File "/mnt/ci_build/workspace/hrw-image-lamp/builddir/openembedded-core/bitbake/lib/bb/build.py", line 277, in exec_func_shell
  File "/mnt/ci_build/workspace/hrw-image-lamp/builddir/openembedded-core/bitbake/lib/bb/process.py", line 123, in run
  File "/mnt/ci_build/workspace/hrw-image-lamp/builddir/openembedded-core/bitbake/lib/bb/process.py", line 104, in _logged_communicate
IOError: [Errno 30] Read-only file system

ERROR: Execution of event handler 'run_buildstats' failed
Traceback (most recent call last):
  File "run_buildstats(e)", line 104, in run_buildstats(e=<bb.build.TaskFailed object at 0xb2e8690>)
  File "buildstats.bbclass", line 5, in write_task_data(status='failed', logfile='/mnt/ci_build/workspace/hrw-image-lamp/builddir/build/tmp-eglibc/buildstats/linaro-image-lamp-qemuarmv7a/201207030933/libcheck-0.9.8-r1/do_compile', dev='xvdb', e=<bb.build.TaskFailed object at 0xb2e8690>)
IOError: [Errno 30] Read-only file system: '/mnt/ci_build/workspace/hrw-image-lamp/builddir/build/tmp-eglibc/buildstats/linaro-image-lamp-qemuarmv7a/201207030933/libcheck-0.9.8-r1/do_compile'

NOTE: package libcheck-0.9.8-r1: task do_compile: Failed
ERROR: Task 1910 (/mnt/ci_build/workspace/hrw-image-lamp/builddir/openembedded-core/meta/recipes-support/libcheck/libcheck_0.9.8.bb, do_compile) failed with exit code '1'
NOTE: Tasks Summary: Attempted 2351 tasks of which 337 didn't need to be rerun and 1 failed.
ERROR: Execution of event handler 'run_buildstats' failed
Traceback (most recent call last):
  File "run_buildstats(e)", line 47, in run_buildstats(e=<bb.event.BuildCompleted object at 0x9734a90>)
IOError: [Errno 30] Read-only file system: '/mnt/ci_build/workspace/hrw-image-lamp/builddir/build/tmp-eglibc/buildstats/linaro-image-lamp-qemuarmv7a/201207030933/build_stats'

I.e. it seemed like, after 14hrs of building, the filesystem on which build took place, became read-only. As trying to investigate this issue in jenkins would be like blind-work, and may take long time, it was discussed and agreed with hrw to set up a standalone EC2 instance, where he'll try to make a build, following closely steps which jenkins does.

[Paul Sokolovsky (pfalcon)]

Created i-32a3684a (m1.medium), using the same AMI as Jenkins' precise_cloud. Added hrw's LP SSH keys.

Run slave init script snippet from Jenkins:

apt-get update
apt-get install --assume-yes bzr
bzr branch lp:~linaro-infrastructure/linaro-ci/lci-build-tools /tmp/node-config
cd /tmp/node-config/node
time $PWD/setup-precise-node

To login:

ssh <email address hidden>

[Marcin Juszkiewicz (hrw)]

logged in, started job

[Marcin Juszkiewicz (hrw)]

NOTE: Tasks Summary: Attempted 3413 tasks of which 590 didn't need to be rerun and all succeeded.

Summary: There were 58 WARNING messages shown.

real 691m32.964s
user 345m56.301s
sys 208m43.979s

[Paul Sokolovsky (pfalcon)]

i-32a3684a was pending in stop state just in case it may needed again, and deleted now.