Re: [Toaster] My notes on importing commandline builds into toaster

--00000000000002fa60060ec4d15d
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Fri, Jan 12, 2024 at 7:40=E2=80=AFAM Richard Purdie <
[email protected]> wrote:

> Since we now have toaster back and operational and able to import
> commandline builds, and we have a usecase where this might be useful, I
> thought I'd try it and see what works/doesn't work.
>
> Alex Kanavin mentioned this build has issues:
>
> https://autobuilder.yoctoproject.org/typhoon/#/builders/88/builds/3515
>
> I went in and saved the eventlog:
>
> https://autobuilder.yocto.io/pub/failed-builds-data/20240112030913.json.z=
st
>
> then I tried to import this into a locally running instance of toaster.
> I had to compress/decompress the file as it was large.
>
> Toaster failed locally to import the build with no error given on the
> UI. Form the commandline it became clear it was trying to do "mkdir
> /home/pokybuild" which clearly isn't my local username. I created the
> directory just to move past this.
>
> The build then imported from the commandline. The issues I noticed were
> then:
>
> * the build duration was incorrect as it timed the event replay rather
> than the original build
> * toaster.bbclass wasn't included so the layerconfig is missing
> * buildstats info was missing as those weren't present
> * log links don't work as I didn't download the logs locally
> * the UI doesn't use any of the event timestamp data, just that from
> buildstats.
> * the cooker log is the replayed cooker log rather than the original
> one
> * trying to view logs results in tracebacks
>
> Unfortunately toaster doesn't display start/end times of the task and
> doesn't let you view the events themselves so it wasn't so useful for
> what I wanted to look into. You can get the task ordering if you add
> that field to the display (it isn't there by default) which did help a
> bit.
>
> I did save the buildstats so I could try a second run with more data:
>
> https://autobuilder.yocto.io/pub/failed-builds-data/stats.tgz
>
> Since I'm documenting this, I may as well save the logs too:
>
> tar -czf stats2.tgz buildstats log work/*/*/*/temp/
>
> https://autobuilder.yocto.io/pub/failed-builds-data/stats2.tgz
>
> Sadly even with that data restored to the correct place, it didn't load
> into the system correctly for some reason. I realised this may be
> because I didn't have the json eventlog in situ so retried again with
> that in the original build path but that didn't improve anything.
>
> I also realised toaster does read the packageinfo task data which I
> didn't have present so package information wasn't added.
>
> All in all, an interesting learning experience and we've some work to
> to do improve the experience here.
>

Thank you for capturing this. It will be invaluable in any attempts to
improve the features.

>
> Cheers,
>
> Richard
>
>
>
>
>
> -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-
> Links: You receive all messages sent to this group.
> View/Reply Online (#6142):
> https://lists.yoctoproject.org/g/toaster/message/6142
> Mute This Topic: https://lists.yoctoproject.org/mt/103684954/924729
> Group Owner: [email protected]
> Unsubscribe: https://lists.yoctoproject.org/g/toaster/unsub [
> [email protected]]
> -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-
>
>

--00000000000002fa60060ec4d15d
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div><br></div><div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=
=3D"gmail_attr">On Fri, Jan 12, 2024 at 7:40=E2=80=AFAM Richard Purdie &lt;=
<a href=3D"mailto:[email protected]">richard.purdie@linuxf=
oundation.org</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" sty=
le=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:soli=
d;padding-left:1ex;border-left-color:rgb(204,204,204)">Since we now have to=
aster back and operational and able to import<br>
commandline builds, and we have a usecase where this might be useful, I<br>
thought I&#39;d try it and see what works/doesn&#39;t work.<br>
<br>
Alex Kanavin mentioned this build has issues:<br>
<br>
<a href=3D"https://autobuilder.yoctoproject.org/typhoon/#/builders/88/build=
s/3515" rel=3D"noreferrer" target=3D"_blank">https://autobuilder.yoctoproje=
ct.org/typhoon/#/builders/88/builds/3515</a><br>
<br>
I went in and saved the eventlog:<br>
<br>
<a href=3D"https://autobuilder.yocto.io/pub/failed-builds-data/202401120309=
13.json.zst" rel=3D"noreferrer" target=3D"_blank">https://autobuilder.yocto=
.io/pub/failed-builds-data/20240112030913.json.zst</a><br>
<br>
then I tried to import this into a locally running instance of toaster.<br>
I had to compress/decompress the file as it was large.<br>
<br>
Toaster failed locally to import the build with no error given on the<br>
UI. Form the commandline it became clear it was trying to do &quot;mkdir<br=
>
/home/pokybuild&quot; which clearly isn&#39;t my local username. I created =
the<br>
directory just to move past this.<br>
<br>
The build then imported from the commandline. The issues I noticed were<br>
then:<br>
<br>
* the build duration was incorrect as it timed the event replay rather<br>
than the original build<br>
* toaster.bbclass wasn&#39;t included so the layerconfig is missing<br>
* buildstats info was missing as those weren&#39;t present<br>
* log links don&#39;t work as I didn&#39;t download the logs locally<br>
* the UI doesn&#39;t use any of the event timestamp data, just that from<br=
>
buildstats.<br>
* the cooker log is the replayed cooker log rather than the original<br>
one<br>
* trying to view logs results in tracebacks<br>
<br>
Unfortunately toaster doesn&#39;t display start/end times of the task and<b=
r>
doesn&#39;t let you view the events themselves so it wasn&#39;t so useful f=
or<br>
what I wanted to look into. You can get the task ordering if you add<br>
that field to the display (it isn&#39;t there by default) which did help a<=
br>
bit.<br>
<br>
I did save the buildstats so I could try a second run with more data:<br>
<br>
<a href=3D"https://autobuilder.yocto.io/pub/failed-builds-data/stats.tgz" r=
el=3D"noreferrer" target=3D"_blank">https://autobuilder.yocto.io/pub/failed=
-builds-data/stats.tgz</a><br>
<br>
Since I&#39;m documenting this, I may as well save the logs too:<br>
<br>
tar -czf stats2.tgz buildstats log work/*/*/*/temp/<br>
<br>
<a href=3D"https://autobuilder.yocto.io/pub/failed-builds-data/stats2.tgz" =
rel=3D"noreferrer" target=3D"_blank">https://autobuilder.yocto.io/pub/faile=
d-builds-data/stats2.tgz</a><br>
<br>
Sadly even with that data restored to the correct place, it didn&#39;t load=
<br>
into the system correctly for some reason. I realised this may be<br>
because I didn&#39;t have the json eventlog in situ so retried again with<b=
r>
that in the original build path but that didn&#39;t improve anything.<br>
<br>
I also realised toaster does read the packageinfo task data which I<br>
didn&#39;t have present so package information wasn&#39;t added.<br>
<br>
All in all, an interesting learning experience and we&#39;ve some work to<b=
r>
to do improve the experience here.<br>
</blockquote><div dir=3D"auto"><br></div><div dir=3D"auto">Thank you for ca=
pturing this. It will be invaluable in any attempts to improve the features=
.</div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;=
border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-=
color:rgb(204,204,204)"><br>
Cheers,<br>
<br>
Richard<br>
<br>
<br>
<br>
<br>
<br>
-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-<br>
Links: You receive all messages sent to this group.<br>
View/Reply Online (#6142): <a href=3D"https://lists.yoctoproject.org/g/toas=
ter/message/6142" rel=3D"noreferrer" target=3D"_blank">https://lists.yoctop=
roject.org/g/toaster/message/6142</a><br>
Mute This Topic: <a href=3D"https://lists.yoctoproject.org/mt/103684954/924=
729" rel=3D"noreferrer" target=3D"_blank">https://lists.yoctoproject.org/mt=
/103684954/924729</a><br>
Group Owner: <a href=3D"mailto:toaster%[email protected]" targ=
et=3D"_blank">[email protected]</a><br>
Unsubscribe: <a href=3D"https://lists.yoctoproject.org/g/toaster/unsub" rel=
=3D"noreferrer" target=3D"_blank">https://lists.yoctoproject.org/g/toaster/=
unsub</a> [<a href=3D"mailto:[email protected]" target=3D"_blank">ticotimo=
@gmail.com</a>]<br>
-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-<br>
<br>
</blockquote></div></div>

--00000000000002fa60060ec4d15d--