*** tosky has quit IRC | 00:02 | |
ianw | the kernel install scripts must handle this? it's been a bit since i looked at those | 00:03 |
---|---|---|
ianw | iirc it's systemd | 00:04 |
clarkb | grub-mkconfig does it iirc | 00:05 |
ianw | it's not driven by https://www.freedesktop.org/software/systemd/man/kernel-install.html ? | 00:05 |
clarkb | it compiles the stuff in /etc/grub then writes it to the target destinatiob | 00:05 |
clarkb | the kernel install may trigger grub-mkinstall though? | 00:05 |
clarkb | something has to update the grub entries | 00:06 |
ianw | 99-grub-mkconfig.install: grub2-mkconfig --no-grubenv-update -o /boot/grub2/grub.cfg >& /dev/null | 00:08 |
ianw | i think it is in the install.d files of kernel-install | 00:08 |
ianw | https://bugzilla.redhat.com/show_bug.cgi?id=1737355#c6 is where i spent a long time debugging something similar-ish, but not for efi | 00:20 |
openstack | bugzilla.redhat.com bug 1737355 in diskimage-builder "no vmlinuz or initramfs on kernel update" [High,On_qa] - Assigned to iwienand | 00:20 |
ianw | centos/rhel7 may be different again, though | 00:22 |
*** jamesmcarthur has joined #openstack-infra | 00:23 | |
*** jamesmcarthur has quit IRC | 00:29 | |
*** smarcet has joined #openstack-infra | 00:32 | |
*** smarcet has joined #openstack-infra | 00:34 | |
*** smarcet has left #openstack-infra | 00:34 | |
ianw | "The grub2-efi package installs a prebaked grubx64.efi on the EFI System partition, which looks for grub.cfg on the ESP in /EFI/fedora/ whereas the grub2-install command creates a custom grubx64.efi, deletes the original installed one, and looks for grub.cfg in /boot/grub2/." | 00:36 |
fungi | debian/ubuntu update grub configuration as a hook triggered by kernel package installs | 00:46 |
fungi | i have a /boot/efi/EFI/debian/grubx64.efi | 00:47 |
*** rkukura has quit IRC | 00:48 | |
ianw | yea, but no grub.conf, right? | 00:49 |
fungi | uses /boot/grub/grub.cfg | 00:49 |
fungi | separate partitions | 00:49 |
*** ricolin has joined #openstack-infra | 00:50 | |
fungi | i have /boot/efi on /dev/mmcblk0p1 and /boot on /dev/mmcblk0p2 | 00:50 |
fungi | and then /dev/mmcblk0p3 luks-encrypted as a pv for the vg which contains my volume for / | 00:51 |
clarkb | ianw: on debuntu you get both if using secyreboot | 00:51 |
clarkb | and both are used | 00:51 |
clarkb | the one in the ESP points to the one in /boot/grub | 00:51 |
clarkb | fungi: if you cat the one in the efi dir you should have ~3 lines to confirm thqt | 00:51 |
fungi | i ran strings on it but it doesn't include any reference to a grub.cfg | 00:54 |
clarkb | fungi its ascii should be openable | 00:55 |
fungi | nope | 00:55 |
fungi | /boot/efi/EFI/debian/grubx64.efi: PE32+ executable (EFI application) x86-64 (stripped to external PDB), for MS Windows | 00:55 |
clarkb | oh sorry not the .efi file the .cfg file | 00:55 |
clarkb | I reaf that as a .cfg on the esp | 00:56 |
fungi | there isn't one in my efi partition | 00:56 |
clarkb | if you dont have that then the efi file should refer to the /boot | 00:56 |
clarkb | it may not refer specifically to the cfg file but you'll have the boot partition uuid or other identifier in there | 00:56 |
fungi | yeah, i didn't find any hd reference other than a templated string for substitution | 00:58 |
ianw | i have (,gpt2)/grub in there | 00:58 |
fungi | ahh, lookin | 00:58 |
fungi | indeed, (,gpt2)/grub in mine too | 00:59 |
fungi | i guess that means same raw block device as the efi tree, but second partition | 00:59 |
*** jamesmcarthur has joined #openstack-infra | 01:04 | |
ianw | hrm, i'm not sure i'm any closer to understanding how to install it all though | 01:05 |
clarkb | fungi: is sda2 where your /boot/grub lives? | 01:07 |
fungi | well /dev/mmcblk0p2 but close enough | 01:07 |
clarkb | ianw: I tested eith grub-mkconfig on an arm testnodeand that seemed to update the files | 01:07 |
clarkb | fungi: ya partition two which maps to efi gpt2 scheme | 01:07 |
fungi | correct | 01:07 |
fungi | grub-mkconfig (via a wrapper script) is what gets called in the debian package trigger for kernel updates too | 01:08 |
*** jamesmcarthur has quit IRC | 01:09 | |
clarkb | and itself is anotger script that runs scripts in /etc/grub | 01:09 |
clarkb | or /etc/grub.d | 01:09 |
openstackgerrit | wangfaxin proposed openstack/reviewday master: Update the community page. https://review.opendev.org/699141 | 01:35 |
*** jamesmcarthur has joined #openstack-infra | 01:35 | |
openstackgerrit | Ian Wienand proposed zuul/nodepool master: Dockerfile: add DEBUG environment flag https://review.opendev.org/694845 | 01:37 |
openstackgerrit | Ian Wienand proposed zuul/nodepool master: Also build sibling container images https://review.opendev.org/697393 | 01:37 |
openstackgerrit | Ian Wienand proposed zuul/nodepool master: Add container-with-siblings functional test https://review.opendev.org/693464 | 01:37 |
openstackgerrit | Ian Wienand proposed zuul/nodepool master: Dockerfile: install nodepool-builder dependencies https://review.opendev.org/693306 | 01:37 |
openstackgerrit | Ian Wienand proposed zuul/nodepool master: Add a container-with-releases functional test https://review.opendev.org/698818 | 01:37 |
openstackgerrit | Ian Wienand proposed zuul/nodepool master: Functional tests - use common verification script https://review.opendev.org/698834 | 01:37 |
*** jamesmcarthur has quit IRC | 01:40 | |
*** yamamoto has joined #openstack-infra | 01:54 | |
*** yamamoto has quit IRC | 02:02 | |
*** larainema has joined #openstack-infra | 02:04 | |
*** yamamoto has joined #openstack-infra | 02:10 | |
*** yamamoto has quit IRC | 02:16 | |
*** hwoarang_ has quit IRC | 02:22 | |
*** yamamoto has joined #openstack-infra | 02:33 | |
*** jamesmcarthur has joined #openstack-infra | 02:36 | |
*** jamesmcarthur_ has joined #openstack-infra | 02:46 | |
*** jamesmcarthur has quit IRC | 02:46 | |
*** lbragstad has joined #openstack-infra | 03:27 | |
*** jamesmcarthur_ has quit IRC | 03:28 | |
*** jamesmcarthur has joined #openstack-infra | 03:32 | |
*** psachin has joined #openstack-infra | 03:34 | |
*** jamesmcarthur has quit IRC | 03:37 | |
*** yamamoto has quit IRC | 03:39 | |
*** yamamoto has joined #openstack-infra | 03:42 | |
*** iokiwi has quit IRC | 04:08 | |
*** openstackgerrit has quit IRC | 04:08 | |
*** dmellado has quit IRC | 04:08 | |
*** diablo_rojo has quit IRC | 04:08 | |
*** irclogbot_0 has quit IRC | 04:08 | |
*** osmanlicilegi has quit IRC | 04:08 | |
*** dmsimard has quit IRC | 04:08 | |
*** strigazi has quit IRC | 04:08 | |
*** ddurst has quit IRC | 04:08 | |
*** bdodd has quit IRC | 04:08 | |
*** sean-k-mooney has quit IRC | 04:08 | |
*** stephenfin has quit IRC | 04:08 | |
*** jlvillal has quit IRC | 04:08 | |
*** Jeffrey4l has quit IRC | 04:08 | |
*** tbarron has quit IRC | 04:08 | |
*** brwyatt has quit IRC | 04:08 | |
*** edausq has quit IRC | 04:08 | |
*** ianw has quit IRC | 04:08 | |
*** otherwiseguy_ has quit IRC | 04:08 | |
*** aspiers has quit IRC | 04:08 | |
*** gagehugo has quit IRC | 04:08 | |
*** zer0c00l has quit IRC | 04:08 | |
*** szaher has quit IRC | 04:08 | |
*** larsks has quit IRC | 04:08 | |
*** gothicmindfood has quit IRC | 04:08 | |
*** jmccrory has quit IRC | 04:08 | |
*** openstackstatus has quit IRC | 04:11 | |
*** openstackstatus has joined #openstack-infra | 04:13 | |
*** ChanServ sets mode: +v openstackstatus | 04:13 | |
*** hwoarang has joined #openstack-infra | 04:20 | |
*** dave-mccowan has quit IRC | 04:23 | |
*** goldyfruit has joined #openstack-infra | 04:27 | |
*** rkukura has joined #openstack-infra | 04:39 | |
*** ykarel has joined #openstack-infra | 04:53 | |
*** goldyfruit has quit IRC | 04:58 | |
*** raukadah is now known as chkumar|rover | 05:22 | |
*** surpatil has joined #openstack-infra | 05:33 | |
*** yamamoto has quit IRC | 05:53 | |
*** yamamoto has joined #openstack-infra | 05:54 | |
*** yamamoto has quit IRC | 05:59 | |
*** gregoryo has joined #openstack-infra | 05:59 | |
*** ramishra has joined #openstack-infra | 06:04 | |
*** kozhukalov has joined #openstack-infra | 06:24 | |
*** pgaxatte has joined #openstack-infra | 06:31 | |
*** yamamoto has joined #openstack-infra | 06:42 | |
*** kozhukalov has quit IRC | 06:51 | |
*** slaweq has joined #openstack-infra | 06:54 | |
*** rcernin has quit IRC | 06:58 | |
*** zzehring has quit IRC | 07:04 | |
*** gregoryo has quit IRC | 07:07 | |
*** slaweq has quit IRC | 07:15 | |
*** pcaruana has joined #openstack-infra | 07:16 | |
*** lpetrut has joined #openstack-infra | 07:28 | |
*** ociuhandu has joined #openstack-infra | 07:32 | |
*** slaweq has joined #openstack-infra | 07:36 | |
*** ociuhandu has quit IRC | 07:36 | |
*** ykarel is now known as ykarel|lunch | 07:37 | |
*** yamamoto has quit IRC | 07:46 | |
*** yamamoto has joined #openstack-infra | 07:46 | |
*** tesseract has joined #openstack-infra | 07:48 | |
*** ralonsoh has joined #openstack-infra | 07:49 | |
*** yamamoto has quit IRC | 07:58 | |
*** ociuhandu has joined #openstack-infra | 07:58 | |
*** yamamoto has joined #openstack-infra | 07:58 | |
*** ociuhandu has quit IRC | 08:00 | |
*** ociuhandu has joined #openstack-infra | 08:01 | |
*** tosky has joined #openstack-infra | 08:02 | |
*** dchen has quit IRC | 08:04 | |
*** tkajinam has quit IRC | 08:06 | |
*** factor has quit IRC | 08:08 | |
*** tesseract has quit IRC | 08:11 | |
*** factor has joined #openstack-infra | 08:17 | |
yoctozepto | morning | 08:20 |
yoctozepto | openstackgerrit seems permagone | 08:21 |
*** ykarel|lunch is now known as ykarel| | 08:30 | |
*** ykarel| is now known as ykarel | 08:30 | |
*** rpittau|afk is now known as rpittau | 08:34 | |
*** pkopec has joined #openstack-infra | 08:35 | |
*** hashar has joined #openstack-infra | 08:37 | |
*** ociuhandu_ has joined #openstack-infra | 08:40 | |
*** sshnaidm|off is now known as sshnaidm | 08:41 | |
*** yamamoto has quit IRC | 08:42 | |
*** ociuhandu has quit IRC | 08:43 | |
*** yamamoto has joined #openstack-infra | 08:45 | |
amorin | clarkb, johnsom, I am reading my name from few days ago, you were asking if we changed something on our side | 08:51 |
amorin | can you let me know which region? We have both GRA1 and BHS1 for OSF | 08:51 |
amorin | and I dont know what TGC is :p | 08:51 |
*** jpena|off is now known as jpena | 08:52 | |
*** rcernin has joined #openstack-infra | 08:54 | |
*** lucasagomes has joined #openstack-infra | 08:55 | |
*** tesseract has joined #openstack-infra | 09:03 | |
*** tesseract has quit IRC | 09:04 | |
*** tesseract has joined #openstack-infra | 09:04 | |
*** apetrich has joined #openstack-infra | 09:06 | |
*** mugsie has quit IRC | 09:19 | |
*** mugsie has joined #openstack-infra | 09:21 | |
*** iurygregory has joined #openstack-infra | 09:26 | |
*** yolanda has quit IRC | 09:28 | |
*** yolanda__ has joined #openstack-infra | 09:28 | |
*** rcernin has quit IRC | 09:36 | |
*** rcernin has joined #openstack-infra | 09:36 | |
*** derekh has joined #openstack-infra | 09:44 | |
*** ociuhandu_ has quit IRC | 09:45 | |
*** zer0c00l has joined #openstack-infra | 10:05 | |
*** strigazi has joined #openstack-infra | 10:05 | |
*** Jeffrey4l has joined #openstack-infra | 10:05 | |
*** ddurst has joined #openstack-infra | 10:05 | |
*** jmccrory has joined #openstack-infra | 10:05 | |
*** edausq has joined #openstack-infra | 10:06 | |
*** larsks has joined #openstack-infra | 10:06 | |
*** otherwiseguy has joined #openstack-infra | 10:07 | |
*** gagehugo has joined #openstack-infra | 10:07 | |
*** diablo_rojo has joined #openstack-infra | 10:07 | |
*** stephenfin has joined #openstack-infra | 10:07 | |
*** osmanlicilegi has joined #openstack-infra | 10:07 | |
*** dmellado has joined #openstack-infra | 10:07 | |
*** ianw has joined #openstack-infra | 10:07 | |
*** ociuhandu has joined #openstack-infra | 10:07 | |
*** szaher has joined #openstack-infra | 10:07 | |
*** brwyatt has joined #openstack-infra | 10:07 | |
*** irclogbot_3 has joined #openstack-infra | 10:09 | |
*** bdodd has joined #openstack-infra | 10:11 | |
*** factor has quit IRC | 10:11 | |
*** jaosorior has joined #openstack-infra | 10:16 | |
*** rcernin has quit IRC | 10:16 | |
*** aspiers has joined #openstack-infra | 10:17 | |
*** gfidente has joined #openstack-infra | 10:38 | |
*** yamamoto has quit IRC | 10:53 | |
*** yamamoto has joined #openstack-infra | 10:53 | |
*** yamamoto has quit IRC | 11:03 | |
tosky | uhm, I see fortnebula mirror issues | 11:21 |
donnyd | On it | 11:21 |
tosky | thanks! | 11:22 |
*** rpittau is now known as rpittau|bbl | 11:22 | |
donnyd | There was a power blip over the weekend and it must not have came back on | 11:23 |
donnyd | The mirror is on it's own ups and is usually unaffected by power issues | 11:25 |
*** ociuhandu has quit IRC | 11:25 | |
*** ociuhandu has joined #openstack-infra | 11:26 | |
yoctozepto | infra-root, any change to bring back openstackgerrit? :-) | 11:28 |
yoctozepto | chance* :-) | 11:28 |
donnyd | infra-root can you ssh into the fortnebula mirror and see why the web server is not coming up | 11:28 |
*** SurajPatil has joined #openstack-infra | 11:34 | |
*** surpatil has quit IRC | 11:36 | |
*** surpatil has joined #openstack-infra | 11:40 | |
*** surpatil has quit IRC | 11:40 | |
*** tbarron has joined #openstack-infra | 11:41 | |
*** yamamoto has joined #openstack-infra | 11:41 | |
*** yamamoto has quit IRC | 11:41 | |
*** yamamoto has joined #openstack-infra | 11:42 | |
*** SurajPatil has quit IRC | 11:43 | |
*** ociuhandu has quit IRC | 11:47 | |
*** ociuhandu has joined #openstack-infra | 11:48 | |
*** ociuhandu has quit IRC | 11:52 | |
*** ociuhandu has joined #openstack-infra | 11:52 | |
*** ociuhandu has quit IRC | 11:53 | |
*** elod has quit IRC | 11:55 | |
*** elod has joined #openstack-infra | 11:56 | |
*** rfolco has joined #openstack-infra | 12:03 | |
donnyd | still working on the FN mirror - it appears to be an l3-agent issue. Its not bringing the router back up properly | 12:10 |
*** dmsimard has joined #openstack-infra | 12:12 | |
*** ociuhandu has joined #openstack-infra | 12:15 | |
*** ociuhandu has quit IRC | 12:15 | |
*** ociuhandu has joined #openstack-infra | 12:16 | |
*** ociuhandu has quit IRC | 12:17 | |
*** ociuhandu has joined #openstack-infra | 12:18 | |
*** ociuhandu has quit IRC | 12:18 | |
*** ociuhandu has joined #openstack-infra | 12:19 | |
donnyd | service is restored to the fortnebula mirror | 12:20 |
*** yamamoto has quit IRC | 12:20 | |
*** yamamoto has joined #openstack-infra | 12:21 | |
*** ociuhandu has quit IRC | 12:21 | |
*** ociuhandu has joined #openstack-infra | 12:22 | |
*** ociuhandu has quit IRC | 12:23 | |
*** pcaruana has quit IRC | 12:27 | |
*** pcaruana has joined #openstack-infra | 12:33 | |
*** jpena is now known as jpena|lunch | 12:39 | |
*** yamamoto has quit IRC | 12:43 | |
*** ociuhandu has joined #openstack-infra | 12:46 | |
*** tobias-urdin has quit IRC | 12:49 | |
*** ociuhandu has quit IRC | 12:51 | |
*** dpawlik has joined #openstack-infra | 12:53 | |
*** ociuhandu has joined #openstack-infra | 12:56 | |
*** rlandy has joined #openstack-infra | 12:58 | |
*** ociuhandu has quit IRC | 13:02 | |
*** jamesmcarthur has joined #openstack-infra | 13:04 | |
*** ykarel is now known as ykarel|afk | 13:05 | |
*** ociuhandu has joined #openstack-infra | 13:07 | |
*** Lucas_Gray has joined #openstack-infra | 13:08 | |
*** goldyfruit has joined #openstack-infra | 13:09 | |
*** rpittau|bbl is now known as rpittau | 13:09 | |
*** ociuhandu has quit IRC | 13:14 | |
*** rosmaita has joined #openstack-infra | 13:14 | |
*** rh-jelabarre has joined #openstack-infra | 13:15 | |
*** ykarel|afk has quit IRC | 13:15 | |
*** jamesmcarthur has quit IRC | 13:15 | |
*** ociuhandu has joined #openstack-infra | 13:15 | |
*** ociuhandu has quit IRC | 13:16 | |
*** tobias-urdin has joined #openstack-infra | 13:17 | |
*** ociuhandu has joined #openstack-infra | 13:17 | |
*** ociuhandu has quit IRC | 13:19 | |
*** ociuhandu has joined #openstack-infra | 13:19 | |
*** jpena|lunch is now known as pjena | 13:31 | |
*** pjena is now known as jpena | 13:32 | |
*** ociuhandu has quit IRC | 13:33 | |
*** yamamoto has joined #openstack-infra | 13:34 | |
*** yamamoto has quit IRC | 13:34 | |
*** yamamoto has joined #openstack-infra | 13:34 | |
*** goldyfruit has quit IRC | 13:37 | |
*** ociuhandu has joined #openstack-infra | 13:43 | |
*** Goneri has joined #openstack-infra | 13:44 | |
*** ociuhandu has quit IRC | 13:47 | |
*** ociuhandu has joined #openstack-infra | 13:48 | |
johnsom | amorin It was ubuntu-bionic-ovh-bhs1-0013345112. We just saw a job finish much faster than it usually does using the TCG (software virtualization) qemu driver. I was just curious if you had done something to speed up your nodepool instances or not. | 13:48 |
fungi | looking into openstackgerrit's disappearance now | 13:49 |
fungi | 2019-12-16 04:08:57 <-- openstackgerrit (~openstack@review01.openstack.org) has quit (*.net *.split) | 13:52 |
fungi | looks like it never recovered after that. it's still listening to gerrit events but doesn't realize it's not on a server | 13:53 |
fungi | restarting now | 13:53 |
*** ociuhandu has quit IRC | 13:54 | |
fungi | #status restarted gerritbot after a 04:08z netsplit left it disconnected from freenode | 13:54 |
openstackstatus | fungi: unknown command | 13:54 |
fungi | thanks for your quick work on the fn mirror, donnyd! | 13:55 |
fungi | l3 agent on the hypervisor host died/crashed? | 13:55 |
*** mriedem has joined #openstack-infra | 13:57 | |
*** stephenfin has quit IRC | 13:59 | |
*** stephenfin has joined #openstack-infra | 14:00 | |
*** openstackgerrit has joined #openstack-infra | 14:01 | |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Use explicit image paths https://review.opendev.org/690511 | 14:01 |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Update pip3 role to install from get-pip.py https://review.opendev.org/690766 | 14:01 |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Add service playbook and test run for prod gerrit https://review.opendev.org/691171 | 14:01 |
*** psachin has quit IRC | 14:01 | |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Add launchpadlib credentials to gerrit ansible https://review.opendev.org/691172 | 14:01 |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Add replication config to gerrit ansible https://review.opendev.org/691173 | 14:01 |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Plumb through storyboard hiera data https://review.opendev.org/691777 | 14:01 |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Clean up review comments https://review.opendev.org/692003 | 14:01 |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Plumb through secure.config contents https://review.opendev.org/691800 | 14:01 |
*** haleyb has joined #openstack-infra | 14:01 | |
*** stephenfin has quit IRC | 14:02 | |
*** jaosorior has quit IRC | 14:02 | |
*** stephenfin has joined #openstack-infra | 14:02 | |
*** stephenfin has quit IRC | 14:04 | |
*** ociuhandu has joined #openstack-infra | 14:05 | |
*** stephenfin has joined #openstack-infra | 14:05 | |
donnyd | fungi: something is going on with the latest round of patches for Stein. | 14:05 |
*** ykarel|afk has joined #openstack-infra | 14:06 | |
donnyd | I have had very very few issues with the L3 agent over the years. Honestly for me it has been very reliable | 14:06 |
donnyd | But something in the last update has made it not work so well | 14:06 |
*** Lucas_Gray has quit IRC | 14:08 | |
donnyd | I opened a bug because something isn't right | 14:11 |
*** ociuhandu_ has joined #openstack-infra | 14:11 | |
*** ociuhandu has quit IRC | 14:13 | |
*** stephenfin has quit IRC | 14:13 | |
*** stephenfin has joined #openstack-infra | 14:14 | |
*** ociuhandu_ has quit IRC | 14:16 | |
*** ociuhandu has joined #openstack-infra | 14:17 | |
*** ociuhandu has quit IRC | 14:21 | |
*** Lucas_Gray has joined #openstack-infra | 14:26 | |
*** dkehn has joined #openstack-infra | 14:26 | |
*** Lucas_Gray has quit IRC | 14:27 | |
*** stephenfin has quit IRC | 14:28 | |
*** stephenfin has joined #openstack-infra | 14:29 | |
*** smarcet has joined #openstack-infra | 14:29 | |
openstackgerrit | Monty Taylor proposed zuul/zuul master: Add --check-config option to zuul scheduler https://review.opendev.org/542160 | 14:30 |
*** ykarel|afk is now known as ykarel|away | 14:34 | |
*** beekneemech is now known as bnemec | 14:42 | |
*** onovy has quit IRC | 14:53 | |
*** smarcet has quit IRC | 14:56 | |
*** chkumar|rover is now known as ignoreirc | 14:57 | |
*** ignoreirc is now known as chkumar|rover | 14:58 | |
openstackgerrit | Merged zuul/nodepool master: Dockerfile: create APP_DIR https://review.opendev.org/693646 | 14:59 |
*** KeithMnemonic has joined #openstack-infra | 15:02 | |
*** psachin has joined #openstack-infra | 15:06 | |
openstackgerrit | Mark Goddard proposed openstack/project-config master: Add publish-to-pypi template for kolla-cli https://review.opendev.org/699223 | 15:11 |
donnyd | fungi: well that wasn't too hard to get fixed up. FN should be back to 100% from the last update now | 15:14 |
fungi | great, thanks again! | 15:15 |
*** smarcet has joined #openstack-infra | 15:17 | |
*** jgwentworth is now known as melwitt | 15:21 | |
*** smarcet has quit IRC | 15:21 | |
*** lpetrut has quit IRC | 15:22 | |
*** goldyfruit has joined #openstack-infra | 15:23 | |
*** ykarel|away has quit IRC | 15:23 | |
*** larainema has quit IRC | 15:33 | |
*** eharney has joined #openstack-infra | 15:37 | |
*** onovy has joined #openstack-infra | 15:43 | |
*** goldyfruit has quit IRC | 15:45 | |
*** ykarel|away has joined #openstack-infra | 15:56 | |
*** iurygregory has quit IRC | 15:57 | |
AJaeger | config-core, one tiny and one large grafana update for review, please: https://review.opendev.org/699001 and https://review.opendev.org/698994 | 15:59 |
openstackgerrit | Slawek Kaplonski proposed openstack/project-config master: Update Neutron's Grafana dashboard https://review.opendev.org/698264 | 15:59 |
*** efried is now known as efried_pto | 16:00 | |
AJaeger | config-core, another grafana update: https://review.opendev.org/#/c/698264 and one small review, please: https://review.opendev.org/699223 | 16:01 |
*** hashar has quit IRC | 16:05 | |
*** hashar has joined #openstack-infra | 16:07 | |
*** jamesmcarthur has joined #openstack-infra | 16:09 | |
*** jaosorior has joined #openstack-infra | 16:10 | |
*** chkumar|rover is now known as raukadah | 16:14 | |
*** pgaxatte has quit IRC | 16:15 | |
*** goldyfruit has joined #openstack-infra | 16:20 | |
*** dpawlik has quit IRC | 16:24 | |
*** gyee has joined #openstack-infra | 16:28 | |
*** yamamoto has quit IRC | 16:28 | |
*** yamamoto has joined #openstack-infra | 16:30 | |
*** yamamoto has quit IRC | 16:35 | |
*** ykarel|away has quit IRC | 16:38 | |
clarkb | AJaeger: I can take a look in a bit | 16:41 |
*** ykarel|away has joined #openstack-infra | 16:47 | |
*** lucasagomes has quit IRC | 16:52 | |
*** smarcet has joined #openstack-infra | 16:53 | |
clarkb | slaweq: AJaeger https://review.opendev.org/#/c/698264/2 will need to be rebased after haleyb's change merges. Sorry didn't catch that until approving haleyb's change | 17:00 |
*** ykarel|away has quit IRC | 17:01 | |
*** ykarel|away has joined #openstack-infra | 17:02 | |
openstackgerrit | Colleen Murphy proposed opendev/irc-meetings master: Change keystone meeting time https://review.opendev.org/699246 | 17:04 |
AJaeger | clarkb: thanks | 17:04 |
*** ricolin has quit IRC | 17:06 | |
haleyb | slaweq: should have pinged you on my dashboard change, think you had already left for the weekend | 17:07 |
openstackgerrit | Merged openstack/project-config master: Update Neutron failure rate dashboard https://review.opendev.org/699001 | 17:09 |
openstackgerrit | Merged openstack/project-config master: Add publish-to-pypi template for kolla-cli https://review.opendev.org/699223 | 17:10 |
openstackgerrit | Merged openstack/project-config master: Update the Octavia failure rate dashboard https://review.opendev.org/698994 | 17:10 |
*** udesale has joined #openstack-infra | 17:14 | |
*** hashar has quit IRC | 17:14 | |
*** ociuhandu has joined #openstack-infra | 17:15 | |
*** ykarel|away has quit IRC | 17:16 | |
*** goldyfruit has quit IRC | 17:17 | |
*** ociuhandu has quit IRC | 17:20 | |
haleyb | slaweq: you want me to rebase your dashboard change? | 17:22 |
*** smarcet has quit IRC | 17:23 | |
*** mattw4 has joined #openstack-infra | 17:26 | |
clarkb | slaweq: also tobiko-devstack-faults-centos-7 is failing after three job attempts because it runs devstack with python2.7 (because centos7) and nova requires python3.6 now | 17:26 |
clarkb | slaweq: I don't know what the best solution to that problem is as I don't think devstack supports centos 8 yet, but wanted to point it out as it is something I've discovered via trackign of job retries | 17:27 |
*** lpetrut has joined #openstack-infra | 17:31 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add support for smart reconfigurations https://review.opendev.org/652114 | 17:31 |
amorin | johnsom ok, we did nothing that I am aware of on the osf aggregate hosts | 17:32 |
amorin | so I dont know for now, | 17:32 |
*** lpetrut has quit IRC | 17:32 | |
amorin | I will ask the whole team to be sure | 17:32 |
johnsom | amorin Ok, maybe we just got luck and an empty host. lol | 17:32 |
amorin | are the results still doing very fast or was it only a one time? | 17:32 |
*** lpetrut has joined #openstack-infra | 17:32 | |
johnsom | amorin Not a big deal, really just for curiosity sake. | 17:33 |
johnsom | I'm not sure. I haven't dug into other runs to see which hosts they ran on. | 17:33 |
fungi | okay, heading out to grab lunch, back soon | 17:33 |
amorin | yes, maybe you were alone on the host, but that's weird, we are not doing so much oversubscription on your aggregate AFAIR | 17:33 |
amorin | so even on non empty host, the results should not be significantly different | 17:34 |
amorin | anyway, being alone on a host is definitely better than sharing :p | 17:34 |
johnsom | It was ~20 minutes faster than normal. Getting close to what we see with KVM, but I confirmed it was running the TCG driver. | 17:35 |
fungi | also, as far as busy hosts and oversubscription, what we tend to see on a lot of our jobs is that they're more i/o-constrained than anything else. could be that i/o starvation (or lack thereof) is at work in those cases? | 17:35 |
fungi | anyway, really headed to lunch now | 17:36 |
openstackgerrit | Merged opendev/irc-meetings master: Change keystone meeting time https://review.opendev.org/699246 | 17:36 |
amorin | fungi, johnsom yes, about IO congestion, I remember we already saw that by the past | 17:40 |
clarkb | zuul_attempts shows that ironic jobs are still filling disks (well checking attempts cross referenced against our cleanup playbook output for those jobs) | 17:40 |
amorin | I will check tomorrow, but maybe we added a host with nvme disks instead of SSD, which could improve the results | 17:40 |
clarkb | I've passed that along to the ironic irc channel | 17:40 |
openstackgerrit | Brian Haley proposed openstack/project-config master: Update Neutron's Grafana dashboard https://review.opendev.org/698264 | 17:40 |
johnsom | amorin Well, it was *good* so... Anyway, not worth a lot of effort. I was just curious if you had deployed some magic. | 17:41 |
amorin | I know we have nvme in some aggregates, not sure about the foundation one | 17:41 |
*** smarcet has joined #openstack-infra | 17:41 | |
amorin | johnsom, ok, dont worry, it's also interesting me if we can improve the results :p | 17:41 |
*** goldyfruit has joined #openstack-infra | 17:43 | |
*** ramishra has quit IRC | 17:48 | |
clarkb | johnsom: amorin it is theoretically possible that qemu improved too? | 17:48 |
amorin | that's an other option yes, I know we upgrade some part of libvirt / qemu in the last month | 17:49 |
amorin | I cant determine from here, but I may check that tomorrow | 17:49 |
johnsom | Possible, however none of the other providers have improved. This is why I was inquiring. | 17:52 |
*** goldyfruit has quit IRC | 17:58 | |
*** derekh has quit IRC | 18:02 | |
*** ijw has joined #openstack-infra | 18:07 | |
*** jpena is now known as jpena|off | 18:08 | |
*** ijw has quit IRC | 18:08 | |
*** ijw has joined #openstack-infra | 18:08 | |
*** psachin has quit IRC | 18:19 | |
*** lpetrut has quit IRC | 18:19 | |
clarkb | email sent on what I've found re flaky jobs and retries | 18:20 |
clarkb | hopefully that gives people a bit more context on why RETRY_LIMITS are somethign to look at if consistent | 18:20 |
*** ralonsoh has quit IRC | 18:25 | |
*** sshnaidm is now known as sshnaidm|afk | 18:26 | |
*** ociuhandu has joined #openstack-infra | 18:30 | |
AJaeger | clarkb: want to review slaweq's change since haleyb rebased and fixed it, please? https://review.opendev.org/#/c/698264 | 18:35 |
clarkb | done | 18:36 |
*** lpetrut has joined #openstack-infra | 18:36 | |
*** smarcet has quit IRC | 18:36 | |
*** smarcet has joined #openstack-infra | 18:39 | |
openstackgerrit | Merged openstack/project-config master: Update Neutron's Grafana dashboard https://review.opendev.org/698264 | 18:45 |
*** rpittau is now known as rpittau|afk | 18:55 | |
*** gfidente is now known as gfidente|afk | 18:57 | |
*** smarcet has quit IRC | 18:59 | |
*** tesseract has quit IRC | 19:06 | |
*** smarcet has joined #openstack-infra | 19:08 | |
*** rfolco has quit IRC | 19:09 | |
*** rfolco has joined #openstack-infra | 19:10 | |
*** lbragstad_ has joined #openstack-infra | 19:12 | |
*** lbragstad has quit IRC | 19:14 | |
openstackgerrit | Merged zuul/zuul master: Add support for smart reconfigurations https://review.opendev.org/652114 | 19:21 |
*** rlandy is now known as rlandy|brb | 19:22 | |
*** auristor has quit IRC | 19:24 | |
*** jamesmcarthur has quit IRC | 19:27 | |
*** jamesmcarthur has joined #openstack-infra | 19:28 | |
*** smarcet has quit IRC | 19:29 | |
*** kozhukalov has joined #openstack-infra | 19:36 | |
*** rlandy|brb is now known as rlandy | 19:45 | |
*** auristor has joined #openstack-infra | 19:46 | |
*** jamesmcarthur has quit IRC | 19:48 | |
*** kozhukalov has quit IRC | 19:51 | |
*** kozhukalov has joined #openstack-infra | 19:51 | |
*** udesale has quit IRC | 19:52 | |
*** Goneri has quit IRC | 19:53 | |
*** jaosorior has quit IRC | 19:59 | |
*** gyee has quit IRC | 19:59 | |
*** eharney has quit IRC | 20:00 | |
*** ijw has quit IRC | 20:07 | |
*** dtroyer has joined #openstack-infra | 20:08 | |
*** smarcet has joined #openstack-infra | 20:13 | |
*** smarcet has joined #openstack-infra | 20:15 | |
*** pkopec has quit IRC | 20:26 | |
*** gyee has joined #openstack-infra | 20:40 | |
*** slaweq has quit IRC | 20:49 | |
*** jamesmcarthur has joined #openstack-infra | 20:49 | |
ianw | infra-root: https://review.opendev.org/691187 and https://review.opendev.org/690798 add a mirror test job to the new arm64 zuul queue (spoiler alert: it worked, just a bit slowly :) | 20:53 |
clarkb | ianw: neat I'll try to take a look after lunch | 20:53 |
ianw | infra-root: also https://review.opendev.org/660541 is a quick one to stop errors on bridge now we have ansible 2.9 there | 20:53 |
*** jamesmcarthur_ has joined #openstack-infra | 20:58 | |
*** jamesmcarthur has quit IRC | 21:01 | |
*** Goneri has joined #openstack-infra | 21:06 | |
*** smarcet has quit IRC | 21:10 | |
*** factor has joined #openstack-infra | 21:13 | |
*** yamamoto has joined #openstack-infra | 21:18 | |
*** rcernin has joined #openstack-infra | 21:21 | |
*** yamamoto has quit IRC | 21:23 | |
openstackgerrit | Merged openstack/diskimage-builder master: Add arm64 based functional test https://review.opendev.org/676111 | 21:31 |
*** ijw has joined #openstack-infra | 21:34 | |
*** slaweq has joined #openstack-infra | 21:39 | |
*** goldyfruit has joined #openstack-infra | 21:44 | |
*** lpetrut has quit IRC | 21:48 | |
openstackgerrit | Lucas Xu proposed opendev/grafyaml master: Add Optional Query Paramter https://review.opendev.org/699301 | 21:48 |
openstackgerrit | Lucas Xu proposed opendev/grafyaml master: Add Optional Query Paramter https://review.opendev.org/699301 | 21:49 |
*** pcaruana has quit IRC | 21:55 | |
*** slaweq has quit IRC | 21:57 | |
*** rfolco is now known as rfolco|bbl | 21:58 | |
openstackgerrit | Lucas Xu proposed opendev/grafyaml master: Add Optional Query Paramter https://review.opendev.org/699301 | 22:02 |
*** mattw4 has quit IRC | 22:04 | |
*** mattw4 has joined #openstack-infra | 22:04 | |
*** mriedem has quit IRC | 22:12 | |
openstackgerrit | Lucas Xu proposed opendev/grafyaml master: Add Optional Query Paramter https://review.opendev.org/699301 | 22:13 |
*** kozhukalov has quit IRC | 22:18 | |
*** mattw4 has quit IRC | 22:28 | |
*** mattw4 has joined #openstack-infra | 22:28 | |
*** smarcet has joined #openstack-infra | 22:35 | |
*** rcernin has quit IRC | 22:39 | |
openstackgerrit | Ian Wienand proposed opendev/system-config master: Add roles for a basic static server https://review.opendev.org/697587 | 22:39 |
*** rcernin has joined #openstack-infra | 22:39 | |
*** iokiwi has joined #openstack-infra | 22:41 | |
*** gfidente|afk has quit IRC | 22:48 | |
*** rlandy is now known as rlandy|bbl | 22:51 | |
*** smarcet has quit IRC | 22:54 | |
*** ijw has quit IRC | 23:05 | |
*** tkajinam has joined #openstack-infra | 23:07 | |
*** rascasoft has quit IRC | 23:11 | |
*** rascasoft has joined #openstack-infra | 23:13 | |
*** jamesmcarthur_ has quit IRC | 23:26 | |
*** smarcet has joined #openstack-infra | 23:30 | |
*** rascasoft has quit IRC | 23:35 | |
*** tosky has quit IRC | 23:43 | |
*** ociuhandu has quit IRC | 23:43 | |
clarkb | corvus: fungi ianw's changes above should be quick reviews if you have a moent | 23:45 |
corvus | clarkb, ianw: why does install-ansible need to run on aarch64? shouldn't that just run on bridge which is ubuntu? | 23:47 |
corvus | er which is x86 | 23:47 |
clarkb | corvus: the test ianw adds runs an arm64 bridge too because nodesets are provisioned in the same cloud region aiui | 23:47 |
clarkb | corvus: its the second change if you want to look at it | 23:48 |
clarkb | (the linaro cloud can't provision x86 nodes) | 23:48 |
corvus | oooh... it was the cloud region thing i was missing | 23:48 |
ianw | yep, that :) we discussed it when i tried mixing clouds and it didn't work :) | 23:48 |
corvus | seems like a reasonable workaround. i expect if we ever have a cloud that can do both, we would do so in order to have a more realistic test. | 23:49 |
corvus | we could also add this as a use-case for nodepool to support crossing providers | 23:49 |
corvus | (we just never thought of that when we designed it) | 23:49 |
*** dchen has joined #openstack-infra | 23:50 | |
corvus | we have a check-arm64 pipeline? why is that? | 23:50 |
clarkb | the linaro cloud can only provide ~8 nodes and those nodes are quite a bit slower than x86 nodes we get elsewhere. Kolla in particular didn't want to wait for normal check results but still wants arm64 jobs to run | 23:52 |
clarkb | the idea is its like experimental but it always runs | 23:52 |
corvus | ack | 23:52 |
corvus | +3 all around | 23:53 |
ianw | yeah, it's useful for kolla, this, and i put a dib job in there too | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!