Saturday, 2020-03-21

*** diurnalist has joined #openstack-kolla00:21
*** diurnalist has quit IRC00:26
*** k_mouza has quit IRC00:54
*** lile has quit IRC01:48
*** tonythomas has quit IRC02:11
*** hongbin has quit IRC03:29
*** negronjl_ has quit IRC04:32
*** negronjl has joined #openstack-kolla04:34
*** bengates has joined #openstack-kolla05:02
*** bengates has quit IRC05:06
*** evrardjp has quit IRC05:36
*** evrardjp has joined #openstack-kolla05:36
*** k_mouza has joined #openstack-kolla05:56
*** k_mouza has quit IRC06:00
*** e0ne has joined #openstack-kolla07:36
*** e0ne has quit IRC07:42
*** devfaz has quit IRC07:46
*** devfaz has joined #openstack-kolla07:52
cosmicsoundgood day07:55
cosmicsoundhas anyone seen issues with python-libvirt missing: Unable to discover resources: python-libvirt module is missing: ImportError: python-libvirt module is missing07:56
*** e0ne has joined #openstack-kolla07:56
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/train: Fix service_mapped_to_host filter  https://review.opendev.org/71425008:38
*** e0ne has quit IRC08:53
*** pbing19 has joined #openstack-kolla08:54
*** e0ne has joined #openstack-kolla09:16
*** e0ne has quit IRC09:31
*** Fl1nt has joined #openstack-kolla09:32
*** jonaspaulo has joined #openstack-kolla09:41
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: WIP/DNM: geneve testing  https://review.opendev.org/71412309:55
*** k_mouza has joined #openstack-kolla09:56
*** k_mouza has quit IRC10:00
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: OVN Support  https://review.opendev.org/69684110:11
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: WIP/DNM: geneve testing  https://review.opendev.org/71412310:57
*** gary_perkins has quit IRC11:39
*** gary_perkins has joined #openstack-kolla11:40
*** sorin-mihai__ has joined #openstack-kolla11:56
*** sorin-mihai_ has quit IRC11:59
*** admin0 has joined #openstack-kolla12:08
openstackgerritMerged openstack/kolla-ansible stable/train: Fix service_mapped_to_host filter  https://review.opendev.org/71425012:11
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: WIP/DNM: geneve testing  https://review.opendev.org/71412312:11
*** sorin-mihai__ has quit IRC12:32
*** e0ne has joined #openstack-kolla12:32
*** e0ne has quit IRC12:32
*** sorin-mihai__ has joined #openstack-kolla12:33
*** pbing19 has quit IRC12:53
kevinzhrw: yoctozepto: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b84/696841/119/check-arm64/kolla-ansible-debian-source-aarch64/b84231c/primary/logs/ansible/test-core-openstack, this one I guess you deployed the Kolla all-in-one in a VM right? For VM deploy, you need to specify CPU models in nova.conf. Could you share the nova.conf?13:26
kevinzHey cosmicsound, nice meeing you13:27
kevinzhttp://zuul.openstack.org/builds?job_name=kolla-publish-debian-source-aarch64   Image publish success.13:32
kevinzhttps://www.irccloud.com/pastebin/bYqJjfSL/13:34
*** diurnalist has joined #openstack-kolla13:43
*** diurnalist has quit IRC13:47
*** hongbin has joined #openstack-kolla14:22
yoctozeptokevinz: right, here are all the configs https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b84/696841/119/check-arm64/kolla-ansible-debian-source-aarch64/b84231c/primary/logs/kolla_configs/14:41
yoctozeptonote nova/libvirt/qemu is happy here; it could be that there is some bug along this path :-/14:42
yoctozeptokevinz: I read your logs - we are actually using the "none" model which is meant to be binary translation I guess14:44
yoctozeptothat said, I don't see us using a different cirros image, I guess we might have actually tried running bios/x86 image ;D14:45
kevinzyoctozepto: cpu_mode = none in arm64 can create instance without error, but actually launching instance will fail14:45
kevinzthis behavior is different with x86.14:46
yoctozeptokevinz: it's exactly this, it's not going to work @hrw14:46
yoctozeptowe forgot to actually test arm64 image ;d14:46
kevinzyoctozepto: It's OK, since we just test virt_type = kvm for a long time. But do not touch virt_type = qemu. So we meet this issue.14:47
kevinzI'm working on it in Nova, https://review.opendev.org/#/c/709494/, and I will try to get this merged ASAP next week14:48
patchbotpatch 709494 - nova - Add default cpu model for aarch64 - 13 patch sets14:48
kevinzyoctozepto: actually devstack-tempest-arm64 also rely on this patch :D, will figure out this soon14:49
yoctozeptokevinz: yeah, thanks; we need both this and the proper image - it's not gonna boot x86_64 anyway ;D14:55
yoctozeptokevinz: https://21de90ebb111255248ad-d7024b4a9df5a3cf5a52965a2b5a469a.ssl.cf5.rackcdn.com/696841/120/check-arm64/kolla-ansible-debian-source-aarch64/5741c66/primary/logs/system_logs/ps.txt15:03
yoctozeptorelevant line: http://paste.openstack.org/show/790972/15:03
yoctozeptoit went infinite loop most likely15:03
*** vesper11 has quit IRC15:05
*** vesper11 has joined #openstack-kolla15:07
kevinzyoctozepto: Cool, thx for that info, will check next Monday :D15:09
hrwyoctozepto: commit 54351ebae22fcdf78a331523a2a065800b9fad8615:32
yoctozeptohrw: must have mixed up tabs, I saw it downloading x86_64 variant15:33
hrwyoctozepto: https://pastebin.com/EDnp1G5P15:33
hrwyoctozepto: tempest image fetched x86 one15:33
yoctozepto2020-03-21 11:19:55 + curl -L -o .//cirros-0.4.0-aarch64-disk.img http://download.cirros-cloud.net/0.4.0//cirros-0.4.0-aarch64-disk.img15:34
hrwdid not played with tempest yet so forgot to change it15:34
yoctozeptoyeah, but we don't do tempest at all now15:34
yoctozeptoso it's hanging in qemu?15:35
hrw(nova-compute)[root@d05 etc]# grep cpu nova/nova.conf15:35
hrwcpu_mode = host-passthrough15:35
hrwlike it should be on aarch6415:35
hrwyoctozepto: or serial port is wrong setup15:36
yoctozeptowell, we run "none"15:36
yoctozeptoand the binary translator comes up15:36
hrwyoctozepto: on CI?15:36
yoctozeptomhm15:36
hrwfuck15:36
yoctozeptocpu_mode = none15:36
hrwthat's why15:36
yoctozeptothat's because (at least originally) on x86_64 there was no nested virt enabled15:37
hrwon aarch64 you mean15:37
yoctozeptono, x86_6415:37
yoctozeptootherwise we would run kvm15:37
yoctozeptonot qemu translator15:37
yoctozeptowe run "none" on all archs15:38
yoctozepto(of which we have 2 only of course)15:38
yoctozeptosee in nova overrides15:38
hrwfsck. we may need to bump cirros15:38
yoctozeptowell15:39
yoctozeptoI'm open15:39
hrwpatch in a queue15:39
yoctozeptoit's rather going in in devstack anyway15:39
hrwhttps://review.opendev.org/71118215:39
patchbotpatch 711182 - kolla-ansible - cirros: upgrade to 0.5.1 - 3 patch sets15:39
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: cirros: upgrade to 0.5.1  https://review.opendev.org/71118215:40
yoctozeptolet's see what happens :D15:40
*** hongbin has quit IRC15:42
hrwlogin as 'cirros' user. default password: 'gocubsgo'. use 'sudo' for root.15:42
hrwcirros5 login: /dev/root resized successfully [took 0.97s]15:42
hrwjust works15:43
yoctozeptonew one?15:43
yoctozepto(or any?)15:43
hrw0.5.1 locally15:43
yoctozeptook15:43
hrw(venv3) 15:44 (4s) hrw@j13-qrep-04:kolla-ansible$ openstack console log show cirros5|pastebinit15:44
hrwhttps://pastebin.com/t28BAKag15:44
yoctozeptolooks legit15:45
yoctozeptois it mode "none" or still pt?15:45
hrwpt15:45
yoctozeptoPlatform: QEMU KVM Virtual Machine15:45
hrwnone is next step15:45
yoctozeptoyeah15:45
yoctozeptok15:45
hrw502 nova_compute_virt_type: "qemu" # ?15:46
yoctozeptorather not, I think 'kvm' is an alias15:47
yoctozeptoah no, it is15:47
yoctozeptovirt_type = {{ nova_compute_virt_type }}15:47
yoctozeptothough they share most other paths15:47
yoctozeptonova_libvirt_cpu_mode: "none"15:47
hrwah ok15:48
yoctozeptoin gate we used simple override with file dropin15:48
yoctozeptonova_libvirt_cpu_mode: "{{ 'host-passthrough' if ansible_architecture == 'aarch64' else '' }}"15:48
yoctozeptoso we brutally override this in CI15:48
hrw501 # Valid options are [ qemu, kvm, vmware, xenapi ]15:49
hrwlooks like need an update15:49
yoctozeptowhat did you use15:49
hrwdefaults15:49
yoctozeptodoes not look like them ;p15:50
hrwk, see where to do a change15:50
hrwhttps://paste.debian.net/1135862/15:51
hrwtime to run https://pastebin.com/56nVtXvp and wait ~40 minutes15:52
*** hongbin has joined #openstack-kolla15:58
*** pbing19 has joined #openstack-kolla16:14
*** dave-mccowan has joined #openstack-kolla16:43
openstackgerritHongbin Lu proposed openstack/kolla master: Zun: add zun-cni-daemon image  https://review.opendev.org/70827316:44
*** e0ne has joined #openstack-kolla16:47
*** sorin-mihai__ has quit IRC16:56
*** sorin-mihai__ has joined #openstack-kolla16:57
*** sorin-mihai__ has quit IRC16:57
*** sorin-mihai__ has joined #openstack-kolla16:58
*** sorin-mihai__ has quit IRC16:59
*** sorin-mihai__ has joined #openstack-kolla17:01
*** sorin-mihai_ has joined #openstack-kolla17:07
*** sorin-mihai__ has quit IRC17:11
*** evrardjp has quit IRC17:36
*** dave-mccowan has quit IRC17:36
*** evrardjp has joined #openstack-kolla17:36
yoctozeptohrw: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_be2/711182/4/check-arm64/kolla-ansible-debian-source-aarch64/be2c537/primary/logs/ansible/test-core-openstack even 0.5.1 hangs with no console17:57
yoctozeptomust be qemu effect17:57
*** e0ne has quit IRC18:06
*** e0ne has joined #openstack-kolla18:07
hrwok18:59
hrwthx18:59
hrw~curse those who created openstack cli command set19:19
yoctozeptoxd19:43
*** e0ne has quit IRC19:44
hrwand nova and it's i440fx/bios ftw19:55
*** sorin-mihai__ has joined #openstack-kolla20:08
*** Fl1nt has quit IRC20:08
*** sorin-mihai_ has quit IRC20:10
*** diurnalist has joined #openstack-kolla21:51
*** vesper11 has quit IRC22:09
*** vesper11 has joined #openstack-kolla22:11
*** dave-mccowan has joined #openstack-kolla22:26
*** dking_desktop has joined #openstack-kolla22:27
*** dave-mccowan has quit IRC22:41
*** jonaspaulo has quit IRC23:23
*** pbing19 has quit IRC23:26
*** pbing19 has joined #openstack-kolla23:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!