*** dave-mccowan has quit IRC | 00:31 | |
*** dave-mccowan has joined #openstack-kolla | 00:34 | |
*** k_mouza has joined #openstack-kolla | 01:15 | |
*** diurnalist has quit IRC | 01:18 | |
*** k_mouza has quit IRC | 01:19 | |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic https://review.opendev.org/712005 | 01:28 |
---|---|---|
*** diurnalist has joined #openstack-kolla | 01:42 | |
*** dave-mccowan has quit IRC | 01:43 | |
*** dave-mccowan has joined #openstack-kolla | 01:54 | |
*** Blinkiz has quit IRC | 02:04 | |
*** diurnalist has quit IRC | 02:09 | |
*** dave-mccowan has quit IRC | 02:29 | |
*** oyrogerg has joined #openstack-kolla | 02:41 | |
*** Tony31 has joined #openstack-kolla | 02:50 | |
*** ykarel|away is now known as ykarel | 03:37 | |
*** JangwonLee has joined #openstack-kolla | 04:25 | |
*** k_mouza has joined #openstack-kolla | 04:28 | |
*** k_mouza has quit IRC | 04:32 | |
sorin-mihai | i managed to break a node so bad that i can't start any of the instances. is there some way to at least backup the instances before trying to redeploy the node? | 04:56 |
sorin-mihai | i'm only interested in preserving the qcow2 files, nothing else, so that i can import them as images later | 04:59 |
Tony31 | @sorin-mihai - an `instance` is just an .xml representation of what you want to define as compute resource, like `vCPU` `memory`. I think you mean you want to save the volume data - for this you would need to check what you're using for the volume (cinder or ceph or something else). Then, you can take a snapshot > upload to image > then download the image as a qcow. | 05:01 |
Tony31 | to investigate the reason why your instances are not starting, check nova and neutron logs for clues | 05:02 |
sorin-mihai | cinder/ceph wheren't enabled | 05:02 |
Tony31 | are you using a nova volume in that case? | 05:03 |
sorin-mihai | not sure that's the type. how do i find out? | 05:04 |
Tony31 | go to openstack gui > admin > volumes | 05:04 |
Tony31 | when it loads up the volumes it should say some information in the `host` column | 05:05 |
sorin-mihai | i guess not a volume either | 05:05 |
Tony31 | in my case, I am using cinder backend so my `host` shows: `hil-kstor2-dev.domain.com@nimble-cinder-dr#nimble-cinder-dr` which is the storage host -> backend | 05:06 |
Tony31 | you dont have any volumes? | 05:06 |
sorin-mihai | no volumes, only some images from which i started instances | 05:08 |
Tony31 | do you still have instances? | 05:08 |
sorin-mihai | yes. the node might not be that badly broken, maybe only the hypervisor | 05:09 |
Tony31 | if you're using the storage on the compute host for the volume data, then im not sure how you can save it because the data is supposed to be destroyed when the instance is removed. you'll probably have a raw image data on the host - do you know where it is? | 05:09 |
sorin-mihai | i guess i could try to create volume from the image that's attached to the instance? | 05:10 |
sorin-mihai | or maybe not, i think it's just the default image i used for all instances | 05:11 |
sorin-mihai | maybe i should just figure out how to fix nova-compute to start the instances again. i can't make any snapshots with whatever i have now | 05:15 |
*** skramaja has joined #openstack-kolla | 05:19 | |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic https://review.opendev.org/712005 | 05:24 |
*** diurnalist has joined #openstack-kolla | 05:29 | |
*** evrardjp has quit IRC | 05:35 | |
*** evrardjp has joined #openstack-kolla | 05:36 | |
*** diurnalist has quit IRC | 05:38 | |
*** abdysn has joined #openstack-kolla | 06:09 | |
*** sri_ has joined #openstack-kolla | 06:13 | |
sri_ | morning | 06:13 |
Tony31 | morning :) | 06:14 |
sri_ | sorin-mihai, I hope it's not a production environment :(. | 06:18 |
sorin-mihai | morning | 06:19 |
sorin-mihai | not exactly production, just a couple of instances that i don't want to rebuild from scratch | 06:19 |
*** JangwonLee has quit IRC | 06:21 | |
*** JangwonLee has joined #openstack-kolla | 06:22 | |
sri_ | oh ok. | 06:23 |
Tony31 | @sorin-mihai - if you could locate the actual volume date on the compute host, I have a strong feeling that it will be an image file (either raw or qcow but we can find out) so i think if you can locate it there then you can FTP it off the host and save it as an image; where you could then re-upload it into openstack and build another instance from it. | 06:23 |
Tony31 | @sorin-mihai can you check `/var/lob/nova/instances/` | 06:24 |
*** sri_ has quit IRC | 06:28 | |
*** irclogbot_2 has quit IRC | 06:29 | |
*** pbing19 has joined #openstack-kolla | 06:31 | |
*** k_mouza has joined #openstack-kolla | 06:44 | |
sorin-mihai | the thing is, the files are there in some docker managed volumes, but i'm more interested to get the nova-compute back up | 06:45 |
sorin-mihai | nova agent-list gives no output, while nova service-list says nova-compute in zone nova is down | 06:46 |
*** k_mouza has quit IRC | 06:49 | |
*** xinliang has joined #openstack-kolla | 06:58 | |
yoctozepto | morning | 07:18 |
yoctozepto | sorin-mihai: is the nova_compute container down? | 07:18 |
yoctozepto | can you simply start it? | 07:19 |
yoctozepto | and yes, the data is on docker volume | 07:19 |
yoctozepto | mounted in that container | 07:19 |
yoctozepto | under /var/lib/nova | 07:19 |
yoctozepto | in /var/lib/nova/instances you should find what you are looking for | 07:20 |
*** pbing19 has quit IRC | 07:22 | |
sorin-mihai | if kolla/centos-source-nova-compute:master-centos8 is the container you're asking about, it's running | 07:22 |
*** pbing19 has joined #openstack-kolla | 07:22 | |
*** xinliang has quit IRC | 07:23 | |
yoctozepto | sorin-mihai: yeah, that's the one, it should have the underscored name | 07:24 |
yoctozepto | you are about kolla-ansible, aren't you? | 07:24 |
yoctozepto | btw, why running master? are you trying to develop kolla/kolla-ansible? | 07:25 |
sorin-mihai | testing and breaking, trying to understand how it works. lol | 07:25 |
yoctozepto | ok | 07:26 |
*** irclogbot_2 has joined #openstack-kolla | 07:29 | |
sorin-mihai | nice, so the qcow file would be /var/lib/nova/instances/some_uuid/disk inside the compute container. now all i need is to identify the uuid for the instance i want to preserve | 07:30 |
yoctozepto | sorin-mihai: it must be in mariadb | 07:31 |
yoctozepto | though I obviously don't remember table names by heart | 07:31 |
sorin-mihai | the web interface is still working | 07:31 |
*** Tony31 has quit IRC | 07:35 | |
mnasiadka | morning | 07:38 |
mnasiadka | yoctozepto: about the ovs-ofctl, can't we ,,make'' it to use tcp: connection instead of socket? | 07:38 |
*** bengates has joined #openstack-kolla | 07:55 | |
*** bengates has quit IRC | 07:57 | |
*** bengates has joined #openstack-kolla | 07:57 | |
*** reph has joined #openstack-kolla | 07:58 | |
*** reph has quit IRC | 08:02 | |
*** reph has joined #openstack-kolla | 08:02 | |
mnasiadka | yoctozepto: ok, I answered to myself, it can't :) | 08:03 |
yoctozepto | mnasiadka: :-) | 08:08 |
mnasiadka | yoctozepto: and I'm afraid after V it will still use ovs-ofctl, even with of_interface=native | 08:08 |
*** Tony31 has joined #openstack-kolla | 08:10 | |
Tony31 | any coding expert here on Upwork? I am looking for a python resource. | 08:11 |
yoctozepto | mnasiadka: of_interface? it's long gone ;p | 08:11 |
yoctozepto | mnasiadka: no idea what they are trying in Victoria | 08:11 |
yoctozepto | mnasiadka: but ovs-ofctl call is deprecated | 08:11 |
mnasiadka | yoctozepto: looking at this: https://bugs.launchpad.net/neutron/+bug/1672340 - I don't think they ever fixed it | 08:14 |
openstack | Launchpad bug 1672340 in neutron "openvswitch firewall driver always uses deprecated ovs-ofctl instead of defined driver" [High,New] | 08:14 |
*** rpittau|afk is now known as rpittau | 08:15 | |
mnasiadka | yoctozepto: I would rather ask Neutron guys if ovs-ofctl call is deprecated - then how to stop using it? :D | 08:15 |
yoctozepto | mnasiadka: the deprec went in in Ussuri which is still pending | 08:16 |
yoctozepto | mnasiadka: for removal in V | 08:16 |
mnasiadka | yoctozepto: I see they are also missing contributors :) | 08:16 |
yoctozepto | mnasiadka: like the whole openstack ;-) or do you mean something more specific? | 08:17 |
mnasiadka | yoctozepto: naah, found the change to remove ofctl calls - https://review.opendev.org/#/c/711949/1 | 08:18 |
patchbot | patch 711949 - neutron - [WIP] Remove ofctl from firewall driver - 1 patch set | 08:18 |
mnasiadka | yoctozepto: around tox, seems we need a pre task to install it back for now? | 08:19 |
hrw | morning | 08:21 |
hrw | https://review.opendev.org/#/c/712987/ mnasiadka yoctozepto? | 08:22 |
patchbot | patch 712987 - kolla - kibana, nova-libvirt: handle it properly for non-x86 - 5 patch sets | 08:22 |
*** cah_link has joined #openstack-kolla | 08:24 | |
*** reph has quit IRC | 08:25 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: do not use unversioned Python binary https://review.opendev.org/710231 | 08:25 |
hrw | rebased | 08:26 |
yoctozepto | mnasiadka: link it in the bug report on k-@ | 08:37 |
yoctozepto | mnasiadka: re tox, I proposed the removal already | 08:38 |
yoctozepto | mnasiadka: see the comment there, looks like aarch64 image also needs setuptools now | 08:39 |
yoctozepto | hrw | 08:39 |
*** ykarel is now known as ykarel|lunch | 08:39 | |
yoctozepto | so soon all will need it | 08:39 |
*** reph has joined #openstack-kolla | 08:40 | |
yoctozepto | also, we need tox removal in all branches as images are the same | 08:40 |
yoctozepto | I guess it's our late cleanup | 08:40 |
hrw | yoctozepto: go for it | 08:41 |
hrw | I did not followed earlier discussion | 08:41 |
yoctozepto | I will if you don't, no problem, just signaling | 08:41 |
yoctozepto | busy atm | 08:42 |
hrw | ah. I see changes in backlog | 08:43 |
hrw | /lastlog command roxx | 08:43 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Custom haproxy script for monitoring galera https://review.opendev.org/710213 | 08:45 |
hrw | yoctozepto: did infra announced image changes? | 08:47 |
yoctozepto | hrw: re arm64 fungi was rather surprised | 08:48 |
yoctozepto | hrw: otherwise, yeah, via their specs | 08:48 |
hrw | thx | 08:49 |
hrw | weird that 'python3 -m venv ~/kolla-venv' does not install setuptools. or maybe it is other place | 08:52 |
yoctozepto | weird, agreed | 08:53 |
mnasiadka | weird is that on ubuntu python3-setuptools does not install python3-wheel :D | 08:53 |
hrw | PermissionError: [Errno 13] Permission denied: '/usr/local/lib/python3.6/site-packages/pbr' | 08:54 |
hrw | I wonder why no venv... | 08:54 |
yoctozepto | mnasiadka: well, not that weird, weird would be in reverse | 08:58 |
mnasiadka | yoctozepto: so up to some days ago, it was in reverse I guess? | 08:58 |
yoctozepto | mnasiadka: no idea, no urge to check | 08:59 |
yoctozepto | hrw: is that somewhere in aarch64 job? | 09:00 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 09:00 |
hrw | let's try that way | 09:00 |
*** xinliang has joined #openstack-kolla | 09:00 | |
hrw | yoctozepto: kolla-build-centos8-source | 09:01 |
hrw | yoctozepto: added ' extra_args: --user ' to pip call | 09:01 |
yoctozepto | hrw: ah, I was focusing on k-a | 09:01 |
yoctozepto | as it has to go first | 09:01 |
hrw | yoctozepto: same issue I think | 09:01 |
yoctozepto | hrw: nah, it should have venv | 09:02 |
*** suff has joined #openstack-kolla | 09:07 | |
*** Tony31 has quit IRC | 09:07 | |
hrw | ;d | 09:07 |
*** gfidente has joined #openstack-kolla | 09:12 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 09:13 |
hrw | argh. | 09:22 |
hrw | why opendev ci logs are so messy | 09:24 |
*** reph has quit IRC | 09:30 | |
*** arxcruz is now known as arxcruz|rover | 09:34 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 09:38 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 09:41 |
hrw | ansible-- | 09:41 |
mnasiadka | yoctozepto: so long for external-check in haproxy - seems support is uncompiled in redhat derivatives... :( | 09:44 |
yoctozepto | hrw: I believe we could agree but for different reasons probably ;p | 09:45 |
hrw | pip module supports creation of virtualenv, installing in it etc. | 09:45 |
yoctozepto | mnasiadka: omg | 09:45 |
hrw | but command module requires shell wrappers to use virtualenvs. | 09:45 |
mnasiadka | yoctozepto: there's still an option to spawn a container called mariadb_clustercheck with xinetd just as redhat does | 09:45 |
hrw | yay logic | 09:45 |
mnasiadka | I'll look into it | 09:45 |
yoctozepto | hrw: yeah, it's a bit of a pity consider ansible is python-based but still command was meant to be general... | 09:46 |
yoctozepto | mnasiadka: hmm, could make sense, does tripleo does it the same also? | 09:47 |
yoctozepto | mnasiadka: or do they depend on pacemaker magic? | 09:47 |
yoctozepto | mnasiadka: and what about osa? | 09:47 |
mnasiadka | yoctozepto: tripleo spawns clustercheck and xinetd on the host (and pacemaker checks status), OSA does the same but with haproxy | 09:49 |
hrw | we should add "echo HERE STARTS KOLLA MAGIC" to all CI jobs | 09:49 |
mnasiadka | yoctozepto: so let's try a separate container with xinetd and clustercheck | 09:49 |
hrw | the only file which gives any info about CI fauilures is fscking json... | 09:50 |
mnasiadka | we can use the regular mariadb image, so should be quite easy to do | 09:50 |
mnasiadka | hrw: you can see them on the ,,console'' tab? | 09:50 |
hrw | mnasiadka: https://zuul.opendev.org/t/openstack/build/f320986d3b4343e290e1939bc10317da/console - OK/CHECKED/SKIPPED. no failures at all | 09:52 |
hrw | mnasiadka: if run.yml fails then no info about it on console tab | 09:53 |
yoctozepto | mnasiadka: ++ | 09:54 |
yoctozepto | mnasiadka, hrw: https://review.opendev.org/713133 <- some stabilizer | 09:54 |
patchbot | patch 713133 - kolla-ansible - CI: Ignore neutron-server CRITICAL about WSREP - 1 patch set | 09:54 |
hrw | "/bin/bash: line 43: docker: command not found", | 09:55 |
hrw | "+ sudo cp -r /etc/kolla kolla_configs", | 09:55 |
hrw | "cp: cannot stat '/etc/kolla': No such file or directory", | 09:55 |
hrw | ha | 09:55 |
hrw | yoctozepto: +1 | 09:56 |
mnasiadka | hrw: if we would move this bash craziness in some extent to Ansible - it could get better | 09:56 |
*** abdysn has quit IRC | 09:58 | |
*** ykarel|lunch is now known as ykarel | 09:59 | |
hrw | mnasiadka: or made sure that run.yml is ran at all | 10:00 |
hrw | run.yml creates /etc/kolla and then post.yml copies from it. | 10:00 |
hrw | or fails at it as run.yml was not run | 10:00 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: CI: Ignore neutron-server CRITICAL about WSREP https://review.opendev.org/713133 | 10:01 |
hrw | +2 | 10:01 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: CI: Avoid tox (and clean up gate setup) https://review.opendev.org/713134 | 10:03 |
yoctozepto | post.yml should be more relaxed regarding copying of logs | 10:06 |
hrw | I would move most of run.yml to pre.yml to be honest | 10:07 |
hrw | whatever post depends on should be done in pre etc | 10:08 |
hrw | so setup_DISTRO.sh run, /etc/kolla creation etc | 10:08 |
hrw | and run.yml just install+run | 10:08 |
hrw | anyway... run.yml is not even started on https://review.opendev.org/#/c/713135/ so 'how to run kolla-build in virtualenv' is bogus question | 10:10 |
patchbot | patch 713135 - kolla - CI: Avoid tox - 6 patch sets | 10:10 |
*** xinliang has quit IRC | 10:12 | |
*** pbing19 has quit IRC | 10:30 | |
openstackgerrit | Merged openstack/kolla master: kibana, nova-libvirt: handle it properly for non-x86 https://review.opendev.org/712987 | 10:31 |
openstackgerrit | Merged openstack/kolla stable/train: Adds python3-systemd for ansible deploy interface https://review.opendev.org/712419 | 10:31 |
openstackgerrit | Merged openstack/kolla stable/train: Add cinderlib RPM to cinder-volume https://review.opendev.org/711206 | 10:31 |
openstackgerrit | Merged openstack/kolla master: CI: CentOS 8: Enable ceph-ansible jobs https://review.opendev.org/712719 | 10:31 |
openstackgerrit | Merged openstack/kolla master: CI: Ignore .zuul.d https://review.opendev.org/712730 | 10:31 |
mgoddard | yoctozepto: about tox - shall we start will reinstalling it as a simple solution we can backport? We can then look to refactor on master | 10:33 |
yoctozepto | mgoddard: k-a looks happy, k almost, I would go with removal as we are almost prepared | 10:35 |
*** ykarel is now known as ykarel|afk | 10:40 | |
osmanlicilegi | morning | 10:42 |
mgoddard | yoctozepto: will be a nasty backport | 10:42 |
hrw | ok, kibana change merged. now time for nasty train backport | 10:49 |
*** jbadiapa has joined #openstack-kolla | 10:55 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible stable/train: Use proper es schema in fluentd when use internal tls https://review.opendev.org/713188 | 10:56 |
*** shyamb has joined #openstack-kolla | 11:00 | |
*** cah_link has quit IRC | 11:04 | |
*** cah_link has joined #openstack-kolla | 11:06 | |
*** kplant has joined #openstack-kolla | 11:07 | |
*** abdysn has joined #openstack-kolla | 11:08 | |
*** also_stingrayza has joined #openstack-kolla | 11:11 | |
*** pbing19 has joined #openstack-kolla | 11:11 | |
*** k_mouza has joined #openstack-kolla | 11:11 | |
*** shyamb has quit IRC | 11:12 | |
*** stingrayza has quit IRC | 11:12 | |
openstackgerrit | Merged openstack/kolla stable/train: Build collectd image for CentOS8 https://review.opendev.org/710822 | 11:19 |
openstackgerrit | Merged openstack/kolla master: Add collectd-pcie-errors package for PCIe Errors https://review.opendev.org/710029 | 11:19 |
yoctozepto | mgoddard: i like 'em nasty | 11:21 |
mgoddard | yoctozepto: I don't doubt it | 11:21 |
*** kplant has quit IRC | 11:22 | |
*** sean-k-mooney has joined #openstack-kolla | 11:25 | |
*** kplant has joined #openstack-kolla | 11:26 | |
*** k_mouza has quit IRC | 11:27 | |
*** ykarel|afk is now known as ykarel | 11:29 | |
*** rpittau is now known as rpittau|bbl | 11:31 | |
*** k_mouza has joined #openstack-kolla | 11:33 | |
*** k_mouza has quit IRC | 11:33 | |
*** k_mouza_ has joined #openstack-kolla | 11:33 | |
openstackgerrit | Merged openstack/kolla master: neutron-base: drop python3-networking-ovn https://review.opendev.org/712762 | 11:37 |
*** reph has joined #openstack-kolla | 11:40 | |
yoctozepto | mgoddard, mnasiadka: re scenarios - as we no longer upgrade ceph on upgrades - I thought we might want to switch default multinode upgrade jobs to a variant without ceph? this could save some time and improve their reliability | 11:41 |
*** shyamb has joined #openstack-kolla | 11:45 | |
openstackgerrit | Merged openstack/kolla master: do not use unversioned Python binary https://review.opendev.org/710231 | 11:50 |
mnasiadka | yoctozepto: but we still need to make sure ceph clients work after upgrade :) | 11:51 |
mnasiadka | (No reason they shouldn’t, but...) | 11:52 |
yoctozepto | mnasiadka: well, we still get that from previous and current release ceph-ansible builds | 11:52 |
yoctozepto | mnasiadka: highly unlikely to break that with upgrade path | 11:52 |
yoctozepto | mnasiadka: but point taken | 11:52 |
yoctozepto | mnasiadka: we could leave periodics with them | 11:53 |
*** pbing19 has quit IRC | 11:55 | |
openstackgerrit | Merged openstack/kolla-ansible master: Use proper es schema in fluentd when use internal tls https://review.opendev.org/713122 | 11:55 |
yoctozepto | let's merge: https://review.opendev.org/713133 | 12:04 |
patchbot | patch 713133 - kolla-ansible - CI: Ignore neutron-server CRITICAL about WSREP - 2 patch sets | 12:04 |
*** Luzi has joined #openstack-kolla | 12:07 | |
*** shyamb has quit IRC | 12:24 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: OVN Support https://review.opendev.org/696841 | 12:24 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Use proper es schema in fluentd when use internal tls https://review.opendev.org/713188 | 12:25 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Custom haproxy script for monitoring galera https://review.opendev.org/710213 | 12:45 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: WIP: Add xinetd to mariadb image for Galera state checking via clustercheck https://review.opendev.org/710217 | 12:48 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: Fix --skip-existing and --skip-parents https://review.opendev.org/713221 | 12:59 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: Fix --skip-existing and --skip-parents https://review.opendev.org/713221 | 13:01 |
*** jimcrowleyibm has joined #openstack-kolla | 13:02 | |
*** JangwonLee has quit IRC | 13:12 | |
*** JangwonLee has joined #openstack-kolla | 13:13 | |
*** rpittau|bbl is now known as rpittau | 13:13 | |
openstackgerrit | Merged openstack/kolla-ansible master: CI: Ignore neutron-server CRITICAL about WSREP https://review.opendev.org/713133 | 13:22 |
*** diurnalist has joined #openstack-kolla | 13:35 | |
*** skramaja has quit IRC | 13:43 | |
*** skramaja has joined #openstack-kolla | 13:44 | |
*** TrevorV has joined #openstack-kolla | 13:46 | |
*** pbing19 has joined #openstack-kolla | 13:47 | |
*** mflynn has joined #openstack-kolla | 14:06 | |
*** Luzi has quit IRC | 14:11 | |
*** Luzi has joined #openstack-kolla | 14:24 | |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: CI: Don't fail on expected critical log messages https://review.opendev.org/713245 | 14:29 |
yoctozepto | mgoddard, mnasiadka: and I was wondering why stable/train are so faily ^ | 14:30 |
yoctozepto | :D | 14:30 |
mgoddard | hmm, true | 14:30 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: CI: Ignore neutron-server CRITICAL about WSREP https://review.opendev.org/713246 | 14:32 |
yoctozepto | let's get both in train, should make gate smoother | 14:33 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: Fix --skip-existing and --skip-parents https://review.opendev.org/713221 | 14:39 |
yoctozepto | mnasiadka: I wonder; did we see neutron failure on train? is not it something new with ussuri? | 14:44 |
yoctozepto | hrw: do you remember where we should report rdo packages have bugs https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_dc1/713188/2/check/kolla-ansible-centos8-binary/dc1e432/primary/logs/kolla/all-CRITICAL.txt - this is train c8 | 14:46 |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic https://review.opendev.org/712005 | 14:56 |
hrw | yoctozepto: #rdo is where I would start | 15:03 |
mnasiadka | yoctozepto: might be new... didn’t see it in train I think | 15:05 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: WIP: Remove support for CentOS 7 https://review.opendev.org/692450 | 15:17 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Switch default base image, tag as master https://review.opendev.org/713265 | 15:17 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Switch last mentions of yum to dnf https://review.opendev.org/713266 | 15:17 |
*** abdysn has quit IRC | 15:28 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: CentOS 8: Use master image tag by default https://review.opendev.org/713272 | 15:34 |
*** reph has quit IRC | 15:46 | |
*** ivve has joined #openstack-kolla | 16:03 | |
*** reph has joined #openstack-kolla | 16:08 | |
*** skramaja has quit IRC | 16:14 | |
*** cah_link has quit IRC | 16:16 | |
*** pbing19 has quit IRC | 16:18 | |
*** pbing19 has joined #openstack-kolla | 16:18 | |
*** pbing19 has quit IRC | 16:20 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: CentOS 8: Use master image tag by default https://review.opendev.org/713272 | 16:20 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Remove support for CentOS 7 https://review.opendev.org/713282 | 16:20 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Remove support for Python 2 on the host https://review.opendev.org/713283 | 16:20 |
*** pbing19 has joined #openstack-kolla | 16:20 | |
*** ykarel is now known as ykarel|away | 16:50 | |
*** brtknr_ has quit IRC | 16:57 | |
*** brtknr has joined #openstack-kolla | 16:57 | |
*** suff has quit IRC | 16:58 | |
*** rpittau is now known as rpittau|afk | 17:07 | |
*** Luzi has quit IRC | 17:14 | |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Use proper es schema in fluentd when use internal tls https://review.opendev.org/713188 | 17:16 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Switch default base image, tag as master https://review.opendev.org/713265 | 17:24 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: WIP: Remove support for CentOS 7 https://review.opendev.org/692450 | 17:24 |
openstackgerrit | Mark Goddard proposed openstack/kolla master: WIP: Remove support for CentOS 7 https://review.opendev.org/692450 | 17:25 |
hrw | waiting for working CI with more aarch64 changes | 17:27 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 17:35 |
*** evrardjp has quit IRC | 17:35 | |
hrw | fixed syntax error | 17:35 |
*** evrardjp has joined #openstack-kolla | 17:36 | |
*** reph has quit IRC | 17:37 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 17:47 |
hrw | fixed fix, venv used, hope it works | 17:47 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 17:52 |
hrw | install setuptools... | 17:52 |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic https://review.opendev.org/712005 | 17:53 |
*** bengates_ has joined #openstack-kolla | 17:57 | |
*** bengates_ has quit IRC | 17:58 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 18:01 |
hrw | install setuptools systemwide... | 18:01 |
*** bengates has quit IRC | 18:01 | |
hrw | and the whole fun of running python instead of python3... | 18:07 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 18:10 |
hrw | so let's install virtualenv too | 18:10 |
*** kplant has quit IRC | 18:15 | |
hrw | die py2!!!! FEW(YGT#$W%*IT @Y$*%@Y%!@#!@#!~#!@elevyn!!! | 18:15 |
openstackgerrit | Merged openstack/kolla stable/stein: Adds python3-systemd for ansible deploy interface https://review.opendev.org/712421 | 18:26 |
*** pbing19 has quit IRC | 18:32 | |
*** jonaspaulo has joined #openstack-kolla | 18:33 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Remove support for Python 2 on the host https://review.opendev.org/713283 | 18:46 |
hrw | how to ansible check 'when centos 7'? | 18:46 |
hrw | ansible_distribution_major_version ok | 18:47 |
*** pbing19 has joined #openstack-kolla | 18:48 | |
hrw | when: ansible_distribution is not 'CentOS' and ansible_distribution_major_version|int < 8 | 18:49 |
hrw | still does not look good | 18:49 |
hrw | nevermind | 18:50 |
hrw | ~curse CI | 18:53 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 18:53 |
hrw | tools/setup_* are past. | 18:54 |
mgoddard | hrw: as I said to yoctozepto earlier, we will need a solution we can backport. I would prefer to just install tox on stable branches. We can do a better fix on master like the above. WDYT? | 18:56 |
hrw | whatever works | 18:57 |
mgoddard | it's just quite a big change to be backporting, and it will not be clean | 18:58 |
hrw | I prefer to jsut install tox on stable/ | 18:58 |
hrw | otherwise we have two develpment branches | 18:58 |
hrw | and if we need to change ANYTHING on stable branches because of some infra changes there then I am gonna smash someone probably | 18:59 |
hrw | I am starting to HATE ansible | 18:59 |
hrw | 2020-03-16 18:59:21.248976 | TASK [Add key for Docker repository] | 18:59 |
hrw | 2020-03-16 18:59:23.221188 | primary | ERROR | 18:59 |
hrw | 2020-03-16 18:59:23.222045 | primary | { | 18:59 |
hrw | 2020-03-16 18:59:23.222183 | primary | "msg": "Warning: apt-key output should not be parsed (stdout is not a terminal)\nE: This command can only be used by root.", | 18:59 |
hrw | what the point of forcing 'become:true' to everything? | 19:00 |
hrw | I am one step from "become:true chmod +4755 `which ansible`" as part of CI scripts | 19:00 |
mgoddard | -1 :) | 19:01 |
hrw | fsck it. become: true everywhere! | 19:01 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 19:02 |
hrw | add apt key? sudo. add apt/yum repo? sudo. install package? sudo, echo 'elo!' sudo! | 19:03 |
hrw | 2020-03-16 19:05:34.433925 | primary | "msg": "key does not seem to have been added", | 19:07 |
hrw | 2020-03-16 19:05:34.434030 | primary | "warnings": [ | 19:07 |
hrw | yay. | 19:07 |
hrw | 2020-03-16 19:05:34.434134 | primary | "Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually" | 19:07 |
hrw | 2020-03-16 19:05:34.434246 | primary | ] | 19:07 |
hrw | in other words: do not use apt_key? | 19:08 |
* hrw EOD | 19:09 | |
hrw | tired of fighting with ansible | 19:09 |
*** gfidente is now known as gfidente|afk | 19:14 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 19:18 |
*** jbadiapa has quit IRC | 19:18 | |
*** mflynn has quit IRC | 19:21 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 19:28 |
*** k_mouza_ has quit IRC | 19:34 | |
hrw | yay. | 19:36 |
hrw | working directory is owned root. | 19:36 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Fix native openvswitch firewall driver in neutron-openvswitch-agent https://review.opendev.org/713129 | 19:36 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: CI: Avoid tox (and clean up gate setup) https://review.opendev.org/713134 | 19:37 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 19:39 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 19:57 |
*** vedup19 has joined #openstack-kolla | 20:40 | |
*** pbing19 has quit IRC | 20:44 | |
*** vedup19 has quit IRC | 20:58 | |
*** pbing19 has joined #openstack-kolla | 21:03 | |
*** vedup19 has joined #openstack-kolla | 21:07 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 21:10 |
*** pbing19 has quit IRC | 21:11 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 21:22 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 21:28 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: CI: Avoid tox https://review.opendev.org/713135 | 21:38 |
*** TrevorV has quit IRC | 22:04 | |
*** vedup19 has quit IRC | 22:06 | |
*** threestrands has joined #openstack-kolla | 22:51 | |
*** jonaspaulo has quit IRC | 23:18 | |
openstackgerrit | Merged openstack/kolla-ansible master: Fix native openvswitch firewall driver in neutron-openvswitch-agent https://review.opendev.org/713129 | 23:19 |
*** zzzeek has quit IRC | 23:21 | |
*** zzzeek has joined #openstack-kolla | 23:22 | |
*** Wellie has quit IRC | 23:57 | |
*** diurnalist has quit IRC | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!