| *** schwicht has quit IRC | 00:10 | |
| *** schwicht has joined #openstack-ansible | 00:35 | |
| *** schwicht has quit IRC | 00:40 | |
| *** schwicht has joined #openstack-ansible | 00:41 | |
| *** tosky has quit IRC | 00:56 | |
| spotz | cjloader: If I see it go through before bed | 01:01 |
|---|---|---|
| openstackgerrit | Merged openstack/openstack-ansible stable/rocky: Adding missing tag for dynamic-address-fact task https://review.opendev.org/695573 | 01:13 |
| *** schwicht has quit IRC | 01:30 | |
| *** hamzy has joined #openstack-ansible | 01:47 | |
| *** KeithMnemonic has quit IRC | 01:52 | |
| *** schwicht has joined #openstack-ansible | 01:54 | |
| *** gyee has quit IRC | 02:25 | |
| *** johnthetubaguy has quit IRC | 03:42 | |
| *** udesale has joined #openstack-ansible | 03:42 | |
| *** dasp has quit IRC | 04:41 | |
| *** dasp has joined #openstack-ansible | 04:41 | |
| *** dave-mccowan has quit IRC | 05:14 | |
| *** pcaruana has joined #openstack-ansible | 06:01 | |
| *** udesale has quit IRC | 06:03 | |
| *** raukadah is now known as chkumar|ruck | 06:12 | |
| *** sshnaidm|afk is now known as sshnaidm | 06:27 | |
| *** udesale has joined #openstack-ansible | 06:37 | |
| *** rgogunskiy has joined #openstack-ansible | 06:48 | |
| *** miloa has joined #openstack-ansible | 06:59 | |
| miloa | Morning | 06:59 |
| *** arbrandes has quit IRC | 07:00 | |
| *** arbrandes has joined #openstack-ansible | 07:01 | |
| *** DanyC has joined #openstack-ansible | 07:04 | |
| *** DanyC has quit IRC | 07:23 | |
| *** dcdamien has joined #openstack-ansible | 07:39 | |
| *** cshen has joined #openstack-ansible | 07:57 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/696798 | 08:12 |
| *** yolanda has quit IRC | 08:18 | |
| *** rodolof has quit IRC | 08:23 | |
| *** spotz has quit IRC | 08:23 | |
| *** pcaruana has quit IRC | 08:24 | |
| *** jamesdenton has quit IRC | 08:24 | |
| *** jlvillal has quit IRC | 08:24 | |
| *** mgariepy has quit IRC | 08:24 | |
| *** jonher has quit IRC | 08:24 | |
| *** johanssone has quit IRC | 08:24 | |
| *** Jeffrey4l has quit IRC | 08:24 | |
| *** kmadac has quit IRC | 08:24 | |
| *** cosmicsound has quit IRC | 08:24 | |
| *** tbarron has quit IRC | 08:24 | |
| *** django has quit IRC | 08:24 | |
| *** irclogbot_3 has quit IRC | 08:24 | |
| *** cp- has quit IRC | 08:24 | |
| *** bjoernt has quit IRC | 08:24 | |
| *** Nick_A has quit IRC | 08:24 | |
| *** nsmeds has quit IRC | 08:24 | |
| *** aspiers has quit IRC | 08:24 | |
| *** szaher has quit IRC | 08:24 | |
| *** waxfire has quit IRC | 08:24 | |
| *** jmccrory has quit IRC | 08:24 | |
| *** rgogunskiy has quit IRC | 08:24 | |
| *** dasp has quit IRC | 08:24 | |
| *** hamzy has quit IRC | 08:24 | |
| *** gshippey has quit IRC | 08:24 | |
| *** Guest62786 has quit IRC | 08:24 | |
| *** Adri2000 has quit IRC | 08:24 | |
| *** mugsie has quit IRC | 08:24 | |
| *** fyx has quit IRC | 08:24 | |
| *** donnyd has quit IRC | 08:24 | |
| *** df_sbr has quit IRC | 08:24 | |
| *** cloudnull has quit IRC | 08:24 | |
| *** jtagcat has quit IRC | 08:24 | |
| *** versionsix has quit IRC | 08:24 | |
| *** owalsh has quit IRC | 08:24 | |
| *** rpittau|afk has quit IRC | 08:24 | |
| *** Carcer has quit IRC | 08:24 | |
| *** gregwork has quit IRC | 08:24 | |
| *** EmilienM has quit IRC | 08:24 | |
| *** toanster has quit IRC | 08:24 | |
| *** cshen has quit IRC | 08:24 | |
| *** dcdamien has quit IRC | 08:24 | |
| *** schwicht has quit IRC | 08:24 | |
| *** trident has quit IRC | 08:24 | |
| *** admin0 has quit IRC | 08:24 | |
| *** dmsimard has quit IRC | 08:24 | |
| *** errr_ has quit IRC | 08:24 | |
| *** d34dh0r53 has quit IRC | 08:24 | |
| *** openstackgerrit has quit IRC | 08:24 | |
| *** antonym has quit IRC | 08:24 | |
| *** brtknr has quit IRC | 08:24 | |
| *** evrardjp has quit IRC | 08:24 | |
| *** arbrandes has quit IRC | 08:24 | |
| *** ansmith has quit IRC | 08:24 | |
| *** zbr has quit IRC | 08:24 | |
| *** wpp has quit IRC | 08:24 | |
| *** do1jlr has quit IRC | 08:24 | |
| *** gixx has quit IRC | 08:24 | |
| *** andrea15 has quit IRC | 08:24 | |
| *** logan- has quit IRC | 08:24 | |
| *** ChosSimbaOne has quit IRC | 08:24 | |
| *** hwoarang has quit IRC | 08:24 | |
| *** NewJorg has quit IRC | 08:24 | |
| *** sep has quit IRC | 08:24 | |
| *** stingrayza has quit IRC | 08:24 | |
| *** samc-bbc has quit IRC | 08:24 | |
| *** mcarden has quit IRC | 08:24 | |
| *** poopcat has quit IRC | 08:24 | |
| *** asettle has quit IRC | 08:24 | |
| *** fresta has quit IRC | 08:24 | |
| *** mubix has quit IRC | 08:24 | |
| *** cyberpear has quit IRC | 08:24 | |
| *** bradm has quit IRC | 08:24 | |
| *** crazzy has quit IRC | 08:24 | |
| *** Anticimex has quit IRC | 08:24 | |
| *** stuartgr has quit IRC | 08:24 | |
| *** brad[] has quit IRC | 08:24 | |
| *** masterpe has quit IRC | 08:24 | |
| *** dirk has quit IRC | 08:24 | |
| *** tinwood has quit IRC | 08:24 | |
| *** persia_ has quit IRC | 08:24 | |
| *** jroll has quit IRC | 08:24 | |
| *** mrda has quit IRC | 08:24 | |
| *** bverschueren has quit IRC | 08:24 | |
| *** gouthamr has quit IRC | 08:24 | |
| *** sshnaidm has quit IRC | 08:24 | |
| *** ondrejbu- has quit IRC | 08:24 | |
| *** gundalow has quit IRC | 08:24 | |
| *** alanmeadows has quit IRC | 08:24 | |
| *** miloa has quit IRC | 08:24 | |
| *** udesale has quit IRC | 08:24 | |
| *** mathlin has quit IRC | 08:24 | |
| *** mensis has quit IRC | 08:24 | |
| *** Blinkiz has quit IRC | 08:24 | |
| *** gokhani has quit IRC | 08:24 | |
| *** oligau has quit IRC | 08:24 | |
| *** kopecmartin has quit IRC | 08:24 | |
| *** kukacz_ has quit IRC | 08:24 | |
| *** weshay_ has quit IRC | 08:24 | |
| *** chkumar|ruck has quit IRC | 08:24 | |
| *** rickflare has quit IRC | 08:24 | |
| *** ioni has quit IRC | 08:24 | |
| *** tobberydberg has quit IRC | 08:24 | |
| *** Miouge has quit IRC | 08:24 | |
| *** j^2 has quit IRC | 08:24 | |
| *** gary_perkins has quit IRC | 08:24 | |
| *** timburke has quit IRC | 08:24 | |
| *** mbuil has quit IRC | 08:24 | |
| *** arxcruz has quit IRC | 08:24 | |
| *** jhesketh has quit IRC | 08:24 | |
| *** snadge has quit IRC | 08:24 | |
| *** redkrieg has quit IRC | 08:24 | |
| *** mattoliverau has quit IRC | 08:24 | |
| *** ebbex has quit IRC | 08:24 | |
| *** noonedeadpunk has quit IRC | 08:24 | |
| *** nwonknu has quit IRC | 08:24 | |
| *** andymccr has quit IRC | 08:24 | |
| *** mhayden has quit IRC | 08:24 | |
| *** johnsom has quit IRC | 08:24 | |
| *** csmart has quit IRC | 08:24 | |
| *** vesper11 has quit IRC | 08:24 | |
| *** jrosser has quit IRC | 08:24 | |
| *** Daemoen has quit IRC | 08:24 | |
| *** goldenfri has quit IRC | 08:24 | |
| *** gchamoul has quit IRC | 08:24 | |
| *** goldyfruit___ has quit IRC | 08:24 | |
| *** prometheanfire has quit IRC | 08:24 | |
| *** mgagne has quit IRC | 08:24 | |
| *** guilhermesp has quit IRC | 08:24 | |
| *** mwhahaha has quit IRC | 08:24 | |
| *** tiffanie has quit IRC | 08:24 | |
| *** odyssey4me has quit IRC | 08:24 | |
| *** mnaser has quit IRC | 08:24 | |
| *** NobodyCam has quit IRC | 08:24 | |
| *** cjloader has quit IRC | 08:24 | |
| *** jtanner has quit IRC | 08:24 | |
| *** melwitt has quit IRC | 08:24 | |
| *** ChanServ has quit IRC | 08:24 | |
| *** cshen has joined #openstack-ansible | 08:24 | |
| *** dcdamien has joined #openstack-ansible | 08:24 | |
| *** arbrandes has joined #openstack-ansible | 08:24 | |
| *** miloa has joined #openstack-ansible | 08:24 | |
| *** rgogunskiy has joined #openstack-ansible | 08:24 | |
| *** udesale has joined #openstack-ansible | 08:24 | |
| *** pcaruana has joined #openstack-ansible | 08:24 | |
| *** dasp has joined #openstack-ansible | 08:24 | |
| *** schwicht has joined #openstack-ansible | 08:24 | |
| *** hamzy has joined #openstack-ansible | 08:24 | |
| *** vesper11 has joined #openstack-ansible | 08:24 | |
| *** jamesdenton has joined #openstack-ansible | 08:24 | |
| *** jhesketh has joined #openstack-ansible | 08:24 | |
| *** jlvillal has joined #openstack-ansible | 08:24 | |
| *** admin0 has joined #openstack-ansible | 08:24 | |
| *** trident has joined #openstack-ansible | 08:24 | |
| *** mgariepy has joined #openstack-ansible | 08:24 | |
| *** ansmith has joined #openstack-ansible | 08:24 | |
| *** jonher has joined #openstack-ansible | 08:24 | |
| *** zbr has joined #openstack-ansible | 08:24 | |
| *** mathlin has joined #openstack-ansible | 08:24 | |
| *** mensis has joined #openstack-ansible | 08:24 | |
| *** wpp has joined #openstack-ansible | 08:24 | |
| *** do1jlr has joined #openstack-ansible | 08:24 | |
| *** dirk has joined #openstack-ansible | 08:24 | |
| *** gshippey has joined #openstack-ansible | 08:24 | |
| *** Blinkiz has joined #openstack-ansible | 08:24 | |
| *** johanssone has joined #openstack-ansible | 08:24 | |
| *** gokhani has joined #openstack-ansible | 08:24 | |
| *** Adri2000 has joined #openstack-ansible | 08:24 | |
| *** Guest62786 has joined #openstack-ansible | 08:24 | |
| *** Jeffrey4l has joined #openstack-ansible | 08:24 | |
| *** mugsie has joined #openstack-ansible | 08:24 | |
| *** tinwood has joined #openstack-ansible | 08:24 | |
| *** persia_ has joined #openstack-ansible | 08:24 | |
| *** jrosser has joined #openstack-ansible | 08:24 | |
| *** fyx has joined #openstack-ansible | 08:24 | |
| *** donnyd has joined #openstack-ansible | 08:24 | |
| *** Daemoen has joined #openstack-ansible | 08:24 | |
| *** jtagcat has joined #openstack-ansible | 08:24 | |
| *** df_sbr has joined #openstack-ansible | 08:24 | |
| *** gixx has joined #openstack-ansible | 08:24 | |
| *** goldenfri has joined #openstack-ansible | 08:24 | |
| *** jroll has joined #openstack-ansible | 08:24 | |
| *** gchamoul has joined #openstack-ansible | 08:24 | |
| *** kmadac has joined #openstack-ansible | 08:24 | |
| *** andrea15 has joined #openstack-ansible | 08:24 | |
| *** toanster has joined #openstack-ansible | 08:24 | |
| *** EmilienM has joined #openstack-ansible | 08:24 | |
| *** gregwork has joined #openstack-ansible | 08:24 | |
| *** Carcer has joined #openstack-ansible | 08:24 | |
| *** rpittau has joined #openstack-ansible | 08:24 | |
| *** owalsh has joined #openstack-ansible | 08:24 | |
| *** versionsix has joined #openstack-ansible | 08:24 | |
| *** cloudnull has joined #openstack-ansible | 08:24 | |
| *** tbarron has joined #openstack-ansible | 08:24 | |
| *** logan- has joined #openstack-ansible | 08:24 | |
| *** dmsimard has joined #openstack-ansible | 08:24 | |
| *** cosmicsound has joined #openstack-ansible | 08:24 | |
| *** spotz has joined #openstack-ansible | 08:24 | |
| *** rodolof has joined #openstack-ansible | 08:24 | |
| *** ChosSimbaOne has joined #openstack-ansible | 08:24 | |
| *** hwoarang has joined #openstack-ansible | 08:24 | |
| *** goldyfruit___ has joined #openstack-ansible | 08:24 | |
| *** bradm has joined #openstack-ansible | 08:24 | |
| *** mrda has joined #openstack-ansible | 08:24 | |
| *** NewJorg has joined #openstack-ansible | 08:24 | |
| *** csmart has joined #openstack-ansible | 08:24 | |
| *** masterpe has joined #openstack-ansible | 08:24 | |
| *** bverschueren has joined #openstack-ansible | 08:24 | |
| *** sep has joined #openstack-ansible | 08:24 | |
| *** oligau has joined #openstack-ansible | 08:24 | |
| *** gouthamr has joined #openstack-ansible | 08:24 | |
| *** django has joined #openstack-ansible | 08:24 | |
| *** errr_ has joined #openstack-ansible | 08:24 | |
| *** stingrayza has joined #openstack-ansible | 08:24 | |
| *** d34dh0r53 has joined #openstack-ansible | 08:24 | |
| *** openstackgerrit has joined #openstack-ansible | 08:24 | |
| *** kopecmartin has joined #openstack-ansible | 08:24 | |
| *** sshnaidm has joined #openstack-ansible | 08:24 | |
| *** irclogbot_3 has joined #openstack-ansible | 08:24 | |
| *** cp- has joined #openstack-ansible | 08:24 | |
| *** prometheanfire has joined #openstack-ansible | 08:24 | |
| *** samc-bbc has joined #openstack-ansible | 08:24 | |
| *** mgagne has joined #openstack-ansible | 08:24 | |
| *** kukacz_ has joined #openstack-ansible | 08:24 | |
| *** bjoernt has joined #openstack-ansible | 08:24 | |
| *** Nick_A has joined #openstack-ansible | 08:24 | |
| *** mcarden has joined #openstack-ansible | 08:24 | |
| *** weshay_ has joined #openstack-ansible | 08:24 | |
| *** poopcat has joined #openstack-ansible | 08:24 | |
| *** rickflare has joined #openstack-ansible | 08:24 | |
| *** evrardjp has joined #openstack-ansible | 08:24 | |
| *** brtknr has joined #openstack-ansible | 08:24 | |
| *** antonym has joined #openstack-ansible | 08:24 | |
| *** ondrejbu- has joined #openstack-ansible | 08:24 | |
| *** gundalow has joined #openstack-ansible | 08:24 | |
| *** guilhermesp has joined #openstack-ansible | 08:24 | |
| *** mwhahaha has joined #openstack-ansible | 08:24 | |
| *** tiffanie has joined #openstack-ansible | 08:24 | |
| *** brad[] has joined #openstack-ansible | 08:24 | |
| *** stuartgr has joined #openstack-ansible | 08:24 | |
| *** Anticimex has joined #openstack-ansible | 08:24 | |
| *** crazzy has joined #openstack-ansible | 08:24 | |
| *** cyberpear has joined #openstack-ansible | 08:24 | |
| *** mubix has joined #openstack-ansible | 08:24 | |
| *** fresta has joined #openstack-ansible | 08:24 | |
| *** asettle has joined #openstack-ansible | 08:24 | |
| *** odyssey4me has joined #openstack-ansible | 08:24 | |
| *** chkumar|ruck has joined #openstack-ansible | 08:24 | |
| *** andymccr has joined #openstack-ansible | 08:24 | |
| *** waxfire has joined #openstack-ansible | 08:24 | |
| *** nsmeds has joined #openstack-ansible | 08:24 | |
| *** snadge has joined #openstack-ansible | 08:24 | |
| *** ioni has joined #openstack-ansible | 08:24 | |
| *** aspiers has joined #openstack-ansible | 08:24 | |
| *** jmccrory has joined #openstack-ansible | 08:24 | |
| *** szaher has joined #openstack-ansible | 08:24 | |
| *** tobberydberg has joined #openstack-ansible | 08:24 | |
| *** mhayden has joined #openstack-ansible | 08:24 | |
| *** Miouge has joined #openstack-ansible | 08:24 | |
| *** alanmeadows has joined #openstack-ansible | 08:24 | |
| *** j^2 has joined #openstack-ansible | 08:24 | |
| *** gary_perkins has joined #openstack-ansible | 08:24 | |
| *** timburke has joined #openstack-ansible | 08:24 | |
| *** mbuil has joined #openstack-ansible | 08:24 | |
| *** arxcruz has joined #openstack-ansible | 08:24 | |
| *** ChanServ has joined #openstack-ansible | 08:24 | |
| *** cjloader has joined #openstack-ansible | 08:24 | |
| *** orwell.freenode.net sets mode: +o ChanServ | 08:24 | |
| *** mnaser has joined #openstack-ansible | 08:24 | |
| *** NobodyCam has joined #openstack-ansible | 08:24 | |
| *** jtanner has joined #openstack-ansible | 08:24 | |
| *** melwitt has joined #openstack-ansible | 08:24 | |
| *** mattoliverau has joined #openstack-ansible | 08:24 | |
| *** redkrieg has joined #openstack-ansible | 08:24 | |
| *** nwonknu has joined #openstack-ansible | 08:24 | |
| *** noonedeadpunk has joined #openstack-ansible | 08:24 | |
| *** ebbex has joined #openstack-ansible | 08:24 | |
| *** johnsom has joined #openstack-ansible | 08:24 | |
| *** cshen has quit IRC | 08:25 | |
| *** cshen has joined #openstack-ansible | 08:30 | |
| cshen | jrosser: https://review.opendev.org/#/c/694313/ it seemed that openstack-ansible-upgrade-aio_metal-centos-7 in zuul check already took 2h41m, in zuul gate even longer. would it be possible to extend the timeout for centos 7 job? | 08:35 |
| *** ivve has joined #openstack-ansible | 08:36 | |
| *** dcdamien has quit IRC | 08:37 | |
| jrosser | cshen: no because that is the upper limit across all the jobs | 08:42 |
| jrosser | it is taking many attempts to get any patch to merge on master currently becasue centos is sooooo slooooow | 08:42 |
| cshen | jrosser: I found timeout 10800 in zuul.d/jobs.yaml. I thought it's configable. | 08:44 |
| jrosser | it is, but i think there is an upper limit in the more general zuul config that an projecy job cannot be configured to exceed | 08:45 |
| cshen | I've seen recheck too many times in the last weeks. I think it wasted us too much time to manual type recheck. | 08:46 |
| jrosser | i believe it is this http://codesearch.openstack.org/?q=max-job-timeout | 08:48 |
| jrosser | cshen: yes i agree that there is too much recheck, but really the problem is centos being slow rather than the timeout being too short | 08:49 |
| jrosser | 3 hour jobs is far too long in the first place really | 08:49 |
| cshen | agreed. almost 1h longer than other distros | 08:52 |
| jrosser | cshen: as soon as *any* py3 only code is merged to master for anything, we have to drop all the centos7 jobs instantly anyway | 08:53 |
| jrosser | so it's going to go away on master, just a question of when | 08:53 |
| noonedeadpunk | mornings | 08:54 |
| noonedeadpunk | yeah, but on train and earlier it will still be a PITA | 08:54 |
| jrosser | absolutely :( | 08:55 |
| jrosser | and i guess we only keep it on master in the hope we can cut an easily backportable centos8 patchset | 08:56 |
| jrosser | before ripping out centos7 and making a backport/merge confict disaster with stable/train | 08:56 |
| jrosser | i think this is why i'd like to press on with the centos8 work even if we have to initially use those random repos | 08:57 |
| *** yolanda has joined #openstack-ansible | 08:58 | |
| *** tosky has joined #openstack-ansible | 09:00 | |
| *** DanyC has joined #openstack-ansible | 09:05 | |
| noonedeadpunk | that absolutelly make sense | 09:13 |
| *** cshen has quit IRC | 09:33 | |
| *** cshen has joined #openstack-ansible | 09:33 | |
| *** dcdamien has joined #openstack-ansible | 09:35 | |
| *** PrinzElvis has joined #openstack-ansible | 09:36 | |
| *** DanyC has quit IRC | 09:40 | |
| *** cshen has quit IRC | 09:44 | |
| noonedeadpunk | cjloader: let's address these last things and you have my vote | 10:09 |
| *** cshen has joined #openstack-ansible | 10:14 | |
| *** DanyC has joined #openstack-ansible | 10:15 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Revert "Add nova placement to placement migration" https://review.opendev.org/693740 | 10:20 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Revert "Add nova placement to placement migration" https://review.opendev.org/693740 | 10:20 |
| *** tosky has quit IRC | 10:21 | |
| *** tosky has joined #openstack-ansible | 10:21 | |
| cshen | jrosser: have we already worked on centos 8? Any code change to see? | 10:22 |
| noonedeadpunk | cshen: https://review.opendev.org/#/c/689629/ | 10:24 |
| cshen | noonedeadpunk: thx | 10:25 |
| *** DanyC has quit IRC | 10:32 | |
| *** DanyC has joined #openstack-ansible | 10:57 | |
| *** isakgicu has joined #openstack-ansible | 10:58 | |
| *** cshen has quit IRC | 11:04 | |
| *** udesale has quit IRC | 11:07 | |
| *** cshen has joined #openstack-ansible | 11:11 | |
| *** zbr_ has joined #openstack-ansible | 11:15 | |
| *** zbr has quit IRC | 11:17 | |
| *** rpittau is now known as rpittau|bbl | 11:27 | |
| ebbex | Any idea what's holding back aio_metal_calico-ubuntu-bionic on this https://review.opendev.org/#/c/693031/ ? | 11:36 |
| ebbex | "Unit nspawn-macvlan.service could not be found." And something about a btrfs filesystem. This has been rechecked so many times. | 11:38 |
| noonedeadpunk | I think you can ping logan- with this | 11:38 |
| jrosser | ebbex: the actual error is here https://zuul.opendev.org/t/openstack/build/43c9b144494645a286caac925cd6d494/log/job-output.txt#9698 | 11:46 |
| ebbex | jrosser: Doesn't look good. Is this an issue with zuul and/or versions of the images currently in use? | 11:55 |
| *** sshnaidm is now known as sshnaidm|afk | 12:02 | |
| jrosser | ebbex: images? it looks like an etcd error | 12:03 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Centos-8 support https://review.opendev.org/689629 | 12:05 |
| *** cshen has quit IRC | 12:09 | |
| *** nicolasbock has joined #openstack-ansible | 12:22 | |
| *** cshen has joined #openstack-ansible | 12:25 | |
| *** goldyfruit___ has quit IRC | 12:32 | |
| ebbex | jrosser: I was thinking about what version of coreos or some other distro is currently in use to provide some version of etcd, if these services come from images that spin up/down upon requests. | 12:37 |
| ebbex | I'm guessing it used to work at some point, then some versions changed and now it's borked? | 12:37 |
| *** goldenfri has quit IRC | 12:49 | |
| jrosser | etcd is just a distribution package via apt, there’s no docker-isms here | 12:50 |
| ebbex | Hmm, is bionic/aio_metal_calico actually not deployable in it's current state? | 12:52 |
| *** schwicht has quit IRC | 12:53 | |
| *** PrinzElvis has quit IRC | 12:55 | |
| *** schwicht has joined #openstack-ansible | 13:20 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Don't require provider_networks with no_containers https://review.opendev.org/696713 | 13:27 |
| openstackgerrit | Merged openstack/openstack-ansible stable/rocky: Bump SHAs for stable/rocky https://review.opendev.org/696799 | 13:27 |
| jrosser | ebbex: here https://zuul.opendev.org/t/openstack/build/43c9b144494645a286caac925cd6d494/log/logs/host/etcd-gateway.service.journal-08-59-28.log.txt.gz | 13:31 |
| jrosser | thats ultimately whats wrong | 13:32 |
| *** rpittau|bbl is now known as rpittau | 13:36 | |
| *** lkoranda has joined #openstack-ansible | 13:38 | |
| *** goldenfri has joined #openstack-ansible | 13:43 | |
| ebbex | jrosser: Aha, I see. Good catch. So it's probably a template thing with regards to a missing endpoint. | 13:47 |
| jrosser | and thats coming from here https://github.com/logan2211/ansible-etcd/blob/2b7912e6ed03f58e6ceee672b8f497cd19836c9e/defaults/main.yml#L55 | 13:49 |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Switch to the amqp repository for erlang dependencies https://review.opendev.org/696580 | 13:52 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server stable/train: Switch to the amqp repository for erlang dependencies https://review.opendev.org/697288 | 13:56 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible stable/train: Don't require provider_networks with no_containers https://review.opendev.org/697289 | 13:57 |
| *** schwicht has quit IRC | 13:58 | |
| *** schwicht has joined #openstack-ansible | 14:01 | |
| *** rodolof has quit IRC | 14:04 | |
| *** spotz has quit IRC | 14:04 | |
| *** schwicht has quit IRC | 14:04 | |
| *** cshen has quit IRC | 14:07 | |
| *** rodolof has joined #openstack-ansible | 14:09 | |
| *** spotz has joined #openstack-ansible | 14:09 | |
| *** rodolof has quit IRC | 14:13 | |
| *** spotz has quit IRC | 14:13 | |
| *** DanyC has quit IRC | 14:14 | |
| *** cshen has joined #openstack-ansible | 14:19 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Removes package cache references from yum config https://review.opendev.org/689896 | 14:19 |
| *** rodolof has joined #openstack-ansible | 14:19 | |
| *** spotz has joined #openstack-ansible | 14:19 | |
| *** schwicht has joined #openstack-ansible | 14:25 | |
| *** lkoranda has quit IRC | 14:27 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Removes package cache references from yum config https://review.opendev.org/697295 | 14:32 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Don't install python2 for Debian https://review.opendev.org/695204 | 14:34 |
| noonedeadpunk | seems like centos become faster lol | 14:34 |
| *** goldyfruit has joined #openstack-ansible | 14:35 | |
| *** sshnaidm|afk is now known as sshnaidm | 14:39 | |
| *** DanyC has joined #openstack-ansible | 14:46 | |
| *** DanyC has quit IRC | 14:57 | |
| cjloader | noonedeadpunk: sounds good | 14:58 |
| cjloader | ty | 14:58 |
| *** DanyC has joined #openstack-ansible | 14:58 | |
| cjloader | doing it now | 14:58 |
| cjloader | and can we backport as well? noonedeadpunk | 14:59 |
| noonedeadpunk | yep | 14:59 |
| noonedeadpunk | But it's not only up to me :p | 15:00 |
| cjloader | yeah | 15:00 |
| cjloader | lol | 15:00 |
| cjloader | what day are you doing the rc? | 15:00 |
| noonedeadpunk | I've published rc today, but we will have another one, which will be actually the release | 15:01 |
| cjloader | so my patch *should* be in? | 15:01 |
| noonedeadpunk | I think it is | 15:01 |
| *** cshen has quit IRC | 15:02 | |
| *** dasp has quit IRC | 15:02 | |
| *** dasp has joined #openstack-ansible | 15:03 | |
| *** rgogunskiy has quit IRC | 15:08 | |
| *** cshen has joined #openstack-ansible | 15:09 | |
| openstackgerrit | Cam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Adds configuration for the Ironic Inspector https://review.opendev.org/680284 | 15:09 |
| cjloader | noonedeadpunk: done ^ | 15:09 |
| *** DanyC has quit IRC | 15:10 | |
| *** lbragstad has joined #openstack-ansible | 15:10 | |
| noonedeadpunk | cjloader: this is not going to work https://review.opendev.org/#/c/680284/80..81/tasks/ironic_db_setup.yml because of this condition https://opendev.org/openstack/openstack-ansible-os_ironic/src/branch/master/tasks/main.yml#L103 | 15:11 |
| noonedeadpunk | so I think you need to drop when statement from import and place it for task | 15:13 |
| cjloader | i'll break out into new file | 15:13 |
| noonedeadpunk | personally I don't need why we need 2 files with 1 task each... | 15:13 |
| noonedeadpunk | *don't see | 15:13 |
| cjloader | ok | 15:14 |
| noonedeadpunk | let me comment | 15:14 |
| *** cshen has quit IRC | 15:14 | |
| *** yolanda__ has joined #openstack-ansible | 15:15 | |
| *** tiffanie has quit IRC | 15:17 | |
| cjloader | ah i understand | 15:17 |
| cjloader | drop when | 15:17 |
| cjloader | and in ironic_db_setup add two whens | 15:17 |
| cjloader | noonedeadpunk | 15:18 |
| noonedeadpunk | yep | 15:18 |
| noonedeadpunk | just posted comment explaining this:) | 15:18 |
| cjloader | sorry | 15:18 |
| cjloader | took a min to understand | 15:18 |
| noonedeadpunk | nah, it's ok | 15:18 |
| *** yolanda__ has quit IRC | 15:18 | |
| noonedeadpunk | anyway it has mistake:( | 15:19 |
| *** udesale has joined #openstack-ansible | 15:20 | |
| cjloader | got it | 15:21 |
| *** dave-mccowan has joined #openstack-ansible | 15:21 | |
| cjloader | there another issue before I re-push? | 15:21 |
| noonedeadpunk | I think it's ok | 15:22 |
| openstackgerrit | Cam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Adds configuration for the Ironic Inspector https://review.opendev.org/680284 | 15:23 |
| noonedeadpunk | cjloader: oh... have you just dropped ironic_inspector_db? | 15:23 |
| noonedeadpunk | It's not needed? Or you just forgot to place it in vars/main.yml? | 15:24 |
| cjloader | no | 15:24 |
| cjloader | not needed | 15:24 |
| noonedeadpunk | ah, nice | 15:24 |
| cjloader | because I used a diff method | 15:24 |
| noonedeadpunk | ++ | 15:24 |
| cjloader | look in tasks/main.yml | 15:25 |
| cjloader | two separate tasks | 15:25 |
| noonedeadpunk | yeah, you did 2 tasks | 15:25 |
| noonedeadpunk | I was just looking for diff between these 2 patches:) | 15:25 |
| cjloader | forgot to delete, glad you saw | 15:25 |
| noonedeadpunk | so it was out of my scope | 15:25 |
| *** dave-mccowan has quit IRC | 15:26 | |
| cjloader | oops | 15:26 |
| noonedeadpunk | ok, let's see what CI says | 15:26 |
| cjloader | hold on | 15:26 |
| cjloader | didn't see your fix | 15:27 |
| cjloader | "'ironic_inspector' in groups and inventory_hostname == groups['ironic_inspector'][0]" | 15:27 |
| cjloader | fixing | 15:27 |
| openstackgerrit | Cam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Adds configuration for the Ironic Inspector https://review.opendev.org/680284 | 15:27 |
| noonedeadpunk | oh, yeah.. It was the error I was talking about | 15:27 |
| noonedeadpunk | Was writing it in a hurry and copy pasted wrong stuff:( | 15:27 |
| cjloader | np | 15:28 |
| cjloader | this is hopefully my last revision lol | 15:28 |
| cjloader | for now | 15:28 |
| *** heikkine has joined #openstack-ansible | 15:28 | |
| noonedeadpunk | is it still working for you? Like both inspector and just ironic? | 15:29 |
| cjloader | yes | 15:29 |
| cjloader | i also followed CI and upgrade jobs don't do any of the inspector tasks | 15:30 |
| cjloader | so it'll be just greenfield deploys with inspector_hosts defined | 15:31 |
| *** DanyC has joined #openstack-ansible | 15:31 | |
| noonedeadpunk | actually they were doing (and probably should) as you've added ironic into inventory with https://review.opendev.org/#/c/680553/16/etc/openstack_deploy/conf.d/ironic.yml.aio | 15:32 |
| *** ivve has quit IRC | 15:33 | |
| cjloader | added that back when it was deploying all together | 15:33 |
| cjloader | but since we added conditionals | 15:33 |
| cjloader | its a big patch I know, i'm sorry | 15:34 |
| noonedeadpunk | but we've added them to run only against inspector hosts, which is the case in terms of aio ci build | 15:34 |
| *** cshen has joined #openstack-ansible | 15:35 | |
| cjloader | yes | 15:35 |
| noonedeadpunk | like now I'm worrid so that we won't ruin ppl deployments during upgrades or new deployments without inspector | 15:35 |
| noonedeadpunk | And don't really mind about some problems with inspector itself - we can iterate on this | 15:36 |
| cjloader | it should be okay, and yes I plan on iterating | 15:37 |
| cjloader | actually | 15:37 |
| *** goldyfruit_ has joined #openstack-ansible | 15:38 | |
| cjloader | https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d67/680284/80/check/openstack-ansible-upgrade-aio_metal-ubuntu-bionic/d67902e/job-output.txt | 15:38 |
| cjloader | look for ironic-inspector | 15:39 |
| cjloader | no tasks | 15:39 |
| cjloader | because stein didn't have it | 15:39 |
| noonedeadpunk | ah, yes, correct | 15:40 |
| cjloader | but regular aio | 15:40 |
| cjloader | will | 15:40 |
| noonedeadpunk | Yeah, that's right:) | 15:40 |
| cjloader | not upgrades | 15:40 |
| *** elenalindq has joined #openstack-ansible | 15:40 | |
| cjloader | make sense now? | 15:41 |
| *** goldyfruit has quit IRC | 15:41 | |
| noonedeadpunk | yep, absolutely | 15:42 |
| cjloader | good thing about inspector is that it cuts out some manual steps gathering node specs | 15:43 |
| cjloader | making it easier for people to use ironic | 15:44 |
| *** sshnaidm is now known as sshnaidm|afk | 15:57 | |
| *** miloa has quit IRC | 16:01 | |
| *** gyee has joined #openstack-ansible | 16:09 | |
| cjloader | noonedeadpunk: so if it passes CI do I have your vote? | 16:10 |
| cshen | this error "Unit nspawn-macvlan.service could not be found" happened very early in the openstack-ansible-upgrade-aio_metal-centos-7 zuul job, do I need to worry? | 16:11 |
| noonedeadpunk | cjloader: at this point it lgtm, but I'd loe jrosser to look through it as well afterwards | 16:12 |
| cjloader | ok | 16:13 |
| cjloader | thx for your help. =) | 16:14 |
| noonedeadpunk | np | 16:16 |
| *** cshen has quit IRC | 16:24 | |
| *** sshnaidm|afk is now known as sshnaidm | 16:25 | |
| openstackgerrit | Cam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Adds configuration for the Ironic Inspector https://review.opendev.org/680284 | 16:34 |
| cjloader | missed "%" on the endif | 16:34 |
| cjloader | =( | 16:35 |
| *** chkumar|ruck is now known as raukadah | 16:43 | |
| *** udesale has quit IRC | 16:58 | |
| *** isakgicu has quit IRC | 17:07 | |
| *** persia_ is now known as persia | 17:16 | |
| *** dcdamien has quit IRC | 17:18 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Install python3 packages for ubuntu https://review.opendev.org/694783 | 17:20 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Replace git.openstack.org with opendev.org https://review.opendev.org/694352 | 17:22 |
| *** DanyC_ has joined #openstack-ansible | 17:22 | |
| *** DanyC has quit IRC | 17:26 | |
| *** DanyC_ has quit IRC | 17:26 | |
| cjloader | noonedeadpunk: looks like the bionic aio job got past ironic! =) | 17:47 |
| cjloader | hope no cent7 timeouts | 17:48 |
| noonedeadpunk | looking at https://review.opendev.org/#/c/694313/ it's unlikely, but still:) | 17:48 |
| *** rpittau is now known as rpittau|afk | 17:50 | |
| cjloader | any case, I think its ready for reviews | 17:50 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Install python3 packages for ubuntu https://review.opendev.org/694783 | 18:22 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Replace git.openstack.org with opendev.org https://review.opendev.org/694352 | 18:22 |
| *** tosky has quit IRC | 18:54 | |
| *** ThiagoCMC has joined #openstack-ansible | 19:19 | |
| ThiagoCMC | Hey guys! I just finished my "stable/train" deployment and the rabbitmq container (process beam.smp) is literally consuming all the CPU Cores of all controllers. Any idea? | 19:21 |
| ThiagoCMC | I tried to "lxc-stop / lxc-start" the rabbit containers, one by one but, its cpu consumption is up again... | 19:22 |
| ThiagoCMC | I can see huge number of errors on rabbitmq logs... | 19:30 |
| ThiagoCMC | Can I just destroy all rabbitmq containers and run the related setup-*.yml playbooks again? | 19:33 |
| *** df_sbr has quit IRC | 19:42 | |
| *** cshen has joined #openstack-ansible | 19:44 | |
| jrosser | ThiagoCMC: we had something very similar to that | 19:48 |
| jrosser | rabbit was just going nuts and it turned out to be 10000s of queued messages | 19:48 |
| *** cshen has quit IRC | 19:49 | |
| jrosser | we had to use rabbitmqctl on each of the three nodes in turn to see which one had the big queues | 19:49 |
| ThiagoCMC | Weird... I just deleted all rabbitmq containers | 19:49 |
| ThiagoCMC | Do you have the rabbitmqctl procedure somewhere? =P | 19:50 |
| *** cshen has joined #openstack-ansible | 19:52 | |
| jrosser | sorry I’m away from my stuff right now | 19:52 |
| *** nicolasbock has quit IRC | 20:06 | |
| *** nicolasbock has joined #openstack-ansible | 20:08 | |
| ThiagoCMC | No problem buddy! | 20:19 |
| cjloader | ThiagoCMC: https://docs.openstack.org/openstack-ansible/latest/admin/maintenance-tasks/rabbitmq-maintain.html#repair-a-partitioned-rabbitmq-cluster-for-a-multi-node-cluster? | 20:20 |
| *** cshen has quit IRC | 20:20 | |
| ThiagoCMC | Oh, nice! Thank you! :-D | 20:21 |
| ThiagoCMC | The new containers that I just re-created, are good! | 20:21 |
| *** mgariepy has quit IRC | 20:27 | |
| *** mgariepy has joined #openstack-ansible | 20:35 | |
| *** lbragstad has quit IRC | 20:37 | |
| *** rgogunskiy has joined #openstack-ansible | 21:01 | |
| *** elenalindq has quit IRC | 21:23 | |
| *** pcaruana has quit IRC | 21:32 | |
| *** df_sbr has joined #openstack-ansible | 21:37 | |
| *** cshen has joined #openstack-ansible | 21:43 | |
| *** cshen has quit IRC | 21:47 | |
| *** rgogunskiy has quit IRC | 21:52 | |
| *** goldyfruit___ has joined #openstack-ansible | 22:09 | |
| *** tosky has joined #openstack-ansible | 22:10 | |
| *** goldyfruit_ has quit IRC | 22:12 | |
| *** goldyfruit_ has joined #openstack-ansible | 22:12 | |
| *** goldyfruit___ has quit IRC | 22:14 | |
| *** schwicht has quit IRC | 23:24 | |
| *** schwicht has joined #openstack-ansible | 23:42 | |
| *** schwicht has quit IRC | 23:46 | |
| *** schwicht has joined #openstack-ansible | 23:48 | |
| *** schwicht has quit IRC | 23:52 | |
| *** goldyfruit_ has quit IRC | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!