| *** igordc has quit IRC | 00:13 | |
| *** gregoryo has joined #openstack-kolla | 00:34 | |
| *** Sravan has joined #openstack-kolla | 00:50 | |
| *** Sravan has quit IRC | 00:54 | |
| *** kplant has quit IRC | 01:46 | |
| *** hongbin has joined #openstack-kolla | 02:04 | |
| *** whoami-rajat has joined #openstack-kolla | 02:07 | |
| openstackgerrit | Rafael Weingärtner proposed openstack/kolla-ansible master: Cloudkitty InfluxDB Storage backend via Kolla-ansible https://review.opendev.org/658418 | 02:09 |
|---|---|---|
| *** skramaja has joined #openstack-kolla | 02:53 | |
| openstackgerrit | Zijian Guo proposed openstack/kolla-ansible master: Add rabbitmq extra volumes https://review.opendev.org/667256 | 03:11 |
| *** Sravan has joined #openstack-kolla | 03:43 | |
| *** zhanglong has quit IRC | 03:59 | |
| *** hongbin has quit IRC | 04:25 | |
| *** Wasaac has joined #openstack-kolla | 04:30 | |
| *** Sravan has quit IRC | 04:30 | |
| *** Wasaac has quit IRC | 04:34 | |
| *** hongbin has joined #openstack-kolla | 04:42 | |
| *** hongbin has quit IRC | 04:49 | |
| *** Sravan has joined #openstack-kolla | 05:01 | |
| *** Sravan has quit IRC | 05:03 | |
| *** Sravan has joined #openstack-kolla | 05:03 | |
| *** ivve has joined #openstack-kolla | 05:04 | |
| *** dannins has joined #openstack-kolla | 05:26 | |
| *** Sravan has quit IRC | 05:34 | |
| *** Sravan has joined #openstack-kolla | 05:42 | |
| *** Luzi has joined #openstack-kolla | 05:44 | |
| *** Sravan has quit IRC | 05:46 | |
| *** pcaruana has joined #openstack-kolla | 05:56 | |
| *** skramaja has quit IRC | 05:57 | |
| *** pcaruana has quit IRC | 05:57 | |
| *** skramaja has joined #openstack-kolla | 05:57 | |
| *** pcaruana has joined #openstack-kolla | 05:57 | |
| *** cah_link has joined #openstack-kolla | 05:59 | |
| *** sm806 has quit IRC | 06:00 | |
| *** sm806 has joined #openstack-kolla | 06:00 | |
| *** zhanglong has joined #openstack-kolla | 06:15 | |
| *** sm806 has quit IRC | 06:26 | |
| *** sm806 has joined #openstack-kolla | 06:26 | |
| *** luksky has joined #openstack-kolla | 06:41 | |
| gregoryo | Anyone around yet? I'd like to know the recommended way to run OVS commands e.g. ovs-vsctl show. Running it in the openvswitch-agent container gives permission denied and I don't know if it has a sudo or root password set. | 06:43 |
| *** altlogbot_0 has quit IRC | 06:46 | |
| yoctozepto | gregoryo: try from openvswitch_vswitchd | 06:47 |
| *** altlogbot_2 has joined #openstack-kolla | 06:49 | |
| *** altlogbot_2 has quit IRC | 06:50 | |
| gregoryo | Excellent, thank you. | 06:51 |
| *** altlogbot_2 has joined #openstack-kolla | 06:55 | |
| *** dpawlik has joined #openstack-kolla | 06:55 | |
| mnasiadka | morning | 07:24 |
| *** hrw has joined #openstack-kolla | 07:25 | |
| hrw | morning | 07:26 |
| yoctozepto | morning | 07:30 |
| *** cgrosjean has joined #openstack-kolla | 07:33 | |
| *** rgogunskiy has joined #openstack-kolla | 07:47 | |
| *** nathharp has joined #openstack-kolla | 07:50 | |
| *** nathharp has quit IRC | 07:50 | |
| *** nathharp has joined #openstack-kolla | 07:51 | |
| *** dougsz has joined #openstack-kolla | 07:51 | |
| *** JangwonLee_ has joined #openstack-kolla | 07:52 | |
| yoctozepto | guys. I see you are trying your luck with recheck, be aware that the chance of losing is high now due to horizon timeouting | 07:55 |
| *** JangwonLee has quit IRC | 07:55 | |
| yoctozepto | also gating is likely to fail... | 07:57 |
| yoctozepto | see: https://review.opendev.org/667204 | 07:58 |
| *** Wasaac has joined #openstack-kolla | 07:58 | |
| *** hrw has quit IRC | 08:01 | |
| *** hrw has joined #openstack-kolla | 08:05 | |
| *** k_mouza has joined #openstack-kolla | 08:15 | |
| *** hamzaachi has joined #openstack-kolla | 08:22 | |
| *** ktibi has joined #openstack-kolla | 08:24 | |
| openstackgerrit | Merged openstack/kolla master: Make SKIPPED_IMAGES more flexible https://review.opendev.org/665116 | 08:29 |
| *** gregoryo has quit IRC | 08:33 | |
| *** cah_link has quit IRC | 08:34 | |
| *** cah_link has joined #openstack-kolla | 08:34 | |
| *** lemko has joined #openstack-kolla | 08:36 | |
| *** k_mouza has quit IRC | 08:49 | |
| *** k_mouza has joined #openstack-kolla | 08:50 | |
| *** priteau has joined #openstack-kolla | 08:56 | |
| hrw | UCA/train is on mirrors so https://review.opendev.org/665908 should pass zuul. vote! | 09:01 |
| yoctozepto | you wish! | 09:03 |
| hrw | yoctozepto: ha ha ;D | 09:05 |
| yoctozepto | hrw: oddly enough it passed the timeouter | 09:07 |
| yoctozepto | http://logs.openstack.org/08/665908/1/check/kolla-build-centos-source/d2ad846/logs/build/horizon.txt.gz | 09:07 |
| *** Wasaac has quit IRC | 09:07 | |
| yoctozepto | this time it managed to it all fast | 09:07 |
| yoctozepto | cosmic rays all around | 09:08 |
| *** gfidente has joined #openstack-kolla | 09:09 | |
| hrw | RETRY_LIMIT fsck. | 09:11 |
| *** Wasaac has joined #openstack-kolla | 09:11 | |
| yoctozepto | hrw: which | 09:12 |
| hrw | kolla-build-centos-binary finger://ze01.openstack.org/be9d40c3dda143ee98926b4d5e390de8 : RETRY_LIMIT in 34m 01s (non-voting) | 09:12 |
| hrw | https://review.opendev.org/#/c/665908/ | 09:12 |
| *** k_mouza has quit IRC | 09:13 | |
| hrw | we have too much ci jobs so retry limits are triggered ;d | 09:14 |
| yoctozepto | hrw: should not be happening | 09:14 |
| yoctozepto | :P | 09:14 |
| yoctozepto | infra informed | 09:14 |
| yoctozepto | we had lots of these the last night | 09:14 |
| yoctozepto | Zuul telling us to finger eh | 09:15 |
| *** nathharp has quit IRC | 09:17 | |
| mgoddard | yoctozepto: is the horizon team going to fix that issue or do we need to work around it? | 09:19 |
| mgoddard | finger normally means zuul has lost connectivity to the VM running the job | 09:20 |
| yoctozepto | mgoddard: seems we need to | 09:20 |
| mgoddard | yoctozepto: have you spoken to the horizon team? | 09:20 |
| yoctozepto | mgoddard: yes, since the morning | 09:20 |
| yoctozepto | on their IRC channel | 09:20 |
| mgoddard | they think it's not a bug? | 09:21 |
| yoctozepto | exactly :D | 09:21 |
| mgoddard | are we doing something unusual to hit it? | 09:21 |
| yoctozepto | we are doing compiles for many horizon plugins | 09:21 |
| yoctozepto | if you do it for one then you don't see it | 09:22 |
| yoctozepto | also, ubuntu is always fast | 09:22 |
| yoctozepto | and centos seems to depend on the vm we get | 09:22 |
| yoctozepto | and it gets ridiculuosly slow | 09:22 |
| yoctozepto | it is slow on my machine compared to ubuntu too | 09:22 |
| mgoddard | do you know why django-admin fixes it? | 09:22 |
| *** dciabrin__ has joined #openstack-kolla | 09:23 | |
| yoctozepto | I do, I just don't know if django-admin is the right way | 09:23 |
| yoctozepto | tried to get that from them but they do not seem to know either | 09:23 |
| yoctozepto | django-admin does not set settings to use | 09:23 |
| yoctozepto | so it is not affected by their very customization they made in that offending commit | 09:24 |
| yoctozepto | that's as far as my django knowledge goes | 09:24 |
| mgoddard | could it be ignoring some useful code from horizon though? | 09:24 |
| yoctozepto | mgoddard: my worries exactly, see my commit, I already had to create the static dir manually | 09:25 |
| yoctozepto | though to me it is a bug if you get an extra dir when you do compilemessages | 09:25 |
| yoctozepto | :P | 09:25 |
| *** dciabrin_ has quit IRC | 09:27 | |
| mgoddard | is it possible that we're skipping compilemessages for plugins by using django-admin? | 09:27 |
| hrw | the issue is only in centos-binary-horizon? | 09:27 |
| mgoddard | could you try a diff of two containers using django-admin vs manage.py? | 09:27 |
| yoctozepto | I should probably redo the binary cases too | 09:27 |
| yoctozepto | hrw: centos-source | 09:27 |
| yoctozepto | > <mgoddard> is it possible that we're skipping compilemessages for plugins by using django-admin? | 09:28 |
| yoctozepto | nope, we are doing it in a loop | 09:28 |
| yoctozepto | for that very reason | 09:28 |
| yoctozepto | > <mgoddard> could you try a diff of two containers using django-admin vs manage.py? | 09:28 |
| yoctozepto | it crossed my mind | 09:28 |
| mgoddard | yoctozepto: if we remove the loop and use manage.py will it also do it for plugins? | 09:28 |
| yoctozepto | mgoddard: nope | 09:29 |
| yoctozepto | been there, done that | 09:29 |
| yoctozepto | :D | 09:29 |
| yoctozepto | it's a one way dependency now | 09:29 |
| *** k_mouza has joined #openstack-kolla | 09:34 | |
| *** SaiHarshaK has joined #openstack-kolla | 09:35 | |
| *** nathharp has joined #openstack-kolla | 09:45 | |
| yoctozepto | ok, let's build the manage.py image and compare now | 09:57 |
| *** gmann has quit IRC | 09:57 | |
| *** Dubla has joined #openstack-kolla | 10:09 | |
| *** SaiHarshaK has quit IRC | 10:09 | |
| *** SaiHarshaK has joined #openstack-kolla | 10:12 | |
| *** Dubla has quit IRC | 10:13 | |
| *** Dubla has joined #openstack-kolla | 10:13 | |
| *** zhanglong has quit IRC | 10:23 | |
| *** ktibi has quit IRC | 10:26 | |
| *** ktibi has joined #openstack-kolla | 10:27 | |
| SaiHarshaK | hello, i am trying to install kolla-stable. globals.yml -> http://paste.openstack.org/show/753347/. I am getting error at " Waiting for nova-compute service up" -> http://paste.openstack.org/show/753348/. What log files should i attach? | 10:31 |
| *** ktibi has quit IRC | 10:31 | |
| SaiHarshaK | Also i tried running command on control node, i got "[]" as output | 10:31 |
| mgoddard | SaiHarshaK: please check nova-compute logs | 10:33 |
| *** gfidente has quit IRC | 10:37 | |
| *** gmann has joined #openstack-kolla | 10:58 | |
| *** kplant has joined #openstack-kolla | 11:12 | |
| *** dciabrin_ has joined #openstack-kolla | 11:13 | |
| *** Dubla has quit IRC | 11:16 | |
| *** dciabrin__ has quit IRC | 11:17 | |
| *** gfidente has joined #openstack-kolla | 11:23 | |
| *** cah_link has quit IRC | 11:33 | |
| *** cah_link has joined #openstack-kolla | 11:42 | |
| SaiHarshaK | i think according to nova-compute logs it's not able to connect to rabbitmq - http://paste.openstack.org/show/753354/. I tried to run rabitmq in control node's container but its stuck restarting | 11:42 |
| *** priteau has quit IRC | 11:43 | |
| *** cah_link1 has joined #openstack-kolla | 11:47 | |
| hrw | SaiHarshaK: x86/ | 11:49 |
| hrw | SaiHarshaK: x86? | 11:49 |
| *** Wasaac has quit IRC | 11:49 | |
| yoctozepto | mgoddard: no difference as far as .mo files are concerned | 11:50 |
| SaiHarshaK | hrw: what? | 11:50 |
| SaiHarshaK | servers are x86_64 | 11:50 |
| mgoddard | yoctozepto: cool, thanks for checking | 11:50 |
| hrw | SaiHarshaK: that's what I asked. thx | 11:50 |
| *** Wasaac has joined #openstack-kolla | 11:50 | |
| *** cah_link has quit IRC | 11:50 | |
| *** cah_link1 is now known as cah_link | 11:50 | |
| SaiHarshaK | i stopped the rabbitmq container and started it hoping to have a look at log files, but the status again shows - Restarting (0) 3 seconds ago. | 11:59 |
| *** k_mouza_ has joined #openstack-kolla | 11:59 | |
| *** luksky has quit IRC | 12:00 | |
| *** goldyfruit has joined #openstack-kolla | 12:00 | |
| *** k_mouza has quit IRC | 12:01 | |
| hrw | SaiHarshaK: remove EDPM_ADDRESS (or sth like that) from rabbitmq extend_start scripts and check | 12:02 |
| SaiHarshaK | hrw: where can i find that? | 12:02 |
| hrw | in container ;( | 12:03 |
| SaiHarshaK | i can't run rabbitmq though | 12:03 |
| *** goldyfruit has quit IRC | 12:05 | |
| hrw | yoctozepto: try "cd */site-packages; python manage.py compilemessages" - without whole for loop. | 12:07 |
| hrw | yoctozepto: will process also django ones but should do it once instead of multiple times | 12:08 |
| *** hamzaachi has quit IRC | 12:14 | |
| SaiHarshaK | hrw: i did "sudo docker update --restart=no rabbitmq". Now if i run "sudo docker start rabbitmq", it doesn't show up on "docker ps" | 12:16 |
| hrw | SaiHarshaK: I saw similar reboots in my testing. removing EPMD_ADDRESS helped but I did not sent that yet for review | 12:17 |
| hrw | yoctozepto: http://paste.debian.net/1089183/ | 12:18 |
| *** heikkine has joined #openstack-kolla | 12:25 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: setup-gate: do not error if directory exists (CI can have it) https://review.opendev.org/667349 | 12:31 |
| hrw | mgoddard, mnasiadka, yoctozepto: ^^ should fix http://logs.openstack.org/08/665908/1/check/kolla-build-ubuntu-binary/886f200/ara-report/ | 12:31 |
| *** Dubla has joined #openstack-kolla | 12:32 | |
| *** goldyfruit has joined #openstack-kolla | 12:33 | |
| hrw | mgoddard, yoctozepto: https://pastebin.com/sN6vpPTJ is centos-source-horizon with https://pastebin.com/eN2s2DzC applied | 12:40 |
| mgoddard | hrw: I think yoctozepto said he tried removing the loop | 12:44 |
| hrw | ok | 12:45 |
| *** Dubla has quit IRC | 12:47 | |
| *** skramaja has quit IRC | 12:54 | |
| *** lemko has quit IRC | 12:55 | |
| *** luksky has joined #openstack-kolla | 13:03 | |
| *** dave-mccowan has joined #openstack-kolla | 13:06 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Wait for mariadb to stop after shutdown https://review.opendev.org/667363 | 13:11 |
| mgoddard | ^ that one should fix a stein release blocker | 13:12 |
| *** whoami-rajat has quit IRC | 13:16 | |
| *** dave-mccowan has quit IRC | 13:18 | |
| *** SaiHarshaK has quit IRC | 13:20 | |
| *** hamzaachi has joined #openstack-kolla | 13:23 | |
| *** dave-mccowan has joined #openstack-kolla | 13:32 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Wait for mariadb to stop after shutdown https://review.opendev.org/667363 | 13:38 |
| *** munimeha1 has joined #openstack-kolla | 13:41 | |
| *** openstackgerrit has quit IRC | 13:48 | |
| *** openstackgerrit has joined #openstack-kolla | 13:50 | |
| openstackgerrit | Jorge Niedbalski proposed openstack/kolla master: [prometheus/openstack-exporter] Changed repository location and version. https://review.opendev.org/667153 | 13:50 |
| *** hamzaachi has quit IRC | 13:52 | |
| hrw | mgoddard: +2 | 13:56 |
| *** Sravan has joined #openstack-kolla | 13:58 | |
| *** Sravan has quit IRC | 14:02 | |
| *** hrww has joined #openstack-kolla | 14:03 | |
| *** spiette has quit IRC | 14:05 | |
| *** hrw has quit IRC | 14:06 | |
| *** hrww is now known as hrw | 14:06 | |
| *** spiette has joined #openstack-kolla | 14:08 | |
| *** Dubla has joined #openstack-kolla | 14:16 | |
| *** Dubla has quit IRC | 14:21 | |
| *** Dubla has joined #openstack-kolla | 14:22 | |
| *** lemko has joined #openstack-kolla | 14:24 | |
| *** dpawlik has quit IRC | 14:27 | |
| *** Luzi has quit IRC | 14:35 | |
| *** igordc has joined #openstack-kolla | 14:49 | |
| *** munimeha1 has quit IRC | 14:59 | |
| yoctozepto | <mgoddard> hrw: I think yoctozepto said he tried removing the loop | 15:20 |
| yoctozepto | yeah but running from the horizon dir | 15:20 |
| yoctozepto | hrw's output looks the right way | 15:20 |
| yoctozepto | so it seems one has to change to site-packages and then run it via manage.py | 15:21 |
| hrw | yoctozepto: https://pastebin.com/xF9rpdg9 is final | 15:21 |
| hrw | building centos/debian/ubuntu binary/source horizon in background now | 15:21 |
| yoctozepto | hrw: I think you should also hit the deb binary | 15:22 |
| yoctozepto | it also has this loop | 15:22 |
| hrw | yoctozepto: deb binary fails anyway | 15:22 |
| hrw | s/deb/debian/ | 15:22 |
| yoctozepto | huh? ubuntu binary works | 15:22 |
| yoctozepto | :D | 15:22 |
| yoctozepto | yeah, debian needs proper testing | 15:23 |
| yoctozepto | failing in many places | 15:23 |
| hrw | Debian/binary target is something I still wonder about disabling | 15:23 |
| yoctozepto | hrw: so can you post this patch for review after applying also in the ubuntu+binary case? | 15:24 |
| hrw | yoctozepto: once I build ubuntu/source I will | 15:24 |
| yoctozepto | and we get it off our chests :D | 15:24 |
| hrw | INFO:kolla.common.utils:Added next task BuildTask(horizon) to queue | 15:24 |
| hrw | last image to build | 15:24 |
| yoctozepto | :D | 15:24 |
| *** yan0s has joined #openstack-kolla | 15:30 | |
| yoctozepto | hrw: https://review.opendev.org/667349 ? | 15:31 |
| yoctozepto | :O | 15:31 |
| hrw | yoctozepto: 14:31 < hrw> mgoddard, mnasiadka, yoctozepto: ^^ should fix http://logs.openstack.org/08/665908/1/check/kolla-build-ubuntu-binary/886f200/ara-report/ | 15:31 |
| hrw | yoctozepto: check how it failed | 15:32 |
| *** igordc has quit IRC | 15:32 | |
| yoctozepto | hrw: odd | 15:32 |
| yoctozepto | let me investigate | 15:32 |
| yoctozepto | it is surely not in use | 15:32 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: horizon: process i18n files just once https://review.opendev.org/667386 | 15:33 |
| yoctozepto | my gosh, zuul is broken | 15:34 |
| yoctozepto | compare with http://logs.openstack.org/08/665908/1/check/kolla-build-ubuntu-binary/886f200/job-output.txt.gz | 15:34 |
| yoctozepto | it run it either twice at the same time or repeated | 15:34 |
| yoctozepto | the txt output has different state than what ara says | 15:34 |
| hrw | yoctozepto: still if you run it and have that dir then it does not have to break for you (despite are you CI or normal user) | 15:37 |
| yoctozepto | hrw: then finally merge the cleanup I so carefully made for you :D | 15:37 |
| yoctozepto | normal user does not run this | 15:38 |
| hrw | yoctozepto: which cleanup? | 15:38 |
| yoctozepto | the one I linked in response there | 15:38 |
| yoctozepto | https://review.opendev.org/664580 | 15:39 |
| *** nathharp_ has joined #openstack-kolla | 15:39 | |
| hrw | ah | 15:40 |
| *** nathharp has quit IRC | 15:42 | |
| hrw | yoctozepto: ok. +2 | 15:43 |
| yoctozepto | hrw: thank you, sir | 15:43 |
| yoctozepto | I sent the case to infra | 15:44 |
| yoctozepto | they seem to be playing now with Zuul | 15:44 |
| hrw | yoctozepto: had to look through it again | 15:44 |
| *** nathharp_ has quit IRC | 15:46 | |
| goldyfruit | guys, I would like to add Masakari role to Kolla, I know there are already 2 reviews https://review.opendev.org/#/c/615469/ and https://review.opendev.org/#/c/615715/ but seems to have lot of conflicts to fix. | 15:47 |
| goldyfruit | Anyone is against starting from scratch ? | 15:47 |
| *** nathharp has joined #openstack-kolla | 15:47 | |
| yoctozepto | <goldyfruit> guys, I would like to add Masakari role to Kolla, I know there are already 2 reviews https://review.opendev.org/#/c/615469/ and https://review.opendev.org/#/c/615715/ but seems to have lot of conflicts to fix. | 15:47 |
| yoctozepto | 6-months-old reviews usually have | 15:48 |
| yoctozepto | :D | 15:48 |
| goldyfruit | For sure :D | 15:48 |
| goldyfruit | Lot of things are missing, stop.yml, etc... | 15:48 |
| goldyfruit | It will be faster for me to start from scratch | 15:49 |
| goldyfruit | I just want to make sure before starting that people will not ask me to fix the 2 reviews instead of creating new ones :D | 15:49 |
| hrw | https://review.opendev.org/#/c/615469 needs rebase and update to today's standards but otherwise is good as a base | 15:50 |
| hrw | not looked at ansible part | 15:51 |
| *** nathharp has quit IRC | 15:51 | |
| yoctozepto | hrw: saving yourself from merge-conflict heart attack | 15:51 |
| yoctozepto | the ansible one is 6 months old | 15:52 |
| yoctozepto | but probably it only worries about order of new config vars | 15:52 |
| hrw | goldyfruit: will you maintain masakari stuff in kolla or will it land on 'we have but no not care' list? | 15:52 |
| hrw | s/no /do / | 15:53 |
| goldyfruit | hrw, as for the Qinling role I'll maintain them, my company are using these projects | 15:53 |
| *** hamzy has quit IRC | 15:54 | |
| hrw | cool | 15:54 |
| *** luksky has quit IRC | 16:00 | |
| *** Wasaac has quit IRC | 16:03 | |
| *** rgogunskiy has quit IRC | 16:03 | |
| *** Wasaac has joined #openstack-kolla | 16:04 | |
| *** igordc has joined #openstack-kolla | 16:04 | |
| *** yan0s has quit IRC | 16:05 | |
| yoctozepto | hrw, mgoddard: ah, I seem to have not completed my answer regarding file differences, it seemed only the static directory was the differing part, everything else ran the exact same (comparing django-admin vs manage.py) | 16:15 |
| *** Sravan has joined #openstack-kolla | 16:16 | |
| yoctozepto | though I find it soothing that hrw found a less brutal approach | 16:16 |
| *** hamzaachi has joined #openstack-kolla | 16:17 | |
| *** Sravan has quit IRC | 16:19 | |
| *** Sravan has joined #openstack-kolla | 16:22 | |
| *** Sravan has quit IRC | 16:25 | |
| *** Dubla has quit IRC | 16:26 | |
| *** Sravan has joined #openstack-kolla | 16:27 | |
| *** cgrosjean has quit IRC | 16:42 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Clean up Zuul repo mirrors for CentOS https://review.opendev.org/664151 | 16:47 |
| kplant | was there a change in magnum recently that requires octavia? | 16:48 |
| kplant | i have master_lb_enabled as false but am still getting: ERROR: The Parameter (octavia_ingress_controller_tag) was not defined in template. | 16:48 |
| kplant | when trying to create a cluster | 16:48 |
| yoctozepto | kplant: I feel this question is better asked in magnum channel :D | 16:50 |
| kplant | yeah that's fair | 16:51 |
| *** k_mouza_ has quit IRC | 16:53 | |
| *** hamzaachi has quit IRC | 16:55 | |
| *** igordc has quit IRC | 16:56 | |
| *** hamzaachi has joined #openstack-kolla | 16:56 | |
| *** igordc has joined #openstack-kolla | 16:59 | |
| *** Sravan has quit IRC | 17:00 | |
| *** rgogunskiy has joined #openstack-kolla | 17:01 | |
| *** rgogunskiy has quit IRC | 17:06 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Wait for mariadb to stop after shutdown https://review.opendev.org/667363 | 17:08 |
| mgoddard | goldyfruit: we spent some time reviewing those patches, it would be a shame to throw them away. They are not so old, why not revive them? | 17:12 |
| mgoddard | goldyfruit: maybe you could speak to the author and find out what was left to do | 17:12 |
| *** hamzy has joined #openstack-kolla | 17:12 | |
| mgoddard | goldyfruit: there was also a patch which enabled masakari in CI to test the code | 17:13 |
| yoctozepto | mgoddard: https://review.opendev.org/664580 - may I get your blessing too | 17:16 |
| *** Wasaac has quit IRC | 17:21 | |
| *** cah_link has quit IRC | 17:28 | |
| mgoddard | yoctozepto: reviewed, but will wait to see if mnasiadka's issue is resolved | 17:28 |
| mgoddard | yoctozepto: did you get anywhere with infra and the zuul issues? | 17:30 |
| *** k_mouza has joined #openstack-kolla | 17:31 | |
| yoctozepto | mgoddard: they seem to be busy, RETRY_LIMIT is killing many jobs and there seems to be this issue with duplicated run, maybe it's the same issue? | 17:33 |
| *** dougsz has quit IRC | 17:33 | |
| mgoddard | yeah could be | 17:33 |
| yoctozepto | if you retry concurrently then it might reach the RETRY_LIMIT :D | 17:34 |
| yoctozepto | sounds logical | 17:34 |
| *** lemko has quit IRC | 17:34 | |
| mgoddard | 'finger' normally means zuul lost connectivity to the VM | 17:34 |
| yoctozepto | I guess you can try pinging them too | 17:34 |
| yoctozepto | mgoddard: yeah, some that managed to leave logs displayed this symptom | 17:34 |
| mgoddard | it's getting near the end of the day, if they're aware hopefully it'll be back tomorrow | 17:35 |
| yoctozepto | might be scheduler doing something nasty there | 17:35 |
| *** k_mouza has quit IRC | 17:35 | |
| yoctozepto | yeah, that's fair | 17:36 |
| *** Sravan has joined #openstack-kolla | 17:38 | |
| *** Sravan_ has joined #openstack-kolla | 17:41 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Remove Oracle Linux stuff in CI code https://review.opendev.org/667420 | 17:42 |
| *** Sravan has quit IRC | 17:42 | |
| mnasiadka | mgoddard: I'm fine now with this change, should I +w it, or do you have some unresolved questions to Radoslaw? | 17:43 |
| mgoddard | mnasiadka: no, go ahead | 17:43 |
| mgoddard | although zuul will probably throw it out :) | 17:44 |
| mnasiadka | fire in the hole | 17:44 |
| mnasiadka | yeah, sorry for not being active last days, but I have some... $job things | 17:44 |
| mnasiadka | I'll have more time tomorrow and in the coming days | 17:44 |
| yoctozepto | mgoddard: re: mariadb change in stein | 17:46 |
| yoctozepto | it seems something analogical is plaguing rabbitmq upgrade as well | 17:46 |
| mgoddard | mnasiadka: no worries, that's life | 17:46 |
| yoctozepto | https://etherpad.openstack.org/p/kolla-ci-errors | 17:46 |
| yoctozepto | at the bottom | 17:46 |
| mgoddard | yoctozepto: are you sure that those failures are not a consequence of the mariadb issues? I have seen where one host fails in mariadb, then the plays continue and other hosts fail in rabbitmq because they have mismatched versions | 17:47 |
| yoctozepto | food for thought because I am not knowledgeable enough :D | 17:47 |
| yoctozepto | mgoddard: I see, let me verify that with your words in mind | 17:48 |
| mgoddard | yoctozepto: that is why I tried setting any_errors_fatal in https://review.opendev.org/#/c/666876 but it seemed not to work (tested in ansible 2.6.something) | 17:48 |
| yoctozepto | mgoddard: you are right, secondary2 was excluded due to mariadb and then it all failed | 17:49 |
| mgoddard | yeah | 17:49 |
| mgoddard | need to spend some time looking into any_errors_fatal, perhaps the bug has been fixed in a more recent ansible | 17:50 |
| yoctozepto | mgoddard: how so did not it work? | 17:50 |
| mgoddard | running out of upstream credits though, downstream calls :) | 17:50 |
| yoctozepto | did not FAIL EARLY? | 17:50 |
| mgoddard | it was as if it was not specified, or set to false | 17:51 |
| yoctozepto | ok, I will take a peek at that | 17:51 |
| mgoddard | there are various ansible bugs about any_errors_fatal not working in certain situations, including in handlers. Hard to tell when they were fixed | 17:51 |
| mgoddard | if you have time that would be great. I think we just need a few test cases to work out when it does and doesn't work | 17:52 |
| mgoddard | if we can fix by using a more recent ansible, that would be nice | 17:52 |
| *** Wasaac has joined #openstack-kolla | 17:52 | |
| mnasiadka | mgoddard: I prefer life over tripleo :) | 17:54 |
| mgoddard | choose life | 17:55 |
| mnasiadka | mgoddard: working on it :) | 17:55 |
| *** Wasaac has quit IRC | 17:58 | |
| *** gfidente has quit IRC | 17:59 | |
| mgoddard | kolla priorities vote results are in: https://etherpad.openstack.org/p/kolla-train-priorities | 18:02 |
| *** Sravan_ has quit IRC | 18:02 | |
| yoctozepto | mgoddard: there is no life in there, but tripleo is | 18:05 |
| *** Sravan has joined #openstack-kolla | 18:05 | |
| *** Sravan has quit IRC | 18:14 | |
| *** iniazi has joined #openstack-kolla | 18:20 | |
| yoctozepto | mgoddard, mnasiadka, hrw: I would be interested in pursuing https://blueprints.launchpad.net/kolla-ansible/+spec/ipv6-control-plane but I am unsure whether we want "When IPv4 address is not available, fallback to IPv6" rather than "let user use IPv6" | 18:21 |
| mgoddard | yoctozepto: there is a community cross project goal for IPv6. We should work with other projects, and even other deployment tools to make sure that it is consistent | 18:22 |
| *** iniazi_ has quit IRC | 18:23 | |
| mgoddard | yoctozepto: updated the blueprint | 18:25 |
| mgoddard | https://governance.openstack.org/tc/goals/train/ipv6-support-and-testing.html | 18:25 |
| yoctozepto | mgoddard: thanks | 18:27 |
| *** Sravan has joined #openstack-kolla | 18:29 | |
| mgoddard | yoctozepto: signed you up on https://etherpad.openstack.org/p/kolla-train-priorities :) | 18:32 |
| openstackgerrit | Gaëtan Trellu proposed openstack/kolla master: Add Masakari container images https://review.opendev.org/615469 | 18:33 |
| goldyfruit | Starting with the easy, I know the Ansible part will be pain in the ass! | 18:33 |
| yoctozepto | goldyfruit: but you can do it! | 18:37 |
| yoctozepto | mgoddard: thanks, feeling like an owner now 8-) | 18:38 |
| goldyfruit | yoctozepto, finger crossed | 18:38 |
| openstackgerrit | Merged openstack/kolla-ansible master: Add gnocchi extra volumes https://review.opendev.org/666975 | 18:38 |
| *** Sravan has quit IRC | 18:39 | |
| yoctozepto | goldyfruit: any reason why -monitors are not based on -base ? | 18:41 |
| yoctozepto | I mean, the masakari-base | 18:43 |
| yoctozepto | but instead on the openstack-base | 18:43 |
| goldyfruit | yoctozepto, I'm going in multiple steps | 18:44 |
| goldyfruit | First I', fixing the conflict | 18:44 |
| goldyfruit | Then I'll add the missing parts | 18:44 |
| yoctozepto | goldyfruit: ok, I'll slap the comment so that you don't forget | 18:45 |
| goldyfruit | Thx | 18:45 |
| *** Sravan has joined #openstack-kolla | 18:46 | |
| yoctozepto | goldyfruit: I suggest you slap workflow -1 or add WIP/DNM on the commit topic so that others are not considering this for review | 18:47 |
| goldyfruit | I'll | 18:47 |
| *** hamzaachi has quit IRC | 18:48 | |
| *** luksky has joined #openstack-kolla | 18:53 | |
| *** Sravan has quit IRC | 18:57 | |
| *** Sravan has joined #openstack-kolla | 18:57 | |
| *** Wasaac has joined #openstack-kolla | 19:02 | |
| *** Wasaac has quit IRC | 19:07 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Clean up Zuul repo mirrors for CentOS https://review.opendev.org/664151 | 19:08 |
| mnasiadka | goldyfruit: masakari still relies on pacemaker? | 19:09 |
| openstackgerrit | Gaëtan Trellu proposed openstack/kolla master: WIP: Add Masakari containers https://review.opendev.org/615469 | 19:11 |
| openstackgerrit | Gaëtan Trellu proposed openstack/kolla master: WIP: Add Masakari containers https://review.opendev.org/615469 | 19:13 |
| yoctozepto | mnasiadka: he busy with proposals :D | 19:16 |
| goldyfruit | mnasiadka, yes | 19:25 |
| mnasiadka | goldyfruit: it will be fun I guess :) | 19:25 |
| goldyfruit | When I was working for RH we tried to implement a solution like (before Masakari) for customers who needed instances HA :D | 19:27 |
| goldyfruit | Based on Pacemaker... It has been a fail. | 19:27 |
| *** pcaruana has quit IRC | 19:38 | |
| yoctozepto | the crowds are cheering, this time it will be successful | 19:38 |
| yoctozepto | also, there is nothing inherently wrong with pacemaker, or is there? | 19:39 |
| *** factor has joined #openstack-kolla | 19:39 | |
| *** icarusfactor has quit IRC | 19:40 | |
| *** Sravan has quit IRC | 19:40 | |
| goldyfruit | from my experience, it doesn't scale at all | 19:42 |
| goldyfruit | when you have too many resources, pacemaker become crazy | 19:42 |
| kplant | goldyfruit: i tried that implementation... and with stonith as well | 19:43 |
| kplant | i couldn't agree more with what you're saying | 19:43 |
| *** kplant has quit IRC | 19:46 | |
| *** rgogunskiy has joined #openstack-kolla | 19:47 | |
| *** rgogunskiy has quit IRC | 19:50 | |
| *** Sravan has joined #openstack-kolla | 19:56 | |
| *** Sravan has quit IRC | 20:01 | |
| *** Sravan has joined #openstack-kolla | 20:17 | |
| *** factor has quit IRC | 20:20 | |
| *** factor has joined #openstack-kolla | 20:21 | |
| *** Sravan has quit IRC | 20:22 | |
| *** ohwhyosa- has quit IRC | 20:24 | |
| *** ivve has quit IRC | 20:24 | |
| *** factor has quit IRC | 20:31 | |
| *** factor has joined #openstack-kolla | 20:32 | |
| *** hamzy has quit IRC | 20:33 | |
| *** factor has quit IRC | 20:52 | |
| *** factor has joined #openstack-kolla | 20:52 | |
| *** factor has quit IRC | 20:59 | |
| *** Sravan has joined #openstack-kolla | 21:05 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: horizon: process i18n files just once https://review.opendev.org/667386 | 21:15 |
| hrw | should pass zuul to the morning | 21:17 |
| *** openstackgerrit has quit IRC | 21:18 | |
| *** factor has joined #openstack-kolla | 21:37 | |
| *** hjensas has quit IRC | 21:50 | |
| *** hjensas has joined #openstack-kolla | 21:50 | |
| *** rgogunskiy has joined #openstack-kolla | 21:51 | |
| *** rgogunskiy has quit IRC | 21:55 | |
| *** cgrosjean has joined #openstack-kolla | 22:18 | |
| *** sean-k-mooney has quit IRC | 22:31 | |
| *** cgrosjean has quit IRC | 22:32 | |
| *** luksky has quit IRC | 22:34 | |
| *** jonaspaulo has quit IRC | 22:45 | |
| *** Sravan has quit IRC | 23:26 | |
| *** Sravan has joined #openstack-kolla | 23:30 | |
| *** Sravan has quit IRC | 23:35 | |
| *** kplant has joined #openstack-kolla | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!