*** rh-jelabarre has quit IRC | 00:07 | |
*** rh-jelabarre has joined #tripleo | 00:08 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 00:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
*** rh-jelabarre has quit IRC | 00:12 | |
*** slaweq has joined #tripleo | 00:14 | |
*** dsneddon has joined #tripleo | 00:19 | |
*** slaweq has quit IRC | 00:25 | |
*** dmacpher has quit IRC | 00:52 | |
*** dmacpher has joined #tripleo | 00:56 | |
*** weshay has quit IRC | 00:59 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 01:10 |
*** slaweq has joined #tripleo | 01:11 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Design new role for zuul-based reproducer https://review.openstack.org/631067 | 01:20 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Design new role for zuul-based reproducer https://review.openstack.org/631067 | 01:22 |
*** slaweq has quit IRC | 01:25 | |
*** rh-jelabarre has joined #tripleo | 02:08 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 02:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
*** slaweq has joined #tripleo | 02:16 | |
*** slaweq has quit IRC | 02:24 | |
*** morazi has quit IRC | 03:01 | |
*** ykarel has joined #tripleo | 03:01 | |
*** psachin has joined #tripleo | 03:05 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 03:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
*** slaweq has joined #tripleo | 03:14 | |
*** aedc has quit IRC | 03:24 | |
*** slaweq has quit IRC | 03:24 | |
*** shyamb has joined #tripleo | 03:39 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common stable/rocky: Check for physical_resource_id before getting deployments https://review.openstack.org/632011 | 03:40 |
*** ramishra has joined #tripleo | 03:41 | |
*** wolverineav has joined #tripleo | 03:47 | |
*** wolverineav has quit IRC | 03:51 | |
*** bfournie has joined #tripleo | 03:53 | |
*** udesale has joined #tripleo | 04:00 | |
*** udesale has quit IRC | 04:00 | |
*** udesale has joined #tripleo | 04:01 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 04:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
*** slaweq has joined #tripleo | 04:16 | |
*** slaweq has quit IRC | 04:24 | |
*** shyamb has quit IRC | 04:28 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Use os_tempest for running tempest on standalone https://review.openstack.org/628415 | 04:57 |
openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: Run os_tempest with standalone for tripleo-specs https://review.openstack.org/627500 | 04:59 |
*** ramishra has quit IRC | 04:59 | |
openstackgerrit | Merged openstack/diskimage-builder master: support cracklib in pam for Gentoo's musl profile https://review.openstack.org/631009 | 05:03 |
*** pdeore has joined #tripleo | 05:04 | |
*** rh-jelabarre has quit IRC | 05:04 | |
*** cfontain has joined #tripleo | 05:06 | |
*** ramishra has joined #tripleo | 05:07 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 05:10 |
*** numans_ has quit IRC | 05:10 | |
*** slaweq has joined #tripleo | 05:15 | |
*** numans has joined #tripleo | 05:17 | |
*** ykarel has quit IRC | 05:19 | |
*** ratailor has joined #tripleo | 05:23 | |
*** slaweq has quit IRC | 05:24 | |
*** skramaja has joined #tripleo | 05:28 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Unskip neutron tempest plugin tests https://review.openstack.org/606937 | 05:32 |
openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: Unskip neutron tempest plugin https://review.openstack.org/631441 | 05:32 |
*** ratailor_ has joined #tripleo | 05:34 | |
*** ratailor has quit IRC | 05:37 | |
*** ratailor__ has joined #tripleo | 05:37 | |
*** cfontain has quit IRC | 05:40 | |
*** ratailor_ has quit IRC | 05:40 | |
*** spsurya has joined #tripleo | 05:41 | |
openstackgerrit | Jason E. Rist proposed openstack/tripleo-quickstart-extras master: Nova was not being properly configured with virthost IP. https://review.openstack.org/632019 | 05:42 |
*** ykarel has joined #tripleo | 05:47 | |
*** ramishra_ has joined #tripleo | 05:48 | |
*** radeks__ has joined #tripleo | 05:49 | |
*** ramishra has quit IRC | 05:51 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 06:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Check for physical_resource_id before getting deployments https://review.openstack.org/632023 | 06:13 |
*** KingJ has quit IRC | 06:42 | |
*** safchain has quit IRC | 06:42 | |
*** egonzalez has quit IRC | 06:42 | |
*** adrianreza has quit IRC | 06:42 | |
*** KingJ has joined #tripleo | 06:42 | |
*** adrianreza has joined #tripleo | 06:43 | |
*** egonzalez has joined #tripleo | 06:43 | |
*** safchain has joined #tripleo | 06:44 | |
*** quiquell|off is now known as quiquell | 06:44 | |
*** shyamb has joined #tripleo | 06:45 | |
*** jtomasek has joined #tripleo | 06:48 | |
*** ramishra_ has quit IRC | 06:50 | |
*** shyam89 has joined #tripleo | 06:52 | |
*** shyamb has quit IRC | 06:55 | |
*** saneax has joined #tripleo | 06:55 | |
*** ksambor has joined #tripleo | 06:59 | |
*** ramishra has joined #tripleo | 06:59 | |
*** rcernin has quit IRC | 07:00 | |
Tengu | hello there :) | 07:02 |
*** cfontain has joined #tripleo | 07:02 | |
*** jaganathan has joined #tripleo | 07:07 | |
*** shyam89 has quit IRC | 07:08 | |
*** shyam89 has joined #tripleo | 07:10 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 07:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
*** hakhande_ has joined #tripleo | 07:10 | |
*** wolverineav has joined #tripleo | 07:11 | |
*** wolverineav has quit IRC | 07:12 | |
openstackgerrit | yatin proposed openstack/tripleo-quickstart-extras master: Do not build projects with '-distgit' in project name https://review.openstack.org/632032 | 07:13 |
*** yprokule has joined #tripleo | 07:13 | |
*** shyam89 has quit IRC | 07:14 | |
*** wolverineav has joined #tripleo | 07:14 | |
*** shyam89 has joined #tripleo | 07:15 | |
*** jschlueter has quit IRC | 07:16 | |
*** shyam89 has quit IRC | 07:21 | |
*** ccamacho has joined #tripleo | 07:28 | |
openstackgerrit | Andriy Shevchenko proposed openstack/puppet-tripleo master: Update home-page https://review.openstack.org/632035 | 07:30 |
*** mschuppert has joined #tripleo | 07:32 | |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Make libvirt role usable by zuul reproducer https://review.openstack.org/629839 | 07:35 |
*** cfontain has quit IRC | 07:36 | |
*** aufi has joined #tripleo | 07:39 | |
*** slaweq has joined #tripleo | 07:43 | |
*** kopecmartin|off is now known as kopecmartin | 07:47 | |
*** apetrich has joined #tripleo | 07:49 | |
*** jfrancoa has joined #tripleo | 07:51 | |
*** cylopez has joined #tripleo | 07:54 | |
marios | o/ folks grateful for comments and suggestions [docs] https://review.openstack.org/#/c/631024/3 & looks like http://logs.openstack.org/24/631024/3/check/openstack-tox-docs/2df3a00/html/contributor/ci_primer.html | 07:55 |
chandankumar | slaweq: hello | 07:56 |
*** paramite has joined #tripleo | 07:56 | |
chandankumar | slaweq: please have a look at this failure http://logs.openstack.org/67/631967/1/check/openstack-ansible-functional-centos-7/e7aafa0/logs/openstack/tempest1/stestr_results.html | 07:56 |
chandankumar | slaweq: It is only giving ssh timed out centos jobs | 07:56 |
*** florianf has joined #tripleo | 07:56 | |
slaweq | chandankumar: hi | 07:56 |
chandankumar | slaweq: Here is all the neutron logs http://logs.openstack.org/67/631967/1/check/openstack-ansible-functional-centos-7/e7aafa0/logs/openstack/openstack1/neutron/ | 07:57 |
*** ykarel is now known as ykarel|lunch | 07:58 | |
slaweq | chandankumar: strange, I don't see any errors in logs | 08:00 |
chandankumar | slaweq: let me get this in Tripleo Side | 08:00 |
*** dsneddon has quit IRC | 08:01 | |
chandankumar | slaweq: http://logs.openstack.org/00/627500/54/check/tripleo-ci-centos-7-standalone-os-tempest/a26d2d0/logs/undercloud/var/log/tempest/stestr_results.html.gz | 08:02 |
chandankumar | slaweq: on tripleo side it is failing with the same error | 08:02 |
*** dsneddon has joined #tripleo | 08:02 | |
*** ramishra has quit IRC | 08:03 | |
chandankumar | slaweq: is it related to old cirros image? | 08:03 |
chandankumar | slaweq: we are currently using there 0.3.5? | 08:04 |
slaweq | chandankumar: I don't think so | 08:04 |
apetrich | jtomasek, Morning! Do you have a minute to talk about this https://review.openstack.org/#/c/630970/ ? | 08:04 |
*** holser_ has joined #tripleo | 08:04 | |
slaweq | chandankumar: this is strange, I don't see in logs where this FIP is configured in router's namespace | 08:08 |
*** ratailor_ has joined #tripleo | 08:08 | |
chandankumar | slaweq: http://logs.openstack.org/00/627500/54/check/tripleo-ci-centos-7-standalone-os-tempest/a26d2d0/logs/undercloud/var/log/containers/nova/nova-api.log.txt.gz#_2019-01-18_13_02_14_808 | 08:08 |
slaweq | can You maybe run this job for me and put it on hold when it will break? That I would be able to log into this node and debug there | 08:09 |
chandankumar | slaweq: https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L131 | 08:09 |
slaweq | chandankumar: what is this error in nova? Related somehow? | 08:09 |
*** ramishra has joined #tripleo | 08:09 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 08:10 |
chandankumar | slaweq: slo.messaging._drivers.impl_rabbit [req-fa2c58d5-c1ee-4906-8ad6-99689d738cab c06bf0047466421194167d2d06b13b0a 77a2d370a2d54bf1b89672600850c62a - default default] [6beeb097-c220-4549-bfe9-0a612b7511a6] AMQP server on centos-7-inap-mtl01-0001893874.internalapi.localdomain:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: error: [Errno 104] Connection reset by peer | 08:10 |
slaweq | chandankumar: yes, I saw that | 08:11 |
*** ratailor__ has quit IRC | 08:11 | |
slaweq | but it'sdifferent test run than http://logs.openstack.org/67/631967/1/check/openstack-ansible-functional-centos-7/e7aafa0/logs/openstack/tempest1/stestr_results.html right? | 08:11 |
chandankumar | slaweq: same tests is failing on tripleo side as wellas OSA side on centos job we are working on reusing the same os_tempest role in tripleo | 08:12 |
chandankumar | but the mystery is it is failing on both side | 08:13 |
jtomasek | apetrich: ok | 08:14 |
chandankumar | slaweq: I will fire a reproducer and pass it to you | 08:14 |
jtomasek | apetrich: yes | 08:14 |
slaweq | chandankumar: thx, maybe that way will be easier to check what is going on there | 08:14 |
apetrich | jtomasek, so my thinking is that a little bloat in the client for it to backwards compatible is acceptable | 08:14 |
apetrich | jtomasek, since I have client tools and we talk to rdo-cloud and I have the foggest idea what version is running on rdo-cloud | 08:15 |
jtomasek | apetrich: yes, I agree, I wanted to comment on that. can you maybe add a deprecation comment to that part? it is a nit though | 08:15 |
apetrich | jtomasek, no problem. it is a good point. I will add it | 08:16 |
apetrich | when that merge we can merge the tripleo-common. | 08:16 |
*** tkajinam has quit IRC | 08:16 | |
jtomasek | apetrich: keeping it also allows my tripleo-common patch to be without change | 08:16 |
jtomasek | apetrich: I'll take one more look on that tripleoclient patch and test both together in my env | 08:17 |
apetrich | jtomasek, amazing. thanks! | 08:17 |
*** wolverineav has quit IRC | 08:18 | |
openstackgerrit | Adriano Petrich proposed openstack/python-tripleoclient master: Remove execution from workflow message send https://review.openstack.org/630970 | 08:26 |
*** wolverineav has joined #tripleo | 08:26 | |
*** wolverineav has quit IRC | 08:28 | |
*** wolverineav has joined #tripleo | 08:29 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Added requirements for integrating os_tempest role https://review.openstack.org/628421 | 08:31 |
*** ykarel|lunch is now known as ykarel | 08:32 | |
*** wolverineav has quit IRC | 08:33 | |
*** gkadam has joined #tripleo | 08:34 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Use os_tempest for running tempest on standalone https://review.openstack.org/628415 | 08:36 |
*** tosky has joined #tripleo | 08:36 | |
openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: Run tempest using os_tempest role in standalone job https://review.openstack.org/627500 | 08:41 |
*** jpich has joined #tripleo | 08:41 | |
*** xek_ has joined #tripleo | 08:42 | |
*** gfidente has joined #tripleo | 08:48 | |
*** hberaud|gone is now known as hberaud | 08:54 | |
*** saneax is now known as saneax|mtg | 08:59 | |
*** jpena|off is now known as jpena | 09:03 | |
*** wolverineav has joined #tripleo | 09:05 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 09:10 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add node disks validation https://review.openstack.org/604356 | 09:17 |
*** d0ugal has quit IRC | 09:21 | |
*** salmankhan has joined #tripleo | 09:21 | |
*** d0ugal has joined #tripleo | 09:22 | |
*** shardy has joined #tripleo | 09:24 | |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add node disks validation https://review.openstack.org/604356 | 09:25 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Use os_tempest for running tempest on standalone https://review.openstack.org/628415 | 09:26 |
chandankumar | marios: I am updating TQE and TOCI patches | 09:26 |
openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: Run tempest using os_tempest role in standalone job https://review.openstack.org/627500 | 09:27 |
*** wolverineav has quit IRC | 09:28 | |
*** panda|off is now known as panda | 09:29 | |
*** avivgt has joined #tripleo | 09:29 | |
*** salmankhan1 has joined #tripleo | 09:30 | |
*** salmankhan has quit IRC | 09:30 | |
*** salmankhan1 is now known as salmankhan | 09:30 | |
marios | ack chandankumar | 09:32 |
marios | shardy: o/ hello don't suppose you still have core on heat? otherwise any idea who i should harrass to get this merged https://review.openstack.org/#/c/628249 (just tried openstack-heat again but don't know folks there rabi has already voted) | 09:33 |
*** boazel has joined #tripleo | 09:36 | |
shardy | marios: Hey yes I do, mostly only reviewing backports these days though | 09:37 |
shardy | therve may also be able to help | 09:37 |
therve | marios: What's openstack-heat | 09:37 |
* shardy looks | 09:37 | |
therve | Just approved it | 09:37 |
shardy | thanks therve | 09:38 |
*** shyam89 has joined #tripleo | 09:38 | |
*** ramishra has quit IRC | 09:38 | |
*** derekh has joined #tripleo | 09:38 | |
marios | shardy: therve thanks! sorry i didn't think of tomas ! thanks folks (therve i mean openstack-heat on freenode) | 09:38 |
*** boazel_ has quit IRC | 09:38 | |
therve | marios: The channel is #heat | 09:38 |
marios | therve: ah thanks. well there are quite a few folks on 'openstack-heat' ! | 09:39 |
marios | therve: i was joining openstack-telemetry andothers for https://review.openstack.org/#/q/topic:replace-scen2+(status:open+OR+status:merged) | 09:39 |
therve | marios: See the topic :D | 09:39 |
marios | therve: thanks :D | 09:39 |
*** ramishra has joined #tripleo | 09:40 | |
*** bogdando has joined #tripleo | 09:41 | |
*** jaganathan has quit IRC | 09:43 | |
*** suuuper has joined #tripleo | 09:44 | |
openstackgerrit | Mike Fedosin proposed openstack/tripleo-docs master: Add OpenShift deployment documentation https://review.openstack.org/632052 | 09:44 |
*** salmankhan has quit IRC | 09:44 | |
*** salmankhan has joined #tripleo | 09:47 | |
*** salmankhan1 has joined #tripleo | 09:51 | |
*** bogdando has quit IRC | 09:51 | |
*** salmankhan has quit IRC | 09:52 | |
*** salmankhan1 is now known as salmankhan | 09:52 | |
*** holser_ has quit IRC | 09:52 | |
*** ratailor_ has quit IRC | 09:52 | |
*** jaosorior has joined #tripleo | 09:53 | |
*** bogdando has joined #tripleo | 09:57 | |
*** dtantsur|afk is now known as dtantsur | 09:57 | |
*** holser_ has joined #tripleo | 09:57 | |
*** chem has joined #tripleo | 09:57 | |
dtantsur | shardy: morning, what can be better than a long and complex patch to start one's Monday? ;) https://review.openstack.org/#/c/576856/ | 10:01 |
*** dciabrin has joined #tripleo | 10:02 | |
dtantsur | I did a live demo of it to jaosorior on Friday | 10:02 |
dtantsur | and the patch celebrated 7 months in existence yesterday, I'd really love it to move forward :) | 10:03 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/rocky: Ensure logs folder is created in prep hosts tasks. https://review.openstack.org/631821 | 10:03 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: [WIP]Use os_tempest for running tempest on standalone https://review.openstack.org/628415 | 10:04 |
openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: [WIP] Run tempest using os_tempest role in standalone job https://review.openstack.org/627500 | 10:05 |
shardy | dtantsur: hi! Sure I'll take a look at it today | 10:09 |
dtantsur | thanks! | 10:10 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 10:10 |
*** ratailor has joined #tripleo | 10:12 | |
openstackgerrit | Lee Yarwood proposed openstack/tripleo-common master: placement: Add missing healthcheck for extracted service https://review.openstack.org/632057 | 10:14 |
lyarwood | mschuppert: ^ thanks for catching that btw | 10:15 |
*** shyam89 has quit IRC | 10:17 | |
Tengu | jaosorior: hello! | 10:18 |
mschuppert | lyarwood: happy to help! | 10:18 |
Tengu | jaosorior: I think you might be interested in an iptables issue I've discovered: all the rules we set in tripleo are useless, at least on the undercloud :D | 10:18 |
jaosorior | Tengu wtf, why/ | 10:19 |
jaosorior | ? | 10:19 |
openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: WIP placement: Extract the service from Nova https://review.openstack.org/630644 | 10:19 |
Tengu | jaosorior: DM - tmate session. | 10:19 |
*** openstackgerrit has quit IRC | 10:21 | |
*** shyam89 has joined #tripleo | 10:23 | |
ykarel | slagle, jaosorior https://review.openstack.org/#/c/576481 seems to have broken fs035 job | 10:24 |
ykarel | arxcruz|ruck, ssbarnea|rover ^^ | 10:24 |
ykarel | is this already known? | 10:24 |
jaosorior | I didn't know | 10:24 |
ykarel | broken: https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035&branch=master | 10:24 |
ykarel | ratailor, owalsh ^^ | 10:25 |
ykarel | i can't see any pass of fs035 in the patch | 10:25 |
arxcruz|ruck | ykarel: nope, opening a lp, thanks | 10:25 |
ykarel | ack | 10:26 |
ratailor | ykarel, ack. | 10:27 |
arxcruz|ruck | ratailor: ykarel: https://bugs.launchpad.net/tripleo/+bug/1812632 | 10:30 |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,Triaged] | 10:30 |
lyarwood | owalsh: ^ | 10:31 |
ratailor | mschuppert, ^^ | 10:31 |
ykarel | arxcruz|ruck, ack | 10:31 |
*** openstackgerrit has joined #tripleo | 10:32 | |
openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Allow to specify order of roles upgrade. https://review.openstack.org/631211 | 10:32 |
ratailor | arxcruz|ruck, ack | 10:32 |
arxcruz|ruck | ratailor: thanks :) | 10:32 |
*** suuuper has quit IRC | 10:33 | |
*** ratailor has quit IRC | 10:38 | |
*** wolverineav has joined #tripleo | 10:41 | |
*** ramishra has quit IRC | 10:41 | |
bogdando | o/ can we merge https://review.openstack.org/#/c/628957/ :) | 10:41 |
*** ramishra has joined #tripleo | 10:41 | |
*** ratailor has joined #tripleo | 10:48 | |
Tengu | jaosorior: https://bugzilla.redhat.com/show_bug.cgi?id=1667887 | 10:49 |
openstack | bugzilla.redhat.com bug 1667887 in openstack-tripleo-heat-templates "Dangerous iptables rules are kept after the deploy (v4 and v6)" [High,New] - Assigned to emacchi | 10:49 |
Tengu | jaosorior: would that be for DF or Security DFG though? | 10:50 |
jaosorior | Tengu: well, if you folks are already working on it. DF | 10:54 |
bogdando | Tengu: hi | 10:55 |
bogdando | bandini: hi! do you know if we have a bug for the mismatching iptables rules issue yet? | 10:55 |
*** ratailor_ has joined #tripleo | 10:55 | |
bogdando | bandini: that issue we debugged at Friday... | 10:55 |
bandini | bogdando: don't think we do yet, wanted to come up with a simple podman reproducer first | 10:56 |
Tengu | bogdando: hey :) | 10:56 |
bogdando | Tengu: the bug was rules created for containers are not at the host | 10:56 |
bogdando | jfyi) | 10:56 |
bandini | bogdando: it might just be that we need to add some '--iptablesnamespace=usethehostdamnit' kind of switch | 10:57 |
Tengu | bogdando: gni? not related to the one I just opened right? | 10:57 |
bogdando | prolly not, just recalled that as well | 10:57 |
*** ratailor has quit IRC | 10:57 | |
Tengu | bandini, bogdando : I think dciabrin and EmilienM pushed a thing that will actually apply the iptables rules from the host and not from haproxy_iptables container anymore | 10:57 |
Tengu | anyway. not realted to the issue I created - mine is due to iptable-services pushing rules in place -.-' | 10:58 |
bogdando | Tengu: the issue was that neutron agents containers contained rules supposed to be at the host as well, like it was for docker & queens, not for our podman testing tho | 10:58 |
bandini | Tengu: right but that is for haproxy, neutron creates iptables rules dynamically from a container so we need to fix things there as well | 10:58 |
Tengu | jaosorior: ok, so I take it, and will discuss a bit. | 10:58 |
jaosorior | Tengu: sure | 10:59 |
bogdando | iirc | 10:59 |
Tengu | bogdando: ok, yeah, so there it's managed from within container. and indeed, namespace is important ;) | 10:59 |
bogdando | so there was no connectivity in netns to ips of vms | 10:59 |
bogdando | right | 10:59 |
Tengu | jaosorior: would you say it's a blocker? | 11:00 |
*** ratailor_ has quit IRC | 11:00 | |
bogdando | tho there is nothing but net ns, a new secret one for iptables in new os version? :D bandini | 11:00 |
*** ratailor has joined #tripleo | 11:00 | |
bandini | bogdando: I wonder :) | 11:00 |
bogdando | one to rule them all | 11:01 |
*** hberaud is now known as hberaud|lunch | 11:04 | |
*** ratailor has quit IRC | 11:06 | |
*** shyam89 has quit IRC | 11:10 | |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 11:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
*** ratailor has joined #tripleo | 11:13 | |
openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Allow connections from anywhere to port 22 https://review.openstack.org/632069 | 11:16 |
openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Allow connections from anywhere to port 22 https://review.openstack.org/632069 | 11:19 |
bandini | bogdando: https://bugs.launchpad.net/tripleo/+bug/1812640 I filed one as a starting point | 11:19 |
openstack | Launchpad bug 1812640 in tripleo "iptables rules are not host-based when using podman" [Undecided,New] | 11:19 |
*** udesale has quit IRC | 11:20 | |
*** dciabrin has quit IRC | 11:27 | |
bogdando | bandini: thanks | 11:33 |
ykarel | jistr, hi | 11:34 |
*** ratailor has quit IRC | 11:36 | |
*** ratailor has joined #tripleo | 11:36 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-heat-templates master: Adding pyshim to nova_cell_v2_discover_host.py https://review.openstack.org/632070 | 11:37 |
ssbarnea|rover | mschuppert: are you working on the LP 1812632? | 11:39 |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,Triaged] https://launchpad.net/bugs/1812632 | 11:39 |
ykarel | jistr, actually i am trying an upgrade from queens to rocky, and it's failing in Compute upgrade step at nova_wait_for_placement_service(with NoOptionError: No option 'valid_interfaces' in section: 'placement'), i looked and find that packages(repos are configured correctly) are not updated to rocky | 11:39 |
ykarel | mschuppert, are u aware of ^^ issue upgrade one | 11:40 |
ykarel | asking as i see u authored that script | 11:40 |
*** suuuper has joined #tripleo | 11:40 | |
mschuppert | ssbarnea|rover: started looking at it. but yes will work on it | 11:40 |
ssbarnea|rover | mschuppert: thanks! i will add you to it, so we will know. | 11:41 |
mschuppert | ykarel: no have not seen it yet | 11:41 |
jistr | ykarel: hi, what script is that from? Or which ansible task in the upgrade? | 11:41 |
ykarel | mschuppert, ack | 11:42 |
ykarel | jistr, openstack overcloud upgrade run --roles Compute | 11:42 |
ykarel | jistr, and error seen in /var/log/containers/mistral/package_update.log | 11:42 |
ykarel | playbook:- deploy_steps_playbook.yaml seeing in failed task | 11:43 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Make libvirt role usable by zuul reproducer https://review.openstack.org/629839 | 11:43 |
*** florianf has quit IRC | 11:45 | |
mschuppert | ykarel: it fails here https://github.com/openstack/tripleo-heat-templates/blob/master/docker_config_scripts/nova_wait_for_placement_service.py#L73 where valid_interfaces this whould be set by https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-base.yaml#L262 | 11:47 |
mschuppert | whould/should | 11:48 |
*** shyam89 has joined #tripleo | 11:48 | |
ykarel | mschuppert, yes that i checked, it's happening in queens to rocky upgrade, | 11:48 |
ykarel | mschuppert, in queens os_interface is set, while since rocky valid_interfaces | 11:49 |
ykarel | mschuppert, i am trying to find why puppet modules not updated with jistr | 11:49 |
mschuppert | ykarel: ok | 11:49 |
ykarel | on compute nodes, on controller i can see new puppet-nova | 11:49 |
owalsh | mschuppert: looks like you've a good handle on LP 1812632, anything I can do to help? | 11:54 |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,Triaged] https://launchpad.net/bugs/1812632 - Assigned to Martin Schuppert (mschuppert) | 11:54 |
jistr | ykarel: do you have the TripleoPackages service included and enabled on computes? | 11:55 |
ykarel | jistr, looking, i used default roles btw | 11:56 |
mschuppert | owalsh: only if you have more time then me to work on it :) I have a meeting now. will look into it later. | 11:56 |
jistr | ykarel: ok then it should be enabled i think... Any output from this task in the upgrade log? https://github.com/openstack/tripleo-heat-templates/blob/stable/rocky/puppet/services/tripleo-packages.yaml#L237-L239 | 11:56 |
owalsh | mschuppert: ack, I'll see what I can do but I expect you'll get to it before I do | 11:58 |
*** holser_ is now known as holser|lunch | 11:58 | |
ykarel | jistr, this task is multiple time in output, all skip and one: u'ok: [overcloud-novacompute-0] => {"changed": false, "msg": "", "rc": 0, "results": ["Nothing to do here, all packages are up to date"]}', | 12:00 |
ykarel | may be repos configured after this task | 12:02 |
jistr | ykarel: yea looks like the repos were incorrect there | 12:05 |
jistr | at that time point | 12:05 |
*** hberaud|lunch is now known as hberaud | 12:05 | |
jistr | ykarel: is that upstream TripleO? Now i'm not sure whether we automate anything there w/r/t repo switching. | 12:06 |
jistr | jfrancoa was looking into repos relatively recently | 12:06 |
ykarel | jistr, yes upstream tripleo | 12:06 |
ykarel | i deployed queens using quickstart | 12:07 |
ykarel | and then upgrade with major_upgrade doc | 12:07 |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 12:10 |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,Triaged] - Assigned to Martin Schuppert (mschuppert) | 12:10 |
openstackgerrit | Slawek Kaplonski proposed openstack/tripleo-heat-templates master: Remove external_network_bridge Neutron option https://review.openstack.org/604764 | 12:12 |
*** pdeore has quit IRC | 12:12 | |
ykarel | jistr, that OK message(no package to update) was at 21 January 2019 09:58:30, while Run deployment NovaComputeUpgradeInitDeployment task at 21 January 2019 10:00:57 | 12:13 |
ykarel | jistr, jfrancoa is ^^ expected? | 12:13 |
*** panda is now known as panda|lunch | 12:14 | |
*** jaganathan has joined #tripleo | 12:16 | |
*** zul has joined #tripleo | 12:16 | |
jistr | ykarel: hm no that's not expected. I think we sort of stopped using the UpgradeInitCommand in practice when we switched to config-download. | 12:17 |
jistr | ykarel: but we should either fix it or remove it | 12:17 |
ykarel | jistr, ack, so u will take care of it ^^ | 12:18 |
ykarel | it might have happen to controller as well, but there i ran multiple times due to some issues | 12:19 |
ykarel | so this package update issue not noticed | 12:19 |
jistr | ah i guess the UpgradeInitDeployment only executes in deploy_steps_playbook, but we need it for upgrade_steps_playbook. I seem to recall jfrancoa mentioning that a while ago. | 12:19 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: [WIP]Use os_tempest for running tempest on standalone https://review.openstack.org/628415 | 12:22 |
*** moguimar has quit IRC | 12:24 | |
*** moguimar has joined #tripleo | 12:24 | |
jistr | ykarel, jfrancoa: reported https://bugs.launchpad.net/tripleo/+bug/1812659 and created a trello card | 12:25 |
openstack | Launchpad bug 1812659 in tripleo "UpgradeInitCommand not applying at correct time" [High,Triaged] | 12:25 |
jistr | likely we should stop applying it via Heat resources and just write out the contents into an Ansible task | 12:25 |
ykarel | jrist, ack, Thanks for checking this out, /me ran the comand again | 12:26 |
*** udesale has joined #tripleo | 12:26 | |
*** rh-jelabarre has joined #tripleo | 12:29 | |
openstackgerrit | Karthik S proposed openstack/os-net-config master: Updating requirements for pyudev https://review.openstack.org/630688 | 12:29 |
openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: [WIP] Run tempest using os_tempest role in standalone job https://review.openstack.org/627500 | 12:31 |
*** dprince has joined #tripleo | 12:34 | |
*** hberaud has quit IRC | 12:35 | |
*** hberaud has joined #tripleo | 12:36 | |
*** mburned is now known as mburned_out | 12:36 | |
*** ratailor has quit IRC | 12:38 | |
*** jistr is now known as jistr|afk | 12:38 | |
*** florianf has joined #tripleo | 12:46 | |
*** ratailor has joined #tripleo | 12:47 | |
jfrancoa | jistr|afk: ykarel: no, we don't do anything for setting up the right repos. that's something that should be done in advance. The work we did was mainly for rhsm managed systems, but upstream (the former UpgradeInitCommand doesn't work as it used to due to the change to Ansible-led upgrade) we don't have anything.. | 12:47 |
jfrancoa | jistr|afk: we should either specify it in the upstream docs (http://tripleo.org/install/post_deployment/upgrade.html#prepare-your-environment-files) or fix the UpgradeInitCommand parameter thing somehow | 12:48 |
ykarel | jfrancoa, ack | 12:48 |
*** ansmith has quit IRC | 12:49 | |
openstackgerrit | Karthik S proposed openstack/os-net-config stable/queens: Sample templates for linux_bond, ovs_bond, dpdkbond using VFs https://review.openstack.org/632080 | 12:53 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: flatten the mistral service configurations https://review.openstack.org/627642 | 12:54 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Drop unused puppet/services parameters https://review.openstack.org/631804 | 12:55 |
*** mburned_out is now known as mburned | 12:55 | |
openstackgerrit | Karthik S proposed openstack/os-net-config stable/queens: NIC-Partitioning: DPDK devices comes up properly after reboot https://review.openstack.org/632081 | 12:57 |
*** weshay has joined #tripleo | 12:58 | |
openstackgerrit | Kamil Sambor proposed openstack/tripleo-quickstart master: Change featureset030 to work with ML2/OVS https://review.openstack.org/611653 | 12:59 |
*** cfontain has joined #tripleo | 13:01 | |
*** holser|lunch is now known as holser_ | 13:04 | |
*** avivgt has quit IRC | 13:04 | |
*** shyam89 has quit IRC | 13:06 | |
*** shyam89 has joined #tripleo | 13:07 | |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 13:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,Triaged] - Assigned to Martin Schuppert (mschuppert) | 13:10 |
*** jistr|afk is now known as jistr | 13:10 | |
*** suuuper has quit IRC | 13:10 | |
*** ratailor has quit IRC | 13:19 | |
openstackgerrit | Kamil Sambor proposed openstack/python-tripleoclient master: WIP: prevent upgrading to incompatible mechanism driver https://review.openstack.org/625049 | 13:25 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-docs master: Add notes for DCN operational availability modes https://review.openstack.org/632089 | 13:25 |
shyam89 | Hi | 13:28 |
*** cfontain has quit IRC | 13:29 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-docs master: Add service template sections walkthough (part 2) https://review.openstack.org/632091 | 13:31 |
*** rlandy has joined #tripleo | 13:32 | |
EmilienM | bandini: heya - for https://bugs.launchpad.net/tripleo/+bug/1812640 - I wonder if it's again some missing bind mounts in neutron-l3 container | 13:34 |
openstack | Launchpad bug 1812640 in tripleo "iptables rules are not host-based when using podman" [High,Triaged] | 13:34 |
bandini | EmilienM: could be yes, we should try and get a small reproducer to start with | 13:36 |
*** panda|lunch is now known as panda | 13:38 | |
*** rbrady has joined #tripleo | 13:41 | |
*** mcornea has joined #tripleo | 13:45 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Made quickstart.sh more portable https://review.openstack.org/627880 | 13:47 |
*** moguimar has quit IRC | 13:48 | |
*** moguimar has joined #tripleo | 13:50 | |
openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Support '--tags' for 'overcloud upgrade run' https://review.openstack.org/630967 | 13:53 |
ykarel | EmilienM, can u review https://review.rdoproject.org/r/#/c/18151/ and the Depends-On https://review.openstack.org/#/c/632032/ | 13:55 |
EmilienM | ykarel: ci team should review first | 13:56 |
*** agopi has joined #tripleo | 13:56 | |
EmilienM | but yeah i'll look too | 13:56 |
ykarel | EmilienM, ack | 13:56 |
ykarel | weshay, sshnaidm panda can u please review ^^ | 13:57 |
*** ansmith has joined #tripleo | 13:57 | |
*** thrash|g0ne is now known as thrash | 13:58 | |
*** ykarel is now known as ykarel|away | 13:59 | |
*** jcoufal has joined #tripleo | 14:00 | |
panda | ykarel|away: looking | 14:01 |
ykarel|away | panda, Thanks | 14:01 |
sshnaidm | ykarel|away, commented | 14:02 |
ykarel|away | ack looking | 14:03 |
*** leanderthal has joined #tripleo | 14:03 | |
ykarel|away | okk will check and fix those with other comments if any, /me leaving home now | 14:03 |
*** udesale has quit IRC | 14:05 | |
*** udesale has joined #tripleo | 14:06 | |
*** ykarel|away has quit IRC | 14:08 | |
*** morazi has joined #tripleo | 14:09 | |
*** toure|gone is now known as toure | 14:09 | |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 14:10 |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,Triaged] - Assigned to Martin Schuppert (mschuppert) | 14:10 |
*** vinaykns has joined #tripleo | 14:11 | |
*** skramaja has quit IRC | 14:14 | |
openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: WIP Move nova_cell_v2_discover_host.py to use internal API https://review.openstack.org/632097 | 14:15 |
openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Implement podman rename via re-apply of containers https://review.openstack.org/621607 | 14:19 |
openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Always attempt a graceful container stop/remove https://review.openstack.org/630219 | 14:19 |
*** shyam89 has quit IRC | 14:19 | |
openstackgerrit | Emilien Macchi proposed openstack/ansible-role-tripleo-modify-image master: yum_update: use role_path to find the script https://review.openstack.org/632099 | 14:24 |
*** xek_ has quit IRC | 14:25 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Make python uploader the default https://review.openstack.org/616019 | 14:25 |
bogdando | PTAL https://review.openstack.org/#/c/630219 and https://review.openstack.org/#/c/621607 | 14:26 |
*** xek_ has joined #tripleo | 14:26 | |
*** tzumainn has joined #tripleo | 14:28 | |
*** abishop has joined #tripleo | 14:33 | |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient stable/rocky: Use --preserve-env to keep proxy settings https://review.openstack.org/632102 | 14:38 |
*** mjturek has joined #tripleo | 14:44 | |
*** shardy has quit IRC | 14:46 | |
*** shardy has joined #tripleo | 14:46 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Create /run/netns if does not exist https://review.openstack.org/630936 | 14:47 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Use net=none for *_init_log(s) containers https://review.openstack.org/630631 | 14:47 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Remove configuration for cni0 bridge https://review.openstack.org/630625 | 14:47 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/rocky: Set heatclient exceptions to verbose https://review.openstack.org/632103 | 14:49 |
openstackgerrit | Lee Yarwood proposed openstack/puppet-tripleo master: placement: Initial extraction of the Placement service from Nova https://review.openstack.org/624335 | 14:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/queens: Set heatclient exceptions to verbose https://review.openstack.org/632104 | 14:49 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Enable testing using ansible molecule https://review.openstack.org/613672 | 14:52 |
*** hakhande_ has quit IRC | 14:52 | |
*** trozet has joined #tripleo | 14:53 | |
trozet | hjensas: hi | 14:53 |
*** wolverineav has quit IRC | 14:53 | |
hjensas | trozet: Hi | 14:54 |
trozet | hjensas: i see you made role-name a mandatory arg: https://github.com/openstack/tripleo-heat-templates/blob/master/tools/merge-new-params-nic-config-script.py#L40 | 14:54 |
trozet | hjensas: i was thinking, shouldn't it also have a choices with it? Is the correct arg control or controller for the controller node? | 14:55 |
hjensas | trozet: yes, wanted to avoid people accidentally using a role that does not have all required networks. | 14:55 |
hjensas | trozet: the correct arg for it would be what is set as 'name' for the role in roles_data.yaml | 14:56 |
trozet | hjensas: ah ok | 14:56 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add node disks validation https://review.openstack.org/604356 | 14:59 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Change UpgradeInitCommonCommand by Ansible tasks https://review.openstack.org/632108 | 15:07 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-heat-templates master: Adding pyshim.sh to missing python commands https://review.openstack.org/632070 | 15:08 |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 15:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 15:10 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Change UpgradeInitCommonCommand by Ansible tasks https://review.openstack.org/632108 | 15:11 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Change UpgradeInitCommonCommand by Ansible tasks https://review.openstack.org/632108 | 15:12 |
*** jaganathan has quit IRC | 15:19 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: [WIP]Use os_tempest for running tempest on standalone https://review.openstack.org/628415 | 15:22 |
*** ykarel|away has joined #tripleo | 15:22 | |
openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: [WIP] Run tempest using os_tempest role in standalone job https://review.openstack.org/627500 | 15:23 |
*** ykarel|away is now known as ykarel | 15:25 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common master: Stop sending execution object via Zaqar message https://review.openstack.org/630291 | 15:29 |
*** agurenko has joined #tripleo | 15:31 | |
openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: [WIP] Run tempest using os_tempest role in standalone job https://review.openstack.org/627500 | 15:35 |
*** avivgt has joined #tripleo | 15:39 | |
*** agurenko has quit IRC | 15:39 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Change UpgradeInitCommonCommand by Ansible tasks https://review.openstack.org/632108 | 15:39 |
*** aedc has joined #tripleo | 15:42 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Change UpgradeInitCommonCommand by Ansible tasks https://review.openstack.org/632108 | 15:42 |
*** abishop has quit IRC | 15:44 | |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Switch to more specific include* statements for undercloud. https://review.openstack.org/632113 | 15:46 |
*** holser_ has quit IRC | 15:50 | |
*** temka has quit IRC | 15:50 | |
*** cylopez has quit IRC | 15:51 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Ensure we get a clean firewall https://review.openstack.org/632117 | 15:54 |
Tengu | jaosorior: -^^ | 15:54 |
jaosorior | Tengu: did you try it out? | 15:54 |
Tengu | jaosorior: yep, it passed my lab. | 15:55 |
Tengu | jaosorior: although more testing will be probably needed, for example "update", "redeploy". | 15:55 |
bogdando | Tengu: at which place it removes those default rules? | 15:57 |
bogdando | I'm confused a little bit | 15:57 |
*** quiquell is now known as quiquell|off | 15:58 | |
Tengu | bogdando: on a not-yet-deployed env, iptables is empty as long as we don't start the iptables service - that service is managed at the "include ::firewall" step. Saving, hence pre-creating the /etc/sysconfig/ip(6)tables file allow to have it empty | 15:58 |
Tengu | at least, no rule at all. | 15:58 |
Tengu | doing should also ensure update won't break, since the file should not change. | 15:59 |
bogdando | Tengu: oh. nice! | 15:59 |
Tengu | (yeah: *should*) | 15:59 |
Tengu | bogdando: that was the cleanest way I could find :(. | 15:59 |
Tengu | of course, the REAL way would be either drop that iptables-services package, or make the maintainers drop the default rules. | 16:00 |
Tengu | but as iptables-services is installed and activated by puppet-firewall, it's a long shot. | 16:00 |
Tengu | and reading the default /etc/sysconfig/iptables header makes me think any change to it, even removal, will be refused. | 16:00 |
Tengu | bogdando: your question makes me think I should add some more details in the commit message :). | 16:01 |
*** udesale has quit IRC | 16:01 | |
bogdando | Tengu: indeed :) | 16:01 |
*** saneax|mtg has quit IRC | 16:02 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Ensure /var/lib/config-data exists before setting selinux context https://review.openstack.org/632120 | 16:02 |
Tengu | bogdando: on my way. | 16:02 |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Ensure we get a clean firewall https://review.openstack.org/632117 | 16:03 |
Tengu | bogdando: -^^ better? | 16:03 |
bogdando | yea | 16:04 |
Tengu | woops. a line is too long. | 16:04 |
*** rbrady has quit IRC | 16:04 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Ensure we get a clean firewall https://review.openstack.org/632117 | 16:05 |
Tengu | done. now I'm happy :). | 16:05 |
Tengu | have to find out why the vi instance launched by git commit doesn't show my red column at 80c.... | 16:05 |
bogdando | nit: it's 71 for git commit msgs ;p | 16:06 |
Tengu | damn..... | 16:07 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Move UpgradeInitCommand and UpgradeInitCommonCommand to run by Ansible https://review.openstack.org/632108 | 16:08 |
*** ksambor has quit IRC | 16:09 | |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Allow ssh from all for undercloud https://review.openstack.org/631784 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 16:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Allow Octavia deployments for Standalone https://review.openstack.org/628957 | 16:10 |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 16:10 |
openstackgerrit | Merged openstack/tripleo-quickstart master: install both python-libselinux versions on py3 env https://review.openstack.org/631825 | 16:10 |
*** Vorrtex has joined #tripleo | 16:10 | |
*** psachin has quit IRC | 16:12 | |
Tengu | jaosorior: and now we will get logging for iptables working fine :D. | 16:20 |
Tengu | no more drop before the LOG target, and the DROP we set on our own in the post.pp. yay | 16:20 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Move UpgradeInitCommand and UpgradeInitCommonCommand to run by Ansible https://review.openstack.org/632108 | 16:21 |
Tengu | that said.... I'm pretty sure rules are never set to "ensure => absent" in order to remove them if they are deprecated... | 16:23 |
Tengu | meaning: we probably still have old things on (really) old instances. | 16:23 |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Switch to more specific include* statements for undercloud. https://review.openstack.org/632113 | 16:24 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Set feature branch for OVB https://review.openstack.org/631955 | 16:24 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Ensure logs folder is created in prep hosts tasks. https://review.openstack.org/631821 | 16:24 |
*** ramishra has quit IRC | 16:24 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Allow dlrn_hash_tag* vars to be overridden https://review.openstack.org/622575 | 16:24 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Do not build projects with '-distgit' in project name https://review.openstack.org/632032 | 16:26 |
openstackgerrit | Merged openstack/ansible-role-tripleo-modify-image master: Update hacking version to latest https://review.openstack.org/628569 | 16:26 |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Ensure we get a clean firewall https://review.openstack.org/632117 | 16:28 |
*** radeks_ has joined #tripleo | 16:32 | |
openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: WIP Move nova_cell_v2_discover_host.py to use internal API https://review.openstack.org/632097 | 16:34 |
*** radeks__ has quit IRC | 16:35 | |
openstackgerrit | Emilien Macchi proposed openstack/ansible-role-tripleo-modify-image master: buildah: include modify-image playbook https://review.openstack.org/632130 | 16:36 |
openstackgerrit | Emilien Macchi proposed openstack/ansible-role-tripleo-modify-image master: buildah: include modify-image playbook https://review.openstack.org/632130 | 16:36 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Make python uploader the default https://review.openstack.org/616019 | 16:36 |
*** leanderthal has quit IRC | 16:41 | |
*** radeks_ has quit IRC | 16:44 | |
*** gkadam has quit IRC | 16:45 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/queens: Ensure logs folder is created in prep hosts tasks. https://review.openstack.org/632133 | 16:50 |
*** bogdando has quit IRC | 16:55 | |
*** aufi has quit IRC | 17:00 | |
*** paramite has quit IRC | 17:03 | |
*** pbandark has joined #tripleo | 17:05 | |
*** jpich has quit IRC | 17:09 | |
*** jpich has joined #tripleo | 17:10 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 17:10 |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 17:10 |
*** avivgt has quit IRC | 17:13 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Move UpgradeInitCommand and UpgradeInitCommonCommand to run by Ansible https://review.openstack.org/632108 | 17:14 |
*** shardy has quit IRC | 17:15 | |
weshay | mwhahaha, jaosorior fyi.. only two gate failures in the last 3 days :) | 17:16 |
*** dtantsur is now known as dtantsur|afk | 17:16 | |
weshay | both are the update jobs and timedout | 17:16 |
*** shardy has joined #tripleo | 17:17 | |
*** yprokule has quit IRC | 17:18 | |
*** errr has quit IRC | 17:19 | |
*** lblanchard has joined #tripleo | 17:20 | |
*** ayoung has joined #tripleo | 17:21 | |
*** kopecmartin is now known as kopecmartin|off | 17:21 | |
*** jpich has quit IRC | 17:22 | |
Tengu | weshay: what, no more podman issue? :D | 17:22 |
weshay | Tengu++ | 17:22 |
*** jpich has joined #tripleo | 17:22 | |
weshay | so far so good | 17:22 |
Tengu | weshay: so the "retry" seems to do its job at least. Without huge impact, if we get only 2 timeouts. | 17:23 |
Tengu | hopefully the podman team will found out the issue with the entrypoint thingy - apparently it's a layer management issue at some level :D | 17:23 |
*** shardy has quit IRC | 17:25 | |
*** shardy has joined #tripleo | 17:25 | |
*** jpich has quit IRC | 17:26 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Enable image inject metadata properties & user roles to be ignored https://review.openstack.org/631443 | 17:28 |
*** lblanchard has quit IRC | 17:29 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Drop unused docker/services parameters https://review.openstack.org/631809 | 17:32 |
*** salmankhan has quit IRC | 17:32 | |
*** salmankhan has joined #tripleo | 17:35 | |
rh-jelabarre | is there a way to increase the SSH wait time for an overcloud deploy? | 17:38 |
openstackgerrit | Emilien Macchi proposed openstack/ansible-role-tripleo-modify-image master: Revert "Use buildah commands for yum update to improve speed" https://review.openstack.org/632138 | 17:39 |
openstackgerrit | Emilien Macchi proposed openstack/ansible-role-tripleo-modify-image master: Revert "Use buildah commands for yum update to improve speed" https://review.openstack.org/632138 | 17:39 |
*** ekultails has joined #tripleo | 17:42 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Make python uploader the default https://review.openstack.org/616019 | 17:42 |
*** ekultails has quit IRC | 17:42 | |
*** ekultails has joined #tripleo | 17:43 | |
*** fragatina has joined #tripleo | 17:43 | |
rh-jelabarre | Our controller node is exceedingly slow to boot, so the final stages of the overcloud times out, and it never creates the overcloudrc file | 17:43 |
*** salmankhan has quit IRC | 17:43 | |
rh-jelabarre | sorry, compute node, not controller | 17:43 |
*** fragatina has quit IRC | 17:44 | |
*** salmankhan has joined #tripleo | 17:44 | |
*** fragatina has joined #tripleo | 17:44 | |
*** cfontain_ has joined #tripleo | 17:47 | |
*** gfidente has quit IRC | 17:51 | |
aedc | Hello everyone | 17:51 |
*** fragatina has quit IRC | 17:52 | |
*** fragatina has joined #tripleo | 17:52 | |
aedc | From a fresh installation (rocky/current), i always have the error : "OSError: [Errno 30] Read-only file system: '/etc/pki/ca-trust/extracted'" | 17:53 |
aedc | i have no problems with ntp (https://bugzilla.redhat.com/show_bug.cgi?id=1578849) | 17:54 |
openstack | bugzilla.redhat.com bug 1578849 in openstack-tripleo-heat-templates "Overcloud deployment failed with BlockStorage" [High,Closed: errata] - Assigned to aschultz | 17:54 |
*** fragatina has quit IRC | 17:55 | |
aedc | other people have encountered this problem ? | 17:55 |
*** fragatina has joined #tripleo | 17:56 | |
*** fragatina has quit IRC | 17:58 | |
*** fragatina has joined #tripleo | 17:58 | |
aedc | My problem is on an undercloud installation | 17:59 |
*** derekh has quit IRC | 18:01 | |
*** lblanchard has joined #tripleo | 18:02 | |
*** fragatina has quit IRC | 18:03 | |
*** fragatina has joined #tripleo | 18:03 | |
mwhahaha | aedc: it's configurable in the udnercloud.conf | 18:04 |
mwhahaha | aedc: make sure you specify ntp servers you can access | 18:04 |
mwhahaha | some places block external ntp sources | 18:05 |
*** shardy has quit IRC | 18:05 | |
*** fragatina has quit IRC | 18:05 | |
*** lblanchard has quit IRC | 18:05 | |
*** artom has joined #tripleo | 18:05 | |
*** fragatina has joined #tripleo | 18:05 | |
*** openstackgerrit has quit IRC | 18:07 | |
*** fragatina has quit IRC | 18:07 | |
*** fragatina has joined #tripleo | 18:08 | |
*** fragatina has quit IRC | 18:08 | |
*** fragatina has joined #tripleo | 18:09 | |
*** fragatina has quit IRC | 18:09 | |
*** fragatina has joined #tripleo | 18:10 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 18:10 |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 18:10 |
*** hberaud is now known as hberaud|gone | 18:11 | |
*** fragatina has quit IRC | 18:11 | |
*** fragatina has joined #tripleo | 18:12 | |
*** fragatina has quit IRC | 18:13 | |
*** jpena is now known as jpena|off | 18:13 | |
*** fragatina has joined #tripleo | 18:14 | |
aedc | thanks mwhahaha, i will try | 18:14 |
*** fragatina has quit IRC | 18:15 | |
aedc | I would like to understand where the problem comes from. Normally, it should not touch the file, but it does so due to a date problem on the edited file? | 18:16 |
*** fragatina has joined #tripleo | 18:16 | |
*** openstackgerrit has joined #tripleo | 18:17 | |
openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Service check in nova_cell_v2_discover_host.py to use internal API https://review.openstack.org/632097 | 18:17 |
aedc | I see that the /etc/pki/ca-trust/extracted directory is mapped to ro (read-only) in the container, so it's quite normal for it to be read-only | 18:17 |
*** _fragatina_ has joined #tripleo | 18:17 | |
*** fragatina has quit IRC | 18:22 | |
aedc | mwhahaha, external ntp doesn't work (example : pool.ntp.org) ? | 18:22 |
*** holser_ has joined #tripleo | 18:25 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: (WIP) Enable testing using ansible molecule https://review.openstack.org/613672 | 18:25 |
*** saneax|mtg has joined #tripleo | 18:28 | |
mwhahaha | aedc: yeah. If you try to use ntpdate with that does it work? If not you need a local source | 18:31 |
*** radeks has joined #tripleo | 18:32 | |
*** saneax|mtg has quit IRC | 18:33 | |
*** ccamacho has quit IRC | 18:33 | |
*** saneax|mtg has joined #tripleo | 18:33 | |
aedc | mwhahaha, no problem using pool.ntp.org with ntpdate | 18:34 |
mwhahaha | aedc: are you installing on baremetal? | 18:36 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Skip templating disabled networks https://review.openstack.org/627420 | 18:36 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add network data for the undercloud https://review.openstack.org/628259 | 18:36 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Remove networks from Undercloud and Standalone roles https://review.openstack.org/628265 | 18:36 |
aedc | mwhahaha, yeah | 18:38 |
mwhahaha | Aedc is the bios set to utc? | 18:38 |
mwhahaha | That was the other issue | 18:38 |
agopi | hello, if given access to UC, is there a way to find out which version of RDO/RHOSP is installed along with the puddle date/ hash | 18:39 |
aedc | Mmmh, i check | 18:39 |
mwhahaha | agopi: check /etc/rhos-release | 18:40 |
*** _fragatina_ has quit IRC | 18:40 | |
mwhahaha | agopi: if that doesn't exist then maybe the repo config | 18:40 |
*** fragatina has joined #tripleo | 18:41 | |
agopi | mwhahaha, in case of downstream if lets say rhos-release was set using -p passed_phase2 or passed_phase1 | 18:41 |
agopi | the repo config only holds the baseurl pointing to that ^ | 18:41 |
mwhahaha | agopi: then no way to know | 18:42 |
agopi | okay thank you mwhahaha. | 18:42 |
mwhahaha | agopi: you should be able to get the major version but not the specific date though | 18:43 |
mwhahaha | I thought it would tell you the date after install in the output | 18:44 |
mwhahaha | Don't know if the rhos-release file gets written out. Will have to check | 18:44 |
rlandy | agopi: what do you need to track exactly? | 18:46 |
agopi | yes mwhahaha I'm able to get the major version from the file but not the specific puddle or commit hash. | 18:46 |
rlandy | we can tell which is the last passed_phase2 | 18:46 |
*** fragatina has quit IRC | 18:47 | |
mwhahaha | I don't think we capture commit hash for anything older thank current dev | 18:47 |
*** radeks has quit IRC | 18:47 | |
*** fragatina has joined #tripleo | 18:47 | |
*** fragatina has quit IRC | 18:47 | |
*** fragatina has joined #tripleo | 18:48 | |
agopi | ah yes, i'm just trying to automatically build this json file - https://github.com/openstack/browbeat/blob/master/metadata/version.json#L3, which we use in browbeat. | 18:48 |
agopi | and usually the user would update the fields, but in case the user forgets I figured there should be a way to automatically populate these, populating osp_series is straigtforward but build doesnt seem so straightforward. | 18:49 |
*** ccamacho has joined #tripleo | 18:50 | |
rlandy | agopi: http://download.lab.bos.redhat.com/rcm-guest/puddles/OpenStack/14.0-RHEL-7/passed_phase2/import_data/ | 18:53 |
*** ykarel has quit IRC | 18:53 | |
*** radeks has joined #tripleo | 18:54 | |
*** saneax|mtg is now known as saneax | 18:54 | |
*** fragatina has quit IRC | 18:56 | |
*** fragatina has joined #tripleo | 18:56 | |
*** fragatina has quit IRC | 18:57 | |
*** jcoufal_ has joined #tripleo | 18:57 | |
*** fragatina has joined #tripleo | 18:58 | |
aedc | do you know what that means => KOLLA_CONFIG_STRATEGY=COPY_ALWAYS ? | 18:58 |
*** jcoufal has quit IRC | 19:01 | |
mwhahaha | aedc: it's how kolla handles it's configs | 19:02 |
*** fragatina has quit IRC | 19:03 | |
*** fragatina has joined #tripleo | 19:04 | |
agopi | rlandy, thanks this is helpful for the current passed_phase2. Was trying to see if it was possible to get the hash from the undercloud itself. | 19:04 |
*** morazi has quit IRC | 19:06 | |
*** fragatina has quit IRC | 19:07 | |
*** fragatina has joined #tripleo | 19:07 | |
aedc | mwhahaha, thks COPY_ALWAYS value is normal ? | 19:08 |
mwhahaha | yes | 19:08 |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812424 | 19:10 |
openstack | Launchpad bug 1812424 in tripleo "IGNORE: just a test" [Critical,Triaged] | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 19:10 |
aedc | ok, that's the thing I do not understand. the directory is ro: ""/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro"(example, docker rabbitmq) But the kolla_set_configs script tries to copy it | 19:11 |
-openstackstatus- NOTICE: The error causing post failures on jobs has been corrected. It is safe to recheck these jobs. | 19:19 | |
*** fragatina has quit IRC | 19:28 | |
*** fragatina has joined #tripleo | 19:29 | |
openstackgerrit | Sagi Shnaidman proposed openstack/openstack-virtual-baremetal master: DNM: test ovb jobs https://review.openstack.org/631375 | 19:30 |
*** pbandark has quit IRC | 19:31 | |
*** rh-jelabarre has quit IRC | 19:31 | |
*** lblanchard has joined #tripleo | 19:31 | |
*** aedc has quit IRC | 19:35 | |
*** fragatina has quit IRC | 19:39 | |
*** fragatina has joined #tripleo | 19:39 | |
dprince | EmilienM: running 'privilaged' isn't always a good solution I think https://review.openstack.org/#/c/631765/ | 19:40 |
dprince | EmilienM: that didn't used to be a requirement. Is it just for the 'podman pull' commands required to pull images? | 19:41 |
*** fragatina has quit IRC | 19:42 | |
*** fragatina has joined #tripleo | 19:43 | |
*** rh-jelabarre has joined #tripleo | 19:50 | |
*** morazi has joined #tripleo | 20:01 | |
*** jfrancoa has quit IRC | 20:02 | |
EmilienM | dprince: yes | 20:09 |
*** xek_ has quit IRC | 20:09 | |
EmilienM | dprince: I tried SYS_ADMIN cap, not enough | 20:09 |
dprince | EmilienM: I'm thinking the way we implemented this 'docker pull' feature was part of the problem. Perhaps we should use Ansible to run it on the Undercloud host | 20:10 |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 20:10 |
dprince | EmilienM: in other words, instead of relaxing permission what if we change the implementation to do it differently | 20:10 |
mwhahaha | that sounds terribly complex | 20:10 |
dprince | well. we already have a concept of running tasks on the bootstrap node. Swift rings I think are built this way | 20:11 |
mwhahaha | since it would python code to call ansible to ssh to the undercloud to do a podman pull | 20:11 |
dprince | we already have python code that does this | 20:11 |
dprince | Executing ansible via Mistral is a thing, we already do it | 20:11 |
mwhahaha | just because we have it, doesn't make it better | 20:11 |
dprince | all I'm suggesting is that we write a playbook to do it, and set the host the the undercloud | 20:12 |
dprince | boom | 20:12 |
dprince | I'm not blocking it. But I do think ContainerImagePrepare stuff is to blame a bit here | 20:14 |
dprince | and rethinking that implementation might help us | 20:15 |
* dprince disagrees it is more complex than anything else we are doing | 20:15 | |
EmilienM | dprince: now stevebaker is back we can have a chat, I was waiting a bit | 20:15 |
stevebaker | hey ho | 20:15 |
mwhahaha | right my point is that we already do too much complex stuff and shouldn't continue :D | 20:15 |
mwhahaha | just cause we do it, doesn't make it a good idea or a good idea to continue | 20:16 |
mwhahaha | there's probably a better way, but i'm not sure ansible is the solution here | 20:16 |
dprince | mwhahaha: how do you define "complex stuff"? | 20:16 |
mwhahaha | mistral workflow to execute python to execute ansible to ssh to localhost to perform podman pull | 20:16 |
dprince | mwhahaha: my main concern is loosening our container privs isn't always the solution. Podman shouldn't require this | 20:17 |
stevebaker | can we just make mistral run an ansible thing with ssh localhost? | 20:17 |
dprince | mwhahaha: is re-using a tool we already have "complex" though? | 20:17 |
mwhahaha | https://upload.wikimedia.org/wikipedia/commons/a/a9/Rube_Goldberg%27s_%22Self-Operating_Napkin%22_%28cropped%29.gif | 20:17 |
dprince | stevebaker: that is what I'm asking for :) | 20:18 |
stevebaker | that is mostly what mistral does these days anyway | 20:18 |
EmilienM | isn't running on localhost already? | 20:19 |
mwhahaha | yea and i'm not sure that's "more secure" | 20:20 |
*** fragatina has quit IRC | 20:20 | |
*** fragatina has joined #tripleo | 20:21 | |
dprince | mwhahaha: So you really rather escalate privs on the container than reuse a Mistral action we already have? | 20:21 |
dprince | as a side note, perhaps there are ways we can better lock down our Ansible mistral action too... | 20:22 |
mwhahaha | i'm just saying you're not selling me on any reduced complexity or an improvement in security | 20:22 |
*** saneax has quit IRC | 20:22 | |
dprince | I'm trying to avoid making more containers run with privs. IMO there is value in that | 20:23 |
dprince | like I said, I think we can lock things down with sudoers too to make the actions executed with ssh controlled. | 20:24 |
dprince | with a privileged container, perhaps not so much | 20:24 |
*** eggmaster has joined #tripleo | 20:24 | |
EmilienM | stevebaker: so would it imply to not using external_deploy_tasks and use host_prep_tasks? | 20:24 |
*** eggmaster is now known as eggs | 20:25 | |
dprince | with the one approach, we have options to make it better. if we escalate privs I'm not sure there are as many options | 20:25 |
stevebaker | maybe we should be focusing on mistral and tht triggering prepare in a consistent way, instead of one calling python and one running the tripleo-container-image-prepare CLI. https://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/puppet/services/container-image-prepare.j2.yaml#n117 They should both be running a custom ansible prepare module | 20:25 |
*** ianw is now known as ianw_pto | 20:26 | |
dprince | stevebaker: agree on consistency. but also would prefer not to have it use privelaged containers | 20:26 |
* dprince thinks we can have both of thes | 20:26 | |
stevebaker | dprince: I'm implying that mistral would run ansible ssh localhost in that change ;) making them consistent might tip the scales for mwhahaha regarding reduced complexity | 20:27 |
mwhahaha | that's teh thing i say increased complexity | 20:28 |
mwhahaha | but whatever | 20:28 |
dprince | EmilienM, mwhahaha: what if we land this and file a bug to re-implement using the improvements we've talked about? | 20:28 |
mwhahaha | the problem is we share this in both the overcloud and undercloud scenario | 20:28 |
mwhahaha | so it's not always mistral executing this stuff | 20:28 |
dprince | well, the undercloud all-in-one installer can't require mistral. So there *is* that. | 20:28 |
mwhahaha | if there's a more secure/less complex way i'd prefer that we do that. but anything + ansible is pretty much more complexity at this point | 20:29 |
dprince | but I think we can short circuit that case anyway as it isn't that useful there | 20:29 |
dprince | for example... you can't 'docker pull' if docker hasn't been installed and configured | 20:29 |
dprince | ditto for podman | 20:29 |
EmilienM | for docker it's even worse, the daemon has to be started to get a pull working | 20:30 |
dprince | of course. I get it | 20:30 |
EmilienM | I'm fine either way, having mistral container in privileged was not my best idea | 20:30 |
stevebaker | don't we have an established pattern for running podman in containers which is less than full privilaged? | 20:31 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - run container image prepare on the host https://review.openstack.org/632160 | 20:32 |
*** jtomasek has quit IRC | 20:32 | |
EmilienM | something like this maybe? | 20:32 |
dprince | stevebaker: I'm trying to establish that we avoid that case where possible! | 20:32 |
mwhahaha | EmilienM: no because on overcloud deploy that'll run on the wrong place | 20:32 |
dprince | stevebaker: https://review.openstack.org/#/c/620062/ | 20:33 |
EmilienM | mwhahaha: maybe delegate to UNdercloud ? | 20:33 |
*** rh-jelabarre has quit IRC | 20:33 | |
*** eggs is now known as eggmaster | 20:33 | |
*** eggmaster is now known as eggs | 20:33 | |
EmilienM | stevebaker: also https://review.openstack.org/#/c/626803/ needs more work | 20:36 |
EmilienM | stevebaker: it didn't test an image build when it landed | 20:36 |
EmilienM | stevebaker: and it doesn't with with the python uploader | 20:36 |
*** rh-jelabarre has joined #tripleo | 20:36 | |
EmilienM | (I saw it this morning) | 20:36 |
stevebaker | EmilienM: ok | 20:37 |
EmilienM | stevebaker: I have a first patch https://review.openstack.org/#/c/632099/ | 20:37 |
EmilienM | stevebaker: but then it fails later | 20:37 |
*** eggs is now known as eggmaster | 20:38 | |
EmilienM | Not found image: 192.168.24.1:8787/tripleomaster/centos-binary-rsyslog-base:296949631440d0f5b6dc0566516f916fe91a58fe_b1bca2af-updated-20190121175026 | 20:38 |
EmilienM | for some reasons, I see the buildah image but without the name and tag | 20:39 |
EmilienM | it's like the buildah commit created an image without name & tag. Have you seen it? | 20:39 |
stevebaker | EmilienM: I haven't seen that issue | 20:43 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - haproxy: deploy IPtables rules from the host https://review.openstack.org/631486 | 20:45 |
stevebaker | EmilienM: I'll have a go at reproducing in an new environment, I need one anyway | 20:46 |
EmilienM | stevebaker: I sent you mine on internal chan | 20:47 |
EmilienM | a tmate | 20:47 |
*** florianf has quit IRC | 20:47 | |
*** aedc has joined #tripleo | 20:51 | |
*** ade_lee has quit IRC | 20:58 | |
*** jcoufal_ has quit IRC | 21:03 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 21:10 |
*** lblanchard has quit IRC | 21:11 | |
*** ssbarnea|bkp2 has joined #tripleo | 21:16 | |
*** ssbarnea|rover has quit IRC | 21:18 | |
*** honza has quit IRC | 21:19 | |
weshay | mwhahaha, https://review.openstack.org/#/c/632097 | 21:21 |
openstackgerrit | Steve Baker proposed openstack/ansible-role-tripleo-modify-image master: Append to the tag on buildah commit https://review.openstack.org/632164 | 21:21 |
openstackgerrit | Emilien Macchi proposed openstack/ansible-role-tripleo-modify-image master: Append to the tag on buildah commit https://review.openstack.org/632164 | 21:22 |
EmilienM | stevebaker: rebased ^ | 21:22 |
EmilienM | so I can easily test it | 21:22 |
weshay | EmilienM, is here :) always https://review.openstack.org/#/c/632097/ | 21:23 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Make python uploader the default https://review.openstack.org/616019 | 21:23 |
EmilienM | weshay: +2 | 21:23 |
weshay | thanks | 21:24 |
*** ccamacho has quit IRC | 21:28 | |
*** dprince has quit IRC | 21:30 | |
*** ansmith has quit IRC | 21:36 | |
*** ade_lee has joined #tripleo | 21:38 | |
EmilienM | beagles: is the neutron systemd wrapper still on your radar? | 21:44 |
*** lblanchard has joined #tripleo | 21:46 | |
*** rcernin has joined #tripleo | 21:54 | |
*** fragatina has quit IRC | 22:04 | |
*** fragatina has joined #tripleo | 22:04 | |
*** lblanchard has quit IRC | 22:06 | |
*** mjturek has quit IRC | 22:07 | |
*** spsurya has quit IRC | 22:09 | |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 22:10 |
*** fragatina has quit IRC | 22:11 | |
*** fragatina has joined #tripleo | 22:12 | |
*** fragatina has quit IRC | 22:18 | |
*** fragatina has joined #tripleo | 22:19 | |
*** agopi has quit IRC | 22:20 | |
*** radeks has quit IRC | 22:21 | |
openstackgerrit | Merged openstack/tripleo-common master: Publish a better failure message for Update Ansible https://review.openstack.org/631799 | 22:22 |
mwhahaha | weshay, Tengu, EmilienM: fun fact, it appears we never hit Bug 1804434 on fedora28 even though we're currently still running 0.12.1. So i guess it's centos kernel specific | 22:29 |
openstack | bug 1804434 in tripleo "podman error with nova container: stderr: standard_init_linux.go:203: exec user process caused \"no such file or directory\"" [High,Fix released] https://launchpad.net/bugs/1804434 - Assigned to Emilien Macchi (emilienm) | 22:29 |
weshay | mwhahaha, heh.. and probably will never ship on centos-7 I'm guessing | 22:31 |
weshay | not sure | 22:31 |
mwhahaha | kinda annoying | 22:32 |
openstackgerrit | Merged openstack/tripleo-specs master: Change openstack-dev to openstack-discuss https://review.openstack.org/622276 | 22:34 |
openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: metrics_qdr: Add TLS support https://review.openstack.org/630736 | 22:34 |
*** fragatina has quit IRC | 22:39 | |
*** fragatina has joined #tripleo | 22:40 | |
*** fragatina has quit IRC | 22:40 | |
*** fragatina has joined #tripleo | 22:40 | |
*** fragatina has quit IRC | 22:41 | |
*** fragatina has joined #tripleo | 22:42 | |
*** fragatina has quit IRC | 22:44 | |
*** fragatina has joined #tripleo | 22:45 | |
*** holser_ has quit IRC | 22:45 | |
*** agopi has joined #tripleo | 22:48 | |
*** vinaykns has quit IRC | 22:48 | |
*** fragatina has quit IRC | 22:51 | |
*** fragatina has joined #tripleo | 22:52 | |
*** agopi has quit IRC | 22:53 | |
*** agopi has joined #tripleo | 22:53 | |
NobodyCam | Good afternoon Tripleo folks | 22:53 |
NobodyCam | off the wall question anyone encountered a case where overcloud nodes go from deploying to deleting | 22:54 |
NobodyCam | Every thing looks like the deploy completes but nodes go straight into deleteing | 22:54 |
mwhahaha | weshay: when was last fedora promotion? | 23:03 |
weshay | mwhahaha, early last week | 23:03 |
*** tkajinam has joined #tripleo | 23:03 | |
mwhahaha | k | 23:04 |
weshay | mwhahaha, 1/14 | 23:04 |
*** fragatina has quit IRC | 23:07 | |
*** fragatina has joined #tripleo | 23:08 | |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1812632 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1812632 in tripleo "Overcloud nova compute docker command failing on nova_cellv2_discover_hosts" [Critical,In progress] - Assigned to Martin Schuppert (mschuppert) | 23:10 |
*** dsneddon has quit IRC | 23:21 | |
*** dsneddon has joined #tripleo | 23:22 | |
*** lblanchard has joined #tripleo | 23:29 | |
*** slaweq has quit IRC | 23:35 | |
*** ekultails has quit IRC | 23:40 | |
*** mcornea has quit IRC | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!