openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 00:00 |
---|---|---|
*** zbitter has joined #tripleo | 00:01 | |
*** zaneb has quit IRC | 00:03 | |
*** gouthamr has joined #tripleo | 00:03 | |
*** sri_ has quit IRC | 00:19 | |
*** sri_ has joined #tripleo | 00:20 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Test work for using zuulV3 native in RDO Cloud https://review.openstack.org/587228 | 00:20 |
*** sri_ has quit IRC | 00:21 | |
*** sri_ has joined #tripleo | 00:22 | |
*** Laszlo-74 has joined #tripleo | 00:23 | |
Laszlo-74 | Hello all | 00:23 |
*** mmedvede_ has joined #tripleo | 00:24 | |
*** mmedvede has quit IRC | 00:24 | |
*** mmedvede_ is now known as mmedvede | 00:24 | |
Laszlo-74 | if I have a tripleo queens install, how can I install other software components in my overcloud? | 00:24 |
openstackgerrit | Jill Rouleau proposed openstack/tripleo-heat-templates master: WIP: Add chrony time service https://review.openstack.org/588111 | 00:25 |
Laszlo-74 | I need to install some collectd components, and I see there is a collectd container on my overcloud hosts | 00:25 |
Laszlo-74 | How can I add more collectd plugins to these containers? | 00:26 |
*** dsneddon has quit IRC | 00:28 | |
*** sri_ has quit IRC | 00:28 | |
*** sri_ has joined #tripleo | 00:29 | |
*** dsneddon has joined #tripleo | 00:34 | |
*** slong has joined #tripleo | 00:41 | |
*** sri_ has quit IRC | 00:45 | |
*** slong has quit IRC | 00:46 | |
*** sri_ has joined #tripleo | 00:46 | |
*** slong has joined #tripleo | 00:46 | |
*** agopi has joined #tripleo | 00:54 | |
*** khyr0n has quit IRC | 00:56 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix standalone home dir variable https://review.openstack.org/595010 | 00:57 |
openstackgerrit | Merged openstack/python-tripleoclient master: Issue a message to update nodes after updating images https://review.openstack.org/591773 | 00:57 |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 01:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 01:10 |
*** mrsoul has joined #tripleo | 01:21 | |
*** mschuppert has quit IRC | 01:23 | |
*** dxiri has joined #tripleo | 01:29 | |
openstackgerrit | xuan.mingyi proposed openstack/puppet-pacemaker master: Add 'Development' in README https://review.openstack.org/588955 | 01:32 |
*** dxiri has quit IRC | 01:33 | |
*** Laszlo-74 has quit IRC | 01:34 | |
*** noama has quit IRC | 01:36 | |
*** sri_ has quit IRC | 01:47 | |
*** sri_ has joined #tripleo | 01:48 | |
*** lblanchard has quit IRC | 01:52 | |
*** khyr0n has joined #tripleo | 01:58 | |
*** sri_ has quit IRC | 02:04 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 02:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 02:10 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: vitrage not supported by tempest on the undercloud https://review.openstack.org/595392 | 02:15 |
weshay | mwhahaha, EmilienM close to a promotion, will need https://review.openstack.org/595392 | 02:15 |
*** bdodd_ has joined #tripleo | 02:23 | |
*** safchain_ has joined #tripleo | 02:27 | |
*** dansmith has joined #tripleo | 02:28 | |
*** mandre has joined #tripleo | 02:28 | |
*** mnasiadka has quit IRC | 02:29 | |
*** safchain has quit IRC | 02:29 | |
*** bdodd has quit IRC | 02:29 | |
*** akrzos has quit IRC | 02:29 | |
*** rpioso|afk has quit IRC | 02:29 | |
*** mandre_off has quit IRC | 02:29 | |
*** htimsnad has quit IRC | 02:29 | |
*** safchain_ is now known as safchain | 02:29 | |
*** psachin has joined #tripleo | 02:47 | |
*** dsneddon has quit IRC | 02:49 | |
*** dsneddon has joined #tripleo | 02:51 | |
*** rpioso has joined #tripleo | 02:58 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 03:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 03:10 |
*** skramaja has joined #tripleo | 03:18 | |
*** morazi has quit IRC | 03:30 | |
*** slong is now known as slong-afk | 03:40 | |
*** udesale has joined #tripleo | 03:47 | |
*** Mantorok has quit IRC | 03:50 | |
*** khyr0n has quit IRC | 03:52 | |
*** Petersingh has joined #tripleo | 03:52 | |
*** saneax has joined #tripleo | 03:57 | |
*** Petersingh is now known as Petersingh|afk | 03:58 | |
*** slong-afk is now known as slong | 04:00 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 04:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 04:10 |
*** ykarel has joined #tripleo | 04:14 | |
*** sri_ has joined #tripleo | 04:17 | |
*** moshele has joined #tripleo | 04:19 | |
*** moshele has quit IRC | 04:22 | |
*** sri_ has quit IRC | 04:33 | |
*** sri_ has joined #tripleo | 04:34 | |
*** slong is now known as slong-afk | 04:39 | |
*** ramishra has joined #tripleo | 04:44 | |
*** links has joined #tripleo | 05:00 | |
*** sri_ has quit IRC | 05:03 | |
*** sri_ has joined #tripleo | 05:05 | |
*** slong-afk is now known as slong | 05:05 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 05:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 05:10 |
*** mschuppert has joined #tripleo | 05:10 | |
*** Petersingh|afk is now known as Petersingh | 05:10 | |
*** ccamacho has quit IRC | 05:11 | |
*** ccamacho has joined #tripleo | 05:12 | |
*** holser_ has joined #tripleo | 05:13 | |
*** shyamb has joined #tripleo | 05:14 | |
*** sri_ has quit IRC | 05:15 | |
*** Guest95179 has joined #tripleo | 05:16 | |
*** Guest95179 is now known as marios | 05:16 | |
*** sri_ has joined #tripleo | 05:16 | |
*** ykarel_ has joined #tripleo | 05:17 | |
Tengu | hello there :) | 05:18 |
*** ccamacho has quit IRC | 05:19 | |
*** ykarel has quit IRC | 05:21 | |
*** yprokule has joined #tripleo | 05:24 | |
*** moshele has joined #tripleo | 05:26 | |
*** dmellado has joined #tripleo | 05:27 | |
*** moshele has quit IRC | 05:29 | |
*** noama has joined #tripleo | 05:32 | |
noama | hi | 05:38 |
noama | Im trying to deploy with master | 05:38 |
noama | getting the following issue on controller node | 05:38 |
noama | Warning: [norpm] Attempting to install xinetd but it will not be installed", | 05:38 |
noama | "Error: Systemd start for xinetd failed!", | 05:38 |
noama | "journalctl log for xinetd:", | 05:38 |
noama | "-- No entries --", | 05:38 |
noama | "Error: /Stage[main]/Xinetd/Service[xinetd]/ensure: change from stopped to running failed: Systemd start for xinetd failed!", | 05:38 |
noama | at "TASK [Debug output for task which failed: Run puppet host configuration for step 2] ***" | 05:39 |
noama | someone know what can lead to this issue? has a workaround? | 05:39 |
*** holser_ has quit IRC | 05:40 | |
*** janki has joined #tripleo | 05:40 | |
*** dsneddon has quit IRC | 05:44 | |
*** dsneddon has joined #tripleo | 05:45 | |
*** hjensas has quit IRC | 05:52 | |
*** ksambor has joined #tripleo | 06:02 | |
*** sri_ has quit IRC | 06:03 | |
*** sri_ has joined #tripleo | 06:03 | |
openstackgerrit | Kamil Sambor proposed openstack/python-tripleoclient master: Add fixtures instead mock https://review.openstack.org/579538 | 06:07 |
*** ccamacho has joined #tripleo | 06:07 | |
*** ratailor has joined #tripleo | 06:09 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 06:10 |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 06:10 |
Tengu | noama: hmm. weird. xinetd shouldn't be needed anymore | 06:12 |
Tengu | noama: you're deploying containerized overcloud right? | 06:12 |
noama | yes | 06:13 |
noama | i followed this | 06:13 |
noama | https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/overcloud.html | 06:13 |
noama | as im not doing an HA , i have 1 controller | 06:13 |
*** shyamb has quit IRC | 06:13 | |
*** shyamb has joined #tripleo | 06:14 | |
Tengu | noama: care to open an issue on launchpad with the logs and command and so on? guess this might be a bug. | 06:14 |
noama | i use environments/puppet-pacemaker.yaml | 06:14 |
Tengu | puppet-pacemaker is for HA | 06:14 |
noama | which i think is mistake in doc | 06:14 |
noama | oh i thought it should be used for non-ha | 06:14 |
jaosorior | good morning folks! | 06:15 |
Tengu | hello jaosorior | 06:15 |
openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates stable/queens: Edit some post update tasks logic https://review.openstack.org/585159 | 06:15 |
Tengu | jaosorior: wondering what would be the "cost" of moving to named volumes instead of those bloody bind-mounts.... | 06:16 |
Tengu | jaosorior: it's really, really wrong with the current situation. | 06:16 |
jaosorior | Tengu: There is some cost to it, however, I think it's the way to go | 06:16 |
jaosorior | Tengu: for lack of terminology, I've been calling "container volumes" to what actually are "named volumes" | 06:17 |
jaosorior | but yes, I think that's the way to go | 06:17 |
Tengu | jaosorior: mainly a process that will check if there is a named volume, if not, create it, sync data from old mount to new volume, drop old location | 06:17 |
jaosorior | Tengu: I would like us to have the hieradata for containers duplicated in a named volume | 06:17 |
jaosorior | and then eventually write all our configs to named volumes, that we then just attach to our containers | 06:17 |
*** jfrancoa has joined #tripleo | 06:17 | |
Tengu | jaosorior: we can do that as a first step. even if this isn't really useful in the end. | 06:18 |
Tengu | that precise thing isn't needed. I'm more aiming the other ones, those with "hot data". | 06:18 |
Tengu | hieradata is cold data. accessed once. | 06:18 |
jaosorior | Tengu: lets go the whole way, why only some data ;) | 06:18 |
Tengu | jaosorior: well, actually, puppet/hieradata is copied inside the image already. Why bother? ;) | 06:19 |
Tengu | and we could actually correct the SELinux issue with those data :D | 06:19 |
jaosorior | ? | 06:19 |
Tengu | I'm aiming the current bind-mount causing the troubles - those in /var/lib for example. | 06:19 |
jaosorior | correct | 06:20 |
Tengu | they are the last issues I get. | 06:20 |
jaosorior | well | 06:20 |
jaosorior | if you want to start with that | 06:20 |
jaosorior | I think it is a good step forwrd | 06:20 |
jaosorior | * forward | 06:20 |
jaosorior | however, it's gonna be a lot of work | 06:20 |
Tengu | if we don't do named volumes, we will need to add the right to hit the setfscreate and security_t thingy. | 06:20 |
jaosorior | so, lets say docker-puppet.py writes named volumes | 06:21 |
Tengu | so basically, as a FIRST TEMPORARY step we can add a policy, so that we can go forward. but doing so means: "temporary will last" | 06:21 |
jaosorior | in one go, we need to change every t-h-t service to mount the named volume instead of the /var/lib/ dir | 06:21 |
Tengu | I know too well that kind of situation ;) | 06:21 |
Tengu | yup | 06:21 |
jaosorior | uhm | 06:21 |
Tengu | and copy the data. | 06:21 |
jaosorior | we already copy the data though | 06:22 |
jaosorior | so that part doesn't change | 06:22 |
Tengu | not always do we? | 06:22 |
jaosorior | most of the time | 06:22 |
jaosorior | if we don't, we gotta fix those instances | 06:22 |
Tengu | hmm ok... | 06:22 |
jaosorior | let me show you | 06:22 |
Tengu | for instance the pxe thingy in ironic container is on the host, and bind-mounted in the container | 06:22 |
jaosorior | yeah | 06:22 |
Tengu | that allows to change the container without any loss | 06:22 |
Tengu | so it doesn't copy anything | 06:22 |
jaosorior | Tengu: sure, but for a lot of other services we do | 06:23 |
jaosorior | there are exceptions, that we need to fix | 06:23 |
jaosorior | such as ironic | 06:23 |
Tengu | jaosorior: ok. | 06:23 |
Tengu | well, data on hosts are persistent at least ;). | 06:23 |
jaosorior | but yeah, look: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L204 for configuration of services, most of the time we mount from /var/lib/config-data... to /var/lib/kolla/config_files.... | 06:23 |
Tengu | container should not have persistent data within. They should be in named volumes :P. I wonder WHY named volumes weren't used in the first place. | 06:24 |
jaosorior | subsequently, we tell kolla to copy that configuration to the location it should be https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L130 | 06:24 |
Tengu | hmm ok | 06:24 |
jaosorior | so, instead of mounting from the host | 06:24 |
jaosorior | we can replace that with the named volume | 06:24 |
Tengu | yeah ok, that's still cold data - for instance configurations | 06:24 |
jaosorior | and stuff should still work | 06:24 |
Tengu | but hot data like a mysql DB are in bind-mounted volume | 06:25 |
jaosorior | where? | 06:25 |
jaosorior | I see | 06:25 |
jaosorior | https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/pacemaker/database/mysql.yaml#L211 | 06:25 |
Tengu | exactly | 06:25 |
jaosorior | Tengu: well, we gotta go case-by-case and fix those | 06:25 |
Tengu | that's better - because we can do service per service. | 06:26 |
jaosorior | OK, should we write a plan of action? or tasks? | 06:26 |
Tengu | there are two use-cases: 1- cold data, that are generated on the host, mounted in the container and copied - never edited. 2- hot data, that are writable from the container, and must NOT be lost | 06:27 |
*** agurenko has joined #tripleo | 06:27 | |
Tengu | jaosorior: we should first get some inputs from the community I think. | 06:27 |
*** moshele has joined #tripleo | 06:27 | |
Tengu | i.e. "why named volumes weren't used in the first place", "any cons we didn't foresee?" and the like. | 06:27 |
jaosorior | Tengu: OK, I suggest you/we write a mail about this, detailing this whole situation in detail, and coming up with a plan of action | 06:27 |
Tengu | jaosorior: starting a pad. | 06:27 |
jaosorior | Tengu: for mysql, I would think it was done so because migration from non-containerized to containerized was easier | 06:27 |
jaosorior | bandini and dciabrini would know | 06:28 |
Tengu | probably the same reasons for any other ones with hot data. | 06:28 |
Tengu | jaosorior: https://etherpad.openstack.org/p/tripleo-named-volumes | 06:28 |
jaosorior | and that's fine; as long as we get a plan of action on how to move away from this | 06:28 |
bandini | afaict it was simply the method used everywhere in tripleo to persist data on the host | 06:29 |
jaosorior | Tengu: we're gonna need upgrade-only containers, that would copy the "hot-data" into named volumes. | 06:30 |
Tengu | jaosorior: yep | 06:30 |
jaosorior | bandini: Do you think it would be problematic if we "removed" /var/lib/mysql from the host? It would be moved towards a named volume instead. | 06:30 |
*** jchhatbar has joined #tripleo | 06:31 | |
*** janki has quit IRC | 06:31 | |
jaosorior | Tengu, bandini: We, of course, need to consider the filesystem used for this... overlayfs, which we use by default in containers, might be too slow for mysql | 06:31 |
*** Petersingh is now known as Petersingh|bomga | 06:32 | |
Tengu | jaosorior: there's probably ONE use we won't really be able to "name-volume": logging. | 06:32 |
Tengu | well, yes, we could, but that will require "some" changes.... | 06:33 |
Tengu | maybe symlink in /var/log/containers or the like | 06:33 |
bandini | jaosorior: I'd have to read up a bit more around named volumes, but as long as stuff is persisted correctly, I think we do not particularly care about the implementation | 06:33 |
*** pcaruana has joined #tripleo | 06:33 | |
*** rdopiera has joined #tripleo | 06:33 | |
*** sri_ has quit IRC | 06:33 | |
bandini | jaosorior, Tengu: what I do suggest is to check if named volume support is on par in podman | 06:33 |
jaosorior | Tengu: at some point in the future I would like to move away from /var/log/containers... and use the container engine's log driver. This means, have containers log to stdout, and that would then be picked up by the logging driver | 06:34 |
bandini | as it would be then extra hard to move to podman if they did not support this stuff properly | 06:34 |
Tengu | bandini: it apparently is supported | 06:34 |
*** sri_ has joined #tripleo | 06:34 | |
bandini | Tengu: make sure you try it first (and I am speaking out of experience here ;) | 06:34 |
Tengu | at least it's mentioned in the "podman" manpage, will need to dig a bit deeper - will check with EmilienM - he has some more XP than me. | 06:34 |
*** zbitter has quit IRC | 06:37 | |
*** dsneddon has quit IRC | 06:38 | |
*** zaneb has joined #tripleo | 06:38 | |
*** dsneddon has joined #tripleo | 06:38 | |
Tengu | jaosorior: care to validate the draft? I'd rather avoid getting the whole community against me ;) | 06:42 |
Tengu | will have my breakfast in the meanwhile :) | 06:44 |
jaosorior | haha sure | 06:47 |
jaosorior | I'll check it out in a bit | 06:47 |
jaosorior | first I'm gonna make some coffee | 06:47 |
*** sri_ has quit IRC | 06:48 | |
*** sri_ has joined #tripleo | 06:48 | |
*** ramishra has quit IRC | 06:49 | |
bandini | I added a q. to the etherpad | 06:51 |
*** hjensas has joined #tripleo | 06:56 | |
jaosorior | bandini: answered | 06:58 |
jaosorior | bandini: at least one reason | 06:58 |
*** apetrich has joined #tripleo | 06:58 | |
Tengu | bandini jaosorior thanks for the question/answer, added in the content | 06:58 |
bandini | ack, thanks ;) | 06:59 |
openstackgerrit | Merged openstack/puppet-tripleo master: Use exec for CA CRL instead of file resource https://review.openstack.org/593491 | 06:59 |
*** shyamb has quit IRC | 06:59 | |
Tengu | anything else? Guess I'll wait this afternoon anyway, in order to get some of the deploy framework validate the content as well. | 06:59 |
*** rcernin has quit IRC | 06:59 | |
*** aufi has joined #tripleo | 07:02 | |
*** ykarel_ is now known as ykarel|away | 07:02 | |
openstackgerrit | Merged openstack/os-collect-config stable/queens: Add region support https://review.openstack.org/587351 | 07:02 |
jaosorior | Tengu: there's a lot of stuff we could do by moving our config (cold data) to named volumes :D ... I'm afraid it's out of scope fo this initiative though | 07:04 |
Tengu | jaosorior: might be a second phase. | 07:04 |
*** shyamb has joined #tripleo | 07:04 | |
jaosorior | Anyway, I'm actually happy with the current content | 07:04 |
jaosorior | might want to give it another pass later | 07:05 |
Tengu | jaosorior: but as said, my main concern is for the hot data - they are the ones creating the issues | 07:05 |
jaosorior | and lets aim for sending it at the end of the day | 07:05 |
*** Petersingh|bomga is now known as Petersingh | 07:05 | |
Tengu | jaosorior: fine for me, as said I'll wait for EmilienM and some others of the team to review it and give their thoughts. | 07:05 |
Tengu | the addition of podman support in paunch might be the right moment to think about it. | 07:05 |
*** ykarel|away has quit IRC | 07:07 | |
*** ramishra has joined #tripleo | 07:07 | |
*** jtomasek has joined #tripleo | 07:08 | |
*** jtomasek has quit IRC | 07:08 | |
*** jtomasek has joined #tripleo | 07:09 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 07:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 07:10 |
*** f1 has joined #tripleo | 07:13 | |
*** f1 is now known as florianf | 07:13 | |
*** bogdando has joined #tripleo | 07:15 | |
*** numans_ has joined #tripleo | 07:15 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Make sure we properly set container related facts during upgrade. https://review.openstack.org/595143 | 07:17 |
shardy_afk | woohoo, standalone all-in-one deployment working on baremetal :) | 07:18 |
*** shardy_afk is now known as shardy | 07:18 | |
jaosorior | shardy: duuude nice! | 07:18 |
jaosorior | shardy: gonna write a blog post about it? | 07:18 |
shardy | jaosorior: yeah I may, although atm I pretty much just followed the docs | 07:18 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/queens: Use exec for CA CRL instead of file resource https://review.openstack.org/595509 | 07:19 |
shardy | had a few issues yesterday but they were due to my environment/configuration | 07:19 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/pike: Use exec for CA CRL instead of file resource https://review.openstack.org/595510 | 07:19 |
*** Petersingh is now known as Petersingh|afk | 07:20 | |
shyamb | Hi | 07:22 |
shyamb | owalsh: Good morning | 07:22 |
*** shyamb has quit IRC | 07:22 | |
*** shyamb has joined #tripleo | 07:22 | |
*** jchhatba_ has joined #tripleo | 07:24 | |
*** Petersingh|afk is now known as Petersingh | 07:24 | |
*** jchhatbar has quit IRC | 07:25 | |
*** jpich has joined #tripleo | 07:29 | |
*** lbudai has joined #tripleo | 07:32 | |
*** lbudai has left #tripleo | 07:33 | |
*** amoralej|off is now known as amoralej | 07:33 | |
*** tosky has joined #tripleo | 07:34 | |
*** jpena|off is now known as jpena | 07:36 | |
*** ykarel|away has joined #tripleo | 07:36 | |
*** ykarel|away is now known as ykarel | 07:36 | |
*** Petersingh is now known as Petersingh|lunch | 07:40 | |
*** shyamb has quit IRC | 07:43 | |
*** gkadam has joined #tripleo | 07:44 | |
*** jchhatba_ has quit IRC | 07:46 | |
*** jchhatba_ has joined #tripleo | 07:48 | |
*** ratailor has quit IRC | 07:49 | |
*** jchhatba_ has quit IRC | 07:50 | |
*** jchhatba_ has joined #tripleo | 07:50 | |
*** paramite_ has joined #tripleo | 08:03 | |
*** owalsh has quit IRC | 08:03 | |
*** dbecker_ has joined #tripleo | 08:07 | |
*** dbecker has quit IRC | 08:07 | |
*** jaosorior has quit IRC | 08:10 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 08:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 08:10 |
*** gkadam is now known as gkadam-afk | 08:14 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart master: Install openstack-heat-agents for Ocata subnodes https://review.openstack.org/595527 | 08:18 |
*** kopecmartin has joined #tripleo | 08:20 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui stable/queens: Add general error message to NodesAssignmentForm https://review.openstack.org/595528 | 08:23 |
*** moguimar has joined #tripleo | 08:31 | |
*** moguimar has quit IRC | 08:31 | |
*** moguimar has joined #tripleo | 08:33 | |
*** dtantsur|afk is now known as dtantsur | 08:33 | |
*** shyamb has joined #tripleo | 08:38 | |
*** ykarel is now known as ykarel|lunch | 08:40 | |
*** Petersingh|lunch is now known as Petersingh | 08:40 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Revert "Revert "Don't trigger repo injection if nothing was built"" https://review.openstack.org/582763 | 08:40 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates master: DONT REVIEW: this is dependency patch https://review.openstack.org/446592 | 08:41 |
*** slong has quit IRC | 08:42 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Reproduce CI multinode job with libvirt https://review.openstack.org/543429 | 08:43 |
d0ugal | mwhahaha: Which mistral workflow bits are you worried about? Is there anything I can do to help? | 08:45 |
*** owalsh has joined #tripleo | 08:48 | |
*** Petersingh is now known as Petersingh|mtg | 08:49 | |
*** owalsh_ has joined #tripleo | 08:50 | |
Tengu | hmm. can anyone provide me with a "generated" Dockerfile for building a container? I don't care which container | 08:51 |
*** owalsh has quit IRC | 08:53 | |
*** owalsh has joined #tripleo | 08:55 | |
openstackgerrit | Daniel Alvarez proposed openstack/tripleo-quickstart master: DNM: OVN tempest test https://review.openstack.org/587830 | 08:56 |
*** owalsh_ has quit IRC | 08:56 | |
*** jaosorior has joined #tripleo | 09:08 | |
openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates stable/pike: Fix neutron log path https://review.openstack.org/595554 | 09:09 |
*** ykarel|lunch is now known as ykarel | 09:10 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 09:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 09:10 |
Tengu | hmmm. wondering if podman actually supports named volumes - I was pretty sure I saw that in its man, but apparently, digging in it doesn't show any real support. fuuuu | 09:11 |
*** jchhatba_ has quit IRC | 09:14 | |
*** jchhatba_ has joined #tripleo | 09:14 | |
jaosorior | Tengu: what? :/ | 09:15 |
jaosorior | could it be you have a version of podman that's too old? | 09:15 |
Tengu | jaosorior: https://github.com/containers/libpod/issues/605 | 09:16 |
Tengu | still, we can use the -v /usr/lib/container/volumes/foo:/var/lib/foo | 09:17 |
Tengu | that should be alright | 09:17 |
*** shyamb has quit IRC | 09:20 | |
Tengu | anyway, will see how to change some file locations. | 09:21 |
Tengu | jaosorior: ah, there's also a "nice" feature for podman that is not in docker (at least, to my knowledge): the "mounts.conf", allowing to get generic mounts in the containers without any mention in the CLI | 09:23 |
Tengu | "Note this is not a volume mount. The content of the volumes is copied into container storage, not bind mounted directly from the host." | 09:24 |
Tengu | nyaaaaa | 09:24 |
Tengu | in the /etc/containers/mounts.conf we could push /etc/puppet :D | 09:25 |
Tengu | and it will be copied inside the containers automatically. | 09:25 |
jaosorior | Tengu: well, we only need that for the containers started by docker-puppet.py | 09:27 |
Tengu | aren't they all launched with it? | 09:28 |
shardy | Tengu: no, it only does config generation and bootstrapping, paunch starts the final service containers | 09:29 |
*** paramite_ has quit IRC | 09:30 | |
shardy | https://hardysteven.blogspot.com/2018/06/tripleo-containerized-deployments.html has some info FYI, and there's some in tripleo-docs | 09:30 |
Tengu | shardy: hmm ok. so basically the puppet stuff isn't needed once it's configured. | 09:30 |
shardy | Tengu: yeah it's just a shim to reuse the puppet stuff for config generation and bootstrapping, the containers are temporary | 09:30 |
*** paramite has joined #tripleo | 09:30 | |
Tengu | shardy: so this explains the need of volumes - generated content goes in those volumes, and are used with the final launch via paunch. | 09:31 |
shardy | Tengu: yup exactly | 09:31 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: IHA Default the compute endpoint check script to internal https://review.openstack.org/595558 | 09:31 |
Tengu | guess we really should move the generated stuff in the right location - being proper container|docker volumes, named or not. | 09:31 |
*** holser_ has joined #tripleo | 09:34 | |
*** shyamb has joined #tripleo | 09:34 | |
*** jchhatbar has joined #tripleo | 09:36 | |
*** jchhatba_ has quit IRC | 09:39 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: allow tripleo-roles to be updated in ci https://review.openstack.org/594933 | 09:43 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Do not enforce libguestfs emulation mode https://review.openstack.org/595566 | 09:51 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/4) https://review.openstack.org/582180 | 09:52 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/4) https://review.openstack.org/582181 | 09:52 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/4) https://review.openstack.org/582301 | 09:52 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnets to networks roles (4/4) https://review.openstack.org/595567 | 09:52 |
*** jaosorior has quit IRC | 09:54 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-common master: Allow networks in roles_data to be dict or list https://review.openstack.org/595570 | 09:54 |
*** ssbarnea has joined #tripleo | 09:55 | |
*** jaganathan has joined #tripleo | 09:55 | |
*** sri_ has quit IRC | 09:55 | |
*** sri_ has joined #tripleo | 09:56 | |
*** Petersingh has joined #tripleo | 09:57 | |
*** Petersingh|mtg has quit IRC | 09:57 | |
*** jchhatbar has quit IRC | 09:58 | |
*** sri_ has quit IRC | 09:59 | |
*** sri_ has joined #tripleo | 09:59 | |
*** sri_ has quit IRC | 10:05 | |
*** sri_ has joined #tripleo | 10:06 | |
*** SlickNik has quit IRC | 10:09 | |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 10:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 10:10 |
*** shyamb has quit IRC | 10:16 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: IHA Default the compute endpoint check script to internal https://review.openstack.org/595558 | 10:17 |
jfrancoa | tosky: hey, one question about your last comment in https://review.openstack.org/#/c/576520/ , is there any bug opened for the error which was introduced? I'm about to investigate it. | 10:31 |
Tengu | bandini: so podman doesn't support named container per se, but this can be worked around - using the proper location for volumes would already provide great benefits :) | 10:31 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Display output of package install in case of failure https://review.openstack.org/595576 | 10:32 |
tosky | jfrancoa: no bug, but really, just check https://review.openstack.org/#/c/582472/ and what the cherry-pick did | 10:33 |
jfrancoa | tosky: ok, I just saw this https://review.openstack.org/#/c/595270/ | 10:33 |
jfrancoa | tosky: :-D collision | 10:34 |
tosky | jfrancoa: basically https://review.openstack.org/#/c/576520/ already existed, then https://review.openstack.org/#/c/582472/ landed before it | 10:34 |
tosky | and the big commit was updated after the merge conflict, but the conflict was not resolved properly | 10:34 |
tosky | so https://review.openstack.org/#/c/582472/ disappeared | 10:34 |
tosky | I sent a new patch for it | 10:35 |
*** mrunge_ is now known as mrunge | 10:35 | |
tosky | as https://review.openstack.org/#/c/595270/ | 10:35 |
tosky | yep | 10:35 |
tosky | that's the full story | 10:35 |
jfrancoa | tosky: I saw that you re-cherry picked it right? sorry for that, it was sooo many templates that it got missed | 10:35 |
jfrancoa | tosky: we should have caught it while reviewing. Thanks for the cherry-pick | 10:36 |
*** boazel has joined #tripleo | 10:38 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart master: Install openstack-heat-agents for Queens and Ocata subnodes https://review.openstack.org/595527 | 10:40 |
*** jchhatbar has joined #tripleo | 10:46 | |
*** Petersingh is now known as Petersingh|afk | 10:53 | |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: WIP: Enabling CI for OVS-DPDK deployment https://review.openstack.org/586969 | 10:59 |
*** raildo has joined #tripleo | 11:02 | |
*** jpena is now known as jpena|lunch | 11:03 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: allow tripleo-roles to be updated in ci https://review.openstack.org/594933 | 11:04 |
*** amoralej is now known as amoralej|lunch | 11:05 | |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 11:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 11:10 |
*** dbecker_ has quit IRC | 11:10 | |
*** dbecker has joined #tripleo | 11:13 | |
*** holser_ has quit IRC | 11:15 | |
*** raildo_ has joined #tripleo | 11:15 | |
*** raildo has quit IRC | 11:15 | |
EmilienM | is it me or launchpad has no css today | 11:17 |
hjensas | EmilienM: looks good to me. | 11:18 |
*** abishop has joined #tripleo | 11:18 | |
EmilienM | hjensas: have you tried hard refresh? maybe you have it in cache | 11:18 |
EmilienM | meh, no big deal anyway | 11:19 |
hjensas | EmilienM: yup, different browser, private session etc. | 11:20 |
EmilienM | hjensas: again my canadian connection :P | 11:21 |
hjensas | EmilienM: :D | 11:22 |
hjensas | EmilienM: any idea why this did'nt pick up the dependency? http://logs.openstack.org/67/595567/1/check/openstack-tox-pep8/686a62e/job-output.txt.gz#_2018-08-23_10_01_46_313747 | 11:23 |
hjensas | s/dependency/Depends-On/ | 11:24 |
EmilienM | hjensas: I think we've seen that before | 11:24 |
EmilienM | hjensas: we needed the patch in tripleo-common to be merged and released | 11:25 |
EmilienM | hjensas: https://github.com/openstack/requirements/blob/2fcead2a79ef38c29b5aad0843a8174ef938545f/upper-constraints.txt#L89 | 11:26 |
openstackgerrit | Merged openstack/diskimage-builder master: Add netcat to redhat-common map-packages https://review.openstack.org/588601 | 11:26 |
*** shyamb has joined #tripleo | 11:29 | |
*** Petersingh|afk is now known as Petersingh | 11:30 | |
*** dprince has joined #tripleo | 11:30 | |
hjensas | EmilienM: ok ... thanks. :) | 11:30 |
EmilienM | hjensas: I know right | 11:31 |
*** udesale has quit IRC | 11:31 | |
*** rh-jelabarre has joined #tripleo | 11:35 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Display output of package install in case of failure https://review.openstack.org/595576 | 11:36 |
*** moshele has quit IRC | 11:49 | |
*** shyamb has quit IRC | 11:52 | |
*** jaosorior has joined #tripleo | 11:54 | |
*** shyamb has joined #tripleo | 11:55 | |
*** agurenko has quit IRC | 11:57 | |
*** boazel has quit IRC | 11:58 | |
*** boazel has joined #tripleo | 11:59 | |
*** agurenko has joined #tripleo | 12:00 | |
*** jcoufal has joined #tripleo | 12:03 | |
*** moshele has joined #tripleo | 12:07 | |
*** jpena|lunch is now known as jpena | 12:09 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 12:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 12:10 |
*** hjensas has quit IRC | 12:10 | |
*** trown|outtypewww is now known as trown | 12:15 | |
*** pcaruana has quit IRC | 12:16 | |
*** pcaruana has joined #tripleo | 12:16 | |
*** raildo_ is now known as raildo | 12:16 | |
shardy | trown: Hey, good morning - let me know when you've had enough coffee to chat about https://etherpad.openstack.org/p/openshift-ansible-cloud-dev-env | 12:17 |
shardy | I've got the AIO environment working on baremetal, but got some questions re the networking | 12:17 |
*** ansmith has quit IRC | 12:20 | |
*** toure|gone is now known as toure | 12:21 | |
*** agurenko has quit IRC | 12:21 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Keep plan on update and store user env_files into swift https://review.openstack.org/583145 | 12:22 |
trown | shardy: good morning ... conveniently I have questions for you wrt passing overcloud-resource-registry-puppet.yaml to `openstack tripleo container image prepare` ... but you were first :) | 12:24 |
*** amoralej|lunch is now known as amoralej | 12:24 | |
trown | shardy: fair warning... I dont 100% understand what I did in that etherpad, I was just hacking on it and trying to make it work | 12:25 |
shardy | trown: hehe no worries - my question was about the ip pool for the ext-subnet - I'm not clear if I should reserve a range on the local lan (e.g like a floating IP) or have a different subnet and a route via the box running the overcloud - I've tried both and I can't reach deployed VMs in either case | 12:25 |
shardy | I suspect we need a second bridge for the VMs like libvirt, then a route between the host network and that | 12:26 |
shardy | but as-is the config adds the local lan to br-ctlplane | 12:26 |
shardy | I'm not sure if we actually need e.g br-ex and br-ctlplane, where the public interface *isn't* added to br-ctlplane, that's only for access the VMs | 12:26 |
shardy | it's kind of confusing as the names are reused from the undercloud, but actually it's a new overcloud neutron setup | 12:27 |
shardy | vs the static setup we have on the undercloud | 12:27 |
openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Move nova-metadata api to httpd wsgi https://review.openstack.org/582623 | 12:28 |
*** holser_ has joined #tripleo | 12:28 | |
trown | just comparing what is in the etherpad to my networks on rdocloud | 12:28 |
shardy | trown: IOW was 192.168.13.50 accessible via the same bridge you added $IP to | 12:29 |
shardy | or did you add a static route | 12:29 |
trown | I definitely didnt add any routes | 12:30 |
trown | I did need those masquerade rules though | 12:30 |
shardy | yea I added those | 12:30 |
shardy | sec let me paste some details, maybe I'm missing something | 12:30 |
trown | I dont currently have that deployed on rdocloud (it ended up not working for deploying openshift), but I could put it up if it would help for comparison to baremetal | 12:31 |
*** rlandy has joined #tripleo | 12:31 | |
dalvarez | o/ anybody aware of this failure? http://logs.openstack.org/30/587830/4/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/cfb92df/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-08-23_10_17_06 apparently only hitting scenario007? | 12:32 |
*** rh-jelabarre has quit IRC | 12:32 | |
openstackgerrit | Aakarsh proposed openstack/tripleo-quickstart master: DNM: Testing browbeat's sysmetric collection https://review.openstack.org/595351 | 12:35 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common master: Support for ARA report for ansible playbooks in deploy https://review.openstack.org/565077 | 12:36 |
openstackgerrit | Sagi Shnaidman proposed openstack/python-tripleoclient master: Support ARA report tracking from command line https://review.openstack.org/583799 | 12:36 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Collect overcloud statistics with ARA https://review.openstack.org/578462 | 12:36 |
openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: [PoC] Enable featureset override https://review.openstack.org/594511 | 12:41 |
*** Petersingh has quit IRC | 12:42 | |
*** tzumainn has joined #tripleo | 12:43 | |
shardy | trown: http://paste.openstack.org/show/728681/ shows where I've got to - the networks are up and configured, but I don't have l2 connectivity to the VM | 12:44 |
shardy | I suspect I need a second bridge and an internal network, then configure floating ips on the external bridge | 12:44 |
*** ssbarnea|ruck has quit IRC | 12:44 | |
shardy | but open to other ideas /me not a neutron guru ;) | 12:44 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Keep plan on update and store user env_files into swift https://review.openstack.org/583145 | 12:44 |
*** moshele has quit IRC | 12:45 | |
trown | shardy: ah ya... you need 2 nics for the config I used ... there is another config for single nic | 12:46 |
*** shyamb has quit IRC | 12:46 | |
trown | shardy: I used the 2 interface example here: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/standalone.html but there is a 1 interface example there too | 12:47 |
openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates stable/pike: Fix neutron log path https://review.openstack.org/595554 | 12:48 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Keep plan on update and store user env_files into swift https://review.openstack.org/583145 | 12:48 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-specs master: WIP upgrades CI with the Standalone installer for Stein https://review.openstack.org/579854 | 12:49 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Display output of package install in case of failure https://review.openstack.org/595576 | 12:49 |
*** ykarel has quit IRC | 12:51 | |
*** ykarel has joined #tripleo | 12:51 | |
shardy | trown: ack yeah, sorry should have clarified, I'm using the single nic config from the docs, but I'm not sure how to then configure the overcloud network in that setup | 12:54 |
*** udesale has joined #tripleo | 12:54 | |
shardy | trown: maybe mwhahaha will know as I think he's tested this | 12:54 |
* shardy may just find another nic to put in this box | 12:55 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Do not enforce libguestfs emulation mode https://review.openstack.org/595566 | 12:55 |
trown | shardy: ya, I dont have much idea there. that config seems a bit more WIP | 12:55 |
shardy | trown: yeah I suspect so - I don't think we can attach the VMs directly to the external network, so I think we must need another bridge and an internal subnet | 12:56 |
* shardy will dig into it | 12:56 | |
openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Move nova-metadata api to httpd wsgi https://review.openstack.org/582623 | 12:57 |
mandre | shardy: hi, do you have an example of ci jobs that download all the images with your change at https://review.openstack.org/#/c/594907/ ? the few jobs I checked were only downloading the needed images... | 13:00 |
weshay | marios|rover, ssbarnea fyi.. all the timeouts upstream are on stable branches http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1 | 13:01 |
*** dhill_ has quit IRC | 13:01 | |
weshay | marios|rover, ssbarnea so I think https://review.openstack.org/#/c/594933/3 will resolve the latest wave of timeouts for us mwhahaha fyi | 13:01 |
weshay | sshnaidm, are we any closer w/ ara? | 13:02 |
trown | shardy: mandre ... when I use overcloud-resource-registry-puppet.yaml instead of environments/docker.yaml I still dont get a keepalived entry | 13:02 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Keep plan on update and store user env_files into swift https://review.openstack.org/583145 | 13:02 |
trown | shardy: mandre http://paste.openstack.org/show/728684/ | 13:02 |
trown | but I do only get entries for the other containers | 13:03 |
sshnaidm | weshay, in mtg | 13:04 |
trown | mandre: btw I looked at some of the stuff wrt setting up registry mirror for fedoraproject... IIUC that needs to be done in openstack infra ... maybe we should just copy an etcd container to our dockerhub mirror? | 13:05 |
shardy | mandre: Hey, no I don't atm - I was trying to fix the 009 issue trown is debugging, but actually environments/docker.yaml has never contained the keepalived service, so we may have some other issue | 13:05 |
shardy | mandre: the point was also to align with the latest t-h-t, where all the docker things are enabled by default | 13:06 |
trown | shardy: ya I think it has been broken since we merged the HA support | 13:06 |
shardy | vs having one environment file where we expect all docker services to be defined | 13:06 |
shardy | trown: Ok, well at least that explains it | 13:06 |
shardy | we did have an experimental job pass on that patch, so it'd be good to figure out why | 13:06 |
*** lblanchard has joined #tripleo | 13:06 | |
*** mjturek has joined #tripleo | 13:09 | |
*** jaosorior has quit IRC | 13:09 | |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient stable/rocky: Issue a message to update nodes after updating images https://review.openstack.org/595748 | 13:09 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 13:10 |
weshay | mwhahaha, EmilienM rocky is promoting | 13:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 13:10 |
weshay | http://38.145.34.55/rocky.log | 13:10 |
*** lennyb has quit IRC | 13:10 | |
EmilienM | weshay: wow | 13:11 |
trown | shardy: ya I tried to look at that... logs are gone though :( http://logs.openstack.org/09/579609/15/experimental/tripleo-ci-centos-7-scenario009-multinode-oooq/f8cf69c/ | 13:11 |
mwhahaha | shardy: if you give me your standalone params file I can check it out | 13:11 |
* mwhahaha will look after breakfast | 13:12 | |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient stable/queens: Issue a message to update nodes after updating images https://review.openstack.org/595765 | 13:14 |
shardy | mwhahaha: thanks https://paste.fedoraproject.org/paste/GOeFh-ueEJBLq4KrssK2Ng/ is the config - it works but I'm not sure if I'm then configuring the overcloud network/subnet correctly as I can't reach the VMs when the boot | 13:15 |
shardy | http://paste.openstack.org/show/728681/ shows how that's set up | 13:16 |
mwhahaha | shardy: so you won't be able to reach the vms on the internal Network but should via a floating ip | 13:16 |
mwhahaha | shardy: when I get to my desk I'll send you my network commands | 13:16 |
shardy | mwhahaha: yeah I was hoping to configure it so I could reach the internal network from the host, but I think the cidr for the subnet is currently wrong as it's the range I should probably use for floating ips | 13:17 |
shardy | the confusing thing was the "public" name in the docs and notes from trown - I guess that actually needs to be the internal subnet then I need a floating ip on a range from my local lan | 13:18 |
shardy | and also what the gateway should be if the subnet can't reach the br-ctlplane ip | 13:19 |
shardy | that's why I thought we'd need another bridge | 13:19 |
* shardy notes a diagram in the docs would help | 13:19 | |
shardy | happy to help with that when I figure this out :) | 13:20 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: avoid container_build_id is not defined failure https://review.openstack.org/595782 | 13:21 |
*** lblanchard has quit IRC | 13:30 | |
*** lvdombrkr has joined #tripleo | 13:31 | |
*** lvdombrkr has left #tripleo | 13:31 | |
*** gbarros has joined #tripleo | 13:31 | |
*** lvdombrkr has joined #tripleo | 13:31 | |
*** rh-jelabarre has joined #tripleo | 13:34 | |
*** paramite has quit IRC | 13:35 | |
*** raildo has quit IRC | 13:35 | |
*** paramite|clone has joined #tripleo | 13:35 | |
*** raildo has joined #tripleo | 13:36 | |
*** ekultails has joined #tripleo | 13:36 | |
*** skramaja has quit IRC | 13:37 | |
openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Add a script to compare playbook executions https://review.openstack.org/588475 | 13:38 |
mwhahaha | shardy: so the standalone params looks ok, how did you setup your neutron networks? | 13:40 |
*** psachin has quit IRC | 13:40 | |
* mwhahaha will try and repro today | 13:40 | |
mwhahaha | i haven't kicked off a standalone in a bit | 13:40 |
mwhahaha | maybe we broke something | 13:40 |
*** zaneb has quit IRC | 13:42 | |
*** zaneb has joined #tripleo | 13:42 | |
*** dhill_ has joined #tripleo | 13:44 | |
shardy | mwhahaha: I tried two ways, first with a separate subnet for ext-subnet, then I tried using the range I've reserved for floating ips - maybe the issue is I have to assign floating IPs always | 13:45 |
shardy | http://paste.openstack.org/show/728685/ | 13:45 |
shardy | probably I should revert to the first approach then configure the floating range | 13:46 |
* shardy has been using undercloud deployed vms for too long where ctlplane access is a given ;) | 13:46 | |
mwhahaha | shardy: so with one nic, i created a private network (192.168.24.x/24) and a provider network (192.168.1.x/29). then you need to create a router and then a floating ip which i assigned to my vm | 13:47 |
mwhahaha | shardy: the 3 ip's documented for the 1 nic config is 1 for host, 1 for router and 1 floating ip | 13:48 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Keep plan on update and store user env_files into swift https://review.openstack.org/583145 | 13:48 |
shardy | mwhahaha: ack yeah I saw that but it wasn't clear where those were defined - I was thinking of the undercloud where we have a bind ip for the services and a vip for haproxy | 13:48 |
mwhahaha | shardy: now if you wanted to straight use the external network as the nic for the vm, then you should be able ot access it | 13:48 |
sshnaidm | weshay, if you want update about ara - better in bluej | 13:48 |
weshay | sshnaidm, k.. I'm locked up for the next 3hrs so maybe tomorrow | 13:49 |
shardy | mwhahaha: Ok thanks for the pointers, I'll give it another go :) | 13:49 |
mwhahaha | shardy: only 1 ip is defined for the host, the others were reserved for your provider network | 13:49 |
sshnaidm | weshay, ok, then will send in mail | 13:49 |
mwhahaha | shardy: i'll kick off a standalone in a bit and come up with the exact commands | 13:49 |
shardy | mwhahaha: Ok, just to clarify - the provider network is the range on my lan, or another subnet where we route to, and the lan ips are the floating ip pool? | 13:50 |
shardy | I don't really care about access from the lan, I just want to be able to ssh to the VMs from the hypervisor, e.g the host box | 13:50 |
mwhahaha | shardy: the provider network is the range on your lan and used for the floating ip | 13:50 |
mwhahaha | which would give you connectivity to the vm from the host | 13:51 |
shardy | mwhahaha: ack thanks - maybe we can rename some things, as the ctlplane name copied from the undercloud config makes this a bit confusing | 13:51 |
shardy | ack thanks, grabbing a coffee then I'll give it a try :) | 13:51 |
mwhahaha | yea i'm not sure how the neutron bits end up so maybe there is a way to get around needing the floating ip | 13:51 |
mwhahaha | but this is how i got it working :D | 13:51 |
mwhahaha | YMMV | 13:51 |
*** rnoriega has joined #tripleo | 13:53 | |
*** trozet has joined #tripleo | 13:53 | |
*** rnoriega has quit IRC | 13:54 | |
weshay | apetrich, http://tripleo.org/install/basic_deployment/tempest.html#running-containerized-tempest-manually | 13:54 |
mandre | trown: looking at http://paste.openstack.org/show/728684/, what happens if you set the resource for OS::TripleO::Services::Keepalived in your scenario009-multinode.yaml file? | 13:55 |
*** rnoriega has joined #tripleo | 13:55 | |
*** jchhatbar has quit IRC | 13:55 | |
trown | mandre: I can try but I would assume that will work because setting it in docker.yaml worked | 13:55 |
mandre | trown: also, I find it interesting it defined the images for openshift as I would have expected overcloud-resource-registry-puppet.yaml to reset the OS::TripleO::Services::OpenShift::Master and Worker services to OS::Heat::None | 13:57 |
mandre | maybe an issue with how the prepare command loads the heat env files | 13:58 |
trown | mandre: ya I was trying to look at that... I am not familiar with that code though so a bit slow going | 13:58 |
trown | mandre: ya adding keepalived resource to scenario009 file works | 13:59 |
mandre | trown: somehow it's not taking into account registy set in /usr/share/openstack-tripleo-heat-templates/overcloud-resource-registry-puppet.yaml | 14:03 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Collect overcloud statistics with ARA https://review.openstack.org/578462 | 14:07 |
*** dhill_ has quit IRC | 14:08 | |
*** gbarros has quit IRC | 14:09 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Avoid parsing failure of provisioned.csv https://review.openstack.org/595795 | 14:10 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 14:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 14:10 |
*** gbarros has joined #tripleo | 14:11 | |
*** raildo_ has joined #tripleo | 14:11 | |
*** raildo has quit IRC | 14:12 | |
*** boazel has quit IRC | 14:12 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Avoid parsing failure of provisioned.csv https://review.openstack.org/595795 | 14:13 |
trown | mandre: I think it must be something to do with the template resoloving code ... it is like the template does not end up with the keepalived resource after getting created on the fly | 14:13 |
mandre | trown: right, that's also my feeling | 14:14 |
mandre | it fails to load the rendered template and fails silently or something | 14:14 |
shardy | I don't think prepare loads the rendered service templates, it just has a mapping of enabled services to *Image parameters? | 14:16 |
shardy | https://github.com/openstack/tripleo-common/blob/master/container-images/overcloud_containers.yaml.j2#L342 | 14:16 |
shardy | so we just need OS::TripleO::Services::Keepalived defined in either the role or any of the -e files, and it should load the image? | 14:17 |
shardy | but I'm perhaps missing something | 14:17 |
openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart-extras master: DNM: TEST for 585649 https://review.openstack.org/595797 | 14:18 |
openstackgerrit | Rafael Folco proposed openstack/tripleo-heat-templates stable/pike: DNM: TEST for 585649 https://review.openstack.org/595798 | 14:21 |
*** dhill_ has joined #tripleo | 14:21 | |
trown | shardy: ya maybe it should just go in the scenario file ... probably better than in docker.yaml | 14:22 |
*** gbarros has quit IRC | 14:23 | |
trown | shardy: but I do think it needs to be defined somewhere other than overcloud-resource-registry-puppet.yaml | 14:23 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations stable/queens: Add validation for checking baremetal boot images https://review.openstack.org/595800 | 14:23 |
trown | shardy: because afaict that doesnt actually work with the container image prepare command | 14:23 |
trown | mandre: wrt the fedoraproject container registry mirror... wdyt of just copying etcd container to our dockerhub mirror? Seems like a lot of work to setup a mirror in openstack infra for one container | 14:25 |
mandre | trown: yeah copying the etcd image to the docker hub would solve the immediate issue, sounds good to me | 14:27 |
shardy | trown: well the deploy command always includes overcloud-resource-registry-puppet.yaml, so it's a bit strange if the prepare command doesn't | 14:27 |
trown | mandre: ok I will work on that this afternoon and put a patch up to point to the new location | 14:27 |
shardy | maybe a question for stevebaker later | 14:27 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Revert "add delorean-current to repolist for updates" https://review.openstack.org/595803 | 14:29 |
*** boazel has joined #tripleo | 14:34 | |
*** ccamacho has quit IRC | 14:35 | |
bandini | mwhahaha: https://review.openstack.org/#/c/595558/ if you have a min ;) | 14:36 |
mwhahaha | bandini: you and your complex shell script shenanigans | 14:36 |
bandini | mwhahaha: if only nova did its job :P | 14:37 |
mwhahaha | :o | 14:37 |
bandini | plus it is python this time :) | 14:37 |
mwhahaha | bandini: python with no tests, might as well be a shell script :D | 14:38 |
bandini | true as well :) | 14:38 |
bandini | I hope we can drop that script for stein, I need to chat a bit more with the nova folks | 14:38 |
openstackgerrit | Rafael Folco proposed openstack/tripleo-heat-templates stable/queens: DNM: TEST for 585649 https://review.openstack.org/595804 | 14:43 |
*** rdopiera has quit IRC | 14:45 | |
*** ekultails has quit IRC | 14:46 | |
*** akrivoka has quit IRC | 14:53 | |
*** moshele has joined #tripleo | 14:54 | |
trown | shardy: found it... we are using different code for image prepare than we do for deploy ... it doesnt allow for using templates on the fly because if the file does not exist we just ignore it: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L1199-L1200 | 14:58 |
trown | shardy: whereas for deploy we are getting stuff from swift https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L202-L204 | 14:59 |
*** itlinux__ has joined #tripleo | 15:06 | |
shardy | trown: aha, so the default j2 rendered environment is ignored | 15:06 |
shardy | good catch! | 15:06 |
shardy | This is one thing I was trying to address with https://review.openstack.org/#/c/574753/ - there's no need for the environment file(s) defining services to be j2 rendered | 15:07 |
trown | had to break out pdb and learn how that code actually works :) | 15:07 |
shardy | I guess we'll need a workaround for now, but hopefully we can revive that patch or something similar during stein | 15:08 |
*** trozet has quit IRC | 15:08 | |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 15:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 15:10 |
*** hamzy has quit IRC | 15:10 | |
mandre | nice catch trown | 15:11 |
*** dhill_ has quit IRC | 15:11 | |
*** dhill_ has joined #tripleo | 15:13 | |
trown | shardy: mandre I put a comment detailing this in https://review.openstack.org/#/c/593621/1 I think that is probably the best solution we have available atm | 15:13 |
mandre | shardy: would love to see your https://review.openstack.org/#/c/574753/ patch merged :) | 15:14 |
trown | shardy: it looks like we would have the same issue in this particular case since that base environment is still j2 | 15:14 |
trown | but that does seem nice in general | 15:14 |
*** itlinux__ is now known as itlinux | 15:15 | |
*** itlinux is now known as 59NAABP8D | 15:15 | |
mandre | it kinda sucks the prepare command ignores the default resource_registry | 15:16 |
mandre | like really sucks | 15:16 |
*** 59NAABP8D has quit IRC | 15:17 | |
mwhahaha | shardy: i just ran through the standalone 1 nic, http://paste.openstack.org/show/728693/ | 15:18 |
*** itlinux has joined #tripleo | 15:18 | |
*** moguimar has quit IRC | 15:18 | |
shardy | mandre: yeah me too - it has some upgrade implications though so I need to work those out and we can revive it next cycle | 15:18 |
shardy | trown: no the services are in environment files that aren't j2 rendered | 15:19 |
shardy | which I think would help in this case? | 15:19 |
trown | shardy: ah I guess we would need to add keepalived to the openshift one | 15:19 |
shardy | trown: yeah | 15:20 |
shardy | mwhahaha: thanks! | 15:20 |
*** aufi has quit IRC | 15:20 | |
mandre | trown, shardy: and haproxy too | 15:20 |
shardy | mwhahaha: I'm missing several of those steps, will try it now | 15:20 |
shardy | flaper87: ^^ | 15:20 |
openstackgerrit | Carlos Camacho proposed openstack/python-tripleoclient master: Give priority to the custom container images file if used https://review.openstack.org/595817 | 15:20 |
mwhahaha | shardy: k i'll try and get this added to the docs and maybe diagram it | 15:20 |
shardy | mwhahaha: sounds good :) | 15:21 |
mwhahaha | shardy: one minor issue with that list of command is that teh vm doesn't have dns set (i didn't set dns server on the private net) | 15:24 |
shardy | mwhahaha: ack thanks, I'll add it | 15:26 |
*** lvdombrkr has quit IRC | 15:27 | |
*** ykarel is now known as ykarel|away | 15:32 | |
mwhahaha | shardy: so in testing you could get away with just launching the vm on the public, but you loose any automatic ip addressing from neutron | 15:32 |
mwhahaha | shardy: i was able to launch a vm just on public but i had to console in to add the ip address | 15:33 |
mwhahaha | itlinux: -^ similar thing when you were asking about just doing a provider network, you can do it but you loose the metadata service out of the box so ssh keys and ip addressing has to be handled in a different way because the provider network doesn't have this | 15:34 |
mwhahaha | (ie no metadata service) | 15:34 |
*** hamzy has joined #tripleo | 15:35 | |
shardy | mwhahaha: interesting, so I guess my previous setup was OK except for the lack of dhcp for the vm | 15:36 |
mwhahaha | https://kimizhang.wordpress.com/2014/11/11/how-to-use-meta-data-service-for-vm-with-provider-network/ | 15:36 |
shardy | thanks for looking into it | 15:36 |
itlinux | thanks.. mwhahaha: | 15:36 |
*** pcaruana has quit IRC | 15:36 | |
mwhahaha | so it seems you can do it but you have to add in a route for teh metadata service | 15:36 |
mwhahaha | then it would work | 15:36 |
mwhahaha | then you don't do tenant networking | 15:36 |
* mwhahaha will do some testing cause this seems handy to have | 15:37 | |
shardy | mwhahaha: ack, thanks - yeah this could be a useful option for the all-in-one case | 15:38 |
itlinux | nice find mwhahaha: like the link | 15:39 |
*** saneax has quit IRC | 15:40 | |
*** amoralej is now known as amoralej|off | 15:41 | |
*** chem has quit IRC | 15:42 | |
mandre | shardy, trown: FYI https://bugs.launchpad.net/tripleo/+bug/1788645 | 15:46 |
openstack | Launchpad bug 1788645 in tripleo "Prepare command ignores the default resource_registry" [Medium,Confirmed] | 15:46 |
*** trozet has joined #tripleo | 15:49 | |
*** raildo has joined #tripleo | 15:50 | |
mwhahaha | shardy: figured it out | 15:51 |
*** raildo_ has quit IRC | 15:51 | |
*** dhill_ has quit IRC | 15:51 | |
*** ykarel|away has quit IRC | 15:51 | |
mwhahaha | hrm maybe not | 15:52 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Keep plan on update and store user env_files into swift https://review.openstack.org/583145 | 15:53 |
*** itlinux is now known as itlinux-away | 15:58 | |
*** ssbarnea|ruck has joined #tripleo | 15:58 | |
*** itlinux-away is now known as itlinux | 16:00 | |
*** itlinux is now known as itlinux-away | 16:00 | |
*** links has quit IRC | 16:02 | |
*** moshele has quit IRC | 16:04 | |
*** yprokule has quit IRC | 16:05 | |
*** itlinux-away is now known as itlinux | 16:05 | |
*** itlinux is now known as itlinux-away | 16:05 | |
*** itlinux-away is now known as itlinux | 16:06 | |
*** itlinux is now known as itlinux-away | 16:07 | |
*** gkadam-afk has quit IRC | 16:07 | |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 16:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 16:10 |
*** dhill_ has joined #tripleo | 16:11 | |
*** itlinux-away is now known as itlinux | 16:13 | |
*** itlinux is now known as itlinux-away | 16:14 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Remove tripleo.sh --bootstrap-subnodes from toci_gate_test.sh https://review.openstack.org/587012 | 16:16 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: vitrage not supported by tempest on the undercloud https://review.openstack.org/595392 | 16:16 |
*** dtrainor has quit IRC | 16:17 | |
*** itlinux-away is now known as itlinux | 16:18 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: mysql/client: create tripleo.cnf everytime https://review.openstack.org/595824 | 16:18 |
*** itlinux is now known as itlinux-away | 16:18 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: mysql/client: create tripleo.cnf everytime https://review.openstack.org/595824 | 16:19 |
*** itlinux-away is now known as itlinux | 16:21 | |
*** jpena is now known as jpena|off | 16:25 | |
mwhahaha | shardy: ok so yea i did figure it out, but it requires at least 4 ipaddresses | 16:29 |
mwhahaha | shardy: 1 for host, 1 for vrouter, 1 for dhcp and 1 for the vm | 16:29 |
*** ksambor has quit IRC | 16:32 | |
shardy | mwhahaha: nice - be interested to see how you set that up - for now your original steps seem to be working, thanks for the help! | 16:32 |
*** jpich has quit IRC | 16:32 | |
weshay | mwhahaha, EmilienM can we put some sort alert bug up when creating new roles in tripleo | 16:33 |
weshay | sshnaidm, ^ | 16:34 |
weshay | to make everyone aware there is a new $repo | 16:34 |
EmilienM | you and your alerts | 16:34 |
itlinux | mwhahaha: did you test the provider network.. just wonder.. I see so maybe I lost track on the topic. TY | 16:34 |
mwhahaha | weshay: no but we should create a check list when adding stuff | 16:34 |
weshay | mwhahaha, ha.. I had a spec on that.. | 16:34 |
mwhahaha | itlinux: yea so i created it's provider only network | 16:34 |
weshay | no reviews | 16:34 |
weshay | but I agree mwhahaha :) | 16:34 |
EmilienM | we should have an alert everytime weshay wants to create an alert | 16:35 |
itlinux | without the change in the neutron(ml2) | 16:35 |
EmilienM | :P | 16:35 |
mwhahaha | itlinux: it's basically that web page (but it's way out of date for the openstack commands) | 16:35 |
weshay | EmilienM, bah.. you people.. YOU FRENCH people | 16:35 |
*** moshele has joined #tripleo | 16:36 | |
* EmilienM sends cheese to Denver | 16:36 | |
itlinux | yea that's not what I am worry about.. those can be easily changed.. | 16:36 |
sshnaidm | weshay, it would be different if only tripleo-ci squad could create repos for tripleo... | 16:36 |
mwhahaha | itlinux: you'd still have to properly configure neutron/ml2 with the provider network info | 16:36 |
itlinux | ok cool.. will check it out if no changes are needed in the neutron ml2 even better.. | 16:36 |
mwhahaha | itlinux: but the trickiness is in the neutron/vrouter/dhcp setup | 16:36 |
itlinux | ok | 16:37 |
itlinux | nice to know.. | 16:37 |
weshay | sshnaidm, mwhahaha https://review.openstack.org/#/c/569224/ | 16:37 |
weshay | ah.. see mwhahaha is a good dude.. he commented | 16:37 |
sshnaidm | weshay, then we would get delegations from other squads with cakes, trying to convince us to create a new repo | 16:37 |
itlinux | even this path is not right anymore /etc/neutron/plugin.ini | 16:38 |
itlinux | since it's in the ml2 now :) | 16:38 |
weshay | sshnaidm, +1 I like cake | 16:38 |
EmilienM | :) | 16:39 |
sshnaidm | weshay, maybe it's seriously, how can we maintain if we don't have control | 16:39 |
EmilienM | what kind of cake? | 16:39 |
EmilienM | the one we find in Denver? | 16:40 |
weshay | sshnaidm, like anyone on this channel has control of anything | 16:40 |
*** udesale has quit IRC | 16:40 | |
weshay | sshnaidm, HOPEFULLY the ptl's would not approve new repos w/o ensuring ci was in place.. mwhahaha :) | 16:41 |
mwhahaha | that's not how it works | 16:42 |
mwhahaha | repos have to be created before ci is in place | 16:42 |
mwhahaha | then you have to add ci to the repo | 16:42 |
weshay | ya.. | 16:42 |
weshay | which is why I don't want wild cards in include_pkgs | 16:42 |
weshay | mwhahaha, however once could commit the zuul.d/layout.yml first | 16:42 |
mwhahaha | weshay: eh that doesn't have any effect until the code is actually included in tripleo | 16:43 |
mwhahaha | so i think you're mixing issues | 16:43 |
sshnaidm | mwhahaha, and what is the process between "not included in tripleo" to "included in tripleo"? | 16:45 |
weshay | mwhahaha, we just need a real process for adding new repos to tripleo, that needs review | 16:46 |
weshay | doesn't need to be debated here | 16:46 |
weshay | since we add 10 new compnents per cycle.. it would help :) | 16:46 |
mwhahaha | weshay: so no, the ptl reviews that | 16:46 |
* weshay runs | 16:46 | |
mwhahaha | so i guess the question i have is what is the CI issue with these new things and were are we hitting issues | 16:46 |
mwhahaha | the actual integration can occur in any existing tripleo project however it generally happens in tripleo-common/THT | 16:47 |
mwhahaha | we have to have a repo, package (included in images/containers) prior to it landing in THT where it'll have an actual effect | 16:47 |
mwhahaha | using a wild card ensures that it works on the initial patch to integrate it | 16:48 |
mwhahaha | w/o having to go through the pain cycle of updating oooq | 16:48 |
weshay | srsly | 16:48 |
sshnaidm | mwhahaha, *could* be a problem when repo is not gated properly and goes to "current/" repo with every new change which can break CI. | 16:48 |
mwhahaha | there could be a problem with me waking up int he morning but i don't think i want to involve the world in planning my alarm clock | 16:49 |
mwhahaha | so yes there needs to be a better process to ensure CI is included in the intial repo creation | 16:49 |
mwhahaha | no that does not mean we need to forcefully add more work elsewhere in tripleo | 16:50 |
weshay | mwhahaha, agree.. | 16:50 |
weshay | just trying to make sure folks adding new repos to tripleo don't break EVERYTHING | 16:50 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: allow tripleo-roles to be updated in ci https://review.openstack.org/594933 | 16:51 |
weshay | mwhahaha, which I think is reasonable.. if you feel there is adequate coverage while using wild cards in the include_pkgs | 16:51 |
weshay | that is fine.. just say so | 16:51 |
mwhahaha | so the wildcards in oooq ensure that one can add a project to CI w/o having to update CI every time. | 16:51 |
weshay | and we'll do that | 16:51 |
mwhahaha | i do and thats why i had it | 16:51 |
mwhahaha | tripleo projects should be whitelisted and if we break shit then we're at fault due to missing CI jobs which should be addressed | 16:51 |
weshay | mwhahaha, ok.. fine.. ssbarnea switch it back to use wild cards please | 16:51 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Create missing directories before mounting them https://review.openstack.org/595831 | 16:52 |
weshay | ssbarnea, sorry for the trouble | 16:52 |
ssbarnea|ruck | okey, better now than in 3h | 16:52 |
mwhahaha | the first step to a new tripleo repo after it's been added is add CI | 16:52 |
mwhahaha | if that is not happening, then we shouldn't be integrating whatever repo that is elsewhere in tripleo | 16:52 |
*** ramishra has quit IRC | 16:52 | |
mwhahaha | the creation of the repo is external to everything until it gets pulled in somewhere | 16:52 |
mwhahaha | and before we approve that we need to make sure it's got appropriate CI coverage | 16:53 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: neutron-api: move /usr/share/neutron mount https://review.openstack.org/595834 | 16:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM - docker-puppet: don't force FACTER_hostname https://review.openstack.org/595274 | 16:54 |
sshnaidm | mwhahaha, anyway worth to check if this repo is included in existing wildcards, it's not always the case | 16:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Podman support for docker-puppet https://review.openstack.org/588655 | 16:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman https://review.openstack.org/590587 | 16:54 |
sshnaidm | mwhahaha, like with these new ansible roles which weren't there | 16:55 |
mwhahaha | sshnaidm: the wildcards in that ci job have 0 affect until they are included in images or containers | 16:55 |
ssbarnea|ruck | weshay : just to avoid another update, is this list ok https://gist.github.com/ssbarnea/3ed5e4e6f644c29468eee1286c7c8e86 ? | 16:55 |
sshnaidm | mwhahaha, not sure I understand you | 16:55 |
mwhahaha | right which is kinda the miss understanding how this works | 16:56 |
mwhahaha | so the risk of the includepkgs doesn't start until a new package is pulled in elsewhere within tripleo | 16:57 |
*** gbarros has joined #tripleo | 16:57 | |
mwhahaha | there is 0 risk using a wild card if the package isn't used either in the overcloud images or is included in a container | 16:57 |
sshnaidm | mwhahaha, until it's built and put in consistent repo | 16:57 |
mwhahaha | because we don't install it | 16:57 |
mwhahaha | no even then there's no risk | 16:57 |
mwhahaha | because we aren't installing it or consuming it | 16:57 |
sshnaidm | mwhahaha, I think we do.. | 16:57 |
weshay | mwhahaha, execpt that if there is a spec.. | 16:58 |
mwhahaha | we don't | 16:58 |
weshay | mwhahaha, the build-test-packages role will build it | 16:58 |
sshnaidm | mwhahaha, when we update something or install built package - we do | 16:58 |
mwhahaha | only if it's included in a ZUUL_CHANGE | 16:58 |
sshnaidm | mwhahaha, nope | 16:58 |
mwhahaha | which means it's been included somehow | 16:58 |
mwhahaha | we don't use that list to build the image | 16:58 |
mwhahaha | er package | 16:58 |
mwhahaha | we use it to include the installation | 16:59 |
sshnaidm | mwhahaha, delorean-curent is regular enabled repo, all packages from there will be installed with first "yum update" | 16:59 |
mwhahaha | yum update doesn't install | 16:59 |
mwhahaha | it would only update | 16:59 |
mwhahaha | so no, it doesn't take affect until it's been installed (via container or image) like i keep saying | 16:59 |
sshnaidm | mwhahaha, last time it was installed because it was a dependency | 16:59 |
mwhahaha | right so that is point at which is becomes included | 17:00 |
sshnaidm | mwhahaha, and dependency is usually the case as I can understand | 17:00 |
mwhahaha | so it shouldn't have landed as a dependency until it had tripleo ci jobs | 17:00 |
mwhahaha | so the issue is in the review of packaing dependency updates | 17:00 |
mwhahaha | and trying to solve this in oooq does not address the actual problem | 17:00 |
mwhahaha | so when it was added as an rpm dependency then it becomes "included in tripleo" | 17:01 |
mwhahaha | because then it becomes installed in the image or container | 17:01 |
mwhahaha | which then will cause it to be built/updated later via oooq | 17:01 |
mwhahaha | excluding it from the end of that process does not address the original issue | 17:02 |
sshnaidm | mwhahaha, agree, but I started to talk that we need to check if it's included in wildcards, so that it will be installed from current, not from promoted.. | 17:02 |
sshnaidm | mwhahaha, after it's part of tripleo etc, etc | 17:02 |
mwhahaha | if it's a tripleo umbrella package we always include it from current | 17:02 |
sshnaidm | mwhahaha, we need an appropriate wildcard in deloren-cureent repo file to include it | 17:03 |
sshnaidm | mwhahaha, like we have openstack-tripleo* | 17:03 |
sshnaidm | mwhahaha, but didn't have ansible-tripleo* | 17:03 |
mwhahaha | right | 17:03 |
mwhahaha | and there was a patch to address that | 17:03 |
sshnaidm | mwhahaha, and it should be part of process to check it | 17:03 |
mwhahaha | correct but then the discussion was that we shouldn't use wildcards | 17:04 |
mwhahaha | so yes there needs to be a single place we can refer to as a check list of things to do when adding a package | 17:04 |
mwhahaha | currently it's spread between rdo/tripleo/people's minds | 17:04 |
sshnaidm | mwhahaha, yeah, exactly | 17:04 |
weshay | ++ | 17:05 |
mwhahaha | but i don't think the correct thing to do is add places that will break and known things to change if we can avoid it | 17:05 |
mwhahaha | we need to reduce the amount of things required and improve the ability to add things on the fly | 17:05 |
mwhahaha | we shouldn't have to touch 10 repos to add a single project | 17:05 |
mwhahaha | which we currently have to do | 17:05 |
mwhahaha | i'm sure jillr can attest to the pain that is adding new stuff | 17:05 |
mwhahaha | so let's not add aditional stumbling blocks unless there is a really good reason | 17:06 |
*** shardy has quit IRC | 17:06 | |
*** moshele has quit IRC | 17:09 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 17:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 17:10 |
jillr | mwhahaha: +1 that pain, trying to catch up - apparently I missed cake, which is a travesty. can you tldr the important bits? | 17:12 |
jillr | I missed something with the ansible roles I think? | 17:12 |
jillr | though they arent packaged yet so hey still time to fix it! | 17:12 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Collect overcloud statistics with ARA https://review.openstack.org/578462 | 17:12 |
openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible https://review.openstack.org/589448 | 17:14 |
jillr | mwhahaha: I feel like I've read the whole convo, but I unfortunately dont grok what step I missed. :( | 17:15 |
jillr | I feel like there might be a review being referred to that I'm not seeing | 17:16 |
*** jfrancoa has quit IRC | 17:23 | |
*** khyr0n has joined #tripleo | 17:24 | |
mwhahaha | jillr: yea i don't think it's specifically anything you missed however you've been going through the larger process pain of adding new stuff and getting it integrated | 17:25 |
*** dtrainor has joined #tripleo | 17:25 | |
jillr | mwhahaha: ah ok gotcha. the cake does help with that at least. :) | 17:26 |
openstackgerrit | Aakarsh proposed openstack/tripleo-quickstart master: DNM: Testing browbeat's sysmetric collection https://review.openstack.org/595351 | 17:26 |
*** jrist has quit IRC | 17:26 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Revert "rocky is not yet promoted, adjust release file" https://review.openstack.org/595840 | 17:27 |
weshay | EmilienM, mwhahaha https://review.openstack.org/#/c/595840/ | 17:27 |
EmilienM | weshay: s/not/now/ | 17:28 |
EmilienM | :P | 17:28 |
* EmilienM +2 | 17:28 | |
EmilienM | weshay: so I think we can propose RC1 now | 17:28 |
EmilienM | if that patch pass and merges | 17:28 |
EmilienM | we have CI ready for stable/rocky (tm) | 17:28 |
*** holser_ has quit IRC | 17:28 | |
openstackgerrit | Goutham Pacha Ravi proposed openstack/tripleo-heat-templates master: Switch Manila API to httpd and support TLS https://review.openstack.org/594566 | 17:34 |
*** holser_ has joined #tripleo | 17:36 | |
weshay | ssbarnea|ruck, I think rdo is out of resources | 17:39 |
weshay | ssbarnea|ruck, I can't shit going either | 17:39 |
weshay | I can't get.. | 17:39 |
ssbarnea|ruck | weshay: ahh, well glad to hear it was not my lack of knowledge. still find weird to get a out of quote error if the cloud does not have resources. | 17:40 |
ssbarnea|ruck | maybe my personal plan of building my own private-home-cloud still makes sense | 17:41 |
weshay | ssbarnea|ruck, ya.. I want to do that too | 17:42 |
ssbarnea|ruck | i am still undercided about the storage part, I have a synology NAS with 4x 1GB ports, not upgradable to 10GbE. Either I get used to the idea of using 4GB, or I can attempt to build a AIO machine that does both storage and compute... bit risky. | 17:44 |
*** gbarros has quit IRC | 17:46 | |
ssbarnea|ruck | i suspect the same problem with rdo cloud: ovs, it failed on creating subnet, quota 20, used 1. | 17:46 |
*** dtantsur is now known as dtantsur|afk | 17:46 | |
*** kopecmartin has quit IRC | 17:47 | |
*** jrist has joined #tripleo | 17:48 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: allow tripleo-roles to be updated in ci https://review.openstack.org/594933 | 17:50 |
*** dsneddon has quit IRC | 17:52 | |
ssbarnea|ruck | mwhahaha ^^ please check it. | 17:52 |
*** dpeacock has quit IRC | 17:52 | |
*** dpeacock has joined #tripleo | 17:52 | |
openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui master: New regex for the FQDN that handles many subdomains and is also case insensitive. https://review.openstack.org/595847 | 17:52 |
*** holser_ has quit IRC | 17:53 | |
*** florianf has quit IRC | 17:53 | |
*** sshnaidm is now known as sshnaidm|off | 17:54 | |
*** tosky has quit IRC | 17:54 | |
*** weshay is now known as weshay|rover | 17:57 | |
*** trown is now known as trown|lunch | 17:59 | |
*** bogdando has quit IRC | 18:01 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: allow tripleo-roles to be updated in ci https://review.openstack.org/594933 | 18:05 |
openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui master: New regex for the FQDN that handles many subdomains and is also case insensitive. https://review.openstack.org/595847 | 18:07 |
*** dsneddon has joined #tripleo | 18:07 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 18:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 18:10 |
*** hjensas has joined #tripleo | 18:27 | |
*** noama has quit IRC | 18:27 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-heat-templates master: avoid unnecessary failure to delete a list of empty workflows https://review.openstack.org/595859 | 18:30 |
*** jcoufal_ has joined #tripleo | 18:30 | |
*** jcoufal has quit IRC | 18:32 | |
*** dxiri has joined #tripleo | 18:33 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: enable centos cr repo in featureset021, promotion jobs https://review.openstack.org/595862 | 18:34 |
weshay|rover | mwhahaha, EmilienM ^ RHEL 7.6 beta announced today | 18:34 |
weshay|rover | rlandy, rfolco please review to see if that makes sense to you guys | 18:34 |
weshay|rover | mwhahaha, just planning on using one job to test CentOS7.6 | 18:35 |
EmilienM | ok | 18:36 |
EmilienM | meh | 18:37 |
EmilienM | we need to release rc1 before this 7.6 hits us | 18:37 |
weshay|rover | EmilienM, you have a few weeks I'm sure | 18:40 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/4) https://review.openstack.org/582301 | 18:42 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnets to networks roles (4/4) https://review.openstack.org/595567 | 18:42 |
*** apetrich has quit IRC | 18:42 | |
EmilienM | I feel like I'm having concurrency issues with podman | 18:44 |
EmilienM | https://paste.fedoraproject.org/paste/WbcxV76hWyA08~SnnsmjNA | 18:44 |
EmilienM | "Error running ['podman', 'exec', '--user=root', u'nova_db_sync', '/usr/bin/bootstrap_host_exec', 'keystone', 'keystone-manage', 'bootstrap', '--bootstrap-password', 'PFEuKglKIzqI4nUoEWDy43PMl']. [125]", | 18:44 |
EmilienM | but I can reproduce it after a total cleanup so something is wrong | 18:45 |
EmilienM | I'm going to disable concurrency to see if that helped | 18:46 |
EmilienM | bandini, mandre: have you seen that in your early testing? | 18:46 |
dprince | EmilienM: what happens if you run that command manually now? | 18:48 |
dprince | EmilienM: that keystone-manage command is only executed once, on the bootstrap node | 18:48 |
EmilienM | dprince: see the command, it shouldn't run in the nova contianer | 18:49 |
*** mjturek has quit IRC | 18:49 | |
*** dxiri has quit IRC | 18:49 | |
dprince | EmilienM: I see keystone-manage there too though | 18:49 |
dprince | EmilienM: that is very weird | 18:49 |
EmilienM | yeah | 18:49 |
EmilienM | I'm redeploying with PROCESS_COUNT=1 | 18:50 |
EmilienM | if you look at logs, nova container was configured at same time | 18:50 |
dprince | EmilienM: paunch should run these commands individually. If it is a podman bug it would be evil | 18:50 |
*** pcaruana has joined #tripleo | 18:52 | |
*** trown|lunch is now known as trown | 19:01 | |
*** mjturek has joined #tripleo | 19:04 | |
*** pcaruana has quit IRC | 19:09 | |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 19:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 19:10 |
*** jrist has quit IRC | 19:10 | |
*** apetrich has joined #tripleo | 19:21 | |
*** jrist has joined #tripleo | 19:22 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 19:22 |
mwhahaha | itlinux, -^ fyi the 2nd example is a provider only network config | 19:23 |
itlinux | cool | 19:23 |
itlinux | this is with ooo | 19:24 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 19:24 |
mwhahaha | itlinux: it's with the standalone, but the general concept is the same | 19:24 |
itlinux | ok just wanted to check .. thanks | 19:25 |
mwhahaha | itlinux: most of the config is specific to the way you configure neutron after the fact. the standalone just has a basic neutron config that only uses a single bridge | 19:25 |
mwhahaha | flaper87: -^ since shardy pinged you earlier about by standalone network config paste you might also want to take a look at the examples | 19:26 |
itlinux | ok.. with HA I need to see how that can be achieved.. once I have a new lab I will check it out.. | 19:26 |
*** mjturek has quit IRC | 19:32 | |
*** assassin has joined #tripleo | 19:32 | |
openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: Update .gitreview for stable/rocky https://review.openstack.org/594261 | 19:35 |
openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky https://review.openstack.org/594262 | 19:35 |
*** ubijtsa has quit IRC | 19:35 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 19:36 |
*** mjturek has joined #tripleo | 19:38 | |
openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: Run emit_releases_file.py for all featuresets https://review.openstack.org/585649 | 19:43 |
bnemec | Any chance I could get reviews on the series starting at https://review.openstack.org/#/c/580524 ? | 19:43 |
bnemec | I'd prefer to get those landed this cycle since they add new interfaces to the puppet module and would be iffy to backport. | 19:43 |
bnemec | They're all pretty simple too. ;-) | 19:44 |
*** assassin has quit IRC | 19:46 | |
*** assassin has joined #tripleo | 19:47 | |
dprince | bnemec: boom | 19:47 |
bnemec | dprince: Thanks! | 19:47 |
*** dprince has quit IRC | 19:49 | |
itlinux | mwhahaha: looks good the https://review.openstack.org/#/c/595869/3 | 19:51 |
*** radeks has joined #tripleo | 19:56 | |
*** gbarros has joined #tripleo | 19:57 | |
*** jcoufal_ has quit IRC | 20:01 | |
*** mjturek has quit IRC | 20:01 | |
*** dsneddon has quit IRC | 20:02 | |
*** holser_ has joined #tripleo | 20:05 | |
*** panda has quit IRC | 20:05 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 20:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 20:10 |
*** radeks has quit IRC | 20:12 | |
*** radeks has joined #tripleo | 20:12 | |
openstackgerrit | Carlos Camacho proposed openstack/python-tripleoclient master: Give priority to the custom container images file if used https://review.openstack.org/595817 | 20:12 |
*** jcoufal has joined #tripleo | 20:13 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: IHA Default the compute endpoint check script to internal https://review.openstack.org/595558 | 20:16 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Integrate Validate-HA work into OVB jobs https://review.openstack.org/537669 | 20:16 |
*** dsneddon has joined #tripleo | 20:23 | |
*** raildo has quit IRC | 20:23 | |
*** mjturek has joined #tripleo | 20:26 | |
*** lblanchard has joined #tripleo | 20:33 | |
*** gbarros has quit IRC | 20:34 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 20:35 |
flaper87 | mwhahaha: checking, thanks! | 20:37 |
*** holser_ has quit IRC | 20:47 | |
*** hamzy has quit IRC | 20:48 | |
*** gbarros has joined #tripleo | 20:51 | |
*** jcoufal has quit IRC | 20:59 | |
*** trown is now known as trown|outtypewww | 21:03 | |
*** lblanchard has quit IRC | 21:04 | |
*** mjturek has quit IRC | 21:05 | |
*** rh-jelabarre has quit IRC | 21:09 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 21:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 21:10 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Avoid local working dir task failure on local without sudo https://review.openstack.org/571180 | 21:11 |
*** gbarros has quit IRC | 21:15 | |
*** trozet has quit IRC | 21:19 | |
*** owalsh_ has joined #tripleo | 21:22 | |
*** thrash is now known as thrash|g0ne | 21:22 | |
mwhahaha | weshay|rover: so the rocky job passed on https://review.openstack.org/#/c/595840/ doesa that mean it's good to go? | 21:25 |
*** owalsh has quit IRC | 21:25 | |
*** owalsh_ has quit IRC | 21:26 | |
*** owalsh has joined #tripleo | 21:27 | |
*** radeks has quit IRC | 21:28 | |
*** panda has joined #tripleo | 21:34 | |
*** rcernin has joined #tripleo | 21:46 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 21:47 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 21:47 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 21:48 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 21:48 |
*** sri_ has quit IRC | 21:49 | |
*** sri_ has joined #tripleo | 21:50 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 21:58 |
openstackgerrit | Merged openstack/puppet-tripleo master: Make Designate pools.yaml configurable https://review.openstack.org/580524 | 22:00 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 22:07 |
openstackgerrit | Merged openstack/puppet-tripleo master: Only run designate pool update on bootstrap node https://review.openstack.org/581899 | 22:08 |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 22:10 |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 22:10 |
openstackgerrit | Merged openstack/puppet-tripleo master: Enable configuration of rndc controls https://review.openstack.org/581900 | 22:10 |
openstackgerrit | Merged openstack/puppet-tripleo master: Allow specifying an rndc key https://review.openstack.org/583658 | 22:11 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 22:16 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/queens: IHA Default the compute endpoint check script to internal https://review.openstack.org/595903 | 22:18 |
*** owalsh has quit IRC | 22:18 | |
*** owalsh has joined #tripleo | 22:22 | |
*** paramite|clone has quit IRC | 22:27 | |
*** dhill_ has quit IRC | 22:32 | |
*** ssbarnea|ruck has quit IRC | 22:41 | |
*** boazel has quit IRC | 22:42 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add container prepare step to Standalone https://review.openstack.org/595908 | 22:44 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 22:44 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 22:45 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add container prepare step to Standalone https://review.openstack.org/595908 | 22:46 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 22:46 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 22:46 |
*** sri_ has quit IRC | 22:47 | |
*** sri_ has joined #tripleo | 22:47 | |
*** zaneb has quit IRC | 22:48 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add container prepare step to Standalone https://review.openstack.org/595908 | 22:52 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 22:52 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 22:52 |
*** threestrands has joined #tripleo | 22:53 | |
* mwhahaha stops messing with docs and wanders off | 22:54 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Include minimal Browbeat playbook in baremetal playbook https://review.openstack.org/581488 | 23:01 |
weshay|rover | mwhahaha, http://logs.openstack.org/40/595840/1/check/tripleo-ci-centos-7-containers-multinode-rocky/6ca9ab4/logs/undercloud/etc/yum.repos.d/delorean.repo.txt.gz | 23:06 |
weshay|rover | EmilienM, ^ | 23:06 |
weshay|rover | that looks good | 23:06 |
weshay|rover | master looks good | 23:06 |
weshay|rover | wf +1 | 23:07 |
mwhahaha | K | 23:07 |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 23:10 |
openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 23:10 |
*** sri_ has quit IRC | 23:14 | |
*** sri_ has joined #tripleo | 23:15 | |
*** sri_ has quit IRC | 23:16 | |
*** sri_ has joined #tripleo | 23:16 | |
*** hamzy has joined #tripleo | 23:18 | |
*** sri_ has quit IRC | 23:21 | |
*** sri_ has joined #tripleo | 23:21 | |
*** rlandy is now known as rlandy|brb | 23:24 | |
*** tbonds has quit IRC | 23:27 | |
*** tbonds has joined #tripleo | 23:29 | |
*** sri_ has quit IRC | 23:37 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!