| *** rlandy has quit IRC | 00:19 | |
| *** jmasud has quit IRC | 00:44 | |
| *** jmasud has joined #oooq | 00:44 | |
| *** jmasud has quit IRC | 01:32 | |
| *** apetrich has quit IRC | 02:09 | |
| *** jmasud has joined #oooq | 02:54 | |
| *** jmasud has quit IRC | 03:31 | |
| *** skramaja has joined #oooq | 04:05 | |
| *** ykarel|away is now known as ykarel | 04:21 | |
| *** ratailor has joined #oooq | 04:31 | |
| *** jmasud has joined #oooq | 04:34 | |
| *** udesale has joined #oooq | 04:41 | |
| *** jmasud has quit IRC | 05:01 | |
| *** jmasud has joined #oooq | 05:19 | |
| *** ysandeep|away is now known as ysandeep | 05:42 | |
| *** jmasud has quit IRC | 06:03 | |
| *** jfrancoa has joined #oooq | 06:05 | |
| *** jfrancoa has quit IRC | 06:06 | |
| *** jfrancoa has joined #oooq | 06:09 | |
| *** marios has joined #oooq | 06:12 | |
| *** bogdando has joined #oooq | 06:28 | |
| *** bogdando has quit IRC | 06:35 | |
| *** bogdando has joined #oooq | 06:37 | |
| *** bogdando has quit IRC | 06:42 | |
| *** bogdando has joined #oooq | 06:50 | |
| *** saneax has joined #oooq | 06:53 | |
| *** bogdando has quit IRC | 06:54 | |
| *** ccamacho has joined #oooq | 07:18 | |
| *** amoralej|off is now known as amoralej | 07:27 | |
| *** tosky has joined #oooq | 07:31 | |
| *** holser has joined #oooq | 07:31 | |
| *** ysandeep is now known as ysandeep|lunch | 07:50 | |
| *** jpena|off is now known as jpena | 07:55 | |
| *** panda has quit IRC | 07:59 | |
| *** pojadhav is now known as pojadhav|lunch | 08:01 | |
| *** panda has joined #oooq | 08:02 | |
| chem | marios: hey, good morning :) | 08:20 |
|---|---|---|
| marios | chem: o/ morning | 08:21 |
| chem | marios: so every downstream update jobs are going to fail because https://review.opendev.org/#/c/724782/ cannot merged because https://review.opendev.org/#/c/726008/1 cannot merge because podman_container role doesn't exist in train (certainly ?) | 08:22 |
| chem | marios: what can we do https://bugs.launchpad.net/tripleo/+bug/1876893 ? | 08:22 |
| openstack | Launchpad bug 1876893 in tripleo "Error: error removing container - device or resource busy" [Critical,In progress] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 08:22 |
| marios | chem: looking | 08:22 |
| chem | marios: thanks | 08:26 |
| *** chem is now known as chem|afk | 08:27 | |
| marios | chem|afk: i mean i see it in train https://opendev.org/openstack/tripleo-ansible/src/branch/stable/train/tripleo_ansible/ansible_plugins/modules/podman_container.py | 08:27 |
| marios | chem|afk: hmmm i wonder if this is another case of - vs _ | 08:37 |
| *** ysandeep|lunch is now known as ysandeep | 08:44 | |
| *** bogdando has joined #oooq | 08:50 | |
| *** chem|afk is now known as chem | 08:57 | |
| *** jtomasek has joined #oooq | 08:59 | |
| *** ykarel is now known as ykarel|lunch | 09:01 | |
| chem | marios: hum ... - vs _ doesn't seem to apply here | 09:02 |
| marios | chem: commented at https://review.opendev.org/#/c/726008/1/tripleo_ansible/roles/tripleo-container-rm/tasks/tripleo_podman_container_rm.yml we could try to unblock by reverting just that part of the review into a separate patch and fix it there | 09:03 |
| marios | chem: yeah the - _ was a red herring i was looking at the job definition and thought it was related | 09:03 |
| marios | chem: those jobs only exist on train branch so its even more confusing | 09:03 |
| chem | marios: I've replied, but basically that patch is supposed to be a fix for an error that happens without it, so "revert" is not a option | 09:09 |
| marios | chem: if we can't do that i.e. revert just that part cos of the bug (theres a lot of context and i haven't been part of it looks like weshay|ruck sshnaidm|afk were mostly looking there so far and today is new ruck|rover day) then we will just have to consider making the job non voting and working out the module issue as another bug | 09:09 |
| marios | chem: yeaeh this is what i was worried about so... ^ | 09:09 |
| chem | marios: but I'm really surprised that we're using ansible module instead of paunch in train ci. | 09:10 |
| chem | marios: downstream default is paunch | 09:10 |
| *** pojadhav|lunch is now known as pojadhav | 09:10 | |
| marios | chem: well you mean podman_container module? its part of tripleo-ansible so in general they want to move away from pauch and have that instead | 09:10 |
| marios | chem: i guess ? | 09:11 |
| chem | marios: I'm not familiar enough with jobs definition, but I believe we're including disable-paunch.yaml environment file somewhere here | 09:11 |
| chem | marios: that stuff https://github.com/openstack/tripleo-heat-templates/blob/stable/train/environments/disable-paunch.yaml#L5..L7 | 09:11 |
| marios | chem: job definition is in zuul.d/molecule on train tripleo-ansible | 09:11 |
| marios | chem: ack so that's good right i mean they don't want to use paunch | 09:12 |
| chem | marios: why ? it's the default downstream | 09:12 |
| chem | marios: for train | 09:13 |
| marios | chem: but that's upstream | 09:13 |
| chem | marios: hehehe, oki. It's just that testing somethnig that isn't used downstream by default isn't that useful to *me* but then, who am I to complain about my poor fate :) | 09:14 |
| marios | chem: if you're saying it's missing backports i can't see something obvious missing comparign train/master tripleo-ansible | 09:14 |
| chem | marios: I really don't know because ... I mainly downstream so my entire world is paunch :) | 09:15 |
| marios | chem: in this particular case its about testing tripleo-ansible which i don't if it's used downstream | 09:18 |
| *** dtantsur|afk is now known as dtantsur | 09:18 | |
| chem | marios: it is, for sure. | 09:18 |
| chem | marios: all over the place | 09:18 |
| marios | chem: yeah :/ | 09:19 |
| marios | chem: sorry | 09:19 |
| marios | chem: like invoked via tht in most places now | 09:19 |
| chem | marios: right | 09:19 |
| marios | chem: then where is it defaulting to paunch still? | 09:19 |
| marios | chem: like via tht or via client or what? | 09:19 |
| chem | marios: I think the upstream ci must include the env file I mentionned earlier at some point of the job definition | 09:20 |
| marios | chem: don't see it in the job definition https://opendev.org/openstack/tripleo-ansible/src/branch/stable/train/zuul.d/molecule.yaml#L169 or the parent https://opendev.org/openstack/tripleo-ansible/src/branch/stable/train/zuul.d/base.yaml | 09:25 |
| chem | marios: what is zuul.d/playbooks/run.yml ? | 09:27 |
| chem | marios: basically where do we build the "deploy.sh" command ? | 09:27 |
| marios | chem: that's a molecule test the run is there https://opendev.org/openstack/tripleo-ansible/src/branch/stable/train/zuul.d/playbooks/run.yml | 09:29 |
| marios | chem: the tripleo-ansible team wrote and manages these tests so i'm not too familiar with them, but what are you looking for ? i don't think there will be a deployment in the traditional sense not for that job | 09:29 |
| chem | marios: hum this is undercloud upgrade, so the only way to include that file would be to use an custom_env_file in undercloud.conf and it's not the case, so maybe I'm just saying non-sense here | 09:30 |
| chem | https://zuul.opendev.org/t/openstack/build/26de0d3e01544542b26caaeda8459277/log/logs/undercloud/home/zuul/undercloud.conf | 09:30 |
| marios | chem: i'm referring to the failing tripleo-ansible-centos-7-molecule-tripleo-container-rm | 09:30 |
| chem | marios: yeah, but that's the same job | 09:31 |
| marios | chem: those jobs are not deploying anything i mean look at the run times 8/12 mins | 09:31 |
| chem | marios: oki, I'm mixing things up here, sorry, right those jobs are something else entirely | 09:33 |
| marios | chem: the converge etc is defined in there for those if you want to dig more https://opendev.org/openstack/tripleo-ansible/src/branch/stable/train/tripleo_ansible/roles/tripleo-container-rm/molecule | 09:33 |
| chem | marios: I've never did any molecule testing ... I'll just be patient here :) | 09:35 |
| chem | marios: I'll raise another issue for discussion about diff in deployment for paunch/ansible in upstream-stein/osp16 testing, because it's kinda unrelated | 09:36 |
| chem | marios: and maybe it's the default for the undercloud, need to double check now ... | 09:37 |
| chem | nope downstream has paunch all over the place | 09:38 |
| chem | I'll ask EmilienM|afk what is the expected "default" for the product | 09:39 |
| chem | maybe it's the downstream which is wrong :) | 09:39 |
| *** irclogbot_3 has quit IRC | 09:41 | |
| *** irclogbot_1 has joined #oooq | 09:41 | |
| chem | marios++ thanks for the support in any case :) | 09:41 |
| *** jtomasek has quit IRC | 09:43 | |
| sshnaidm|afk | btw we have https://review.opendev.org/#/c/726003/ | 09:44 |
| *** sshnaidm|afk is now known as sshnaidm | 09:44 | |
| *** apetrich has joined #oooq | 09:44 | |
| *** ykarel|lunch is now known as ykarel | 09:44 | |
| marios | chem: :/ didn't do much but its a very convulted issue... we don't own those jobs, they are only on train, and the actual blocker is a different job alltogether... as i said, cos its molecule we will likely end up skipping that | 09:45 |
| *** jtomasek has joined #oooq | 09:45 | |
| marios | sshnaidm: ack... chem did you see weshay|ruck posted https://review.opendev.org/#/c/726003/1/zuul.d/layout.yaml but surely it should be the other way around sshnaidm ? | 09:46 |
| chem | marios: whatever works as would say Woody Allen :) | 09:46 |
| marios | sshnaidm: like lets make the molecule one non voting in order to fix the undercloud upgrade job | 09:46 |
| marios | not the other way around... | 09:46 |
| sshnaidm | I'm looking now into molecule failure | 09:47 |
| chem | marios: sshnaidm if we are able to unlock without merging the nv all the better :) | 09:48 |
| * chem goes back into his downstream rabbit hole | 09:49 | |
| sshnaidm | yeah, it passed in master, but surprisingly doesn't find module on train, checking.. | 09:50 |
| *** jmasud has joined #oooq | 09:51 | |
| marios | sshnaidm: jobs are only defined for train | 09:53 |
| marios | sshnaidm: it was really confusing to dig into | 09:53 |
| marios | sshnaidm: i mean that failing molecule job | 09:53 |
| sshnaidm | marios, tripleo-ansible-centos-8-molecule-tripleo_container_rm ? | 09:55 |
| sshnaidm | in train it's tripleo-ansible-centos-7-molecule-tripleo-container-rm | 09:55 |
| marios | sshnaidm: yeah i can't find it at master | 09:56 |
| marios | sshnaidm: oh i see :) centos8 for master ack | 09:56 |
| marios | sshnaidm: well it's a different job so that still holds ;) 12:53 < marios> sshnaidm: jobs are only defined for train | 09:56 |
| sshnaidm | ok, found the problem.. | 09:59 |
| *** jtomasek has quit IRC | 10:04 | |
| sshnaidm | arxcruz, chandankumar ptal https://review.opendev.org/#/c/725066/ | 10:08 |
| *** jtomasek has joined #oooq | 10:12 | |
| *** jmasud has quit IRC | 10:16 | |
| *** skramaja has quit IRC | 10:16 | |
| *** skramaja has joined #oooq | 10:16 | |
| *** holser has quit IRC | 10:17 | |
| *** jtomasek has quit IRC | 10:17 | |
| *** jtomasek has joined #oooq | 10:18 | |
| *** holser has joined #oooq | 10:19 | |
| *** jmasud has joined #oooq | 10:19 | |
| *** derekh has joined #oooq | 10:21 | |
| chandankumar | sshnaidm, please have a look when free https://review.rdoproject.org/r/#/q/topic:tobuildflag+(status:open+OR+status:merged) | 10:29 |
| *** jmasud has quit IRC | 10:34 | |
| sshnaidm | chandankumar, what is the purpose of fs02 in master? | 10:39 |
| chandankumar | sshnaidm, the goal was to build the image with in the job and test it | 10:40 |
| chandankumar | so that we donot get any corrupted images on the image server where some directories got missing | 10:40 |
| sshnaidm | chandankumar, but it's not going to upload this image? | 10:40 |
| chandankumar | sshnaidm, yes, it is going to upload the image, the image will be built and tested | 10:41 |
| chandankumar | with in the job | 10:41 |
| sshnaidm | chandankumar, I mean uploading to images server | 10:41 |
| sshnaidm | chandankumar, you have it "false": https://review.rdoproject.org/r/#/c/27289/4/zuul.d/ovb-jobs.yaml | 10:42 |
| chandankumar | sshnaidm, it is not going to upload the image | 10:42 |
| sshnaidm | chandankumar, we could use 035 for that tbh | 10:42 |
| chandankumar | sshnaidm, ok, then, let me take a look at fs035 | 10:43 |
| sshnaidm | nevermind, we can do this too | 10:43 |
| *** ysandeep is now known as ysandeep|brb | 10:57 | |
| *** ysandeep|brb is now known as ysandeep | 11:10 | |
| *** skramaja has quit IRC | 11:27 | |
| *** skramaja has joined #oooq | 11:27 | |
| weshay|ruck | akahat, give me 3 min :) | 11:30 |
| akahat | weshay|ruck, okay. | 11:31 |
| *** jpena is now known as jpena|lunch | 11:32 | |
| weshay|ruck | akahat, https://hackmd.io/sn48EeOoRjWNzvtV9IudxQ?both | 11:40 |
| *** ysandeep is now known as ysandeep|afk | 11:48 | |
| rfolco|rover | arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 11:52 |
| rfolco|rover | ping virtual training starting in 7 min | 11:52 |
| rfolco|rover | pls join early | 11:52 |
| rfolco|rover | https://meet.google.com/fgn-rnkp-sqt | 11:53 |
| weshay|ruck | sshnaidm++ | 11:55 |
| rfolco|rover | arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 11:59 |
| rfolco|rover | ping we are starting now | 11:59 |
| *** ysandeep|afk is now known as ysandeep | 12:00 | |
| *** rlandy has joined #oooq | 12:02 | |
| rfolco|rover | panda, remind me to stop recording and start a new one on your presentation | 12:05 |
| *** amoralej is now known as amoralej|lunch | 12:05 | |
| rfolco|rover | marios, 15 min passed (half) | 12:16 |
| panda | rfolco|rover: sure | 12:18 |
| panda | rfolco|rover: remember to stop recording. | 12:34 |
| panda | rfolco|rover: remember to stop recording. | 12:34 |
| panda | rfolco|rover: remember to stop recording. | 12:34 |
| panda | rfolco|rover: remember to stop recording. | 12:35 |
| *** Goneri has joined #oooq | 12:37 | |
| *** jpena|lunch is now known as jpena | 12:38 | |
| *** udesale_ has joined #oooq | 12:40 | |
| *** ratailor has quit IRC | 12:42 | |
| *** ratailor has joined #oooq | 12:43 | |
| *** udesale has quit IRC | 12:43 | |
| *** bogdando_ has joined #oooq | 12:43 | |
| *** bogdando has quit IRC | 12:45 | |
| *** bogdando_ is now known as bogdando | 12:45 | |
| *** chem has quit IRC | 12:48 | |
| *** bogdando has quit IRC | 12:49 | |
| *** bogdando has joined #oooq | 12:49 | |
| *** skramaja has quit IRC | 12:50 | |
| *** chem has joined #oooq | 12:50 | |
| *** bogdando has quit IRC | 12:54 | |
| *** ratailor has quit IRC | 12:56 | |
| *** bogdando has joined #oooq | 12:56 | |
| *** bogdando_ has joined #oooq | 12:59 | |
| *** bogdando has quit IRC | 13:01 | |
| rfolco|rover | panda, we are on top of hour, maybe you can wrap up the introduction, we can resume this next week if you still have slides to cover..... or extend more 10 min (steal from planning mtg) if weshay|ruck agrees | 13:02 |
| *** bogdando has joined #oooq | 13:03 | |
| weshay|ruck | rfolco|rover, we can let him go.. planning should be shorter than usual imho | 13:03 |
| rfolco|rover | great | 13:03 |
| rfolco|rover | thx weshay|ruck | 13:03 |
| *** bogdando_ has quit IRC | 13:04 | |
| *** ykarel is now known as ykarel|afk | 13:05 | |
| *** bogdando has quit IRC | 13:07 | |
| rfolco|rover | arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 13:12 |
| rfolco|rover | ping planning mtg | 13:12 |
| rfolco|rover | https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw | 13:12 |
| rfolco|rover | https://meet.google.com/tbr-rgjz-cjc | 13:12 |
| *** amoralej|lunch is now known as amoralej | 13:15 | |
| arxcruz | chandankumar: https://review.opendev.org/#/c/725878 | 13:28 |
| *** TrevorV has joined #oooq | 13:32 | |
| *** jtomasek has quit IRC | 13:45 | |
| *** ykarel|afk is now known as ykarel | 14:07 | |
| *** bogdando has joined #oooq | 14:09 | |
| panda | rfolco|rover: U sure usssuri is pronounced Usurey ? | 14:09 |
| rfolco|rover | panda, my bad, its uzuri ? | 14:09 |
| rfolco|rover | usery | 14:10 |
| rfolco|rover | misery | 14:10 |
| panda | rfolco|rover: oo-soo-ree | 14:10 |
| rfolco|rover | panda, ok so the diff is soo | 14:10 |
| panda | soo the difference is | 14:10 |
| rfolco|rover | soo diffrent | 14:11 |
| rfolco|rover | arxcruz, muted you, siren is there? | 14:12 |
| arxcruz | rfolco|rover: i live in a place full of old people, there are sirens all day along sorry | 14:13 |
| rfolco|rover | ...says the "young guy" | 14:14 |
| arxcruz | rfolco|rover: there are two seniorenhaus here (builds where only retired people lives) | 14:15 |
| rfolco|rover | marios, panda: my reaction to your presentations... https://michaelpiff.files.wordpress.com/2015/07/weebae-ohhh.gif?w=680 | 14:16 |
| rfolco|rover | arxcruz, got it | 14:16 |
| panda | rfolco|rover: and I wasn't even naked. | 14:16 |
| rfolco|rover | marios, please add the slides to https://hackmd.io/OXNWWIShSBaPXPC8d7kFgQ, or give me the link pls | 14:16 |
| rlandy | jpena: hi ... got a failure reporting to dlrn downstream for one test but works fine for another - can you see what I am missing (will post links in pvt) | 14:19 |
| jpena | rlandy: sure, let me check | 14:20 |
| panda | pojadhav: akahat soniya29 ysandeep: when I'm back on monday I'm expecting to see at least 2000 question from each of you on the introduction to testing. Thanks. | 14:26 |
| ysandeep | panda, :) o/ sure .. will try for 2001 Q | 14:27 |
| pojadhav | panda, sure :) | 14:28 |
| panda | ysandeep: yeah! already surpass the expectations. | 14:28 |
| ysandeep | rlandy marios please invite me too for internal component sync, whenever you schedule , thank you! :) | 14:29 |
| *** tosky_ has joined #oooq | 14:29 | |
| rlandy | ysandeep: sure | 14:29 |
| ysandeep | :) thanks | 14:32 |
| *** tosky has quit IRC | 14:32 | |
| *** ysandeep is now known as ysandeep|afk | 14:33 | |
| *** pojadhav is now known as pojadhav|afk | 14:33 | |
| rlandy | marios: k - so I can get by the install if I use the candidate only repo | 14:34 |
| rlandy | looking at standalone failure now | 14:34 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/89/198789/17/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/5164055/logs/undercloud/home/zuul/standalone_deploy.log | 14:34 |
| *** dsneddon has quit IRC | 14:36 | |
| *** panda is now known as panda|pto | 14:42 | |
| marios | rlandy: (ack in pvt) | 14:42 |
| weshay|ruck | https://hackmd.io/2MdkNAUuT7aBcM0Yck4xnw | 14:43 |
| *** jtomasek has joined #oooq | 14:50 | |
| ykarel | rlandy, i have seen similar error as the above deploy.log | 15:01 |
| ykarel | that happens when old python six is used with some newver version of urllib3 | 15:02 |
| rlandy | ykarel: really? i suspected it was a urllib3 issue | 15:02 |
| rlandy | ykarel: so python six needs an update? | 15:02 |
| ykarel | rlandy, yeap | 15:02 |
| rlandy | ykarel: thanks - checking versions | 15:02 |
| ykarel | python six should be available in osp 17 | 15:02 |
| ykarel | so just update should work | 15:03 |
| rlandy | ykarel: deps in osp is a whole story unto itself :( | 15:03 |
| ykarel | rlandy, fyi we also hit similar issue in one of our job and fixed with update https://review.rdoproject.org/r/#/c/27197/ | 15:04 |
| *** tosky_ is now known as tosky | 15:04 | |
| rlandy | toplink/vol/rhel-8/packages/python-six/1.12.0/1.el8ost/noarch/python3-six-1.12.0-1.el8ost.noarch.rpm | 15:04 |
| *** marios is now known as marios|afk | 15:05 | |
| rlandy | k - let me try that | 15:05 |
| rlandy | thank you | 15:05 |
| *** matbu has quit IRC | 15:08 | |
| *** matbu has joined #oooq | 15:10 | |
| *** jtomasek has quit IRC | 15:10 | |
| ykarel | ack, we have 1.14 in RDO that worked, 1.12.0 should also work but not tried | 15:11 |
| rlandy | ykarel++ - that seemed to work | 15:34 |
| *** marios|afk is now known as marios | 15:45 | |
| ykarel | rlandy, ack | 15:47 |
| weshay|ruck | rlandy, where is the change that was made to tempest to increase the network timeout on ssl calls? | 15:53 |
| rlandy | weshay|ruck: https://review.opendev.org/#/c/706288/33/zuul.d/standalone-jobs.yaml line 867 | 15:57 |
| weshay|ruck | tempest_tempest_conf_overrides: | 15:58 |
| weshay|ruck | service-clients.http_timeout: '120' | 15:58 |
| weshay|ruck | rhanks! | 15:58 |
| weshay|ruck | I think 039 may be failing due to that | 15:58 |
| *** ykarel is now known as ykarel|away | 16:07 | |
| *** dtantsur is now known as dtantsur|afk | 16:28 | |
| *** pojadhav|afk is now known as pojadhav | 16:28 | |
| rfolco|rover | weshay|ruck, I am probably confusing bugs | 16:33 |
| rfolco|rover | weshay|ruck, whats tempest bug ? | 16:33 |
| chandankumar | rfolco|rover, weshay|ruck https://review.opendev.org/#/c/725858/ gates are clear now except podman issue i think | 16:34 |
| rfolco|rover | arxcruz, what is the tempest bug ? | 16:35 |
| chandankumar | rfolco|rover, you are looking at https://bugs.launchpad.net/tripleo/+bug/1877230/comments/1 | 16:36 |
| openstack | Launchpad bug 1877230 in tripleo "https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar doesn't exist (anymore?)" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 16:36 |
| rfolco|rover | chandankumar, yes, it failed last time, so looking at the logs | 16:37 |
| chandankumar | rfolco|rover, now it is gone, https://review.rdoproject.org/zuul/build/6db681503ed34b2aac602d6cc070af06 from last run | 16:37 |
| chandankumar | rfolco|rover, https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-containers-build-push/2f4729e/logs/containers-failed-to-build.log you need a bug for this one | 16:38 |
| rfolco|rover | https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master&job_name=periodic-tripleo-centos-8-master-containers-build-push | 16:38 |
| rfolco|rover | failed, worked, failed again | 16:38 |
| rfolco|rover | yep chandankumar | 16:39 |
| chandankumar | https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-containers-build-push/2f4729e/logs/buildah-builds/kolla-builds/e82753f4-06b3-446d-8002-c1a2e2ba2c49/docker/neutron/neutron-openvswitch-agent/neutron-openvswitch-agent-build.log | 16:39 |
| chandankumar | Failed to download metadata for repo 'advanced-virtualization' | 16:39 |
| chandankumar | may be mirror issue | 16:39 |
| *** sshnaidm is now known as sshnaidm|afk | 16:46 | |
| *** bogdando has quit IRC | 16:46 | |
| rfolco|rover | chandankumar, https://bugs.launchpad.net/tripleo/+bug/1877416 | 16:48 |
| openstack | Launchpad bug 1877416 in tripleo "periodic-tripleo-centos-8-buildimage-overcloud-full-master failed to build 3 containers" [Critical,Triaged] | 16:48 |
| *** udesale_ has quit IRC | 16:52 | |
| *** derekh has quit IRC | 16:53 | |
| chandankumar | rfolco|rover, it is container build not image build, title needs to be corrected | 16:56 |
| rfolco|rover | chandankumar, oops copy/paste :( | 16:57 |
| rfolco|rover | fixed | 16:57 |
| *** jpena is now known as jpena|off | 17:15 | |
| *** marios has quit IRC | 17:16 | |
| rlandy | weshay|ruck: fixing the standalone error - will rerun | 17:20 |
| *** pojadhav is now known as pojadhav|away | 17:21 | |
| rfolco|rover | weshay|ruck, arxcruz hope this is the right job to reproduce/look at | 17:25 |
| rfolco|rover | https://review.rdoproject.org/r/#/c/27349/ | 17:25 |
| *** amoralej is now known as amoralej|off | 17:28 | |
| *** rfolco|rover has quit IRC | 17:40 | |
| *** rfolco has joined #oooq | 17:42 | |
| *** jbadiapa has quit IRC | 17:42 | |
| *** rfolco is now known as rfolco|rover | 17:46 | |
| *** ccamacho has quit IRC | 17:51 | |
| weshay|ruck | rfolco|rover, ya.. looking for queens too.. but that should be fine for now | 17:55 |
| rfolco|rover | weshay|ruck, ok fs010 is what arxcruz used I assume | 17:56 |
| weshay|ruck | rfolco|rover, aye | 17:57 |
| rfolco|rover | weshay|ruck, I started w/ wrong job, asked jpena to hold vm, now he is off and I am trying to ping nhicher to fix it, hold the new one | 17:57 |
| rlandy | walk ... biab | 18:07 |
| *** rlandy is now known as rlandy|biab | 18:07 | |
| chandankumar | weshay|ruck, quick merge https://review.rdoproject.org/r/#/c/27363/ | 18:29 |
| weshay|ruck | chandankumar, done | 18:30 |
| chandankumar | weshay|ruck, thanks, I will work on cleaning up rhel8 based from third party jobs tomorrow | 18:31 |
| chandankumar | and put some readme there | 18:31 |
| weshay|ruck | +1 | 18:31 |
| weshay|ruck | chandankumar, the fix for undercloud-upgrades merged.. waiting to see if it's truly fixed | 18:31 |
| chandankumar | cool | 18:32 |
| weshay|ruck | chandankumar, did I put this in the right place? https://review.opendev.org/726220 | 18:35 |
| chandankumar | weshay|ruck, you need to use this one tempest_tempest_conf_overrides | 18:37 |
| weshay|ruck | ah k | 18:38 |
| chandankumar | weshay|ruck, https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset001.yml#L190 | 18:38 |
| weshay|ruck | thanks! | 18:38 |
| *** rlandy|biab is now known as rlandy | 18:39 | |
| chandankumar | weshay|ruck, https://review.rdoproject.org/zuul/status/change/5331,1ce221295082f22abd97eb0999d4f7b256b9e7f0 now it looks good | 18:39 |
| weshay|ruck | +1 | 18:40 |
| chandankumar | rlandy, weshay|ruck https://review.rdoproject.org/r/#/q/topic:tobuildflag+(status:open+OR+status:merged) few more reviews | 18:42 |
| rlandy | k | 18:42 |
| *** saneax has quit IRC | 18:44 | |
| *** saneax has joined #oooq | 18:44 | |
| weshay|ruck | chandankumar, which job uploads the image? | 18:45 |
| weshay|ruck | see my comment | 18:45 |
| chandankumar | weshay|ruck, https://review.rdoproject.org/r/27342 will turn off the image upload to toci testing repo | 18:47 |
| chandankumar | *toci testing | 18:47 |
| chandankumar | weshay|ruck, then I need to rename the job | 18:48 |
| chandankumar | weshay|ruck, I will rename it | 18:48 |
| weshay|ruck | chandankumar, sorry | 18:48 |
| weshay|ruck | rfolco|rover, https://review.opendev.org/726224 | 18:50 |
| weshay|ruck | rfolco|rover, you good? need anything | 18:50 |
| rfolco|rover | weshay|ruck, good | 18:50 |
| chandankumar | weshay|ruck, https://review.rdoproject.org/r/#/q/topic:tobuildflag+(status:open+OR+status:merged) removed -upload from job name | 18:51 |
| weshay|ruck | thanks done | 18:53 |
| *** jmasud has joined #oooq | 18:58 | |
| chandankumar | weshay|ruck, can you take a look at marios comment on this review https://review.opendev.org/#/c/720776/ ? | 19:01 |
| weshay|ruck | chandankumar, ya.. I think marios's comment afaict.. is reaffirming using release rather than distro | 19:02 |
| weshay|ruck | to determine using a md5sum agg or dlrn_hash | 19:02 |
| weshay|ruck | chandankumar, just manually tested the failing molecule.. I think it should pass now | 19:02 |
| chandankumar | weshay|ruck, aye thanks! | 19:03 |
| weshay|ruck | chandankumar, we can clean up the commit message on the parent I think | 19:03 |
| weshay|ruck | lots of stuff merged | 19:03 |
| chandankumar | yes | 19:03 |
| chandankumar | that would be good | 19:03 |
| weshay|ruck | that could be breaking the dlrn build | 19:04 |
| *** jmasud has quit IRC | 19:10 | |
| weshay|ruck | rlandy, when you have a sec | 19:13 |
| weshay|ruck | https://review.opendev.org/#/c/726224/ | 19:13 |
| rlandy | looking | 19:14 |
| weshay|ruck | thanks | 19:16 |
| weshay|ruck | rfolco|rover, can you put my and bhagyarhi's keys on https://review.rdoproject.org/r/#/c/27349/ nodes | 19:17 |
| weshay|ruck | https://github.com/weshayutin.keys | 19:17 |
| weshay|ruck | meh.. empty here https://github.com/Bhagyashribs.keys | 19:18 |
| chandankumar | weshay|ruck, https://github.com/bshewale.keys but still empty | 19:19 |
| *** dpawlik has quit IRC | 19:23 | |
| weshay|ruck | rlandy, you sure about rm osptrunk-deps.repo? | 19:26 |
| weshay|ruck | rhos-release {{ rhos_release_args }} | 19:26 |
| weshay|ruck | sudo rm -rf /etc/yum.repos.d/rhos-release-17.repo | 19:26 |
| weshay|ruck | sudo rm -rf /etc/yum.repos.d/osptrunk-deps.repo | 19:26 |
| weshay|ruck | https://code.engineering.redhat.com/gerrit/#/c/199471/16/config/release/rhos-17-periodic.yml | 19:26 |
| rlandy | weshay|ruck: there are old deps in there | 19:26 |
| weshay|ruck | so we get it from dlrn and rhos-release | 19:26 |
| rfolco|rover | will add yours | 19:26 |
| rlandy | candidate has newer ones | 19:27 |
| rlandy | weshay|ruck: no - not rho-release | 19:27 |
| weshay|ruck | ah | 19:27 |
| rlandy | candidate | 19:27 |
| weshay|ruck | k | 19:27 |
| rlandy | like build-deps | 19:27 |
| weshay|ruck | roger that | 19:27 |
| rlandy | which may be wrong | 19:27 |
| rlandy | but it's the only option that works atm | 19:27 |
| rlandy | I tried combinations of them all | 19:27 |
| weshay|ruck | jebus | 19:28 |
| weshay|ruck | rlandy, so .. you've confirmed.. http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17/osptrunk-deps.repo is not good for the standalone? | 19:29 |
| rfolco|rover | weshay|ruck, container push failure is mirror issue looks like, https://review.rdoproject.org/r/#/c/27361/ works | 19:29 |
| rfolco|rover | chandankumar, ^ | 19:29 |
| chandankumar | rfolco|rover, aye thanks for confirming | 19:30 |
| rlandy | weshay|ruck: it didn't work for me - it should though | 19:30 |
| weshay|ruck | rlandy, which build? https://code.engineering.redhat.com/gerrit/#/c/198789/ | 19:30 |
| rfolco|rover | weshay|ruck, nodes gone, checking w/ nhicher what happened | 19:31 |
| weshay|ruck | loverly | 19:31 |
| rlandy | weshay|ruck: chandankumar: pls see https://review.opendev.org/#/c/725974/ | 19:32 |
| rlandy | ^^ will hose rhos-16 builds | 19:32 |
| rlandy | but I want to remove those | 19:32 |
| rlandy | nobody is looking at them | 19:32 |
| rlandy | we need that for standalone pipeline | 19:32 |
| rlandy | weshay|ruck: pls also review https://code.engineering.redhat.com/gerrit/#/c/198790/ | 19:35 |
| rlandy | updated that review for rhos-17 pipelines | 19:35 |
| rlandy | weshay|ruck: what should the project be? | 19:35 |
| rlandy | https://code.engineering.redhat.com/gerrit/#/c/198790/2/zuul.d/tripleo.yaml | 19:35 |
| rlandy | line 2 | 19:35 |
| weshay|ruck | good question | 19:35 |
| weshay|ruck | rlandy, wfm.. maybe as in rhos-ops.. matches https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml#L11 | 19:36 |
| rlandy | weshay|ruck: k - we can merge that after standalone merges | 19:38 |
| weshay|ruck | wfm | 19:38 |
| rlandy | restesting with your get-hash patch | 19:38 |
| weshay|ruck | rlandy, /me notes.. pass / fail is ok.. atm | 19:38 |
| weshay|ruck | especially if we're figuring out deps | 19:39 |
| rlandy | weshay|ruck: so deps ... here's the thing | 19:39 |
| rlandy | I think candidate deps work | 19:39 |
| rlandy | if we're ok to use those | 19:39 |
| rlandy | we include build deps upstream | 19:39 |
| rlandy | so it's not a bigger violation | 19:39 |
| rlandy | it just seems more updated | 19:39 |
| rlandy | and openvswitch has a clash if you include noth | 19:40 |
| rlandy | both | 19:40 |
| weshay|ruck | rlandy, we need to signal that back to #rdo apevec, jpena etc | 19:40 |
| weshay|ruck | because folks that are not using ci.. will hit issues if they are hosting the wrong repo in deps | 19:40 |
| rlandy | weshay|ruck: ok - let's get a passing standalone job and I'll chat with jpena tomorrow | 19:40 |
| weshay|ruck | k | 19:40 |
| rlandy | they are not hosting anything | 19:40 |
| rlandy | it's just a link to brew | 19:41 |
| weshay|ruck | in osp dlrn they link to brew | 19:41 |
| rlandy | reldel hosts both | 19:41 |
| rlandy | yep | 19:41 |
| weshay|ruck | ya.. I know | 19:41 |
| rlandy | no hosting going on | 19:41 |
| weshay|ruck | but dlrn should point to a working repo | 19:41 |
| weshay|ruck | poor choice of words | 19:41 |
| rlandy | osp-deps is oisgesmuddled | 19:41 |
| weshay|ruck | bonus points for using yiddish in bugs | 19:42 |
| rlandy | spending too much time with my mom :) | 19:43 |
| *** dsneddon has joined #oooq | 19:56 | |
| chandankumar | rlandy, regarding this review https://review.opendev.org/#/c/725974/2/roles/repo-setup/tasks/get-dlrn-hash-newest.yml what about using release there? like weshay|ruck did https://review.opendev.org/#/c/720776/15/roles/repo-setup/tasks/get-dlrn-hash-newest.yml | 19:58 |
| chandankumar | instead of multiple distro conditions | 19:59 |
| rlandy | chandankumar: I'm abandoning that for weshay|ruck's review | 19:59 |
| rlandy | just testing to see it works with downstream | 19:59 |
| chandankumar | rlandy, may be we can update weshay|ruck ruck to satisfy downstream needs | 19:59 |
| chandankumar | rlandy, aye | 20:00 |
| *** dsneddon has quit IRC | 20:00 | |
| rlandy | chandankumar: I think it might works as is | 20:01 |
| weshay|ruck | chandankumar, release is defined on internal release config | 20:07 |
| rlandy | weshay|ruck: ok if I removed rhos016 jobs | 20:08 |
| rlandy | not passing and nobosy is looking at them | 20:08 |
| rlandy | nobody | 20:08 |
| weshay|ruck | rlandy, ya remove :) | 20:08 |
| rlandy | we will have rhos-17 jobs soon | 20:08 |
| weshay|ruck | rlandy, need some +2 support https://review.opendev.org/#/q/topic:1876893+(status:open+OR+status:merged) | 20:22 |
| *** jfrancoa has quit IRC | 20:22 | |
| weshay|ruck | will revert when the bug is fixed | 20:23 |
| weshay|ruck | bugs | 20:23 |
| rlandy | ok | 20:23 |
| rfolco|rover | weshay|ruck, last time tempest ssh test worked kernel was kernel-3.10.0-1062.18.1.el7.x86_64 | 20:24 |
| rfolco|rover | weshay|ruck, after updating to kernel-3.10.0-1127.el7.x86_64, it failed | 20:24 |
| rfolco|rover | not saying this is the root cause, just facts | 20:24 |
| rfolco|rover | 1062 --> 1127 | 20:24 |
| weshay|ruck | rfolco|rover, aye.. and ping rhos-ops as to why the kernel is diff in upstream vs rdo | 20:25 |
| rfolco|rover | weshay|ruck, let me double check this info... the info above is rdo-rdo | 20:25 |
| weshay|ruck | ah | 20:26 |
| weshay|ruck | rfolco|rover, k.. because those jobs are passing upstream.. fs010 anyway | 20:26 |
| weshay|ruck | rfolco|rover, https://trello.com/c/niYGK63i/1475-cixlp1876087tripleociproa-queens-rocky-stein-tempestscenariotestnetworkbasicopstestnetworkbasicops-failing-timeout | 20:27 |
| rlandy | weshay|ruck: fyi ... //code.engineering.redhat.com/gerrit/#/c/199674/ | 20:32 |
| rfolco|rover | weshay|ruck, sorry, but i don't know what is the fs010 job upstream you refer | 20:38 |
| rfolco|rover | weshay|ruck, can you please point me ? | 20:38 |
| *** TrevorV has quit IRC | 20:44 | |
| *** rfolco|rover is now known as rfolco|rover|off | 21:11 | |
| *** saneax has quit IRC | 21:44 | |
| *** jmasud has joined #oooq | 21:55 | |
| weshay|ruck | rfolco|rover|off, how to fish | 22:00 |
| weshay|ruck | [whayutin@localhost zuul.d]$ egrep -rn 010 * | 22:00 |
| weshay|ruck | deprecated-jobs.yaml:110: featureset: '010' | 22:00 |
| weshay|ruck | multinode-jobs.yaml:195: - tripleo-ci-centos-7-scenario010-multinode-oooq-container | 22:00 |
| weshay|ruck | multinode-jobs.yaml:246: featureset: '010' | 22:00 |
| weshay|ruck | multinode-jobs.yaml:273: featureset: '010' | 22:00 |
| weshay|ruck | multinode-jobs.yaml:314: featureset: '010' | 22:00 |
| weshay|ruck | multinode-jobs.yaml:328: featureset: '010' | 22:00 |
| weshay|ruck | ## CentOS 7 jobs | 22:02 |
| weshay|ruck | - job: | 22:02 |
| weshay|ruck | name: tripleo-ci-centos-7-containers-multinode | 22:02 |
| weshay|ruck | parent: tripleo-ci-base-multinode | 22:02 |
| weshay|ruck | branches: ^(stable/(pike|queens|rocky|stein|train)).*$ | 22:02 |
| weshay|ruck | vars: | 22:02 |
| weshay|ruck | nodes: 1ctlr | 22:02 |
| weshay|ruck | featureset: '010' | 22:02 |
| weshay|ruck | playbooks: | 22:02 |
| weshay|ruck | - multinode.yml | 22:02 |
| *** jmasud has quit IRC | 22:06 | |
| *** holser has quit IRC | 22:31 | |
| *** holser has joined #oooq | 22:45 | |
| *** dsneddon has joined #oooq | 23:18 | |
| rlandy | weshay|ruck: still around? | 23:26 |
| *** holser has quit IRC | 23:29 | |
| *** jmasud has joined #oooq | 23:34 | |
| *** tosky has quit IRC | 23:36 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
