| *** dsneddon has joined #oooq | 00:12 | |
| *** dsneddon has quit IRC | 01:16 | |
| *** dsneddon has joined #oooq | 01:17 | |
| *** dsneddon has quit IRC | 01:22 | |
| *** Goneri has joined #oooq | 01:30 | |
| *** Goneri has quit IRC | 01:39 | |
| *** dsneddon has joined #oooq | 01:55 | |
| *** Goneri has joined #oooq | 02:13 | |
| *** weshay has quit IRC | 02:17 | |
| *** dsneddon has quit IRC | 02:42 | |
| *** dsneddon has joined #oooq | 02:45 | |
| *** Goneri has quit IRC | 02:47 | |
| *** ykarel has joined #oooq | 02:55 | |
| *** rfolco has quit IRC | 03:13 | |
| *** dsneddon has quit IRC | 03:50 | |
| *** dsneddon has joined #oooq | 03:57 | |
| *** dsneddon has quit IRC | 04:02 | |
| *** ratailor has joined #oooq | 04:14 | |
| *** surpatil has joined #oooq | 04:19 | |
| *** rlandy|biab has quit IRC | 04:30 | |
| *** soniya29 has joined #oooq | 04:35 | |
| *** skramaja has joined #oooq | 04:36 | |
| *** dsneddon has joined #oooq | 04:38 | |
| *** ratailor has quit IRC | 04:42 | |
| *** ratailor has joined #oooq | 04:42 | |
| *** udesale has joined #oooq | 05:00 | |
| *** ykarel is now known as ykarel|afk | 05:40 | |
| *** ratailor has quit IRC | 05:43 | |
| *** ratailor has joined #oooq | 05:44 | |
| *** ykarel|afk has quit IRC | 05:45 | |
| *** ykarel|afk has joined #oooq | 06:00 | |
| *** ykarel|afk is now known as ykarel | 06:08 | |
| *** ratailor_ has joined #oooq | 06:09 | |
| *** ratailor has quit IRC | 06:11 | |
| *** aakarsh has quit IRC | 06:17 | |
| *** marios has joined #oooq | 06:28 | |
| *** ratailor_ has quit IRC | 07:05 | |
| *** matbu has joined #oooq | 07:06 | |
| *** bogdando has joined #oooq | 07:07 | |
| *** ratailor has joined #oooq | 07:08 | |
| *** amoralej|off is now known as amoralej | 07:18 | |
| *** tesseract has joined #oooq | 07:20 | |
| *** akahat has joined #oooq | 07:20 | |
| *** matbu has quit IRC | 07:22 | |
| *** matbu has joined #oooq | 07:24 | |
| *** holser has joined #oooq | 07:32 | |
| *** kopecmartin|off is now known as kopecmartin | 07:36 | |
| *** tosky has joined #oooq | 07:37 | |
| *** apetrich has quit IRC | 07:40 | |
| *** jpena|off is now known as jpena | 07:41 | |
| *** jfrancoa has joined #oooq | 07:47 | |
| *** jaosorior has quit IRC | 07:48 | |
| chandankumar | marios: :-) | 07:51 |
|---|---|---|
| marios | chandankumar: sorry | 07:52 |
| marios | :) | 07:52 |
| chandankumar | marios: no problem! | 07:52 |
| marios | chandankumar: i think if we do that it makes it much easier next time we have to copy/paste it | 07:52 |
| chandankumar | marios: added more reviews to the queue in RDO side | 07:52 |
| *** soniya29 is now known as soniya29|lunch | 07:52 | |
| chandankumar | yup | 07:52 |
| marios | chandankumar: you won't have to update all those 'train' things | 07:52 |
| *** rascasoft has joined #oooq | 07:52 | |
| *** apetrich has joined #oooq | 07:52 | |
| *** surpatil is now known as surpatil|lunch | 07:53 | |
| bogdando | hi folks, please need you opinion on https://review.opendev.org/#/c/685134 | 07:54 |
| *** matbu has quit IRC | 07:59 | |
| *** holser has quit IRC | 08:01 | |
| marios | bogdando: not sure i follow how the randomized fetches will affect the caching though though i don't know much about how the 'openstack infra mirrors' work | 08:01 |
| marios | bogdando: like either it is cached or it isn't | 08:01 |
| marios | bogdando: or you mean, within the cache itself | 08:01 |
| bogdando | marios: AFAIK, there is docker.io mirrors with caching proxy | 08:02 |
| bogdando | so docker.io doesn't trigger rate limiting | 08:02 |
| bogdando | if randomized, cache "disappears" so docker.io might drop the download rates drastically | 08:03 |
| marios | bogdando: k, i don't follow why the cache disappears though based on the order we're requesting containers | 08:04 |
| marios | bogdando: oh common layers | 08:04 |
| marios | bogdando: so like if you request all the nova things together they will have much of the common stuff in cache | 08:04 |
| bogdando | marios: different layers of different images will less likely reside in that cache simultaneously | 08:04 |
| marios | like that? | 08:04 |
| bogdando | yes | 08:04 |
| marios | bogdando: i see thanks. this particular point notwithstanding the question still stands 'how much improvement are we getting' from all the improvement things landed these days | 08:05 |
| marios | bogdando: i guess they will compare the job run times next week or so | 08:06 |
| marios | bogdando: but it is impossible to answer about the effect of any one of those things, like the one you're asking today | 08:06 |
| *** matbu has joined #oooq | 08:06 | |
| marios | bogdando: unless we asses it here before merging it. but then is it big enough of a difference by itself to be felt i don't know | 08:06 |
| bogdando | right, only asking about confirming the concern | 08:07 |
| marios | bogdando: i put the conversation on the patch for the others lets see what they and anyone else might comment later | 08:09 |
| bogdando | thanks | 08:09 |
| jfrancoa | marios: hey, do you have a moment? | 08:11 |
| marios | jfrancoa: i'm gonna go afk in a couple mins for errand but will be back in ~1hr | 08:11 |
| *** holser has joined #oooq | 08:11 | |
| jfrancoa | marios: ack, I'll ping you back later | 08:12 |
| marios | jfrancoa: ack | 08:12 |
| *** matbu has quit IRC | 08:16 | |
| *** matbu has joined #oooq | 08:18 | |
| *** marios has quit IRC | 08:19 | |
| *** soniya29|lunch is now known as soniya29 | 08:28 | |
| *** derekh has joined #oooq | 08:33 | |
| *** surpatil|lunch is now known as surpatil | 08:34 | |
| arxcruz|rover | zbr|ruck: around? hey, i'll be a little bit off today, spend the whole night at the hospital with my daughter | 08:41 |
| zbr|ruck | arxcruz|rover: sure, take care! | 08:41 |
| *** ykarel is now known as ykarel|lunch | 08:41 | |
| *** ratailor has quit IRC | 08:48 | |
| *** chem has joined #oooq | 08:48 | |
| *** ratailor has joined #oooq | 08:51 | |
| *** tosky has quit IRC | 08:51 | |
| arxcruz|rover | ykarel|lunch: the get_endpoint still not working right? What can we do to get this merged asap ? :) | 09:02 |
| *** ykarel|lunch is now known as ykarel | 09:12 | |
| *** dtantsur|afk is now known as dtantsur | 09:18 | |
| *** marios has joined #oooq | 09:24 | |
| *** dtantsur is now known as dtantsur|lunch | 09:24 | |
| arxcruz|rover | zbr|ruck: taking my daughter to hospital, brb | 09:52 |
| *** skramaja has quit IRC | 10:02 | |
| zbr|ruck | arxcruz|rover: fyi, i added https://review.rdoproject.org/r/#/c/21860/ to validate pingus change. | 10:06 |
| *** ratailor has quit IRC | 10:11 | |
| chandankumar | zbr|ruck: https://review.rdoproject.org/r/#/c/21860/ check the comment | 10:16 |
| zbr|ruck | ^ for first one or both? | 10:18 |
| chandankumar | zbr|ruck: only for periodic | 10:18 |
| arxcruz|rover | zbr|ruck: turns out my wife was already comming back from the hospital | 10:20 |
| arxcruz|rover | zbr|ruck: like your dnm message :P | 10:20 |
| *** ratailor has joined #oooq | 10:31 | |
| *** tesseract has quit IRC | 10:35 | |
| *** tesseract has joined #oooq | 10:35 | |
| *** sshnaidm|off is now known as sshnaidm|pto | 10:44 | |
| *** akahat has quit IRC | 10:45 | |
| *** ratailor_ has joined #oooq | 10:45 | |
| *** ratailor has quit IRC | 10:47 | |
| chandankumar | kopecmartin: soniya29 surpatil I have added the agenda for tempest meeting, please update/edit here : https://etherpad.openstack.org/p/tripleo-tempest-squad-meeting | 10:52 |
| *** recheck has quit IRC | 11:00 | |
| *** recheck has joined #oooq | 11:01 | |
| *** dtantsur|lunch is now known as dtantsur | 11:03 | |
| *** bogdando has quit IRC | 11:16 | |
| *** jpena is now known as jpena|lunch | 11:17 | |
| *** bogdando has joined #oooq | 11:17 | |
| *** jaosorior has joined #oooq | 11:19 | |
| chandankumar | zbr|ruck: Hello | 11:20 |
| chandankumar | zbr|ruck: https://logs.rdoproject.org/60/21860/21/check/periodic-tripleo-ci-rhel-8-scenario004-standalone-master/e3faaaf/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-09-27_06_49_52 | 11:20 |
| chandankumar | zbr|ruck: we are stilling using docker in podman jobs? | 11:20 |
| chandankumar | s/podman/scenario004 job | 11:21 |
| zbr|ruck | yes, change not merged | 11:21 |
| zbr|ruck | chandankumar: do you have any idea why I got http://logs.rdoproject.org/60/21860/21/check/tripleo-ci-rhel-8-scenario004-standalone-rdo/dd24b62/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz ? | 11:23 |
| zbr|ruck | image not found rhel-binary-cron | 11:23 |
| zbr|ruck | i got other jobs failing with other images missing rhel-binary-aodh-api | 11:25 |
| chandankumar | zbr|ruck: checking | 11:28 |
| *** matbu has quit IRC | 11:28 | |
| *** matbu has joined #oooq | 11:29 | |
| chandankumar | zbr|ruck: that container does not exists on rdo registry that's why failing | 11:32 |
| chandankumar | zbr|ruck: when was the last rdo promotion happened | 11:32 |
| zbr|ruck | yep, i found that myself. maybe it was a broken promotion? | 11:33 |
| *** jaosorior has quit IRC | 11:33 | |
| chandankumar | zbr|ruck: it is what I found in current tripleo https://trunk.rdoproject.org/rhel8-master/current-tripleo/delorean.repo | 11:34 |
| chandankumar | zbr|ruck: but periodic failure is something we need to look | 11:34 |
| chandankumar | why it is taking docker stuff | 11:34 |
| arxcruz|rover | ykarel: https://review.opendev.org/#/c/684288/ merged, let's hope for a promotion :D | 11:39 |
| arxcruz|rover | zbr|ruck: ^ | 11:39 |
| ykarel | arxcruz|rover, Great timing, periodic job will be running in some time, let me see if repo is consistent | 11:39 |
| arxcruz|rover | panda: around? https://logs.rdoproject.org/60/21860/21/check/periodic-tripleo-ci-rhel-8-scenario004-standalone-master/e3faaaf/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-09-27_06_49_49 | 11:40 |
| chandankumar | zbr|ruck: I found the issue https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L306 | 11:40 |
| chandankumar | parent from centos7 which has docker https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L126 | 11:40 |
| chandankumar | zbr|ruck: we need to flip the switch | 11:40 |
| arxcruz|rover | panda: is that okay if i set container_registry_deploy_docker and container_registry_deploy_docker_distribution to false here ? | 11:40 |
| arxcruz|rover | since rhel doesn't have docker | 11:40 |
| ykarel | hmm repo is consistent, but it's not picked by DLRN yet, let's hope it get's picked up before periodic job starts | 11:41 |
| chandankumar | from docker to podman | 11:41 |
| arxcruz|rover | ykarel: do your black magic man! :P | 11:44 |
| arxcruz|rover | chandankumar: you're talking about rhel error ? | 11:45 |
| chandankumar | arxcruz|rover: yes periodic one where we are testing pyngus package | 11:45 |
| chandankumar | arxcruz|rover: https://review.rdoproject.org/r/#/c/21860/ | 11:45 |
| arxcruz|rover | i blame marios | 11:47 |
| *** ratailor__ has joined #oooq | 11:49 | |
| chandankumar | arxcruz|rover: can we get a patch in rhel8 job part? | 11:49 |
| arxcruz|rover | chandankumar: working on it | 11:50 |
| chandankumar | arxcruz|rover: cool, thanks :-) | 11:51 |
| *** ratailor_ has quit IRC | 11:51 | |
| *** weshay has joined #oooq | 11:55 | |
| weshay | arxcruz|rover, zbr|ruck ping me when you can chat | 11:57 |
| ykarel | arxcruz|rover, it got picked up by dlrn :- https://trunk.rdoproject.org/centos7-master/report.html | 11:58 |
| ykarel | so we are good with master | 11:58 |
| arxcruz|rover | chandankumar: zbr|ruck https://review.rdoproject.org/r/#/c/22625/ | 11:58 |
| arxcruz|rover | weshay: just a sec | 11:59 |
| chandankumar | arxcruz|rover: done, thanks! | 11:59 |
| arxcruz|rover | weshay: i'm ready | 12:01 |
| weshay | eek.. 2min brb | 12:02 |
| weshay | ok.. | 12:04 |
| weshay | https://meet.google.com/igz-wfku-nka | 12:05 |
| *** dsneddon has quit IRC | 12:09 | |
| *** dsneddon has joined #oooq | 12:09 | |
| *** bogdando_ has joined #oooq | 12:09 | |
| *** bogdando has quit IRC | 12:10 | |
| *** bogdando_ is now known as bogdando | 12:10 | |
| *** jpena|lunch is now known as jpena | 12:10 | |
| *** jfrancoa has quit IRC | 12:26 | |
| *** ratailor__ has quit IRC | 12:30 | |
| *** rfolco has joined #oooq | 12:38 | |
| *** rlandy has joined #oooq | 12:40 | |
| weshay | arxcruz|rover, 2019-09-27 12:37:29.114754 | primary | 'baseos_undercloud_image_url' is undefined | 12:41 |
| *** jfrancoa has joined #oooq | 12:42 | |
| *** dtrainor has quit IRC | 12:48 | |
| *** bogdando has quit IRC | 12:50 | |
| *** soniya29 has quit IRC | 12:51 | |
| *** dtrainor has joined #oooq | 12:53 | |
| *** matbu has quit IRC | 12:54 | |
| chandankumar | rlandy: hello | 12:55 |
| chandankumar | rlandy: I got the parenting solution | 12:55 |
| chandankumar | rlandy: https://review.rdoproject.org/r/#/c/22624/ | 12:55 |
| *** matbu has joined #oooq | 12:56 | |
| chandankumar | rlandy: I updated other patches also | 12:56 |
| *** udesale has quit IRC | 12:58 | |
| *** udesale has joined #oooq | 12:58 | |
| marios | rfolco: rlandy panda sync in a minute | 12:59 |
| chandankumar | kopecmartin: meeting time | 13:00 |
| rlandy | chandankumar: thanks - will look after meeting | 13:02 |
| ykarel | arxcruz|rover, master pipeline failed in 1 job consistent-to-tripleo-ci-testin | 13:10 |
| ykarel | commit df96ffc5276ee316be925f9423612e9190055d8f / distro 60f2e6559ee5b128816fdf17e14b54759a915e27 combination not found in RHEL | 13:10 |
| *** amoralej is now known as amoralej|lunch | 13:10 | |
| arxcruz|rover | ykarel: http://www.nooooooooooooooo.com/ | 13:11 |
| ykarel | i see that hash build in centos(at 11:56:47), and rhel(12:51:52), 55 minute gap | 13:12 |
| ykarel | may be u can reschedule openstack periodic to run again? | 13:13 |
| ykarel | now it looks better | 13:13 |
| ykarel | nope still not better, | 13:16 |
| ykarel | seems both DLRN builders get triggered at different time, so it leads to different queue for them | 13:16 |
| ykarel | may be jpena can have a look at it ^^ | 13:16 |
| jpena | ykarel: I can get some improvements (right now it runs once every hour for rhel), but perfect synchronization will not be achievable | 13:18 |
| ykarel | jpena, yup some improvement will help | 13:19 |
| ykarel | jpena, currently that job waits for 40 minutes to timeout | 13:19 |
| ykarel | so if possible they are sync in 40 minutes it would be good | 13:19 |
| jpena | ykarel: ack, I've changed it | 13:19 |
| ykarel | jpena, so what are current setting for rhel and centos one | 13:20 |
| jpena | ykarel: run every 5 minutes | 13:20 |
| ykarel | jpena, okk, good, that should improve it | 13:21 |
| rlandy | arxcruz|rover: zbr|ruck: weshay: marios, panda and I would like to merge some patches for the promoter | 13:21 |
| rlandy | we do not expect production errors | 13:21 |
| rlandy | we can revert if need be | 13:21 |
| rlandy | there will be at max three patches | 13:22 |
| arxcruz|rover | merge code on production on friday? | 13:22 |
| arxcruz|rover | :P | 13:22 |
| panda | arxcruz|rover: production is not touched | 13:22 |
| rlandy | panda objects | 13:22 |
| marios | arxcruz|rover: shouldn't affect anything | 13:22 |
| marios | arxcruz|rover: if it does just revert | 13:22 |
| marios | arxcruz|rover: and sue panda | 13:22 |
| rlandy | arxcruz|rover: we will revert if you are unhappy | 13:22 |
| arxcruz|rover | sounds like a good plan | 13:22 |
| rlandy | thank you | 13:22 |
| weshay | arxcruz|rover, https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/948414545dff4f299c38279bae563880?logfile=console.log | 13:30 |
| weshay | running well | 13:30 |
| arxcruz|rover | cool | 13:31 |
| chandankumar | rlandy: want to sync? | 13:33 |
| rlandy | chandankumar: in a few | 13:33 |
| chandankumar | ok | 13:33 |
| rlandy | chandankumar: out of meeting - let's sync | 13:36 |
| chandankumar | rlandy: https://meet.google.com/apo-vxox-dzo?pli=1&authuser=0 | 13:37 |
| rlandy | joining | 13:39 |
| ykarel | arxcruz|rover, zbr|ruck are u aware of any blocker for stein? i see it's 12 day and can't find a card related to it | 13:45 |
| * ykarel checks last run | 13:45 | |
| arxcruz|rover | ykarel: the ssh issue ? | 13:46 |
| ykarel | arxcruz|rover, ssh issue was queens only | 13:46 |
| arxcruz|rover | then is the get_endpoint issue | 13:46 |
| arxcruz|rover | sorry, i need to verify | 13:46 |
| ykarel | arxcruz|rover, that was master only | 13:46 |
| weshay | arxcruz|rover, you can tmux a on the hp box and be on the undercloud | 13:47 |
| arxcruz|rover | ykarel: then i need to check we were focused on master... :/ | 13:47 |
| weshay | ykarel, bringing up a real bm test for queens as well | 13:47 |
| ykarel | weshay, ack but seems it will pass there :), but good if it reproduces | 13:47 |
| weshay | ykarel, on a real bm box? | 13:48 |
| weshay | ya.. I think ur right | 13:48 |
| weshay | ykarel, it may be important to note.. we're fixing something caused by using nodepool | 13:49 |
| weshay | that's what I want to double check | 13:49 |
| ykarel | weshay, yes with the symptoms we have seen till now, it seems network related, so seems those usedns setting will move it ahead, but still we doubting on public connectivity | 13:49 |
| ykarel | on overcloud node | 13:50 |
| ykarel | nodes | 13:50 |
| zbr|ruck | nope | 13:50 |
| weshay | ykarel, aye.. agree.. having the bm env will help w/ that as well | 13:50 |
| weshay | amoralej|lunch, ykarel https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/948414545dff4f299c38279bae563880?logfile=console.log | 13:50 |
| ykarel | weshay, yes | 13:50 |
| ykarel | weshay, also i am not able to reproduce with zuul reproducer on my personal tenant | 13:51 |
| weshay | rlandy, fyi.. I just added a queens bm job in internal sf | 13:51 |
| rlandy | weshay: sec on meeting | 13:51 |
| ykarel | weshay, even i tried latest nodepool image | 13:51 |
| ykarel | but still it didn't reproduced | 13:51 |
| ykarel | :( | 13:51 |
| ykarel | may be it specific to CI tenant | 13:52 |
| weshay | ykarel, ya.. I also hit a bug in the new reproducer, so you were also correct.. I was using the older one.. both are valid for testing tripleo | 13:52 |
| zbr|ruck | weshay: let me know if you have few minutes, re missing containers in builds. | 13:52 |
| weshay | ykarel, where the newer one also makes sure you are operating in the same env as jobs | 13:52 |
| ykarel | weshay, i used newer one only, and there overcloud deploy get's successful | 13:53 |
| chandankumar | weshay: marios https://review.rdoproject.org/r/#/c/22549/ please merge it | 13:53 |
| ykarel | even with newer nodepool image, c7.7 kernel | 13:53 |
| weshay | ykarel, oh.. it passes for you in the new reproducer? | 13:53 |
| ykarel | weshay, yes | 13:53 |
| ykarel | i faced some issues but worked arounded those | 13:54 |
| weshay | hrm.. perhaps we're fighting an issue w/ openstack-nodepool tenant | 13:54 |
| weshay | ykarel, interesting.. issues w/ the zuul launching the job? | 13:54 |
| weshay | that's where the new one failed for me | 13:54 |
| ykarel | weshay, one issue was related to docker login, so i skipped that | 13:54 |
| ykarel | and other was it retried multiple times if it fails, so set attempts: 1 | 13:55 |
| *** surpatil has quit IRC | 13:55 | |
| weshay | ykarel, if the issues are really just the interaction of tripleo + rdo-cloud I'm inclinded to waive the tests for queens and send it through... | 13:55 |
| weshay | ykarel, ah cool | 13:56 |
| weshay | makes sense.. mine was failing in pre and that's where the login is | 13:56 |
| *** udesale has quit IRC | 13:56 | |
| ykarel | registry_login_enabled: false | 13:56 |
| weshay | have to take my kid to school.. bb in a few | 13:56 |
| ykarel | ack | 13:56 |
| weshay | ykarel, rock.. good to know | 13:56 |
| weshay | arxcruz|rover, let's patch the new reproducer w/ that ^ | 13:57 |
| weshay | ykarel++ | 13:57 |
| *** ratailor has joined #oooq | 14:02 | |
| *** Vorrtex has joined #oooq | 14:07 | |
| weshay | zbr|ruck, hey | 14:10 |
| marios | panda: we need that one? (don't think so right? https://review.rdoproject.org/r/#/c/22464/5/playbooks/rdo-tox-molecule-pre.yaml | 14:10 |
| weshay | zbr|ruck, can chat now | 14:10 |
| marios | panda: gona remove the depends on | 14:10 |
| panda | marios: kill it with fire | 14:10 |
| rfolco | marios, quick question, why 2 containers do not exist for ppc64le ? I could not follow that... | 14:12 |
| rfolco | msg: manifest-push.yml debug:ppc64le container not found for neutron-server | 14:12 |
| zbr|ruck | weshay: is there way to generate permalinks for google meet? | 14:12 |
| *** amoralej|lunch is now known as amoralej | 14:12 | |
| weshay | zbr|ruck, haven't seen one if there is | 14:12 |
| zbr|ruck | https://meet.google.com/zrs-bzjz-yvx | 14:13 |
| zbr|ruck | meet makes me see how nice bj was :D | 14:13 |
| panda | rfolco: it follows production, not all containers in x86 have an equivalent in ppc/ Some services are currently not supported. | 14:14 |
| marios | rfolco: cos they don't | 14:14 |
| rfolco | panda, I thought we were using mock ones, not real ones | 14:15 |
| marios | rfolco: like for x86 they are all built but for some of those there is also pppc | 14:15 |
| zbr|ruck | at least I was able to findout how to make it appear as an app instead of browser tab | 14:15 |
| marios | rfolco: sec, there https://review.rdoproject.org/r/#/c/22445/25/ci-scripts/infra-setup/roles/promoter/molecule/container-push/playbook.yml@63 | 14:15 |
| marios | rfolco: thats the mock data ^^ | 14:15 |
| panda | rfolco: in this case you're testing the manifest push behaviour | 14:15 |
| zbr|ruck | weshay: https://review.opendev.org/#/c/685302/ | 14:16 |
| panda | rfolco: the manifest-push needs to act accordingly and not confuse itself, when there are less containers in ppc than there are in x86, and handle the gaps correctly | 14:16 |
| rfolco | the list is base openstack-base neutron-server nova-compute | 14:17 |
| panda | rfolco: the input artifact in this case is created ad hoc to represent a possibly prolematic real-life situation | 14:17 |
| rfolco | we get these from rdo ? | 14:17 |
| panda | rfolco: no, they are all fake | 14:17 |
| rfolco | aaaah | 14:17 |
| rfolco | ok | 14:17 |
| rfolco | this could be more explcit in the test IMO | 14:18 |
| panda | rfolco: this is the nature of the tests in generale | 14:18 |
| rfolco | 2 missing, 2 skipped in that debug task, so its not clear what the expected output is | 14:19 |
| marios | panda: rfolco rlandy as discussed in call updated https://review.rdoproject.org/r/22002 | 14:19 |
| panda | rfolco: and we are really only touching the tip of the iceberg here | 14:19 |
| panda | marios: ship it! | 14:19 |
| rfolco | ok I should stop reviewing then | 14:19 |
| marios | rfolco: | 14:19 |
| marios | rfolco: no do not | 14:19 |
| marios | panda: lets let folks review it its fine | 14:19 |
| panda | rfolco: doooon't stop! reviewing it! | 14:20 |
| rfolco | k | 14:20 |
| marios | panda: i can iterate again if we need, if its somethign major, otherwise we can merge and fix it next week but lets wait for more comments | 14:20 |
| marios | thanks rfolco panda rlandy | 14:20 |
| rlandy | looking | 14:20 |
| marios | no fire rlandy | 14:20 |
| marios | can be later whenever you have time thanks | 14:20 |
| weshay | rlandy++ for baremetal!!! | 14:22 |
| rlandy | weshay: oops - hope that works - haven't checked it in a few weeks as we have not had promotions | 14:23 |
| * rlandy needs to add osp-16 as well | 14:23 | |
| rlandy | queens should be the most likely to run though | 14:23 |
| rlandy | marios: any danger is this ... | 14:24 |
| rlandy | environment: | 14:24 |
| rlandy | DOCKER_CLI_EXPERIMENTAL: enabled | 14:24 |
| marios | rlandy: saves me from having to add export DOCKDER_CLI .. on all the "docker manifest" commands | 14:25 |
| panda | AFAIK this just enables the docker manifest subcommand | 14:25 |
| marios | rlandy: i.e. we need it for 'docker manifest' | 14:25 |
| rlandy | fine | 14:25 |
| rlandy | yep - just checking we do not enable something else with that | 14:25 |
| panda | rlandy: this deosn't mean "allow docker to act irationally because it's in experimental mode" | 14:26 |
| marios | rlandy: ack thanks for checking | 14:26 |
| marios | panda: --trash-my-machine | 14:26 |
| panda | marios: docker pull --implicity-pull-all-dockerhub. | 14:26 |
| rlandy | because docker never acts irrationally even in its current mode?? | 14:27 |
| panda | rlandy: you have a point there. | 14:27 |
| rlandy | I feel we should push all this code - by the time I get back, I assume the majority of the fallout will be sorted | 14:28 |
| panda | rlandy: and if it doesn't you can always stay on PTO some days more. | 14:28 |
| rlandy | if only I had more days to take on PTO | 14:28 |
| * rlandy is sort of living on borrowed PTO time | 14:29 | |
| weshay | rfolco, ping me when you have a few min to show me around the container prep stuff | 14:30 |
| rfolco | weshay, sure give me e a few to review marios patch before they merge it | 14:30 |
| panda | rlandy: maybe we can trade, I have way more that I can use | 14:30 |
| rlandy | panda: I | 14:30 |
| rlandy | ll pay | 14:30 |
| rlandy | marios: +2'ed - let's do this - we won't know for sure until we try it out | 14:33 |
| rlandy | beside you've hit patch 70 | 14:33 |
| marios | rlandy: ack | 14:33 |
| rlandy | impressive in an odd way4 | 14:33 |
| marios | rlandy: yeah that was cos it kept changing (molecule/localhost/zuul job/then rebases on the new requirement /quay/role etc ) | 14:33 |
| rlandy | I hear you | 14:34 |
| *** jaosorior has joined #oooq | 14:34 | |
| rfolco | marios, panda done | 14:35 |
| rfolco | marios, comments are just sanity checks w/ logs.... except L137 on manifest-push.yml, which I think it should be like the step before IMHO | 14:36 |
| rfolco | weshay, ping | 14:37 |
| weshay | rfolco, hey | 14:38 |
| rfolco | weshay, good time now? | 14:38 |
| weshay | https://meet.google.com/etf-xwxz-kwa?authuser=1 | 14:38 |
| marios | rfolco: sec looking | 14:40 |
| marios | rfolco: i don't see any comments | 14:41 |
| marios | rfolco: it can't be the same | 14:41 |
| marios | rfolco: because then the loop index doesn't work for the conditional | 14:41 |
| panda | marios: rfolco rlandy ok I'll push the big red button | 14:50 |
| rlandy | run for cover!!!! | 14:51 |
| * rlandy fixing linters errors | 14:51 | |
| rlandy | test available for review shortly | 14:51 |
| *** ratailor has quit IRC | 14:52 | |
| *** matbu has quit IRC | 14:58 | |
| zbr|ruck | weshay: deployment failure with unable to find yum_update.sh : https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_132/684309/3/check/tripleo-ci-centos-7-undercloud-containers/132c629/logs/undercloud/home/zuul/install-undercloud.log.txt.gz | 15:04 |
| *** matbu has joined #oooq | 15:04 | |
| zbr|ruck | i was also surprised to read ansible-playbook 2.6.14 --- my impression was that we were no longer using unsupported versions of ansible | 15:05 |
| *** ykarel is now known as ykarel|afk | 15:08 | |
| weshay | zbr|ruck, will look in a sec | 15:18 |
| marios | thanks panda rfolco rlandy | 15:19 |
| *** dtantsur is now known as dtantsur|afk | 15:20 | |
| *** arxcruz|rover is now known as arxcruz|zzz | 15:22 | |
| rlandy | panda: how did you not get this error ... http://logs.rdoproject.org/48/22348/46/check/rdo-tox-molecule/7bccbbc/tox/reports.html | 15:30 |
| rlandy | install it? | 15:30 |
| * marios out | 15:30 | |
| marios | have a good break those who are out next few | 15:30 |
| zbr|ruck | rlandy: that is because pytest collection phase. | 15:31 |
| rlandy | zbr|ruck: meaning? | 15:32 |
| *** marios has quit IRC | 15:32 | |
| mjturek | rfolco if you have some time later, can you look at the rdoregistry and see if things are looking like you expect? | 15:32 |
| rlandy | panda has the same import in his tests | 15:32 |
| zbr|ruck | can be bypassed in two ways: a) easy/non-optimal: add switch to pytest to ignore collection errors b) changing test_promoter.py to bypass in case of missing module. | 15:32 |
| zbr|ruck | documented at https://stackoverflow.com/questions/30086558/py-test-fails-due-to-missing-module | 15:33 |
| zbr|ruck | let me know if you want me to make a CR to fix it. | 15:33 |
| weshay | rlandy, please review this https://review.opendev.org/#/c/685368/ | 15:35 |
| rlandy | weshay: to com when we do and don't want to build images ... | 15:37 |
| rlandy | confirm | 15:37 |
| rlandy | yes on bm and ovb with/without periodic? | 15:38 |
| rlandy | in the current case it was skipping on check not periodic? | 15:38 |
| panda | rlandy: it's a different environment, and rdo-tox-molecule does not test the dlrn_promoter itself. In tox.ini try adding dlrnapi_client to the deps = in section [testenv:molecule] | 15:39 |
| *** ykarel|afk is now known as ykarel | 15:39 | |
| panda | rlandy: wait | 15:40 |
| weshay | rlandy, ? | 15:41 |
| panda | rlandy: pytest is considering your file a py test file, and it shouldn't. It's better that you rename the file in promoter_test.py, otherwise pytest will always try to launch it whie it shouldn't | 15:43 |
| rlandy | panda: rename it to what? | 15:44 |
| panda | rlandy: pytst has a glob expression on the thole subtree. Every file that starts with a test_* for it it's a pytest file. Yours isn't. If you rename it to promoter_test.py or anything that doesn't start with test_ then rdo-tox-molecule will ignore it and stop complaining | 15:45 |
| panda | whole* | 15:46 |
| rlandy | ah | 15:47 |
| weshay | rlandy, commented on https://review.opendev.org/#/c/685368 | 15:49 |
| weshay | rlandy, you wrote that code, /me is not sure I'm fully in context w/ the what and why | 15:50 |
| rlandy | weshay: honestly we'd need to check it | 15:50 |
| rlandy | ages ago | 15:50 |
| weshay | Image building was not running in stable/ branches | 15:50 |
| weshay | due to wrong regex, this patch fixes it to build on | 15:50 |
| weshay | branches containing / in them. | 15:50 |
| weshay | k | 15:50 |
| chandankumar | zbr|ruck: around? | 15:50 |
| rlandy | you acn assign to me - I'll fix it as soon as I get ^^ in | 15:50 |
| chandankumar | zbr|ruck: RHEL-8 scenario 4 standalone, pacemaker requires docker, but in RHEL-8 there is no docker , it actually installs podman how we are going to handle that case? | 15:51 |
| weshay | chandankumar, I think pacemaker requires docker on centos, not RHEL8 | 15:55 |
| *** jbadiapa has joined #oooq | 15:56 | |
| weshay | chandankumar, I'm not sure if this is working in periodic https://review.rdoproject.org/r/#/c/22377/ | 15:56 |
| chandankumar | weshay: but my question is how we can make sure docker is installed in RHEL 8? | 16:05 |
| weshay | chandankumar, docker should not be installed on RHEL 8 | 16:06 |
| weshay | chandankumar, this works in OSP 15 right? podman + pacemaker | 16:06 |
| chandankumar | weshay: yes in downstream | 16:06 |
| weshay | chandankumar, right.. it could be we need to find the patches that makes that work and move them upstream.. where they should be | 16:07 |
| chandankumar | weshay: yes correct, that will help. | 16:07 |
| weshay | chandankumar, we had to do that for a few other rhel8 + tripleo jobs | 16:07 |
| chandankumar | weshay: https://logs.rdoproject.org/60/21860/21/check/periodic-tripleo-ci-rhel-8-scenario004-standalone-master/e3faaaf/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-09-27_06_49_52 | 16:09 |
| chandankumar | weshay: based of this questions came up today | 16:09 |
| weshay | chandankumar, ya.. that's the periodic.. that means I screwed up the patch I pointed at | 16:10 |
| weshay | https://review.rdoproject.org/r/#/c/22377/ | 16:10 |
| * weshay looks again | 16:10 | |
| weshay | chandankumar, it's working correctly in check | 16:11 |
| * weshay gets | 16:11 | |
| chandankumar | weshay: that needs internal modification | 16:11 |
| chandankumar | scenario4 was blocked on pygunus package | 16:11 |
| weshay | chandankumar, http://logs.rdoproject.org/53/682853/5/openstack-check/tripleo-ci-rhel-8-scenario004-standalone-rdo/b89c1e3/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 16:13 |
| weshay | chandankumar, scen003 was blocked on pyngunus I thought.. is scenario04 as well? | 16:14 |
| chandankumar | let me pull the bug | 16:14 |
| weshay | chandankumar, I don't think so | 16:14 |
| weshay | chandankumar, zbr|ruck all the rhel 8 scenario jobs are failing atm.. as of the last two days | 16:14 |
| zbr|ruck | yep, i know. | 16:15 |
| chandankumar | it all came from this review https://review.rdoproject.org/r/#/c/21860/ | 16:15 |
| weshay | zbr|ruck, need booogs | 16:15 |
| chandankumar | zbr|ruck: pygunus was for scenario3 or 4? | 16:15 |
| weshay | chandankumar, scen003... | 16:15 |
| zbr|ruck | it was 3 | 16:15 |
| weshay | change that review to scenario 3 | 16:15 |
| weshay | but even still.. I think zbr|ruck has a handle on it.. we need a kolla patch to merge | 16:16 |
| weshay | for painindangus I mean pyngus | 16:16 |
| chandankumar | thanks for the clarification , whole day got confused on this | 16:16 |
| weshay | :) | 16:16 |
| chandankumar | rlandy: and I were dicussing on podman vs docker | 16:17 |
| zbr|ruck | chandankumar: you do not use depends-on on the same repository, it never works. | 16:18 |
| zbr|ruck | you rebase on top of it instead | 16:18 |
| chandankumar | zbr|ruck: ack | 16:18 |
| chandankumar | zbr|ruck: weshay we need to tweak kolla for centos 8 also | 16:19 |
| chandankumar | another mess to solve | 16:19 |
| rlandy | chandankumar: pls leave me notes on the patch - will get to that after broken images builds | 16:20 |
| chandankumar | rlandy: that one sorted out | 16:20 |
| *** jaosorior has quit IRC | 16:21 | |
| chandankumar | Happy weekend #oooq, | 16:21 |
| chandankumar | Happy holidays rlandy :-) | 16:21 |
| *** chandankumar is now known as raukadah | 16:21 | |
| rlandy | thanks | 16:21 |
| rlandy | oh how I LOVE linters | 16:22 |
| *** chem has quit IRC | 16:23 | |
| rlandy | I have no idea if my code works but every line has been edited to make linters happy | 16:23 |
| panda | rlandy: autopep8 :) | 16:25 |
| ykarel | :) | 16:25 |
| *** holser has quit IRC | 16:26 | |
| * ykarel still smiling with the statement:- I have no idea if my code works but every line has been edited to make linters happy | 16:26 | |
| zbr|ruck | rlandy: that is because you did not embrace black, yet. | 16:27 |
| zbr|ruck | black reformats your code so you dont have to (please the linters) | 16:27 |
| zbr|ruck | weshay: are we allowed to get packages from epel or not? (centos) | 16:30 |
| weshay | zbr|ruck, only if you want to be struck by lightning | 16:30 |
| weshay | zbr|ruck, why? | 16:30 |
| zbr|ruck | weshay: this means that our pyngus patch from https://review.opendev.org/#/c/685302/5/docker/openstack-base/Dockerfile.j2 is not correct. | 16:31 |
| zbr|ruck | read last comment | 16:31 |
| *** jpena is now known as jpena|off | 16:31 | |
| zbr|ruck | i was trying to findout where it comes from because on that file it was only installed from pip | 16:32 |
| *** tesseract has quit IRC | 16:32 | |
| zbr|ruck | so the change is at best incomplete if not even wrong | 16:32 |
| weshay | zbr|ruck, my understanding is that is now in dlrn_deps and epel | 16:32 |
| weshay | zbr|ruck, I don't see the comment you are referring to | 16:33 |
| *** ykarel has quit IRC | 16:34 | |
| zbr|ruck | i updated the CR, now should be fine, if it passes but considering is friday, my hopes are low. | 16:39 |
| weshay | zbr|ruck, I see no changes in ps 5 - 7 | 16:40 |
| weshay | ah.. now I do | 16:41 |
| weshay | adding python2-pyngus | 16:41 |
| zbr|ruck | also for debian | 16:41 |
| *** zbr|ruck is now known as zbr | 16:41 | |
| zbr | stepping down from ruck. also good news martin already put a +2 to it, we may get it merged today. | 16:42 |
| weshay | zbr, have a good weekend | 16:43 |
| *** ykarel has joined #oooq | 16:50 | |
| *** derekh has quit IRC | 17:01 | |
| *** weshay is now known as weshay|ruck | 17:08 | |
| *** amoralej is now known as amoralej|off | 17:10 | |
| weshay|ruck | rlandy, https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/5ec22e4764d24b39b0533b7d4e18769a?logfile=console.log | 17:38 |
| zbr | weshay|ruck: guess what, centos7 failure to find python2-pyngus at https://fbddc0304e65cd8308f1-04499c28cd43dbd0610a4f6cd3b9b5ff.ssl.cf2.rackcdn.com/685302/7/check/tripleo-build-containers-centos-7/86b3f2b/logs/build.log.txt.gz | 17:58 |
| weshay|ruck | zbr, ya.. it's called python-pyngus not python2 | 17:58 |
| weshay|ruck | python-pyngus and python3-pyngus | 17:58 |
| *** Vorrtex has quit IRC | 19:10 | |
| *** kopecmartin is now known as kopecmartin|off | 19:15 | |
| *** ykarel is now known as ykarel|away | 19:29 | |
| weshay|ruck | sshnaidm|pto, you are famous https://medium.com/faun/docker-container-for-hp-servers-management-with-ilo-8947ff5da62b | 19:45 |
| *** jbadiapa has quit IRC | 19:50 | |
| *** ykarel|away has quit IRC | 20:16 | |
| *** dsneddon has quit IRC | 20:28 | |
| rlandy | rfolco: pls vote on https://review.rdoproject.org/r/#/c/22348/ | 20:44 |
| rlandy | it will fail until promotion complete | 20:44 |
| sshnaidm|pto | weshay|ruck, no claps though :( | 20:46 |
| weshay|ruck | sshnaidm|pto, I gave you a clap, but couldn't get it to work today.. /me will look at it as I have time | 20:47 |
| sshnaidm|pto | \o/ | 20:47 |
| rfolco | rlandy, will need mor etime to review that one | 20:47 |
| rlandy | rfolco: no major rush | 20:49 |
| rlandy | panda just wanted it in | 20:49 |
| rlandy | panda: if you're still around, it passes tox now | 20:49 |
| rlandy | weshay|ruck: k - what else do you want me to look at? otherwise will fix train jobs patches | 20:51 |
| weshay|ruck | rlandy, there were a couple old repro | 20:52 |
| * weshay|ruck gets | 20:52 | |
| weshay|ruck | rlandy, I don't think this is right to be honest https://review.opendev.org/#/c/685184/ | 20:52 |
| rlandy | weshay|ruck: going to piece the old reproducer patches together next week - I think I still have them all | 20:52 |
| weshay|ruck | rlandy, my install got all the way through to tempest btw | 20:53 |
| rlandy | nice | 20:53 |
| rlandy | very nice | 20:53 |
| rlandy | we need to bring that back | 20:53 |
| weshay|ruck | rlandy, we can merge this right? https://review.opendev.org/#/c/685346/ | 20:53 |
| rlandy | to_build should be correctly set | 20:53 |
| rlandy | weshay|ruck: ack +2'ed that | 20:54 |
| *** jtomasek has quit IRC | 20:55 | |
| *** dsneddon has joined #oooq | 20:57 | |
| panda | rlandy: thanks. | 21:14 |
| weshay|ruck | panda, go enjoy your weekend :) | 21:15 |
| *** jfrancoa has quit IRC | 21:17 | |
| rlandy | weshay|ruck: Ill check in on sunday if you something bm/queens done | 21:19 |
| weshay|ruck | rlandy, k.. have a nice weekend | 21:19 |
| rlandy | still around for a bit | 21:20 |
| *** rlandy has quit IRC | 21:39 | |
| *** rfolco has quit IRC | 21:42 | |
| *** jpena|off has quit IRC | 22:07 | |
| *** jpena|off has joined #oooq | 22:09 | |
| *** rfolco has joined #oooq | 22:10 | |
| *** dsneddon has quit IRC | 22:29 | |
| *** dsneddon has joined #oooq | 23:18 | |
| *** dsneddon has quit IRC | 23:23 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!