| *** tosky has quit IRC | 00:32 | |
| *** Goneri has quit IRC | 00:53 | |
| *** apetrich has quit IRC | 03:09 | |
| *** ysandeep|away is now known as ysandeep | 03:12 | |
| *** saneax has joined #oooq | 03:19 | |
| *** dmsimard|off has joined #oooq | 04:18 | |
| *** ykarel|away is now known as ykarel | 04:26 | |
| *** udesale has joined #oooq | 04:51 | |
| *** ratailor has joined #oooq | 05:00 | |
| *** ysandeep is now known as ysandeep| | 05:28 | |
| *** ysandeep| is now known as ysandeep | 05:31 | |
| *** jmasud has quit IRC | 06:06 | |
| *** jmasud has joined #oooq | 06:07 | |
| *** marios has joined #oooq | 06:08 | |
| *** saneax has quit IRC | 06:46 | |
| *** saneax has joined #oooq | 07:06 | |
| *** jfrancoa has joined #oooq | 07:06 | |
| *** bogdando has joined #oooq | 07:18 | |
| *** apetrich has joined #oooq | 07:27 | |
| *** pojadhav is now known as pojadhav|lunch | 07:34 | |
| *** jschlueter has quit IRC | 07:43 | |
| *** jbadiapa has joined #oooq | 07:43 | |
| *** jschlueter has joined #oooq | 07:43 | |
| *** dpawlik has joined #oooq | 07:47 | |
| *** jschlueter has quit IRC | 07:48 | |
| *** jschlueter has joined #oooq | 07:50 | |
| *** matbu has joined #oooq | 07:59 | |
| *** chem has joined #oooq | 08:09 | |
| *** amoralej|off is now known as amoralej | 08:22 | |
| *** tosky has joined #oooq | 08:24 | |
| *** dtantsur|afk is now known as dtantsur | 08:29 | |
| *** ykarel is now known as ykarel|lunch | 08:39 | |
| *** jpena|off is now known as jpena | 08:54 | |
| *** jmasud has quit IRC | 08:54 | |
| *** jmasud has joined #oooq | 08:55 | |
| *** pojadhav|lunch is now known as pojadhav | 09:04 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:15 | |
| marios | it is really bizarre "outside" is too quiet today (day #1 lockdown here) :( | 09:24 |
|---|---|---|
| *** d0ugal has quit IRC | 09:25 | |
| *** d0ugal has joined #oooq | 09:25 | |
| *** jbadiapa has quit IRC | 09:27 | |
| *** ykarel|lunch is now known as ykarel | 09:38 | |
| panda | marios: if you want we can meet and I'll make random noises during the day. | 09:46 |
| marios | panda: sounds good i'll get back to you | 09:47 |
| *** whoami-rajat is now known as whoami-rajat|lun | 09:50 | |
| *** whoami-rajat|lun is now known as whoami-rajat | 09:50 | |
| chandankumar | kopecmartin, Hello | 10:01 |
| kopecmartin | chandankumar: hi, what's up? | 10:02 |
| chandankumar | kopecmartin, Hello, got the answer on tripleo | 10:02 |
| chandankumar | zbr, can you take a look at tox-docs job failure on rdo | 10:04 |
| marios | panda noise.start() | 10:06 |
| zbr | with a link for sure | 10:06 |
| marios | while [ true ] | 10:06 |
| marios | killall panda | 10:07 |
| panda | marios: :PRRRRR | 10:07 |
| panda | marios: RATTLE RATTLE | 10:07 |
| marios | lol | 10:07 |
| panda | marios: TOOOT | 10:07 |
| panda | marios: CLANG CLANG CLANG | 10:07 |
| marios | kill -9 panda | 10:07 |
| chandankumar | zbr, https://logserver.rdoproject.org/87/26087/5/check/tox-docs/c46f0a2/job-output.txt | 10:07 |
| zbr | apparently unzip is missing from centos-8 image, can be installed but better to pre-build it. use bindep! | 10:09 |
| chandankumar | zbr, https://review.rdoproject.org/r/#/c/26098/ check patchset first | 10:10 |
| zbr | chandankumar: read the logs! "No package gtar available." | 10:12 |
| chandankumar | zbr, check this https://logserver.rdoproject.org/98/26098/1/check/tox-docs/c819924/job-output.txt | 10:13 |
| zbr | btw, i have no clue what this gtar is | 10:13 |
| chandankumar | zbr, https://docs.ansible.com/ansible/latest/modules/unarchive_module.html#notes | 10:14 |
| zbr | you are showing me another build, one that did not had unzip installed | 10:14 |
| chandankumar | zbr, updated patchset let see | 10:16 |
| zbr | chandankumar: the correct package name is "tar" not "gtar" | 10:16 |
| zbr | put tar and unzip and you should be fine | 10:16 |
| *** sshnaidm has quit IRC | 10:18 | |
| *** sshnaidm has joined #oooq | 10:19 | |
| *** holser has joined #oooq | 10:29 | |
| marios | panda: zbr: sshnaidm: chandankumar: can you please vote there when you get chance so i can avoid another rebase | 11:06 |
| marios | https://review.rdoproject.org/r/#/c/25794/ | 11:06 |
| marios | & that one https://review.rdoproject.org/r/#/c/25795/ please thanks | 11:07 |
| sshnaidm | marios, please rebase on my patch https://review.rdoproject.org/r/#/c/26083/ | 11:09 |
| marios | sshnaidm: but your one is changing fs39 stuff.. mine was older? | 11:09 |
| sshnaidm | marios, currently it's wrong defined, my patch is fixing it | 11:10 |
| sshnaidm | marios, in particular jobs for opendev.org/openstack/openstack-virtual-baremetal | 11:10 |
| marios | sshnaidm: sigh.. i asked for votes so we can merge it (e.g. i already had to rebase conflict for another ofyour patches there https://review.rdoproject.org/r/#/c/26077/ | 11:11 |
| sshnaidm | marios, sorry, I planned to land it yesterday, but outage.. | 11:11 |
| marios | sshnaidm: but now you're asking me to rebase again i don't think that's right... not saying you did that on purpose, but my patch was first... if there is aproblem with the files: then please comment on my patch and i will update it | 11:11 |
| marios | sshnaidm: i have many patches in play see (fs 39 @ https://hackmd.io/7MBqFHurTA2e5H8kYRwgag?both#Reviews-still-in-play-to-addmove-jobs) | 11:12 |
| sshnaidm | marios, well, it's not matter of first or not, definitions in current state are wrong | 11:12 |
| marios | sshnaidm: and its not easy to keep these all in play | 11:12 |
| sshnaidm | marios, let's combine these patches together then | 11:13 |
| sshnaidm | actually it what rebase means.. | 11:13 |
| marios | sshnaidm: so merge mine (which doesn't touch files) | 11:14 |
| marios | sshnaidm: then you can fix files on top? | 11:14 |
| marios | sshnaidm: my one adds the centos8 fs39 definition into the layout | 11:15 |
| sshnaidm | marios, yeah, and that's the problem | 11:15 |
| marios | sshnaidm: so if there is something wrong in my changes comment there with a review? and i can address it? | 11:15 |
| marios | sshnaidm: instead of fixing it in another review without telling anyone? | 11:16 |
| sshnaidm | marios, it's a lot of things wrong there unfortunately, somebody didn't include people in review | 11:16 |
| sshnaidm | marios, ok, let's not block you, I'll handle all this after you merge your patches, because it's a real mess there | 11:17 |
| marios | sshnaidm: "somebody didn't include people in review" i always put people on the review ? not sure what you mean https://review.rdoproject.org/r/#/c/25794/ folks are added there you too | 11:17 |
| sshnaidm | marios, I didn't mean you, but I don't remember reviewing OVB changes like it's configured now | 11:18 |
| sshnaidm | let's blame weshay|ruck | 11:18 |
| marios | sshnaidm: ah k ... thanks for considering my opinion here anyway | 11:18 |
| marios | zbr: fyi i am planning to update that https://review.opendev.org/#/c/713659/ for your comment but will wait for the current test to complete before doing it (not ignoring you) | 11:19 |
| marios | zbr: sorry meant that one ;) https://review.opendev.org/#/c/714065/ | 11:20 |
| *** tosky is now known as tosky_ | 11:24 | |
| *** yolanda has quit IRC | 11:27 | |
| chandankumar | sshnaidm, jpena https://review.rdoproject.org/r/#/c/26074/ | 11:27 |
| weshay|ruck | sshnaidm, marios re: job names? | 11:29 |
| weshay|ruck | chandankumar, you avail to help train for an hour? | 11:29 |
| chandankumar | weshay|ruck, about? | 11:30 |
| marios | weshay|ruck: we were discussing fs39 and https://review.rdoproject.org/r/#/c/25794 vs https://review.rdoproject.org/r/#/c/26083 (don't need you to do something now i think we resolved it) | 11:30 |
| weshay|ruck | k.. thanks | 11:30 |
| weshay|ruck | chandankumar, see ur cal | 11:31 |
| weshay|ruck | ysandeep, u ready? | 11:31 |
| marios | food biab | 11:31 |
| sshnaidm | chandankumar, jpena do we have "nodeset: centos-8" on vexx? | 11:31 |
| ysandeep | weshay|ruck, yes I am on call | 11:31 |
| *** yolanda has joined #oooq | 11:32 | |
| weshay|ruck | chandankumar, https://meet.google.com/hed-hzqk-eob?authuser=1 | 11:33 |
| *** sshnaidm has quit IRC | 11:34 | |
| *** sshnaidm has joined #oooq | 11:34 | |
| jpena | sshnaidm: yes, it uses the "cloud-centos-8" label, which is present in vexxhost | 11:37 |
| *** tosky_ is now known as tosky | 11:40 | |
| *** migi has quit IRC | 11:44 | |
| *** holser__ has joined #oooq | 11:52 | |
| *** holser has quit IRC | 11:52 | |
| zbr | sadly pyhton3-libselinux is still not present on centos-7, even if I remember reading that they agreed to provide it. probably is 7.8 stuff. | 11:55 |
| sshnaidm | marios, can you please add only periodic here? https://review.rdoproject.org/r/#/c/25794/7/zuul.d/tripleo.yaml | 12:00 |
| weshay|ruck | ysandeep, https://trello.com/b/j4IcIomh/production-chain-escalation | 12:00 |
| sshnaidm | marios, because I'll need to change all your changes | 12:00 |
| sshnaidm | marios, I'll need to apply https://review.rdoproject.org/r/#/c/26083/2/zuul.d/tripleo.yaml which mostly reconfigures everything | 12:01 |
| marios | sshnaidm: if you comment there and i can update. but if i understood correctly 'its hard to rebase onto your change' ... but if i rebase onto yours its easier? | 12:02 |
| sshnaidm | marios, or even easier if you do periodics part, and I'll do the check jobs part | 12:03 |
| marios | sshnaidm: but my change and yours are different if i understood... my change just adds the centos8 job names... doesn't change anything else/files or anything | 12:03 |
| marios | sshnaidm: ok. lets keep it simple. can you please comment on the change and point to the thing you want me to change? | 12:04 |
| marios | change :D | 12:04 |
| sshnaidm | marios, ok, nvrmnd, let's merge your patch :) | 12:04 |
| marios | sshnaidm: thanks sagi | 12:08 |
| *** sshnaidm is now known as sshnaidm|afk | 12:08 | |
| weshay|ruck | ysandeep, https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ | 12:14 |
| kopecmartin | zbr: weshay|ruck could you please review? affects only infrared plugin side https://review.opendev.org/#/c/713325/ | 12:16 |
| chandankumar | ysandeep, https://hackmd.io/sn48EeOoRjWNzvtV9IudxQ?edit | 12:17 |
| weshay|ruck | https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint23 | 12:21 |
| *** sshnaidm|afk is now known as sshnaidm | 12:24 | |
| chandankumar | ysandeep, https://hackmd.io/sn48EeOoRjWNzvtV9IudxQ?view#Things-to-keep-an-eye | 12:24 |
| *** rlandy has joined #oooq | 12:24 | |
| ysandeep | chandankumar, ack thank you :) | 12:26 |
| *** jpena is now known as jpena|lunch | 12:29 | |
| *** rfolco has joined #oooq | 12:30 | |
| weshay|ruck | https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint23 | 12:31 |
| *** ratailor has quit IRC | 12:32 | |
| *** udesale_ has joined #oooq | 12:42 | |
| *** udesale has quit IRC | 12:45 | |
| *** jmasud has quit IRC | 12:53 | |
| zbr | hilarious, docs change failing gate due to deployment. https://review.opendev.org/#/c/714460/ | 12:55 |
| *** Goneri has joined #oooq | 12:55 | |
| *** jmasud has joined #oooq | 12:56 | |
| *** holser__ has quit IRC | 13:06 | |
| *** amoralej is now known as amoralej|lunch | 13:12 | |
| marios | weshay|ruck: https://docs.openstack.org/tripleo-docs/latest/ci/stages-overview.html maybe that | 13:16 |
| marios | "for how it was before" | 13:16 |
| *** jbadiapa has joined #oooq | 13:25 | |
| *** ysandeep is now known as ysandeep|away | 13:31 | |
| *** jpena|lunch is now known as jpena | 13:32 | |
| *** holser has joined #oooq | 13:44 | |
| *** TrevorV has joined #oooq | 13:49 | |
| chandankumar | rlandy, https://review.rdoproject.org/r/#/c/25769/ is good to go | 13:53 |
| *** holser has quit IRC | 13:55 | |
| *** amoralej|lunch is now known as amoralej | 14:00 | |
| *** holser has joined #oooq | 14:01 | |
| *** holser has quit IRC | 14:05 | |
| *** holser has joined #oooq | 14:05 | |
| apetrich | weshay|ruck, is https://bugs.launchpad.net/tripleo/+bug/1868632 still happening? Is that that is blocking feature010? | 14:08 |
| openstack | Launchpad bug 1868632 in tripleo "overcloud-deploy fails w/ The Workflow errored and no messages were received. " [Critical,Triaged] - Assigned to Adriano Petrich (apetrich) | 14:08 |
| *** pojadhav is now known as pojadhav|away | 14:08 | |
| marios | sshnaidm: o/ commented there (about files: https://review.rdoproject.org/r/#/c/26083/4/zuul.d/tripleo.yaml ) fyi | 14:17 |
| marios | sshnaidm: thanks for rebasing | 14:17 |
| sshnaidm | marios, " also add roles/undercloud-deploy and roles/build-images " - for checking them with c7? | 14:20 |
| marios | sshnaidm: well for fs39 in general | 14:20 |
| sshnaidm | marios, why is it important for 039? | 14:20 |
| marios | sshnaidm: if you see those changes in my comment you can see the relevance | 14:21 |
| marios | https://review.opendev.org/#/c/714065/3/roles/undercloud-deploy/templates/install_novajoin.sh.j2 | 14:21 |
| marios | sshnaidm: ok maybe not the image build one cos its general for py3 | 14:21 |
| sshnaidm | marios, so it's enough install_novajoin.sh.j2 | 14:21 |
| marios | sshnaidm: ack fine yes | 14:22 |
| sshnaidm | marios, yeah, but it brought me another thought, we need to check build-images role for ovb c7 still | 14:22 |
| sshnaidm | marios, ok, seems like it runs ovb-branchless, so should be fine, ignore it | 14:23 |
| marios | sshnaidm: k... about the install_novajoin.sh maybe you need more than that (like there is a task which is ipa specific that generates that file sec let me find) | 14:23 |
| marios | sshnaidm: like that one where the template is rendered for example https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-deploy/tasks/novajoin_prep.yml | 14:24 |
| sshnaidm | marios, ok, let's add the whole role then | 14:25 |
| marios | sshnaidm: so maybe add that too, or just the whole role not sure maybe its overkill | 14:25 |
| marios | sshnaidm: k... | 14:25 |
| sshnaidm | rfolco, are you closing tasks now? | 14:28 |
| rfolco | sshnaidm, from sprint 21, 22 | 14:28 |
| sshnaidm | rfolco, are they moving to jira or..? | 14:28 |
| sshnaidm | rfolco, because some of them are not done at all | 14:29 |
| rfolco | we'll have to create new tasks in sprint 24 then | 14:29 |
| sshnaidm | rfolco, new US as well? | 14:29 |
| sshnaidm | rfolco, so should we reopen them of copy to new ones? | 14:30 |
| rfolco | sshnaidm, if its the same us, we can move to sprint 24, np | 14:30 |
| rlandy | sshnaidm: when you were testing ovb on centos 8 - did you hit introspection issues? | 14:32 |
| rfolco | sshnaidm, just tell me the stories you want to move, I can move them. Stories from sprint 22 are closed, but can be moved from the backlog screen to sprint 24. | 14:38 |
| sshnaidm | rfolco, set you by mail, these should be at least parked | 14:43 |
| sshnaidm | rlandy, ovb is working on c8 now | 14:43 |
| sshnaidm | rlandy, or what do you mean..? | 14:43 |
| rlandy | sshnaidm: yeah - I know ... debugging baremetal introspection and I wanted to know if you made a change to the nodes.json | 14:44 |
| rlandy | in ovb | 14:44 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/40/195040/6/check/periodic-tripleo-ci-centos-8-bm_envA-3ctlr_1comp-featureset001-master/9f95481/logs/undercloud/home/zuul/overcloud_prep_images.log | 14:44 |
| rlandy | got a hanging introspection in baremetal and the log is less than helpful | 14:45 |
| rlandy | sshnaidm: reason I am asking is that I see messages to update ipmi and mac and I don;t see those in ovb logs | 14:46 |
| rlandy | (which may be unrelated to the hang) | 14:46 |
| sshnaidm | rlandy, well, I see there 2 problems, one is timeout and seconds is bug in ansible task to get results | 14:47 |
| sshnaidm | rlandy, I'll handle the second one | 14:47 |
| rlandy | sshnaidm: yep - the first I need to debug | 14:47 |
| rlandy | the second - it would be helpful to get a hint of what went wrong | 14:48 |
| sshnaidm | rlandy, hmm, nodes seems in "manageable" | 14:48 |
| rlandy | sshnaidm: yep - introspection starts | 14:48 |
| rlandy | boots nodes | 14:48 |
| rlandy | so we have ipmi access | 14:48 |
| rlandy | and never completes | 14:49 |
| chandankumar | sshnaidm, rlandy please have a look when free https://review.rdoproject.org/r/#/c/25769/ for c8 third party testing | 14:49 |
| * rlandy will ping bfournie | 14:49 | |
| rlandy | chandankumar: sorry was in meeting - will look at previous review | 14:49 |
| sshnaidm | rlandy, is it reproducible? I can make a change to see more logs and we can depend on it | 14:49 |
| chandankumar | panda, are tripleo-ci-promotion-staging jobs are broken for c7? | 14:50 |
| rlandy | sshnaidm: yep - repeatable but b, deploys take a long time. I can depends-on on the next run | 14:50 |
| chandankumar | pojadhav|away, t\nERROR: Could not find a version that satisfies the requirement mistral-lib===2.0.0 (from -c | 14:50 |
| chandankumar | sorry | 14:50 |
| sshnaidm | rlandy, ack | 14:50 |
| chandankumar | panda, ^^ | 14:50 |
| rlandy | sshnaidm: now I want to debug the hang while I have the nodes in the that state | 14:50 |
| sshnaidm | rlandy, you mean you're on the host now? | 14:51 |
| rlandy | sshnaidm: host and have a console to the overcloud nodes | 14:51 |
| panda | chandankumar: link ? | 14:51 |
| rlandy | yes - I am on the host | 14:51 |
| chandankumar | panda, https://logserver.rdoproject.org/97/26097/1/check/tripleo-ci-promotion-staging-single-pipeline-centos-7/580d319/job-output.txt | 14:51 |
| sshnaidm | rlandy, ok, so you can just run introspection now? | 14:52 |
| rlandy | yep | 14:52 |
| panda | chandankumar: it appears so, and it's upper contraints' fault again | 14:53 |
| chandankumar | panda, is there any plan to move those jobs to c8? | 14:53 |
| panda | chandankumar: the sooner we move to centos8 the better ... | 14:53 |
| panda | chandankumar: is the UA asking me about sprint's plans ? :) | 14:53 |
| chandankumar | panda, hehe, I will take care of that | 14:54 |
| chandankumar | let me fire up few patches | 14:54 |
| panda | chandankumar: I have patches | 14:54 |
| apetrich | weshay|ruck, cheers! | 14:54 |
| panda | chandankumar: to start working in that direction | 14:54 |
| sshnaidm | rlandy, can you run this task? http://paste.openstack.org/show/791134/ | 14:54 |
| chandankumar | panda, link ? | 14:54 |
| panda | chandankumar: I discussed with wes about moving everything to c8, not sure if it ended up being on the sprint. | 14:55 |
| panda | chandankumar: this is the start https://review.rdoproject.org/r/26022 | 14:55 |
| sshnaidm | rlandy, and just pass a node "node_uuids_intro" | 14:55 |
| sshnaidm | or tmate | 14:56 |
| rlandy | sshnaidm: as a separate playbook or add it to an existing one? | 14:56 |
| chandankumar | rlandy, by the way full tempest split patches are merged now https://review.rdoproject.org/r/26035 and https://review.rdoproject.org/r/26080 and criteria review is here https://review.rdoproject.org/r/#/c/26097/ | 14:56 |
| *** udesale_ has quit IRC | 14:57 | |
| sshnaidm | rlandy, if no tmate, than something like this http://paste.openstack.org/show/791136/ | 14:58 |
| sshnaidm | rlandy, need to point ansible modules to find tripleo-ansible modules | 14:58 |
| sshnaidm | rlandy, like /usr/share/... | 14:59 |
| rlandy | sshnaidm: running now | 15:03 |
| rlandy | see the node boot | 15:03 |
| weshay|ruck | out of mtgs | 15:05 |
| *** beagles is now known as beagles_mtg | 15:06 | |
| sshnaidm | rlandy, still running? | 15:09 |
| weshay|ruck | sshnaidm, hey :) | 15:09 |
| sshnaidm | weshay|ruck, hi | 15:09 |
| weshay|ruck | so the public cockpit is still not showing the latest code.. /me looks | 15:09 |
| rlandy | sshnaidm: rekicked in tmate | 15:09 |
| * weshay|ruck looks into it.. | 15:09 | |
| rlandy | so you can also watch the fun | 15:09 |
| sshnaidm | weshay|ruck, I'm inclined to disable mysql for now to free it for updates | 15:10 |
| weshay|ruck | sshnaidm, ok by me | 15:10 |
| sshnaidm | weshay|ruck, ok, will do today later | 15:10 |
| weshay|ruck | ok.. thanks | 15:10 |
| rlandy | weshay|ruck: sshnaidm: in other news drac doesn't require containers any more - works on my laptop - they must have upgraded | 15:11 |
| weshay|ruck | panda, you around? can we chat for 5 min | 15:11 |
| marios | chandankumar: looks like the topic branch changed? don't see the tempest one any more ... but anyway can you add the changes to https://bugs.launchpad.net/tripleo/+bug/1868938 ? | 15:11 |
| openstack | Launchpad bug 1868938 in tripleo "tempest_tempest_conf_overrides ignored in the featureset if set in job featureset_override" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 15:11 |
| weshay|ruck | panda, re: next sprint.. want to give you some insight to some future work | 15:11 |
| sshnaidm | rlandy, using web java? | 15:11 |
| marios | chandankumar: nm found it from depends on will add | 15:12 |
| rlandy | sshnaidm: yes - need to try ilo again | 15:12 |
| sshnaidm | rlandy, cool | 15:12 |
| panda | weshay|ruck: ok | 15:12 |
| weshay|ruck | panda, https://meet.google.com/uii-gdtr-skc?authuser=1 | 15:13 |
| weshay|ruck | panda, http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17/component/ | 15:16 |
| marios | chandankumar: sshnaidm: when you get a chance please vote on that one to remove the override from fs52 https://review.opendev.org/#/c/714909/ | 15:20 |
| sshnaidm | marios, seems like standalone actually fails on tempest in this patch | 15:23 |
| marios | sshnaidm: ah let me check sec | 15:24 |
| rlandy | chandankumar: sorry weshay|ruck already merged your patches before I could review | 15:24 |
| marios | sshnaidm: yeah its a test though unrelated http://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_35b/714909/1/check/tripleo-ci-centos-8-standalone/35bb0b4/logs/undercloud/var/log/tempest/stestr_results.html | 15:24 |
| marios | sshnaidm: will recheck | 15:24 |
| *** ykarel is now known as ykarel|away | 15:25 | |
| marios | sshnaidm: thanks for checking lets see if it persists | 15:28 |
| weshay|ruck | git up and go :) | 15:29 |
| *** bogdando has quit IRC | 15:29 | |
| arxcruz|rover | weshay|ruck: so, i guess the CI Escalation was one hour ago right? | 15:30 |
| weshay|ruck | yup | 15:30 |
| weshay|ruck | we're good | 15:30 |
| weshay|ruck | arxcruz|rover, you can renick... | 15:30 |
| arxcruz|rover | still wrong in the rhos calendar | 15:30 |
| weshay|ruck | YOU ARE FREE | 15:30 |
| *** arxcruz|rover is now known as arxcruz | 15:30 | |
| arxcruz | YES! | 15:31 |
| marios | arxcruz: \o/ welcome back | 15:31 |
| arxcruz | who will be the rr ? | 15:31 |
| weshay|ruck | FREE AT LAST FREE AT LAST | 15:31 |
| weshay|ruck | THANK GOD ALMIGHTY | 15:31 |
| marios | weshay|ruck: does it mean arx has to go into isolation now with rlandy for 2 weeks? | 15:31 |
| marios | sorry bad joke :/ | 15:32 |
| marios | :( | 15:32 |
| weshay|ruck | too soon? | 15:32 |
| arxcruz | marios: i am in isolation for 3 weeks already | 15:32 |
| weshay|ruck | lolz | 15:32 |
| weshay|ruck | covid humor | 15:32 |
| rlandy | arxcruz: come on over | 15:32 |
| marios | yah right? | 15:32 |
| rlandy | I could use the company | 15:32 |
| marios | arxcruz: ah sorry man bad joke for sure then | 15:32 |
| arxcruz | marios: normal 3 weeks lol | 15:32 |
| marios | arxcruz: yeah well same here we've kinda been isolating as much as possible for ~10 days but since yesterday its law here | 15:32 |
| marios | arxcruz: so i have to print a special paper to leave the house (like in other countries) | 15:33 |
| arxcruz | but being honest, I'm used to stay at home for log period of time, but the idea that I really can't leave home is driving me crazy | 15:33 |
| marios | arxcruz: yeah... and it isn't just about me as you said, 'this is pretty much my life already' ... but kids etc makes it complicated | 15:33 |
| arxcruz | marios: yeah, my daughter today said: why do you have meetings in english instead of portuguese? | 15:34 |
| arxcruz | I said: because my boss doesn't speak portuguese | 15:34 |
| marios | :) | 15:34 |
| arxcruz | and she said: talk in german then | 15:34 |
| arxcruz | i told her he doesn't speak german either | 15:34 |
| arxcruz | and now she told me: you should speak with your boss in german so he can learn | 15:34 |
| marios | arxcruz: bless | 15:34 |
| arxcruz | weshay|ruck: get ready ^ | 15:34 |
| arxcruz | marios: but since disney+ she's less bored | 15:35 |
| weshay|ruck | rlandy, chandankumar they already ran in the pipeline periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master periodic-tripleo-ci-centos-8-standalone-full-tempest-api-master (2. attempt) | 15:41 |
| * weshay|ruck checks results | 15:41 | |
| weshay|ruck | chandankumar++ | 15:42 |
| weshay|ruck | not bad https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master/4366d79/logs/undercloud/var/log/tempest/stestr_results.html.gz | 15:42 |
| weshay|ruck | just a timeout AssertionError: Timed out waiting for 10.100.0.14 to become reachable from 192.168.24.110 | 15:43 |
| weshay|ruck | arxcruz, now keep me posted on multi-threading scenarios :) | 15:43 |
| arxcruz | weshay|ruck: ack | 15:44 |
| marios | zbr: we have new deps issue for py27 tests? https://review.rdoproject.org/r/#/c/25795/ tox-py27 failed there https://review.rdoproject.org/r/#/c/25795/ =================================== log end ==================================== | 15:46 |
| marios | ERROR: could not install deps [pytest-cov, -chttps://releases.openstack.org/constraints/upper/master, -r/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/test-requirements.txt, -r/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/dlrnapi_promoter/requirements.txt, -r/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/dlrnapi_promoter/test-requirements.txt, | 15:46 |
| marios | -r/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf/requirements.txt]; v = InvocationError(u'/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/.tox/py27/bin/pip install -U pytest-cov -chttps://releases.openstack.org/constraints/upper/master -r/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/test-requirements.txt | 15:46 |
| marios | -r/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/dlrnapi_promoter/requirements.txt -r/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/dlrnapi_promoter/test-requirements.txt -r/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf/requirements.txt', 1) | 15:46 |
| marios | oops sorry | 15:46 |
| marios | that line looked shorter on my screen :/ | 15:46 |
| marios | ERROR: No matching distribution found for mistral-lib===2.0.0 | 15:47 |
| zbr | marios: let me guess: openstack upper constraints f*** us. | 15:47 |
| marios | zbr: maybe only just saw it | 15:47 |
| marios | yah looks like its from upper contraints | 15:48 |
| zbr | it will only get worse, we had 3 last week. | 15:48 |
| zbr | weshay|ruck: i am close to declare that using py27 with upper constraints from master become close to impossible. | 15:48 |
| weshay|ruck | zbr, ya.. can we chat about that stuff? | 15:48 |
| zbr | should we talk to made decision on that? | 15:49 |
| weshay|ruck | chandankumar, :) https://review.rdoproject.org/r/#/c/26101/ | 15:49 |
| zbr | if marios can join even better (or others) | 15:49 |
| weshay|ruck | marios, you have 5min to chat w/ zbr and I? | 15:49 |
| marios | weshay|ruck: sure | 15:50 |
| weshay|ruck | zbr, marios https://meet.google.com/psz-ivjq-agn?authuser=1 | 15:51 |
| marios | https://review.rdoproject.org/r/#/c/25795/ | 15:52 |
| *** pojadhav|away is now known as pojadhav | 15:53 | |
| chandankumar | weshay|ruck, I have got the criteria patch https://review.rdoproject.org/r/#/c/26097/ | 15:56 |
| weshay|ruck | oh ok.. sorry | 15:57 |
| weshay|ruck | chandankumar, qq.. do we have similiar patches to split fs20? | 15:57 |
| chandankumar | weshay|ruck, fs split is already done | 15:57 |
| chandankumar | by marios | 15:57 |
| marios | chandankumar: o/ weshay|ruck there https://tree.taiga.io/project/tripleo-ci-board/task/1383 | 16:01 |
| chandankumar | weshay|ruck, https://review.rdoproject.org/r/#/c/25769/ +2 and +w | 16:07 |
| marios | https://review.rdoproject.org/r/#/c/25795/ | 16:09 |
| marios | zbr: ^^ | 16:09 |
| marios | weshay|ruck: fyi/fwiw (cos you mentioned code search ) i use that a lot http://paste.openstack.org/raw/791150/ (search all three of them ) | 16:12 |
| *** beagles_mtg is now known as beagles | 16:21 | |
| weshay|ruck | marios, OH.. i didn't know they had a client | 16:22 |
| weshay|ruck | thanks | 16:22 |
| marios | weshay|ruck: not a client i just added alias into my bash profile | 16:28 |
| marios | weshay|ruck: just allowed me to combine upstream/rdo/dstream search into one command (and you can change firefox to whatever browser you use) | 16:29 |
| weshay|ruck | OH | 16:29 |
| weshay|ruck | chandankumar, qq on https://review.rdoproject.org/r/#/c/25769/ | 16:37 |
| zbr | weshay|ruck: on ci-config we have concoction of requirements that makes installation impossible: https://github.com/rdo-infra/ci-config/blob/master/tox.ini#L40-L43 | 16:38 |
| zbr | it makes no sense, as these files are into conflicts. | 16:39 |
| zbr | we should not have different reqs | 16:39 |
| weshay|ruck | zbr, ya.. seems like we need different jobs based on the path of the repo | 16:39 |
| zbr | what is even more interesting is how it was possible to introduce that | 16:40 |
| chandankumar | weshay|ruck, replied | 16:40 |
| weshay|ruck | zbr, example excludes https://review.rdoproject.org/r/#/c/26097/ | 16:40 |
| zbr | appearently the major source of issues is rrcockpit and i don't want to touch that again | 16:40 |
| *** jbadiapa has quit IRC | 16:40 | |
| weshay|ruck | zbr, let's break out the jobs :) | 16:40 |
| zbr | here is the deal: if a role has requirments, it should install them itself, not us pre-installing those for the role. | 16:41 |
| * marios shutdown sequence | 16:43 | |
| marios | taiga gets all messed up, the second rfolco gets back from holiday | 16:47 |
| marios | coincidence? | 16:47 |
| marios | :D | 16:47 |
| * marios runs | 16:47 | |
| rfolco | :-O | 16:48 |
| rfolco | how | 16:48 |
| rfolco | u | 16:48 |
| rfolco | dare | 16:48 |
| *** marios is now known as marios|out | 16:53 | |
| *** jmasud has quit IRC | 16:53 | |
| *** jmasud has joined #oooq | 16:56 | |
| *** rfolco is now known as rfolco|bbl | 16:58 | |
| *** marios|out has quit IRC | 16:58 | |
| weshay|ruck | 2020-03-25 16:51:43.244986 | TASK [ovb-manage : Recover idnum] | 17:03 |
| weshay|ruck | 2020-03-25 16:51:43.890906 | primary | cat: /home/zuul/workspace/ovb/idnum: No such file or directory | 17:03 |
| weshay|ruck | 2020-03-25 16:51:54.415862 | primary | ERROR | 17:03 |
| weshay|ruck | 2020-03-25 16:51:54.416261 | primary | { | 17:03 |
| weshay|ruck | 2020-03-25 16:51:54.416327 | primary | "delta": "0:00:00.002460", | 17:03 |
| weshay|ruck | 2020-03-25 16:51:54.416371 | primary | "end": "2020-03-25 16:51:43.891277", | 17:03 |
| weshay|ruck | 2020-03-25 16:51:54.416410 | primary | "msg": "non-zero return code", | 17:03 |
| weshay|ruck | 2020-03-25 16:51:54.416448 | primary | "rc": 1, | 17:03 |
| weshay|ruck | 2020-03-25 16:51:54.416486 | primary | "start": "2020-03-25 16:51:43.888817" | 17:03 |
| weshay|ruck | 2020-03-25 16:51:54.416524 | primary | } | 17:03 |
| weshay|ruck | rlandy, what do you make of that one? ^ | 17:03 |
| weshay|ruck | stack didn't come up? | 17:03 |
| rlandy | seen that before | 17:03 |
| rlandy | link? | 17:04 |
| weshay|ruck | https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset001&job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001 | 17:04 |
| *** dtantsur is now known as dtantsur|afk | 17:06 | |
| weshay|ruck | rlandy, I think rdo is down | 17:06 |
| rlandy | weshay|ruck: I see | 17:08 |
| rlandy | 2020-03-25 14:26:22.470438 | TASK [Assert role has worked in (CentOS|RedHat) 8] | 17:08 |
| rlandy | 2020-03-25 14:26:22.563235 | primary | ERROR | 17:08 |
| rlandy | 2020-03-25 14:26:22.563545 | primary | { | 17:08 |
| rlandy | 2020-03-25 14:26:22.563631 | primary | "assertion": "\"invalid username/password\" in registry_login_podman.results.0.stderr", | 17:08 |
| rlandy | ie: no stack created | 17:08 |
| rlandy | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/tripleo-rdo-base/container-login.yaml@master] | 17:10 |
| weshay|ruck | rlandy, aye.. registry is down | 17:10 |
| rlandy | weshay|ruck: yeah so the error is because there is no stack to delete | 17:11 |
| weshay|ruck | rlandy, thanks | 17:11 |
| *** derekh has joined #oooq | 17:14 | |
| sshnaidm | weshay|ruck, I think registry was moved(?) today, or should be moved soon | 17:18 |
| weshay|ruck | sshnaidm, ya.. writing that email now | 17:19 |
| weshay|ruck | sshnaidm, so.. it looks like ovb jobs use a mirror for the registry | 17:19 |
| weshay|ruck | [whayutin@localhost testenv]$ egrep -rn registry * | 17:19 |
| weshay|ruck | multinode.yml:11:undercloud_docker_registry_mirror: "{{ lookup('env','NODEPOOL_DOCKER_REGISTRY_V2_PROXY') }}" | 17:19 |
| weshay|ruck | ovb.yml:21:undercloud_docker_registry_mirror: "{{ lookup('env','NODEPOOL_DOCKER_REGISTRY_V2_PROXY') }}" | 17:19 |
| weshay|ruck | singlenode.yml:11:undercloud_docker_registry_mirror: "{{ lookup('env','NODEPOOL_DOCKER_REGISTRY_V2_PROXY') }}" | 17:19 |
| weshay|ruck | standalone.yml:11:undercloud_docker_registry_mirror: "{{ lookup('env','NODEPOOL_DOCKER_REGISTRY_V2_PROXY') }}" | 17:19 |
| weshay|ruck | [whayutin@localhost testenv]$ | 17:19 |
| weshay|ruck | but if you can't login.. I guess jobs are just down | 17:19 |
| weshay|ruck | because I think we log into both | 17:19 |
| weshay|ruck | docker.io and rdo | 17:19 |
| weshay|ruck | meh | 17:20 |
| sshnaidm | why do we login | 17:20 |
| sshnaidm | no need to login in check jobs | 17:20 |
| weshay|ruck | yes.. | 17:20 |
| weshay|ruck | 2020-03-25 16:51:03.772831 | TASK [Assert role has worked in (CentOS|RedHat) 8] | 17:20 |
| weshay|ruck | 2020-03-25 16:51:03.836284 | primary | ERROR | 17:20 |
| weshay|ruck | 2020-03-25 16:51:03.836563 | primary | { | 17:20 |
| weshay|ruck | 2020-03-25 16:51:03.836604 | primary | "assertion": "\"invalid username/password\" in registry_login_podman.results.0.stderr", | 17:20 |
| weshay|ruck | 2020-03-25 16:51:03.836635 | primary | "evaluated_to": false, | 17:20 |
| weshay|ruck | 2020-03-25 16:51:03.836665 | primary | "msg": "Role failed authentication with ." | 17:20 |
| weshay|ruck | 2020-03-25 16:51:03.836693 | primary | } | 17:20 |
| weshay|ruck | https://logserver.rdoproject.org/87/501987/31/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/8cad206/job-output.txt | 17:20 |
| sshnaidm | weshay|ruck, registry_login_enabled: false | 17:21 |
| sshnaidm | and should be fine | 17:22 |
| weshay|ruck | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-rdo-base/container-login.yaml#L65 | 17:24 |
| weshay|ruck | nope | 17:24 |
| weshay|ruck | poorly written | 17:24 |
| *** jpena is now known as jpena|off | 18:00 | |
| *** irclogbot_2 has quit IRC | 18:37 | |
| *** rfolco|bbl is now known as rfolco | 18:39 | |
| *** amoralej is now known as amoralej|off | 18:59 | |
| *** irclogbot_2 has joined #oooq | 19:01 | |
| rlandy | weshay|ruck: wrt aggregate hash, | 19:02 |
| weshay|ruck | aye | 19:02 |
| rlandy | I noticed yesterday that the top-level current-tripleo did not have the same hashes as the component current-tripleo | 19:03 |
| rlandy | it took a while to sync up | 19:03 |
| rlandy | idk if that was just a rdo cloud hitch | 19:03 |
| rlandy | or if that is the request to not change the top level until all hashes have updated | 19:04 |
| weshay|ruck | rlandy, OH.. so you are saying.. a compnent promoted to current-tripleo.. you noted the baseurl for the component.. and current-tripleo/delorean.repo in the base dir did not match | 19:05 |
| weshay|ruck | the baseurl's did not match | 19:05 |
| weshay|ruck | panda, note that test case ^ | 19:06 |
| dpawlik | ah so conversation moved here | 19:06 |
| rlandy | yes | 19:06 |
| rlandy | weshay|ruck: I'd have to watch the next promotion to see if it's always the case | 19:07 |
| weshay|ruck | rlandy, sounds to me like we need to add a unit test case to the dlrn src to ensure the two match | 19:07 |
| rlandy | weshay|ruck: so we requested a sync'ed change | 19:07 |
| weshay|ruck | what's a synced change? | 19:07 |
| rlandy | ie: when all the components have promoted | 19:08 |
| rlandy | is there a wait time? | 19:08 |
| weshay|ruck | there should not be.. /me looks at latest changes | 19:08 |
| weshay|ruck | rlandy, this will help that cause.. or should https://softwarefactory-project.io/r/#/c/17748/ | 19:11 |
| weshay|ruck | rlandy, and then of course our change https://review.rdoproject.org/r/#/c/25931/ | 19:12 |
| rlandy | looking | 19:13 |
| rlandy | weshay|ruck: so ... let's say we're in the integration line ... and baremetal promotes ... | 19:15 |
| rlandy | (with the above changes) | 19:15 |
| rlandy | until ui promotes, | 19:16 |
| weshay|ruck | rlandy, put this on the sprint https://tree.taiga.io/project/tripleo-ci-board/task/1589?kanban-status=1447274 | 19:16 |
| rlandy | the hash in the top-level will be the old hash, right | 19:16 |
| rlandy | and the component will have what? | 19:16 |
| weshay|ruck | impossible over irc https://meet.google.com/prk-wvrv-wfc?authuser=1 | 19:16 |
| rlandy | it's ok | 19:17 |
| rlandy | adding to the card | 19:17 |
| rlandy | weshay|ruck: k - added to card, thanks | 19:21 |
| dpawlik | weshay|ruck, sshnaidm I turn on back the old registry | 19:22 |
| weshay|ruck | both layers should promote at the same time | 19:22 |
| weshay|ruck | dpawlik, ? | 19:22 |
| dpawlik | it can take a while when DNS propgation is done | 19:22 |
| weshay|ruck | dpawlik, you are not providing enough context | 19:23 |
| weshay|ruck | dpawlik, is the one in vex going down now? | 19:23 |
| dpawlik | weshay|ruck, no :) I turn on the previous one to check few things. It is just FYI | 19:24 |
| weshay|ruck | dpawlik, it's important to provide context my man :) | 19:24 |
| dpawlik | weshay|ruck, like: don't be surprised that the old one is not down like I said | 19:24 |
| dpawlik | weshay|ruck, sorry | 19:24 |
| weshay|ruck | dpawlik, is there anyone assisting you? | 19:24 |
| dpawlik | will talk with sshnaidm | 19:25 |
| *** Trevor_V has joined #oooq | 19:28 | |
| *** TrevorV has quit IRC | 19:32 | |
| *** irclogbot_2 has quit IRC | 19:37 | |
| *** irclogbot_0 has joined #oooq | 19:39 | |
| *** irclogbot_0 has quit IRC | 19:42 | |
| *** irclogbot_3 has joined #oooq | 19:45 | |
| weshay|ruck | rfolco, can you start a sprint summary doc please | 19:47 |
| rlandy | should master be using iptables or firewalld? | 19:53 |
| rfolco | weshay|ruck, mtg notes for planning on hackmd ? or a separate hackmd doc ? | 19:57 |
| weshay|ruck | rfolco, no hackmd.. the sprint summary the way you normally do it | 20:00 |
| rfolco | oh the summary report for the last sprint | 20:00 |
| rfolco | ok ok | 20:00 |
| weshay|ruck | rfolco, I'll fill in the details | 20:00 |
| rfolco | thanks | 20:00 |
| *** irclogbot_3 has quit IRC | 20:00 | |
| *** irclogbot_1 has joined #oooq | 20:03 | |
| *** irclogbot_1 has quit IRC | 20:12 | |
| *** irclogbot_1 has joined #oooq | 20:15 | |
| *** irclogbot_1 has quit IRC | 20:16 | |
| *** irclogbot_2 has joined #oooq | 20:21 | |
| weshay|ruck | arxcruz, can you mark this https://hackmd.io/7MBqFHurTA2e5H8kYRwgag read only please or give me admin | 20:38 |
| *** tosky has quit IRC | 20:40 | |
| weshay|ruck | rlandy, oooof https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?result=success | 20:51 |
| weshay|ruck | looking for an older branch to compare it to | 20:52 |
| rlandy | weshay|ruck: I'm on the older host | 20:52 |
| rlandy | env C | 20:52 |
| rlandy | has 1500 mtus | 20:52 |
| weshay|ruck | on the undercloud? | 20:53 |
| *** tosky has joined #oooq | 20:54 | |
| *** jmasud has quit IRC | 20:54 | |
| rlandy | on all | 20:55 |
| rlandy | checking where ovb sets its mtus | 20:55 |
| *** jmasud has joined #oooq | 20:56 | |
| rlandy | you can check do-ci-fx2-06-s4.v103.rdoci.lab.eng.rdu2.redhat.com | 20:57 |
| rlandy | rdo | 20:57 |
| *** rfolco has quit IRC | 20:58 | |
| *** jmasud has quit IRC | 21:10 | |
| rlandy | weshay|ruck: https://code.engineering.redhat.com/gerrit/#/c/195040/ | 21:29 |
| *** derekh has quit IRC | 21:34 | |
| *** dpawlik has quit IRC | 21:35 | |
| *** derekh has joined #oooq | 21:42 | |
| *** derekh has quit IRC | 21:44 | |
| *** jmasud has joined #oooq | 22:29 | |
| *** Trevor_V has quit IRC | 22:49 | |
| *** jfrancoa has quit IRC | 23:13 | |
| *** chem has quit IRC | 23:26 | |
| *** chem has joined #oooq | 23:27 | |
| *** rlandy has quit IRC | 23:51 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!