| *** rlandy|ruck|bbl is now known as rlandy|ruck | 01:31 | |
| *** marios is now known as marios|ruck | 05:51 | |
| *** ykarel|away is now known as ykarel | 06:12 | |
| *** amoralej|off is now known as amoralej | 07:00 | |
| marios|ruck | bhagyashris: o/ hey in https://bugs.launchpad.net/tripleo/+bug/1936776/comments/1 did you mean to point to a different bug? "I see the related bug: [1] https://bugs.launchpad.net/tripleo/+bug/1936776 " it points to the same bug | 08:03 |
|---|---|---|
| chandankumar | marios|ruck: o/ https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/801192 to close this https://bugs.launchpad.net/tripleo/+bug/1936287 | 08:04 |
| marios|ruck | chandankumar: thanks will check in bit | 08:04 |
| *** bhagyashris_ is now known as bhagyashris | 08:05 | |
| marios|ruck | bhagyashris: o/ hey in https://bugs.launchpad.net/tripleo/+bug/1936776/comments/1 did you mean to point to a different bug? "I see the related bug: [1] https://bugs.launchpad.net/tripleo/+bug/1936776 " it points to the same bug | 08:07 |
| bhagyashris | marios|ruck, my bad updated | 08:10 |
| bhagyashris | https://bugs.launchpad.net/tripleo/+bug/1935974 | 08:10 |
| bhagyashris | wrong link was posted now corrected here : https://bugs.launchpad.net/tripleo/+bug/1936776/comments/1 | 08:11 |
| marios|ruck | bhagyashris: ah thanks | 08:13 |
| marios|ruck | chandankumar: bhagyashris: soniya|rover: lets sync? | 08:30 |
| marios|ruck | 11:04 < chandankumar> marios|ruck: o/ https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/801192 | 08:45 |
| marios|ruck | branches: * http://38.102.83.109/promoter_logs/ is the same as promoter.rdoproject.org yes confirmed via curl | 08:48 |
| marios|ruck | master: * http://10.0.148.74/promoter_logs/ | 08:48 |
| marios|ruck | centos7: * http://10.0.148.59/promoter_logs/ | 08:48 |
| bhagyashris | http://10.0.148.74/promoter_logs/ | 08:48 |
| bhagyashris | master ^ | 08:48 |
| bhagyashris | http://promoter.rdoproject.org/promoter_logs/ (w, v, u and t) | 08:49 |
| marios|ruck | thanks bhagyashris chandankumar | 08:49 |
| chandankumar | marios|ruck: yw :-) | 08:49 |
| * zbr if anyone wonders, i started a personal CR backlog cleansing session this morning... | 09:02 | |
| zbr | sshnaidm: do we have job for publishing collections? | 09:18 |
| soniya|rover | marios|ruck, i was having lunch | 09:21 |
| marios|ruck | soniya|rover: k we had a scheduled call for the ruck|rover hand off | 09:22 |
| marios|ruck | soniya|rover: let me know if you need something. i am filing a new scen1 bug right now then i will try and catchup on the cix ongoing bugs maybe you can do same? | 09:23 |
| sshnaidm | zbr, in progress | 09:23 |
| soniya|rover | marios|ruck, okay | 09:24 |
| zbr | ok, i abandoned some older work in that direction (zuul-jobs). | 09:24 |
| zbr | sshnaidm: can you +W these https://review.opendev.org/q/topic:%22reqconstraints%22+(status:open%20OR%20status:merged) | 09:32 |
| *** bhagyashris_ is now known as bhagyashris | 09:35 | |
| sshnaidm | zbr, mm.. this is validations, I'd give a chance to validation folks to merge it :) | 09:36 |
| zbr | they raised it, passed CI, i only got involved because i was added as reviewer. I am sure it cannot hurt. | 09:36 |
| zbr | is a generic workaround for speeding pip installs | 09:36 |
| zbr | if you remember my work on constraints.txt, that was another method to make it very fast. | 09:37 |
| zbr | the less we use the pip resolver, the faster it gets. | 09:37 |
| *** ykarel is now known as ykarel|lunch | 10:25 | |
| zbr | marios|ruck: sshnaidm dviroel: triple.repos collection is ready: https://review.opendev.org/c/openstack/tripleo-repos/+/801621 | 10:37 |
| marios|ruck | zbr: ack added to reviews list | 10:44 |
| zbr | marios|ruck: btw, i updated your review at https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/793331 to make use of collection install. i will look for results. | 10:49 |
| zbr | i am not sure if you also need the CLI of you needed only ansible part. | 10:50 |
| marios|ruck | bhagyashris: o/ hey regarding https://bugs.launchpad.net/tripleo/+bug/1937035 - was there only one example of this? I can't find any more and the description is only pointing to one (if you cant remember np just say) | 10:54 |
| marios|ruck | zbr: hmmm... then you need to recheck at https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486 and also the downstream test https://code.engineering.redhat.com/gerrit/c/testproject/+/200295 | 10:55 |
| marios|ruck | bhagyashris: chandankumar: any idea about that? https://bugs.launchpad.net/tripleo/+bug/1937035/comments/4 | 11:01 |
| marios|ruck | bhagyashris: as a general rule if we only file a bug if we see it 2 or more times | 11:01 |
| dviroel | zbr: nice, i'll take a look | 11:08 |
| rlandy | bhagyashris: hi - want to meet at half past the hour? like in 17 mins rather for pre-planning? | 11:12 |
| bhagyashris | rlandy, sure | 11:20 |
| bhagyashris | i am free now | 11:20 |
| marios|ruck | bhagyashris: when you get a chance see my comments above thanks | 11:21 |
| marios|ruck | bhagyashris: especially 14:01 < marios|ruck> bhagyashris: chandankumar: any idea about that? https://bugs.launchpad.net/tripleo/+bug/1937035/comments/4 | 11:22 |
| bhagyashris | marios|ruck, i dont have much idea i see it's reported yesterday and yesterday i was on sick leave | 11:22 |
| marios|ruck | bhagyashris: ah thanks i will harrass chandankumar instead then :D | 11:22 |
| marios|ruck | chandankumar: please check 14:01 < marios|ruck> bhagyashris: chandankumar: any idea about that? https://bugs.launchpad.net/tripleo/+bug/1937035/comments/4 | 11:22 |
| bhagyashris | and day before yesterday was public holiday | 11:23 |
| bhagyashris | marios|ruck, no problem | 11:23 |
| marios|ruck | bhagyashris: ack ... for some reason i thought you filed that but it was chandankumar sorry | 11:23 |
| bhagyashris | marios|ruck, np | 11:23 |
| rlandy | bhagyashris, k - joining the meeting | 11:29 |
| bhagyashris | ok give me 2 min | 11:29 |
| zbr | marios|ruck: let me know when you have few minutes to explain me your patch about installing yum_config. I got a small surprise, that ansible is not installed: https://review.rdoproject.org/zuul/build/018f43aa7f04407195ba0fc7ad77ff75 | 11:32 |
| marios|ruck | zbr: the run on that from yesterday is green https://review.rdoproject.org/zuul/build/d3101eba16d449c2b9e03e8df0140847 | 11:34 |
| marios|ruck | zbr: could it be something you updated? or somethign else unrelated possibly | 11:34 |
| marios|ruck | zbr: but anyway as mentioned earlier, that is just the install.. the real test is the patch that depends-on that one there https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486 | 11:35 |
| marios|ruck | zbr: ah actually that is from the other patch 791486 14:34 < marios|ruck> zbr: the run on that from yesterday is green https://review.rdoproject.org/zuul/build/d3101eba16d449c2b9e03e8df0140847 | 11:35 |
| zbr | i tried to use ansible to install the collection but ansible is not yet installed. so basically you try to copy some ansible modules onto a machine that does not yet have ansible installed. | 11:36 |
| marios|ruck | zbr: but still from yesterday it was not hitting the issue you saw (ran for 2hrs https://review.rdoproject.org/zuul/build/f94626719fdc402d9f37158a82e22ff0 | 11:36 |
| zbr | that is because it was not calling ansible | 11:37 |
| marios|ruck | zbr: but i thought your patch was reverted though? | 11:37 |
| zbr | nope, alex created a revert but after i explain him he agreed that the revert is not needed. | 11:37 |
| zbr | he did not want to see ansible modules inside python packages, that was the concern | 11:38 |
| marios|ruck | zbr: k | 11:38 |
| zbr | clearly the collection installation needs to happen later, after ansible is installed, but i am not sure where ansilble gets installed. | 11:39 |
| zbr | also keep in mind that ansible modules do not need to be installed on nodes, only on controller. ansible will know how to copy them to nodes when needed. | 11:40 |
| zbr | i suspect the number of places where we need to install the triple.repos collection would be quite lower than the current patch, right? | 11:41 |
| zbr | if I would guess, we likely need to do it only inside qs | 11:43 |
| rlandy | marios|ruck: hey - how goes it in ruck/rover land? will catch up before you EOD or when you have a moment | 11:45 |
| marios|ruck | rlandy: ack sure we can catch up later... going through cix at the moment | 11:45 |
| zbr | sshnaidm: can you give me access to tripleo namespace on galaxy (or manually publish the collection once)? | 11:50 |
| sshnaidm | zbr, what's your username there? | 11:50 |
| zbr | ssbarnea | 11:51 |
| *** ykarel|lunch is now known as ykarel | 11:52 | |
| sshnaidm | zbr, check it now | 11:53 |
| zbr | sshnaidm: thanks. i see it. | 11:54 |
| zbr | i will do it manually first to allow us to test the other bits. | 11:54 |
| sshnaidm | zbr, not sure I understand this patch https://review.opendev.org/c/openstack/tripleo-repos/+/801621 - did you convert it to collection and no command line tool now? | 11:57 |
| zbr | command line tool remains, no change on that bit. "pip install tripleo-repos" install all 3 clis | 11:58 |
| zbr | but that will not install any ansible modules, ansible modules are installed as part of the collection. | 11:58 |
| zbr | if you do install the collection, you do not need to install python module, it works without installing it. (is embedded). | 11:58 |
| zbr | basically the two distribution models are independent | 11:59 |
| zbr | one provides python modules/clis, and the other one ansible bits. | 11:59 |
| zbr | haha, good that i tried upload, galaxy refused it, small nit. | 12:00 |
| sshnaidm | zbr, I think it tests with ansible-test now before upload | 12:04 |
| zbr | ahh, right. so we will need few more rounds of fixes, for sanity for start which i postponed to keep review size small. | 12:06 |
| zbr | sshnaidm: first version is up at https://galaxy.ansible.com/tripleo/repos -- now i can start testing it. i needed few minor tweaks, it does not run ansible-test. | 12:12 |
| marios|ruck | chandankumar: around? re https://trello.com/c/85yCXxqV/2017-cixlp1934879tripleociproa-victoriaussuritrain-c8tempestlibexceptionstimeoutexception-request-timed-out-failing-in-scenario004-st#comment-60f56155596cb84113aeac1c do you know what we are waiting for? i am testing with https://bugs.launchpad.net/tripleo/+bug/1934879/comments/6 | 12:17 |
| marios|ruck | chandankumar: when you have a minute, please check 1. https://trello.com/c/85yCXxqV/2017-cixlp1934879tripleociproa-victoriaussuritrain-c8tempestlibexceptionstimeoutexception-request-timed-out-failing-in-scenario004-st#comment-60f96244b5208c111ba382eb and 2. | 12:19 |
| marios|ruck | https://trello.com/c/HD7Czc2N/2031-cixlp1937035tripleociproa-create-router-failed-with-the-server-didnt-respond-in-time-504-gateway-time-out#comment-60f950cee848f46cf97828be | 12:20 |
| chandankumar | marios|ruck: sure | 12:21 |
| marios|ruck | chandankumar: thanks | 12:22 |
| chandankumar | marios|ruck: I have seened one time in periodic so filed it | 12:22 |
| chandankumar | marios|ruck: But I agree with the general rule if a job fails twice only then file | 12:23 |
| chandankumar | for integration and component line | 12:23 |
| marios|ruck | chandankumar: k as commented there we only have one example of it then it was green again | 12:24 |
| marios|ruck | chandankumar: 'there' i mean on the bug https://bugs.launchpad.net/tripleo/+bug/1937035/comments/4 | 12:25 |
| marios|ruck | chandankumar: what about the ceph one are we waiting on something else to happen after the pull request merged? | 12:25 |
| chandankumar | marios|ruck: for above bug we have a fix also https://review.opendev.org/c/openstack/tripleo-heat-templates/+/801761 | 12:26 |
| marios|ruck | chandankumar: i have posted the tests to try and find out but asking as you commented on the bug 'it will take some time' | 12:26 |
| marios|ruck | chandankumar: yeah i commented there... i am a bit concerned about fixing somethign if it isn't broken though https://review.opendev.org/c/openstack/tripleo-heat-templates/+/801761/1#message-b6d5dcd5f50962a167d5619ee8b342183bbf9b5b | 12:26 |
| chandankumar | marios|ruck: looking at ceph pull request | 12:26 |
| marios|ruck | chandankumar: especially to change a default value... | 12:26 |
| *** amoralej is now known as amoralej|lunch | 12:28 | |
| zbr | marios|ruck: it seem that i was able to impersonate you by accident: https://review.opendev.org/c/openstack/tripleo-quickstart/+/801776 | 12:32 |
| dviroel | lol | 12:33 |
| zbr | i wanted to avoid changing your CR that made use of get_hash, removed the changeid to create a new one, but when i uploaded i forgot to rewrite the git author. result is a change from you uploaded by me. | 12:34 |
| marios|ruck | zbr: it has owner zbr there though so not completely impersonated | 12:34 |
| zbr | which is kinda correct as you were the original author of the patch, that is only a variation. | 12:34 |
| marios|ruck | zbr: but still wtf | 12:34 |
| zbr | i mentioned to avoid confusions. i am curious if that will work. | 12:35 |
| marios|ruck | zbr: however i would much prefer that we change my patch https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486 which contains all my revisions and work thus far rather than a new one | 12:35 |
| chandankumar | marios|ruck: updated the comment for manila ceph https://bugs.launchpad.net/tripleo/+bug/1934879/comments/4 | 12:35 |
| marios|ruck | zbr: if it is for testing, fine, but please don't merge https://review.opendev.org/c/openstack/tripleo-quickstart/+/801776 | 12:35 |
| zbr | nopb, if it works i can abandon this and update yours. | 12:35 |
| zbr | i suspect i missed to add sudo to galaxy install, and it will install the collection only for current user. | 12:36 |
| *** ykarel_ is now known as ykarel | 12:38 | |
| zbr | does anyone know who calls `bootstrap_ansible_via_rpm` function because i see it defined but nobody is calling it inside the same repo | 12:38 |
| pojadhav | rlandy, we can skip 1:1.. as I dont have any agenda to discuss with.. :) | 12:38 |
| rlandy | pojadhav: sure | 12:38 |
| marios|ruck | chandankumar: but does it apply for upstream too? ah because those containers aren't built by us ? | 12:39 |
| chandankumar | marios|ruck: yes, it applies for upstream too, tom commented here with more clarity https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/801736/2#message-e8d8a3f5da47c62df4a0dc2b7e7bde8aa884e7ac | 12:41 |
| marios|ruck | chandankumar: well tom said that master might pass there... | 12:41 |
| marios|ruck | chandankumar: k let's see what happens in the test and i'll try and get them to clarify on the card or bug | 12:42 |
| marios|ruck | chandankumar: thanks | 12:42 |
| chandankumar | marios|ruck: thanks for chasing it down :-) | 12:42 |
| bhagyashris | arxcruz, zbr, sshnaidm, rlandy, marios|ruck , ysandeep, bhagyashris, svyas, soniya29|rover , pojadhav, akahat, weshay, chandankumar, frenzy_friday, dviroel | 12:56 |
| bhagyashris | Tripleo CI planning meeting in 4 mins | 12:56 |
| bhagyashris | https://hackmd.io/P5sTPMSBREe5kBS_4jDhIg#2021-07-22-Unified-Sprint-48-Planning @ line no- 197 | 12:57 |
| bhagyashris | zbr, planning meeting | 13:01 |
| rlandy | ssamal: good morning! | 13:02 |
| marios|ruck | soniya29|rover: o/ are you working on something ? if not can you please help me on the cix. i got up to the first card in degraded - can you carry on please? | 13:02 |
| marios|ruck | soniya29|rover: i will try and continue tomorrow | 13:02 |
| marios|ruck | soniya29|rover: basically trying to see what we can close out etc/catchup on the status for those and comment as necessary | 13:02 |
| soniya29|rover | marios|ruck, ruck, sure | 13:02 |
| soniya29|rover | marios|ruck, I will continue with the first card | 13:03 |
| marios|ruck | soniya29|rover: i commented on the first card so start with the 2nd one in degraded | 13:04 |
| marios|ruck | soniya29|rover: some of those might be fixed already, or some we need to check if we can revert the skips etc | 13:04 |
| soniya29|rover | marios|ruck, okay | 13:05 |
| marios|ruck | rlandy: http://dashboard-ci.tripleo.org/d/Z4vLSmOGk/cockpit?orgId=1 | 13:07 |
| chandankumar | marios|ruck: rlandy https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/34616 | 13:09 |
| chandankumar | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/34615 | 13:09 |
| chandankumar | arxcruz: https://src.fedoraproject.org/rpms/python-stevedore it is not available for EPEL8 | 13:15 |
| *** amoralej|lunch is now known as amoralej | 13:29 | |
| marios|ruck | zbr: rejoining us? | 14:07 |
| marios|ruck | reviews please https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486 | 14:09 |
| marios|ruck | sshnaidm: pojadhav: bhagyashris: fyi https://projects.engineering.redhat.com/browse/TRIPLEOCI-580 | 14:23 |
| sshnaidm | frenzy_friday, can you pass link please to sova patch? | 14:26 |
| frenzy_friday | sshnaidm, https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/787502 | 14:26 |
| rlandy | marios|ruck: soniya29|rover: pojadhav: do you want to meet re: cockpit briefly? push to tomorrow? | 14:34 |
| soniya29|rover | rlandy, let's do it tommorrow | 14:34 |
| pojadhav | rlandy, will do tomorrow if all agree? | 14:34 |
| rlandy | soniya29|rover: marios|ruck: pojadhav: ack ^^ feel free to meet w/o me and fix the gating | 14:34 |
| zbr | marios|ruck: i tried to describe the work done with tripleo.repos on the ticket to make it easier to understand what is needed/done. let me know if I was clear enough. https://projects.engineering.redhat.com/browse/TRIPLEOCI-559 | 14:35 |
| marios|ruck | zbr: ack looks good | 14:35 |
| rlandy | marios|ruck: soniya29|rover: pls ping me when you are EoD and will follow tasks in tripleo-ci chat in the afternoon | 14:35 |
| marios|ruck | rlandy: will do | 14:35 |
| pojadhav | sshnaidm, i think cockpit service needs to restart..? as your patches got merged but panel looks like not working properly.. | 14:35 |
| * marios|ruck fetch coffee brb | 14:35 | |
| sshnaidm | pojadhav, looking | 14:36 |
| rlandy | akahat: sent you meeting invite for tomorrow re: scenario010 patches | 14:37 |
| sshnaidm | pojadhav, restarted, let's keep an eye | 14:40 |
| pojadhav | sshnaidm, sure | 14:41 |
| sshnaidm | pojadhav, did we add logs publish to sprint? | 14:41 |
| pojadhav | nope | 14:42 |
| zbr | rlandy: can you please help me with something related to quickstart.sh, particularry install-deps side? Where is ansible really installed? | 14:47 |
| rlandy | zbr: that's a loaded question | 14:47 |
| rlandy | we install different ansibles in diff places | 14:48 |
| zbr | i seen stuff like installing python, python deps, other rpms but not the ansible bit and i need to add a command to run "ansible-galaxy install ..." | 14:48 |
| zbr | if you can point me to those it would be great as i cannot really install the collection if I do not have ansible-galaxy command (part of ansible) | 14:49 |
| rlandy | inside zuul jobs - ansible in installed ahead of our hitting quickstart.sh | 14:49 |
| rlandy | probably the cleanest quicksh.sh run is what is run in ci.centos jobs | 14:50 |
| rlandy | no zuul pre-playbooks at hand | 14:50 |
| rlandy | so there is the ansible openstack uses and the one the ci set ups | 14:50 |
| rlandy | zbr: you'll also note that we have a bunch of playbooks tha are called in build-image and container build jobs that have ansible that never run quickstart.sh | 14:52 |
| rlandy | zbr: so what's your exact scope? | 14:52 |
| rlandy | then I can send the relevant links | 14:52 |
| zbr | rlandy: take a look at https://review.opendev.org/c/openstack/tripleo-quickstart/+/801776 and you will understand. | 14:53 |
| zbr | we have a new collection that we need to install it, i need to find the right place to inject the install bit. | 14:54 |
| *** ykarel_ is now known as ykarel | 14:56 | |
| rlandy | yea - but your question where anisble itself is installed ... | 14:56 |
| rlandy | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/install-deps.sh#L252 | 14:56 |
| rlandy | if that is still in use | 14:57 |
| zbr | rlandy: and small surprise for you: https://codesearch.opendev.org/?q=bootstrap_ansible_via_rpm&i=nope&files=&excludeFiles=&repos= | 14:57 |
| zbr | earlier today I asked: where is this code called from... i only see it defined. | 14:57 |
| rlandy | zbr: ^^ so it is never run? | 14:57 |
| zbr | clearly not from code inside opendev.org | 14:58 |
| rlandy | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/requirements.txt#L2 well we lay down a requirement | 14:59 |
| zbr | ok, that is clearly a good start | 14:59 |
| zbr | so basically inside bootstrap() | 15:00 |
| rlandy | let's see where jobs think ansible comes from | 15:01 |
| rlandy | zbr: so looking at a ci.centos log: https://ci.centos.org/job/tripleo-quickstart-promote-master-current-tripleo-delorean-minimal/943/artifact/collect_logs.txt | 15:03 |
| rlandy | Requirement already satisfied: ansible<2.10,>=2.9 in /home/jenkins/workspace/tripleo-quickstart-promote-master-current-tripleo-delorean-minimal/lib/python3.6/site-packages (from -r requirements.txt (line 2)) (2.9.23) | 15:03 |
| rlandy | ^^ coming from tripleo-ci | 15:03 |
| zbr | i made a change, we will see soon. | 15:04 |
| rlandy | Installing build dependencies: started | 15:05 |
| rlandy | so it looks like that is the cleanest check | 15:05 |
| zbr | probably is more than one place but that one should be the most important one, i think i know what error i did. | 15:05 |
| rlandy | you should kick a quickstart job with any change that to quickstart and extras | 15:05 |
| zbr | i tried to do "sudo ansible..." but if ansible was installed for current user from pip, no wonder why i got command not found. | 15:05 |
| rlandy | good to know | 15:06 |
| rlandy | on df call - ping of needed | 15:06 |
| rlandy | if | 15:06 |
| *** ykarel is now known as ykarel|away | 15:08 | |
| zbr | thanks! | 15:09 |
| zbr | kopecmartin: i got a strange ir error on a test: install: error: the following arguments are required: TYPE | 15:09 |
| zbr | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f78/792652/8/check/openstack-tox-molecule/f787465/tox/reports.html | 15:09 |
| zbr | did something changed with infrared? | 15:10 |
| marios|ruck | rlandy: any idea if there is something up with the tooling that makes the cix cards? i filed that today https://bugs.launchpad.net/tripleo/+bug/1937236 but didn't show up yet i can't spot what is missing (tag, importance, milestone/?) | 15:17 |
| marios|ruck | rlandy: i added promotion-blocker to that one too https://bugs.launchpad.net/tripleo/+bug/1936825 but it also doesn't show up | 15:18 |
| rlandy | marios|ruck: I noticed it took some time when chandankumar filed one | 15:18 |
| marios|ruck | rlandy: k i'll check tomorrow then | 15:18 |
| rlandy | marios|ruck: it used to run in a box under weshay's desk | 15:19 |
| rlandy | I have a note from him with latest deploy | 15:19 |
| marios|ruck | rlandy: maybe he took it to the mountains with him | 15:19 |
| rlandy | let me check | 15:19 |
| marios|ruck | rlandy: k thanks | 15:19 |
| rlandy | pojadhav++ sshnaidm++ cockpit looks better | 15:24 |
| rlandy | marios|ruck: soniya29|rover: ^^ | 15:24 |
| sshnaidm | yay | 15:24 |
| marios|ruck | great thanks sshnaidm and pojadhav reporting looks fixed for gate now | 15:25 |
| marios|ruck | soniya29|rover: me and rlandy will sync in 5 for a few mins if you are still around (I know is late for you) | 15:25 |
| soniya29|rover | marios|ruck, sure | 15:26 |
| soniya29|rover | marios|ruck, I will join | 15:26 |
| marios|ruck | soniya29|rover: ack | 15:27 |
| chandankumar | marios|ruck: rlandy logging out now, see ya tomorrow | 15:28 |
| rlandy | chandankumar: have a good night | 15:28 |
| marios|ruck | o/ have a good 1 chandankumar | 15:28 |
| marios|ruck | rlandy: soniya29|rover: https://meet.google.com/kev-mmgv-tch | 15:29 |
| *** rlandy is now known as rlandy|ruck | 15:31 | |
| zbr | just fond another repo where pip takes forever to install deps, artcl... time to add pip-compile to it. | 15:32 |
| akahat | rlandy|ruck, ack. | 15:38 |
| pojadhav | sshnaidm, zbr, chandankumar, rlandy|ruck : pls have a look when free https://review.opendev.org/q/topic:%2522wallaby-upgrade-jobs%2522+(status:open+OR+status:merged)+owner:+pojadhav | 15:55 |
| *** pojadhav is now known as pojadhav|afk | 15:56 | |
| soniya29|rover | marios|ruck, leaving for today | 15:56 |
| marios|ruck | ack have a good 1 soniya29|rover | 15:57 |
| marios|ruck | soniya29|rover: me too in few ;) | 15:57 |
| soniya29|rover | marios|ruck, yeah, byee | 15:57 |
| rlandy|ruck | ok | 15:58 |
| marios|ruck | zbr: sorry for giving you a hard time on the call earlier you didn't deserve it, just frustrated that it was close to merging and now needs a fixup which i am not even going to get to do cos ruck | 16:06 |
| zbr | marios|ruck: i am glad is not personal. yep, i know what frustration means, today I had to abandon ~40-50 CRs during cleanup session | 16:10 |
| zbr | you can believe that it almost make you cry to know the amount of effort you put in each of them, and know that you throw them away | 16:10 |
| zbr | at least in that case nothing is thrown away | 16:10 |
| marios|ruck | zbr: ack thanks | 16:12 |
| zbr | i still have failures as even if collection gets installed, later I get error about failing to find module, but i will figure it out. https://zuul.opendev.org/t/openstack/build/67c58fe0b0a14b0183a4b3a539b4767a | 16:13 |
| marios|ruck | zbr: yes this 'couldn't find the module' was the biggest source of pain here and why i was installing it the way i was | 16:14 |
| zbr | apparently galaxy install installs collection into a bit weird location: /home/zuul/src/opendev.org/openstack/tripleo-quickstart/collections/ansible_collections/tripleo/repos | 16:14 |
| zbr | that is clearly not among the default search paths of ansible, i suspect we alter ANSIBLE_COLLECTION_PATH somewhere | 16:15 |
| marios|ruck | zbr: https://review.opendev.org/c/openstack/tripleo-quickstart/+/791486/34/ansible.cfg | 16:16 |
| zbr | that is not involved for collection, but i found the place where we did alter it. | 16:16 |
| zbr | in fact that is one of the great benefits of using collections: we no longer need to alter ansible paths. | 16:16 |
| zbr | altering stuff like "library" or "roles_path" is quite evil and risky, it can easily backfile. | 16:17 |
| zbr | with silent bugs like name shadowing where you endup with multiple different versions and you never really know which one was used. | 16:18 |
| marios|ruck | rlandy|ruck: off in a couple mins need sthing? | 16:21 |
| rlandy|ruck | marios|ruck: nope - have a good night | 16:21 |
| marios|ruck | thanks hope you have a quiet one rlandy|ruck o/ | 16:24 |
| *** marios|ruck is now known as marios|out | 16:24 | |
| *** amoralej is now known as amoralej|off | 16:32 | |
| kopecmartin | zbr: no idea .. let me check | 16:55 |
| rlandy|ruck | eagles: hello ... I am debugging a standaloen scenario010 failure on rhos-17 ... | 18:33 |
| rlandy|ruck | Details: (PoolScenarioTest:setUpClass) show_loadbalancer provisioning_status failed to update to ACTIVE within the required time 900. Current status of show_loadbalancer: PENDING_CREATE | 18:33 |
| rlandy|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-scenario010-standalone-rhos-17/ab9a682/logs/undercloud/var/log/tempest/stestr_results.html | 18:33 |
| rlandy|ruck | showing up in the network component line and the integration line | 18:33 |
| rlandy|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-scenario010-standalone-rhos-17/f34835f/logs/undercloud/var/log/tempest/stestr_results.html | 18:34 |
| rlandy|ruck | eagles: before I log a bug - is there something up front you can spot? | 18:34 |
| eagles | rlandy|ruck: looking | 18:51 |
| rlandy|ruck | eagles: thanks - if I skip that test it will be all of octaiva testing | 19:05 |
| rlandy|ruck | which I would prefer not to do | 19:05 |
| rlandy|ruck | we had scanrio010 passing in downstream all along | 19:05 |
| eagles | nothing jumps out .. 1s | 19:09 |
| rlandy|ruck | ok - I'll bug it and skip it for investigation | 19:10 |
| rlandy|ruck | so the network component can promote and the 17 line | 19:10 |
| eagles | rlandy|ruck: I've asked johnsom to have a look to see if something jumps out | 19:12 |
| rlandy|ruck | eagles: thanks - creating bug for tracking (bugzilla - since it's internal) | 19:12 |
| eagles | rlandy|ruck: ack thanks | 19:12 |
| johnsom | Looks like nova from the summary page. Still digging | 19:13 |
| rlandy|ruck | eagles: what's the correct component? openstack-octavia? nova? | 19:13 |
| eagles | rlandy|ruck: you can put openstack-octavia - I'll flip it to nova it that turns out to be the source of the issue | 19:14 |
| rlandy|ruck | perfect - thanks | 19:14 |
| eagles | rlandy|ruck: thanks 10^6 | 19:14 |
| johnsom | Yeah, it might be that nova vif issue the perf team was seeing | 19:15 |
| eagles | johnsom: I saw an error in that looked like a duplicate mac but not sure if that's the implementation detecting something wrong and backing off or an actual error | 19:16 |
| eagles | "Interface already exists" | 19:17 |
| johnsom | Yeah, that is fine. It is a retry after the initial nova boot of the vm took too long. | 19:17 |
| eagles | ack | 19:18 |
| rlandy|ruck | https://bugzilla.redhat.com/show_bug.cgi?id=1985079 | 19:19 |
| * eagles nods | 19:20 | |
| rlandy|ruck | skipping for the moment so we have time ":) | 19:20 |
| johnsom | lol, it took 13 minutes for nova to boot a VM???? | 19:26 |
| johnsom | Yeah, so that errored in the setup class before it could start the Octavia tests. It looks like the nova boot time is too slow there for the current test timeout settings. No errors in Octavia or Nova here. | 19:31 |
| johnsom | I am guessing this is some kind of nested virtualization environment without the KVM nested virt extensions enabled. Or your disk io is in bad shape. | 19:32 |
| eagles | oh hah, not a good scene | 19:39 |
| johnsom | Yeah, it's a test environment failure. | 19:39 |
| eagles | rlandy|ruck: is this something that is occurring over and over or is this the first run where this has happened? | 19:39 |
| johnsom | That should take between 30 seconds and 1:30 normally. | 19:40 |
| rlandy|ruck | eagles: for about a week in the integration line .. the bug contains the info and link of when it started | 19:40 |
| rlandy|ruck | we had node failures over the weekend due to psi update | 19:41 |
| johnsom | Do you have a disk down in your storage array? | 19:41 |
| rlandy|ruck | after that - flat fails | 19:41 |
| rlandy|ruck | so may be related | 19:41 |
| eagles | ack, I'll spread it around some internal whiteboards to get some more eyes on | 20:09 |
| *** sshnaidm is now known as sshnaidm|afk | 20:10 | |
| *** rlandy|ruck is now known as rlandy|ruck|biab | 23:17 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!