| *** amoralej|off is now known as amoralej | 06:06 | |
| jpodivin | chkumar|ruck: I'm having trouble with DLRN-rpmbuild for tripleoclient in RDO. Do you know who I should ping about that? | 06:22 |
|---|---|---|
| chkumar|ruck | jpodivin: you can amoralej on #rdo channel (he also hangs here) | 06:26 |
| chkumar|ruck | *can ping | 06:26 |
| jpodivin | chkumar|ruck: thanks, will do | 06:26 |
| *** bhagyashris is now known as bhagyashris|out | 06:26 | |
| marios | chkumar|ruck: o/ when you next have time please add to your review queue https://review.opendev.org/c/openstack/tripleo-ci/+/834320 | 09:38 |
| chkumar|ruck | marios: \o, please have a look when free https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/836988 thanks! | 09:41 |
| marios | chkumar|ruck: ack thanks for checking will revisit | 09:42 |
| marios | chkumar|ruck: o/ https://review.rdoproject.org/r/c/rdo-jobs/+/40842/2#message-c20afa3058f45f16d66fe0df34aabb70f5d92d3d in case you see anything strange in scen1-4 standalone (it was tested but just in case we miss something else) | 10:19 |
| chkumar|ruck | marios: sure, thanks for the heads up! | 10:19 |
| chkumar|ruck | jm1: please vote on this https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/41764 when back! | 10:27 |
| *** chem is now known as Guest1672 | 10:29 | |
| rlandy | chkumar|ruck: jm1: how are things today? | 10:29 |
| rlandy | let's sync if you're around | 10:29 |
| rlandy | chkumar|ruck: downstream still down? | 10:30 |
| chkumar|ruck | rlandy: yes, issue with new zuul itself | 10:30 |
| rlandy | gee | 10:30 |
| rlandy | chkumar|ruck: https://meet.google.com/tes-zkyc-qhw?pli=1&authuser=0 | 10:31 |
| chkumar|ruck | rlandy: ovb jobs will fail during stack create | 10:31 |
| chkumar|ruck | due to baremetal issue on vexxhost | 10:31 |
| chkumar|ruck | rlandy: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-internal-standalone-train&skip=0 | 10:34 |
| chkumar|ruck | rlandy: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/41238 | 10:35 |
| *** rlandy_ is now known as rlandy | 10:50 | |
| chkumar|ruck | jm1: rlandy https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/41784 for master promotion | 10:50 |
| rlandy | akahat: hi - the promoter keep failing on promoting train c7 again | 10:50 |
| rlandy | can you debug that | 10:50 |
| rlandy | it's still trying | 10:50 |
| frenzy_friday | bot pls add to review list https://review.rdoproject.org/r/c/rdo-jobs/+/40553 | 10:57 |
| reviewbot | I have added your review to the Review list | 10:58 |
| chkumar|ruck | rlandy: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/41784 | 11:08 |
| *** dviroel|out is now known as dviroel | 11:15 | |
| marios | chkumar|ruck: rlandy: anyone else want to join us with review time? | 11:16 |
| jm1 | rlandy: hey :) i guess you already synced with chkumar|ruck? | 11:17 |
| rlandy | jm1: on review time - will sync with you again after review time | 11:18 |
| rlandy | jm1: pls nick | 11:18 |
| rlandy | you need to be |rover | 11:18 |
| *** jm1|ruck is now known as jm1|rover | 11:18 | |
| jm1 | rlandy: upps, o/c, changed it to jm1|rover | 11:19 |
| jm1|rover | rlandy: here i am.. | 11:19 |
| jm1 | rlandy: split personality 🙊 | 11:20 |
| rlandy | jm1|rover: pls join https://meet.google.com/vzm-nrah-qqf?authuser=0 | 11:23 |
| chkumar|ruck | rlandy: I think we lost you | 11:26 |
| rlandy | ykarel: hello ... is there still work on https://bugs.launchpad.net/tripleo/+bug/1964940? not blocking us but the CIX is still open | 11:35 |
| ykarel | rlandy, i got back from PTO today, will check latest status on it | 11:35 |
| rlandy | ykarel: thanks - no rush - just cleaning CIX board | 11:36 |
| chkumar|ruck | https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/build-containers | 11:44 |
| Guest1672 | and it crashed | 12:03 |
| jpodivin | chkumar|ruck: I'm running into trouble with cross-swift-py36 and cross-swift-py27 in stable/train of the requirements project. | 12:22 |
| jpodivin | there seems to be some sort of encoding issue. But I don't know enough about swift properly diagnose it. | 12:23 |
| rlandy | jpodivin: storage team | 12:26 |
| rlandy | christian? | 12:26 |
| *** amoralej is now known as amoralej|lunch | 12:28 | |
| jpodivin | rlandy: ack, Is there a tag I should mark it with? Or will the ci/promotion blocker suffice? | 12:30 |
| rlandy | promotion blocker will get it to CIX | 12:31 |
| rlandy | that is all you need | 12:31 |
| jpodivin | rlandy: ok done | 12:35 |
| rlandy | dasm: can you review https://review.opendev.org/c/openstack/tripleo-docs/+/835782 - let us know if you are still -1 there | 12:41 |
| chkumar|ruck | rlandy: I have not addressed the comment | 12:42 |
| chkumar|ruck | on this patch | 12:42 |
| jpodivin | rlandy: regarding the https://bugs.launchpad.net/tripleo/+bug/1968184 I'm wondering if this sort of modification could have helped https://review.opendev.org/c/openstack/tripleo-ci/+/834631/1/roles/run-test/templates/common_vars.bash.j2 | 12:42 |
| chkumar|ruck | got updated due to testing of this https://review.opendev.org/c/opendev/git-review/+/823413 (know fix for fedora 36) | 12:42 |
| jpodivin | it's derived from what some of the other projects with nonstandard branch names are doing | 12:43 |
| rlandy | jpodivin: chkumar|ruck | 12:50 |
| rlandy | s patch fixes the general problem | 12:50 |
| rlandy | which is probably needed anyways | 12:51 |
| chkumar|ruck | rlandy: validation-common is a special case as their branch name got changed | 12:51 |
| chkumar|ruck | I think https://review.opendev.org/c/openstack/tripleo-ci/+/834631 would be a good approach | 12:51 |
| chkumar|ruck | then we can remove validation-common from branchless project | 12:52 |
| jpodivin | chkumar|ruck: ok. I'm gooing to update the message on the review and move it out of the WIP | 12:57 |
| jpodivin | chkumar|ruck: done, review is open https://review.opendev.org/c/openstack/tripleo-ci/+/834631 | 13:00 |
| rcastillo | o/ | 13:00 |
| chkumar|ruck | jpodivin: please add closes-bug https://bugs.launchpad.net/bugs/1968184 in the review | 13:02 |
| jpodivin | chkumar|ruck: Ok, I'll do it in a minute, we're having a meeting | 13:02 |
| *** amoralej|lunch is now known as amoralej | 13:14 | |
| rlandy | chkumar|ruck: jm1|rover: periodic-tripleo-ci-build-containers-ubi-8-push-wallaby passed | 13:17 |
| rlandy | were you investigating that one? | 13:18 |
| jm1|rover | rlandy: yes | 13:23 |
| jm1|rover | rlandy: reran successfully | 13:23 |
| jm1|rover | rlandy: details in ruck rover notes | 13:24 |
| dasm|off | chkumar|ruck: qq, are you OK with my feedback here? https://review.opendev.org/c/openstack/tripleo-docs/+/835782 If not, I can remove -1 and submit these changes in a separate chakge | 13:25 |
| dasm|off | *change | 13:25 |
| chkumar|ruck | dasm|off: I can submit those changes in a seperate patch | 13:26 |
| chkumar|ruck | currently on rr shift | 13:26 |
| *** dasm|off is now known as dasm | 13:27 | |
| dasm | chkumar|ruck: would you like me to do that for you? | 13:27 |
| chkumar|ruck | dasm: go ahead :-) | 13:27 |
| dasm | ack | 13:27 |
| chkumar|ruck | rlandy: cix | 13:31 |
| marios | folks please have a look when you get a chance thank you -> https://review.rdoproject.org/r/c/rdo-jobs/+/41663 | 13:37 |
| marios | rlandy: chkumar|ruck: dviroel: arxcruz: o/ please check when you have time thanks https://review.opendev.org/c/openstack/tripleo-ci/+/837343 && https://review.rdoproject.org/r/c/rdo-jobs/+/41663 | 13:41 |
| akahat | rlandy, c7_train promoted: http://promoter.rdoproject.org/promoter_logs/centos7_train_2022-04-11T13:15.log | 13:52 |
| * dasm will join scrum after srbac | 13:59 | |
| marios | jm1|rover: https://hackmd.io/FGMoCiRfSNa8puA1BpTQ-Q?edit thanks | 14:27 |
| chkumar|ruck | rlandy: hello | 14:57 |
| rlandy | chkumar|ruck: hi | 14:57 |
| chkumar|ruck | rlandy: Do we want to open a bug for ovb retry limit? I have added info here: https://hackmd.io/1lRiCS-oS3-J1ZYHZH3Xzg?view#11th-Apr-2022 | 14:57 |
| chkumar|ruck | rlandy: we are still seeing few | 14:57 |
| rlandy | chkumar|ruck: then yes - for tracking - pls | 14:58 |
| rlandy | we can close it when we no longer see the issue | 14:58 |
| chkumar|ruck | rlandy: can you help jm1 on that as a exercise | 14:58 |
| rlandy | chkumar|ruck: jm1|rover: going into prod chain cal - pls ping when you are EoD and what you want watched | 14:58 |
| rlandy | downstream should be back now | 14:59 |
| chkumar|ruck | rlandy: I am logging out now | 14:59 |
| rlandy | periodic-tripleo-ci-centos-9-standalone-full-tempest-api-network-wallabytestprojectmastercheck36255,46 | 14:59 |
| rlandy | 1 hr 50 mins 16 secs2022-04-11 12:23:51SUCCESS | 14:59 |
| rlandy | chkumar|ruck: ^^ passed | 14:59 |
| chkumar|ruck | rlandy: awesome | 14:59 |
| rlandy | should promote network | 14:59 |
| chkumar|ruck | rlandy: for new master promotion, we just need 39 | 15:02 |
| rlandy | chkumar|ruck: do you want a new testproject? | 15:02 |
| chkumar|ruck | rlandy: https://review.rdoproject.org/r/c/testproject/+/40169 | 15:02 |
| rlandy | ah - thanks | 15:02 |
| chkumar|ruck | rlandy: for cs9 wallaby we need only fs064 running here jm1|rover 's patch https://review.rdoproject.org/r/c/testproject/+/41794 | 15:05 |
| rlandy | great | 15:05 |
| * jm1|rover bbl | 15:06 | |
| chkumar|ruck | see ya tomorrow jm1|rover rlandy \o | 15:08 |
| rlandy | have a good night | 15:08 |
| jm1|rover | chkumar|ruck: thanks for your help :) bye | 15:08 |
| dasm | chkumar|ruck: your docs patch https://review.opendev.org/c/openstack/tripleo-docs/+/835782 got +W | 15:16 |
| rlandy | jm1|rover: when you are back - can you rerun failed jobs from wallaby c8 | 15:24 |
| rlandy | may be some legit failures | 15:24 |
| rlandy | not sure | 15:24 |
| * dviroel going lunch + take car to repair shop - brb | 15:32 | |
| *** dviroel is now known as dviroel|lunch|afk | 15:32 | |
| *** marios is now known as marios|out | 16:08 | |
| rlandy | current-tripleo/2022-04-11 13:21 rhos-17 on rhel-9 promoted | 17:22 |
| *** amoralej is now known as amoralej|off | 17:30 | |
| rlandy | lunch - brb | 18:07 |
| * dviroel ice cream - biab | 18:19 | |
| jm1|rover | rlandy: all wallaby c8 jobs? its 6 new jobs since my morning 😳 | 18:32 |
| jm1|rover | rlandy: https://review.rdoproject.org/r/c/testproject/+/41808 | 18:34 |
| *** pojadhav is now known as pojadhav|out | 18:40 | |
| jm1|rover | cs9 wallaby fs64 is done, how to check promotion? | 18:40 |
| dviroel | jm1|rover: hey, you using ruck_rover.py to check jobs missing for promotion? | 18:49 |
| rlandy | sorry - bacj | 18:49 |
| rlandy | back | 18:49 |
| rlandy | jm1|rover: no worries - testproject added already | 18:50 |
| jm1|rover | dviroel: yep, why? | 18:53 |
| jm1|rover | dviroel: ah i see | 18:53 |
| dviroel | jm1|rover: if all jobs are green for a specific hash, you can check promoter logs | 18:54 |
| dviroel | jm1|rover: i.e. if you expect a promotion | 18:54 |
| rlandy | jm1|rover: https://review.rdoproject.org/r/c/testproject/+/41808/1/.zuul.yaml looks right | 18:55 |
| dviroel | jm1|rover: OR, you can quickly check updates on tags here: https://trunk.rdoproject.org/centos9-wallaby/ (e.g. for c9 wallaby) - current-tripleo should update after a promotion | 18:56 |
| rlandy | jm1|rover: if you want to meet, I can take you through component promotion | 18:57 |
| rlandy | in downstream | 18:57 |
| jm1|rover | rlandy: can we do tomorrow? want to submit some patches for chandan and then go eod | 19:00 |
| rlandy | jm1|rover; sure | 19:01 |
| rlandy | see you tomorrow | 19:01 |
| rlandy | logging a bug for https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-standalone-on-multinode-ipa&job_name=tripleo-ci-centos-9-standalone-on-multinode-ipa&skip=0 | 19:01 |
| frenzy_friday | Hey rlandy, could you pls merge https://review.rdoproject.org/r/c/config/+/41697 towards your eod today? I'll start the testprojects then tomorrow in my morning | 19:02 |
| * dviroel looks too | 19:03 | |
| rlandy | frenzy_friday: will do | 19:03 |
| frenzy_friday | thanks :) | 19:03 |
| rlandy | dviroel: +2'ed https://review.rdoproject.org/r/c/config/+/41697 | 19:04 |
| rlandy | feel free to w+ if you are ok with it | 19:04 |
| rlandy | should only impact quay container | 19:04 |
| dviroel | ack | 19:05 |
| rlandy | need to reboot here | 19:07 |
| dviroel | frenzy_friday: still around? | 19:08 |
| dviroel | frenzy_friday: rlandy: i see 4 places to fix c9 secret https://codesearch.rdoproject.org/codesearch/?q=quay_rdoproject_tripleomastercentos9_secret&i=nope&files=&repos= | 19:11 |
| dviroel | 2 fixed in the same patch | 19:12 |
| dviroel | another 1 here: https://review.rdoproject.org/r/c/config/+/41787/6 | 19:12 |
| dviroel | missing one | 19:12 |
| jm1|rover | dviroel: thanks for the tip, will check it :) | 19:13 |
| *** rlandy_ is now known as rlandy | 19:28 | |
| rlandy | ade_lee: hello ... https://bugs.launchpad.net/tripleo/+bug/1968615 - multinode-ipa job started failing today | 19:32 |
| rlandy | in check and periodic | 19:32 |
| rlandy | ade_lee: any recent changes you are aware of that may have triggered this? | 19:33 |
| rlandy | jm1|rover: chkumar|ruck: ^^ fyi - gate and promo blocker | 19:33 |
| jm1|rover | rlandy: did you already add it to hackmd? | 19:45 |
| jm1|rover | rlandy: cannot find it, will add it | 19:46 |
| rlandy | jm1|rover: not yet - waiting to chat with ade_lee about fix | 19:48 |
| * dviroel pick up car in repair shop - brb | 19:49 | |
| rlandy | jm1|rover; no worries - will add it by my EoD | 19:49 |
| jm1|rover | rlandy: shouldn't this job show up in ./ruck_rover.py --release master --distro centos-9 ? | 19:49 |
| rlandy | jm1|rover: probably passed in a previous run | 19:50 |
| rlandy | of the same hash | 19:50 |
| rlandy | https://trunk.rdoproject.org/api-centos9-master-uc/api/civotes_agg_detail.html?ci_name=periodic-tripleo-ci-centos-9-standalone-on-multinode-ipa-master | 19:54 |
| rlandy | https://logserver.rdoproject.org/69/40169/5/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master/f5a498a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 19:56 |
| rlandy | may be related issue | 19:56 |
| jm1|rover | rlandy: this ipa job fails the ping test. actually i cannot ping redhat.com from my system as well. | 20:02 |
| jm1|rover | redhat.com resolves to two ip addresses for me, 34.235.198.240 and 52.200.142.250. i cannot ping both?! | 20:03 |
| jm1|rover | rlandy: in the jobs which did not fail, redhat.com was resolved to 209.132.183.105 which is pingable from my system | 20:04 |
| rlandy | jm1|rover: hmmm .. maybe something on their side | 20:04 |
| rlandy | I can't ping it either | 20:04 |
| rlandy | I can ping ibm.com | 20:05 |
| jm1|rover | rlandy: its probably some kind of "protection"/firewall. i can open https connections to all of those ips | 20:05 |
| jm1|rover | rlandy: only icmp is blocked | 20:06 |
| rlandy | jm1|rover: must be new | 20:06 |
| rlandy | jm1|rover: let me try change the test ping | 20:07 |
| rlandy | and see if that works | 20:07 |
| jm1|rover | rlandy: older jobs all resolved to 209.132.183.105 | 20:08 |
| jm1|rover | rlandy: so redhat.com has to fix its firewall. let me open a bug ;) | 20:08 |
| * dasm stepping away for a bit | 20:10 | |
| jm1|rover | rlandy: opened a bug in service-now, because i have no idea who is responsible for redhat.com.. | 20:16 |
| rlandy | jm1|rover: do you have a ticket number I can add to a bug? | 20:17 |
| jm1|rover | rlandy: INC2175422 | 20:19 |
| jm1|rover | rlandy: added it to ruck rover hackmd as well | 20:19 |
| jm1|rover | rlandy: i am now EOD | 20:19 |
| rlandy | jm1|rover: thanks - have a good night | 20:20 |
| ade_lee | rlandy, hey - just saw your ping, been in meetings | 21:19 |
| ade_lee | rlandy, are we really failing to resolve redhat.com? | 21:19 |
| rlandy | ade_lee: yep - jm1 thinks it's a problem on redhat.com's side | 21:23 |
| rlandy | I changed the test site | 21:23 |
| rlandy | trying that noe | 21:23 |
| rlandy | now | 21:23 |
| ade_lee | ok | 21:23 |
| dviroel | rlandy: sorry, missed https://review.rdoproject.org/r/c/config/+/41697 | 21:37 |
| rlandy | dviroel: no worries | 21:37 |
| rlandy | merged it | 21:37 |
| rlandy | thought you were EoD | 21:37 |
| dviroel | rlandy: i was reviewing the following one, which I think that is needed now that we merged this one | 21:37 |
| rlandy | dviroel: yeah - that one frenzy_friday can merge in her morning | 21:38 |
| dviroel | this one https://review.rdoproject.org/r/c/config/+/41787/6 | 21:38 |
| rlandy | the one with impact | 21:38 |
| dviroel | ack | 21:38 |
| * dviroel going out o/ | 22:02 | |
| *** dviroel is now known as dviroel|out | 22:02 | |
| dasm | o/ | 22:15 |
| *** dasm is now known as dasm|off | 23:57 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!