Monday, 2020-11-02

*** tosky has quit IRC00:57
*** rfolco has quit IRC01:10
*** saneax has quit IRC02:31
*** udesale has joined #oooq03:06
*** skramaja has joined #oooq04:13
*** ykarel|away has joined #oooq04:22
*** ykarel|away is now known as ykarel04:30
*** saneax has joined #oooq05:02
*** ysandeep|away is now known as ysandeep|ruck05:16
*** ratailor has joined #oooq05:46
akahatarxcruz, o/06:08
akahatarxcruz, let's merge this: https://review.opendev.org/#/c/759287/06:08
*** marios has joined #oooq06:08
*** sshnaidm|off is now known as sshnaidm|rover06:49
sshnaidm|rovermarios, please check in your time: https://review.opendev.org/#/c/75973706:49
ysandeep|rucksshnaidm|rover, hey o/ want to sync for sometime06:52
sshnaidm|roverysandeep|ruck, sure06:52
ysandeep|rucksshnaidm|rover, meet.google.com/eyr-pxea-znh06:53
mariossshnaidm|rover: ack06:57
*** pojadhav is now known as pojadhav|sick06:58
*** matbu has joined #oooq07:03
*** skramaja has quit IRC07:14
*** skramaja has joined #oooq07:15
ysandeep|rucksshnaidm|rover, fyi.. i have moved https://bugs.launchpad.net/tripleo/+bug/1900158 to fix-commited as ussuri latest jobs have passed the introspection issue which we were hitting earlier after https://github.com/redhat-cip/hardware/pull/150 merged.07:36
openstackLaunchpad bug 1900158 in tripleo "ci.centos jobs in master and ussuri are failing introspection - failed to run hardware-detect utility" [Critical,Fix released] - Assigned to Ronelle Landy (rlandy)07:36
*** skramaja has quit IRC07:37
*** skramaja has joined #oooq07:38
sshnaidm|roverysandeep|ruck, ack07:43
*** slaweq has joined #oooq07:53
*** frenzy_friday has joined #oooq08:05
*** ykarel_ has joined #oooq08:06
*** ykarel has quit IRC08:09
*** dtantsur|afk is now known as dtantsur08:12
*** ysandeep|ruck is now known as ysandeep|lunch08:22
*** ykarel_ is now known as ykarel08:31
zbrmorning!08:35
zbrmarios: i asked wes last week but i did not get an answer: do we really need to support qs running on py2 for any release?08:35
zbras centos-7 received py3 support, even the oldest release we support can make use of py308:36
zbrand if i remember well the official support model is that we support *latest* version of the platform, so no issue to demand py3 everywhere.08:36
zbreven for old openstack releases08:36
marioszbr: 'old' - e.g. queens jobs use it still. if we now _can_ consider switching that to py3 then we should start that as an effort, but i guess it will take a secondary priority to finishing out the content provider stuffs08:37
zbrthat is quite important because we have a huge amount of scrap code, a permanent source of bugs08:37
zbrsure, i am not saying do the full seitch to py3 now, but only trying to advertise the benefit08:38
zbri am sure you know that huge amount of branching needed everywhere in order to deal with both py2/py3.08:38
zbrIMHO the benefits for our team are huge08:38
*** ksambor has joined #oooq08:40
marioszbr: i don't think anyone would disagree with that .08:40
marioszbr: so at least sync up with our tc/ua to get it into the list for programming perhaps we can start that next sprint?08:41
*** tosky has joined #oooq08:45
*** apetrich has joined #oooq08:47
arxcruzakahat: i'm not core :/09:17
*** derekh has joined #oooq09:30
*** yolanda has joined #oooq09:36
*** ysandeep|lunch is now known as ysandeep|ruck09:39
*** holser has joined #oooq09:54
*** chem has joined #oooq10:04
ysandeep|rucksshnaidm|rover, fyi.. opened https://bugs.launchpad.net/tripleo/+bug/1902506 , Issue noticed on rdocloud- i will try to switch them on vexxhost and see how that goes.10:16
openstackLaunchpad bug 1902506 in tripleo "Fs039 in security component is failing in master/Victoria/Ussuri on TASK [ovb-manage : Attach instance to provision OVB network]" [Critical,Triaged]10:16
*** ratailor has quit IRC10:27
*** ratailor has joined #oooq10:28
sshnaidm|roverysandeep|ruck, it may be misconfiguration10:38
sshnaidm|roverysandeep|ruck, checking..10:38
ysandeep|rucksshnaidm|rover, yes cloud name is vexx host and node is rdo10:39
sshnaidm|roverysandeep|ruck, yep10:39
*** odyssey4me|PTO is now known as odyssey4me10:43
*** udesale_ has joined #oooq10:51
*** udesale has quit IRC10:54
*** dtantsur is now known as dtantsur|brb11:21
ysandeep|ruckarxcruz, hello o/ when you get time, I need help with some tempest stuff - http://paste.openstack.org/show/799596/11:33
arxcruzysandeep|ruck: sure11:42
arxcruzysandeep|ruck: give me a few minutes, i'm going to lunch now11:42
ysandeep|ruckarxcruz: sure, enjoy your meal :)11:43
arxcruzraukadah: let me know when you're back, need to ask you something about ceph repository on quay11:43
ysandeep|ruckarxcruz, i think chandan will be back on wednesday11:44
frenzy_fridayHi, I am trying to install osp queens on Fedora 30 using tripleo-quickstart. Ansible threw an error "'libvirt_packages' is undefined". I checked tripleo-quickstart/roles/environment/vars/ and added libvirt_packages (with qemu-kvm  libvirt  libvirt-python  libguestfs-tools  python-lxml  polkit-pkla-compat  python-netaddr  virt-install  libvirt-daemon-config-network  libvirt-daemon-kvm  virt-manager  virt-viewer  python311:46
frenzy_fridaypython3-lxml  python3-netaddr  python3-pip  python3-devel -python3-libvirt) to fedora.yml. Is that the right place to add, and did I miss any package?11:46
*** ratailor has quit IRC11:48
*** ratailor has joined #oooq11:48
*** rfolco has joined #oooq11:52
arxcruzfrenzy_friday: it's one way to do it for sure12:00
sshnaidm|roverfrenzy_friday, I'm not sure it's supported for fedora30, why not to use centos?12:00
arxcruzakahat: https://review.opendev.org/759287 will be merged soon ;)12:00
sshnaidm|roverfrenzy_friday, most likely you'll need to copy this: https://github.com/openstack/tripleo-quickstart/blob/master/roles/environment/vars/centos-8.yml#L1812:01
frenzy_fridayI copied that, but there seems to be no package qemu-kvm-common for fedora 30, so i removed it.12:02
akahatarxcruz, great :)12:02
frenzy_fridayLet me try to switch to centos then12:02
akahatfrenzy_friday, https://hackmd.io/UZPFdivCSAm18jTLDBSdfg12:04
sshnaidm|roverfrenzy_friday, probably you need more repositories for fedora, but yes, better to try on centos12:05
*** ysandeep|ruck is now known as ysandeep|afk12:07
arxcruzysandeep|afk: let me know when you're back12:11
rfolcosshnaidm|rover, this one is ready to merge https://review.opendev.org/#/c/759738/12:14
*** rlandy has joined #oooq12:17
*** holser has quit IRC12:18
*** holser has joined #oooq12:20
*** ratailor has quit IRC12:30
*** chem has quit IRC12:30
weshay|ruckakahat, marios mtg12:30
*** chem has joined #oooq12:32
weshay|ruckhttps://hackmd.io/MlbZ_izSTEuZsCWTJvu_Kg12:33
*** ysandeep|afk is now known as ysandeep|ruck12:38
ysandeep|ruckarxcruz, hi12:38
arxcruzysandeep|ruck: hey12:38
ysandeep|ruckarxcruz, want to chat via gmeet?12:38
arxcruzokay12:39
ysandeep|ruckarxcruz, meet.google.com/spf-qwdj-gsp12:39
ysandeep|ruckarxcruz, http://paste.openstack.org/show/799596/12:43
ysandeep|ruckarxcruz, https://review.opendev.org/#/c/758430/12:44
mariosrlandy: weshay|ruck:  shnaidm|rover: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/master.yml12:46
rfolcoarxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, pojadhav, akahat, weshay, chandankumar13:02
rfolcoscrum time13:02
rlandyysandeep|ruck: hey - was having trouble with 16.2 test - failing to get last rhoe-release test in13:06
rlandyyou familiar with the issue?13:07
rlandyotherwise can raise something later>13:07
ysandeep|ruckrlandy, sry I was not able to check downstream in last 2 3 days, busy with upstream queues.13:08
rlandyysandeep|ruck: np - I understand13:08
arxcruzysandeep|ruck: https://review.opendev.org/#/c/760914/13:08
rlandywill look into it13:08
ysandeep|ruckarxcruz, thanks! if possible lets discuss the part 2 of my query after scrum.13:10
arxcruzysandeep|ruck: it's a date ;)13:11
mariosrfolco: https://review.opendev.org/#/c/759788/13:23
weshay|rucksshnaidm|rover, did rdo-cloud go down?13:25
weshay|ruckmonitoring stopped13:25
weshay|ruckysandeep|ruck, you have cix?13:32
weshay|ruckor should I roll there13:32
ysandeep|ruckweshay|ruck, i am on cix call13:33
weshay|ruck++13:33
weshay|ruckthanks13:33
arxcruzakahat: merged os_tempest content-provider \o/13:39
akahatarxcruz, cool. thanks.. :)13:40
akahat\o/13:40
weshay|ruckansible-config_template            checkout_out_branches.sh  os-collect-config  puppet-glance    puppet-mistral       puppet-swift          repolist_good           tripleo-ipa13:40
weshay|ruckansible-role-container-registry    instack                   os-net-config      puppet-heat      puppet-neutron       puppet-tripleo        tripleo-ansible         tripleo-ipsec13:40
weshay|ruckansible-role-redhat-subscription   instack-undercloud        os-refresh-config  puppet-horizon   puppet-nova          puppet-zaqar          tripleo-common          tripleo-operator-ansible13:40
weshay|ruckansible-role-tripleo-modify-image  old                       paunch             puppet-ironic    puppet-openstacklib  python-tripleoclient  tripleo-heat-templates  tripleo-puppet-elements13:40
weshay|ruckcheck_layout.sh                    os-apply-config           puppet-cinder      puppet-keystone  puppet-oslo          repolist              tripleo-image-elements  tripleo-validations13:40
marioshttps://zuul.openstack.org/builds?job_name=tripleo-build-containers-centos-7-train13:47
*** migi_pto is now known as migi13:47
marioshttps://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/build-image.yaml13:48
weshay|ruckzbr, https://review.opendev.org/#/c/760438/14:02
sshnaidm|roverweshay|ruck, checking monitoring..14:05
*** dtantsur|brb is now known as dtantsur14:12
sshnaidm|roverweshay|ruck, should be ok now14:14
weshay|rucksshnaidm|rover, thanks14:22
weshay|ruckfrenzy_friday, https://meet.google.com/oiv-geho-mai?authuser=114:22
*** TrevorV has joined #oooq14:22
apetrichweshay|ruck, I'm closing https://bugs.launchpad.net/tripleo/+bug/1902136 because I don't see it happening ever again14:30
openstackLaunchpad bug 1902136 in tripleo "TypeError: a bytes-like object is required, not 'MagicMock" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)14:30
apetrichit was a promotion blocker14:31
apetrichSorry wrong channel. I moving to #tripleo14:31
rlandymarios: hey - I think I am up to date with content-provider patches I owed ... wrt victoria .. where should I pick up?14:42
rlandythe ipa job?14:42
rfolcoweshay|ruck, Found some additional tripleo jobs like in https://opendev.org/x/tobiko/src/commit/bb0a45ffde2987996ede36d0b9e1d457dac2b01f/zuul.d/tripleo.yaml14:44
rfolcoweshay|ruck, working on these remaining repos14:44
weshay|ruckmeh... not sure if those ever worked..14:45
mariosrlandy: o/ yeah i think so... wrt the upgrade jobs we have v10 https://review.opendev.org/759654 v5 https://review.opendev.org/759702 v4 https://review.opendev.org/760323 so please review those/keep an eye otherwise?14:45
rfolcoweshay|ruck, sahara too14:46
rfolcohttps://opendev.org/openstack/sahara/src/branch/master/.zuul.yaml14:46
rlandymarios: ok14:46
ysandeep|ruckarxcruz++14:52
*** chem has quit IRC15:04
*** chem has joined #oooq15:05
weshay|ruckrlandy, fyi.. puppet repos blocked by https://review.opendev.org/#/c/760934/115:11
weshay|ruckwell.. that needs to merge rather15:11
rlandyweshay|ruck: such is life15:12
rlandyweshay|ruck: I think this covers all the missing minion content-provider jobs ... https://review.opendev.org/#/c/760929/15:13
rlandylet me know if you saw another case15:13
weshay|ruckrlandy, http://codesearch.openstack.org/?q=tripleo-ci-centos-8-containers-undercloud-minion&i=nope&files=&repos=15:14
rlandyweshay|ruck: the rest have content-provider15:15
rlandyvars: &undercloud_consumer_vars15:15
weshay|ruckah ya.. thanks15:15
rlandy consumer_job: true15:15
*** skramaja has quit IRC15:19
rlandyweshay|ruck: I think these two can merge as well ... https://review.opendev.org/#/c/760221/ ( needs w+) https://review.opendev.org/#/c/760244 (rechecked)15:19
rlandyand we're back to busy zuul15:20
mjturekrfolco: Could you take a look at these logs? https://logserver.rdoproject.org/ci.centos.org/tripleo-upstream-containers-build-master-ppc64le/2815/logs/logs/ jeremyfreudberg_ and I are a bit stumped why things aren't building other than the base containers15:22
rfolcomjturek, sure15:22
mjturekthanks rfolco15:24
*** jeremyfreudberg_ has joined #oooq15:25
*** rh-jelabarre has joined #oooq15:25
rfolcomjturek, any reason why you using kolla yet ?15:25
mjturekwe shouldn't be we made the switch to ticb15:26
mjturektcib*15:26
rfolcomjturek, do you have use_kolla: false in your job config ?15:26
rfolcomjturek, https://github.com/openstack/tripleo-ci/blob/master/zuul.d/build-containers.yaml#L205-L21015:27
rfolcomjturek, here is the job you want to compare with https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_bdc/758627/40/gate/tripleo-build-containers-ubi-8/bdcd59c/15:29
mjturekrfolco: yes we're doing use_kolla: false15:30
mjturekhttps://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/tripleo-upstream-builders.yml#L5215:30
mjturekthe logs also show that tcib is being used15:30
rfolcomjturek, right, I see kolla dirs even in tcib, I am sorry15:30
rfolcomjturek, please check ansible version and psutils15:30
rfolcoansible is 2.9.13 in upstream job15:31
mjturekwe're 2.8.015:31
mjturekrfolco: yeah I see the kolla file but that's about it hmm15:31
mjturekrfolco: think the ansible version could be problematic?15:31
rfolcoI am more worried about this15:33
rfolcoNo15:33
rfolco2020-11-02 12:25:57 | module named 'psutil'15:33
rfolcomjturek, just guessing for now what could be missing15:34
rfolconot sure15:34
mjturekoh interesting!15:34
mjturekrfolco: where is that?15:34
rfolcohttps://logserver.rdoproject.org/ci.centos.org/tripleo-upstream-containers-build-master-ppc64le/2815/logs/logs/build.log15:35
rfolcolooks like missing requirements, but not 100% sure15:35
mjturekwell that certainly could be it yeah15:36
*** rfolco has quit IRC15:41
rlandyupdating fedora - going down for reboot15:58
*** rlandy has quit IRC15:58
weshay|ruckno body is yelling about CI today..16:01
weshay|ruckWIN WIN WIN16:01
mariosweshay|ruck: you were asking about milestones few days back fyi https://launchpad.net/tripleo/wallaby16:09
weshay|ruckmarios++16:12
weshay|ruckmarios, and we have to move all the bugs to wallaby now16:12
mariosweshay|ruck: moved the victoria ones to "current stable release" and 'released' all of them .. i think we have to move bugs16:12
weshay|ruckperhaps tomorrow16:12
mariosyeah16:12
mariosweshay|ruck: but right...16:12
mariosweshay|ruck: thanks16:12
marios:)16:12
weshay|ruckscripts for that :)16:12
mariosweshay|ruck: yes i recall i wanted to check them and then we can catch up tomorrow in your morning16:13
weshay|ruckk16:13
*** rlandy has joined #oooq16:22
*** udesale_ has quit IRC16:27
rlandygoing down again for reboot16:28
*** rlandy has quit IRC16:28
*** rfolco has joined #oooq16:30
*** ykarel is now known as ykarel|away16:39
*** ysandeep|ruck is now known as ysandeep|away16:39
rfolcomjturek, all those errors are the same, which makes me think its a python dependency issue, psutils? I am not sure16:40
mjturekrfolco it's a good theory~16:40
mjturek!*16:40
openstackmjturek: Error: "*" is not a valid command.16:40
mjtureknot sure what's causing it yet tho16:40
rfolcotake a look at the requirements installed in the venv16:41
rfolcoI would start there16:41
*** rlandy has joined #oooq16:49
*** ykarel|away has quit IRC16:57
weshay|ruckwoot.. quay is working?17:08
weshay|ruckI mean...17:08
weshay|ruckwoot.. quay is WORKING!17:08
*** marios is now known as marios|out17:22
rfolcoweshay|ruck, quick question: what should we do with jobs like this https://opendev.org/openstack/sahara/src/branch/stable/ussuri/.zuul.yaml#L2017:25
rfolcoweshay|ruck, remove, mark as nv, convert to c8 and provider ?17:26
weshay|ruckrfolco, a c7 job in ussuri...17:27
rfolcoweshay|ruck, yes17:27
weshay|ruckrfolco, I would put up a change to remove it https://zuul.openstack.org/builds?job_name=sahara-tripleo-ci-centos-7-scenario003-standalone&branch=stable%2Fussuri17:28
*** tosky has quit IRC17:28
rfolcoweshay|ruck, ok thanks.17:29
*** marios|out has quit IRC17:42
*** sshnaidm|rover is now known as sshnaidm|afk17:57
*** dtantsur is now known as dtantsur|afk17:58
*** derekh has quit IRC18:03
rfolcoweshay|ruck, there is no patches for puppet-* repos on stable branches, I'm on it ok?18:23
rfolcoussuri/train/queens18:23
*** rlandy is now known as rlandy|brb18:47
*** jmasud has quit IRC18:48
weshay|ruckrfolco, thanks19:01
*** rlandy|brb is now known as rlandy19:14
weshay|ruckrlandy, ping.. has anyone escalated internal dlrn19:19
weshay|ruckrlandy, I'll do it now if not19:19
weshay|ruckI don't see anything yet19:19
weshay|ruckhttp://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/promoted-components/delorean.repo19:19
weshay|ruckweird..19:19
weshay|ruckhttp://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component/cloudops/d7/7a/d77ad494ba5a2d75fa2e2b00a8a34c4df9f07fc2_26d16a3d_1708fba619:19
weshay|ruck404 cloud ops is 40419:19
weshay|ruckbut exists here http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/component/cloudops/d7/7a/d77ad494ba5a2d75fa2e2b00a8a34c4df9f07fc2_26d16a3d_0166213b/19:19
rlandyweshay|ruck: not yet .. yeah - idk why that is19:19
weshay|rucksomebody messed around in the dlrn db19:19
weshay|ruckrlandy, k.. /me escalates19:20
rlandyweshay|ruck: before that there was another error19:20
rlandyin containre builds19:20
rlandyI think this current dlrn issue is hiding the earlier error19:20
rlandyweshay|ruck: I was going to BZ the container failure and then saw this19:21
weshay|ruckk.. /me writing it up19:21
mjturekrfolco fwiw https://review.rdoproject.org/r/#/c/30728/19:21
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-periodic-integration-rhos-16.2&job_name=periodic-tripleo-rhel-8-rhos-16.2-promote-promoted-components-to-tripleo-ci-testing-internal19:22
rlandy^^ that has been down since 10/3019:22
rlandyweshay|ruck: maybe if we get ^^ fixed it will address the container build problem19:24
rfolcomjturek, is it possible to test w/ this patch before merging it ?19:25
weshay|ruckrlandy, I think we could promote cloud-ops and perhaps clear it19:25
weshay|ruckI'll check19:25
rlandygo for it f you can19:27
mjturekwe could probably try locally yeah - need to find a place to test19:29
rfolcomjturek, we can also revert if needed, I'll +w19:31
weshay|ruckrlandy, consistent is at the same hash.. nothing we can do19:35
rlandyweshay|ruck: how do we get a 404 on that19:35
rlandyconfused how that even happens19:35
weshay|ruckrlandy, the last 8 numbers are off.. never seen that happen19:35
rlandysince the last promotion?19:36
weshay|ruckrlandy, the issue is in component-ci-testing promoted-components.. etc19:43
rlandyweshay|ruck: how so?19:48
weshay|ruckthe dlrn.repo has a baseurl for cloudops that's a 40419:48
rlandyyep19:51
rlandyso it's all a problem19:51
rlandyI guess we see if jpena can address it?19:51
weshay|ruckaye19:52
rlandythe font in upgraded irc client is weird19:54
*** tosky has joined #oooq20:27
weshay|ruckrlandy, not seeing any significant drop in check or gate pass rates :)20:29
rlandyweshay|ruck: maybe they have not taken action yet20:30
*** rfolco has quit IRC20:46
*** rfolco has joined #oooq20:51
*** rfolco has quit IRC20:56
*** rfolco has joined #oooq21:06
*** TrevorV has quit IRC21:29
*** jmasud has joined #oooq21:40
*** saneax has quit IRC21:58
*** rfolco has quit IRC21:59
*** slaweq has quit IRC23:03
*** rlandy has quit IRC23:53

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!