Wednesday, 2020-07-01

*** ryohayakawa has joined #openstack-infra00:02
*** diablo_rojo has quit IRC00:44
*** yamamoto has joined #openstack-infra00:46
*** yamamoto has quit IRC00:49
*** yamamoto has joined #openstack-infra00:58
*** markvoelker has joined #openstack-infra01:20
*** markvoelker has quit IRC01:24
*** gyee has quit IRC01:35
*** rlandy|afk has quit IRC01:37
*** ricolin_ has joined #openstack-infra01:43
*** Tengu has quit IRC01:47
*** Tengu has joined #openstack-infra01:49
*** verdurin has quit IRC02:29
*** ramishra has quit IRC02:30
*** ramishra has joined #openstack-infra02:31
*** verdurin has joined #openstack-infra02:33
*** zxiiro has quit IRC02:41
*** armax has quit IRC03:19
*** rfolco has quit IRC03:20
*** ricolin_ is now known as ricolin03:30
*** psachin has joined #openstack-infra03:33
*** markvoelker has joined #openstack-infra04:03
*** markvoelker has quit IRC04:08
*** ykarel|away is now known as ykarel04:24
*** Lucas_Gray has quit IRC04:30
*** iurygregory has quit IRC04:31
*** evrardjp has quit IRC04:33
*** udesale has joined #openstack-infra04:33
*** evrardjp has joined #openstack-infra04:33
*** apetrich has quit IRC04:43
*** mugsie has quit IRC04:53
*** mugsie has joined #openstack-infra04:57
*** markvoelker has joined #openstack-infra05:03
*** strigazi has quit IRC05:04
*** strigazi has joined #openstack-infra05:06
*** markvoelker has quit IRC05:07
*** ysandeep|away is now known as ysandeep05:09
*** marios has joined #openstack-infra05:16
*** matt_kosut has joined #openstack-infra05:16
*** lmiccini has joined #openstack-infra05:17
*** vishalmanchanda has joined #openstack-infra05:23
*** strigazi has quit IRC05:46
openstackgerritFederico Ressi proposed openstack/project-config master: Create a new repository for Tobiko DevStack plugin  https://review.opendev.org/73837805:48
*** ccamacho has quit IRC05:58
*** factor has quit IRC06:03
AJaegerconfig-core, a couple of reviews, please: https://review.opendev.org/738513 https://review.opendev.org/738378 https://review.opendev.org/73745706:03
*** factor has joined #openstack-infra06:03
*** icarusfactor has joined #openstack-infra06:05
*** factor has quit IRC06:06
*** icarusfactor has quit IRC06:22
*** ccamacho has joined #openstack-infra06:31
*** tetsuro has joined #openstack-infra06:33
*** amoralej|off is now known as amoralej06:39
*** tetsuro has quit IRC06:43
*** tetsuro has joined #openstack-infra06:43
*** tetsuro has joined #openstack-infra06:55
*** tetsuro has quit IRC06:56
*** bhagyashris is now known as bhagyashris|brb06:59
*** rcernin has quit IRC07:02
*** markvoelker has joined #openstack-infra07:04
*** rcernin has joined #openstack-infra07:04
*** hashar has joined #openstack-infra07:09
*** iurygregory has joined #openstack-infra07:09
*** markvoelker has quit IRC07:09
*** slaweq has quit IRC07:12
*** jcapitao has joined #openstack-infra07:13
*** slaweq has joined #openstack-infra07:13
*** bhagyashris|brb is now known as bhagyashris07:15
*** markvoelker has joined #openstack-infra07:18
*** markvoelker has quit IRC07:23
*** rcernin has quit IRC07:30
*** nightmare_unreal has joined #openstack-infra07:30
*** ralonsoh has joined #openstack-infra07:33
*** dtantsur|afk is now known as dtantsur07:35
*** jtomasek has quit IRC07:36
*** jtomasek has joined #openstack-infra07:39
*** tosky has joined #openstack-infra07:40
*** ociuhandu has quit IRC07:41
*** rcernin has joined #openstack-infra07:49
*** xek has joined #openstack-infra07:58
*** jpena|off is now known as jpena07:58
*** xek has quit IRC07:59
*** xek has joined #openstack-infra08:00
*** rcernin has quit IRC08:06
*** eolivare has joined #openstack-infra08:07
*** ramishra has quit IRC08:09
*** hashar has quit IRC08:17
*** hashar has joined #openstack-infra08:18
*** ociuhandu has joined #openstack-infra08:20
openstackgerritHervĂ© Beraud proposed openstack/openstack-zuul-jobs master: Stop to use the __future__ module.  https://review.opendev.org/73288708:21
openstackgerritHervĂ© Beraud proposed openstack/openstack-zuul-jobs master: Update the common_translation_update role to use python3  https://review.opendev.org/73875508:21
*** ysandeep is now known as ysandeep|lunch08:21
*** gfidente has joined #openstack-infra08:33
*** derekh has joined #openstack-infra08:45
*** apetrich has joined #openstack-infra08:48
*** gfidente is now known as gfidente|ffu08:50
*** jtomasek_ has joined #openstack-infra09:05
*** jtomasek has quit IRC09:07
*** ysandeep|lunch is now known as ysandeep09:21
openstackgerritStephen Finucane proposed openstack/pbr master: Add support for virtualenv 20.x  https://review.opendev.org/71996409:25
*** hashar has quit IRC09:25
*** ryohayakawa has quit IRC09:31
stephenfinMorning. Does anyone know what's happening here? https://review.opendev.org/#/c/736622/ Seems tox is not installed on the host?09:33
*** Lucas_Gray has joined #openstack-infra09:33
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Allow deleting workspace after running terraform destroy  https://review.opendev.org/73877109:34
*** yamamoto has quit IRC09:37
*** hashar has joined #openstack-infra09:42
*** hashar is now known as hasharAway09:47
fricklerstephenfin: that seems an ordering issue, tools/test-setup.sh is run from playbooks/unittests/pre.yaml while tox would only be installed later from playbooks/tox/pre.yaml09:50
stephenfinfrickler: Thanks for taking a look. I wonder what changed though? tools/test-setup.sh appears unchanged from 11-201709:51
*** ricolin has quit IRC09:52
fricklerstephenfin: well infra moved tox (like pip and virtualenv) from being preinstalled in the CI image to being installed by "ensure-*" roles09:53
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Allow deleting workspace after running terraform destroy  https://review.opendev.org/73877109:53
stephenfinaha, that's doing the damage so09:53
fricklernot sure why some jobs still passed here https://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-py36&project=openstack/oslo.messaging09:54
*** yamamoto has joined #openstack-infra09:55
*** hasharAway has quit IRC09:57
fricklerstephenfin: seems AJaeger proposed a fix here already, just need to merge that I guess https://review.opendev.org/73624809:58
*** hashar has joined #openstack-infra09:58
stephenfinfrickler++ I'd even looked at that /o\09:59
*** tkajinam has quit IRC09:59
fricklerguess the patch needs to be merged with elod's kombu fix10:00
openstackgerritElod Illes proposed openstack/devstack-gate master: DNM: remove g-api from subnode  https://review.opendev.org/73878010:01
*** xek has quit IRC10:05
*** yamamoto has quit IRC10:06
*** yamamoto has joined #openstack-infra10:07
*** andrewbonney has joined #openstack-infra10:11
*** apetrich has quit IRC10:12
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Allow deleting workspace after running terraform destroy  https://review.opendev.org/73877110:13
elodstephenfin: actually my patch that constrains kombu cannot be merged, so probably oslo.messaging should adapt to the kombu change (or kombu should be fixed, but I don't know if it is a bug or a feature :))10:14
stephenfinelod: I've replied on that. There's been a new version of kombu released which I'm hoping resolves the issue10:14
stephenfinIf so, we'll just blacklist .9 and .1010:14
elodstephenfin: I've tested with 4.6.9, 4.6.10 and 4.6.11, but oslo.messaging failed with all of them :/10:15
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Allow deleting workspace after running terraform destroy  https://review.opendev.org/73877110:26
*** ysandeep is now known as ysandeep|brb10:27
*** dtantsur is now known as dtantsur|brb10:27
openstackgerritSlawek Kaplonski proposed openstack/project-config master: Update Neutron Grafana dashboard  https://review.opendev.org/73878410:28
*** ysandeep|brb is now known as ysandeep10:37
sean-k-mooneyo/ is there an issue with rackspace and installing pacages currently?10:43
fricklersean-k-mooney: nothing that I know of, do you have a pointer to a failure?10:44
sean-k-mooneyactully this looks like a case thing10:45
sean-k-mooneyCollecting uwsgi10:45
sean-k-mooney  Downloading http://mirror.iad.rax.opendev.org/pypifiles/packages/c7/75/45234f7b441c59b1eefd31ba3d1041a7e3c89602af24488e2a22e11e7259/uWSGI-2.0.19.1.tar.gz (803kB)10:45
sean-k-mooney  Saved ./uWSGI-2.0.19.1.tar.gz10:45
sean-k-mooneySuccessfully downloaded uwsgi10:45
sean-k-mooneyYou are using pip version 9.0.3, however version 20.1.1 is available.10:45
sean-k-mooneyYou should consider upgrading via the 'pip install --upgrade pip' command.10:45
sean-k-mooney+ lib/apache:install_apache_uwsgi:97       :   local uwsgi10:45
sean-k-mooney++ lib/apache:install_apache_uwsgi:98       :   ls 'uwsgi*'10:45
sean-k-mooneyls: cannot access 'uwsgi*': No such file or directory10:45
sean-k-mooney./uWSGI-2.0.19.1.tar.gz vs uwsgi*10:45
fricklersean-k-mooney: please use paste.openstack.org next time ;)10:45
*** ramishra has joined #openstack-infra10:45
sean-k-mooneyfrickler: i do if its longer tehn a few lines :)10:46
frickleralso, that's a devstack issue, fixed for stein and newer10:46
sean-k-mooneyya this is a rocky patch10:46
sean-k-mooneyi guess rocky is em?10:46
sean-k-mooneyso it proably was not backported10:47
fricklersean-k-mooney: for rocky things are still in progress, if you want to know more, let's move over to #openstack-qa10:47
sean-k-mooneyfrickler: i just noticed that a backport failed but sure10:47
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Allow deleting workspace after running terraform destroy  https://review.opendev.org/73877111:00
*** priteau has joined #openstack-infra11:02
*** jcapitao is now known as jcapitao_lunch11:10
*** kevinz has quit IRC11:11
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Allow deleting workspace after running terraform destroy  https://review.opendev.org/73877111:12
*** markvoelker has joined #openstack-infra11:15
*** sshnaidm|afk is now known as sshnaidm|ruck11:19
*** markvoelker has quit IRC11:19
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Allow deleting workspace after running terraform destroy  https://review.opendev.org/73877111:25
*** udesale_ has joined #openstack-infra11:28
*** jpena is now known as jpena|lunch11:29
*** udesale has quit IRC11:31
*** apetrich has joined #openstack-infra11:45
*** mmethot has quit IRC11:50
*** csatari has quit IRC11:53
*** owalsh_ has joined #openstack-infra11:55
*** csatari has joined #openstack-infra11:56
*** owalsh has quit IRC11:58
*** Lucas_Gray has quit IRC11:58
*** amoralej is now known as amoralej|lunch12:00
*** mmethot has joined #openstack-infra12:00
*** Lucas_Gray has joined #openstack-infra12:00
AJaegerelod, stephenfin, alternative: squash the two changes if you need both...12:03
*** jcapitao_lunch is now known as jcapitao12:07
elodAJaeger: unfortunately, it's not enough to just squash those12:14
noonedeadpunkhi there! sorry for taking so long. You can release hold for https://review.opendev.org/#/c/689629/12:16
AJaegerelod: that's sad ;(12:16
*** irclogbot_3 has quit IRC12:16
*** irclogbot_0 has joined #openstack-infra12:17
*** jpena|lunch is now known as jpena12:23
*** derekh has quit IRC12:28
*** rlandy has joined #openstack-infra12:33
*** ysandeep is now known as ysandeep|afk12:45
*** dtantsur|brb is now known as dtantsur12:45
*** xek has joined #openstack-infra12:46
*** trident has quit IRC12:46
*** derekh has joined #openstack-infra12:48
*** trident has joined #openstack-infra12:49
*** ricolin has joined #openstack-infra12:54
*** rlandy is now known as rlandy|training12:57
*** rfolco has joined #openstack-infra13:00
*** xek has quit IRC13:01
openstackgerritLance Bragstad proposed openstack/project-config master: Create a new project for ansible-tripleo-ipa-server  https://review.opendev.org/73884213:07
*** amoralej|lunch is now known as amoralej13:08
AJaegerconfig-core, a couple of reviews, please: https://review.opendev.org/738513 https://review.opendev.org/738378 https://review.opendev.org/73745713:17
*** xek has joined #openstack-infra13:22
*** abhishekk has quit IRC13:22
*** jhesketh has quit IRC13:22
*** abhishekk has joined #openstack-infra13:23
*** jhesketh has joined #openstack-infra13:24
funginoonedeadpunk: thanks for the heads up, i've dropped that node back into available quota just now13:24
*** Lucas_Gray has quit IRC13:27
*** Lucas_Gray has joined #openstack-infra13:30
*** psachin has quit IRC13:31
*** ysandeep|afk is now known as ysandeep13:31
*** xek has quit IRC13:33
*** dklyle has quit IRC13:35
*** bhagyashris is now known as bhagyashris|afk13:42
*** yamamoto has quit IRC13:50
*** Tengu has quit IRC13:56
*** Tengu has joined #openstack-infra13:57
*** hashar has quit IRC14:06
*** xek has joined #openstack-infra14:07
openstackgerritStephen Finucane proposed openstack/pbr master: Add support for virtualenv 20.x  https://review.opendev.org/71996414:10
*** yamamoto has joined #openstack-infra14:11
*** yamamoto has quit IRC14:11
*** yamamoto has joined #openstack-infra14:12
*** yamamoto has quit IRC14:16
*** dave-mccowan has quit IRC14:22
AJaegerstephenfin: thanks for fixing oslo.messaging!14:22
*** dave-mccowan has joined #openstack-infra14:25
smcginnisSome random person started a meeting in #openstack-cinder. Anyway to take over the meetbot there?14:28
fricklersmcginnis: if you wait 60 minutes, anyone can issue the #endmeeting. if you need it faster, maybe some other infra-root know offhand how to do it14:32
smcginnisfrickler: Not critical, so we can wait. We might want to manually delete that log afterwards since it's just capturing a bunch of random chat while the actual Cinder meeting is ongoing in another channel.14:33
clarkbwe can add a chair to the meeting via the meetbot admin commands, I haven't done it in forever so will take a minute to figure out and we're debugging a different issue too :/14:33
smcginnisThis is definitely less important.14:35
*** diablo_rojo has joined #openstack-infra14:43
*** armax has joined #openstack-infra14:47
*** dklyle has joined #openstack-infra14:49
smcginnisIf someone could delete http://eavesdrop.openstack.org/meetings/cinder/2020/cinder.2020-07-01-14.15.html at some point, that's the random one someone started in #openstack-cinder15:05
smcginnisThanks!15:05
*** dave-mccowan has quit IRC15:08
*** dave-mccowan has joined #openstack-infra15:11
*** ysandeep is now known as ysandeep|away15:15
fungi#status log removed stray /srv/meetbot-openstack/meetings/cinder/2020/cinder.2020-07-01-14.15.* on eavesdrop.o.o at the request of smcginnis15:23
openstackstatusfungi: finished logging15:23
fungithat got the text and html versions of the minutes and the meeting log15:23
smcginnisThank you15:28
fungiany time!15:30
*** sshnaidm|ruck is now known as sshnaidm|afk15:32
*** factor has joined #openstack-infra15:32
*** lmiccini has quit IRC15:45
*** amoralej is now known as amoralej|off15:47
*** jackedin has joined #openstack-infra15:53
*** hamalq has joined #openstack-infra15:57
*** hamalq_ has joined #openstack-infra15:58
*** sshnaidm|afk is now known as sshnaidm|ruck16:01
*** ricolin has quit IRC16:01
*** hamalq has quit IRC16:02
*** armax has quit IRC16:06
*** marios is now known as marios|out16:07
*** armax has joined #openstack-infra16:11
*** udesale_ has quit IRC16:12
*** derekh has quit IRC16:15
*** sshnaidm|ruck is now known as sshnaidm|afk16:20
*** jcapitao has quit IRC16:23
*** xek has quit IRC16:29
*** hashar has joined #openstack-infra16:29
*** ykarel is now known as ykarel|away16:34
openstackgerritMerged openstack/project-config master: Update Neutron Grafana dashboard  https://review.opendev.org/73878416:39
yoctozeptomorning infra; any idea why centos and ubuntu images come with time sync enabled but debian does not? planned/ommission?16:40
yoctozeptospecifically ubuntu bionic, centos8 and debian buster16:40
fungiyoctozepto: likely an oversight... i don't know offhand whether that's done in dib's minimal elements or in our infra-package-needs element16:43
clarkbwe install ntp and ntpdate on ubuntu and debian. Maybe debian doesnt enable it by default16:43
clarkbfungi: infra-package-needs16:43
*** ddurst has quit IRC16:43
*** dtantsur is now known as dtantsur|afk16:44
fungior there's some boot-time race causing it to be unable to start (maybe tries before dns resolution is working and can't look up the timeservers?)16:44
*** ociuhandu_ has joined #openstack-infra16:45
yoctozeptowhat about timesyncd? the "default" install would get me timesyncd on all ubuntu (bionic/focal) and debian buster16:46
yoctozeptoactually on ubuntu it is timesyncd that is running16:46
yoctozepto(i mean in infra)16:47
*** ociuhandu has quit IRC16:49
*** jackedin has quit IRC16:49
fungii'd never noticed the systemd-timesyncd package before, all my debian systems (even those running sid) still use ntp16:49
AJaegerconfig-core, a couple of reviews, please: https://review.opendev.org/738513 https://review.opendev.org/738378 https://review.opendev.org/73745716:50
fungiyoctozepto: i guess timesyncd is yet another standard system component that the systemd crowd decided to nih?16:50
*** factor has quit IRC16:51
*** icarusfactor has joined #openstack-infra16:51
yoctozeptofungi: and you are right ;-)16:52
*** ociuhandu_ has quit IRC16:52
fungion debian at least, it looks like both ntp and systemd-timesyncd packages provide/replace the time-daemon virtual package, and both are optional priority16:52
*** jpena is now known as jpena|off16:53
*** Lucas_Gray has quit IRC16:53
*** Lucas_Gray has joined #openstack-infra16:58
*** hashar has quit IRC16:58
*** ociuhandu has joined #openstack-infra16:59
*** andrewbonney has quit IRC17:00
*** marios|out has quit IRC17:05
*** ociuhandu has quit IRC17:07
*** ralonsoh has quit IRC17:10
*** ralonsoh has joined #openstack-infra17:10
*** corvus has quit IRC17:15
*** bnemec has quit IRC17:15
*** rledisez has quit IRC17:15
*** fresta has quit IRC17:15
*** guillaumec has quit IRC17:15
*** timburke has quit IRC17:15
*** jamespage has quit IRC17:15
*** jmccrory has quit IRC17:15
*** andreykurilin has quit IRC17:15
*** ericyoung has quit IRC17:15
*** zaro has quit IRC17:15
*** factor has joined #openstack-infra17:16
*** icarusfactor has quit IRC17:16
*** hashar has joined #openstack-infra17:17
*** jamespage has joined #openstack-infra17:18
*** fresta has joined #openstack-infra17:18
*** corvus has joined #openstack-infra17:18
*** guillaumec has joined #openstack-infra17:18
*** ericyoung has joined #openstack-infra17:18
*** jmccrory has joined #openstack-infra17:18
*** timburke has joined #openstack-infra17:18
*** andreykurilin has joined #openstack-infra17:19
*** zaro has joined #openstack-infra17:19
*** bnemec has joined #openstack-infra17:21
*** mmethot has quit IRC17:26
*** jtomasek_ has quit IRC17:26
*** amoralej|off has quit IRC17:26
*** bdodd has quit IRC17:26
*** kmarc has quit IRC17:26
*** otherwiseguy has quit IRC17:26
*** weshay_ruck has quit IRC17:26
*** mtreinish has quit IRC17:26
*** zzzeek has quit IRC17:26
*** freerunner has quit IRC17:26
*** AJaeger has quit IRC17:26
*** calebb has quit IRC17:26
*** hongbin has joined #openstack-infra17:28
*** irclogbot_0 has quit IRC17:28
*** gyee has joined #openstack-infra17:29
*** mmethot has joined #openstack-infra17:29
*** jtomasek_ has joined #openstack-infra17:29
*** amoralej|off has joined #openstack-infra17:29
*** bdodd has joined #openstack-infra17:29
*** kmarc has joined #openstack-infra17:29
*** otherwiseguy has joined #openstack-infra17:29
*** weshay_ruck has joined #openstack-infra17:29
*** mtreinish has joined #openstack-infra17:29
*** calebb has joined #openstack-infra17:29
*** zzzeek has joined #openstack-infra17:29
*** freerunner has joined #openstack-infra17:29
*** AJaeger has joined #openstack-infra17:29
*** nightmare_unreal has quit IRC17:29
*** irclogbot_2 has joined #openstack-infra17:29
*** Lucas_Gray has quit IRC17:30
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Test multiarch release builds and use temp registry with buildx  https://review.opendev.org/73731517:30
*** gfidente|ffu is now known as gfidente|afk17:34
*** yamamoto has joined #openstack-infra17:44
*** hashar is now known as hasharAway17:47
*** yamamoto has quit IRC17:53
*** xek has joined #openstack-infra17:54
*** ramishra has quit IRC18:01
clarkbfungi: yoctozepto we use timesyncd on focal18:13
*** eharney has quit IRC18:16
openstackgerritMerged zuul/zuul-jobs master: Test multiarch release builds and use temp registry with buildx  https://review.opendev.org/73731518:19
fungireading up on the shortcuts timesyncd takes, i don't think i'd use it on my own servers18:20
*** slaweq has quit IRC18:25
*** hasharAway is now known as hashar18:25
*** eolivare has quit IRC18:26
openstackgerritLance Bragstad proposed openstack/project-config master: Create a new project for ansible-tripleo-ipa-server  https://review.opendev.org/73884218:28
smcginnisI have a theoretical permissions questions: is it possible to configure ACLs to allow a group of people to push tags on only certain branches?18:32
*** chandankumar is now known as raukadah18:39
openstackgerritMerged zuul/zuul-jobs master: ensure-pip debian: update package lists  https://review.opendev.org/73752918:39
clarkbsmcginnis: no because tags are independent of branches18:40
smcginnisclarkb: Thanks, that's kinda what I figured, but thought I would ask.18:41
clarkbone of the reasons we ask projects have a smaller group with tag push perms is you can actually push a tag with completely arbitrary code18:41
clarkbyoctozepto: fungi fwiw I think the expectation is that our nodes will boot with ntp updates of some sort18:43
fungiyep, folks have indeed pushed tags of things which aren't even on any branch18:43
clarkbsince we know that clocks can be out of sync at boot18:43
clarkbso thats definitely a bug to sort out18:43
smcginnisYeah, just trying to find a way to enable the Ironic team's plan for bugix branch releases without completely overhauling (and losing) all the protections we have in the release tooling.18:43
*** hongbin has quit IRC18:44
clarkbyou could give them approval rights on the changes that create the tags18:46
*** factor has quit IRC18:46
clarkbvia some branch maybe18:46
*** factor has joined #openstack-infra18:46
clarkb(thats somewhat handwavy but the controls on changes are much more robust)18:46
smcginnisclarkb: I'm not sure I understand that.18:50
clarkbsmcginnis: the way tags are made for openstack today is you push a change with a sha1 and version and when that change merges zuul jobs fire off and tag the tag and do related things18:51
clarkbsmcginnis: it may be possible to give ironic devs approval rights on the changes that do ^18:51
clarkblike maybe openstack/releases has a ironic/bugfixes branch18:51
clarkband they are allowed to approve changes on that branch which triggers the jobs18:52
smcginnisclarkb: Ah, so we could have a branch of releases that removes most of the protections we have in place to allow them to push up a tag patch that would otherwise fail validation.18:52
clarkbmaybe, I'm not sure of all the details there but I think that could theoretically be made to work18:53
clarkband ya your pre merge ci could do all the normal validation first18:53
clarkbalso that may open a weird bug/workaround/problem where they can tag outside of bugfixes too18:54
smcginnisStill, since these "releases" are only semi-official, maybe we just set up one or two of that we trust and let them just tag when they want to without going through openstack/releases.18:54
clarkbsince the change could be for a sha on any branch18:54
*** dklyle has quit IRC18:54
fungior use a different repo for metadata triggering those tags18:57
*** dklyle has joined #openstack-infra19:02
*** factor has quit IRC19:04
*** factor has joined #openstack-infra19:04
*** ociuhandu has joined #openstack-infra19:06
*** factor has quit IRC19:10
*** hongbin has joined #openstack-infra19:18
smcginnisI thought we had fixed propose-update-constraints, and I'm pretty sure it was observed working, with https://review.opendev.org/#/c/736032/3/playbooks/proposal/pre.yaml19:27
smcginnisBut now they are failing with "ImportError: No module named setuptools"19:27
fungihttps://zuul.opendev.org/t/openstack/builds/?job_name=propose-update-constraints19:30
clarkbfungi: ^ I think you were involved in that?19:30
fungii was looking at it over the weekend, yeah19:30
fungiseems like it passed just a few hours ago19:30
smcginnisYeah, they pass, but they are failing silently.19:31
smcginnishttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e14/ea0bfd1ceacb4cabf3b9829bccab9ae3696037e3/release/propose-update-constraints/e14e1d9/job-output.txt19:31
fungioh, right, now i remember looking at t19:31
smcginnis2020-06-30 14:10:12.31906719:31
fungiso what we were mainly discussing over the weekend was getting the constraints updates passing tests so they could land again19:32
fungii'm not sure i've seen a recent proposal update (the one which landed was manually generated)19:32
fungiso it's likely been broken since the outset of the image switch19:32
smcginnisI'm fairly sure we had at least some work after that patch mentioned above, but I could very well be wrong.19:33
fungihttps://review.opendev.org/#/q/owner:%22OpenStack+Proposal+Bot%22+project:openstack/requirements19:35
smcginnisSome to master on the 18th. That patch merged on the 17th19:36
fungiyeah, looks like there was at least one proposed as recenty as the 18th from a tag event19:36
fungiso none in the past two weeks basically19:37
*** yoctozepto7 has joined #openstack-infra19:37
smcginnisLuckily it's been mostly quiet, but even the nightly job has had issues, so I have a feeling that will pick up a lot of updates next time it runs.19:38
fungiwell, like i said, there was a manually generated one merged over the weekend as a stopgap19:38
fungibut yeah, the most recent daily from generate-constraints was also updated on the 18th19:39
smcginnisSo is the issue that ensure-pip in https://opendev.org/openstack/project-config/src/branch/master/playbooks/proposal/pre.yaml doesn't install it globally?19:40
fungiit installs it for a version of python19:41
fungilooks like it installed it for python3.719:41
fungibut the job seems to be breaking when trying to use it under python 3.819:41
fungiso maybe what happened on the 18th is we added constraints generation for 3.8?19:41
clarkbmaybe virtualenvs would be the right choice here?19:42
clarkbsince its different versions anyway?19:42
smcginnisWe've had 3.8 in there for awhile now.19:42
fungiwe used to use virtualenvs19:42
fungiat one point it was decided that you shouldn't have to rely on a virtualenv to do things like generate release artifacts or run build-sphinx19:43
fungiand then we discovered that not using a virtualenv for build-sphinx was not so simple as we thought so rolled that back19:43
fungianyway, we could likely solve this by including the ensure-pip role for each interpreter the job intends to use19:44
clarkbya it takes a parameter for version iirc19:44
*** yoctozepto has quit IRC19:45
*** yoctozepto7 is now known as yoctozepto19:45
smcginnisSo https://opendev.org/openstack/project-config/src/branch/master/playbooks/proposal/pre.yaml#L2 would have some parameters calling that out?19:45
*** Tengu has quit IRC19:45
clarkbhrm so it does but only if installing pip from pypi not distro packages19:46
clarkbwhich is probably fine for this case?19:46
clarkbsmcginnis: https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-pip/defaults/main.yaml#L5 I think you can rerun the role multiple times setting that value to different pythons each time19:47
clarkband you also need to set ensure_pip_from_upstream to True19:47
*** vishalmanchanda has quit IRC19:47
*** Tengu has joined #openstack-infra19:47
smcginnisOK, I'll give that a shot.19:48
fungillooks like we could probably use https://zuul-ci.org/docs/zuul-jobs/python-roles.html#rolevar-ensure-pip.ensure_pip_from_upstream_interpreters19:48
fungibut it doesn't support doing it from distro packages apparently19:48
clarkbfungi: ya19:48
smcginnisWould it also need "ensure_pip_from_pacakges: false", or is that overridden by ensure_pip_from_upstream?19:48
fungiwhich seems a bit odd since distro packages are the default19:48
*** ralonsoh has quit IRC19:50
smcginnisLooks like ensure_pip_from_upstream_interpreters takes a list. Do I need to rerun the role multiple times? Or can I just give that a list of all our supported runtimes?19:51
fungican probably just update the one invocation there with the list19:52
openstackgerritSean McGinnis proposed openstack/project-config master: update-constraints: Install pip for all versions  https://review.opendev.org/73892619:53
fungiand you may want to unset ensure_pip_from_packages looking at the logic in https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-pip/tasks/main.yaml#L31-L5119:54
smcginnisOK, I think that patch should be right in that respect then.19:55
smcginnisNot sure about the rest of it, but I hope at least that part. :D19:55
*** rlandy|training is now known as rlandy19:59
*** eharney has joined #openstack-infra19:59
fungii think that should work *if* the nodes where that playbook runs have all of those interpreters present20:02
smcginnisThat actually was one part that concerned me putting that together.20:03
smcginnisHow do we know what versions are there? And now I assume we have to remember to update that over time as our runtimes change.20:04
smcginnisIt seems like we need something that will just make sure it is installed for whatever version is used to run the job without needing to really care which that is.20:04
*** Fidde has joined #openstack-infra20:04
fungiyes, it makes me wonder if the ensure-pip role should be smarter to install packages corresponding to the interpreter versions already present on the system20:04
smcginnisThat would be nice.20:05
smcginnisIt just seems really fragile right now.20:05
fungismcginnis: well, that's basically what it does (make sure it is installed for whatever version is used to run the job)20:05
clarkbits assuming a single interpreter per major version20:05
fungithis job is special20:05
clarkbwhich is the case 90% of the time20:05
clarkbya20:05
fungiin that it invokes multiple python versions20:05
*** hongbin has quit IRC20:06
fungiearlier on i suggested that we should run constraints proposals as a multi-node job with different platforms and then aggregate the results into a single proposal, but that gets hairy20:06
smcginnisI don't think that's what's actually happening here.20:07
smcginnisWe're just running the script and failing on trying to get the name here: https://opendev.org/openstack/project-config/src/branch/master/roles/copy-release-tools-scripts/files/release-tools/update_constraints.sh#L9920:08
fungioh, i think i may have misread that build log20:10
fungiactually looking again i see that it runs `python setup.py --name`20:10
fungiwhich will be using python 2.7 when we installed pip for python320:10
smcginnisYep. Then most of the rest is just sed.20:10
*** Fidde has quit IRC20:10
smcginnisReally?20:11
smcginnisShould that be updated to use 'python3 setup.py --name' then?20:11
fungii believe so20:11
fungiif it runs in a virtualenv it'll be using whatever python interprter version the virtualenv was built for, but if it's just running in a system context then `python` is 2.7 not 3.something20:12
openstackgerritSean McGinnis proposed openstack/project-config master: Use python3 for update_constraints  https://review.opendev.org/73893120:13
smcginnisAlternative then ^20:13
fungiand hopefully that doesn't cause problems for generating python 2.7 constraints for older branches20:14
fungibut having working constraints generation for master will be a good first step at least20:15
smcginnisI don't think it should. I think that script is independent of the values it updates.20:15
*** slaweq has joined #openstack-infra20:25
*** hongbin has joined #openstack-infra20:54
*** slaweq has quit IRC21:19
*** xek has quit IRC21:20
*** priteau has quit IRC21:21
*** matt_kosut has quit IRC21:21
*** matt_kosut has joined #openstack-infra21:22
*** matt_kosut has quit IRC21:26
*** factor has joined #openstack-infra21:29
*** factor has quit IRC21:33
*** factor has joined #openstack-infra21:33
*** hashar has quit IRC21:49
*** factor has quit IRC21:49
*** factor has joined #openstack-infra21:50
*** haleyb has joined #openstack-infra21:52
*** rlandy has quit IRC22:27
*** grantza has quit IRC22:28
*** icarusfactor has joined #openstack-infra22:33
*** rcernin has joined #openstack-infra22:36
*** factor has quit IRC22:36
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Handle multi-arch docker manifests in promote  https://review.opendev.org/73894522:39
*** tkajinam has joined #openstack-infra22:46
*** rcernin has quit IRC22:47
*** rcernin has joined #openstack-infra22:47
openstackgerritMerged zuul/zuul-jobs master: Handle multi-arch docker manifests in promote  https://review.opendev.org/73894522:53
*** gfidente|afk has quit IRC22:59
*** grantza has joined #openstack-infra23:01
*** hongbin has quit IRC23:11
*** tosky has quit IRC23:16
*** hongbin has joined #openstack-infra23:16
*** Lucas_Gray has joined #openstack-infra23:21
*** hamalq_ has quit IRC23:41
*** rfolco has quit IRC23:48
*** yamamoto has joined #openstack-infra23:52
*** yamamoto has quit IRC23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!