Wednesday, 2020-01-29

weshay|ruckhrm.. best guess right now would be we're sending logstash a gzipd file by accident atm, would that do it?  fix is here https://review.opendev.org/#/c/704649/200:00
clarkb"TypeError: $.plot is not a function"00:00
clarkbweshay|ruck: no we should handle gzip vs not gzip ok00:00
*** armax has quit IRC00:00
weshay|ruckhrm k00:00
* weshay|ruck gets the code I suspect00:00
clarkbweshay|ruck: I think its treating the whole document as a multiline event because it can't parse the line prefixes properly00:00
weshay|ruckhttps://opendev.org/openstack/ansible-role-collect-logs/src/branch/master/tasks/collect/system.yml#L120-L12400:01
weshay|ruckit's been there for a while though00:01
weshay|ruckI can disable it if it's blowing you guys up though00:01
clarkbweshay|ruck: https://opendev.org/openstack/logstash-filters/src/branch/master/filters/openstack-filters.conf#L12 its the INFO after the timestamp and before the |00:02
clarkbI think00:02
* weshay|ruck looks00:02
clarkbbecaus the rule there expects timestamp then |00:02
fungiokay, so graph rendering error stems from https://opendev.org/opendev/elastic-recheck/src/branch/master/web/share/elastic-recheck.js#L18 being invalid i guess?00:03
weshay|ruckoh i see00:03
clarkbfungi: ya, but reading the flot readme it seems that $.plot is the expected graphing function00:04
clarkbfungi: now I'm guessing its some issue with jquery00:04
clarkbfungi: oh expcet we may not be serving the flot files if I'm reading my debugger correctly00:05
openstackgerritMerged opendev/gerritlib master: Pass Gerrit not GerritConnection to GerritWatcher  https://review.opendev.org/70469300:05
*** yolanda has quit IRC00:06
clarkbjquery.flot.min.js is a 40400:06
*** smarcet has quit IRC00:07
clarkban issue with our minimization and copy I think00:07
clarkbI see jquery.flot.js in /opt/flot/source00:08
clarkbbut for some reason it didn't get minimized and copied00:08
*** tosky has quit IRC00:08
fungioops00:08
*** yolanda has joined #openstack-infra00:09
clarkbmanually running yui-compressor gives: Caused by: java.util.MissingResourceException: Can't find bundle for base name org.mozilla.javascript.resources.Messages, locale en_US00:10
fungido we really need to minimize these?00:11
clarkbprobably not00:11
clarkbconfirmed that running yui-compressor just on the jquery.flot.js file is what breaks00:13
fungiseems like just one more fragile toolchain component00:13
clarkbrunning it on other fiels that have been minimized succeeds00:13
clarkbmostly I just wanted to do what required minimal effort00:14
fungicompletely agree00:16
fungiwhich is why ripping out a misbehaving optional piece of the toolchain may be simpler than trying to figure out why it's choking on that file00:17
clarkbya, but then I have to figure out what to rewrite to change filepaths00:17
clarkband that is apparently really difficult00:17
clarkbits in e-r00:19
clarkbok give me a minute to set this up on the new server and if it works we can update puppet and e-r00:19
clarkbprogress, no more 404s but still not working I think we may need to load more js into the browser00:25
*** jamesmcarthur has joined #openstack-infra00:28
clarkbfungi: ya so the problem now is we basically have to include all the js files I think00:32
clarkbin normal js dev I expect all of this gets compiled into a single minimized file00:32
fungioh, were they all being concatenated previously?00:32
clarkbfungi: I think flot had everything in a monolithic file before then split stuff up00:34
clarkbin any case try a hard refresh now00:34
clarkbI think I got it00:34
clarkbnow to update puppet and e-r00:34
*** jamesmcarthur has quit IRC00:38
openstackgerritClark Boylan proposed opendev/elastic-recheck master: Update flot js file inclusion to match new flot  https://review.opendev.org/70471600:39
openstackgerritClark Boylan proposed opendev/system-config master: Copy unminimized flot files  https://review.opendev.org/70471700:41
clarkbfungi: ^ I think that will fix it00:41
fungiawesome, looking00:41
clarkboh wait I need to update gate.html too00:42
clarkbone sec00:42
openstackgerritClark Boylan proposed opendev/elastic-recheck master: Update flot js file inclusion to match new flot  https://review.opendev.org/70471600:43
clarkbthat should do it00:44
clarkb(and is in place on the new server)00:44
clarkbI feel like I just leveled up my web dev stat00:46
clarkbinfra-root I think once I've got status stable it would be good ofr us to get a handle on our gerrit tooling beyond just config management (jeepyb, gerritlib, etc). I'll try to pick up my testing work and make that more robust so we can think about maybe using the other gerrit python lib or rewrite bits of jeepyb safely00:48
clarkbthat should then feed into writing toolign to make opendev more consumable by others00:49
*** threestrands has joined #openstack-infra00:50
fungii'd love to see us discard as much of jeepyb as we can safely get away with00:53
fungioptionally, break some of it out into smaller independent projects00:54
clarkbya I think what we should do is get the important bits tested so that if/when we replace those bits we ensure behavior does't change00:54
fungiit sort of turned into a dumping ground for anything gerrit-related00:54
fungigranted, it sort of also started out as a dumping ground for anything gerrit-related00:55
clarkbya00:55
fungiit was harder for us to make new projects back then, ironically ;)00:55
fungiye olde bootstrapping problem00:55
clarkbits actually quite easy to set up a gerrit to test against now so I think we should just go ahead and do full itnegration testing of whatever gerrit-related chagnes we have :)00:56
fungiwe've been doing that for git-review since ages00:56
clarkbcorvus: ^ re that is the 'secret' passwd for admin built into gerrit?00:56
clarkbfungi: its quite a bit easier now using the zuul quickstart pattern. You don't have to manually edit the db from what I can see00:56
clarkb(which git-review does beacuse it predates simplified gerrit installation)00:56
fungibut even git-review's functional testing could benefit from being redone with our new gerrit container jobs, yeah00:56
fungigranted, git-review's can bootstrap from a tox invocation, not sure how to easily run those tests locally unless the answer is to rerun our job playbooks in a local ansible00:58
clarkbfungi: I think it would be run docker-compose then tox00:59
fungiso git-review could also benefit from some unit testing with mocks00:59
clarkbok I need to step out for evening thigns now. I'll try to swing back around and get that gitea OOM story written. If not tonight then tomorrow morning01:00
*** armax has joined #openstack-infra01:04
*** slaweq has joined #openstack-infra01:11
*** jamesmcarthur has joined #openstack-infra01:14
*** slaweq has quit IRC01:16
*** jamesmcarthur has quit IRC01:16
*** jamesmcarthur has joined #openstack-infra01:19
*** jamesmcarthur has quit IRC01:21
*** igordc has quit IRC01:23
*** yamamoto has joined #openstack-infra01:25
*** Lucas_Gray has quit IRC01:26
*** jamesmcarthur has joined #openstack-infra01:47
*** gyee has quit IRC01:55
*** hamzy has quit IRC01:56
*** hamzy has joined #openstack-infra01:56
*** jrist has quit IRC01:57
*** jpena|off has quit IRC01:57
*** weshay has joined #openstack-infra01:57
*** kopecmartin has quit IRC01:57
*** nhicher has quit IRC01:57
*** weshay|ruck has quit IRC01:57
*** kopecmartin has joined #openstack-infra02:00
*** jamesmcarthur has quit IRC02:03
*** zzzeek has quit IRC02:03
*** jpena|off has joined #openstack-infra02:05
*** zzzeek has joined #openstack-infra02:08
*** zul has quit IRC02:12
*** jamesmcarthur has joined #openstack-infra02:14
*** smarcet has joined #openstack-infra02:15
*** smarcet has joined #openstack-infra02:16
*** gshippey has quit IRC02:16
*** yamamoto has quit IRC02:19
*** nhicher has joined #openstack-infra02:20
*** rfolco has joined #openstack-infra02:31
*** rfolco has quit IRC02:36
ianwclarkb/fungi: thanks for looking in on publishing.  sorry son decided today would be a good day to jump of playground equipment and need a foot xray02:40
*** jrist has joined #openstack-infra02:40
*** jamesmcarthur has quit IRC02:53
fungiouch!03:02
fungihope it's just a bruise/sprain03:02
fungifoot fractures are no fun03:02
ianwyeah, looks like it, thankfully :)03:03
ianwi'll ping AJaeger a little later but i think those sites are good to go with a dns cutover03:04
fungigood. christine, my wife, had a compression fracture in one foot from over-training and was laid up in one of frankenstein's boots for over 6 months03:04
ianwreleases and tarballs i think will need more thought03:04
fungii hope that tarball/release publication turns out to be more straightforward than docs/site content03:05
fungithough it will need a seed copy03:05
ianw:( on the foot03:05
ianwyep, i guess step one is creating the volumes actually, which i haven't done03:05
fungiwe do already have afs publication for branch tarballs: http://files.openstack.org/project/opendev.org/tarballs/03:07
fungii think the idea was to expand that03:07
fungiand maybe redirect tarballs.openstack.org/(.*) to tarballs.opendev.org/openstack/$103:08
fungihttps://tarballs.opendev.org/ is itself up and working03:08
*** yamamoto has joined #openstack-infra03:08
ianwyeah, so if content went to /afs/...tarballs/openstack/ ...03:10
fungiif by release you mean the releases.openstack.org site, that's probably very similar to governance and security sites03:11
ianwand then static.opendev.org served the tarballs.openstack.org vhost from "/openstack" it should be transparent?03:11
*** slaweq has joined #openstack-infra03:11
fungicorrect03:11
ianwi might formalise this in some tasks of https://storyboard.openstack.org/#!/story/200659803:12
fungiwe could either do that or permanent pattern redirect03:12
fungiboth seem legit, though the latter means we might be able to drop the old hostname eventually03:13
fungianyway, if we keep the old publication job and add the new one alongside it, we can copy the existing files into afs at out leisure and then cut over hosting when it's ready, similar to what you did with governance et cetera03:15
*** yamamoto has quit IRC03:15
*** slaweq has quit IRC03:16
ianwhrm, so it seems that opendev.org www/tarballs/etc is all on one volume03:19
fungiahh, i guess moving tarballs to its own probably makes sense03:20
ianwwe could do this many ways; make an openstack tarballs volume and mount that under03:21
ianwor indeed, separate to a new volume03:21
ianwi think a little email is in order so covus can loop in asynchronously as i imagine he setup opendev.org volumes03:22
fungiyeah, i'm inclined not to separate subpaths of the tarballs site into separate volumes if only to cut down on manual overhead for new namespaces who want to start publishing tarballs in opendev03:25
*** rlandy|bbl is now known as rlandy03:29
*** jamesmcarthur has joined #openstack-infra03:29
*** jamesmcarthur has quit IRC03:38
*** rlandy has quit IRC03:42
*** goldyfruit_ has quit IRC04:04
mordredclarkb: ++ to getting a handle on gerrit tooling / dealing with jeepyb04:11
mordredthere's a bunch of things that, at this point, could be playbooks and/or zuul jobs04:11
*** udesale has joined #openstack-infra04:13
*** smarcet has quit IRC04:24
*** factor has joined #openstack-infra04:24
fungithat's basically what i was thinking with splitting stuff out04:25
funginot specifically the implementations, just the things that need doing04:26
fungiwe have simpler/cleaner ways to do a lot of it now04:26
fungicompared to 201204:26
*** ykarel|away is now known as ykarel04:35
*** zxiiro has quit IRC04:37
*** redrobot has quit IRC04:37
*** redrobot has joined #openstack-infra04:38
mordred++04:43
mordredfungi: case in point ... we have gerrit hook scripts that do $things which currently mean we have to install jeepyb into the gerrit container so that the hook scripts can run ... but those tasks might be better suited to be no-node zuul post jobs04:44
mordredthey might not04:44
mordredbut it's at least worth thinking about04:45
mordredsimilarly (and I might hack on this one sooner than later) - because puppet we currently do config management for gerrit and gitea in sequence with and tied to manage-projects ... but really manage-projects is about managing data in the service and the other is about managing the service - so maybe that wants to be two playbooks that get triggered by different things - and the gerrit project part of04:46
mordredjeepyb can just be some ansible like it is for gitea04:46
fungii suspect all the hook scripts could be zuul jobs now05:10
fungithey just call launchpad apis or leave comments on gerrit reviews05:11
*** slaweq has joined #openstack-infra05:11
fungiand i agree wrt manage-projects, though we need to find ways to stop fiddling with the database (which presumably will be necessary when we upgrade to notedb anyway)05:12
*** raukadah is now known as chkumar|rover05:13
mordredfungi: do we still fiddle with the db?05:15
mordredfungi: I thought we were all API now05:15
*** slaweq has quit IRC05:15
mordredOH05:16
mordredgroup uuid05:16
clarkbmordred: I have a change up to change that in my testing stack05:17
mordredclarkb: cool05:17
clarkbseems to work against modern gwrrit (because its tested :) ))05:17
mordredclarkb: btw - I have a change up to add apache support to docker-gerrit ... but that made me want to go LE review-dev so that the apache config for the ssl certs could be done easily05:18
clarkbmordred: k also openid login doesnt work on review-dev becauseit redirects you to review.opendev.org after logging in05:18
mordred(right now it should work  - we don't need to block on the LE - paths to certs can be passed in - but it would be nicer to not need to)05:18
mordredclarkb: neat05:18
clarkbdid not have time to look at that and just used ssh instead05:18
mordredclarkb: seems like maybe we should just go ahead and create a review-dev.opendev.org - would be a good way to verify that the ansible is taking care of everything it's supposed to05:19
clarkbmakes sense05:19
mordredI'll work on both review-dev.opendev.org and LE of review-dev.opendev.org as next steps there05:20
clarkbfwiw jeepyb and manage projects in particulwr encodes a lot of good stuff it justneeds a refactor to be maintainable05:21
mordredclarkb: gerrit.config:canonicalWebUrl = https://review.opendev.org/05:22
mordredgerrit.config:gitHttpUrl = https://review.opendev.org/05:22
clarkbpossible it gets refactored into ansible module but overall I dont think we can delete a lot of what it does05:22
mordredon review-dev ... that would do it :)05:22
clarkb++05:22
mordredclarkb: ++05:22
openstackgerritMonty Taylor proposed opendev/system-config master: Add Apache to Ansible for Gerrit  https://review.opendev.org/70449805:24
mordredclarkb: ^^ that should both add apache - and fix the openid redirect05:24
openstackgerritMonty Taylor proposed opendev/system-config master: Add SSL Cipher list to gerrit apache vhost  https://review.opendev.org/70472905:33
mordredfungi: ^^ thanks - there's the cipher list05:34
*** hwoarang has quit IRC05:48
*** hwoarang has joined #openstack-infra05:48
*** kjackal has joined #openstack-infra06:05
*** lmiccini has joined #openstack-infra07:01
*** slaweq has joined #openstack-infra07:11
openstackgerritDaniel Lublin proposed opendev/git-review master: Allow choosing which field to use as author when naming branch  https://review.opendev.org/44457407:13
*** rchanter has quit IRC07:15
*** slaweq has quit IRC07:15
*** dpawlik has joined #openstack-infra07:16
AJaegerianw: just glancing over backscroll - how can I help exactly?07:17
*** redrobot has quit IRC07:21
*** pgaxatte has joined #openstack-infra07:29
*** pkopec has joined #openstack-infra07:41
*** ykarel is now known as ykarel|lunch07:42
AJaegerfungi, ianw, transparency-policy repo is dead, no merges - but publishing is set up via https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L4254. We could remove that - let me propose that...07:44
openstackgerritAndreas Jaeger proposed openstack/project-config master: Remove publishing job for transparency-policy  https://review.opendev.org/70473707:47
AJaegerfungi, ianw, ^07:50
*** dtantsur|afk is now known as dtantsur07:54
*** slaweq has joined #openstack-infra07:56
*** tesseract has joined #openstack-infra08:03
*** hashar has joined #openstack-infra08:07
*** tkajinam has quit IRC08:08
*** rpittau|afk is now known as rpittau08:08
ianwAJaeger: do you think you might have a chance to look at the service-types publishing?08:08
AJaegerianw: I thought mnaser signed up to do all the remaining jobs?08:08
ianwAJaeger: ok, mnaser ^ :)  i think it's next on the list and should be straight forward now08:09
AJaegerianw, mnaser : happy to review and help if questions arise08:10
ianwAJaeger: if you could override governance.openstack.org and security.openstack.org with 23.253.245.150 and confirm it seems ok, i'll be confident enough to cut over the dns tomorrow08:10
AJaegerianw: https://23.253.245.150/ looks fine but not the subdirectories like https://23.253.245.150/tc08:11
*** jtomasek has joined #openstack-infra08:12
AJaegerianw: not sure how to do this for security08:12
ianwAJaeger: did you put entires in /etc/hosts for security/governance.openstack.org?08:12
AJaegerah ;)08:13
AJaegerwill do08:13
AJaegerianw: /tc still does not work for me, security looks fine08:15
AJaegerianw: could you review this docs update, please? https://review.opendev.org/70435908:15
ianwAJaeger: hrm ... https://governance.openstack.org/tc/ is working for me with the hosts override, let me check the logs08:16
AJaegertry: without trailing "/" -> https://governance.openstack.org/tc08:17
ianwahh, hrm08:17
AJaegerAh, without neither site works - so user error ;)08:17
AJaegerall is good ;)08:17
ianwheh, yeah just trying that :)  ok, at least everything is broken in the same way :)08:18
AJaegerall links seem to work - let's switch ;)08:19
ianwmnaser: i've added https://storyboard.openstack.org/#!/story/2006598 task  38503 for the service-types change08:20
*** rcernin has quit IRC08:20
openstackgerritMerged openstack/project-config master: Fix description for promote-tox-docs-infra  https://review.opendev.org/70435908:26
openstackgerritAndreas Jaeger proposed openstack/project-config master: Remove static publishing for governance  https://review.opendev.org/70474108:28
AJaegerianw: once you swichted DNS, we cna merge ^08:28
ianwAJaeger: thanks, cleanup was my next thing :)08:29
*** gfidente has joined #openstack-infra08:29
*** dchen has quit IRC08:32
openstackgerritAntoine Musso proposed zuul/zuul master: gear: remove support for custom MASS_DO packet  https://review.opendev.org/70474208:34
*** tosky has joined #openstack-infra08:35
AJaegerianw: what was the topic to use? I forgot about it ;(08:39
AJaegerianw: will use static-services ...08:40
ianwAJaeger: static-services is the one from the spec08:40
ianwi don't think i've been super careful about using it though08:40
openstackgerritAndreas Jaeger proposed openstack/project-config master: Remove static publishing for governance  https://review.opendev.org/70474108:40
openstackgerritAndreas Jaeger proposed openstack/project-config master: Remove promote-tox-docs-static  https://review.opendev.org/70474508:40
AJaegerianw: cleanups pushed and topic updated. fungi will need to approve the election change08:42
ianwthanks, i'm about to disappear so won't switch dns now and leave anyone with a mess :)08:42
AJaegerhave a good night, ianw ! Thanks08:43
openstackgerritAndreas Jaeger proposed openstack/project-config master: Move governance-uc jobs in-tree  https://review.opendev.org/70474708:52
*** jpena|off is now known as jpena08:54
*** ralonsoh has joined #openstack-infra08:59
*** gshippey has joined #openstack-infra09:03
*** rchanter has joined #openstack-infra09:03
*** ykarel|lunch is now known as ykarel09:04
openstackgerritSorin Sbarnea proposed opendev/gerritbot master: Avoid silent execution failures  https://review.opendev.org/61880209:13
*** lucasagomes has joined #openstack-infra09:16
openstackgerritMohammed Naser proposed zuul/zuul master: Start ignoring certain Gerrit events  https://review.opendev.org/70475609:38
*** iurygregory has joined #openstack-infra09:40
openstackgerritSimon Westphahl proposed zuul/zuul master: Allow skipping child jobs from paused job again  https://review.opendev.org/70475809:47
*** threestrands has quit IRC09:47
openstackgerritSagi Shnaidman proposed openstack/project-config master: Don't require CLA for contributors of Ansible Openstack modules  https://review.opendev.org/70464809:55
mnaserAJaeger: i apologize for dropping the ball on the static hosting thing.  i've had a few things happen here personally that slowed me down overall.  i'd like to know where it's at roughly and what's needed to finish it up09:59
*** xek has quit IRC10:10
*** derekh has joined #openstack-infra10:13
*** lifeless has quit IRC10:19
*** hashar has quit IRC10:30
*** ykarel is now known as ykarel|away10:31
AJaegermnaser: I didn't dig into that either in the last weeks, so from ianw I understood that he needs a job for service-types publishing. Have a look what we did for the other repos and ask if you have questions.10:34
AJaegermnaser: Is everything fine for you again and are you able to help - or do you need help?10:34
*** psachin has joined #openstack-infra10:35
ianwmnaser: yes please don't stress over it; https://storyboard.openstack.org/#!/story/2006598 task #37723 is the next thing10:36
ianwbut we are not blocked, there's work to do with tarballs and releases that i have in progress too10:37
AJaegermnaser: the stack at https://review.opendev.org/#/c/704737 is the cleanup for the first jobs in case you want to review a bit10:43
*** xek has joined #openstack-infra10:55
*** pcaruana has quit IRC10:57
*** priteau has joined #openstack-infra10:59
*** udesale has quit IRC11:01
*** xek_ has joined #openstack-infra11:10
*** xek has quit IRC11:10
openstackgerritMatthieu Huin proposed zuul/zuul master: JWT drivers: Deprecate RS256withJWKS, introduce OpenIDConnect  https://review.opendev.org/70197211:12
openstackgerritMatthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option  https://review.opendev.org/70227511:12
openstackgerritMatthieu Huin proposed zuul/zuul master: admin REST API: zuul-web integration  https://review.opendev.org/64353611:12
*** Lucas_Gray has joined #openstack-infra11:16
openstackgerritDaniel Bengtsson proposed openstack/reviewstats master: Stop configuring install_command in tox.  https://review.opendev.org/69450611:17
*** psachin has quit IRC11:18
*** rchanter has quit IRC11:33
*** pcaruana has joined #openstack-infra11:40
*** calbers has quit IRC11:49
*** ykarel|away is now known as ykarel11:49
*** calbers has joined #openstack-infra11:50
*** rpittau is now known as rpittau|bbl11:53
*** ociuhandu has joined #openstack-infra11:58
*** ramishra has quit IRC12:08
*** rfolco has joined #openstack-infra12:10
*** hashar has joined #openstack-infra12:10
*** ramishra has joined #openstack-infra12:13
*** sshnaidm is now known as sshnaidm|afk12:15
openstackgerritTristan Cacqueray proposed zuul/zuul-operator master: Replace existing operator tasks with the new dhall function  https://review.opendev.org/70210612:29
openstackgerritTristan Cacqueray proposed zuul/zuul-operator master: Generate TLS certificats for the gearman service  https://review.opendev.org/70271612:29
openstackgerritTristan Cacqueray proposed zuul/zuul-operator master: Handle service restart when connections are changed  https://review.opendev.org/70362412:29
openstackgerritTristan Cacqueray proposed zuul/zuul-operator master: Add tenant reconfiguration when main.yaml changed  https://review.opendev.org/70363112:29
openstackgerritTristan Cacqueray proposed zuul/zuul-operator master: Add OpenShift SCC and functional test  https://review.opendev.org/70275812:30
*** jpena is now known as jpena|lunch12:31
*** ociuhandu has quit IRC12:31
*** hashar has quit IRC12:34
mnaserAJaeger, ianw: cool, i'm doing better now -- it sounds like most governance/tc related stuff is taken care of and the only static publishing left is specs/security/service-types from what i understand in that story, right?12:36
*** ociuhandu has joined #openstack-infra12:40
openstackgerritThierry Carrez proposed opendev/irc-meetings master: Add Large Scale SIG meeting  https://review.opendev.org/70479012:42
openstackgerritMohammed Naser proposed zuul/zuul master: Start ignoring certain Gerrit events  https://review.opendev.org/70475612:44
openstackgerritMerged openstack/project-config master: Remove publishing job for transparency-policy  https://review.opendev.org/70473712:46
*** ramishra has quit IRC12:50
*** gfidente has quit IRC12:56
*** gfidente has joined #openstack-infra12:57
openstackgerritMerged opendev/irc-meetings master: Add Large Scale SIG meeting  https://review.opendev.org/70479012:58
*** Lucas_Gray has quit IRC12:59
*** goldyfruit_ has joined #openstack-infra13:01
*** rlandy has joined #openstack-infra13:02
*** artom has quit IRC13:06
AJaegermnaser: yes, looks like it. ianw might know best13:07
*** rh-jelabarre has joined #openstack-infra13:12
*** ociuhandu has quit IRC13:17
*** ociuhandu has joined #openstack-infra13:21
*** ociuhandu has quit IRC13:26
*** jpena|lunch is now known as jpena13:29
*** smarcet has joined #openstack-infra13:29
*** rchanter has joined #openstack-infra13:29
*** rpittau|bbl is now known as rpittau13:30
*** rosmaita has quit IRC13:32
*** rosmaita has joined #openstack-infra13:32
*** pkopec_ has joined #openstack-infra13:33
*** smarcet has quit IRC13:33
*** ramishra_ has joined #openstack-infra13:36
*** pkopec has quit IRC13:36
*** ykarel is now known as ykarel|away13:36
*** redrobot has joined #openstack-infra13:46
*** Lucas_Gray has joined #openstack-infra13:49
*** jamesmcarthur has joined #openstack-infra13:49
*** strigazi has quit IRC13:56
*** rchanter has quit IRC13:58
*** petevg has joined #openstack-infra13:59
*** ociuhandu has joined #openstack-infra14:00
*** strigazi has joined #openstack-infra14:02
*** ykarel|away is now known as ykarel14:02
*** zxiiro has joined #openstack-infra14:04
*** pkopec_ has quit IRC14:05
*** pkopec has joined #openstack-infra14:05
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: fetch-output-openshift: initial role  https://review.opendev.org/68204414:11
*** smarcet has joined #openstack-infra14:12
*** gfidente has quit IRC14:13
*** gfidente has joined #openstack-infra14:13
*** Lucas_Gray has quit IRC14:14
*** addyess has quit IRC14:16
*** KeithMnemonic has joined #openstack-infra14:20
*** zzzeek has quit IRC14:22
*** pkopec has quit IRC14:23
*** pkopec has joined #openstack-infra14:23
*** zzzeek has joined #openstack-infra14:23
*** addyess has joined #openstack-infra14:24
*** pkopec has quit IRC14:26
*** pkopec has joined #openstack-infra14:26
*** jamesmcarthur has quit IRC14:38
*** pkopec has quit IRC14:39
*** pkopec has joined #openstack-infra14:39
*** jamesmcarthur has joined #openstack-infra14:40
*** jamesmcarthur has quit IRC14:45
*** priteau has quit IRC14:50
*** priteau has joined #openstack-infra14:51
openstackgerritTristan Cacqueray proposed zuul/zuul-operator master: Add OpenShift SCC and functional test  https://review.opendev.org/70275814:53
*** priteau has quit IRC14:56
*** sshnaidm|afk is now known as sshnaidm14:56
*** dklyle has quit IRC15:02
*** dklyle has joined #openstack-infra15:03
*** priteau has joined #openstack-infra15:07
*** jamesmcarthur has joined #openstack-infra15:09
*** jamesmcarthur has quit IRC15:14
*** smarcet has quit IRC15:24
*** ociuhandu has quit IRC15:24
*** smarcet has joined #openstack-infra15:30
*** artom has joined #openstack-infra15:31
fricklerinfra-root: FYI I'm going to be on PTO until next Wednesday15:40
clarkbfrickler: enjoy your holidays15:40
*** pgaxatte has quit IRC15:42
openstackgerritMerged opendev/elastic-recheck master: Update flot js file inclusion to match new flot  https://review.opendev.org/70471615:42
clarkbfungi: ^ I went ahead and approved that and will approve the config mgmt side now15:43
clarkbAnd once this stabilizes I'll have to see if I can work e-r into the QA teams toolset. gmann do you have thoughts on that?15:44
*** smarcet has quit IRC15:45
*** jamesmcarthur has joined #openstack-infra15:47
*** smarcet has joined #openstack-infra15:50
*** lbragstad has quit IRC15:52
*** ociuhandu has joined #openstack-infra15:52
*** jamesmcarthur has quit IRC15:53
*** smarcet has quit IRC15:53
*** smarcet has joined #openstack-infra15:55
*** lbragstad has joined #openstack-infra15:57
*** jackedin has joined #openstack-infra16:01
*** smarcet has quit IRC16:01
*** chkumar|rover is now known as raukadah16:04
openstackgerritMerged opendev/system-config master: Copy unminimized flot files  https://review.opendev.org/70471716:07
openstackgerritMerged openstack/project-config master: Remove static publishing for governance  https://review.opendev.org/70474116:07
*** ykarel is now known as ykarel|away16:09
*** eharney has quit IRC16:09
*** smarcet has joined #openstack-infra16:13
*** gyee has joined #openstack-infra16:14
*** lmiccini has quit IRC16:21
clarkbto summarize the airship call it was largely a logistics call. Explaining how we enroll resources into nodepool once accounts are ready16:23
clarkbsounds like we may have credentials by the end of the week16:24
clarkbre the flot stuff. I'll force puppet to rerun the flot file copies by moving the flot repo aside16:25
openstackgerritThierry Carrez proposed openstack/project-config master: Allow python-storyboardclient direct release  https://review.opendev.org/70483716:33
fungiyour local edits seem to have gotten the graphs showing up for me at least16:34
clarkbfungi: ya, I've now undone them to force updates16:34
clarkbthough I think I need to wait for N+1 puppet because N is about to run16:34
clarkbfungi: if you hard refresh they should be broken16:34
fungiyep, confirmed, on reload they're broken again16:34
clarkbthen once confirmed that it reconfigures properly I'll switch dns and look at deleting the old server tomorrow.16:35
fungiso once they start working once more, we can update dns i suppose16:35
fungiyeah16:35
*** lbragstad has quit IRC16:38
clarkbyup next run should have it so in about an hour it will be another round of browser refreshes16:38
*** jamesmcarthur has joined #openstack-infra16:39
clarkbwith that out of the way, are we all caught up on static migration reviews? AJaeger fungi16:40
AJaegerclarkb: we're ready to switch dns anytime - ianw wnats to do it later today16:40
fungii believe i am. we need some help from the uc to approve changes there though16:40
clarkbroger16:41
fungibut those are just cleanup16:41
clarkbthis is excellent progress over the last few days, thank you everyone for helping16:41
AJaegerexactly, only cleanup left - and then next sites ;)16:41
openstackgerritMerged openstack/project-config master: Remove promote-tox-docs-static  https://review.opendev.org/70474516:45
fungipretty sure security.o.o dns can be switched over too if it hasn't been already16:49
gmannclarkb: i am ok for e-r to QA, only worring about web part of it as i (or any QA) have very limited knowledge on js side.16:50
gmannbut you are here so should be ok :)16:50
clarkbgmann: same with us re web16:50
AJaegerfungi: both governance and security can - but ianw did not have time to monitor in case of problems16:50
AJaegerfungi: and only those two AFAIU16:50
clarkbgmann: I think in my mind to start its mostly just using the tool and keep queries up to date16:50
fungiyep16:50
clarkbgmann: as it is a really powerful tool for QA work, but seems like the QA team may not use it much?16:51
fungiAJaeger: that's what i gathered from scrollback anyway. thanks for confirming16:51
*** eharney has joined #openstack-infra16:51
fungiclarkb: gmann: the irony is that the web stuff was developed by (then) regular contributors to the qa team along with some interns16:52
gmannclarkb: yeah. health-deashboard is another example where js things are setup and keep working.16:52
gmannfungi: clarkb true. i think they keep working and if anyone want to improve/enhance anyone is welcome. so overall lgtm. keep it upto date with queries etc is more close to QA.16:53
AJaegerspotz: could you put https://review.opendev.org/#/c/704746/ on your review queue, please? It's a small job cleanup16:53
*** ociuhandu has quit IRC16:59
clarkbgmann: (this is pure brainstorming right now) to start maybe the QA team can try to add a new query each week? Could be group activity during office hours if no one shows up with other questions17:00
*** bnemec-ooo has quit IRC17:00
clarkbgmann: then we'll improve our classificatiion rate and get some experience with the tool17:00
gmann+117:01
spotzAJaeger: looking now17:02
spotzI'll ask the group to review tomorrow morning in our meeting if will workflow after if that works for you17:03
spotzif=and17:03
fungispotz: it's just cleanup, so it's not blocking anything urgent, but reviews are appreciated nonetheless!17:05
spotzfungi okie17:05
*** jackedin_ has joined #openstack-infra17:10
*** lucasagomes has quit IRC17:12
*** jackedin has quit IRC17:14
*** lbragstad has joined #openstack-infra17:15
*** dtantsur is now known as dtantsur|afk17:19
AJaegerspotz: there's no functional change, just moving the lines from one repo to another. It can wait until tomorrow. thanks17:20
spotzAJaeger: Just trying to get the UC more into the mindset of checking for reviews17:21
*** pkopec has quit IRC17:24
AJaegerspotz: hope you're successful ;)17:26
spotzAJaeger: Thanks:)17:28
*** rpittau is now known as rpittau|afk17:33
clarkbstatus has had its N+1 puppet run and appears to have working e-r graphs again17:37
clarkbfungi: ^ can you double check when you have a moment?17:38
clarkbI've just noticed that I think there is a bug in the time axis labels17:38
clarkbbut I think we can sort that out as a followon17:38
clarkb(probably a unit conversion? I dunno)17:38
*** gfidente is now known as gfidente|afk17:38
clarkbif the time axis labels are the only issue we can find I'll go ahead and update dns17:42
fungiclarkb: yep, seems to be working again, graphs load more quickly than they used to as well, i think?17:43
fungiand yeah, the x axis values are indeed strange. i wonder what that's a count of... hours?17:44
clarkbit should be a 10 day range17:44
clarkbthat means there are 30 indexes there17:45
clarkbeach is 8 hours?17:45
clarkbI'm going to update dns17:45
*** jberg-dev has joined #openstack-infra17:47
clarkb#status log Updated status.openstack.org to point at new Xenial status01.openstack.org server17:49
openstackstatusclarkb: finished logging17:49
clarkbgmann: ^ please let us know if you see any problems with health17:50
clarkbI'll delete the old server in the next day or two if no problems show up17:50
gmannclarkb: sure.17:52
clarkbcool have a fix for the xaxis now17:56
clarkbchange in a minute17:56
*** jpena is now known as jpena|off17:58
openstackgerritClark Boylan proposed opendev/elastic-recheck master: Fix flot xaxis labels  https://review.opendev.org/70485817:59
clarkbfungi: ^17:59
fungiawesome17:59
clarkbflot has really good docs which help a js noob like me figure things out18:00
openstackgerritMerged openstack/project-config master: Don't require CLA for contributors of Ansible Openstack modules  https://review.opendev.org/70464818:01
*** rkukura has joined #openstack-infra18:01
clarkbin debugging ^ I've realized that the json files we load have lots of unnecessary whitespace which may contribute to their size18:01
clarkbworking on a fix for that now too18:01
*** mattw4 has joined #openstack-infra18:01
*** lbragsta_ has joined #openstack-infra18:03
*** derekh has quit IRC18:03
openstackgerritClark Boylan proposed opendev/elastic-recheck master: Don't pretty print json files  https://review.opendev.org/70486018:06
clarkbI expect ^ will have a noticeable impact on file size which should impact page load times18:07
*** jamesmcarthur has quit IRC18:09
*** michael-beaver has joined #openstack-infra18:10
clarkb1.7MB to 302KB18:11
clarkbwith the current all.json file18:11
*** rkukura has quit IRC18:15
*** jamesmcarthur has joined #openstack-infra18:18
funginice!18:18
*** adriancz has quit IRC18:18
fungithat's a lot of whitespace18:18
*** lbragsta_ has quit IRC18:20
*** tosky has quit IRC18:22
Shrewswow. quick math says 82% reduction? crazy18:26
openstackgerritMerged opendev/elastic-recheck master: Fix flot xaxis labels  https://review.opendev.org/70485818:26
*** jamesmcarthur has quit IRC18:26
clarkbShrews: ya its a lot of deep nesting so a lot of 4 space indents18:27
Shrewsclarkb: great find18:29
openstackgerritMerged opendev/elastic-recheck master: Don't pretty print json files  https://review.opendev.org/70486018:32
*** priteau has quit IRC18:33
*** rkukura has joined #openstack-infra18:34
*** ramishra_ has quit IRC18:37
fungiwhat i like best is that it's just yet another thing we can *stop* doing, so simplifies the automation in the process18:37
*** eharney has quit IRC18:38
*** benj_ has quit IRC18:47
*** kjackal has quit IRC18:47
*** benj_ has joined #openstack-infra18:47
*** ralonsoh has quit IRC18:47
*** kjackal has joined #openstack-infra18:49
*** eharney has joined #openstack-infra18:51
*** iurygregory has quit IRC18:52
openstackgerritJeremy Stanley proposed opendev/puppet-mediawiki master: Update default OpenID provider to ubuntu.com  https://review.opendev.org/63076118:53
openstackgerritJeremy Stanley proposed opendev/puppet-mediawiki master: puppet-lint: class included by absolute name  https://review.opendev.org/70486318:53
fungiinfra-puppet-core: can you take a look at ^ when you get a sec?18:53
*** pkopec has joined #openstack-infra18:54
*** jamesmcarthur has joined #openstack-infra18:55
*** tesseract has quit IRC18:59
*** igordc has joined #openstack-infra19:02
*** jackedin_ has quit IRC19:02
*** tomaw has quit IRC19:04
*** kjackal has quit IRC19:04
*** tomaw has joined #openstack-infra19:05
*** hashar has joined #openstack-infra19:10
openstackgerritJeremy Stanley proposed opendev/puppet-mediawiki master: Sort extensions list for improved manageability  https://review.opendev.org/70487119:13
openstackgerritJeremy Stanley proposed opendev/puppet-mediawiki master: Add the ConfirmEdit extension  https://review.opendev.org/70487219:13
fungithose too19:13
*** kprice789 has joined #openstack-infra19:14
clarkbfungi: yup I'll take a look shortly19:15
*** smarcet has quit IRC19:17
fungithat last one is going to grow, i'm iterating through missing extensions now19:17
*** kjackal has joined #openstack-infra19:18
*** hashar has quit IRC19:26
*** eharney has quit IRC19:26
openstackgerritJeremy Stanley proposed opendev/puppet-mediawiki master: Sort extensions list for improved manageability  https://review.opendev.org/70487119:27
openstackgerritJeremy Stanley proposed opendev/puppet-mediawiki master: Add missing extensions  https://review.opendev.org/70487219:27
*** jamesmcarthur has quit IRC19:27
fungihttps://wiki-dev.openstack.org/wiki/Main_Page is loading for me with those applied19:28
funginext i need to focus on figuring out why the login button isn't showing up, and also why images are missing19:28
clarkbnice. sorry just finishing up one thing then will dig into that19:28
fungibut need to take a break to grab late lunch and run some pre-fosdem errands, should be back soonish19:29
*** mattw4 has quit IRC19:29
*** mattw4 has joined #openstack-infra19:30
*** jamesmcarthur has joined #openstack-infra19:38
*** eharney has joined #openstack-infra19:39
cloudnullqq - any idea why this is failing zuul checks - https://review.opendev.org/#/c/704875/3/zuul.d/layout.yaml ?19:42
cloudnull"multiple repeat at position 37"?19:42
openstackgerritMerged zuul/zuul master: Change default Gerrit HTTP auth method  https://review.opendev.org/70406819:43
clarkbcloudnull: line 40, **19:44
clarkbI'm guessing that is a regex parse error19:44
cloudnullah ha!19:44
clarkbline 61 too19:44
* cloudnull updating 19:45
cloudnullthanks cloudnull19:45
cloudnull** clarkb19:45
cloudnullstupid tab complete.19:45
clarkbyou're welcome19:46
clarkbfungi: I went ahead and approved all but https://review.opendev.org/#/c/704872/. The other chagne swere small in scope and applied to non production server. For https://review.opendev.org/#/c/704872/ you indicated the listm ight grow so left it as is for now19:48
*** eharney has quit IRC19:48
clarkbif that is the complete list feel free to approve19:48
*** dklyle has quit IRC19:56
*** gmann is now known as gmann_afk19:57
*** dawzon has joined #openstack-infra19:58
*** lifeless has joined #openstack-infra20:01
*** dklyle has joined #openstack-infra20:03
*** hashar has joined #openstack-infra20:05
*** dklyle has quit IRC20:08
*** dklyle has joined #openstack-infra20:14
openstackgerritClark Boylan proposed opendev/elastic-recheck master: Simplify 1708704's query  https://review.opendev.org/70487820:17
clarkbfungi: ^ workaround for the e-r OOMing20:17
openstackgerritMerged opendev/puppet-mediawiki master: puppet-lint: class included by absolute name  https://review.opendev.org/70486320:18
openstackgerritMerged opendev/puppet-mediawiki master: Update default OpenID provider to ubuntu.com  https://review.opendev.org/63076120:18
* clarkb finds lunch20:19
*** smarcet has joined #openstack-infra20:20
*** slaweq has quit IRC20:22
*** slaweq has joined #openstack-infra20:23
*** mattw4 has quit IRC20:25
ianwok i'm going to switch the governance and static openstack.org A/AAAA to the opendev server now20:27
ianwactually they're cname-ed20:29
ianw#status log governance.openstack.org and security.openstack.org switched CNAMEs to new static.opendev.org server20:30
openstackstatusianw: finished logging20:30
openstackgerritMerged zuul/zuul-jobs master: Fix periodic image build jobs  https://review.opendev.org/70468020:34
*** auristor has quit IRC20:37
*** auristor has joined #openstack-infra20:38
*** pkopec has quit IRC20:43
openstackgerritMerged openstack/project-config master: Allow python-storyboardclient direct release  https://review.opendev.org/70483720:47
*** dawzon has quit IRC20:53
*** slaweq has quit IRC20:54
openstackgerritMerged opendev/puppet-mediawiki master: Sort extensions list for improved manageability  https://review.opendev.org/70487120:54
*** eharney has joined #openstack-infra21:03
*** slaweq has joined #openstack-infra21:04
*** smarcet has quit IRC21:04
*** jamesmcarthur has quit IRC21:05
*** kjackal has quit IRC21:07
*** artom has quit IRC21:08
*** slaweq has quit IRC21:09
*** Lucas_Gray has joined #openstack-infra21:10
*** slaweq has joined #openstack-infra21:11
*** smarcet has joined #openstack-infra21:14
*** slaweq has quit IRC21:16
fungiclarkb: thanks, i indicated the list would grow, then i grew the list in another revision. it's probably complete for now so i'll approve21:16
clarkb++21:17
*** gmann_afk is now known as gmann21:17
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: fetch-output-openshift: initial role  https://review.opendev.org/68204421:25
openstackgerritMerged opendev/elastic-recheck master: Simplify 1708704's query  https://review.opendev.org/70487821:27
clarkbfungi: thank you for ^21:27
fungiyw21:27
clarkblooks like refstack is the last host not being currently looked at for upgrades that needs an upgrade21:30
clarkbfungi: any idea who to talk to about possibly taking a downtime on that service (mostly awnt to coordinate any acitivty)21:30
*** rcernin has joined #openstack-infra21:32
openstackgerritClark Boylan proposed opendev/system-config master: Switch more puppet testing to xenial  https://review.opendev.org/70488921:32
clarkbthis is a related cleanup change to the work we've done the last few days21:32
*** jamesmcarthur has joined #openstack-infra21:32
*** stevebaker_ has quit IRC21:35
openstackgerritMerged opendev/puppet-mediawiki master: Add missing extensions  https://review.opendev.org/70487221:38
fungiclarkb: i feel like this might be something diablo_rojo_phon can help with21:38
fungior diablo_rojo depending on time of day21:39
fungi(regarding refstack)21:39
*** mattw4 has joined #openstack-infra21:40
clarkbianw: https://storyboard.openstack.org/#!/story/2007237 story filed21:42
*** xek_ has quit IRC21:42
clarkbianw: let me know if I can add more info21:42
clarkbfungi: good idea21:42
*** apetrich has quit IRC21:43
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: fetch-output-openshift: initial role  https://review.opendev.org/68204421:43
diablo_rojoclarkb, you need refstack reviews? or what?21:45
*** gfidente|afk is now known as gfidente21:46
clarkbdiablo_rojo: we need to upgrade the server refstack runs on and wonder how/who to coordinate any needed downtime/testing/etc21:46
diablo_rojoOhh okay. I can help? Though I am not sure exactly what that entails.21:47
clarkbdiablo_rojo: usually the way it works is we build a new server alongside the old one, test that it works and then cut dns over. In this case there is a db backend that we'll either need to share or migrate over too. I'll have to have a think on the best way to do that21:47
clarkbdiablo_rojo: I think what we would need is someone to help confirm that the new server is workign ebfore we make it the production server21:47
diablo_rojoAh, okay. I am not exactly sure how to do that having not touched it before, but I can poke egle and see what that entails.21:48
clarkbthanks!21:48
clarkbnote there is no new server yet. likely a next week acitivty21:48
diablo_rojoclarkb, no problem21:48
diablo_rojoclarkb, noted.21:50
openstackgerritsebastian marcet proposed opendev/puppet-openstackid master: Refactored Deployment Script Functions  https://review.opendev.org/70432921:53
smarcetfungi: could we review and approved theese changes https://review.opendev.org/#/c/704329/ and https://review.opendev.org/#/c/704482/ thx u :)21:55
clarkbsmarcet: fyi semicolon is still there at https://review.opendev.org/#/c/704329/1..3/files/functions21:58
smarcetclarkb: sorry will get rid of it21:58
clarkbno worth a -1, but figured I would point it out21:58
clarkbk21:58
fungidiablo_rojo: i'm happy to work with you on that too, we can tag-team it if you like22:00
fungii'm also not that sure what i'm looking at, so it can be a learning experience all 'round22:00
*** ociuhandu has joined #openstack-infra22:01
openstackgerritsebastian marcet proposed opendev/puppet-openstackid master: Refactored Deployment Script Functions  https://review.opendev.org/70432922:03
smarcetfungi:clarkb: done :)22:03
*** ociuhandu has quit IRC22:06
*** smarcet has quit IRC22:06
*** jtomasek has quit IRC22:06
*** tosky has joined #openstack-infra22:10
clarkbthe e-r graph pages are now backed by the smaller json files22:14
clarkbit seems like they load much quicker now22:14
openstackgerritMerged opendev/puppet-openstackid master: Fixed broken deployment  https://review.opendev.org/70448222:15
*** rh-jelabarre has quit IRC22:17
*** jamesmcarthur has quit IRC22:18
*** jamesmcarthur has joined #openstack-infra22:19
*** artom has joined #openstack-infra22:19
fungithey already seemed quicker than the old server, so supra-fast now22:24
clarkbI'm going to look at logstash and es a bit closer now to see what may be making them unhappy22:25
*** hashar has quit IRC22:25
openstackgerritJames E. Blair proposed zuul/zuul master: Add gcloud_service auth option for Gerrit driver  https://review.opendev.org/70490422:26
clarkbwe've essentially run out of disk :/22:32
clarkbI'm going to delete older indexes to free space for new data22:33
*** rfolco has quit IRC22:33
clarkbthen we'll likely need to figure out why daily indexes are into the half terabyte size range22:33
fungi#status log filed pbl whitelisting request with spamhaus for lists.katacontainers.io ipv4 address22:35
openstackstatusfungi: finished logging22:35
clarkbI manually reduced ES retention to a week for the current dataset22:39
clarkbI expect the cluster will go green, then we can monitor and make adjustment should we overflow again22:39
ianwclarkb: thanks for story, LGTM as something we can track22:45
clarkbinfra-root https://review.opendev.org/#/c/704889/ passes testing and would be good to land to reflect our current ability to test things and what we've got in production22:46
clarkb(its a simple change to what platforms we run puppet tests for a few things on)22:46
ianwsince we seem ok with the tarball mail i sent, i'm going to get creating the afs volume and see about publishing jobs22:47
fungisounds great, thanks for taking care of that ianw!22:48
clarkbthe refstack installation process is interesting22:56
clarkbwe download the sdist from pypi, untar it, pip install that, then run npm things in it22:56
clarkbat this point I think the nodejs stuff may potentially cause us problems22:56
*** smarcet has joined #openstack-infra23:03
openstackgerritMerged opendev/puppet-openstackid master: Refactored Deployment Script Functions  https://review.opendev.org/70432923:05
clarkbya we install nodejs-legacy which doesn't exist on newer distro releaes23:06
*** smarcet has quit IRC23:06
*** kaisers has quit IRC23:06
*** tkajinam has joined #openstack-infra23:07
*** slaweq has joined #openstack-infra23:11
openstackgerritJames E. Blair proposed zuul/zuul master: Add gcloud_service auth option for Gerrit driver  https://review.opendev.org/70490423:12
*** rlandy is now known as rlandy|bbl23:14
*** slaweq has quit IRC23:16
*** kaisers has joined #openstack-infra23:23
*** dchen has joined #openstack-infra23:24
openstackgerritMerged opendev/system-config master: Switch more puppet testing to xenial  https://review.opendev.org/70488923:27
clarkbI think I'll need to spin up a test VM for refstack and spend a lot of time manually iterating on it23:28
clarkbthe node stuff is gonna need work for sure23:28
*** gfidente has quit IRC23:33
*** sshnaidm is now known as sshnaidm|afk23:45
*** tosky has quit IRC23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!