Thursday, 2018-08-09

*** gyee has quit IRC00:00
*** jamesmcarthur has quit IRC00:03
ianwanyone want to suggest why the "when:" statement for only including the file on centos & debian didn't trigger properly in http://logs.openstack.org/35/589335/10/check/openstack-infra-base-integration-fedora-latest/9470852/ara-report/ ?00:04
*** bobh has joined #openstack-infra00:04
*** bobh has quit IRC00:08
*** bobh has joined #openstack-infra00:09
*** r-daneel has quit IRC00:10
scasmy gut says old syntax00:11
ianwfor extra weirdness, here's the same thing from a prior run where it seem sto be skipped correctly -> http://logs.openstack.org/35/589335/10/check/openstack-infra-base-integration-fedora-27/f6259d3/ara-report/00:12
*** zhurong has joined #openstack-infra00:12
*** bobh has quit IRC00:13
scaswhen: "'{{ ansible_os_family }}' == 'Debian' and [...]" is what my non-ansible ways seem to conjure up00:13
ianwwhen should be a raw jinja2 expression, so no braces etc00:15
scasi didn't say i knew ansible well :)00:17
*** dingyichen has joined #openstack-infra00:22
*** dhill_ has joined #openstack-infra00:28
*** xarses_ has joined #openstack-infra00:29
*** dhill_ has quit IRC00:29
*** dhill_ has joined #openstack-infra00:29
*** jesusaur has quit IRC00:42
*** kei-ichi has quit IRC00:47
*** kei-ichi has joined #openstack-infra00:49
*** dhill_ has quit IRC00:49
openstackgerritWei Tie proposed openstack-dev/pbr master: Support subdirectory in the url  https://review.openstack.org/59006601:04
*** ddurst- is now known as ddurst01:04
*** gagehugo_ has quit IRC01:07
*** pbourke has quit IRC01:20
*** pbourke has joined #openstack-infra01:22
*** gagehugo has joined #openstack-infra01:22
*** eumel8 has quit IRC01:24
*** zhurong has quit IRC01:47
*** yamamoto has joined #openstack-infra01:48
*** yamamoto has quit IRC01:51
*** xarses_ has quit IRC01:55
*** SumitNaiksatam has joined #openstack-infra01:56
*** mriedem has quit IRC02:08
ianwsight, 500 errors from github for a pull request02:15
*** jamesmcarthur has joined #openstack-infra02:21
*** xe1gyq_ has joined #openstack-infra02:25
xe1gyq_Hi :)02:25
xe1gyq_I am working in setting up OpenStack Documentation for StarlingX and I have some questions02:25
xe1gyq_I am not clear what is the official guideline about the structure of <project>/doc directory, does it need to include conf.py or not? Any place to see the latest documentation about the specific structure?02:26
xe1gyq_About the same <project>/doc structure, which could be a project that implements these latest guidelines on documentation stucture and build?02:27
*** Bhujay has joined #openstack-infra02:30
*** Bhujay has quit IRC02:30
*** Bhujay has joined #openstack-infra02:31
*** zhurong has joined #openstack-infra02:34
*** rmcallis has joined #openstack-infra02:39
*** rmcall has quit IRC02:41
*** dklyle has joined #openstack-infra02:46
*** psachin has joined #openstack-infra02:47
*** hongbin has joined #openstack-infra02:49
*** Bhujay has quit IRC02:51
*** bobh has joined #openstack-infra02:53
*** bobh has quit IRC02:55
*** rmcall has joined #openstack-infra02:56
*** bobh has joined #openstack-infra02:56
*** rmcallis has quit IRC02:57
*** bobh has quit IRC02:57
*** rosmaita has quit IRC03:04
*** roman_g has quit IRC03:07
*** bobh_ has joined #openstack-infra03:08
*** bobh_ has quit IRC03:11
jlv-sickAre POST_FAILUREs a known issue at the moment?03:17
jlv-sickI've gotten them twice in two runs over the last 4 hours or so: https://review.openstack.org/54713203:17
*** ykarel has joined #openstack-infra03:21
*** jamesmcarthur has quit IRC03:30
*** dhill_ has joined #openstack-infra03:35
*** ramishra has joined #openstack-infra03:36
*** jesusaur has joined #openstack-infra03:38
*** ykarel_ has joined #openstack-infra03:38
*** ykarel has quit IRC03:40
*** dhill_ has quit IRC03:40
*** hongbin has quit IRC03:41
*** dklyle has quit IRC03:42
*** dhill_ has joined #openstack-infra03:43
*** bobh_ has joined #openstack-infra03:44
*** zhurong has quit IRC03:53
*** ykarel__ has joined #openstack-infra03:54
*** ykarel_ has quit IRC03:56
*** janki has joined #openstack-infra03:57
*** hemna_ has quit IRC03:57
*** larainema has joined #openstack-infra03:58
*** ykarel__ is now known as ykarel03:59
*** bobh_ has quit IRC04:01
*** e0ne has joined #openstack-infra04:11
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: enable inventory to be updated with zuul_return  https://review.openstack.org/59009204:12
ianwxe1gyq_: i'd imagine it will require a conf.py04:14
ianwjlv-sick: hrrm, all in the applytests?04:16
*** jamesmcarthur has joined #openstack-infra04:22
*** e0ne has quit IRC04:24
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Revert "Remove unneeded required projects"  https://review.openstack.org/59005404:25
*** jamesmcarthur has quit IRC04:26
xe1gyq_ianw: here you go https://review.openstack.org/#/c/590094/04:32
*** Bhujay has joined #openstack-infra04:32
*** Bhujay has quit IRC04:34
*** markvoelker has joined #openstack-infra04:41
*** apetrich has joined #openstack-infra04:42
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] openafs client install  https://review.openstack.org/58933504:43
*** jesusaur has quit IRC04:46
*** jesusaur has joined #openstack-infra04:48
*** xarses_ has joined #openstack-infra04:48
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] openafs client install  https://review.openstack.org/58933505:01
*** udesale has joined #openstack-infra05:06
*** nicolasbock has joined #openstack-infra05:34
*** eumel8 has joined #openstack-infra05:36
*** hwoarang has joined #openstack-infra05:41
openstackgerritWei Tie proposed openstack-dev/pbr master: Support subdirectory in the url  https://review.openstack.org/59006605:43
*** AJaeger has quit IRC06:16
*** quiquell has joined #openstack-infra06:19
*** AJaeger has joined #openstack-infra06:19
*** Emine has joined #openstack-infra06:28
*** hamzy_ has quit IRC06:29
*** hamzy_ has joined #openstack-infra06:29
*** gbutnaru_ has quit IRC06:32
*** nicolasbock has quit IRC06:35
*** pcaruana has joined #openstack-infra06:38
*** nicolasbock has joined #openstack-infra06:41
*** gbutnaru_ has joined #openstack-infra06:45
*** udesale has quit IRC06:54
*** evrardjp has joined #openstack-infra06:54
*** ccamacho has joined #openstack-infra06:58
*** udesale has joined #openstack-infra06:58
*** stakeda has joined #openstack-infra07:06
*** yamamoto has joined #openstack-infra07:11
*** ginopc has joined #openstack-infra07:11
*** Bhujay has joined #openstack-infra07:16
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Revert "Revert "Remove unneeded required projects""  https://review.openstack.org/59014207:16
*** rcernin has quit IRC07:16
*** amoralej|off is now known as amoralej07:19
*** holser_ has joined #openstack-infra07:20
holser_Good morning07:20
holser_Can anyone help me with 587982 ... it's stuck on gating ... at least according to http://zuul.openstack.org07:21
holser_Thanks07:21
*** Bhujay has quit IRC07:22
*** dpawlik has joined #openstack-infra07:22
*** yamamoto has quit IRC07:22
dirkhere: could you please review https://review.openstack.org/#/c/589007 - it is blocking py36 jobs on global requirements repo07:22
AJaegerholser_: we merge in order - and that one is in a queue, so 588619 needs to merge first etc.07:22
AJaegerdirk: this is not slack ;)07:23
holser_Thanks AJaeger07:23
AJaegerdirk: better ask infra-root directly for a system-config change like yours07:23
holser_I'll keep my fingers crossed07:23
*** xarses_ has quit IRC07:23
*** dpawlik has quit IRC07:24
*** dpawlik has joined #openstack-infra07:24
AJaegereumel8, corvus , tristanC lots of new translation imports, see https://review.openstack.org/#/q/status:open+topic:zanata/translations,n,z - thanks!07:24
*** ykarel has quit IRC07:36
*** ykarel has joined #openstack-infra07:39
dirkAJaeger: It seems at least you have a slack-plugin installed ;)07:39
AJaeger;)07:40
*** Bhujay has joined #openstack-infra07:40
*** xarses_ has joined #openstack-infra07:42
eumel8AJaeger, corvus , tristanC:  yes, thanks also from my side. Now we are back in service just in time R307:42
tristanCexcellent, glad we fixed this :-)07:43
*** jpena|off is now known as jpena07:50
openstackgerritMerged openstack-infra/puppet-statusbot master: Have the 'statusbot' service subscribe to the pip install  https://review.openstack.org/54713207:51
*** tosky has joined #openstack-infra07:52
*** udesale has quit IRC07:53
*** xarses_ has quit IRC07:58
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Added Cyborg Team Meeting  https://review.openstack.org/58997108:05
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Support job pause  https://review.openstack.org/58538908:07
toskycan anyone please fix the channel topic on #openstack-interop? It seems to be stuck on "(Meeting topic: maintenance)" for 10 days08:11
*** lucasagomes has joined #openstack-infra08:12
AJaegertosky: what should the topic be?08:17
*** jpich has joined #openstack-infra08:19
toskyAJaeger: uh, good question, let me dig the previous topics08:19
AJaegerthanks, tosky - couldn't find it quickly myself ;(08:19
*** dulek has joined #openstack-infra08:20
*** udesale has joined #openstack-infra08:24
toskyAJaeger: I suspect I will have to wait for the cores to show up08:24
*** dtantsur|afk is now known as dtantsur08:33
fricklertosky: AJaeger: I've set the topic to the latest I found in the logs on eavesdrop, let me know if you need a different one08:34
*** janki has quit IRC08:36
toskyfrickler: wow, you went back a lot08:37
toskyor I missed it (I checked June and July)08:38
toskythanks, I will ask08:38
fricklertosky: yeah, that was from march. didn't matter much for "wget -r", though ;)08:40
toskyah, direct access to the logs :P08:41
cgoncalvescould someone please review https://review.openstack.org/#/c/588676/? it is required in order to verify SSL certificates when e.g. fetching RPM repo metadata, otherwise jobs fail08:44
cgoncalveswe detected this in octavia when changed the nodeset to centos7. job would fail when fetching metadata from EPEL repo08:44
*** priteau has quit IRC08:47
*** priteau has joined #openstack-infra08:47
quiquellzuul question, can we have a Depends-On in the same project if we are not reparenting ?08:50
openstackgerritMerged openstack-infra/system-config master: Remove references to stackalytics.o.o  https://review.openstack.org/58520808:50
AJaegerfrickler: thanks!08:54
quiquelljrist: Are you there ? have a tht question08:56
toskyquiquell: it should work (Depends-On on the same project)08:56
quiquelltosky: Cool thanks,08:57
quiquellUps wrong channel with the tht quesiton08:57
*** pbourke has quit IRC09:08
*** ykarel is now known as ykarel|lunch09:11
*** electrofelix has joined #openstack-infra09:11
*** janki has joined #openstack-infra09:15
*** pbourke has joined #openstack-infra09:16
*** dingyichen has quit IRC09:16
*** ykarel|lunch is now known as ykarel|mtg09:30
*** derekh has joined #openstack-infra09:35
*** dpawlik has quit IRC09:39
*** dpawlik has joined #openstack-infra09:41
*** gfidente has joined #openstack-infra09:42
*** ykarel_ has joined #openstack-infra09:42
*** ykarel|mtg has quit IRC09:44
*** dpawlik has quit IRC09:45
*** rakhmerov has joined #openstack-infra09:48
*** dpawlik has joined #openstack-infra09:49
*** neiljerram has joined #openstack-infra09:55
*** Emine has quit IRC10:04
*** Emine has joined #openstack-infra10:04
*** ykarel_ has quit IRC10:06
openstackgerritMerged openstack-infra/irc-meetings master: Added Cyborg Team Meeting  https://review.openstack.org/58997110:09
openstackgerritMerged openstack/diskimage-builder master: Install ca-certificate with redhat-common  https://review.openstack.org/58867610:11
*** ykarel has joined #openstack-infra10:14
*** claudiub has joined #openstack-infra10:18
*** stakeda has quit IRC10:26
openstackgerritMarkus Hosch proposed openstack-infra/nodepool master: Add list of metrics provided to statsd  https://review.openstack.org/59023310:31
*** dhill_ has quit IRC10:51
openstackgerritSlawek Kaplonski proposed openstack-infra/project-config master: Clean Neutron failure rates Grafana dashboard  https://review.openstack.org/59023910:53
*** ansmith has quit IRC10:56
*** amoralej is now known as amoralej|lunch11:01
*** jpena is now known as jpena|lunch11:01
*** holser_ has quit IRC11:06
*** snapiri has quit IRC11:25
*** snapiri has joined #openstack-infra11:25
*** sambetts|afk has quit IRC11:29
*** agopi has quit IRC11:31
*** bobh_ has joined #openstack-infra11:31
*** annp has quit IRC11:42
*** agopi has joined #openstack-infra11:49
*** rh-jelabarre has joined #openstack-infra11:52
*** yamamoto has joined #openstack-infra11:57
*** jpena|lunch is now known as jpena11:58
*** boden has joined #openstack-infra12:01
*** dhill_ has joined #openstack-infra12:06
*** eharney has quit IRC12:17
openstackgerritMichel Peterson proposed openstack-infra/project-config master: [n-odl] Make the Y axis display correctly  https://review.openstack.org/59027512:19
*** trown|outtypewww is now known as trown12:22
*** jamesmcarthur has joined #openstack-infra12:23
openstackgerritSlawek Kaplonski proposed openstack-infra/project-config master: Clean Neutron failure rates Grafana dashboard  https://review.openstack.org/59023912:25
*** jamesmcarthur has quit IRC12:27
*** lathiat_ has quit IRC12:30
*** lathiat has joined #openstack-infra12:31
*** rosmaita has joined #openstack-infra12:32
openstackgerritMerged openstack-infra/nodepool master: Bump minimum openstacksdk version to 0.17.2  https://review.openstack.org/58956312:35
pabelangerianw: we don't seem to be tracking FIP task in grafana.o.o now for nodepool any more. For example: stats.nodepool.task.packethost-us-west-1.NetworkGetPorts12:37
*** oanson has joined #openstack-infra12:42
*** tpsilva has joined #openstack-infra12:44
*** edmondsw has joined #openstack-infra12:45
*** ansmith has joined #openstack-infra12:47
*** ianychoi has quit IRC12:49
*** kgiusti has joined #openstack-infra12:54
openstackgerritMike Kolesnik proposed openstack-infra/project-config master: Remove Networking-ODL fullstack from grafana  https://review.openstack.org/59030512:56
toskynot sure if it's an infra question but I think you know when: are stable branches creates during RC1? (this week for Rocky)12:56
*** quiquell has quit IRC12:58
*** eharney has joined #openstack-infra12:58
*** ramishra has quit IRC12:59
mordredtosky: I believe stable branches are cut for a project when it cuts its rc113:01
mordredtosky: but I don't actually know13:01
*** amoralej|lunch is now known as amoralej13:02
*** jamesmcarthur has joined #openstack-infra13:02
toskyack, thanks13:02
*** sthussey has joined #openstack-infra13:06
*** ramishra has joined #openstack-infra13:08
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Remove old inactive users  https://review.openstack.org/58855313:08
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Set mgmt_hieradata variable for bridge.openstack.org  https://review.openstack.org/58862713:08
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Use a when clause to make skip work with first_found  https://review.openstack.org/58996313:08
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Add exim role to base playbook  https://review.openstack.org/58996413:08
*** holser_ has joined #openstack-infra13:12
openstackgerritMerged openstack-infra/openstackid master: Fix 400 error on auth code grant  https://review.openstack.org/58999713:23
*** mriedem has joined #openstack-infra13:24
*** jcoufal has joined #openstack-infra13:27
*** jcoufal_ has joined #openstack-infra13:28
*** edmondsw has quit IRC13:29
*** yamamoto has quit IRC13:31
*** jcoufal has quit IRC13:31
*** apetrich has quit IRC13:34
AJaegertosky: ask on #openstack-release13:35
*** gbutnaru_ is now known as gbutnaru13:36
*** edmondsw has joined #openstack-infra13:37
*** jistr is now known as jistr|call13:39
*** edmondsw has quit IRC13:41
*** ccamacho has quit IRC13:44
*** ccamacho has joined #openstack-infra13:44
*** bobh_ has quit IRC13:44
*** eharney has quit IRC13:45
*** ykarel is now known as ykarel|away13:46
openstackgerritMonty Taylor proposed openstack-infra/puppet-openstack_infra_spec_helper master: Run ansible base playbook for puppet tests  https://review.openstack.org/58832613:46
*** ccamacho has quit IRC13:48
*** edmondsw has joined #openstack-infra13:48
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: enable inventory to be updated with zuul_return  https://review.openstack.org/59009213:49
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: add support for generic build resource  https://review.openstack.org/57066813:49
*** eharney has joined #openstack-infra13:49
openstackgerritMerged openstack-infra/project-config master: Adding tobiko to the project list  https://review.openstack.org/58896313:51
*** boden has quit IRC13:52
*** ykarel|away has quit IRC13:53
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider  https://review.openstack.org/57066713:53
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift Pod provider  https://review.openstack.org/59033513:53
*** apetrich has joined #openstack-infra13:54
*** jistr|call is now known as jistr13:59
*** apetrich has quit IRC14:01
*** amotoki_ is now known as amotoki14:01
openstackgerritMonty Taylor proposed openstack-infra/ansible-role-puppet master: Update yaml style to be consistent with infra yaml  https://review.openstack.org/59033814:07
openstackgerritMonty Taylor proposed openstack-infra/puppet-openstack_infra_spec_helper master: Run ansible base playbook for puppet tests  https://review.openstack.org/58832614:19
mordredcmurphy, clarkb: I made https://review.openstack.org/#/c/588553/ depends-on https://review.openstack.org/#/c/588326/ - and am looking at the runs in the system-config patch to make sure it's running ansible correctly14:20
cmurphyyay testing14:20
mordredikr?14:20
*** ccamacho has joined #openstack-infra14:25
*** ccamacho has quit IRC14:25
*** ccamacho has joined #openstack-infra14:26
*** hongbin has joined #openstack-infra14:41
*** rpioso|afk is now known as rpioso14:42
*** dtantsur is now known as dtantsur|brb14:43
fungiwow, looking through the etherpad-lite develop branch, they've seriously doubled down on improving their testing recently14:44
pabelangerAJaeger: mind a +3 on https://review.openstack.org/588388/ to remove old fedora-27 job. needed for removal of fedora-27 DIB in nodepool14:44
AJaegerpabelanger: done14:46
*** ginopc has quit IRC14:47
fungiinfra-root: i've restarted the etherpad-lite service on etherpad-dev.o.o, currently at commit 10f0cb3 (head of the develop branch). this includes 58c3154 which should fix the bullet list authorship attribution issue, but testing is warranted. if they don't tag a release in the next couple weeks, i propose we upgrade etherpad.o.o to this commit a week before the ptg14:50
*** ginopc has joined #openstack-infra14:51
*** priteau has quit IRC14:52
pabelangerAJaeger: thanks14:53
fungihttps://etherpad-dev.openstack.org/p/things in case anybody wants to help test the bullet list authorship problem is solved14:53
openstackgerritMerged openstack-infra/project-config master: Remove legacy-tempest-dsvm-neutron-full-fedora-27 job  https://review.openstack.org/58838814:55
*** ginopc has quit IRC14:58
*** ginopc has joined #openstack-infra14:58
pabelangerclarkb: corvus: catching up after a few days of leave, is there a check list of things to do before migrating logs to swift for zuul.o.o?15:01
mordredpabelanger: we need to remember to run around in a circle waving our arms in the air and screaming15:02
pabelanger:)15:02
*** Swami has joined #openstack-infra15:03
*** janki has quit IRC15:03
openstackgerritMonty Taylor proposed openstack-infra/puppet-openstack_infra_spec_helper master: Run ansible base playbook for puppet tests  https://review.openstack.org/58832615:03
openstackgerritFrank Kloeker proposed openstack-infra/project-config master: Setup missing translation jobs for neutron-lbaas-dashboard  https://review.openstack.org/59036415:04
pabelangerconfig-core: could I get a +3 on https://review.openstack.org/581117/ moving forward with using fedora-latest over fedora-2715:10
*** hwoarang has quit IRC15:12
mordredpabelanger: done15:14
clarkbmordred: pabelanger I think its mostly just getting the last little details like icons working and restarting all the logstash workers15:17
clarkbthen the arm flailing happens after we switch :)15:18
mordredso much arms. all the flailing15:18
*** ginux has joined #openstack-infra15:20
mordredclarkb: fwiw, my next step on bridge is to test running remote puppet from there to something - probably review-dev ...15:20
pabelangerokay cool, I'm happy to volunteer for the effort. Some discussion now of also trying the new swift upload of logs in rdoproject, after it's been done upstream here15:20
clarkbmordred: that is a good candidate, non trivial puppet but also dev server :)15:20
mordredbut I'm iterating on getting the integration testing in the gate to grok the base playbook first15:20
*** ginux is now known as Guest845815:20
*** ginopc has quit IRC15:20
*** Guest8458 is now known as ginopc15:20
mordredI*think* that's almost working - so once it is I'll bang on that a bit more15:21
*** Bhujay has quit IRC15:21
mordredpabelanger: sweet!15:21
openstackgerritWitold Bedyk proposed openstack-infra/project-config master: Remove openstack-python35-jobs for monasca-api  https://review.openstack.org/59038715:22
*** jcoufal_ has quit IRC15:24
fungihttps://78.media.tumblr.com/55e743a6c14ecf989ac7a8f744e58582/tumblr_n3kfmpZxcG1srkiv2o1_400.gif15:26
fungi(kermit arms)15:26
openstackgerritMerged openstack-infra/project-config master: Gate zuul-job on fedora-latest  https://review.openstack.org/58111715:27
mordredfungi: that was dangerously close to you adopting the millenial approach of communicating via gifs and emjoi15:29
mordredfungi: you didn't secret go get a snapchat account did you?15:29
*** dtantsur|brb is now known as dtantsur15:29
*** ccamacho has quit IRC15:29
*** jcoufal has joined #openstack-infra15:30
clarkbI dunno I'm catching up on email and fungi is replying to people inline using text. Not sure the snapchat bug has quite gotten to fungi yet15:32
AJaegerclarkb, pabelanger, could you look together at https://review.openstack.org/563790 and https://review.openstack.org/586639 - and decide which one to use? Those are in conflict and are different approaches.15:33
mordredok. cool. I didn't want to have to completley reassess my view of reality15:33
*** ginopc has quit IRC15:33
fungiyeah, i also still don't top-post, do people top-post on snapchat?15:36
corvuspabelanger: re swift logs -- we need to verify that the new log processor is working, finish the icon support, and update the playbook to run the htmlify role.15:36
clarkbAJaeger: pabelanger had updated one of my related changes to make the reordering there as well. I think we can probably abandon his change above as long as we get the log inventory stack in?15:36
clarkbAJaeger: pabelanger https://review.openstack.org/#/c/563789/ is the change, looks like it may need a rebase though?15:36
mordredfungi: I think the answer is "bouncing emoji face"15:37
fungiahh15:37
*** priteau has joined #openstack-infra15:37
mordredfungi: but I might be wrong, and it might be "poop emoji" - I really don't know15:37
*** ginopc has joined #openstack-infra15:38
fungii thought that one was just a common glyph at a particular unicode codepoint15:39
*** dklyle has joined #openstack-infra15:39
mordredfungi: as are we all15:42
AJaegerpabelanger: want to update (see clarkb's comment above)? Could you together propose the way forward, please?15:44
*** psachin has quit IRC15:44
openstackgerritWei Tie proposed openstack-dev/pbr master: Support subdirectory in the url  https://review.openstack.org/59006615:45
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Use log-inventory in base jobs  https://review.openstack.org/56378915:47
pabelangerAJaeger: done15:47
AJaegerpabelanger: so, we can merge 563789 now? Good, will +2A then...15:50
pabelangerAJaeger: actually, let me find a job log first and link it15:51
pabelangerjust to confirm it is working15:51
AJaegerpabelanger: ok, will +2 - and let you +A15:51
AJaegerpabelanger: so, do we still need https://review.openstack.org/#/c/586639/1/roles/validate-host/tasks/main.yaml ? https://review.openstack.org/#/c/563790/1/roles/validate-host/tasks/main.yaml removes that line15:52
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: DMN - testing base-test  https://review.openstack.org/59040715:53
pabelangerAJaeger: nope, I'll drop15:54
pabelangerAJaeger: clarkb: https://review.openstack.org/588387/ removed fedora-27 job that is no longer used15:55
* dtantsur watches more and more people leaving their passwords in #openstack-unregistered.. :(15:55
*** roman_g has joined #openstack-infra15:57
corvushrm.  we could make it so that the channel is muted and only ops see messages15:58
*** SumitNaiksatam has quit IRC15:59
Shrewscorvus: i was about to suggest that15:59
*** dklyle has quit IRC15:59
corvuswe could also have a bot autorespond when people join15:59
*** ykarel|away has joined #openstack-infra16:00
corvusalso "quiet unregistered users" "+q $~a" would be an option16:01
*** dklyle has joined #openstack-infra16:01
*** jpena is now known as jpena|off16:07
*** jpich has quit IRC16:08
*** Bhujay has joined #openstack-infra16:08
*** ginopc has quit IRC16:09
*** holser_ has quit IRC16:12
*** derekh has quit IRC16:14
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Delete legacy-tempest-dsvm-neutron-full-fedora-27  https://review.openstack.org/58838716:15
openstackgerritMarkus Hosch proposed openstack-infra/nodepool master: Add metric for image build result  https://review.openstack.org/59041216:16
openstackgerritJill Rouleau proposed openstack-infra/project-config master: Add release jobs to ansible-role-tripleo-*  https://review.openstack.org/59004516:24
clarkbcorvus: Shrews any idea if the spam attack persists?16:26
corvusclarkb: not offhand.  i'd be supportive of turning off +r here to find out16:29
clarkbcorvus: wfm16:29
mordredcorvus, clarkb: I just added +R on myself on Sunday16:29
mordredbecause the spam attack had spread to private messages16:29
mordredbut I am supportive of turning off +r to test it just to see16:30
corvuswell, that's not promising.  maybe we should try later.16:30
clarkbhttps://freenode.net/news/spam-shake is most recent update from freenode16:31
Shrewstopic in #freenode seems to suggest it is still ongoing16:31
clarkbxe1gyq_: It is python sphinx documentation. You'll need whatever it is that sphinx needs to run16:35
clarkbxe1gyq_: we don't really control any of that (and it could change over time if sphinx makes changes)16:35
*** hongbin has quit IRC16:37
*** Swami has quit IRC16:37
*** tosky has quit IRC16:39
*** ykarel|away has quit IRC16:40
*** armax has joined #openstack-infra16:47
pabelangerclarkb: AJaeger: I've +3 https://review.openstack.org/563789 after confirming log-inventory worked as expected16:48
*** ifat_afek has joined #openstack-infra16:50
*** boden has joined #openstack-infra16:50
clarkbwe appear to have leaked ports in packethost fwiw16:51
pabelangerah, was trying to figure out why it was deleting all the nodes16:51
clarkbI am working to clean them out. In the past they have been the byproduct of other errors I think16:51
mordredxe1gyq_, clarkb: well - we do have a slightly stricter approach than sphinx broadly16:51
clarkbso will keep looking around to see if other errors are apparent16:52
clarkb(maybe leaked fips too?16:52
mordredxe1gyq_, clarkb: we require the doc directory to be called "doc" to have a "source" directory under that, for conf.py to be in doc/source - and we don't use any of the Makefiles that sphinx-quickstart generates16:53
openstackgerritMatt Riedemann proposed openstack-infra/irc-meetings master: Update the nova team meeting chair to melwitt  https://review.openstack.org/59042716:53
mriedemmelwitt: ^16:53
clarkbmordred: ah right, we need sphinx source content in doc/source but if sphinx wanted to call it sphinx_conf.py we wouldn't dictate that, they do right?16:53
clarkb(its been a stable api, I don't expect it to change, but if you want to know what goes in a conf.py sphinx is your source for that info)16:54
*** agopi has quit IRC16:54
mordredclarkb: that's right16:54
mordredclarkb: I would imagine if sphinx changed conf.py to something else a giant portion of the world would immediately break :)16:55
openstackgerritMerged openstack-infra/project-config master: Use log-inventory in base jobs  https://review.openstack.org/56378916:55
*** amoralej is now known as amoralej|off16:58
clarkbdeleting ports is slow17:00
clarkbI could probably parallelize it actually, but meh17:00
xe1gyq_ian: Thanks for your help!17:00
openstackgerritMarkus Hosch proposed openstack-infra/nodepool master: Add metric for image build result  https://review.openstack.org/59041217:02
*** ramishra has quit IRC17:03
clarkbwe don't appear to have leaked floating ips17:03
xe1gyq_clarkb: thanks! I have made the appropiate changes into the conf.py based in feedback, it seems I got confused looking around where conf.py is located17:03
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP Map file comment line numbers  https://review.openstack.org/59042917:03
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs  https://review.openstack.org/58837817:04
xe1gyq_mordred: thanks! I have removed the Makefile as part of the feedback obtained17:04
*** AhmadMahmoudi has joined #openstack-infra17:05
clarkbI think packethost has broken in such a way that we have servers in an error state due to their ports not existing or being found17:06
clarkbissuing server delete against these servers directly doesn't seem to help17:07
clarkbI don't think I've ever seen this failure mode before17:07
clarkbmordred: ^ ring a bell for you?17:07
openstackgerritAdam Spiers proposed openstack-dev/specs-cookiecutter master: make tox docs environment follow PTI guidelines for sphinx build  https://review.openstack.org/59043617:10
clarkbits like the inverse of a port leak, we lost the ports :/17:12
*** AhmadMahmoudi has quit IRC17:14
*** AhmadMahmoudi has joined #openstack-infra17:14
mnaserit should still be able to delete them17:16
*** jamesmcarthur has quit IRC17:16
mnaserbecause afaik it would be a noop if the ports dont exist17:16
pabelangerclarkb: corvus: I can't seem to figure out why https://review.openstack.org/588378/ hasn't been enqueued into zuul.o.o, wondering if maybe a side affect of http API now?17:16
clarkbmnaser: Unable to establish connection to http://localhost:8158/neutron/v2.0/ports.json?device_id=d31fef3b-5b91-4007-9f77-ff6c55d609b1: HTTPConnectionPool(host='localhost', port=8158): Max retries exceeded with url: /neutron/v2.0/ports.json?device_id=d31fef3b-5b9", u'code': 50017:16
pabelangerchecking zuul debug logs now17:16
clarkbmnaser: that is the error in the server record returned by server show17:17
clarkbmriedem: ^ you may know if that is expected or not17:17
mnaserclarkb: the compute node is misconfigured17:17
mnaseror maybe platform9 does something weird17:17
*** xarses_ has joined #openstack-infra17:17
mnaserwait, it's returning 50017:17
mnaserso it's responding but with a 500.. on localhost.. on the compute node.. are you seeing that error in the 'fault' or 'error' section in the api?17:17
clarkbmnaser: ya17:17
* mnaser has no idea what type of shenanigans they do...17:18
clarkbmnaser: fault17:18
mnaseris neutron api responding publicly?17:18
clarkbmnaser: ya we can boot other nodes and show ports that do seem to exist17:18
mnaserclarkb: localized to a single compute node?17:18
clarkbmnaser: that I don't know17:18
mnaserhostId in the API will give you the answer17:18
clarkbok17:18
clarkbpabelanger: only reporting back to gerrit is over https17:19
openstackgerritMatthieu Huin proposed openstack-infra/nodepool master: Do not abort node launch if failed node cannot be deleted  https://review.openstack.org/58985417:19
clarkbpabelanger: depends on loop maybe?17:19
pabelangerclarkb: know more in a minute, looking at logs17:20
mriedemclarkb: if that's server show,17:21
mriedemit's from the api trying to get the port from neutron so we can get the related security groups for the port17:21
mriedem"Max retries exceeded with url" is likely from ksa?17:21
mriedembut my guess is neutron is overloaded?17:22
mriedemserver show wouldn't hit the compute node at all17:22
clarkbmriedem: would you expect that to prevent the delete from going through? or is there likely omething else going on with the failed deletes?17:22
pabelangerclarkb: corvus: looks like http 400 error from gerrit: http://paste.openstack.org/show/727754/17:22
mriedemdidn't read far enough back about failed deletes,17:23
mriedembut server delete will try to delete/unbind ports yeah17:23
*** udesale has quit IRC17:23
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP Map file comment line numbers (alternate)  https://review.openstack.org/59044217:24
mriedemsomeone did recently add a retry on the network teardown during server delete in the compute https://github.com/openstack/nova/commit/c6dda9f8064e0fcdf7ac85d08ed68554083be74b17:24
clarkbmriedem: and if that fails the delete will fail?17:25
mriedembut that's not released or on stable17:25
mriedemclarkb: yeah17:25
clarkbmnaser: initial sampling says different compute hosts17:25
corvuspabelanger: look for 2 more attempts17:25
mriedemwe'll have killed the guest on the host by that point17:26
mnasermriedem: but the delete of port happens on the compute node, right?17:26
mriedembut we'll raise before getting here https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L262917:26
mriedemto delete the instance from the nova db17:26
clarkbmriedem: ok, I don't think those ports exist anymore fwiw, so when trying to get them via device_id (the nova instance id) it fails, but I've not absolutely confirmed that yet17:26
corvuspabelanger: oh!  they're both going to fail, that's not a transient error17:26
mriedemmnaser: when deleting the server, if the compute is up, yes17:26
pabelangercorvus: yah, next 2 also fail17:26
openstackgerritMatthew Edmonds proposed openstack-infra/project-config master: Add readthedocs web hooks for powervm  https://review.openstack.org/59044417:26
*** studarus has joined #openstack-infra17:26
mnasercause the compute is up and yet it's erroring failing to contact *localhost*17:26
mriedemclarkb: we should get a 404 from neutron then, not a 50017:26
mnaserand contacting localhost and getting a 500 from it17:26
mriedemthen the compute is misconfigured17:26
mnaserwhich is super weird17:26
pabelangercorvus: checking docs to see what is bad with the request17:27
mnaseri was just wondering *how* there is something listening at localhost on that port lol17:27
corvuspabelanger: "file .zuul.yaml not found in revision 588378,6"17:27
mnaseron compute node17:27
mriedemalso, when nova-compute tears down the ports, if they are already gone, we won't see them17:27
mriedemhttps://github.com/openstack/nova/blob/master/nova/network/neutronv2/api.py#L150117:27
mriedemand if we're racing, we'll ignore 404 https://github.com/openstack/nova/blob/master/nova/network/neutronv2/api.py#L148717:28
pabelangercorvus: that is true, we don't have a .zuul.yaml file. only zuul.d/ files17:28
mriedemi mean, you look up robust and you'll see nova in the dictionary amiright guys?!?!?!!?17:28
corvuspabelanger: i see the problem17:28
clarkbmriedem: mnaser: and hte confusion about localhost is that the compute process not api server or conductor etc is what calls out to neutron?17:28
mriedemclarkb: if that is what is actually deleting the port yes,17:29
mriedembut you were saying server show above so i was confused17:29
mnaseri think he meant that after deleting the server, 'fault' was set to an exception with the 500 hitting neutron17:29
clarkbmriedem: that is where I got the fault output17:29
mriedemit is possible for nova-api to delete the ports if the compute service, on which the server is running, is down17:29
mriedemclarkb: ah ok17:29
clarkbmriedem: server delete returns no error but doesn't succeed17:29
mnaserso nova-api is responding fine, its the 'fault' field that contains the exception17:29
mriedemthen the server delete rpc cast to compute17:29
clarkbmnaser: yup17:29
mriedemand compute failed17:29
mnasernova service-list should confirm if compute is up or down17:30
studarusclarkb: not urgent but I've been seeing a higher than usual delete count and wanted to know if I should investgate17:30
pabelangercorvus: ack17:30
pabelangerthanks17:30
clarkbstudarus: ya I think it is a side effect of what we are discussing with mnaser and mriedem, we have a bunch of nodes in an error state that nodepool will try to frequently delete17:30
studarusgotcha17:30
clarkbstudarus: it seems to be at least partially related to 500 errors when looking up ports17:31
studarusSo it is provider agnostic?17:31
clarkbstudarus: no this is packethost specific17:31
studarusthen I should investigate!17:32
clarkbstudarus: if I server show one of the packethost ERROR instances I get fault neutron returned 500 error on port lookup essentially17:32
clarkband deletes fail to actually delete17:32
clarkbstudarus: ok let me know if I can help provide more info17:33
*** gouthamr is now known as gouthamr_away17:37
pabelangerclarkb: when free, trying to figure out why we didn't re-run check jobs at: https://review.openstack.org/588415/ but went straight into gate with a recheck17:38
clarkbpabelanger: because it was already +1 Verified17:38
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Scope config line comments to change  https://review.openstack.org/59044617:38
pabelangerah right17:39
corvuspabelanger: ^ that should fix it17:39
corvusi'm thinking about a test17:39
*** Bhujay has quit IRC17:39
pabelangercorvus: great17:45
clarkbcorvus: pabelanger so it was getting queued just not able to report back when jobs completed? I guess the error on ps6 was a clue to that since ps7 only updated commit msg17:46
corvusyep17:46
openstackgerritPaul Belanger proposed openstack-infra/bindep master: Remove fedora-27 fallback job  https://review.openstack.org/59045017:47
*** gyee has joined #openstack-infra17:47
*** mudpuppy has joined #openstack-infra17:48
*** psachin has joined #openstack-infra17:51
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Scope config line comments to change  https://review.openstack.org/59044617:52
*** felipemonteiro has joined #openstack-infra17:52
corvusclarkb, pabelanger: ^ fix with tests17:52
clarkbstudarus: noticing that floating IP networking might also be unhappy (similar to when you decided to make a dedicated network node). Perhaps those two things are related17:52
openstackgerritAdam Spiers proposed openstack-dev/specs-cookiecutter master: make tox docs environment follow PTI guidelines for sphinx build  https://review.openstack.org/59043617:57
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Scope config line comments to change  https://review.openstack.org/59044617:59
corvusclarkb, pabelanger: ^ sorry, pep8 error.  should be gtg now17:59
*** SumitNaiksatam has joined #openstack-infra18:00
*** gfidente has quit IRC18:05
*** ifat_afek has quit IRC18:07
*** agopi has joined #openstack-infra18:14
fungiclarkb: i see you're discussing packethost issues in here. studarus e-mailed you and me asking about the high delete count there18:15
fungiahh, he found you in here too18:15
*** priteau has quit IRC18:15
* fungi is still catching up on scrollback after writing a particularly lengthy e-mail18:16
studarusI finallly defeated the IRC registration guardians...18:16
funginone shall pass!18:16
openstackgerritColleen Murphy proposed openstack-infra/puppet-cgit master: Filter out link-local ipv6 address in loadbalancer  https://review.openstack.org/57626218:21
openstackgerritMerged openstack-infra/project-config master: Remove fedora-27 jobs  https://review.openstack.org/58838618:21
*** panda|ruck is now known as panda|ruck|off18:22
*** dtantsur is now known as dtantsur|afk18:24
*** trown is now known as trown|lunch18:26
*** felipemonteiro has quit IRC18:30
*** electrofelix has quit IRC18:31
*** apetrich has joined #openstack-infra18:33
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Remove old inactive users  https://review.openstack.org/58855318:36
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Set mgmt_hieradata variable for bridge.openstack.org  https://review.openstack.org/58862718:36
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Use a when clause to make skip work with first_found  https://review.openstack.org/58996318:36
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Add exim role to base playbook  https://review.openstack.org/58996418:36
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Split base playbook into two plays  https://review.openstack.org/59047818:36
studarusOne nova host is flakey. Spinning up a replacement.18:37
studarusNova services are reported down.18:38
clarkbstudarus: is that what was preventing the deletes from happening?18:38
mordredcmurphy: darn all these pesky tests showing issues in what seemed fine!18:39
mordredcmurphy: we should delete the tests, it would make it easier for me to land these patches ;)18:39
studarusWell, it is a smoking gun but I can't say for certain.18:39
dhellmannclarkb : I would like to add a topic to the infra agenda for the ptg. Is there an etherpad for that, yet? I don't see one on https://wiki.openstack.org/wiki/PTG/Stein/Etherpads18:39
*** jamesmcarthur has joined #openstack-infra18:39
clarkbdhellmann: https://etherpad.openstack.org/p/infra-ptg-denver-2018 I will add it to the wiki now18:40
dhellmannclarkb : thanks18:40
cmurphymordred: we could land code so much faster!18:43
mordredclarkb, corvus: https://review.openstack.org/#/c/588553 I updated it to add a comment about the uids - does that seem decent?18:44
clarkbmordred: that wfm18:45
zxiiroIs openstack meetbot maintained? we have a request to have it generate a symlink for the latest copy of the meeting minutes but seems like the project is maybe not really  active so I dunno if it would be worth opening a feature request for it?18:50
*** owalsh has quit IRC18:50
zxiiromaybe I'll open one anyway just to have it logged.18:50
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Fixed bug on track serialization  https://review.openstack.org/59048518:51
*** owalsh has joined #openstack-infra18:51
fungizxiiro: we'd like to reimplement it in a more modern bot framework, so the incentive to keep dumping features in there has been lukewarm at best18:52
fungiwhat's there is already forked from debian and then ubuntu i think, and not super maintainable18:53
openstackgerritMerged openstack-infra/openstackid-resources master: Fixed bug on track serialization  https://review.openstack.org/59048518:53
zxiirofungi: I would be interested in participating in such a bot framework if it was started. keep me posted. In the meantime I'll open a storyboard to remind me of this feature request.18:53
fungizxiiro: https://specs.openstack.org/openstack-infra/infra-specs/specs/irc.html is currently a "help wanted" category spec18:55
zxiirofungi: awesome, i starred that story, thanks!18:56
fungizxiiro: up side to that plan is that we can still basically use the current meetbot plugin directly, so maybe not incompatible with what you're asking to do18:57
zxiiroI'd totally jump on this if I had free time to lead it. I used to love making IRC bots.18:57
fungi(or maybe the plugin only needs a little work to make it compatible with limnoria)18:57
corvuszxiiro, fungi, jlv-sick: i plan to pick up the limnoria work once we fix up our deployment tooling, then we can move forward on that.  hopefully quickly and in parallel.19:01
corvus(i started, but our current deployment tooling is wedged in a complicated way and we can't actually install limnoria right now)19:01
* mordred hopes to have that fixed soon19:04
openstackgerritColleen Murphy proposed openstack-infra/puppet-ethercalc master: Update ethercalc to work with Ubuntu Xenial  https://review.openstack.org/52714419:08
openstackgerritColleen Murphy proposed openstack-infra/puppet-ethercalc master: Add basic rspec test  https://review.openstack.org/52782219:08
openstackgerritColleen Murphy proposed openstack-infra/puppet-ethercalc master: Turn off binary symlink in nodejs module  https://review.openstack.org/58529119:08
openstackgerritColleen Murphy proposed openstack-infra/puppet-ethercalc master: Add workaround for ethercalc bug  https://review.openstack.org/58529219:08
openstackgerritColleen Murphy proposed openstack-infra/puppet-ethercalc master: Add idempotency test  https://review.openstack.org/58529319:08
openstackgerritColleen Murphy proposed openstack-infra/puppet-ethercalc master: Add test for ethercalc::apache  https://review.openstack.org/58529419:08
openstackgerritColleen Murphy proposed openstack-infra/puppet-ethercalc master: Use versioncmp function  https://review.openstack.org/59048919:08
cmurphyoops19:08
*** mriedem has quit IRC19:11
*** mriedem has joined #openstack-infra19:11
*** apetrich has quit IRC19:18
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for paste.o.o  https://review.openstack.org/59049219:21
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for planet.o.o  https://review.openstack.org/59049319:21
prometheanfireif I just got added to core on a project, does anyone know how to get gertty to resync to allow me to bote +2+W and the like?19:24
prometheanfireone of the reviews I can vote on, the others I can't19:25
*** SumitNaiksatam has left #openstack-infra19:25
*** jcoufal_ has joined #openstack-infra19:26
*** pcaruana has quit IRC19:33
openstackgerritMerged openstack-infra/zuul master: Scope config line comments to change  https://review.openstack.org/59044619:37
fungiprometheanfire: ctrl+r19:38
prometheanfiretried that :P19:38
fungiare you subscribed to the project that change is targeting?19:38
fungior alternatively, did you ctrl+r while viewing the change in question?19:39
prometheanfirectrl+r for each one works, but not project wide19:39
prometheanfireguess that works (not many reviews)19:39
prometheanfirehave to do it from within the change19:39
fungibasically, gertty will resync all changes owned by you and all changes in projects to which you subscribe, as well as any change you happen to have up viewing at the time you hit it19:40
fungiit will not automatically resync any other changes it simply happens to know about19:40
*** jcoufal_ has quit IRC19:41
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn the future parser on for etherpad-dev  https://review.openstack.org/59002619:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for etherpad.o.o  https://review.openstack.org/59002919:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for ethercalc.o.o  https://review.openstack.org/59003019:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for eavesdrop.o.o  https://review.openstack.org/59004819:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for paste.o.o  https://review.openstack.org/59049219:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for planet.o.o  https://review.openstack.org/59049319:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for logstash-worker01  https://review.openstack.org/59049919:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Turn on the future parser for all logstash workers  https://review.openstack.org/59050019:42
*** trown|lunch is now known as trown19:43
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Split base playbook into two plays  https://review.openstack.org/59047819:43
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs  https://review.openstack.org/58837819:46
prometheanfirewin 3319:47
*** xe1gyq_ has quit IRC19:54
fungiso much win19:54
*** jcoufal_ has joined #openstack-infra19:54
*** jcoufal_ has quit IRC19:55
*** eharney has quit IRC19:57
*** psachin has quit IRC20:02
studarusclarkb: how far back do you keep glance images? 32 images going back to July 4 seem right?20:05
*** apetrich has joined #openstack-infra20:05
fungiwe normally only keep two for each as far as i know (the most recent two which built/uploaded successfully)20:06
fungithe only time i'd expect to see images from july 4 is if image building broke for a month20:07
studarusOk - so that looks fine then20:07
pabelangermaybe image for mirror?20:08
studarusThe instance error is unable to connect to neutron on localhost. Happened across multiple servers.20:08
fungiyeah, we may have manually uploaded a custom image to boot the mirror server from but i wouldn't expect more than one of those (and would be in the other tenant)20:08
studarusI hit neutron localhost across them all and it replied20:09
*** nicolasbock has quit IRC20:11
clarkbstudarus: neutron was returning a 500 error, maybe the neutron logs have more info on why it did that?20:15
*** ansmith has quit IRC20:16
studarusI did a quick grep for error. Let me actually open the log...  :)20:20
*** apetrich has quit IRC20:20
studarusClarkb: too many open files... Failed to read or write20:22
pabelangersounds like ulimit issue20:24
openstackgerritMerged openstack-infra/zuul master: Add winrm certificate handling  https://review.openstack.org/53571720:28
*** owalsh_ has joined #openstack-infra20:29
openstackgerritMerged openstack-infra/zuul master: Support job pause  https://review.openstack.org/58538920:29
studarusyeah, files-max is ready 26M though...20:31
studarusalready20:31
*** owalsh has quit IRC20:31
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Add allowed-triggers and allowed-reporters tenant settings  https://review.openstack.org/55408220:31
openstackgerritLogan V proposed openstack-infra/zuul master: encrypt_secret: Allow file scheme for public key  https://review.openstack.org/58142920:31
*** owalsh has joined #openstack-infra20:34
openstackgerritMerged openstack-infra/zuul-jobs master: Add a yarn role  https://review.openstack.org/58655020:34
*** owalsh_ has quit IRC20:35
*** apetrich has joined #openstack-infra20:35
*** kgiusti has left #openstack-infra20:35
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Add command socket handler for full reconfiguration  https://review.openstack.org/58175420:36
*** owalsh_ has joined #openstack-infra20:39
*** owalsh has quit IRC20:39
corvusi'm going to restart zuul-web.  in the process, i'm going to see if we still have that pidfile problem.  it may be down for a minute or two20:40
corvusyes we do -- so that does need fixing in zuul-web.20:41
openstackgerritMerged openstack-infra/zuul master: Add request reference when hitting a node failure  https://review.openstack.org/58985620:43
corvustristanC: looks like we missed something in the job api: http://paste.openstack.org/show/727768/20:46
*** yamahata_ has joined #openstack-infra20:48
openstackgerritMerged openstack-infra/zuul master: Allow get_mime: False on localhost  https://review.openstack.org/54947520:52
*** ssbarnea has quit IRC20:52
*** gouthamr_away is now known as gouthamr20:53
*** jamesmcarthur has quit IRC20:56
*** jamesmcarthur has joined #openstack-infra21:03
*** trown is now known as trown|outtypewww21:04
*** yamahata_ is now known as yamahata__21:04
*** yamahata__ is now known as yamahata21:05
openstackgerritMerged openstack-infra/zuul master: Use copy instead of symlink for multi-tenant dashboard  https://review.openstack.org/58755421:09
openstackgerritMerged openstack-infra/zuul master: Make GitHub rate limit logging configurable  https://review.openstack.org/58029521:13
*** dosaboy has joined #openstack-infra21:14
*** yamahata has quit IRC21:17
*** jcoufal has quit IRC21:17
*** dave-mccowan has quit IRC21:17
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933421:19
*** gouthamr is now known as gouthamr|brb21:20
*** yamahata has joined #openstack-infra21:20
*** gouthamr|brb is now known as gouthamr21:20
*** gouthamr is now known as gouthamr|brb21:21
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Split base playbook into two plays  https://review.openstack.org/59047821:21
pabelangerclarkb: fungi: ianw: https://review.openstack.org/590450/ is another fedora-27 clean up21:21
mordredcorvus: that doesn't look awesome21:22
openstackgerritMerged openstack-infra/zuul master: Add command socket handler for full reconfiguration  https://review.openstack.org/58175421:22
*** owalsh_ is now known as owalsh21:25
*** slaweq has quit IRC21:26
*** apetrich has quit IRC21:32
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [WIP] kerberos & afs client roles  https://review.openstack.org/58933421:33
*** iyamahat has joined #openstack-infra21:35
*** iyamahat has quit IRC21:36
*** iyamahat has joined #openstack-infra21:37
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: [WIP] openafs client install  https://review.openstack.org/58933521:37
*** iyamahat has left #openstack-infra21:40
*** gouthamr|brb is now known as gouthamr21:40
*** boden has quit IRC21:49
*** jamesmcarthur has quit IRC21:49
*** agopi has quit IRC21:51
*** jamesmcarthur has joined #openstack-infra21:56
clarkbfungi: https://review.openstack.org/590450/ is one that you are probably interested in it given prior concerns about bindep testing22:02
fungithanks!22:02
*** yamamoto has joined #openstack-infra22:04
*** sthussey has quit IRC22:06
fungiaha, yes i think it was this change which prompted my earlier discussion (and surprise at the fact that we had frozen the fallback file rather than continuing to treat it as a functional test on each platform)22:06
fungier, nope22:06
fungiit came up in the context of adding opensuse entries to the fallback list, now that i think about it22:06
fungianyway yeah, i'm resolved that we have good enough coverage without that additional functional testing22:07
*** neiljerram has quit IRC22:08
*** jamesmcarthur has quit IRC22:09
*** rcernin has joined #openstack-infra22:09
*** slaweq has joined #openstack-infra22:11
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Split base playbook into two plays  https://review.openstack.org/59047822:14
*** tobasco is now known as tobias-urdin22:14
*** slaweq has quit IRC22:15
openstackgerritMerged openstack-infra/bindep master: Remove fedora-27 fallback job  https://review.openstack.org/59045022:17
*** yamamoto has quit IRC22:21
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: cache branches in connections/sources  https://review.openstack.org/58997522:21
*** tosky has joined #openstack-infra22:30
*** xe1gyq has joined #openstack-infra22:48
clarkbcmurphy: mordred re changes like https://review.openstack.org/#/c/590030/2 we should coordinate around the bridge cutover as we will have to update the new magical inventory things22:50
*** claudiub has quit IRC22:55
*** evrardjp has quit IRC22:55
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs  https://review.openstack.org/58837822:56
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs  https://review.openstack.org/58837823:01
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Flip fedora-latest integration tests voting  https://review.openstack.org/59057923:05
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Cache branches in connections/sources  https://review.openstack.org/58997523:05
pabelangerdmsimard: do you mind a +3 on https://review.openstack.org/590577/ so we can remove fedora-27 from nodepool (replaced with fedora-latest)23:06
*** gyee has quit IRC23:06
*** tpsilva has quit IRC23:10
*** slaweq has joined #openstack-infra23:11
*** slaweq has quit IRC23:16
*** AhmadMahmoudi has quit IRC23:19
*** rpioso is now known as rpioso|afk23:24
*** efried has quit IRC23:31
*** efried has joined #openstack-infra23:31
openstackgerritMatt McEuen proposed openstack-infra/project-config master: New Airship project - Treasuremap  https://review.openstack.org/59058123:33
ianwis axe throwing a thing?23:35
clarkbianw: ya its byob though23:35
clarkbthey provide the axes23:35
ianwhaha what could possibly go wrong23:35
mordredclarkb: yeah - maybe so?23:38
mordredclarkb: lemme see how far I get tomorrow23:38
*** tosky has quit IRC23:48
*** ssbarnea has joined #openstack-infra23:54
*** slagle has joined #openstack-infra23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!