Tuesday, 2018-08-21

*** gyee has quit IRC00:00
*** longkb has joined #openstack-infra00:05
pabelangerianw: haven't looked at epel in some time, sorry00:06
ianwpabelanger: thanks, on investigation i think it's a case of "didn't test what i thought it tested"00:08
pabelangerack00:09
*** rpioso is now known as rpioso|afk00:13
openstackgerritIan Wienand proposed openstack-infra/system-config master: Update to latest docs PTI  https://review.openstack.org/59348300:17
openstackgerritIan Wienand proposed openstack-infra/system-config master: Generate roles documentation  https://review.openstack.org/59347800:17
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add kerberos-client role  https://review.openstack.org/59348600:17
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add openafs-client role  https://review.openstack.org/59348700:17
ianwsee if that gets past the gate without the utf-8 fix00:17
ianwbonus points if you can see what's interesting about "If set to yes, userdel will remove the userĀ“s group if it contains no"00:18
*** hongbin has joined #openstack-infra00:26
*** dingyichen has joined #openstack-infra00:29
*** dingyichen has quit IRC00:34
*** dingyichen has joined #openstack-infra00:36
*** agopi has quit IRC00:42
openstackgerritIan Wienand proposed openstack-infra/system-config master: Generate roles documentation  https://review.openstack.org/59347801:01
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add kerberos-client role  https://review.openstack.org/59348601:01
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add openafs-client role  https://review.openstack.org/59348701:01
openstackgerritIan Wienand proposed openstack-infra/system-config master: Move tox basepython to top-level  https://review.openstack.org/59398201:01
*** felipemonteiro has joined #openstack-infra01:04
openstackgerritIan Wienand proposed openstack-infra/system-config master: [DNM] testing zuul-sphinx updated installation  https://review.openstack.org/59348401:05
*** yamahata has quit IRC01:22
*** felipemonteiro has quit IRC01:27
*** janki has joined #openstack-infra01:28
*** yamahata has joined #openstack-infra01:33
*** neilsun has joined #openstack-infra01:39
*** Bhujay has joined #openstack-infra02:00
*** felipemonteiro has joined #openstack-infra02:00
*** zhangfei has joined #openstack-infra02:00
openstackgerritIan Wienand proposed openstack-infra/system-config master: Generate roles documentation  https://review.openstack.org/59347802:04
openstackgerritIan Wienand proposed openstack-infra/system-config master: Move tox basepython to top-level  https://review.openstack.org/59398202:04
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add kerberos-client role  https://review.openstack.org/59348602:04
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add openafs-client role  https://review.openstack.org/59348702:04
*** gcb_ has joined #openstack-infra02:07
*** yamahata has quit IRC02:15
*** apetrich has quit IRC02:27
*** rlandy has quit IRC02:42
*** felipemonteiro has quit IRC02:43
*** markvoelker has joined #openstack-infra03:01
*** psachin has joined #openstack-infra03:06
*** janki has quit IRC03:06
*** jamesmcarthur has joined #openstack-infra03:15
*** jamesmcarthur has quit IRC03:19
*** larainema has joined #openstack-infra03:20
*** diablo_rojo has quit IRC03:21
*** Bhujay has quit IRC03:24
*** rh-jelabarre has quit IRC03:38
*** ramishra has joined #openstack-infra03:40
openstackgerritIan Wienand proposed openstack-infra/system-config master: Update to latest docs PTI  https://review.openstack.org/59348303:43
openstackgerritIan Wienand proposed openstack-infra/system-config master: Generate roles documentation  https://review.openstack.org/59347803:44
openstackgerritIan Wienand proposed openstack-infra/system-config master: Move tox basepython to top-level  https://review.openstack.org/59398203:44
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add kerberos-client role  https://review.openstack.org/59348603:44
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add openafs-client role  https://review.openstack.org/59348703:44
openstackgerritIan Wienand proposed openstack-infra/system-config master: roles/exim: Remove true filter plugin  https://review.openstack.org/59399803:44
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add kerberos-client role  https://review.openstack.org/59348603:51
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add openafs-client role  https://review.openstack.org/59348703:51
*** ykarel has joined #openstack-infra04:00
*** udesale has joined #openstack-infra04:00
*** ykarel has quit IRC04:06
*** ykarel has joined #openstack-infra04:07
*** hongbin has quit IRC04:10
openstackgerritMerged openstack-infra/irc-meetings master: OpenStack Upstream Institute meeting time update  https://review.openstack.org/59371304:12
*** ijw has joined #openstack-infra04:13
*** felipemonteiro has joined #openstack-infra04:25
openstackgerritMerged openstack-infra/zuul master: Fix reject clauses in the absence of approvals  https://review.openstack.org/58976204:25
AJaegerconfig-core, these changes are needed by release team - care to review, please? https://review.openstack.org/591837 https://review.openstack.org/591836 https://review.openstack.org/59266704:26
*** janki has joined #openstack-infra04:27
*** psachin has quit IRC04:27
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Add build-tox-docs and build-openstack-docs-pti  https://review.openstack.org/59372304:30
*** markvoelker has quit IRC04:32
AJaegerconfig-core, and the one above as well, please - needs https://review.openstack.org/#/q/topic:infra-docs+status:open whole stack. We need that new template above for one of smcginnis python3-first changes04:32
AJaegerthanks, ianw04:34
ianwAJaeger: thank you too :)  https://review.openstack.org/#/c/593982/ moves the docs build to python3.  i actually left the python2 failure in the stack with https://review.openstack.org/#/c/593478/ because i think we should fix zuul-sphinx for it anyway04:35
openstackgerritMerged openstack-infra/project-config master: Explicitly add stable-maint-core to governed repos  https://review.openstack.org/59183704:37
AJaegeryes, we should - even if we move to python  3...04:37
ianwAJaeger: the other thing, speaking of the read-the-docs templates ... uptake of people fixing their publishing has been low.  i think i've only seen one change04:38
ianwAJaeger: my thought was maybe to put a non-voting job in their check queue, and then maybe eventually flick it to voting & failing if no action is taken04:39
ianwa dummy "you-need-to-update-your-readthedocs-job" job04:39
openstackgerritMerged openstack-infra/project-config master: prune dead branches when syncing with origin  https://review.openstack.org/59266704:40
*** markvoelker has joined #openstack-infra04:43
*** Bhujay has joined #openstack-infra04:45
AJaegerianw: yeah, good idea...04:46
openstackgerritIan Wienand proposed openstack-infra/system-config master: [DNM] testing zuul-sphinx updated installation  https://review.openstack.org/59348404:49
AJaegerdhellmann: how to convert  publish-openstack-sphinx-docs-direct? Want to create an extra job for this? See my discussion with smcginnis on https://review.openstack.org/#/c/593895/2/.zuul.yaml04:50
*** Bhujay has quit IRC04:51
*** markvoelker has quit IRC04:52
*** Bhujay has joined #openstack-infra04:53
openstackgerritIan Wienand proposed openstack-infra/project-config master: Remove openstack-python3 from accessbot  https://review.openstack.org/59400504:58
openstackgerritNguyen Hai proposed openstack-infra/project-config master: remove job settings for vitrage repositories  https://review.openstack.org/59282804:59
*** holser_ has joined #openstack-infra04:59
openstackgerritIan Wienand proposed openstack-infra/system-config master: roles/exim: remove "true" filter plugin  https://review.openstack.org/59399805:06
openstackgerritIan Wienand proposed openstack-infra/system-config master: Update to latest docs PTI  https://review.openstack.org/59348305:06
openstackgerritIan Wienand proposed openstack-infra/system-config master: Generate roles documentation  https://review.openstack.org/59347805:06
openstackgerritIan Wienand proposed openstack-infra/system-config master: Move tox basepython to top-level  https://review.openstack.org/59398205:06
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add kerberos-client role  https://review.openstack.org/59348605:06
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add openafs-client role  https://review.openstack.org/59348705:06
*** ykarel has quit IRC05:07
openstackgerritIan Wienand proposed openstack-infra/system-config master: [DNM] testing zuul-sphinx updated installation  https://review.openstack.org/59348405:08
openstackgerritNguyen Hai proposed openstack-infra/project-config master: remove job settings for vitrage repositories  https://review.openstack.org/59282805:09
openstackgerritMerged openstack-infra/project-config master: Remove openstack-python3 from accessbot  https://review.openstack.org/59400505:13
*** psachin has joined #openstack-infra05:14
ianwmordred: ok, so if you start at https://review.openstack.org/#/c/589335/ and work backwards through depends-on and stacked patches, that's probably first example of zuul jobs from system-config.  as they say, may you live in interesting times.05:18
*** ykarel has joined #openstack-infra05:25
*** jbadiapa has quit IRC05:32
openstackgerritMerged openstack-infra/zuul-jobs master: Build releasenotes when tox.ini changes  https://review.openstack.org/59229805:33
openstackgerritMerged openstack-infra/zuul-jobs master: npm: add CI=true environment  https://review.openstack.org/59196405:33
*** ijw has quit IRC05:35
openstackgerritIan Wienand proposed openstack-infra/system-config master: roles/exim: remove "true" filter plugin  https://review.openstack.org/59399805:43
openstackgerritIan Wienand proposed openstack-infra/system-config master: Update to latest docs PTI  https://review.openstack.org/59348305:43
openstackgerritIan Wienand proposed openstack-infra/system-config master: Generate roles documentation  https://review.openstack.org/59347805:43
openstackgerritIan Wienand proposed openstack-infra/system-config master: Move tox basepython to top-level  https://review.openstack.org/59398205:43
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add kerberos-client role  https://review.openstack.org/59348605:43
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add openafs-client role  https://review.openstack.org/59348705:43
openstackgerritIan Wienand proposed openstack-infra/system-config master: Also lint top-level ansible roles/ directory  https://review.openstack.org/59401405:43
*** jaosorior has quit IRC05:45
*** jaosorior has joined #openstack-infra05:47
openstackgerritNguyen Hai proposed openstack-infra/project-config master: remove job settings for searchlight repositories  https://review.openstack.org/59403305:50
*** zhangfei has quit IRC05:59
*** holser_ has quit IRC06:02
AJaegerconfig-core, vitrage is ready with python3-first - final change is https://review.openstack.org/#/c/592828 and ready for review06:05
*** janki has quit IRC06:06
*** yamahata has joined #openstack-infra06:07
*** alexchadin has joined #openstack-infra06:27
*** ccamacho has joined #openstack-infra06:28
*** rcernin has quit IRC06:38
*** rcernin has joined #openstack-infra06:40
*** pcaruana has joined #openstack-infra06:42
*** rcernin has quit IRC06:51
*** snapiri has quit IRC07:02
*** snapiri has joined #openstack-infra07:05
*** jamesmcarthur has joined #openstack-infra07:15
*** f1 has joined #openstack-infra07:16
*** jamesmcarthur has quit IRC07:20
*** alexchadin has quit IRC07:21
*** jtomasek has joined #openstack-infra07:24
*** tosky has joined #openstack-infra07:29
*** hashar has joined #openstack-infra07:29
*** jbadiapa has joined #openstack-infra07:30
*** alexchadin has joined #openstack-infra07:32
*** jtomasek has quit IRC07:33
*** jtomasek has joined #openstack-infra07:33
Tengurf07:39
*** jpich has joined #openstack-infra07:39
*** jpena|off is now known as jpena07:40
*** ginopc has joined #openstack-infra07:42
dirkhow does one report issues with the https://www.openstack.org/ website? is there some launchpad storyboard bug tracker somewhere?07:47
AJaegerdirk, yes, there's some launchpad bug tracker, let me find it...07:50
AJaegerdirk, https://bugs.launchpad.net/openstack-org07:51
AJaegerfrickler: if you have some time for reviews today, could you look at https://review.openstack.org/#/q/status:open+++topic:infra-docs , please?07:55
openstackgerritlei zhang proposed openstack-infra/infra-manual master: Disable the badge from openstackdocstheme 1.23  https://review.openstack.org/59405607:56
*** felipemonteiro has quit IRC07:57
*** shardy has joined #openstack-infra08:00
dirkAJaeger: thanks!08:08
openstackgerritNguyen Hai proposed openstack-infra/project-config master: remove job settings for horizon repositories  https://review.openstack.org/59406908:10
*** e0ne has joined #openstack-infra08:10
*** yankcrime has joined #openstack-infra08:11
*** zhangfei has joined #openstack-infra08:12
openstackgerritNguyen Hai proposed openstack-infra/project-config master: remove job settings for horizon repositories  https://review.openstack.org/59406908:13
openstackgerritKeiichi Hikita proposed openstack-infra/project-config master: Add translation job to zuul.d/projects.yaml  https://review.openstack.org/59407008:13
openstackgerritNguyen Hai proposed openstack-infra/project-config master: remove job settings for horizon repositories  https://review.openstack.org/59406908:14
openstackgerritKeiichi Hikita proposed openstack-infra/project-config master: Add translation job to zuul.d/projects.yaml  https://review.openstack.org/59407008:17
*** zhangfei has quit IRC08:29
*** electrofelix has joined #openstack-infra08:33
*** dbecker has quit IRC08:34
*** shardy has quit IRC08:43
*** shardy has joined #openstack-infra08:44
*** zhangfei has joined #openstack-infra08:45
*** alexchadin has quit IRC08:53
*** holser_ has joined #openstack-infra08:53
*** dingyichen has quit IRC09:06
*** alexchadin has joined #openstack-infra09:14
*** sshnaidm|off is now known as sshnaidm09:21
*** apetrich has joined #openstack-infra09:23
*** mriedem has joined #openstack-infra09:42
*** dtantsur|afk is now known as dtantsur09:59
*** dpawlik_ has quit IRC10:03
*** dpawlik has joined #openstack-infra10:08
*** jamesmcarthur has joined #openstack-infra10:15
*** rpioso|afk is now known as rpioso10:19
*** jamesmcarthur has quit IRC10:20
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove unused infra publish templates  https://review.openstack.org/59371410:25
*** alexchadin has quit IRC10:25
*** Bhujay has quit IRC10:26
*** ykarel is now known as ykarel|lunch10:29
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Add build-tox-docs and build-openstack-docs-pti  https://review.openstack.org/59372310:30
*** Tengu has quit IRC10:32
*** Tengu has joined #openstack-infra10:33
*** alexchadin has joined #openstack-infra10:36
*** dbecker has joined #openstack-infra10:37
openstackgerritMerged openstack-infra/project-config master: remove job settings for vitrage repositories  https://review.openstack.org/59282810:40
*** hashar is now known as hasharAway11:00
*** rpioso is now known as rpioso|afk11:09
*** jpena is now known as jpena|lunch11:10
*** ykarel|lunch is now known as ykarel11:10
*** Bhujay has joined #openstack-infra11:13
openstackgerritMerged openstack-infra/project-config master: Remove obsolete infra publish jobs  https://review.openstack.org/59371511:16
openstackgerritMerged openstack-infra/project-config master: Update infra-manual publishing  https://review.openstack.org/59372411:16
*** snapiri has quit IRC11:16
*** udesale has quit IRC11:25
*** ansmith has quit IRC11:33
*** e0ne has quit IRC11:36
*** zhangfei has quit IRC11:37
*** tpsilva has joined #openstack-infra11:44
*** MasterofJOKers has quit IRC11:49
*** rh-jelabarre has joined #openstack-infra11:49
*** trown|outtypewww is now known as trown11:50
*** longkb has quit IRC11:50
*** annp has quit IRC11:50
*** jlibosva has joined #openstack-infra11:52
*** larainema has quit IRC11:54
*** MasterofJOKers has joined #openstack-infra11:56
*** boden has joined #openstack-infra11:59
*** rosmaita has joined #openstack-infra12:07
radezhey folks, I'm trying to add Create Reference to my project's permissions so that I can push a branch to an unoffical project12:09
radezI updated permissions in the webui and created this review12:09
radezhttps://review.openstack.org/#/c/594141/12:09
radezbut it says it's in merge conflict? I'm not quite sure how to resolve this12:09
mordredradez: heya - you want gerrit/acls/openstack/networking-ansible.config in the openstack-infra/project-config repo12:11
radezmordred: ah, thx I'll take a look there12:12
mordredradez: I have no clue why the other thing shows merge conflict ... seems weird :)12:12
* radez shrugs12:12
radezI don't have any expereince with it... which is why i asked here :)12:13
radezdoes seem wierd though, when I checked out that change the git history looked happy12:13
radezhm, though I think I tried to add create in the wrong place, I added it under tags...12:14
*** weshay is now known as weshay|ssbarnea_12:15
radezmaybe I should double check that heads is where it should be under12:15
*** weshay|ssbarnea_ is now known as weshay12:15
*** jpena|lunch is now known as jpena12:18
openstackgerritDan Radez proposed openstack-infra/project-config master: Adding create access to push stable branches  https://review.openstack.org/59415112:20
*** jcoufal has joined #openstack-infra12:30
AJaegerradez: alphebtical order of entries in that section ^12:32
AJaegerradez: otherwise the tests will not pass12:32
radezAJaeger: thx, just saw that12:33
openstackgerritDan Radez proposed openstack-infra/project-config master: Adding create access to push stable branches  https://review.openstack.org/59415112:33
*** ssbarnea is now known as ssbarnea|ruck12:35
AJaegermordred: could I trouble you for some infra-manual reviews, please? https://review.openstack.org/#/q/project:openstack-infra/infra-manual https://review.openstack.org/593344 https://review.openstack.org/59080912:35
AJaegerradez: keep in mind that deletion of branches is an admin only option - so you need to ask here for it.12:35
radezAJaeger: ack, when woudl be delete branches?12:36
radezI suppose when a stable relase goes eol?12:36
AJaegerradez: for example12:37
*** rlandy has joined #openstack-infra12:41
radezAJaeger: k, we'll keep that in mind thx for the heads up12:42
*** kgiusti has joined #openstack-infra12:45
*** jamesmcarthur has joined #openstack-infra12:47
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Update publish-openstack-sphinx-docs-direct jobs  https://review.openstack.org/59415912:54
AJaegerdhellmann, smcginnis, this should help with operations-guide ^12:54
smcginnisAJaeger: Thanks!12:56
AJaegersmcginnis: I've just updated your change, followup coming12:57
smcginnisOh good, was just doing that.12:57
AJaegersmcginnis: followup #594163 pushed as well - now you should be fine13:02
smcginnisThanks for your help with those.13:02
AJaegerdhellmann: is that part of your automatic changes (converting publish-openstack-sphinx-docs-direct to publish-openstack-sphinx-docs-direct and build-openstack-sphinx-docs to build-openstack-docs-pti as in #594163)? Please update goal-tools if needed13:03
*** efried is now known as efried_goatin13:03
cmurphyinfra-root: ask.o.o seems down again13:04
*** jamesmcarthur has quit IRC13:04
*** boden has quit IRC13:06
*** ansmith has joined #openstack-infra13:09
radezmordred: could I get your +2 again on this: https://review.openstack.org/#/c/594151/ had to rearrange for alphabetical ordering13:10
fungichecking13:10
fungicmurphy: thanks, should be up again13:10
fungiapache seems to be silently crashing on an almost daily basis there now13:11
*** boden has joined #openstack-infra13:11
fungi#status log started apache service on ask.openstack.org (died around log rotation again leaving no information as to why)13:12
openstackstatusfungi: finished logging13:13
*** r-mibu has joined #openstack-infra13:15
fungipretty sure it's log rotation based on this from the (rotated) error.log:13:16
fungi[Tue Aug 21 06:48:40.647625 2018] [mpm_event:notice] [pid 19182:tid 140462698928000] AH00493: SIGUSR1 received.  Doing graceful restart13:16
fungi[Tue Aug 21 06:48:40.845420 2018] [core:notice] [pid 19182] AH00060: seg fault or similar nasty error detected in the parent process13:16
cmurphynot very graceful at all13:17
*** psachin has quit IRC13:17
openstackgerritMonty Taylor proposed openstack-infra/system-config master: WIP Add iptables role  https://review.openstack.org/59397313:17
mordredfungi, corvus: ^^ could use help finishing that13:17
mordredfungi, cmurphy: oh fun restart!13:17
*** rossella_s has joined #openstack-infra13:19
dhellmannAJaeger : what is special about that direct job?13:19
fungimordred: cmurphy: i want to say there were issues with mpm_event in trusty which are solved in the apache version in xenial. maybe that's what this is?13:21
radezthx mordred!13:22
mordredradez: my pleasure!13:22
mordredfungi: I could believe that13:22
fungithough https://bugs.debian.org/872036 suggests it could be related to multiple simultaneous signals being sent to the apache parent process during log rotation13:23
openstackDebian bug 872036 in apache2-mpm-event "AH00060: seg fault or similar nasty error detected in the parent process" [Important,Open]13:23
openstackgerritMerged openstack-infra/project-config master: Adding create access to push stable branches  https://review.openstack.org/59415113:23
AJaegerdhellmann: it publishes to docs.o.o/operations-guide and not to docs.o.o/operations-guide/latest13:24
AJaegerdhellmann: and we need to convert it to new PTI13:24
dhellmannok13:24
dhellmannI just wasn't sure how it was different from the other job13:24
dhellmann"direct" didn't really convey any meaning :-)13:25
AJaegerdhellmann: have a better name? Happy to rename :)13:25
dhellmannno, that's fine, now that I understand it13:25
*** eharney has quit IRC13:26
dhellmannwhat exactly replaces what? you seem to have pasted the same name tweice in your message earlier13:26
dhellmannthose are job names, are there templates?13:26
openstackgerritMerged openstack-infra/infra-manual master: Clarify inability to delete tags  https://review.openstack.org/59080913:26
AJaegerdhellmann: no template that uses the job, see #594163 for change of template and jobs13:27
*** trown is now known as trown|brb13:27
dhellmannok, I'm not handling anything for docs that isn't in a template, yet, so I'll have to add that13:28
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Increase the run_all forks count to 20  https://review.openstack.org/59417313:29
AJaegerdhellmann: so, both a template change and a job change in this case. Not sure how many repos use that specific job and that specific template13:29
AJaegerbbl13:29
dhellmannAJaeger : ok, I'm still not clear on the names. you said "converting publish-openstack-sphinx-docs-direct to publish-openstack-sphinx-docs-direct" but those are the same name13:30
dhellmannand you said "build-openstack-sphinx-docs to build-openstack-docs-pti" where the first is a job and the second is a template13:30
openstackgerritMerged openstack-infra/infra-manual master: Give examples for master only jobs  https://review.openstack.org/59334413:31
AJaegerconvertign job publish-openstack-sphinx-docs-direct to publish-openstack-tox-docs-direct13:31
*** trown|brb is now known as trown13:31
AJaegerbuild-openstack-sphinx-docs is both a job and a template13:31
AJaegerdifferent namespaces ;)13:31
*** sthussey has joined #openstack-infra13:31
AJaegerand I talked about converting template build-openstack-sphinx-docs to template build-openstack-docs-pti13:31
AJaegerdhellmann: change https://review.openstack.org/#/c/594163/ does exactly this conversion13:32
dhellmannAJaeger : ok13:32
dhellmannthe template change should already be handled by the tools13:32
dhellmannah, no, it only does the publish one13:33
AJaegerI just created build-openstack-docs-pti this morning, it did not exists before13:33
dhellmannok, I get it now13:33
*** apetrich has quit IRC13:33
*** efried_goatin is now known as efried13:37
*** ccamacho has quit IRC13:38
*** e0ne has joined #openstack-infra13:40
*** jamesmcarthur has joined #openstack-infra13:44
fungisimilar apache reload signal handler segfault bug: https://bugzilla.redhat.com/show_bug.cgi?id=137683513:46
openstackbugzilla.redhat.com bug 1376835 in httpd "httpd with worker/event mpm segfaults after multiple successive graceful reloads" [Medium,Closed: errata] - Assigned to luhliari13:46
*** alexchadin has quit IRC13:55
*** jcoufal has quit IRC13:56
dhellmannAJaeger : I think https://review.openstack.org/594183 does what you're asking for. Please confirm when you have a minute.13:57
*** jcoufal has joined #openstack-infra13:57
*** alexchadin has joined #openstack-infra13:58
*** felipemonteiro has joined #openstack-infra13:59
openstackgerritMonty Taylor proposed openstack-infra/git-review master: Start using reno for releasenotes  https://review.openstack.org/59367014:00
openstackgerritMonty Taylor proposed openstack-infra/git-review master: Use doc/requirements and openstackdocstheme  https://review.openstack.org/59418614:00
*** agopi has joined #openstack-infra14:01
*** f1 is now known as florianf14:02
*** jbadiapa has quit IRC14:05
*** pbourke has quit IRC14:06
*** felipemonteiro has quit IRC14:07
*** pbourke has joined #openstack-infra14:07
*** ccamacho has joined #openstack-infra14:08
*** jbadiapa has joined #openstack-infra14:11
*** alexchadin has quit IRC14:13
*** alexchadin has joined #openstack-infra14:13
*** eharney has joined #openstack-infra14:23
*** vivsoni has quit IRC14:25
*** felipemonteiro has joined #openstack-infra14:26
*** felipemonteiro has quit IRC14:32
*** r-daneel has joined #openstack-infra14:47
*** rpioso|afk is now known as rpioso14:48
*** ccamacho has quit IRC14:53
*** felipemonteiro has joined #openstack-infra14:56
*** alexchadin has quit IRC14:56
*** yamahata has quit IRC14:57
*** jamesmcarthur has quit IRC14:57
*** alexchadin has joined #openstack-infra14:57
*** ginopc has quit IRC15:01
*** hasharAway is now known as hashar15:02
*** felipemonteiro has quit IRC15:02
*** dpawlik has quit IRC15:03
*** jlibosva has quit IRC15:03
*** felipemonteiro has joined #openstack-infra15:03
*** alexchadin has quit IRC15:03
*** felipemonteiro has quit IRC15:05
*** jamesmcarthur has joined #openstack-infra15:07
*** pcaruana has quit IRC15:09
pabelangerfungi: corvus: mordred: I think this morning, I'll stop ze01.o.o, and remove the executor-git cache. Then bring it back online, and monitor for cache repopulating15:12
pabelangeronce good, I'll then try to mass chmod ze02, confirm working before moving to rest of exectors15:12
fungipabelanger: sounds like what we discussed yesterday--thanks!15:13
*** priteau has joined #openstack-infra15:13
openstackgerritmelissaml proposed openstack-infra/puppet-openstackci master: Remove the duplicated word  https://review.openstack.org/59430915:14
corvusmordred: what still needs doing on the iptable patch?15:18
mordredcorvus: the handlers file - I'm unsure about the starting/stopping of the services15:19
mordredI looked on a xenial node and there didn't even seem to be an iptables service15:19
mordredcorvus: I *think* everything else is translated over15:19
*** michalpelka has joined #openstack-infra15:19
AJaegerconfig-core, could you review https://review.openstack.org/594159 to add some docs jobs using the PTI, please?15:19
mordredcorvus: oh - I should probably also change the invocatoins15:19
corvusmordred: i think it's called netfilter now15:19
mordredcorvus: I can work on shifting variables/parameters if you've got brainspace to figure out what the right thing to do for start/stop is15:20
corvusmordred: sure thing15:20
corvusmordred: also 1 comment inline15:20
fungiyeah, see my comments from yesterday... on trusty it's iptables-persistent, on xenial and bionic it's netfilter-persistent15:21
fungiand the start|restart|reload|force-reload arguments to its initscript all just do the same thing: load the ruleset15:21
fungistop argument is a no-op15:21
mordrednod. for some reason my brain is just refusing to engage on tis15:22
fungihence my suggestion for not treating it as a service, just calling the initscript as a reload command15:22
fungiit's simply abusing the init system to make sure your configured rules are loaded into the kernel at boot15:22
mordredyeah15:22
mordredI just went and looked for the initscript, couldn't find it (I think I missed your note about the iptables-persistent/netfilter-persistent) and was like "gah"15:23
corvusi'll get you a list15:23
fungi/etc/init.d/iptables-persistent (<=trusty) and /etc/init.d/netfilter-persistent (>=xenial)15:24
corvusthat ^.  we can use either 'start', 'restart', or 'reload' as an argument.15:27
corvusin both cases15:27
*** Bhujay has quit IRC15:27
fungii like reload, but it's pretty immaterial which we choose aside from readability15:28
corvusunder centos we should do 'systemctl reload iptables'15:30
*** felipemonteiro has joined #openstack-infra15:30
corvusand 'systemctl reload ip6tables'15:31
fungiinteresting that they split them15:31
corvusmordred: want me to try to type that up?15:31
*** felipemonteiro has quit IRC15:32
mordredcorvus: yes please - I don't know why my brain is rebeling on it- but it is15:33
pabelangermordred: you need to install iptables-persistent, which then add netfilter-persistent service15:33
mordredcorvus: I'm working on the manifest/site.pp host_vars/group_vars update15:33
corvusmordred: ok.  would you prefer to use the geerlinguy module?15:33
pabelangerIIRC, netfilter-persistent doesn't have init.d scripts15:33
*** jbadiapa has quit IRC15:33
mordredcorvus: no - I think we have 99% of the role done15:33
corvusok15:33
mordredcorvus: really just need the restart stuff15:34
pabelangermordred: actually, ignore me. I am wrong. iptables-persistent gets you some plugins15:34
pabelangermaybe they are needed for init scripts, let me check something locally15:36
openstackgerritHongbin Lu proposed openstack-infra/project-config master: Add openstack/os-ken to neutron  https://review.openstack.org/58835515:37
*** electrofelix has quit IRC15:37
*** electrofelix has joined #openstack-infra15:37
*** yamahata has joined #openstack-infra15:38
pabelangerokay, now that I have some coffee I am going to stop ze0115:39
pabelangerplease say if you have any objections15:39
corvuspabelanger: just check that no release jobs are running15:40
pabelangercorvus: agree15:40
fungipabelanger: we have initscripts from them all the way up through bionic at least. i checked15:40
*** dklyle has quit IRC15:41
fungi/usr/share/doc/iptables-persistent/README on a bionic system explains15:41
*** armax has joined #openstack-infra15:42
pabelangerfungi: I left a comment on the iptables review which might be a typo15:42
*** dklyle has joined #openstack-infra15:44
*** e0ne has quit IRC15:44
*** ykarel is now known as ykarel|away15:45
*** strigazi has quit IRC15:46
*** strigazi has joined #openstack-infra15:46
*** ramishra has quit IRC15:54
*** gyee has joined #openstack-infra15:56
openstackgerritSaul Wold proposed openstack-infra/project-config master: stx-specs: Add new repo for specifications  https://review.openstack.org/59267615:56
corvusmordred: oh i forgot our iptables stuff did the ip translation; that's a good reason to stick with this vs geerlinguy15:57
*** rosmaita has quit IRC15:57
openstackgerritSaul Wold proposed openstack-infra/project-config master: stx-specs: Add new repo for specifications  https://review.openstack.org/59267615:58
*** r-mibu has quit IRC16:04
pabelangerpackethost doesn't seem happy: http://paste.openstack.org/raw/728540/ for nodepool16:05
mordredcorvus: yah - we have some complexity16:07
openstackgerritMonty Taylor proposed openstack-infra/system-config master: WIP Transfer rules  https://review.openstack.org/59434016:07
mordredcorvus: I'm working on the rule data in a followup patch^^ with the intent of squashing it - but committing/pushing up so that I don't accidentally lose work - because yay data transformatoin16:08
corvusmordred: cool -- i'd like to get rid of the special snmp rule, sort of like how we did with exim aliases (make a global set of default rules, then add to it for hosts that need extras).  good idea?16:09
openstackgerritVieri proposed openstack-infra/project-config master: import zuul job settings from project-config  https://review.openstack.org/59434916:09
*** rpioso is now known as rpioso|afk16:12
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Add iptables role  https://review.openstack.org/59397316:14
corvusmordred: ^ there's the update, but without the snmp change.  maybe we could stack that on top of your WIP transfer patch16:15
*** jpena is now known as jpena|off16:19
mordredcorvus: yes16:19
*** sambetts has joined #openstack-infra16:19
openstackgerritMonty Taylor proposed openstack-infra/system-config master: WIP Transfer rules  https://review.openstack.org/59434016:20
sambettsHi infra, when zuul dequeues a change because there is a new patchset does it abort the existing jobs that are running? and when if it does, does it run the post plays for the jobs that were aborted??16:20
mordredcorvus: stacked16:20
mordredsambetts: yes, and no16:21
corvusmordred: i'll take a stab at factoring out the snmp stuff on top of your change, ok?16:21
corvusmordred: er, i mean, your most recent change :)16:22
sambettsmordred: ah... thats a problem... we use the post plays to release shared resources in our CI, in our old jenkins CI it always ran the post job tasks even if it aborted16:22
pabelangerze01.o.o directory permissions have been fixed, and http://logs.openstack.org/21/594321/1/check/openstack-tox-validate/4f6066a/job-output.txt.gz completed successfully16:22
corvussambetts: can your shared resource be expressed as a static node in nodepool?16:23
sambettscorvus: I'm not sure how ranges of vlans can be expressed in nodepool, we use a DB to track these and the pre plays claim the resource, and the post plays release them16:24
*** jtomasek_ has joined #openstack-infra16:25
*** jtomasek has quit IRC16:26
corvussambetts: yeah, it doesn't support that yet; though we plan to have it support many more kinds of resources.  ultimately that's the part of the system that's responsible for allocating resources to zuul.16:27
fungiin the past we've discussed the possibility of nodepool becoming a thingpool and gaining the ability to create and destroy a variety of things on demand16:27
fungithough likely more of a discussion for #zuul too16:28
corvussambetts: i don't have an immediate solution to that problem, other than to say it's a known need, and we'd like to support it.16:28
sambettsI could probably express almost anything in nodepool if it didn't try to check port 22 was up on the a nodes, I discussed with Monty in dublin about how we have baremetal servers for ironic that we want to express in nodepool as static resources, but they aren't deployed with an OS so it can't respond to the heartbeat16:29
*** hashar has quit IRC16:29
corvussambetts: as an interim solution, you might be able to devise a system to invalidate the resource reservation in the pre-playbook.  if you have the reservation record the zuul build uuid, you could use the status api to see if the build is still running.16:29
sambettscorvus: we have a crude way of doing that already, 3hr timeout on the resource, perhaps it could be made smarter as you say16:30
corvussambetts: indeed, maybe we should start with the static driver and just disable some behaviors (like the ssh check, and adding to the ansible inventory) to get support for generic ancillary resources without too much effort.16:31
sambettsI worry about not running the post plays on abort for other reasons though, for example we have tasks that remove the used VLANs from the switch we're testing so clean up the external environment16:31
corvussambetts: yeah, that sort of work either calls for a dedicated nodepool driver, or a different way of handling cleanup tasks in zuul16:32
fungior a hacky bolt-on that checks if zuul is still using the provisioned vlans and cleans up any which should be freed16:32
fungi(as a workaround)16:33
sambettsthe old jenkins way of doing things treated aborts as the same as a failure of the run task of the job, I'm surprised zuul isn't treating it the same16:33
*** panda is now known as panda|off16:33
pabelanger#status log Stopped ze01.o.o, deleted executor-git directory on filesystem, started ze01.o.o again. Zuul has properly repopulated the directory with right file permissions16:34
openstackstatuspabelanger: finished logging16:34
fungii don't recall jenkins running anything if a job got aborted, but maybe that was a feature we never leveraged16:34
*** jpich has quit IRC16:34
corvusfungi: we never used it (or, rather, we stopped using it after we had scaling problems with it)16:35
fungisambetts: as an interim solution, could you run some persistent loop somewhere that checked whether the vlans had any entries in their bridge tables and then deprovisioned them if they were empty (perhaps with some delay in case they're in the process of getting servers added to them when you catch them)?16:35
corvusfungi, sambetts: or perform that check/cleanup in the pre playbook too (along with the suggested invalidation)16:36
fungiwhere "empty" is defined as only has known static entries or something, depending on what you're connecting these vlans to16:37
sambettsour setup was install using puppet-openstackci, so I'm surprised this is something that our setup did differently :/16:37
*** dtantsur is now known as dtantsur|afk16:38
sambettsother third party CI installers writing jobs may expect the same behaviour too16:38
sambettsI expect the cleanest solution for now will be to enhance our pre-play to invalid the vlans in a smarter way, e.g. tracking the build IDs with the claim and checking if they are still running as you said16:39
fungisambetts: well, whether or not you ran extra things on job abort would i expect be entirely up to what you put in your jjb configuration16:39
fungiand have little if anything to do with how you provisioned the zuul/jenkins16:39
fungiservices16:39
sambettsfungi: the standard jjb template for openstack ci jobs used the post run parts (publishers I think is the right term) to upload the logs etc which it did even on abort16:41
sambettswe added a couple of other publishers to do our release, but it was only in addition to what already ran16:42
sambettshttps://github.com/CiscoSystems/project-config-third-party/blob/master/jenkins/jobs/networking-cisco-macros.yaml#L11216:42
fungiright, i think we did upload (some) logs on abort, but we never reported them and so didn't really rely on them since they were wholly undiscoverable for most users16:44
corvuswe did not use postbuildscript16:44
sambettsright, but postbuildscript was just a type of publisher, it still ran the publishers16:44
corvusour log publisher was just a standard shell task16:44
corvuspostbuildscript is a special kind of publisher that can be configured to run even on failure or abort.  we never used that in openstack-infra16:45
corvus(or rather, we never used it widely at scale; we experimented with it long enough to determine it wasn't appropriate for our configuration)16:46
*** trown is now known as trown|lunch16:46
sambettsah right, got it, I forgot about that flag (I'm so far down the CI rabbit hole my brain hurts)16:46
corvusyeah, you can get headaches from the pressure down here :)16:47
fungiso that's why i always need to decompress in the evenings16:47
*** felipemonteiro has joined #openstack-infra16:48
openstackgerritJames E. Blair proposed openstack-infra/system-config master: iptables: factor out snmp rules  https://review.openstack.org/59443716:49
openstackgerritJames E. Blair proposed openstack-infra/system-config master: iptables: add a README  https://review.openstack.org/59443816:49
*** ykarel|away has quit IRC16:49
corvusmordred, fungi: ^ i think that stack is ready for review.  i wrote the readme earlier, but i forgot to include it.  maybe we just squash all 4 patches after we're done reviewing?16:49
sambettscorvus, fungi: thanks for the explanation, I'll explore enhancing our pre-plays for now16:50
openstackgerritMonty Taylor proposed openstack-infra/system-config master: WIP Transfer rules  https://review.openstack.org/59434016:50
*** markvoelker has joined #openstack-infra16:50
mordredcorvus: yes - I think squashing once done - and I think that ^^ is ready for review16:51
mordredmaybe I shoudl remove the WIP from it16:51
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Transfer iptables rules to ansible  https://review.openstack.org/59434016:51
pabelangercorvus: fungi: does the following syntax for chmod of executor-git look correct:16:52
pabelangersudo find /var/lib/zuul/executor-git -type d -exec chmod 755 {} \;16:52
*** sambetts is now known as sambetts|afk16:52
corvusmordred: i'll update my snmp patch16:52
*** felipemonteiro has quit IRC16:52
openstackgerritJames E. Blair proposed openstack-infra/system-config master: iptables: factor out snmp rules  https://review.openstack.org/59443716:54
openstackgerritJames E. Blair proposed openstack-infra/system-config master: iptables: add a README  https://review.openstack.org/59443816:54
corvusmordred, fungi: ^ there we go!16:54
fungipabelanger: sudo chmod -R u=rwX,go=rX /var/lib/zuul/executor-git16:55
fungipabelanger: that'll give you 0755 on directories and 0644 on regular files16:56
*** shardy has quit IRC16:57
*** michalpelka has quit IRC16:58
*** nicolasbock has joined #openstack-infra16:59
*** florianf has quit IRC17:04
*** neilsun has quit IRC17:05
pabelangerfungi: I actually wonder, if we do a chmod, if we are going to affect the repo state? What if a file in repo needs 075517:08
fungipabelanger: oh, yes we will. it might be better to not go full recursive17:09
fungisince these are git repos, changing the modes of any files in them will be an uncommitted change in them17:09
* fungi takes a look at one real quick to provide a better suggestion17:10
pabelangeryah17:10
pabelangerI can just cd in to folders and chmod projects17:10
fungiahh, i think what you had originally is actually fine. i believe git does not track permissions of directories (so these are created based on context like umask and parent directory perms), it only tracks permissions of files17:12
fungidouble-checking17:13
pabelangeryah, I can see 777 dirs in git projects17:14
pabelangerso, believe your statement is correct17:14
fungiright, i see a mix in them17:14
*** jamesmcarthur has quit IRC17:14
fungibut for example nova's playbooks directory is world-writeable on ze10 but in my local clone checked out to origin/master it is not17:14
pabelangerfungi: but all of nova's directories on ze10 is 777 right?17:16
pabelangerif so, I think we can use the find command17:16
pabelangerhowever, if this gets more complicated, maybe juts easier to have stop other executors and have zuul reclone to be safe17:17
funginot all of nova's directories are, no17:17
pabelangerze01.o.o seems to have filled back up nicely17:17
*** yamahata has quit IRC17:17
pabelangerfungi: I see that too in ze02.o.o17:18
pabelangerfungi: I wonder if they were created after 3.2.0 restart and now have proper permissions17:19
fungipabelanger: anyway, testing locally, changing directory perms does not cause git to see any uncommitted change, but altering file perms does, so i think the find with -type d is safe17:19
pabelangerokay17:19
pabelangerwill proceed with that on ze02 first17:19
fungialso you might consider doing chmod 0755 rather than just 755. it's a generally safer choice as that also clears extended flags (setuid/setgid and such)17:21
pabelangersure17:21
*** tosky has quit IRC17:24
*** electrofelix has quit IRC17:39
*** e0ne has joined #openstack-infra17:42
*** dave-mccowan has quit IRC17:44
pabelangerfungi: okay, all executors have had find command run17:45
pabelangerchecking random jobs to confirm things are still good17:45
AJaegerdhellmann: what's going on with https://review.openstack.org/#/c/594349/1 ? Looks like pilot error - any idea who pushed that one?17:49
*** jamesmcarthur has joined #openstack-infra17:49
dhellmannI do not know who that person is17:49
AJaegerthat's what I feared ;(17:50
AJaegerconfig-core, https://review.openstack.org/593938 is ready for python3-first, please review17:52
AJaegerconfig-core, couple more changes ready to merge: https://review.openstack.org/593606 https://review.openstack.org/592576 https://review.openstack.org/592474 . Please review17:53
*** trown|lunch is now known as trown17:53
AJaegerfungi, as election official could you review https://review.openstack.org/#/c/587631/ and the dependency (plus those on top of it), please?17:53
fungiAJaeger: o17:54
fungier17:54
*** portdirect has quit IRC17:54
fungiAJaeger: i'm not currently an election official, but happy to review it as an upcoming tc candidate17:54
pabelangerthe good new with all the dynamic reconfiguration zuul is doing with python3-first topic, memory still looks great: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=392&rra_id=all17:54
pabelangerif anything, there is a slight bump in memory usage this week17:54
AJaegerfungi: still have election +2? the dependency needs review first...17:54
fungii do not have +2 on the election repo, no17:55
fungitonyb: persia: ^17:55
fungidiablo_rojo can too, but i don't see her in here right now17:55
*** diablo_rojo has joined #openstack-infra17:56
AJaegerpersia: https://review.openstack.org/#/c/587632/ is the change we talk about - plus the two on top of it. Those are just job changes and look fine to me ;)17:56
AJaeger3 election officials - and one of them proposed the changes, so waiting for the other two to review. diablo_roja gave her +2s already...17:56
AJaegerfungi: thanks17:56
AJaegerpabelanger: wow, that looks nice. Great work of zuul devs!17:57
AJaegerpabelanger: with all those python3-first, I want to get our queue small to avoid conflicts...17:58
*** yamahata has joined #openstack-infra17:58
* persia catches up17:59
AJaegerconfig-core, these are ready as well: https://review.openstack.org/592251 https://review.openstack.org/592671 https://review.openstack.org/59229017:59
AJaegerthanks, persia !17:59
*** apetrich has joined #openstack-infra18:02
AJaegerdmsimard, pabelanger  what to do with https://review.openstack.org/571919 ? Looking at pabelanger's comment, I suggest to abandon - but I see clarkb's +2 as well...18:03
pabelangerAJaeger: no, we can abandon it I think18:03
AJaegerdmsimard: are you around and want to do so?18:04
pabelanger-1 with comment18:04
pabelangernodes come online in 30secs in most clouds18:05
pabelanger4.5mins for rackspace18:05
AJaegerthanks18:05
*** jamesmcarthur has quit IRC18:08
dmsimardAJaeger, pabelanger: I have no strong opinion, iirc it was in the context that there was almost a 50/50 ratio between ubuntu and centos jobs back at the time and we were more aggressive on pre-provisioning ubuntu nodes18:08
AJaegerwow, 333 changes in check queue? We're busy today...18:08
dmsimardsee "in-use nodes" http://grafana.openstack.org/d/rZtIH5Imz/nodepool?orgId=118:08
pabelangerdmsimard: AJaeger: I think fixing the launch errors from provider will be more helpful to be honest. then we get move nodes online18:09
AJaegerfungi:  can you now +2A the election change, please? - https://review.openstack.org/#/c/587631/18:09
pabelangernodepool will schedule node requests in order they arrive18:09
*** jbadiapa has joined #openstack-infra18:09
mordreddhellmann, AJaeger: just to double-check my understanding - when python3-first patches arrive on my repos and are green, I'm clear for merging them, right? (I believe that is what I understand from the docs, but I'm having a gun-shy moment, so wanted to double-check)18:12
dmsimardpabelanger: sure, anyway it's not a significant patch or anything -- we can bump it later if need be18:12
AJaegermordred: yes, go ahead. If you want me to double check something, tell me...18:13
dhellmannmordred : yes, go for it if you're ready18:13
dhellmannmordred : although I do not know the person who proposed those, so I was going to review them carefully18:13
dhellmannI'll try to do that this afternoon18:13
AJaegermordred: os-service-types?  5 changes on top of each other with duplicates- I gave some -1s ;(18:17
mordreddhellmann: awesome. yay fr unknown humans18:17
mordredAJaeger: yah - wel - they are each doing different things and just have bad subject lines18:18
mordredbut yeah18:18
dhellmanna blessing and a curse, in this case, but yeah, more hands is good18:18
AJaegerdhellmann: again something odd https://review.openstack.org/#/c/594286/1/.zuul.yaml18:21
openstackgerritMerged openstack-infra/project-config master: Adding jobs for qinling-dashboard  https://review.openstack.org/59225118:21
AJaegerdhellmann: is everybody gone crazy and pushing changes everywhere? Seems your little project team grown in an uncoordinated way ;(18:22
dhellmannyeah, I don't know who these people are18:22
AJaegeroh fun...18:23
openstackgerritMerged openstack-infra/project-config master: Remove job config for openstack/election  https://review.openstack.org/58763118:26
*** dave-mccowan has joined #openstack-infra18:30
mtreinishdhellmann: heh, they probably figured out that it's a good way to pad stats18:30
dhellmannAJaeger : http://lists.openstack.org/pipermail/openstack-dev/2018-August/133610.html18:31
AJaegerdhellmann: thanks!18:33
AJaegermordred, dhellmann, also those patches are not complete - I'm missing the project-config ones ;(18:34
dhellmannthe script doesn't propose that one, so I'm not surprised18:34
AJaegerah - "untrainted folks"18:34
dhellmannI wonder if these are being garbled because they had to convert the gerrit remote to https, and that got messed up18:35
*** dave-mccowan has quit IRC18:35
AJaegerconfig-core, https://review.openstack.org/593938 is ready for python3-first, please review.18:36
AJaegerdhellmann: or run the script twice?18:36
dhellmannmaybe18:36
dhellmannit shouldn't produce duplicate patches18:36
dhellmannan older version of the propose script did not explicitly say which branch to run git-review against, and when the .gitreview file hadn't been merged in a stable branch those patches were proposed against master18:37
*** NobodyCam has quit IRC18:37
*** zxiiro has quit IRC18:37
*** lamt has quit IRC18:37
*** kklimonda has quit IRC18:37
*** Adri2000 has quit IRC18:37
*** gtmanfred has quit IRC18:37
*** wendar has quit IRC18:37
*** vkmc has quit IRC18:37
*** jokke_ has quit IRC18:37
*** admcleod has quit IRC18:37
*** ttx has quit IRC18:37
*** kencjohnston has quit IRC18:37
*** zer0c00l has quit IRC18:37
*** fungi has quit IRC18:37
*** `Kevin has quit IRC18:37
dhellmannbut that wouldn't explain them showing up in series like these are18:37
dhellmannso I have no idea what they've done18:37
AJaeger;(18:37
*** kencjohnston_ has joined #openstack-infra18:38
*** vkmc has joined #openstack-infra18:40
*** fbouliane has quit IRC18:42
*** kota_ has quit IRC18:42
*** TheJulia has quit IRC18:42
*** shoogz has quit IRC18:42
*** tobberydberg has quit IRC18:42
*** dougwig has quit IRC18:42
*** hrybacki has quit IRC18:42
*** mnaser has quit IRC18:42
*** asilenkov has quit IRC18:42
*** therve has quit IRC18:42
dhellmannAJaeger : I think you're right. Looking at the content of the changes, it seems the tools were run on the same repos twice.18:43
AJaegerah :(18:46
*** jrist has quit IRC18:46
*** kota_ has joined #openstack-infra18:46
*** shoogz has joined #openstack-infra18:46
*** admcleod has joined #openstack-infra18:47
*** fungi has joined #openstack-infra18:48
openstackgerritAndreas Jaeger proposed openstack-infra/zuul master: Update docs build job  https://review.openstack.org/59451018:48
*** zxiiro has joined #openstack-infra18:50
*** eharney has quit IRC18:52
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Use tox docs for zuul publishing  https://review.openstack.org/59451318:52
*** rosmaita has joined #openstack-infra18:53
fungiinfra meeting in 4 minutes18:56
fungidid anyone actually volunteer to chair this week?18:56
*** e0ne has quit IRC18:57
openstackgerritAndreas Jaeger proposed openstack-infra/nodepool master: Update docs build job  https://review.openstack.org/59451718:59
*** eharney has joined #openstack-infra18:59
*** priteau has quit IRC19:00
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour19:00
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Add iptables role  https://review.openstack.org/59397319:02
*** TheJulia has joined #openstack-infra19:03
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-sphinx master: Update docs build job  https://review.openstack.org/59451819:05
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Use tox docs for zuul publishing  https://review.openstack.org/59451319:05
openstackgerritAndreas Jaeger proposed openstack-infra/zuul master: Update docs build job  https://review.openstack.org/59451019:07
*** mnaser has joined #openstack-infra19:07
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-sphinx master: Update docs build job  https://review.openstack.org/59451819:08
openstackgerritAndreas Jaeger proposed openstack-infra/nodepool master: Update docs build job  https://review.openstack.org/59451719:10
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-base-jobs master: Update docs build job  https://review.openstack.org/59452119:11
*** jamesmcarthur has joined #openstack-infra19:11
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Update docs build job  https://review.openstack.org/59452219:12
*** jamesmcarthur has quit IRC19:15
*** rpioso|afk is now known as rpioso19:17
*** bnemec has quit IRC19:20
*** bnemec has joined #openstack-infra19:20
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Add snmpd role and add it to base  https://review.openstack.org/59396919:22
*** r-daneel has quit IRC19:24
*** r-daneel has joined #openstack-infra19:24
*** armax has quit IRC19:31
*** armax has joined #openstack-infra19:33
*** melwitt has quit IRC19:33
*** sdake has quit IRC19:33
*** mancdaz has quit IRC19:34
*** _Cyclone_ has quit IRC19:34
*** igormarnat has quit IRC19:34
*** melwitt has joined #openstack-infra19:34
*** _Cyclone_ has joined #openstack-infra19:34
*** sdake has joined #openstack-infra19:34
*** bstinson has quit IRC19:39
*** jmorgan1 has quit IRC19:39
*** evrardjp has quit IRC19:39
*** bradm has quit IRC19:39
*** eventingmonkey has quit IRC19:39
*** pcarver has quit IRC19:39
*** jistr|off has quit IRC19:39
*** cgoncalves has quit IRC19:39
*** timothyb89 has quit IRC19:39
*** rodrigods has quit IRC19:39
*** jillr has quit IRC19:39
*** scas has quit IRC19:39
*** mriedem is now known as mriedem_afk19:39
*** sambetts|afk has quit IRC19:42
*** jillr has joined #openstack-infra19:46
*** eventingmonkey has joined #openstack-infra19:46
*** dirk has quit IRC19:46
*** samueldmq has quit IRC19:46
*** cgoncalves has joined #openstack-infra19:46
*** bstinson has joined #openstack-infra19:47
*** jistr has joined #openstack-infra19:47
*** Tengu has quit IRC19:47
*** onovy has quit IRC19:48
*** samueldmq has joined #openstack-infra19:49
*** onovy has joined #openstack-infra19:54
*** studarus has joined #openstack-infra19:58
*** eharney has quit IRC19:59
studaruspabelander: got your tweet! recurring issue solved for now. ovswitch appears to be leaking file descriptors slowly...20:00
studaruspabelanger: ^^^^20:01
pabelangerstudarus: aweomse! Thanks for looking20:01
studarusif anyone has ideas why ovswitch leaks file descriptors - let me know...20:02
pabelangerstudarus: which OS are you using?20:03
*** r-daneel has quit IRC20:03
*** r-daneel has joined #openstack-infra20:03
studarusUbuntu - but I spun up some CentOS and they had the same behavior20:03
pabelangernot sure, we didn't use ovs in infracloud20:04
cmurphyany config-core interested in pushing https://review.openstack.org/593606 through so we can get this release rolling?20:04
studarusI'm going to time the fd usage and see if the leak happens over the weekend when Zuul is quiet...20:04
pabelangermnaser: maybe you know?^20:04
openstackgerritDoug Hellmann proposed openstack-infra/openstack-zuul-jobs master: move legacy requirements jobs to the requirements repository  https://review.openstack.org/59453920:04
AJaegerconfig-core, Could I get some reviews for https://review.openstack.org/#/c/593938/ and https://review.openstack.org/594159, please?20:07
*** Tahvok_ has joined #openstack-infra20:12
*** beisner_ has joined #openstack-infra20:12
*** gmann_ has joined #openstack-infra20:13
openstackgerritDavid Shrewsbury proposed openstack-infra/system-config master: Add timezone role  https://review.openstack.org/59454220:13
Shrewsmordred: corvus: took a shot ^^^20:13
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove job settings for requirements repositories  https://review.openstack.org/59366020:13
openstackgerritMerged openstack-infra/project-config master: Add publish-to-pypi job to keystone-tempest-plugin  https://review.openstack.org/59360620:13
Shrewsmordred: corvus: though i'm not clear on what section it belongs in in base.yaml20:13
mordredShrews: nice (that's too easy)20:14
*** jaosorior_ has joined #openstack-infra20:14
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove job settings for requirements repositories  https://review.openstack.org/59366020:14
openstackgerritDavid Shrewsbury proposed openstack-infra/system-config master: Add timezone role  https://review.openstack.org/59454220:17
*** jaosorior has quit IRC20:17
*** ddurst- has joined #openstack-infra20:18
*** edmondsw_ has joined #openstack-infra20:18
*** Tahvok has quit IRC20:19
*** edmondsw has quit IRC20:19
*** beisner has quit IRC20:19
*** AJaeger has quit IRC20:19
*** ddurst has quit IRC20:19
*** gmann has quit IRC20:19
*** edmondsw_ is now known as edmondsw20:19
*** gmann_ is now known as gmann20:19
*** Tahvok_ is now known as Tahvok20:19
*** beisner_ is now known as beisner20:19
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove job settings for requirements repositories  https://review.openstack.org/59366020:22
*** jamesmcarthur has joined #openstack-infra20:22
openstackgerritDoug Hellmann proposed openstack-infra/openstack-zuul-jobs master: move legacy requirements jobs to the requirements repository  https://review.openstack.org/59453920:23
*** AJaeger has joined #openstack-infra20:23
pabelangerAJaeger: fungi: just to follow up, I don't see anymore ansible warnings about world-readable directories! I think we are good on zuul-executor front20:24
fungiawesome20:24
fungithanks for fixing that!20:24
ianwpabelanger: haha, i noticed that in the linting jobs and was going to look into that ... love it when a problem "fixes itself" (via hard work of others :)20:25
pabelangerianw: indeed20:26
*** studarus has quit IRC20:26
*** jamesmcarthur has quit IRC20:26
*** kgiusti has left #openstack-infra20:27
*** hashar has joined #openstack-infra20:30
corvuspabelanger: thanks!20:33
ianwmordred / corvus : for review purposes, what was the decision on roles in system-config?  generic things at roles/* and other things at playbooks/roles?20:35
ianwi think we ruled out everything at roles/* ... so that leaves everything under playbooks as the other option20:36
mordredI think it's gonna be a mix of both20:37
*** scas has joined #openstack-infra20:37
mordredianw: so - yeah , the first thing you said20:38
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Transfer iptables rules to ansible  https://review.openstack.org/59434020:40
ianwmordred: ok.  if you like, i can help split up your role movement change and make sure it works with documentation etc, as i've been knee deep it yesterday20:40
openstackgerritMonty Taylor proposed openstack-infra/system-config master: iptables: factor out snmp rules  https://review.openstack.org/59443720:40
openstackgerritMonty Taylor proposed openstack-infra/system-config master: iptables: add a README  https://review.openstack.org/59443820:40
mordredianw: please do!20:40
mordredcorvus, fungi, ianw: we should probably land the cron job patch and get it applied20:42
ianwmordred: will do updates this morning20:42
*** rosmaita has quit IRC20:43
mordredhttps://review.openstack.org/#/c/591152/ <--20:43
ianwhappy to have cronjob change landed, i'm around20:43
*** ansmith has quit IRC20:43
*** holser_ has quit IRC20:44
corvus+320:45
mordred\o/20:45
ianwmordred/corvus: given discussions, getting https://review.openstack.org/593477 & https://review.openstack.org/579474 into zuul-sphinx + a release would make things a little smoother20:47
corvusianw: i'll look at that now20:48
corvusianw: what's the 'html' mean in there?20:49
ianwcorvus: regenerate the html pages when the config option changes20:49
corvusianw: interesting.  change lgtm -- do you think we should exercise it?  we can add it to its own doc build config to test it20:50
ianwcorvus: on the utf-8 thing, see https://review.openstack.org/#/c/593478/ for where it's used.  in a follow-on i move it all to python3, but since zuul-jobs has a python2 support policy i guess we should do something about it20:51
corvusianw: https://zuul-ci.org/docs/zuul-sphinx/20:51
corvusianw: (all those examples are really tests of a sort)20:51
ianwcorvus: agree could add it to the repo, i did test it via a manual requirements.txt override in one of the other changes if i can find it, before we decided to move20:54
*** jamesmcarthur has joined #openstack-infra20:58
openstackgerritMonty Taylor proposed openstack-infra/storyboard-webclient master: Remove grunt-contrib-less  https://review.openstack.org/59455021:00
openstackgerritMerged openstack-infra/zuul-sphinx master: Open role readme files in utf-8 mode  https://review.openstack.org/57947421:01
*** harlowja has joined #openstack-infra21:02
*** mriedem_afk is now known as mriedem21:04
*** trown is now known as trown|outtypewww21:07
*** hashar has quit IRC21:12
openstackgerritMerged openstack-infra/system-config master: Start running puppet cron on bridge.openstack.org  https://review.openstack.org/59115221:16
openstackgerritMerged openstack-infra/storyboard-webclient master: Update fontawesome to version 5  https://review.openstack.org/54567621:17
openstackgerritMerged openstack-infra/storyboard-webclient master: Make board and worklist icons unique  https://review.openstack.org/54567721:17
openstackgerritMerged openstack-infra/storyboard-webclient master: Convert less to scss  https://review.openstack.org/37959521:17
openstackgerritMerged openstack-infra/storyboard-webclient master: Redesign the sidebar to neaten code and improve contrast  https://review.openstack.org/54901021:21
*** rh-jelabarre has quit IRC21:22
openstackgerritMerged openstack-infra/storyboard-webclient master: Reduce the number of items in the sidebar  https://review.openstack.org/54905921:24
openstackgerritMerged openstack-infra/storyboard-webclient master: Make the page background less bright  https://review.openstack.org/54921021:24
openstackgerritMerged openstack-infra/storyboard-webclient master: Add a drop shadow beneath the header navbar  https://review.openstack.org/54921121:24
openstackgerritMerged openstack-infra/storyboard-webclient master: Add shadow to board lanes  https://review.openstack.org/54921221:24
openstackgerritMerged openstack-infra/storyboard-webclient master: Redesign dashboard to reduce clutter  https://review.openstack.org/54933321:25
mordredinfra-root: ok - cron patch landed, I'm going to pull system-config and run the bridge playbook to enable it21:26
openstackgerritMerged openstack-infra/storyboard-webclient master: Improve appearance of search bars  https://review.openstack.org/58867521:26
mordredinfra-root: cronjob has been sucessfully installed - we are now live with bridge.o.o21:28
mordredwe should now see a run of run_all here in a minute or so21:29
mordredI've started a tail of ansible.log in the screen session21:29
openstackgerritMerged openstack-infra/zuul-sphinx master: Add config option to find other roles  https://review.openstack.org/59347721:30
*** ansmith has joined #openstack-infra21:38
ianwcorvus: ok with a 0.2.3 release for ^ ?21:38
corvusianw: yeah, i'll push that now21:39
ianwgreat, thanks21:40
*** jamesmcarthur has quit IRC21:48
openstackgerritIan Wienand proposed openstack-infra/system-config master: playbooks/roles/exim: remove "true" filter plugin  https://review.openstack.org/59399821:49
*** jamesmcarthur has joined #openstack-infra21:50
openstackgerritIan Wienand proposed openstack-infra/system-config master: Move tox basepython to top-level  https://review.openstack.org/59398221:51
*** sshnaidm is now known as sshnaidm|afk21:51
openstackgerritIan Wienand proposed openstack-infra/system-config master: Update to latest docs PTI  https://review.openstack.org/59348321:52
*** jamesmcarthur_ has joined #openstack-infra21:52
*** jamesmcarthur_ has quit IRC21:55
*** jcoufal has quit IRC21:55
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Set path in cron so we can find ansible-playbook  https://review.openstack.org/59455421:55
*** jamesmcarthur has quit IRC21:55
mordredcorvus, ianw: ^^21:55
corvusmordred: should that be part of the next task rather than its own task?21:56
*** jamesmcarthur has joined #openstack-infra21:56
mordredcorvus: no, it does not appear so21:58
mordredcorvus: https://docs.ansible.com/ansible/2.6/modules/cron_module.html21:58
mordredI could totally be reading that wrong though21:58
corvusmordred: no, i guess that makes sense given the crontab file syntax21:59
ianwor it could go in run_all.sh , but i guess it's hard to think of another context it runs in that /usr/local won't be in path21:59
*** jamesmcarthur has quit IRC22:01
ianw"This module is flagged as preview" ... maybe nobody uses cron these days22:01
*** boden has quit IRC22:03
corvusianw: they're just waiting to make sure this "cron" thing isn't a fad22:03
*** boden has joined #openstack-infra22:03
*** boden has quit IRC22:03
*** boden has joined #openstack-infra22:04
*** boden has quit IRC22:04
*** jamesmcarthur has joined #openstack-infra22:04
*** boden has joined #openstack-infra22:05
*** boden has quit IRC22:05
*** boden has joined #openstack-infra22:05
*** boden has quit IRC22:06
*** boden has joined #openstack-infra22:06
*** boden has quit IRC22:07
*** tosky has joined #openstack-infra22:07
*** boden has joined #openstack-infra22:07
*** boden has quit IRC22:07
*** jamesmcarthur has quit IRC22:08
*** boden has joined #openstack-infra22:08
*** boden has quit IRC22:08
*** boden has joined #openstack-infra22:08
ianwi trigger all my periodic jobs via a very simple protobuf based containerised nodejs microservice22:09
*** boden has quit IRC22:09
*** boden has joined #openstack-infra22:09
*** boden has quit IRC22:10
*** boden has joined #openstack-infra22:10
*** boden has quit IRC22:10
*** rcernin has joined #openstack-infra22:10
*** boden has joined #openstack-infra22:11
*** boden has quit IRC22:11
*** boden has joined #openstack-infra22:12
*** boden has quit IRC22:12
*** boden has joined #openstack-infra22:12
*** boden has quit IRC22:13
*** boden has joined #openstack-infra22:13
*** boden has quit IRC22:14
fungi~how hipster of you22:14
mnaserLol22:15
ianwfungi: me rn -> https://i.redd.it/hxsjhsmurch11.jpg22:19
ianw(this was "reddit admins updating again", I lol because I couldn't tell if genuine 80's photo or hipster 2018)22:19
*** mriedem is now known as mriedem_away22:22
fungidual-screen!!!22:23
*** rkukura has joined #openstack-infra22:33
*** diablo_rojo has quit IRC22:44
*** jtomasek_ has quit IRC22:47
*** diablo_rojo has joined #openstack-infra22:48
openstackgerritMerged openstack-infra/storyboard-webclient master: Remove grunt-contrib-less  https://review.openstack.org/59455022:50
*** tpsilva has quit IRC22:58
dimsLOL fungi23:01
*** tosky has quit IRC23:07
*** r-daneel has quit IRC23:09
openstackgerritKeiichi Hikita proposed openstack-infra/project-config master: Add translation job to zuul.d/projects.yaml  https://review.openstack.org/59407023:25
openstackgerritIan Wienand proposed openstack-infra/system-config master: run_all.sh: add timestamp  https://review.openstack.org/59456823:35
ianwmordred: ^ but cron seems to be running things ok now23:36
ianwoh hang on, i think i looked at the wrong file, cron hasn't run it yet23:38
*** jamesmcarthur has joined #openstack-infra23:39
openstackgerritMerged openstack-infra/system-config master: Set path in cron so we can find ansible-playbook  https://review.openstack.org/59455423:40
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Create tox_revoke_sudo variable for tox job.  https://review.openstack.org/59456923:41
*** jamesmcarthur has quit IRC23:44
openstackgerritPaul Belanger proposed openstack-infra/zuul-jobs master: Create tox_revoke_sudo variable for tox job.  https://review.openstack.org/59456923:48
openstackgerritMerged openstack-infra/system-config master: Update to latest docs PTI  https://review.openstack.org/59348323:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!