| *** lukebrowning has joined #openstack-infra | 00:06 | |
| *** lukebrowning has quit IRC | 00:10 | |
| *** Guest62992 has quit IRC | 00:10 | |
| *** lamt has joined #openstack-infra | 00:11 | |
| *** lukebrowning has joined #openstack-infra | 00:12 | |
| *** lukebrowning has quit IRC | 00:17 | |
| *** lukebrowning has joined #openstack-infra | 00:19 | |
| ianw | curl: (28) Resolving timed out after 10529 milliseconds | 00:22 |
|---|---|---|
| ianw | http://logs.openstack.org/83/526583/1/check/dib-dsvm-functests-python3/632bbd9/job-output.txt.gz#_2017-12-17_23_37_29_046348 | 00:22 |
| *** lukebrowning has quit IRC | 00:23 | |
| ianw | dmsimard: what ever happened to those roles to stamp the provider, ip address, etc etc into the start of the job logs? | 00:23 |
| *** lukebrowning has joined #openstack-infra | 00:25 | |
| *** Krenair has quit IRC | 00:25 | |
| *** lukebrowning has quit IRC | 00:30 | |
| *** lukebrowning has joined #openstack-infra | 00:31 | |
| *** Krenair has joined #openstack-infra | 00:31 | |
| *** lukebrowning has quit IRC | 00:36 | |
| *** lukebrowning has joined #openstack-infra | 00:38 | |
| *** salv-orlando has joined #openstack-infra | 00:40 | |
| *** lukebrowning has quit IRC | 00:43 | |
| *** lukebrowning has joined #openstack-infra | 00:44 | |
| *** salv-orlando has quit IRC | 00:45 | |
| *** lukebrowning has quit IRC | 00:50 | |
| *** lukebrowning has joined #openstack-infra | 00:51 | |
| *** psachin has joined #openstack-infra | 00:54 | |
| *** lukebrowning has quit IRC | 00:56 | |
| *** lukebrowning has joined #openstack-infra | 00:57 | |
| dmsimard | ianw: there's a wip revert, haven't had the chance to get back to it | 00:58 |
| dmsimard | The problem is that some vars are not available if you run from localhost | 00:59 |
| dmsimard | Like the nodepool provider etc | 00:59 |
| dmsimard | I meant to look at a broader level how we planned on adressing this since different drivers (static, OCI, openstack, etc) would have different reprensentation of that data | 01:00 |
| dmsimard | Should probably drop that and just default to none if they're not there for the time being | 01:00 |
| *** lukebrowning has quit IRC | 01:02 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test https://review.openstack.org/528130 | 01:04 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version https://review.openstack.org/528156 | 01:04 |
| *** StevenK has quit IRC | 01:08 | |
| *** rm_work has quit IRC | 01:08 | |
| *** kiennt26 has joined #openstack-infra | 01:08 | |
| *** rm_work has joined #openstack-infra | 01:09 | |
| *** lukebrowning has joined #openstack-infra | 01:10 | |
| *** ihrachys_ has quit IRC | 01:10 | |
| *** basilb662 has joined #openstack-infra | 01:11 | |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETywmdtquyrg: signed8bit_Zzz jonher ianychoi Wei_Liu gouthamr yolanda lihi rkukura sambetts_ kzaitsev_pi alex_xu sbezverk quite lukebrowning hemna_ caphrim007 mordred jrist logan- lamt dhill_ kukacz di | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETmpngdcqcjn: stakeda hjensas bauzas jonher markvoelker dbecker oanson rcernin sbezverk xinliang adreznec kukacz lukebrowning d0ugal_ mordred yolanda pbourke ianychoi gouthamr caphrim007 logan- quite mtreinish jascott1 vivsoni dimak Wei_Liu lifeless Krenair kzaitsev_pi l | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETorgat: bauzas lamt Wei_Liu markvoelker oanson logan- kukacz jascott1 jrist apetrich gouthamr yolanda adreznec hemna_ kiennt26 leyal psachin lihi tushar rm_work hjensas quite mtreinish Swimi | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETzrnmoejaqi: hjensas rcernin yolanda lukebrowning lifeless markvoelker alex_xu xinliang gouthamr dbecker kukacz Krenair kiennt26 abelur_ quite lamt rm_work kzaitsev_pi dhill_ jonher rkukura vivsoni d0ugal_ sambetts_ numans psachin hemna_ jrist bauzas caphrim00 | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETmspwdvylkv: jrist hjensas kiennt26 dhill_ caphrim007 jascott1 sbezverk stakeda d0ugal_ alex_xu mordred Wei_Liu rcernin sambetts_ Krenair apetrich tushar dbecker efried_cya_jan lifeless raissa rm_work lihi Swimingly vivsoni yolanda abelur_ ianychoi lamt logan- kukacz dimak xinliang mtreini | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETguxhob: xinliang jrist lifeless adreznec numans pbourke abelur_ rkukura lukebrowning hemna_ Krenair bauzas lihi d0ugal_ Swimingly rcernin oanson yolanda gouthamr tushar caphrim007 markvoelker stakeda logan- quite leyal dhill_ mordred efried_cya_jan raissa viv | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETkrzfcuzuz: kzaitsev_pi jascott1 raissa vivsoni jrist kiennt26 hemna_ yolanda leyal numans dbecker Swimingly markvoelker stakeda abelur_ quite sbezverk xinliang d0ugal_ signed8bit_Zzz bauzas dimak pbo | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETqfnytjwt: kzaitsev_pi leyal efried_cya_jan bauzas quite abelur_ sbezverk gouthamr logan- lamt psachin kukacz mordred oanson hjensas raissa Krenair jrist alex_xu caphrim007 signed8bit_Zzz Swimingly lukebrowning jascott1 Wei_Liu markvoelker yolanda lihi rkukura d0ugal_ hemna_ stakeda numans | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETnksmp: numans markvoelker pbourke lukebrowning jrist psachin dimak tushar lihi kukacz mtreinish quite lifeless efried_cya_jan hjensas signed8bit_Zzz gouthamr logan- xinliang bauzas dbecker ianychoi rkukura alex_xu sbezverk Krenair dhill_ stakeda mordred jonher rm_work | 01:11 |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETdxpkk: Krenair Swimingly leyal psachin quite gouthamr jascott1 logan- d0ugal_ abelur_ adreznec oanson markvoelker lihi mordred kukacz sbezverk lifeless pbourke raissa lukebrowning hemna_ sambetts_ rm_work xinliang dbecker lamt hjensas jrist mtreinish alex_xu | 01:12 |
| *** StevenK has joined #openstack-infra | 01:12 | |
| *** ChanServ sets mode: +o mordred | 01:12 | |
| basilb662 | ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ https://www.youtube.com/watch?v=--jYqzJErTI LRH IS LIVE NOW!! CALL 415-349-5666 #LRH EFNETaikvg: rm_work ianychoi bauzas gouthamr jonher xinliang jrist caphrim007 lamt Swimingly apetrich quite tushar dhill_ lihi Krenair Wei_Liu yolanda efried_cya_jan abelur_ lifeless mtreinish d0ugal_ raissa lukebrowning num | 01:12 |
| *** mordred sets mode: +b *!*@68.58.107.72 | 01:12 | |
| *** basilb662 was kicked by mordred (basilb662) | 01:12 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test https://review.openstack.org/528130 | 01:12 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version https://review.openstack.org/528156 | 01:12 |
| *** lukebrowning has quit IRC | 01:15 | |
| openstackgerrit | zhongshengping proposed openstack-infra/project-config master: Remove legacy jobs from puppet openstack modules https://review.openstack.org/526983 | 01:17 |
| dmsimard | Those spambots are annoying, saw a few today across different channels from ansible to openstack | 01:18 |
| bkero | They are still going on | 01:18 |
| bkero | in #openstack-kolla and #osuosl at least | 01:18 |
| dmsimard | I wonder if freenode staff is aware.. | 01:18 |
| dmsimard | It's sunday so.. | 01:18 |
| bkero | Monday in some parts of the world | 01:19 |
| *** signed8bit_Zzz is now known as signed8b_ | 01:19 | |
| fungi | yeah, they seem to be aware because i saw a couple part channels with a k-line messae | 01:19 |
| fungi | message | 01:19 |
| fungi | i got pinged by them on at least a dozen channels so far | 01:19 |
| *** signed8b_ has quit IRC | 01:19 | |
| fungi | the one that just now parted #openstack-horizon was k-lined | 01:20 |
| fungi | so i expect netops must be playing whack-a-mole with the offenders | 01:20 |
| fungi | i've akicked them on a few channels where i've caught them before someone else | 01:21 |
| *** gouthamr has quit IRC | 01:21 | |
| fungi | #status log Slowly deleting 4161 "jenkins" verify -1 votes from open changes in Gerrit with a 1-second delay between each | 01:22 |
| openstackstatus | fungi: finished logging | 01:22 |
| dmsimard | apparently in #freenode they seem to be suggesting enabling a channel mode to prevent unregistrered users from joining | 01:22 |
| fungi | infra-root: ^ in case you notice anything weird with gerrit or zuul load | 01:22 |
| ianw | fungi: i was like "why is fungi reviewing random devstack changes on a sunday" :) | 01:24 |
| fungi | dmsimard: yeah, it's a question of which is less user-friendly... preventing our users who can barely figure out irc (much less nickserv registration) from joining our channels, or blasting them with potentially offensive spam when they do | 01:24 |
| *** lukebrowning has joined #openstack-infra | 01:24 | |
| bkero | There's also the difference of doing that permanently or just until the spam wave subsides. | 01:25 |
| *** cuongnv has joined #openstack-infra | 01:25 | |
| *** cuongnv has quit IRC | 01:26 | |
| *** cuongnv has joined #openstack-infra | 01:27 | |
| *** daidv has joined #openstack-infra | 01:27 | |
| *** namnh has joined #openstack-infra | 01:27 | |
| openstackgerrit | dongwenjuan proposed openstack-infra/puppet-openstackci master: add `git_source_repo` parameter for zuul_scheduler https://review.openstack.org/528594 | 01:28 |
| *** lukebrowning has quit IRC | 01:29 | |
| *** lukebrowning has joined #openstack-infra | 01:30 | |
| dmsimard | infra-root, there's a definitive spam wave around -- freenode k-lines ASAP but all our users are getting spammed with hateful messages. They recommend enabling mode "r" for channels which prevents unregistered users from joining | 01:32 |
| openstackgerrit | dongwenjuan proposed openstack-infra/puppet-openstackci master: add `git_source_repo` parameter for zuul_scheduler https://review.openstack.org/528594 | 01:33 |
| *** daidv has quit IRC | 01:33 | |
| dmsimard | Some unsupervised channels have it particularly bad: http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/latest.log.html | 01:33 |
| *** lukebrowning has quit IRC | 01:35 | |
| *** namnh has quit IRC | 01:36 | |
| *** ChanServ sets mode: +o dmsimard | 01:36 | |
| *** dmsimard sets mode: +r | 01:36 | |
| prometheanfire | ya, I've seen it in non registered mode channels | 01:39 |
| dmsimard | #status log (dmsimard) enabled mode +r to prevent unregistered users from joining channels hit by spam bots: #openstack-ansible, #openstack-dev, #openstack-infra, #openstack-kolla, #openstack-operators, #puppet-openstack, #rdo | 01:40 |
| openstackstatus | dmsimard: finished logging | 01:40 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test https://review.openstack.org/528130 | 01:40 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version https://review.openstack.org/528156 | 01:40 |
| andymccr | keystone, cinder and telemetry chans still getting hit i think. | 01:40 |
| ianw | openstack-release is pretty bad too | 01:40 |
| dmsimard | ok looking | 01:41 |
| andymccr | thanks dmsimard! | 01:41 |
| *** lukebrowning has joined #openstack-infra | 01:42 | |
| dmsimard | ok, took care of those too. | 01:43 |
| cuongnv | dmsimard: openstack-neutron is getting hit quite badly too | 01:43 |
| *** chrisyang_0660 has joined #openstack-infra | 01:43 | |
| dmsimard | cuongnv: thanks, clear | 01:44 |
| cuongnv | thanks dmsimard | 01:44 |
| dmsimard | #status notice The freenode network is currently the target of automated spam attacks, we have enabled temporary restrictions on targetted OpenStack channels which requires users to be logged on to NickServ. If you see spam in your channel, please report it in #openstack-infra. Thanks. | 01:46 |
| openstackstatus | dmsimard: sending notice | 01:46 |
| *** lukebrowning has quit IRC | 01:46 | |
| -openstackstatus- NOTICE: The freenode network is currently the target of automated spam attacks, we have enabled temporary restrictions on targetted OpenStack channels which requires users to be logged on to NickServ. If you see spam in your channel, please report it in #openstack-infra. Thanks. | 01:47 | |
| rcernin | spam in #tripleo | 01:48 |
| tonyb | LOL, now they've started with private messages :( | 01:48 |
| ianw | dmsimard: can you try kicking the bot in openstack-requirements? some chatter seems to suggest that's enough | 01:48 |
| dmsimard | tonyb: you can enable a usermode to prevent that | 01:48 |
| dmsimard | tonyb: https://freenode.net/kb/answer/usermodes mode +R | 01:49 |
| openstackstatus | dmsimard: finished sending notice | 01:49 |
| dmsimard | #status log (dmsimard) added +r to additional targetted channels: #openstack-keystone, #openstack-cinder, #openstack-telemetry, #openstack-requirements, #openstack-release, #tripleo | 01:52 |
| openstackstatus | dmsimard: finished logging | 01:52 |
| rcernin | dmsimard: they are in #openstack-qa now | 01:53 |
| dmsimard | rcernin: cleared, thanks | 01:54 |
| rcernin | thanks for the umode tip:) | 01:54 |
| dmsimard | ianw: I wonder if there's a way to easily apply modes to a bunch of channels | 01:55 |
| dmsimard | doing this by hand is... unefficient | 01:55 |
| dmsimard | like, I'd like to ban/kick a user from all channels simultaneously | 01:55 |
| johnsom | I covered lbaas, fyi | 01:55 |
| dmsimard | johnsom: thanks | 01:56 |
| ianw | dmsimard: yeah, not that i know of :/ | 01:57 |
| dmsimard | would be worthwhile to add into one of our bots | 01:58 |
| dmsimard | with the number of channels we have | 01:58 |
| ianw | i think freenode generally do a good job. i remember only very few instances of this sort of thing over quite a few years | 01:58 |
| johnsom | +1 | 01:58 |
| dmsimard | yeah, they're working hard in #freenode right now | 01:59 |
| dmsimard | but it seems like they're handling this manually | 01:59 |
| johnsom | They are in horizon now | 01:59 |
| *** ilbelkyr has joined #openstack-infra | 01:59 | |
| johnsom | I only have privilege for lbaas, so sorry I can't help more | 01:59 |
| dmsimard | johnsom: I don't see any spam in horizon ? | 02:00 |
| dmsimard | (just joined) | 02:00 |
| dmsimard | maybe the spammer got klined already | 02:00 |
| ilbelkyr | I might've hammered that one | 02:00 |
| dmsimard | ilbelkyr: ah, thanks :) | 02:00 |
| johnsom | openstack-horizon? | 02:00 |
| ilbelkyr | feel free to let me know of other channels they're hitting | 02:00 |
| dmsimard | johnsom: yeah | 02:00 |
| johnsom | Yeah, last one was a minute ago | 02:00 |
| dmsimard | ilbelkyr: we've been kickbanning them, do you need any data ? | 02:01 |
| rcernin | and now in #openstack-glance | 02:01 |
| ianychoi | #openstack-ptg channel is being attacked | 02:01 |
| johnsom | yep, there goes ptg | 02:02 |
| dmsimard | got it | 02:02 |
| *** kiennt26 has quit IRC | 02:02 | |
| johnsom | Thanks | 02:02 |
| ianychoi | thanks (2) | 02:02 |
| andymccr | openstack-meeting-4 is up next - fun times. | 02:03 |
| andymccr | haha thanks dmsimard | 02:03 |
| dmsimard | I'll go ahead and parse the list of channels we have and add +r preemptively | 02:04 |
| dmsimard | this is getting tiring | 02:04 |
| *** waynr has left #openstack-infra | 02:05 | |
| andymccr | yeah i think that makes sense. | 02:05 |
| dims | #openstack-ptg #openstack-release #openstack-meeting-cp | 02:06 |
| dmsimard | dims: I got ptg and release earlier, just got meeting-cp now. Thanks. | 02:07 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test https://review.openstack.org/528130 | 02:09 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version https://review.openstack.org/528156 | 02:09 |
| fungi | we could have just added it to the accessbot config, i'm willing to bet | 02:13 |
| dmsimard | fungi: does accessbot enforce a default set of modes ? | 02:14 |
| fungi | that's what i was checking, just sets access masks not flags | 02:15 |
| fungi | so not without some additional dev work | 02:16 |
| openstackgerrit | Merged openstack/diskimage-builder master: Check source-repository-* files for trailing newline https://review.openstack.org/526583 | 02:16 |
| dmsimard | yeah trying to see what's the best approach to get us through the night | 02:17 |
| *** lukebrowning has joined #openstack-infra | 02:18 | |
| pabelanger | Hmm, i though we managed IRC channels via a bot | 02:20 |
| pabelanger | but don't see that configuration | 02:20 |
| dmsimard | pabelanger: iirc the modes are set originally on channel registration | 02:21 |
| dmsimard | i.e, https://docs.openstack.org/infra/system-config/irc.html#access | 02:21 |
| pabelanger | ah, yah. We should consider automating that | 02:21 |
| *** Wei_Liu has quit IRC | 02:22 | |
| fungi | adding support for it to the accessbot script would make the most sense, as it already has the necessary privs | 02:23 |
| *** lukebrowning has quit IRC | 02:23 | |
| prometheanfire | ya... | 02:24 |
| *** lukebrowning has joined #openstack-infra | 02:24 | |
| dmsimard | http://git.openstack.org/cgit/openstack-infra/puppet-accessbot/tree/files/checkaccess.py or http://git.openstack.org/cgit/openstack-infra/puppet-accessbot/tree/files/accessbot.py sounds appropriate but I'm not very familiar with the context in which those are ran | 02:25 |
| fungi | just gets fired by puppet | 02:26 |
| fungi | i'm looking at chanserv help but not seeing how to get it to set channel modes | 02:27 |
| fungi | aha, set mlock | 02:28 |
| dmsimard | fungi: looks like /msg chanserv flags | 02:29 |
| dmsimard | mlock is not quite the same | 02:29 |
| fungi | nope, those are different | 02:29 |
| dmsimard | mlock prevents users from changing the flags | 02:29 |
| dmsimard | as I understand it | 02:29 |
| *** lukebrowning has quit IRC | 02:30 | |
| fungi | channel flags are not the same as channel modes though | 02:30 |
| dmsimard | ah yeah you're right .. | 02:30 |
| fungi | and mlock "allows you to enforce a set of modes" | 02:30 |
| *** lukebrowning has joined #openstack-infra | 02:31 | |
| fungi | something like /msg chanserv set #openstack-infra mlock -r | 02:31 |
| dmsimard | yeah, that would prevent me from doing +r unless I went through chanserv afaict | 02:31 |
| dmsimard | which I guess would make sense | 02:32 |
| fungi | oh +r, right | 02:32 |
| dmsimard | It's the part about looping through the different channels that we have which would make going through our bot handy | 02:32 |
| dmsimard | looked real quick if I could script it through weechat, no dice | 02:32 |
| fungi | the access "bot" script already just executes commands through privmsg to chanserv for a list of channels, so likely not hard to extend for this use case | 02:34 |
| fungi | but yeah, in the short term you could just paste a list of chanserv commands into your server buffer | 02:34 |
| dmsimard | that's genius :/ | 02:35 |
| dmsimard | (no sarcasm) | 02:35 |
| *** lukebrowning has quit IRC | 02:36 | |
| *** lukebrowning has joined #openstack-infra | 02:37 | |
| dmsimard | fungi: http://paste.openstack.org/raw/629168/ (channels from gerritbot config) | 02:40 |
| fungi | you'll want to test one of those lines just to be sure it works as intended too | 02:41 |
| fungi | but lgtm | 02:41 |
| fungi | see if it causes the channel to become mode +r | 02:42 |
| *** lukebrowning has quit IRC | 02:42 | |
| fungi | and whether -r clears it similarly | 02:43 |
| fungi | and then if the flood has subsided tomorrow, we can rerun the same list with -r to undo it | 02:43 |
| *** lukebrowning has joined #openstack-infra | 02:43 | |
| dmsimard | good idea | 02:48 |
| dmsimard | I'll try it here | 02:48 |
| *** dmsimard sets mode: -r | 02:48 | |
| *** ChanServ sets mode: +r | 02:48 | |
| dmsimard | looks like it works | 02:48 |
| dmsimard | and I can't -r | 02:48 |
| *** lukebrowning has quit IRC | 02:48 | |
| fungi | cool | 02:52 |
| dmsimard | fungi: care to +3 https://review.openstack.org/#/c/528589/ so ianw can cover through our night ? | 02:54 |
| dmsimard | #status log (dmsimard) all channels configured through gerritbot have been mlocked +r: http://paste.openstack.org/raw/629168/ we should remove this once the spam wave subsides | 02:55 |
| openstackstatus | dmsimard: finished logging | 02:55 |
| *** lukebrowning has joined #openstack-infra | 02:55 | |
| fungi | approvidado | 02:55 |
| fungi | dmsimard: itym accessbot? surely not gerritboy | 02:56 |
| fungi | t | 02:56 |
| dmsimard | thanks | 02:56 |
| fungi | just making sure | 02:56 |
| dmsimard | fungi: yeah I meant accessbot | 02:56 |
| dims | @dmsimard : thanks! | 02:57 |
| dmsimard | fungi: can I undo that? | 02:57 |
| dmsimard | fungi: I kind of still meant gerritbot (as in, the source of the channel list) | 02:57 |
| fungi | nah, you can log a correction thouh | 02:57 |
| fungi | oh, i was suggesting you should have based it on the accessbot channels list | 02:57 |
| fungi | not all our channels use gerritbot | 02:58 |
| dmsimard | hmm, let me see the delta between the two | 02:58 |
| *** lukebrowning has quit IRC | 02:59 | |
| fungi | probably just a handful, but if you're looking for an official list of channels we manage that would be the ones in the accessbot channels config | 03:00 |
| dmsimard | ah, yeah, meeting channels amongst other things | 03:00 |
| ianw | it seems in #freenode they're pretty on to the issues, but i will keep an eye here | 03:00 |
| persia | FWIW, I'm seeing a significant slowdown on traffic even on non-openstack channels with no active ops | 03:00 |
| dmsimard | persia: what do you mean by slowdown in traffic ? less spammers ? | 03:00 |
| fungi | persia: ianw: thanks for the update, hopefully it's subsiding | 03:00 |
| openstackgerrit | Merged openstack-infra/project-config master: Add myself to accessbot https://review.openstack.org/528589 | 03:01 |
| persia | dmsimard: Yes. | 03:01 |
| *** numans has quit IRC | 03:03 | |
| dmsimard | persia: thanks | 03:06 |
| persia | dmsimard: Thank you for your efforts to discourage them: my info is just confirmation that you have been part of a successful defence. | 03:06 |
| dmsimard | \o/ | 03:08 |
| dmsimard | and thank you chanserv for not disconnecting me for flood | 03:08 |
| fungi | heh | 03:10 |
| * fungi continues deleting jenkins -1 votes from open changes | 03:11 | |
| dmsimard | #status log (dmsimard) we re-ran mlock commands on OpenStack channels using the accessbot list of channels instead, here is the definitive list of channels that were made +r: http://paste.openstack.org/raw/629176/ | 03:12 |
| openstackstatus | dmsimard: finished logging | 03:12 |
| dmsimard | I'm off for now, see you tomorrow | 03:15 |
| fungi | thanks! | 03:16 |
| ianw | thanks dmsimard! | 03:16 |
| ianw | pabelanger: if you're walking by ... there was something that flew by about a better way to manage .service files from puppet in the xenial upgrade last week, but i can't remember what it was. let me know if that rings a bell | 03:17 |
| *** yamamoto has joined #openstack-infra | 03:18 | |
| mwhahaha | ianw: what's the context around the .service file thing | 03:23 |
| dmsimard | btw there seems to be a weird bug around twitter with statusbot: https://twitter.com/openstackinfra/status/942572463279562753 (see \u2026?) | 03:24 |
| *** david-lyle has joined #openstack-infra | 03:25 | |
| ianw | dmsimard: ... yay unicode :/ | 03:25 |
| ianw | mwhahaha: writing a service file for etherpad as part of the xenial upgrade | 03:26 |
| mwhahaha | ianw: i recommend camptocamp-systemd for managing any systemd stuff | 03:27 |
| mwhahaha | but not sure if that's pecific to what you're working on | 03:27 |
| mwhahaha | https://github.com/camptocamp/puppet-systemd | 03:27 |
| ianw | mwhahaha: hmmm, not looking terribly promising that we would support that in modules.env | 03:28 |
| ianw | "This is a | 03:28 |
| ianw | # potential conflict with puppet-community/puppet-archive. " | 03:28 |
| mwhahaha | weird | 03:30 |
| dmsimard | I wanted to look real quick at pre-pending names of people who issue #status commands but it's non-trivial at first glance so I'll look.. one day | 03:36 |
| * dmsimard off | 03:36 | |
| *** dmsimard sets mode: -o dmsimard | 03:36 | |
| *** lukebrowning has joined #openstack-infra | 03:37 | |
| *** lukebrowning has quit IRC | 03:42 | |
| *** lukebrowning has joined #openstack-infra | 03:43 | |
| *** ykarel has joined #openstack-infra | 03:46 | |
| *** lukebrowning has quit IRC | 03:48 | |
| ianw | i'm sure i don't want to ask why etherpad installs it's npm dependencies into /var/log ... | 03:49 |
| *** lukebrowning has joined #openstack-infra | 03:53 | |
| *** lukebrowning has quit IRC | 03:57 | |
| *** lukebrowning has joined #openstack-infra | 03:59 | |
| *** lathiat has quit IRC | 04:02 | |
| *** lukebrowning has quit IRC | 04:04 | |
| *** lathiat has joined #openstack-infra | 04:04 | |
| dmsimard | ianw: getting emails every minute for hound sync | 04:05 |
| dmsimard | flock no such file or directory | 04:05 |
| *** lukebrowning has joined #openstack-infra | 04:05 | |
| ianw | dmsimard: hmm, ok, looking | 04:06 |
| dmsimard | Presumably the /var/run/hound directory doesn't exist | 04:08 |
| *** lukebrowning has quit IRC | 04:10 | |
| *** lukebrowning has joined #openstack-infra | 04:12 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Put hound sync lock in /var/run https://review.openstack.org/528617 | 04:12 |
| *** udesale has joined #openstack-infra | 04:12 | |
| ianw | doh, that's also going to run every minute | 04:12 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Put hound sync lock in /var/run https://review.openstack.org/528617 | 04:14 |
| *** lukebrowning has quit IRC | 04:16 | |
| *** lukebrowning has joined #openstack-infra | 04:18 | |
| *** lukebrowning has quit IRC | 04:23 | |
| *** lukebrowning has joined #openstack-infra | 04:24 | |
| *** dbecker has quit IRC | 04:25 | |
| *** lukebrowning has quit IRC | 04:29 | |
| *** lukebrowning has joined #openstack-infra | 04:30 | |
| dmsimard | lol what an amazing default for the minute parameter | 04:31 |
| *** lukebrowning has quit IRC | 04:35 | |
| *** lukebrowning has joined #openstack-infra | 04:37 | |
| *** gagehugo has quit IRC | 04:40 | |
| *** lukebrowning has quit IRC | 04:42 | |
| *** lukebrowning has joined #openstack-infra | 04:43 | |
| *** lukebrowning has quit IRC | 04:48 | |
| *** lukebrowning has joined #openstack-infra | 04:53 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test https://review.openstack.org/528130 | 04:56 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version https://review.openstack.org/528156 | 04:56 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Fix up log rotation https://review.openstack.org/528624 | 04:56 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Don't install npm dependencies in /var/log https://review.openstack.org/528625 | 04:56 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Xenial: add a service file https://review.openstack.org/528626 | 04:56 |
| *** lukebrowning has quit IRC | 04:58 | |
| *** lukebrowning has joined #openstack-infra | 04:59 | |
| *** lukebrowning has quit IRC | 05:04 | |
| *** caphrim007 has quit IRC | 05:33 | |
| *** lukebrowning has joined #openstack-infra | 05:38 | |
| *** lukebrowning_ has joined #openstack-infra | 05:40 | |
| *** benj_ has quit IRC | 05:42 | |
| *** lukebrowning has quit IRC | 05:44 | |
| *** gagehugo has joined #openstack-infra | 05:45 | |
| *** lukebrowning_ has quit IRC | 05:45 | |
| *** lukebrowning has joined #openstack-infra | 05:47 | |
| *** gagehugo has quit IRC | 05:50 | |
| *** jbadiapa has joined #openstack-infra | 05:51 | |
| *** lukebrowning has quit IRC | 05:51 | |
| *** gagehugo has joined #openstack-infra | 05:51 | |
| *** lukebrowning has joined #openstack-infra | 05:53 | |
| *** lukebrowning has quit IRC | 05:58 | |
| *** lukebrowning has joined #openstack-infra | 06:00 | |
| *** ramishra has joined #openstack-infra | 06:02 | |
| *** lukebrowning has quit IRC | 06:05 | |
| *** ijw has joined #openstack-infra | 06:05 | |
| *** ramishra has quit IRC | 06:06 | |
| *** lukebrowning has joined #openstack-infra | 06:10 | |
| *** lukebrowning has quit IRC | 06:15 | |
| *** lukebrowning has joined #openstack-infra | 06:17 | |
| *** lukebrowning has quit IRC | 06:21 | |
| *** jascott1 has quit IRC | 06:25 | |
| *** hjensas has quit IRC | 06:25 | |
| *** ramishra has joined #openstack-infra | 06:27 | |
| *** kiennt26 has joined #openstack-infra | 06:28 | |
| *** annp has joined #openstack-infra | 06:32 | |
| *** namnh has joined #openstack-infra | 06:37 | |
| *** namnh has quit IRC | 06:37 | |
| *** namnh has joined #openstack-infra | 06:38 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Don't install npm dependencies in /var/log https://review.openstack.org/528625 | 06:43 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Xenial: add a service file https://review.openstack.org/528626 | 06:43 |
| *** zhurong has joined #openstack-infra | 06:43 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test https://review.openstack.org/528130 | 06:43 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version https://review.openstack.org/528156 | 06:43 |
| *** cuongnv has quit IRC | 06:44 | |
| AJaeger | config-core, could you review https://review.openstack.org/521105 and https://review.openstack.org/528477 , please? These update translations and releasenotes jobs. | 06:45 |
| *** cuongnv has joined #openstack-infra | 06:45 | |
| *** rcernin has quit IRC | 06:46 | |
| *** ijw has quit IRC | 06:47 | |
| *** kiennt26 has quit IRC | 06:47 | |
| *** ijw has joined #openstack-infra | 06:49 | |
| *** lukebrowning has joined #openstack-infra | 06:49 | |
| *** kiennt26 has joined #openstack-infra | 06:51 | |
| *** lukebrowning has quit IRC | 06:54 | |
| *** yolanda has quit IRC | 06:55 | |
| *** lukebrowning has joined #openstack-infra | 06:56 | |
| *** lukebrowning has quit IRC | 07:00 | |
| *** ijw has quit IRC | 07:05 | |
| *** daidv has joined #openstack-infra | 07:11 | |
| kiennt26 | HexChat: 2.10.2 ** OS: Linux 4.4.0-104-generic x86_64 ** Distro: Ubuntu "xenial" 16.04 ** CPU: 8 x Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz (GenuineIntel) @ 1,60GHz ** RAM: Physical: 15,6GiB, 76,6% free ** Disk: Total: 1,5TiB, 23,7% free ** VGA: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor Graphics Controller ** Sound: HDA-Intel - HDA Intel PCH ** Ethernet: Intel Corporation | 07:12 |
| kiennt26 | 82579LM Gigabit Network Connection ** Uptime: 6h 31m 35s ** | 07:12 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Xenial: add a service file https://review.openstack.org/528626 | 07:22 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test https://review.openstack.org/528130 | 07:22 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version https://review.openstack.org/528156 | 07:22 |
| *** lukebrowning has joined #openstack-infra | 07:26 | |
| ianw | AJaeger: both LGTM, as usual though i think you (or someone) should babysit them a little | 07:27 |
| *** lukebrowning has quit IRC | 07:30 | |
| *** lukebrowning has joined #openstack-infra | 07:32 | |
| *** ijw has joined #openstack-infra | 07:36 | |
| *** lukebrowning has quit IRC | 07:36 | |
| AJaeger | ianw: will do - thanks | 07:37 |
| *** lukebrowning has joined #openstack-infra | 07:38 | |
| *** ijw has quit IRC | 07:42 | |
| *** lukebrowning has quit IRC | 07:43 | |
| *** lukebrowning has joined #openstack-infra | 07:44 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: consolidate interop jobs https://review.openstack.org/528644 | 07:44 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove obsolete interop jobs https://review.openstack.org/528645 | 07:45 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Improve ensure-reno https://review.openstack.org/528477 | 07:45 |
| *** lukebrowning has quit IRC | 07:49 | |
| *** HeOS has joined #openstack-infra | 07:50 | |
| *** ijw has joined #openstack-infra | 07:50 | |
| openstackgerrit | Merged openstack-infra/project-config master: Use ensure-babel to make sure babel is installed https://review.openstack.org/521105 | 07:51 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Handle sigterm in nodaemon mode https://review.openstack.org/528646 | 07:54 |
| *** lukebrowning has joined #openstack-infra | 07:54 | |
| *** lukebrowning has quit IRC | 07:59 | |
| *** ijw has quit IRC | 08:00 | |
| *** lukebrowning has joined #openstack-infra | 08:01 | |
| *** ijw has joined #openstack-infra | 08:02 | |
| *** lukebrowning has quit IRC | 08:05 | |
| *** rcernin has joined #openstack-infra | 08:06 | |
| *** ijw has quit IRC | 08:07 | |
| *** lukebrowning has joined #openstack-infra | 08:07 | |
| *** ijw has joined #openstack-infra | 08:07 | |
| *** robled has quit IRC | 08:09 | |
| *** robled has joined #openstack-infra | 08:10 | |
| *** lukebrowning has quit IRC | 08:12 | |
| *** ijw has quit IRC | 08:12 | |
| *** lukebrowning has joined #openstack-infra | 08:13 | |
| *** shardy has joined #openstack-infra | 08:17 | |
| *** lukebrowning has quit IRC | 08:18 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove swift legacy tox jobs https://review.openstack.org/528649 | 08:19 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy swift tox jobs https://review.openstack.org/528650 | 08:19 |
| *** lukebrowning has joined #openstack-infra | 08:20 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: handler: fix support for handler without launch_manager https://review.openstack.org/524773 | 08:21 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Add a plugin interface for drivers https://review.openstack.org/524620 | 08:21 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: builder: do not cleanup image for driver not managing image https://review.openstack.org/516920 | 08:21 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a static driver for Nodepool https://review.openstack.org/468624 | 08:21 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a generic run_handler https://review.openstack.org/526325 | 08:21 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement an OpenContainer driver https://review.openstack.org/468753 | 08:21 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a Kubernetes driver https://review.openstack.org/521356 | 08:21 |
| *** zhurong has quit IRC | 08:21 | |
| *** e0ne has joined #openstack-infra | 08:24 | |
| *** lukebrowning has quit IRC | 08:24 | |
| *** yamamoto has quit IRC | 08:25 | |
| * AJaeger loves Zuul v3 - just converted the legacy swift jobs to Zuul v3 native in https://review.openstack.org/#/c/528582/ . This is really nice now. | 08:32 | |
| AJaeger | fungi, you might want to review ^ | 08:32 |
| *** lukebrowning has joined #openstack-infra | 08:32 | |
| *** lukebrowning has quit IRC | 08:37 | |
| *** lukebrowning has joined #openstack-infra | 08:39 | |
| *** markvoelker has quit IRC | 08:42 | |
| *** raissa has quit IRC | 08:42 | |
| *** lukebrowning has quit IRC | 08:43 | |
| *** raissa has joined #openstack-infra | 08:43 | |
| *** raissa has quit IRC | 08:44 | |
| *** lukebrowning has joined #openstack-infra | 08:44 | |
| *** raissa has joined #openstack-infra | 08:44 | |
| *** jpena|off is now known as jpena | 08:44 | |
| *** raissa has quit IRC | 08:44 | |
| *** raissa has joined #openstack-infra | 08:45 | |
| *** raissa has quit IRC | 08:45 | |
| *** raissa has joined #openstack-infra | 08:46 | |
| *** raissa has quit IRC | 08:46 | |
| *** raissa has joined #openstack-infra | 08:46 | |
| *** raissa has quit IRC | 08:47 | |
| *** raissa has joined #openstack-infra | 08:47 | |
| *** raissa has quit IRC | 08:48 | |
| *** lukebrowning has quit IRC | 08:48 | |
| AJaeger | config-core, could you review https://review.openstack.org/528580 (convert dashboard tox jobs) and https://review.openstack.org/528166 (add missing job descriptions) and https://review.openstack.org/525658 (improve zanata-cli download), please? | 08:50 |
| *** ccamacho has joined #openstack-infra | 08:51 | |
| *** amoralej|off is now known as amoralej | 08:52 | |
| *** ijw has joined #openstack-infra | 08:57 | |
| *** slaweq has joined #openstack-infra | 08:58 | |
| *** alexchadin has joined #openstack-infra | 08:58 | |
| *** shardy has quit IRC | 08:59 | |
| *** shardy has joined #openstack-infra | 09:00 | |
| *** lukebrowning has joined #openstack-infra | 09:00 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Xenial: add a service file https://review.openstack.org/528626 | 09:01 |
| *** sbezverk has quit IRC | 09:01 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test https://review.openstack.org/528130 | 09:01 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version https://review.openstack.org/528156 | 09:01 |
| *** ijw has quit IRC | 09:01 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Clean up more puppetmaster remnants https://review.openstack.org/249815 | 09:03 |
| *** jpich has joined #openstack-infra | 09:05 | |
| *** lukebrowning has quit IRC | 09:05 | |
| *** lukebrowning has joined #openstack-infra | 09:07 | |
| *** lukebrowning has quit IRC | 09:11 | |
| strigazi | hello AJaeger, I would like to change the hour of the magnum meeting. Are the slots in the meeting channels reserved in a repo or wiki? | 09:17 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove revoke-sudo from translations playbook https://review.openstack.org/528664 | 09:19 |
| AJaeger | strigazi: Read http://eavesdrop.openstack.org/ for details and pointers | 09:19 |
| strigazi | AJaeger thanks | 09:19 |
| AJaeger | config-core, please review 528664 - missed one case in reviewing. | 09:19 |
| AJaeger | ianw: babysitting was needed ;( ^ | 09:19 |
| *** lucas-afk is now known as lucasagomes | 09:23 | |
| *** giblet is now known as gibi | 09:23 | |
| *** yamamoto has joined #openstack-infra | 09:26 | |
| *** lukebrowning has joined #openstack-infra | 09:29 | |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/project-config master: Add releasenotes and docs job to congress-dashboard https://review.openstack.org/528671 | 09:29 |
| *** yamamoto has quit IRC | 09:33 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Add new repo for Blazar tempest plugin https://review.openstack.org/528672 | 09:33 |
| *** lukebrowning_ has joined #openstack-infra | 09:35 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Added initial jobs for blazar-tempest-plugin https://review.openstack.org/528674 | 09:35 |
| *** stakeda has quit IRC | 09:36 | |
| *** andreykurilin_ has quit IRC | 09:36 | |
| *** andreykurilin has joined #openstack-infra | 09:36 | |
| *** lukebrowning has quit IRC | 09:36 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:39 | |
| *** lukebrowning_ has quit IRC | 09:40 | |
| *** lukebrowning has joined #openstack-infra | 09:42 | |
| *** hashar has joined #openstack-infra | 09:46 | |
| *** kiennt26 has quit IRC | 09:46 | |
| *** lukebrowning has quit IRC | 09:47 | |
| *** e0ne_ has joined #openstack-infra | 09:48 | |
| *** lukebrowning has joined #openstack-infra | 09:48 | |
| *** e0ne_ has quit IRC | 09:50 | |
| *** e0ne has quit IRC | 09:51 | |
| *** e0ne has joined #openstack-infra | 09:51 | |
| *** e0ne has quit IRC | 09:52 | |
| *** lukebrowning has quit IRC | 09:53 | |
| *** e0ne has joined #openstack-infra | 09:53 | |
| *** lukebrowning has joined #openstack-infra | 09:55 | |
| *** janki has joined #openstack-infra | 09:55 | |
| *** ijw has joined #openstack-infra | 09:58 | |
| *** lukebrowning has quit IRC | 10:00 | |
| *** lukebrowning has joined #openstack-infra | 10:01 | |
| *** ijw has quit IRC | 10:03 | |
| *** lukebrowning has quit IRC | 10:06 | |
| *** lukebrowning has joined #openstack-infra | 10:08 | |
| *** cuongnv has quit IRC | 10:08 | |
| *** lukebrowning has quit IRC | 10:12 | |
| *** lukebrowning has joined #openstack-infra | 10:14 | |
| *** lukebrowning has quit IRC | 10:19 | |
| *** lukebrowning has joined #openstack-infra | 10:20 | |
| *** lukebrowning has quit IRC | 10:25 | |
| *** lukebrowning has joined #openstack-infra | 10:26 | |
| *** udesale has quit IRC | 10:27 | |
| *** lukebrowning has quit IRC | 10:32 | |
| *** lukebrowning has joined #openstack-infra | 10:33 | |
| *** d0ugal_ has quit IRC | 10:36 | |
| *** lukebrowning has quit IRC | 10:38 | |
| *** udesale has joined #openstack-infra | 10:38 | |
| *** lukebrowning has joined #openstack-infra | 10:39 | |
| *** markvoelker has joined #openstack-infra | 10:42 | |
| *** lukebrowning has quit IRC | 10:44 | |
| *** makowals has joined #openstack-infra | 10:50 | |
| *** namnh has quit IRC | 10:52 | |
| *** sambetts_ is now known as sambetts | 10:54 | |
| *** lukebrowning has joined #openstack-infra | 10:56 | |
| *** rcernin has quit IRC | 10:58 | |
| *** ijw has joined #openstack-infra | 11:00 | |
| *** lukebrowning has quit IRC | 11:01 | |
| *** udesale has quit IRC | 11:01 | |
| *** lukebrowning has joined #openstack-infra | 11:03 | |
| *** ijw has quit IRC | 11:05 | |
| andreaf | high folks just reporting that there was spam on openstack-qa as well | 11:06 |
| *** lukebrowning has quit IRC | 11:07 | |
| *** lukebrowning has joined #openstack-infra | 11:09 | |
| *** ijw has joined #openstack-infra | 11:09 | |
| *** yamamoto has joined #openstack-infra | 11:12 | |
| *** lukebrowning has quit IRC | 11:13 | |
| *** ijw has quit IRC | 11:14 | |
| *** claudiub has joined #openstack-infra | 11:15 | |
| *** yamamoto has quit IRC | 11:15 | |
| *** lukebrowning has joined #openstack-infra | 11:15 | |
| *** d0ugal has joined #openstack-infra | 11:16 | |
| *** markvoelker has quit IRC | 11:17 | |
| *** lukebrowning has quit IRC | 11:20 | |
| *** lukebrowning has joined #openstack-infra | 11:22 | |
| *** lukebrowning has quit IRC | 11:26 | |
| *** lukebrowning has joined #openstack-infra | 11:28 | |
| smcginnis | Thanks for the spam firefighting infra folks. | 11:29 |
| *** derekh has joined #openstack-infra | 11:29 | |
| *** lukebrowning has quit IRC | 11:33 | |
| *** lukebrowning has joined #openstack-infra | 11:34 | |
| *** jpich has quit IRC | 11:36 | |
| *** jpich has joined #openstack-infra | 11:37 | |
| *** lukebrowning_ has joined #openstack-infra | 11:38 | |
| *** lukebrowning has quit IRC | 11:39 | |
| *** lukebrowning_ has quit IRC | 11:43 | |
| *** pbourke has quit IRC | 11:43 | |
| *** lukebrowning has joined #openstack-infra | 11:45 | |
| *** lukebrowning has quit IRC | 11:49 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Add new repo for Blazar tempest plugin https://review.openstack.org/528672 | 11:51 |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Add blazar-tempest-plugin to zuul jobs https://review.openstack.org/528696 | 11:53 |
| *** chandankumar has joined #openstack-infra | 11:54 | |
| *** smatzek has joined #openstack-infra | 11:55 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Add new repo for Telemetry tempest plugin https://review.openstack.org/526863 | 11:57 |
| *** lukebrowning has joined #openstack-infra | 11:57 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Add telemetry-tempest-plugin to zuul https://review.openstack.org/528697 | 11:58 |
| chandankumar | AJaeger: i have updated the patches as said. | 11:58 |
| *** lukebrowning has quit IRC | 12:02 | |
| *** lukebrowning has joined #openstack-infra | 12:09 | |
| *** yolanda has joined #openstack-infra | 12:10 | |
| *** ijw has joined #openstack-infra | 12:10 | |
| *** nicolasbock_ has joined #openstack-infra | 12:11 | |
| *** lucasagomes is now known as lucas-hungry | 12:13 | |
| *** markvoelker has joined #openstack-infra | 12:14 | |
| *** lukebrowning has quit IRC | 12:14 | |
| *** ijw has quit IRC | 12:15 | |
| *** yamamoto has joined #openstack-infra | 12:16 | |
| *** yamamoto has quit IRC | 12:21 | |
| AJaeger | thanks, chandankumar | 12:23 |
| fungi | dmsimard: the unicode-uncleanness with statusbot should be solved by 527461 | 12:23 |
| fungi | ianw: ^ | 12:24 |
| *** lukebrowning has joined #openstack-infra | 12:25 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: zk: automatically retry command when connection is lost https://review.openstack.org/523640 | 12:25 |
| *** nicolasbock_ has quit IRC | 12:26 | |
| *** lukebrowning has quit IRC | 12:29 | |
| *** lukebrowning has joined #openstack-infra | 12:31 | |
| *** janki has quit IRC | 12:36 | |
| *** lukebrowning has quit IRC | 12:36 | |
| *** lukebrowning has joined #openstack-infra | 12:37 | |
| *** jpena is now known as jpena|lunch | 12:38 | |
| *** udesale has joined #openstack-infra | 12:46 | |
| *** lukebrowning has quit IRC | 12:47 | |
| *** markvoelker has quit IRC | 12:48 | |
| *** lukebrowning has joined #openstack-infra | 12:48 | |
| *** claudiub has quit IRC | 12:51 | |
| *** lukebrowning has quit IRC | 12:53 | |
| *** claudiub has joined #openstack-infra | 12:53 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added new Bulk events endpoints https://review.openstack.org/528390 | 12:56 |
| *** psachin has quit IRC | 12:56 | |
| mpeterson | hey! question, is there a way to exclude a step of a pre-run of a parent job? | 12:58 |
| *** lukebrowning has joined #openstack-infra | 13:00 | |
| *** lukebrowning has quit IRC | 13:04 | |
| *** lukebrowning has joined #openstack-infra | 13:06 | |
| *** bobh has joined #openstack-infra | 13:07 | |
| *** igordc has quit IRC | 13:08 | |
| *** igordc has joined #openstack-infra | 13:08 | |
| *** lucas-hungry is now known as lucasagomes | 13:08 | |
| pabelanger | mpeterson: best to create a new parent with pre-run not defined or maybe expose a variable to skip running tasks if not set | 13:09 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Move meeting channel to free up weekly slot https://review.openstack.org/523871 | 13:10 |
| *** lukebrowning has quit IRC | 13:11 | |
| mpeterson | pabelanger: nice, the variable idea is actually a nice one... I was so fixated that it slipped my mind, thanks | 13:11 |
| *** ijw has joined #openstack-infra | 13:12 | |
| *** ykarel has quit IRC | 13:12 | |
| *** lukebrowning has joined #openstack-infra | 13:12 | |
| *** lukebrowning has quit IRC | 13:17 | |
| *** ijw has quit IRC | 13:17 | |
| *** ijw has joined #openstack-infra | 13:17 | |
| *** yamamoto has joined #openstack-infra | 13:18 | |
| *** lukebrowning has joined #openstack-infra | 13:22 | |
| *** amrith has joined #openstack-infra | 13:22 | |
| *** ijw has quit IRC | 13:22 | |
| *** trown|outtypewww is now known as trown | 13:24 | |
| *** jpena|lunch is now known as jpena | 13:24 | |
| *** lukebrowning has quit IRC | 13:26 | |
| *** yamamoto has quit IRC | 13:26 | |
| *** electrofelix has joined #openstack-infra | 13:27 | |
| *** lukebrowning has joined #openstack-infra | 13:28 | |
| *** trown is now known as trown|ruck | 13:29 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: requirements: remove paramiko <2.0 cap https://review.openstack.org/528719 | 13:32 |
| *** lukebrowning has quit IRC | 13:33 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: requirements: remove paramiko <2.0 cap https://review.openstack.org/528720 | 13:33 |
| *** tosky has joined #openstack-infra | 13:34 | |
| *** kgiusti has joined #openstack-infra | 13:35 | |
| *** bobh has quit IRC | 13:35 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: No longer consider "jenkins" votes when enqueuing https://review.openstack.org/528722 | 13:38 |
| *** jrist has quit IRC | 13:39 | |
| *** rlandy has joined #openstack-infra | 13:40 | |
| *** rlandy is now known as rlandy|rover | 13:41 | |
| *** amoralej is now known as amoralej|lunch | 13:45 | |
| *** lukebrowning has joined #openstack-infra | 13:48 | |
| dmsimard | infra-root, #freenode says the spam wave from last night has subsided, I'll remove the channel restrictions now | 13:49 |
| *** lukebrowning_ has joined #openstack-infra | 13:51 | |
| pabelanger | thanks | 13:52 |
| fungi | thanks again dmsimard! | 13:53 |
| *** lukebrowning has quit IRC | 13:53 | |
| dmsimard | hm, so, for the record | 13:53 |
| dmsimard | you can't selectively remove a channel mode lock, you have to not specify it | 13:53 |
| fungi | ahh, okay | 13:53 |
| dmsimard | yesterday I did /msg chanserv set #channel mlock +r | 13:53 |
| dmsimard | so that potentially erased previous mode locks | 13:54 |
| fungi | i doubt we had any for those channels | 13:54 |
| *** jrist has joined #openstack-infra | 13:54 | |
| dmsimard | and now I have to do "/msg chanserv set #channel mlock" to remove the mlock entirely (because mlocking -r would prevent users from setting +r) | 13:54 |
| dmsimard | yeah, I think I might document that somewhere appropriate in system-config | 13:54 |
| fungi | anyway, that probably makes eventual implementation in accessbot simpler since it works basically the same way as acl masks | 13:54 |
| * dmsimard nods | 13:55 | |
| *** lukebrowning_ has quit IRC | 13:56 | |
| *** lukebrowning has joined #openstack-infra | 13:58 | |
| *** e0ne has quit IRC | 13:58 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: requirements: remove paramiko <2.0 cap https://review.openstack.org/528728 | 14:00 |
| *** ChanServ sets mode: +o dmsimard | 14:00 | |
| *** dmsimard sets mode: -r | 14:00 | |
| dmsimard | hrm | 14:00 |
| dmsimard | removing the mlock doesn't remove the mode :/ | 14:01 |
| *** ijw has joined #openstack-infra | 14:01 | |
| *** gcb has joined #openstack-infra | 14:01 | |
| fungi | unset mlock? | 14:01 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: requirements: remove paramiko <2.0 cap https://review.openstack.org/528729 | 14:01 |
| fungi | ahh, you probably need to mlock -r and then unset the mlock | 14:01 |
| *** lukebrowning has quit IRC | 14:02 | |
| dmsimard | yeah that's what I was just told | 14:03 |
| dmsimard | meh | 14:03 |
| *** ramishra has quit IRC | 14:03 | |
| *** lukebrowning has joined #openstack-infra | 14:04 | |
| *** dprince has joined #openstack-infra | 14:04 | |
| *** gcb has quit IRC | 14:05 | |
| *** gcb has joined #openstack-infra | 14:06 | |
| *** dmsimard sets mode: -o dmsimard | 14:06 | |
| *** dprince has quit IRC | 14:06 | |
| *** dprince has joined #openstack-infra | 14:07 | |
| *** e0ne has joined #openstack-infra | 14:07 | |
| *** jroll has joined #openstack-infra | 14:07 | |
| *** ijw has quit IRC | 14:08 | |
| *** lukebrowning has quit IRC | 14:09 | |
| *** andreas_s has joined #openstack-infra | 14:10 | |
| dmsimard | one mlock command every 2 seconds.. 186 channels | 14:10 |
| * dmsimard sighs | 14:10 | |
| *** lukebrowning has joined #openstack-infra | 14:10 | |
| *** jcoufal has joined #openstack-infra | 14:13 | |
| *** lukebrowning has quit IRC | 14:15 | |
| *** salv-orlando has joined #openstack-infra | 14:16 | |
| fungi | try deleting a reviewer from 4161 changes in gerrit ;) | 14:19 |
| *** jpena is now known as jpena|off | 14:19 | |
| fungi | that ran most of the evening | 14:19 |
| *** andreas_s has quit IRC | 14:19 | |
| *** mriedem has joined #openstack-infra | 14:20 | |
| *** jpena|off is now known as jpena | 14:20 | |
| *** ralonsoh has joined #openstack-infra | 14:20 | |
| *** felipemonteiro has joined #openstack-infra | 14:20 | |
| *** lukebrowning has joined #openstack-infra | 14:20 | |
| *** amoralej|lunch is now known as amoralej | 14:21 | |
| *** robled has quit IRC | 14:23 | |
| *** robled has joined #openstack-infra | 14:24 | |
| *** andreas_s has joined #openstack-infra | 14:24 | |
| *** lukebrowning has quit IRC | 14:25 | |
| lbragstad | thanks dmsimard! | 14:25 |
| *** alexchadin has quit IRC | 14:26 | |
| *** robled has quit IRC | 14:27 | |
| AJaeger | config-core, please review 528664 to fix translation jobs - missed one case in reviewing previous change | 14:27 |
| *** lukebrowning has joined #openstack-infra | 14:27 | |
| *** robled has joined #openstack-infra | 14:27 | |
| *** robled has quit IRC | 14:27 | |
| *** robled has joined #openstack-infra | 14:27 | |
| *** smatzek has quit IRC | 14:28 | |
| fungi | AJaeger: what about the translation jobs needs sudo after the pre phase? | 14:28 |
| *** jcoufal_ has joined #openstack-infra | 14:28 | |
| fungi | mostly curious what's happening as root after stuff is installed | 14:28 |
| *** smatzek has joined #openstack-infra | 14:28 | |
| *** andreas_s has quit IRC | 14:29 | |
| *** jcoufal has quit IRC | 14:29 | |
| *** andreas_s has joined #openstack-infra | 14:29 | |
| *** eharney has joined #openstack-infra | 14:30 | |
| AJaeger | http://git.openstack.org/cgit/openstack-infra/project-config/tree/roles/prep-zanata/tasks/main.yaml needs root | 14:30 |
| AJaeger | and is called from main playbook, see http://git.openstack.org/cgit/openstack-infra/project-config/tree/playbooks/translation/upstream-translation-update.yaml | 14:30 |
| AJaeger | somebody could refactor as well... | 14:31 |
| fungi | ahh, i see. so it's more software being installed into system paths | 14:31 |
| *** lukebrowning has quit IRC | 14:31 | |
| *** andreas_s has quit IRC | 14:32 | |
| *** andreas_s has joined #openstack-infra | 14:32 | |
| AJaeger | yes | 14:32 |
| *** smatzek has quit IRC | 14:33 | |
| AJaeger | and the last change added the revoke-sudo by accident ;( last=merged earlier today | 14:33 |
| *** lukebrowning has joined #openstack-infra | 14:33 | |
| *** stevebaker has quit IRC | 14:35 | |
| *** ykarel has joined #openstack-infra | 14:36 | |
| dmsimard | fungi: yeah actually I noticed you removed all of them, not necessarily the ones that had been added last week | 14:36 |
| dmsimard | fungi: I saw you removing -1's from old, old patches | 14:36 |
| AJaeger | dmsimard: could you review 528664 as well to fix translations, please? | 14:36 |
| AJaeger | dmsimard: we discussed the removal in a previous infra team meeting | 14:37 |
| *** lukebrowning has quit IRC | 14:38 | |
| *** Nil_ has joined #openstack-infra | 14:39 | |
| *** lukebrowning has joined #openstack-infra | 14:39 | |
| *** kjackal has joined #openstack-infra | 14:40 | |
| *** trown|ruck is now known as trown|afk | 14:40 | |
| AJaeger | mnaser: could you add https://review.openstack.org/#/c/526983/ again to your review queue, please? - for puppet module job changes | 14:41 |
| fungi | dmsimard: yes, the point was to remove them from all open changes as we discussed in the infra meeting a couple weeks ago (the pending action item i deferred last week) | 14:43 |
| *** stevebaker has joined #openstack-infra | 14:43 | |
| dmsimard | fungi: ah ok | 14:43 |
| fungi | it was entirely unrelated to anything that may have happened more recently | 14:43 |
| dmsimard | AJaeger: yes, I have some time today dedicated to going through a batch of reviews | 14:44 |
| fungi | though i wonder where you actually saw new verified votes being left by the jenkins account? we removed its access to do that from our all-projects acl several weeks ago | 14:44 |
| *** lukebrowning has quit IRC | 14:44 | |
| dmsimard | #status log (dmsimard) the channel restrictions mentioned last night have been removed after #freenode confirmed the spam wave had stopped. | 14:44 |
| openstackstatus | dmsimard: finished logging | 14:44 |
| fungi | if zuul.o.o was able to leave new verified votes as jenkins since then, that makes me wonder if gerrit's acl enforcement is broken | 14:45 |
| AJaeger | fungi, let me check backlog... | 14:45 |
| dmsimard | fungi: I'm not sure if it was verified votes, I just got a bunch of emails with vote removals, didn't pay attention to what they were.. I'll take a look | 14:45 |
| AJaeger | fungi: https://review.openstack.org/#/c/528482/1 | 14:45 |
| fungi | the vote removals were all for verified votes, yes | 14:45 |
| AJaeger | fungi: it was not verified | 14:45 |
| AJaeger | fungi: it just was a comment | 14:46 |
| *** lukebrowning has joined #openstack-infra | 14:46 | |
| fungi | yup, so working as expected | 14:46 |
| fungi | other than rackspace rebooting zuul.o.o in the middle of last week | 14:46 |
| fungi | causing it to start running yet again | 14:47 |
| AJaeger | mordred: http://logs.openstack.org/a0/a02f9831010adcbaa02e25da0dea59f4e83e2bb6/tag/publish-openstack-releasenotes/872a891/ara/ is a failure of taskflow project. They have only no test-requirements.txt, everything is in extras. I'll create a doc/requirements.txt now. just wanted to mention it... | 14:47 |
| *** lukebrowning has quit IRC | 14:50 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:51 | |
| *** salv-orlando has quit IRC | 14:52 | |
| *** salv-orlando has joined #openstack-infra | 14:53 | |
| dmsimard | AJaeger: they have neither a test-requirements.txt or a doc/requirements.txt ? How were they building docs before ? | 14:53 |
| dmsimard | you at least need sphinx in there | 14:53 |
| *** jamesmcarthur has joined #openstack-infra | 14:54 | |
| *** felipemonteiro has quit IRC | 14:54 | |
| AJaeger | dmsimard: see https://review.openstack.org/528735 - everything in setup.cfg (and requirements.txt) | 14:54 |
| AJaeger | dmsimard: mordred will write a novel about odd cases in project setup uncovered while working on docs and releasenotes ;( | 14:55 |
| *** lukebrowning has joined #openstack-infra | 14:55 | |
| *** d0ugal has quit IRC | 14:56 | |
| dmsimard | oh wow so they don't use pbr actually | 14:58 |
| AJaeger | dmsimard: they do use pbr... | 14:58 |
| *** smatzek has joined #openstack-infra | 14:58 | |
| dmsimard | huh, but with pbr you don't need to have a setup.cfg layout like that :/ | 14:59 |
| pabelanger | okay, I think I have kdc04.o.o online and setup for replication | 14:59 |
| dmsimard | AJaeger: oh, for subpackaging | 14:59 |
| pabelanger | however, I had to manually copy some things around. I wonder if we should maybe puppet some of the step | 14:59 |
| pabelanger | jeblair: ^ specifically: https://docs.openstack.org/infra/system-config/kerberos.html#realm-creation we say copy keytab file to kdc servers, any reason not to have puppet manage that? | 15:00 |
| *** lukebrowning has quit IRC | 15:00 | |
| fungi | dmsimard: that project also has some history outside of openstack and retains vestiges of earlier package design as a resuly | 15:01 |
| fungi | result | 15:01 |
| *** lukebrowning has joined #openstack-infra | 15:02 | |
| dmsimard | ever since I learned about pbr and tox (from OpenStack) I don't want to work with anything else | 15:02 |
| *** smatzek has quit IRC | 15:02 | |
| dmsimard | I accept that a lot of it has to do with arcane magic and I am cool with that | 15:03 |
| fungi | we're even trying to strip down pbr now that a lot of its functionality is finding its way into established ecosystem tooling | 15:03 |
| fungi | e.g., setup.cfg support in setuptools now | 15:03 |
| *** smatzek has joined #openstack-infra | 15:04 | |
| *** dprince has quit IRC | 15:04 | |
| *** dprince has joined #openstack-infra | 15:05 | |
| *** marst has joined #openstack-infra | 15:06 | |
| *** smatzek has quit IRC | 15:06 | |
| *** lukebrowning has quit IRC | 15:06 | |
| *** smatzek has joined #openstack-infra | 15:07 | |
| *** lukebrowning has joined #openstack-infra | 15:08 | |
| *** d0ugal has joined #openstack-infra | 15:08 | |
| *** d0ugal has quit IRC | 15:11 | |
| *** d0ugal has joined #openstack-infra | 15:13 | |
| *** lukebrowning has quit IRC | 15:13 | |
| *** lukebrowning has joined #openstack-infra | 15:14 | |
| dmsimard | fungi: btw I found something interesting regarding RDO's logserver performance when it comes to pruning files and directories -- we basically have the same problem as upstream (albeit at a lower scale) | 15:15 |
| dmsimard | The sysctl vm.vfs_cache_pressure setting -- it defaults to 100 and it can be summarized as a number which represents the tendency of the kernel to reclaim the memory used for VFS caches | 15:16 |
| dmsimard | So things like file and directory metadata (which ends up being important when you're trying to find files and directories based on date) | 15:17 |
| dmsimard | I've lowered that amount to 50 and it's made a noticeable impact, at least for us | 15:17 |
| dmsimard | some more explanations here: http://docs.gluster.org/en/latest/Administrator%20Guide/Linux%20Kernel%20Tuning/#vmvfs95cache95pressure | 15:18 |
| fungi | certainly worth a try until we get a more effective sharding scheme in place for new writes | 15:19 |
| dmsimard | So with the amount of data that we have, it might be worthwhile to consider upping the amount of RAM (we only have 8GB right now) and tune vfs_cache_pressure | 15:19 |
| *** lukebrowning has quit IRC | 15:19 | |
| dmsimard | I read https://www.usenix.org/legacy/publications/library/proceedings/usenix01/full_papers/kroeger/kroeger_html/node8.html out of boredom too :) | 15:20 |
| *** ijw has joined #openstack-infra | 15:20 | |
| *** lukebrowning has joined #openstack-infra | 15:21 | |
| dmsimard | 8GB of RAM for a fileserver with 12+TB of content is pretty short :) | 15:21 |
| fungi | well, it's 12+tb of content for which only maybe 10% ever gets looked at by a human | 15:23 |
| fungi | (and probably an order of magnitude less even) | 15:23 |
| dmsimard | true, but the directory hierarchy and file metadata gets loaded into the cache (and swapped out since we don't have enough ram) | 15:24 |
| *** rbrndt has joined #openstack-infra | 15:24 | |
| dmsimard | when they're uploaded, I mean | 15:24 |
| fungi | sure | 15:25 |
| fungi | in positive news, we're down to 68% blocks and 51% inodes in use on the logs volume now and it looks like it's dropping further | 15:26 |
| *** ijw has quit IRC | 15:26 | |
| *** lukebrowning has quit IRC | 15:26 | |
| fungi | though much of that is likely the holiday lull in activity | 15:26 |
| openstackgerrit | Javier Peña proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/528739 | 15:27 |
| fungi | and the fact that i added some 1tb or more a couple weeks ago | 15:27 |
| fungi | of reclaimed capacity from the old docs-draft volume | 15:27 |
| *** lukebrowning has joined #openstack-infra | 15:27 | |
| openstackgerrit | Javier Peña proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/528739 | 15:28 |
| dmsimard | that reminds me I need to wrap up the ara "sqlite-over-http" stack of patches .. | 15:28 |
| *** gouthamr has joined #openstack-infra | 15:28 | |
| *** gouthamr has quit IRC | 15:29 | |
| mordred | morning AJaeger ... shall we break everything by landing the sphinx patch today? | 15:29 |
| openstackgerrit | Javier Peña proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/528739 | 15:31 |
| AJaeger | mordred: yeah ;) | 15:31 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fix on view speakers info permission https://review.openstack.org/528742 | 15:31 |
| AJaeger | mordred: could you review 528664 first to fix translations, please? | 15:31 |
| mnaser | AJaeger: all good, thank you for the reminder re: puppet change. | 15:31 |
| mordred | AJaeger, dmsimard: also, that taskflow setup.cfg is way too clever | 15:31 |
| AJaeger | dmsimard: we need to reconfigure Zuul as your recheck showed ;( | 15:32 |
| dmsimard | AJaeger: yeah I did a recheck to see if it had been reloaded yet | 15:32 |
| dmsimard | mordred: so doing a /etc/init.d/zuul-scheduler reload is totally safe ? | 15:32 |
| *** lukebrowning has quit IRC | 15:32 | |
| AJaeger | infra-root, let's merge "Switch build-openstack-sphinx-docs to build-sphinx-docs" https://review.openstack.org/#/c/521145 , please | 15:32 |
| AJaeger | Let's do this early in our day to be able to get fixes in if needed. | 15:33 |
| mordred | dmsimard: yes - I believe so - that should send a signal to zuul to tell it to do a reconfigure | 15:33 |
| dmsimard | mordred: k | 15:33 |
| AJaeger | all our tests look fine but setup has some many corner cases, I'm sure something is missing. | 15:33 |
| AJaeger | mordred: please abandon https://review.openstack.org/522251 - not needed anymore | 15:34 |
| dmsimard | infra-root: doing a reload of zuul-scheduler to make zuul load projects that were created but the git repo wasn't ready in time | 15:34 |
| *** lukebrowning has joined #openstack-infra | 15:34 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Fix on view speakers info permission https://review.openstack.org/528742 | 15:34 |
| mordred | AJaeger: done on boh | 15:35 |
| mordred | both | 15:35 |
| AJaeger | mordred: I'll be offline for roughly three hours in a bit - but will help afterwards if needed. | 15:35 |
| AJaeger | mordred: thanks | 15:35 |
| *** aarefiev has joined #openstack-infra | 15:35 | |
| pabelanger | dmsimard: why didn't puppet-zuul do it? | 15:36 |
| AJaeger | pabelanger: there's a race | 15:36 |
| *** ykarel has quit IRC | 15:36 | |
| fungi | sounds like maybe puppet-zuul did it too early? | 15:37 |
| dmsimard | pabelanger: I added a topic on tomorrow's infra meeting | 15:37 |
| AJaeger | pabelanger: see https://review.openstack.org/528375 | 15:37 |
| dmsimard | we need 3 patches to create projects now | 15:37 |
| AJaeger | pabelanger: puppet might update Zuul before the repo is created | 15:37 |
| dmsimard | 1) create project in gerrit, 2) add project to zuul main.yaml 3) add jobs to the project | 15:37 |
| AJaeger | explained now in 528375 - fungi, pabelanger, a +2A is welcome. | 15:38 |
| AJaeger | We all would love if we don't need the 3 changes - so, happy to revert 528375 once we don't have that race | 15:38 |
| dmsimard | yeah basically zuul loads the new main.yaml before jeepyb creates the git repo | 15:38 |
| pabelanger | right, maybe we can add a check job to ensure project exists in git.o.o before we land main.yaml changes | 15:38 |
| jeblair | or fix our orchestration system | 15:39 |
| AJaeger | wait an hour in between ;) | 15:39 |
| dmsimard | pabelanger: requiring 3 patches is ridiculous, we need to find a way | 15:39 |
| AJaeger | jeblair: ++ | 15:39 |
| *** lukebrowning has quit IRC | 15:39 | |
| jeblair | version lock project-config during an ansible run | 15:39 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove revoke-sudo from translations playbook https://review.openstack.org/528664 | 15:39 |
| fungi | "warning: wait one hour after merging new projects before swimming" | 15:39 |
| dmsimard | jeblair: does zuul load the new main.yaml immediately when it merges ? or it's puppet that ends up doing that ? | 15:39 |
| jeblair | dmsimard: puppet | 15:40 |
| AJaeger | dmsimard: http://grafana.openstack.org/dashboard/db/zuul-status?panelId=26&fullscreen | 15:40 |
| dmsimard | jeblair: and that fires after a merge ? or it's within the 30 minute window ? | 15:40 |
| dmsimard | AJaeger: yeah that's the reload | 15:40 |
| jeblair | dmsimard: driven by the ansible cron wheel | 15:40 |
| *** felipemonteiro_ has quit IRC | 15:40 | |
| *** lukebrowning has joined #openstack-infra | 15:40 | |
| jeblair | i suspect we can solve it by having ansible check out project-config, get a hash, then pass that as a fact to every puppet invocation, and have puppet check out that hash of project-config. | 15:41 |
| dmsimard | where is the checkout of project-config right now ? in puppet-openstsackci ? | 15:41 |
| dmsimard | openstackci* | 15:41 |
| *** armax has joined #openstack-infra | 15:41 | |
| jeblair | dmsimard: i believo so | 15:41 |
| *** slaweq has quit IRC | 15:41 | |
| AJaeger | dmsimard: I rechecked... | 15:42 |
| mordred | jeblair: that's what we already do for gerrit and the git servers ... | 15:42 |
| mordred | jeblair: perhaps we just need to add the zuul scheduler to the gerrit/git sequencing playbook? | 15:42 |
| jeblair | mordred: oh, indeed. that may do the trick. | 15:43 |
| * mordred makes patch real quick | 15:43 | |
| * AJaeger WIPs https://review.openstack.org/#/c/528375/ | 15:43 | |
| jeblair | mordred: would we need any more project_config_ref plumbing? | 15:44 |
| dmsimard | looks like here http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n1420 | 15:44 |
| mordred | jeblair: no - it's already in place | 15:44 |
| mordred | jeblair: theplumbing is for ht epuppet module | 15:44 |
| mordred | jeblair: zuulv3.o.o is the puppet hostname for that server now, yeah? | 15:44 |
| jeblair | mordred: for puppet-project_config ? | 15:44 |
| jeblair | mordred: yes | 15:44 |
| dmsimard | brb, need to clear my chat buffer, yesterday's spam is making my client lag | 15:45 |
| jeblair | mordred: cool, yeah, i see it in puppet-project_config, so it should 'just work' :) | 15:45 |
| *** lukebrowning has quit IRC | 15:45 | |
| AJaeger | wow! | 15:45 |
| *** dmsimard has quit IRC | 15:45 | |
| *** dmsimard has joined #openstack-infra | 15:46 | |
| *** dmsimard has quit IRC | 15:46 | |
| *** dmsimard has joined #openstack-infra | 15:46 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add zuul scheduler to the git/gerrit puppet sequence https://review.openstack.org/528744 | 15:46 |
| mordred | jeblair, dmsimard: ^^ | 15:46 |
| AJaeger | team, can we merge "Switch build-openstack-sphinx-docs to build-sphinx-docs" https://review.openstack.org/#/c/521145 , please? This allows mordred and myself to continue with docs building stack... | 15:46 |
| *** lukebrowning has joined #openstack-infra | 15:47 | |
| mordred | now ... I think that whole approach could be improved upon - but the above patch should make the current bleeding better (I hope) | 15:47 |
| mordred | also - ++ to what AJaeger said about https://review.openstack.org/#/c/521145 | 15:47 |
| mordred | AJaeger: I think https://review.openstack.org/#/c/521557 is ready now too, yeah? | 15:48 |
| AJaeger | mordred: yes - see top of https://etherpad.openstack.org/p/merge-updated-pti-topic | 15:49 |
| AJaeger | mordred: I tried to put them in order for approval - but feel free to rearrange, the order is not the only one | 15:49 |
| AJaeger | .. only possible one | 15:49 |
| AJaeger | infra-root, https://etherpad.openstack.org/p/merge-updated-pti-topic gives all changes - but we can go one by one with delay... | 15:49 |
| mordred | AJaeger: ++ | 15:50 |
| dmsimard | AJaeger, mordred: +3 on sphinx but I left a comment | 15:50 |
| AJaeger | mordred: that's not all changes actually but the largest part. Once those are in, we have to take inventory again IMHO ;) | 15:50 |
| *** tosky has quit IRC | 15:51 | |
| AJaeger | dmsimard: thanks for +3 | 15:51 |
| * AJaeger will be back later | 15:51 | |
| mordred | dmsimard: good question! we should write up a faq on that, since that got asked over the weekend too ... | 15:51 |
| *** gcb has quit IRC | 15:51 | |
| dmsimard | mordred: yeah, I'm curious why it is necessary | 15:52 |
| *** lukebrowning has quit IRC | 15:52 | |
| mordred | dmsimard: the answer is - in 99% of the cases in our jobs where we're calling 'stat' - we are doing so to see if a file exists - so the extras that the stat module adds, calculating md5 and whatnot, is wasted cpu effort | 15:52 |
| pabelanger | we don't usually have issues creating git repos in our git.o.o right? Just replicating them to github.com | 15:52 |
| dmsimard | mordred: btw, now that you're (hopefully?) no longer sick, can we cut a shade 1.25.1 with the batching fix ? | 15:52 |
| mordred | dmsimard: yes! | 15:52 |
| AJaeger | config-core, could you review https://review.openstack.org/528580 (convert dashboard tox jobs) and https://review.openstack.org/528166 (add missing job descriptions) and https://review.openstack.org/525658 (improve zanata-cli download), please? | 15:52 |
| mordred | pabelanger: correct. I do not believe we have any issues creating repos on git.o.o - are we haveing github creation issues again? | 15:53 |
| *** armax has quit IRC | 15:53 | |
| pabelanger | mordred: no, was just trying to see if that was ever a case. Since if jeebpy failed to create the repo in git.o.o, then main.yaml would still fail. But, i couldn't think that has ever happened, and likey if did we might have larger issues | 15:54 |
| *** claudiub has quit IRC | 15:54 | |
| pabelanger | +3 528744 | 15:55 |
| *** r-daneel has joined #openstack-infra | 15:55 | |
| *** lukebrowning has joined #openstack-infra | 15:56 | |
| *** makowals has quit IRC | 15:57 | |
| dmsimard | btw an easy +3 to not receive one email a minute between 4:00 and 4:59 from the codesearch server: https://review.openstack.org/#/c/528617/ (and also fix the actual sync process) | 15:57 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Switch build-openstack-sphinx-docs to build-sphinx-docs https://review.openstack.org/521145 | 15:58 |
| pabelanger | jeblair: do you mind looking at kdc04.o.o and see if you are happy with it running as slave? if so, I'd like to see about removing kdc02.o.o (trusty) from realm | 15:58 |
| mordred | dmsimard, pabelanger, jeblair: regardless of our decision to embrace a future state of being on ansible rather than puppet, perhaps we should rewrite the manage projects stuff as native ansible rather than as a portion of the puppet config for those servers - as a utility playbook that gets kicked on changes to projects.yaml | 15:58 |
| pabelanger | I followed steps at https://docs.openstack.org/infra/system-config/kerberos.html#realm-creation to add it | 15:58 |
| dmsimard | mordred: I added puppet and ansible (and by extension, the ansiblify control plane spec) as a topic on tomorrow's infra meeting | 15:59 |
| dmsimard | I'm not thrilled about writing a puppet module to deploy the ARA node if we decide to go through with the puppetboard replacement -- I'll do it if I have to but... :) | 16:00 |
| mordred | dmsimard: cool. I *definitely* think we should rework project creation if we decide to ansiblify control plane - but I kinda think even if we didn't that inverting how we do manage projects could be a win | 16:00 |
| dmsimard | oh, strictly speaking about project creation you mean | 16:01 |
| cmurphy | oh are we having the rip-out-puppet talk again? :) | 16:01 |
| *** lukebrowning has quit IRC | 16:01 | |
| fungi | did it ever end? | 16:01 |
| dmsimard | cmurphy: we want to see if it's worth revisiting https://review.openstack.org/#/c/469983/ | 16:02 |
| dmsimard | considering we haven't upgraded to puppet 4 (or puppet 5) yet | 16:02 |
| jeblair | fungi: do you want to weigh in on https://review.openstack.org/528331 ? | 16:02 |
| cmurphy | fungi: well it ebbs and flows :) | 16:02 |
| fungi | touché | 16:02 |
| *** lukebrowning has joined #openstack-infra | 16:03 | |
| cmurphy | the upgrade to puppet 4 shouldn't really be that hard, it's been on my list for a while but my priorities keep shifting :( | 16:03 |
| *** dtantsur|afk has quit IRC | 16:03 | |
| pabelanger | well, ubuntu-bionic has puppet 4.10. We could work to get a DIB online of it, and start getting some testing in place on puppet4 shortly | 16:03 |
| dmsimard | jeblair: spaces instead of tabs in the zone file ? | 16:03 |
| jeblair | dmsimard: please read previous comments | 16:04 |
| cmurphy | the apply-test script already supports setting a puppet version so we just need a new apply test job that sets it | 16:04 |
| *** dtantsur has joined #openstack-infra | 16:04 | |
| cmurphy | and then make it voting | 16:04 |
| pabelanger | cmurphy: does that also bring in puppet4 from puppetlabs repo? | 16:05 |
| cmurphy | pabelanger: yes | 16:05 |
| pabelanger | kk | 16:05 |
| andreykurilin | hi folks! Is there a way to filter changes in merge confilct status? | 16:05 |
| pabelanger | in that case, we could get some jobs going now | 16:05 |
| cmurphy | yes | 16:05 |
| cmurphy | would be trivial | 16:05 |
| *** bobh has joined #openstack-infra | 16:07 | |
| pabelanger | I wonder if puppet upgrading puppet sould be sane or if we'd need to reprovision if we moved from puppet3 to puppet4 | 16:07 |
| *** felipemonteiro has joined #openstack-infra | 16:07 | |
| pabelanger | would* | 16:07 |
| *** Apoorva has joined #openstack-infra | 16:07 | |
| *** lukebrowning has quit IRC | 16:07 | |
| *** xarses has quit IRC | 16:08 | |
| cmurphy | i'm not sure if it's changed but i think it used to be the ansible task runs install_puppet.sh | 16:08 |
| cmurphy | so ansible upgrading puppet not puppet upgrading puppet | 16:08 |
| jeblair | cmurphy: i think that's still the case | 16:08 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/zuul-jobs master: Dereference symlinks when staging artefacts https://review.openstack.org/528748 | 16:08 |
| *** lukebrowning has joined #openstack-infra | 16:09 | |
| dmsimard | jeblair: added a comment about the serial | 16:09 |
| cmurphy | so then if install_puppet.sh works correctly it should hopefully gracefully handle the upgrade | 16:09 |
| pabelanger | doesn't puppet-puppet do it? | 16:09 |
| pabelanger | looking now | 16:09 |
| jeblair | dmsimard: ack. i agree those are things worth tackling. shouldn't be an issue until we're somewhat higher volume, so i think we can do them later. | 16:10 |
| jeblair | dmsimard: eg, have puppet rewrite the serial when it updates. | 16:11 |
| *** r-daneel_ has joined #openstack-infra | 16:11 | |
| dmsimard | jeblair: if we choose the unix time serial format (over date serial format) I don't think it's something we can change later because the date number would be smaller ? | 16:11 |
| dmsimard | I'm not sure actually /me looks | 16:11 |
| *** r-daneel has quit IRC | 16:11 | |
| *** r-daneel_ is now known as r-daneel | 16:11 | |
| cmurphy | pabelanger: it might technically but it should basically be a noop because the script should have already done it | 16:11 |
| dmsimard | 1513365986 vs, say, 2017121801 | 16:11 |
| jeblair | dmsimard: we can restart the servers | 16:12 |
| *** benj_ has joined #openstack-infra | 16:12 | |
| dmsimard | the date format is larger, though, so we should be good if we decide the change our mind | 16:12 |
| fungi | dmsimard: jeblair: yeah, serial rollover isn't super hard (though having slaves makes it a multi-step process) | 16:13 |
| jeblair | dmsimard: i also think an automated solution is likely to be easier with timestamps anyway | 16:13 |
| dmsimard | jeblair: yeah, if it's going to be automated, unix time is fine | 16:13 |
| jeblair | so i'd bet on it staying the same | 16:13 |
| dmsimard | date format is better for humans | 16:13 |
| jeblair | (some) humans | 16:13 |
| * dmsimard is a human | 16:13 | |
| pabelanger | cmurphy: okay, I wasn't aware install_puppet.sh ran any other time then when we first bring online a server | 16:14 |
| *** lukebrowning has quit IRC | 16:14 | |
| * jeblair may not meet dmsimard's definition of human | 16:14 | |
| dmsimard | jeblair: actually, when you're not in the united states it's super confusing | 16:14 |
| dmsimard | because the date is either YYYYMMDD or YYYYDDMM | 16:14 |
| dmsimard | when there's no number greater than 12, it's a real problem | 16:14 |
| pabelanger | also, I am not sure we use puppet-puppet any more. possible it was only used in DIB | 16:15 |
| *** tosky has joined #openstack-infra | 16:15 | |
| dmsimard | In most official documents in Canada, you can't write numbers, you have to spell out the month (or it's abbreviation) | 16:15 |
| *** lukebrowning has joined #openstack-infra | 16:15 | |
| *** leakypipes is now known as jaypipes | 16:15 | |
| dmsimard | Part of it perhaps comes from the fact that in french, you pronounce the day before the month | 16:17 |
| *** esberglu has joined #openstack-infra | 16:17 | |
| dmsimard | ex January 1 vs 1 Janvier | 16:17 |
| dmsimard | ¯\_(ツ)_/¯ | 16:17 |
| fungi | didn't iso 8601 solve all of this? ;) | 16:18 |
| openstackgerrit | Merged openstack-infra/system-config master: Put hound sync lock in /var/run https://review.openstack.org/528617 | 16:18 |
| *** lukebrowning has quit IRC | 16:20 | |
| cmurphy | pabelanger: hmm i expected it to either be in system-config/playbooks or in ansible-role-puppet but I'm not finding it, so I might be wrong | 16:20 |
| *** lukebrowning has joined #openstack-infra | 16:21 | |
| *** ijw has joined #openstack-infra | 16:22 | |
| pabelanger | cmurphy: np, will dig more into it later. But agree, first step we can get some puppet 4 jobs running now in system-config. Might propose some patches later today to see how it works :) | 16:23 |
| cmurphy | sweet | 16:23 |
| cmurphy | okay yeah it's just launch-node.py that runs install_puppet.sh and then there's an update-puppet.yaml playbook that actually updates the puppet modules and ansible roles but not puppet itself | 16:26 |
| *** lukebrowning has quit IRC | 16:26 | |
| *** ijw has quit IRC | 16:27 | |
| *** ijw has joined #openstack-infra | 16:27 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add zuul scheduler to the git/gerrit puppet sequence https://review.openstack.org/528744 | 16:29 |
| *** jcoufal has joined #openstack-infra | 16:30 | |
| *** jcoufal_ has quit IRC | 16:32 | |
| *** ijw has quit IRC | 16:32 | |
| *** Goneri has joined #openstack-infra | 16:35 | |
| *** trown|afk has quit IRC | 16:37 | |
| *** lukebrowning has joined #openstack-infra | 16:38 | |
| *** catintheroof has joined #openstack-infra | 16:38 | |
| *** andreas_s has quit IRC | 16:38 | |
| *** andreas_s has joined #openstack-infra | 16:39 | |
| *** dmsimard is now known as dmsimard|afk | 16:39 | |
| openstackgerrit | Javier Peña proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/528739 | 16:41 |
| andreaf | infra-core: any idea about this? I have 7 or 8 sphinx jobs failing on this http://logs.openstack.org/06/527106/5/check/build-openstack-sphinx-docs/491d636/job-output.txt.gz#_2017-12-18_16_28_48_121174 | 16:42 |
| *** jpena is now known as jpena|brb | 16:42 | |
| *** lukebrowning has quit IRC | 16:42 | |
| pabelanger | AJaeger: ^related to sphinx work recently? | 16:43 |
| pabelanger | andreaf: I think we just merged some changes to docs, but I haven't followed too much | 16:43 |
| andreaf | AJaeger, pabelanger: it looks like I'm missing doc/requirements.txt in devstack, but that was not required beforeafaik | 16:44 |
| andreaf | http://logs.openstack.org/06/527106/5/check/build-openstack-sphinx-docs/491d636/ara/result/a138d53d-2272-4112-bc8f-f439fb1dcb00/ | 16:44 |
| pabelanger | yah | 16:44 |
| *** lukebrowning has joined #openstack-infra | 16:44 | |
| andreaf | AJaeger, pabelanger: any idea what I should put in there? | 16:44 |
| andreaf | AJaeger, pabelanger: or why is it needed now? | 16:44 |
| pabelanger | andreaf: I am not sure myself, it would see it is required now. But should be a simply patch to make it optional. cc AJaeger mordred | 16:45 |
| *** annp_ has joined #openstack-infra | 16:45 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zone-zuul-ci.org master: Initial commit https://review.openstack.org/528331 | 16:45 |
| *** catintheroof has quit IRC | 16:45 | |
| *** andreas_s has quit IRC | 16:47 | |
| andreaf | pabelanger: yeah I guess this breaks a lot of gates :) | 16:47 |
| pabelanger | yah, working on a patch | 16:47 |
| *** armaan has joined #openstack-infra | 16:47 | |
| andreaf | pabelanger: thanks! | 16:48 |
| *** makowals has joined #openstack-infra | 16:48 | |
| *** lukebrowning has quit IRC | 16:49 | |
| *** lukebrowning has joined #openstack-infra | 16:50 | |
| pabelanger | okay | 16:51 |
| pabelanger | I see issue | 16:51 |
| *** vhosakot has joined #openstack-infra | 16:51 | |
| *** jamesmcarthur has quit IRC | 16:52 | |
| pabelanger | We now epect atleast 1 or doc/requirements.txt test-requirements.txt | 16:52 |
| clarkb | infra-root I've approved a change to statusbot that shouldn't cause any trouble but if you notice it not working or acting funny the git log may be the place to look (I'll keep an eye on it myself) | 16:52 |
| pabelanger | otherwise, we fail | 16:52 |
| pabelanger | but, don't know why that is | 16:52 |
| *** tosky has quit IRC | 16:52 | |
| *** makowals has quit IRC | 16:53 | |
| notmyname | fungi: I have 200+ review emails with your name on them this morning. the first few are "removed reviewer jenkins...". how much do I need to pay attention to these emails? | 16:53 |
| *** jamesmcarthur has joined #openstack-infra | 16:53 | |
| fungi | notmyname: not at all, but you may want to see http://lists.openstack.org/pipermail/openstack-dev/2017-December/125684.html | 16:54 |
| notmyname | fungi: thanks :-) | 16:54 |
| notmyname | fungi: hadn't gotten to the 260+ unread emails yet ;-) | 16:54 |
| *** felipemonteiro has quit IRC | 16:55 | |
| *** slaweq_ has joined #openstack-infra | 16:55 | |
| notmyname | ah, perfect. sounds good | 16:55 |
| *** lukebrowning has quit IRC | 16:55 | |
| fungi | notmyname: yep, i filter review comments from gerrit into a different inbox and read ml posts before gerrit comments that way, but i sometimes forget not everyone follows that same pattern ;) | 16:56 |
| notmyname | I do the split too, but normally review comments are smaller than the rest of the openstack MLs :-) | 16:56 |
| *** ihrachys has joined #openstack-infra | 16:56 | |
| notmyname | so I just reverse the read order, normally | 16:56 |
| *** lukebrowning has joined #openstack-infra | 16:57 | |
| fungi | got it. i've found in the past that having context from ml discussions helps me better assess related changes, but i can see how the reverse might be just as true | 16:57 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Revert "Switch build-openstack-sphinx-docs to build-sphinx-docs" https://review.openstack.org/528760 | 16:57 |
| *** andreas_s has joined #openstack-infra | 16:57 | |
| *** jamesmcarthur has quit IRC | 16:58 | |
| pabelanger | infra-root: config-core: I've proposed a revert of our sphinx changes this morning, it appears to have broken devstack doc jobs, plus some others^ | 16:58 |
| pabelanger | I haven't been following the latest changes so unsure how to best move forward for now | 16:59 |
| *** slaweq_ has quit IRC | 17:00 | |
| *** armax has joined #openstack-infra | 17:00 | |
| *** rwsu has joined #openstack-infra | 17:01 | |
| *** myoung is now known as myoung|brb | 17:01 | |
| *** lukebrowning has quit IRC | 17:02 | |
| *** myoung|brb is now known as myoung | 17:02 | |
| *** annp_ has quit IRC | 17:02 | |
| *** lucasagomes is now known as lucas-afk | 17:03 | |
| *** lukebrowning has joined #openstack-infra | 17:03 | |
| mordred | pabelanger: can you point me to the broken things? | 17:04 |
| *** gyee has joined #openstack-infra | 17:04 | |
| mordred | pabelanger: I can probably make a patch to fix the issue pretty quickly | 17:04 |
| pabelanger | mordred: sure; http://logs.openstack.org/06/527106/5/check/build-openstack-sphinx-docs/491d636/job-output.txt.gz#_2017-12-18_16_28_47_511571 | 17:05 |
| mordred | pabelanger: thanks | 17:05 |
| *** makowals has joined #openstack-infra | 17:06 | |
| pabelanger | so, looks like projects without test-requirements.txt or doc/requirements are failing | 17:06 |
| fungi | seems we just needed a third case to skip loading either if neither exist? | 17:07 |
| *** lukebrowning has quit IRC | 17:08 | |
| *** lukebrowning has joined #openstack-infra | 17:09 | |
| *** hemna_ has quit IRC | 17:10 | |
| *** felipemonteiro has joined #openstack-infra | 17:11 | |
| *** trown has joined #openstack-infra | 17:12 | |
| *** trown has quit IRC | 17:12 | |
| mordred | pabelanger: https://review.openstack.org/528766 Add doc/requirements.txt file with doc requirements | 17:12 |
| mordred | that should fix it | 17:12 |
| *** jpich has quit IRC | 17:13 | |
| mordred | fungi: no - we need to fix the repos where thathappens - so far the cases where it has happened is repos where the requirements have been put in strange places | 17:13 |
| *** felipemonteiro_ has joined #openstack-infra | 17:13 | |
| *** jamesmcarthur has joined #openstack-infra | 17:13 | |
| *** chandankumar is now known as {aborted} | 17:14 | |
| mordred | fungi: now - I *do* think we should probably update the ensure-sphinx role to check to see if there is a doc extra if there is no doc/requirements.txt found (which would address the taskflow case - and is likely a completely fair way to want to do that) | 17:14 |
| *** trown has joined #openstack-infra | 17:14 | |
| *** lukebrowning has quit IRC | 17:14 | |
| *** trown has quit IRC | 17:14 | |
| pabelanger | okay, so doc/requirements.txt is need from now on | 17:14 |
| openstackgerrit | Merged openstack-infra/zone-zuul-ci.org master: Initial commit https://review.openstack.org/528331 | 17:14 |
| *** lukebrowning has joined #openstack-infra | 17:16 | |
| *** andreas_s has quit IRC | 17:16 | |
| *** trown has joined #openstack-infra | 17:16 | |
| *** felipemonteiro has quit IRC | 17:17 | |
| *** trown is now known as trown|ruck | 17:17 | |
| *** jascott1 has joined #openstack-infra | 17:17 | |
| *** Apoorva has quit IRC | 17:17 | |
| *** jamesmcarthur has quit IRC | 17:20 | |
| *** hemna_ has joined #openstack-infra | 17:20 | |
| *** lukebrowning has quit IRC | 17:20 | |
| *** jascott1 has quit IRC | 17:21 | |
| *** makowals has quit IRC | 17:21 | |
| *** lukebrowning has joined #openstack-infra | 17:22 | |
| *** r-daneel_ has joined #openstack-infra | 17:22 | |
| *** r-daneel has quit IRC | 17:23 | |
| *** r-daneel_ is now known as r-daneel | 17:23 | |
| *** catintheroof has joined #openstack-infra | 17:23 | |
| *** armaan has quit IRC | 17:24 | |
| *** armaan has joined #openstack-infra | 17:24 | |
| *** lukebrowning has quit IRC | 17:27 | |
| *** jpena|brb is now known as jpena | 17:27 | |
| *** lukebrowning has joined #openstack-infra | 17:28 | |
| *** jamesmcarthur has joined #openstack-infra | 17:28 | |
| *** ijw has joined #openstack-infra | 17:28 | |
| *** jascott1 has joined #openstack-infra | 17:29 | |
| *** catintheroof has quit IRC | 17:30 | |
| clarkb | mordred: pabelanger if we are going to roll forward and not use that revert it is probably worth an email to the mailing list? | 17:31 |
| *** pas-ha has left #openstack-infra | 17:31 | |
| *** lukebrowning has quit IRC | 17:33 | |
| mordred | clarkb: yah - I can write one - AJaeger and I *should* have found most of them, but I imagine there will be a few edge cases we didn't find | 17:34 |
| *** ijw has quit IRC | 17:34 | |
| clarkb | I've +2'd the devstack change to fix that repo at least. Maybe jeblair can be second reviewer on it? | 17:34 |
| mordred | clarkb: I'd like to see if we can avoid the revert - unless the bleeding becomes too much | 17:34 |
| *** lukebrowning has joined #openstack-infra | 17:34 | |
| pabelanger | yah, I've abandoned the revert for now | 17:35 |
| pabelanger | +1 to ML post | 17:35 |
| *** lukebrowning has quit IRC | 17:39 | |
| *** lukebrowning has joined #openstack-infra | 17:41 | |
| jeblair | clarkb, pabelanger, mordred: done | 17:43 |
| *** aarefiev has quit IRC | 17:44 | |
| *** lukebrowning has quit IRC | 17:45 | |
| *** sambetts is now known as sambetts|afk | 17:47 | |
| *** lukebrowning has joined #openstack-infra | 17:47 | |
| *** rkukura has quit IRC | 17:47 | |
| *** amoralej is now known as amoralej|off | 17:49 | |
| fungi | dmsimard|afk: not sure if this is a bug in newer ara or something weird with my system/browser, but if i attempt to expand the tasks for tag.yaml on http://logs.openstack.org/a2/a2e8f393ed7bf03d29f083aa956f3989c33a6050/release-post/tag-releases/ebe2c41/ara/ it just spins indefinitely with "Loading task results..." (firefox 52.3.0) | 17:51 |
| mordred | infra-root, config-core: https://etherpad.openstack.org/p/URCnVSwY5v - draft mailing list message about sphinx jobs | 17:52 |
| *** lukebrowning has quit IRC | 17:52 | |
| *** derekh has quit IRC | 17:52 | |
| *** jamesmcarthur has quit IRC | 17:52 | |
| *** andreas_s has joined #openstack-infra | 17:53 | |
| *** jamesmcarthur has joined #openstack-infra | 17:53 | |
| *** lukebrowning has joined #openstack-infra | 17:53 | |
| clarkb | mordred: lgtm | 17:55 |
| clarkb | did some minor edits | 17:55 |
| *** andreas_s has quit IRC | 17:57 | |
| mordred | sweet. also, the devstack patch has passed the docs job, so yay | 17:57 |
| frickler | mordred: I have some other sphinx breakage which seems related to autogenerated api docs. old: http://logs.openstack.org/08/526008/2/check/build-openstack-sphinx-docs/1d1bc67/job-output.txt.gz#_2017-12-08_11_09_52_293892 new+broken: http://logs.openstack.org/08/526008/2/gate/build-openstack-sphinx-docs/ebcda8e/job-output.txt.gz#_2017-12-18_16_03_36_083690 | 17:58 |
| *** lukebrowning has quit IRC | 17:58 | |
| *** udesale has quit IRC | 17:58 | |
| *** lukebrowning has joined #openstack-infra | 18:00 | |
| mordred | frickler: looking | 18:00 |
| *** ijw has joined #openstack-infra | 18:01 | |
| fungi | mordred: i think that announcement is missing a summary of what our ci system runs to build sphinx docs for projects now | 18:01 |
| clarkb | mordred: fungi maybe link to the PTI for that? | 18:02 |
| fungi | like, in the past if we wanted to know whether the docs jobs in the ci system would work, we could run `tox -e venv -- python setup.py build_sphinx` | 18:02 |
| mordred | ah. kk. one sec | 18:02 |
| fungi | so, yes, assuming the pti has that (i seem to recall it did but double-checking now) a link to it would help | 18:02 |
| clarkb | ya I had to look it up earlier when figuring out what was going on | 18:03 |
| fungi | https://governance.openstack.org/tc/reference/project-testing-interface.html#documentation does indeed come pretty close anyway | 18:03 |
| *** harlowja has joined #openstack-infra | 18:04 | |
| *** ijw has joined #openstack-infra | 18:04 | |
| fungi | a bit hand-wavey about installing your deps (like, in my case i'll likely emulate tox anyway by creating a venv to install sphinx and any required extensions into so that i don't end up installing stuff as root) | 18:04 |
| *** lukebrowning has quit IRC | 18:04 | |
| fungi | still on the fence about this pti change for documentation building, since tox provided a lot of useful dependency handling and we've now said that since people outside the openstack community don't appreciate convenient dependency handling we should stop recommending it | 18:06 |
| *** lukebrowning has joined #openstack-infra | 18:06 | |
| clarkb | ya I'm not sure why tox is a bad thing for doc building if I'm writing docs for Go or js | 18:06 |
| clarkb | it happens to be a tool that solves a problem | 18:06 |
| clarkb | (if we don't want a top level requirements.txt to avoid confusion thats fine) | 18:07 |
| *** wolverineav has joined #openstack-infra | 18:07 | |
| fungi | i suppose outside of python-based projects, the odds that you'll already have tox installed go way down, and so installing tox might be more of a pain than manually installing sphinx and required extensions | 18:08 |
| *** jascott1 has quit IRC | 18:10 | |
| fungi | but in that case, i expect you'd be better off putting the relevant system packages for sphinx and its extensions in your bindep.txt instead so you can at least use your distro's prepackaged versions (and just avoid using sphinx extensions which aren't already well-supported by major lts distros) | 18:10 |
| *** hashar is now known as hasharDockerEat | 18:10 | |
| mordred | fungi, clarkb ok - updated to add the command then updated the todo section at the end to let people know what their [docs] env should look like | 18:11 |
| * mordred reads scrollback | 18:11 | |
| *** lukebrowning has quit IRC | 18:11 | |
| *** lukebrowning has joined #openstack-infra | 18:12 | |
| mordred | fungi: you know ... now that you say that above - maybe we should not fail hard if no test-requirements.txt or doc/requirements.txt are found ... the 'just put them in bindep.txt' is a great fallback | 18:13 |
| *** ijw has quit IRC | 18:13 | |
| mordred | or, rather, is a great story for folks who aren't python and who also don't have any extensions | 18:13 |
| andreaf | mordred: well, we don't have a docs/requirements.txt in either devstack or tempest so we cannot merge changes | 18:14 |
| mordred | andreaf: https://review.openstack.org/#/c/528766/ | 18:14 |
| openstackgerrit | Javier Peña proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/528739 | 18:14 |
| andreaf | mordred: ok thanks | 18:15 |
| *** lukebrowning has quit IRC | 18:17 | |
| *** ijw_ has joined #openstack-infra | 18:18 | |
| *** lukebrowning has joined #openstack-infra | 18:18 | |
| *** Apoorva has joined #openstack-infra | 18:21 | |
| *** Apoorva has quit IRC | 18:21 | |
| *** wolverineav has quit IRC | 18:21 | |
| jeblair | fungi: since all our housts run recursive resolvers, there will be a conflict between unbound and the authoritative resolver. should we configure nsd/bind to also be recursive resolvers for local queries, or not run unbound and set local resolution to 8.8.8.8 or something? | 18:22 |
| *** Apoorva has joined #openstack-infra | 18:22 | |
| *** ijw_ has quit IRC | 18:22 | |
| *** wolverineav has joined #openstack-infra | 18:23 | |
| clarkb | jeblair: I think unbound only listens on loopback | 18:23 |
| *** lukebrowning has quit IRC | 18:23 | |
| clarkb | jeblair: so we could have nsd/bind listen on the external interface and it should work? | 18:23 |
| fungi | well, you'd have to stop bind from listening on the loopback regardless to run unbound there | 18:23 |
| fungi | but yeah, that's one way | 18:23 |
| jeblair | oh, that might work. i can try that. | 18:24 |
| fungi | on my nameservers i've been doing option #2 (set recursion=no and then use remote resolvers in /etc/resolv.conf) | 18:24 |
| *** lukebrowning has joined #openstack-infra | 18:25 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Deal with lack of requirements file better https://review.openstack.org/528781 | 18:25 |
| mordred | fungi, AJaeger: ^^ something like that perhaps | 18:25 |
| fungi | if the only service being provided is dns, then it shouldn't itself rely on a local resolver for much besides rudimentary general tasks like package updates and sending cronspam | 18:25 |
| fungi | but for consistency's sake i like the unbound on loopback bind on external option | 18:26 |
| *** rhallisey has joined #openstack-infra | 18:26 | |
| *** e0ne has quit IRC | 18:26 | |
| jeblair | fungi: yes. also, updating the git repos with the zone data. :) | 18:26 |
| fungi | oh, right that ;) | 18:26 |
| jeblair | fungi: "listen-on: !localhost" maybe? | 18:26 |
| *** ijw has joined #openstack-infra | 18:26 | |
| *** ijw has quit IRC | 18:26 | |
| fungi | listen-on-v6 { !localhost; }; | 18:27 |
| fungi | hopefully? | 18:27 |
| jeblair | fungi: oh, yes, i see how that works. i assumed both, but i see -v6 supercedes. | 18:27 |
| fungi | i haven't tried !localhost so not entirely certain | 18:28 |
| *** shardy has quit IRC | 18:28 | |
| mordred | infra-root: we ok with the current draft of the sphinx email? I'mma send it if so | 18:28 |
| *** rbrndt has quit IRC | 18:28 | |
| mordred | frickler: btw - I haven't forgotten about you ... AJaeger, when you're back, I feel like we dealt with a thing similar to frickler's python-designateclient issue before but I can't remember what we did exactly - I'd love to see if you remember before I re-solve the issue from scratch | 18:29 |
| jeblair | fungi: i don't see an option like that for nsd... :/ | 18:29 |
| fungi | mordred: lgtm. i appreciate the command summary, and the linked change does at least indirectly link to the pti from review comments | 18:29 |
| clarkb | mordred: why does the docs tox target include both requirements.txt? | 18:29 |
| *** electrofelix has quit IRC | 18:29 | |
| *** lukebrowning has quit IRC | 18:30 | |
| fungi | clarkb: presumably to avoid installing the project itself? | 18:30 |
| clarkb | why have a doc/requirements.txt then? | 18:30 |
| fungi | oh, i get what you're asking | 18:30 |
| fungi | why install the project's dependencies at all | 18:31 |
| clarkb | lines 70 and 71 in the etherpad | 18:31 |
| fungi | the other tricky bit which we worked out a solution for with tox was applying constraints | 18:31 |
| mordred | clarkb: for *openstack* projects it's important to list requirements because we want to make sure they get installed with constraints applied | 18:31 |
| *** lukebrowning has joined #openstack-infra | 18:31 | |
| mordred | for things that are not following constraints, requirements.txt can totally be left off of the docs env | 18:31 |
| clarkb | mordred: but not for docs building right? we only need the docs requirements with constraints applied? | 18:31 |
| mordred | no - for python projects, sphinx wants the project installed so it can import the project and do introspection of the python objects to do api docs | 18:32 |
| fungi | jeblair: does it maybe have an option for specifying the listening interface name? | 18:32 |
| clarkb | mordred: gotcha | 18:32 |
| * fungi is hunting in nsd manpages | 18:32 | |
| jeblair | fungi: looks like only ip addrs | 18:32 |
| fungi | so far only seeing options for a list of ip addresses or everything | 18:33 |
| fungi | yeah :/ | 18:33 |
| *** ralonsoh has quit IRC | 18:33 | |
| mordred | clarkb: after we get back from winter break, I imagine writing up a proposal to switch to using the new Pipfile stuff, my misgivings about the direction the python packaging ecosystem is going in notwithstanding | 18:33 |
| clarkb | mordred: fun | 18:33 |
| mordred | clarkb: since I *believe* it actually handles both the requirements and the concept of them having constrained versions much better - and should allow us to shed some layers of complexity | 18:33 |
| clarkb | fwiw I think a lot of our homegrown solutions to these problems can be deprecated and put out to pasture which is potentially a very good thing | 18:33 |
| mordred | clarkb: ++ | 18:34 |
| clarkb | ya pipfile is basically constraints + requirements in one with better checks | 18:34 |
| clarkb | the hash checking is a super nice feature if you want to pull in random sdists for example | 18:34 |
| *** xarses has joined #openstack-infra | 18:34 | |
| jeblair | i don't suppose we have a good way of getting a list of non-local ipv4 and ipv6 addresses in puppet? | 18:35 |
| *** lukebrowning has quit IRC | 18:36 | |
| *** catintheroof has joined #openstack-infra | 18:36 | |
| clarkb | facter does expose that info iirc not sure how easy it is to separate the non local addrs though | 18:36 |
| fungi | in theory we could get a list of addresses and then filter out ::1 and anything in 127.0.0.0/8? | 18:36 |
| *** catintheroof has quit IRC | 18:36 | |
| *** catintheroof has joined #openstack-infra | 18:36 | |
| *** catintheroof has quit IRC | 18:36 | |
| fungi | granted that's ugly/hacky | 18:37 |
| *** lukebrowning has joined #openstack-infra | 18:37 | |
| mordred | jeblair: sorry - not fllowing super well - 'non-local' addresses - which type do you mean? | 18:38 |
| jeblair | mordred: ip addresses that are not localhost | 18:38 |
| mordred | ah - gotcha. thanks | 18:38 |
| pabelanger | $::interfaces is a thing in puppet, you could loop over and ignore lo | 18:40 |
| jeblair | pabelanger: is that ip addresses? | 18:40 |
| mordred | jeblair: facter provides an 'interfaces' value, which is a comma-separated list - one could grab that, filter 'lo' - then look for "ipaddress_{{ item }}" - which is the ip address for the interface in question | 18:40 |
| pabelanger | jeblair: no, you'll need to then use ipaddress_eth0, ipaddress_eth1 | 18:40 |
| pabelanger | that will be the IP | 18:41 |
| jeblair | what about ipv6? | 18:41 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix misleading message about statsd not installed https://review.openstack.org/528785 | 18:41 |
| pabelanger | ipaddress6_eth0 | 18:41 |
| mordred | jeblair: http://paste.openstack.org/show/629233/ is an example from my laptop, fwiw | 18:41 |
| *** lukebrowning has quit IRC | 18:42 | |
| mordred | and yah - I agree with pabelanger on ipaddress6_ ... | 18:42 |
| jeblair | what's $ipaddress and $ipaddress6 ? (with no suffix?) | 18:42 |
| pabelanger | I think iterface with default route? | 18:43 |
| mordred | jeblair: looking ... http://paste.openstack.org/show/629234/ is the same thing for review-dev.o.o | 18:43 |
| pabelanger | not sure, but ipaddress and ipaddress_eth0 are the same for me | 18:43 |
| jeblair | maybe that's good enough for our purposes? | 18:44 |
| mordred | they are not the same for my laptop for reasons I don't understand | 18:44 |
| pabelanger | Return the IPv4 address for the default network interface. | 18:44 |
| pabelanger | https://puppet.com/docs/facter/3.9/core_facts.html#ipaddress | 18:44 |
| pabelanger | legacy fact, not sure what that means | 18:44 |
| mordred | my default gw is on wlp3s0 - but you can see that it has used the value from ipaddress_br_33993c84d744 as my ipaddress | 18:44 |
| jeblair | it seems to dtrt on a rax server | 18:45 |
| mordred | yah. so we can probably ignore my laptop until we want my laptop to be a dns server | 18:45 |
| jeblair | mordred: i can live with that :) | 18:45 |
| *** makowals has joined #openstack-infra | 18:46 | |
| *** lukebrowning has joined #openstack-infra | 18:48 | |
| *** makowals has quit IRC | 18:48 | |
| clarkb | DR plan: mordreds laptop | 18:49 |
| mordred | fungi, clarkb: k. I added some more links to the actual PTI docs, as well as slightly more words about the constraints file and requirements.txt file in the todo section | 18:51 |
| mordred | fungi, clarkb: look ok now? | 18:51 |
| clarkb | looking | 18:52 |
| fungi | lgtm | 18:52 |
| clarkb | mordred: lines 80 and 81 can be removed ya? | 18:52 |
| *** lukebrowning has quit IRC | 18:53 | |
| *** lukebrowning has joined #openstack-infra | 18:54 | |
| *** slaweq_ has joined #openstack-infra | 18:56 | |
| *** catintheroof has joined #openstack-infra | 18:56 | |
| pabelanger | clarkb: any think we should check before stopping kdc02.o.o? kdc04.o.o is now online and getting updates from kdc01.o.o | 18:57 |
| clarkb | pabelanger: are the appropriate 02 dns records removed first? | 18:57 |
| pabelanger | clarkb: not yet, they are still online | 18:58 |
| *** dmsimard|afk is now known as dmsimard | 18:58 | |
| pabelanger | wasn't sure which order to do | 18:58 |
| clarkb | we might want to pull the dns records first so that 02 is not used then stop the service | 18:58 |
| pabelanger | sure | 18:58 |
| mordred | clarkb: yes. htank you | 18:59 |
| clarkb | mordred: other than that lgtm ship it | 18:59 |
| *** lukebrowning has quit IRC | 18:59 | |
| *** CrayZee has joined #openstack-infra | 19:00 | |
| *** lukebrowning has joined #openstack-infra | 19:00 | |
| *** slaweq_ has quit IRC | 19:00 | |
| pabelanger | okay, kd02.o.o A/AAAA and SRV records removed | 19:00 |
| openstackgerrit | Javier Peña proposed openstack-infra/puppet-openstackci master: Add AFS mirror support https://review.openstack.org/528739 | 19:01 |
| *** ijw has joined #openstack-infra | 19:01 | |
| *** jpena is now known as jpena|off | 19:01 | |
| jeblair | pabelanger, mordred, clarkb, fungi: $::ipaddress and $::ipaddress6 both seem to be working for this with both nsd and bind. thanks :) | 19:03 |
| clarkb | jeblair: woot | 19:03 |
| fungi | neat | 19:03 |
| pabelanger | yay | 19:03 |
| mordred | jeblair: woot | 19:05 |
| *** lukebrowning has quit IRC | 19:05 | |
| *** lukebrowning has joined #openstack-infra | 19:07 | |
| *** e0ne has joined #openstack-infra | 19:07 | |
| *** ijw has quit IRC | 19:08 | |
| *** rkukura has joined #openstack-infra | 19:09 | |
| *** rhallisey has quit IRC | 19:09 | |
| *** jascott1 has joined #openstack-infra | 19:10 | |
| *** lukebrowning has quit IRC | 19:11 | |
| *** lukebrowning has joined #openstack-infra | 19:13 | |
| AJaeger | mordred: coming back slowly... | 19:14 |
| AJaeger | mordred: let me look at frickler's problem | 19:14 |
| mordred | AJaeger: I've got a patch for it - but there is a wider issue I thnk we need a different patch for - working on that | 19:15 |
| mordred | AJaeger: sorry, I should have mentioned I started poking | 19:15 |
| *** kjackal has quit IRC | 19:16 | |
| *** smatzek_ has joined #openstack-infra | 19:16 | |
| AJaeger | mordred: looking at frickler's python-designateclient: I fear we forgot about that one ;( octavia - change https://review.openstack.org/521211 - might be related | 19:17 |
| *** lukebrowning has quit IRC | 19:17 | |
| *** trown|ruck has quit IRC | 19:18 | |
| frickler | AJaeger: mordred: I think there are a lot more, keystone e.g. is failing, too. probably everyone using "[pbr] autodoc_tree_index_modules = True" | 19:18 |
| dmsimard | fungi: re: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2017-12-18.log.html#t2017-12-18T17:51:52 | 19:18 |
| *** trown has joined #openstack-infra | 19:18 | |
| dmsimard | fungi: not a bug in ARA, the data is incomplete (see the grey icon on the far left) | 19:18 |
| dmsimard | fungi: so it means that playbook either crashed (hard) or timed out | 19:19 |
| *** trown is now known as trown|ruck | 19:19 | |
| fungi | oh, thanks | 19:19 |
| dmsimard | or was interrupted in any other way | 19:19 |
| fungi | and yeah, timed out | 19:19 |
| *** smatzek has quit IRC | 19:19 | |
| *** lukebrowning has joined #openstack-infra | 19:19 | |
| dmsimard | basically ara doesn't have a way to know if a playbook is either in progress or is incomplete | 19:19 |
| dmsimard | since ansible only provides the start and the end of things, it knows there's something that started.. but if it never ends | 19:20 |
| dmsimard | ¯\_(ツ)_/¯ | 19:20 |
| dmsimard | fungi: also, that report was generated on 0.14.2 which means our hack to update ara on the executors isn't working (or it'd be 0.14.5) | 19:21 |
| dmsimard | I'll take a quick look before I get sidetracked. | 19:21 |
| dmsimard | yeah.. ara==0.14.0 on ze02 | 19:22 |
| AJaeger | mordred: no worries - waiting for your comments. | 19:22 |
| *** rbrndt has joined #openstack-infra | 19:22 | |
| dmsimard | oh wait, the patch to update ara hasn't even merged yet -- I was convinced that had landed: https://review.openstack.org/#/c/516740/ | 19:23 |
| dmsimard | clarkb: did you see fungi's comment in ^ ? | 19:24 |
| *** lukebrowning has quit IRC | 19:24 | |
| clarkb | dmsimard: ya I was waiting for report back from fungi's test | 19:24 |
| AJaeger | jeblair, fungi, mordred, clarkb, pabelanger : The other thing regarding the docs job: We have projects that install not only themselves but also neutron and some other projects. The docs publish job is a final one, so we cannot add those on a per project base. So, they currently fail. mordred's change solve this as well - if we consider them a dead-end, we need to probably remove the final: true from | 19:24 |
| AJaeger | the docs publishing job. | 19:24 |
| *** lukebrowning has joined #openstack-infra | 19:25 | |
| dmsimard | clarkb: ok I -W'd to make sure it doesn't merge | 19:25 |
| dmsimard | cause the depended-on patch merged, it surely hasn't triggered the gate automatically | 19:26 |
| clarkb | fungi: do you have that info yet ^ | 19:26 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Deal with lack of requirements file better https://review.openstack.org/528781 | 19:28 |
| fungi | clarkb: oh, i probably used improper tenses in that comment. i have it working for puppet-subunit2sql as of last week | 19:28 |
| clarkb | fungi: ah cool. do you want to push a new patchset or should I? | 19:28 |
| clarkb | (Ican dig up your changes to subunit2sql easily enough) | 19:28 |
| fungi | i'll do it | 19:28 |
| clarkb | ok | 19:28 |
| *** lukebrowning has quit IRC | 19:30 | |
| *** hasharDockerEat is now known as hashar | 19:30 | |
| *** CrayZee has left #openstack-infra | 19:31 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-zuul master: Ensure ara is updated on executors https://review.openstack.org/516740 | 19:31 |
| *** rhallisey has joined #openstack-infra | 19:31 | |
| fungi | clarkb: dmsimard: ^ that matches the implementation in puppet-subunit2sql (except for s/pip/pip3/) | 19:32 |
| *** lukebrowning has joined #openstack-infra | 19:32 | |
| * dmsimard looks | 19:32 | |
| AJaeger | ianw, could you review https://review.openstack.org/525658 , please? dmsimard wants you to look, he gave a procedural -1 on that... | 19:32 |
| dmsimard | fungi: lgtm, only thing I'm not sure about at first glance is the double escape "\\" | 19:33 |
| dmsimard | fungi: iirc I had manually tested clarkb's approach and it seemed to work fine but I could be wrong | 19:33 |
| dmsimard | I'll search through my logs, hang on | 19:34 |
| dmsimard | excerpt here: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2017-11-30.log.html#t2017-11-30T19:58:09 | 19:36 |
| *** bobh_ has joined #openstack-infra | 19:36 | |
| fungi | dmsimard: it fails when bootstrapping a new server, because no ara package is installed yet so the first argument ends up empty | 19:36 |
| *** lukebrowning has quit IRC | 19:36 | |
| dmsimard | oh, hmm | 19:36 |
| fungi | and if the first argument is not quoted, the first part of the expression test encounters is a binary operator | 19:36 |
| dmsimard | you're right, I tested upgrading but didn't test from scratch | 19:36 |
| fungi | *boom* | 19:36 |
| *** dsariel has joined #openstack-infra | 19:37 | |
| clarkb | ya I tested upgraded too | 19:37 |
| *** bobh has quit IRC | 19:37 | |
| clarkb | this is why we have code review :) | 19:37 |
| *** bobh__ has joined #openstack-infra | 19:37 | |
| fungi | as for the \\" in a " delimited puppet string, it's working identically in subunit2sql::init | 19:37 |
| dmsimard | \o/ | 19:37 |
| dmsimard | thank YAML for text blocks so we won't need all that quoting and escaping madness | 19:38 |
| *** bobh has joined #openstack-infra | 19:38 | |
| dmsimard | escaping double brackets in jinja is (very) painful though | 19:38 |
| clarkb | yaml has its own string escape trouble | 19:38 |
| clarkb | and ansible can't handle unbalanced 's | 19:38 |
| clarkb | tldr its all bad | 19:38 |
| fungi | er, rather, this is a ' delimited puppet string with \\" inside of a " | 19:39 |
| fungi | anyway, this is working in production: http://git.openstack.org/cgit/openstack-infra/puppet-subunit2sql/tree/manifests/init.pp#n53 | 19:39 |
| dmsimard | clarkb: wait until you write jinja that deals with Go-style templating (double brackets), it's very fun | 19:39 |
| *** mriedem has quit IRC | 19:40 | |
| dmsimard | a snippet from an openshift thing we got: {% raw %}{{ range .items }}{{$name:=.metadata.name}}{{ range .status.tags }}{{ if eq .tag {% endraw %}"{{ source_tag }}"{% raw %} }}{{ $name }}{{ "\n" }}{{ end }}{{ end }}{{ end -}}{% endraw %} | 19:40 |
| fungi | and switching from /usr/bin/pip3 to pip3 with a search path is because when i tried to call /usr/bin/pip in the install-subunit2sql-safely exec i discovered our only pip is /usr/local/bin/pip due to our bootstrapping | 19:40 |
| *** bobh_ has quit IRC | 19:40 | |
| *** mriedem has joined #openstack-infra | 19:41 | |
| dmsimard | fungi: yup, makes sense | 19:41 |
| fungi | until i got all that ironed out, i couldn't build the replacement subunit2sql-workerNN servers | 19:41 |
| dmsimard | fungi: it's always a better practice to specify a path for things anyway | 19:41 |
| dmsimard | although in puppet I personally tend to specify a global execution path | 19:41 |
| *** bobh__ has quit IRC | 19:42 | |
| clarkb | I +1'd the change, fungi's updates make sense to me its just that I wrote the basis for them so want other eyeballs on it before approving, though I guess we used it in subunit2sql so maybe I'm overly paranoid | 19:42 |
| dmsimard | so that I don't need to repeat it all the time | 19:42 |
| clarkb | jeblair: mordred ^ maybe you want to review 516740? | 19:42 |
| *** xarses has quit IRC | 19:43 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Handle projects still using pbr autodoc_index_modules https://review.openstack.org/528796 | 19:43 |
| mordred | AJaeger, dmsimard, pabelanger: ^^ how's that? | 19:44 |
| dmsimard | who thought docs were so complicated | 19:44 |
| * dmsimard didn't | 19:44 | |
| *** lukebrowning has joined #openstack-infra | 19:45 | |
| *** xarses has joined #openstack-infra | 19:46 | |
| *** e0ne has quit IRC | 19:46 | |
| *** armax has quit IRC | 19:46 | |
| AJaeger | dmsimard: it's not docs - it's how people tried to optimize requirements | 19:47 |
| *** xarses_ has joined #openstack-infra | 19:49 | |
| AJaeger | mordred: do you have a depends-on change to test that it works? use keystone or python-designateclient | 19:50 |
| *** xarses has quit IRC | 19:51 | |
| AJaeger | mordred: nice hack ;) | 19:51 |
| mordred | AJaeger: yah - lemme make one real quick | 19:51 |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/zuul-jobs master: Handle projects still using pbr autodoc_index_modules https://review.openstack.org/528796 | 19:51 |
| dmsimard | mordred: lgtm, just added an ultra nit | 19:54 |
| mordred | dmsimard: awesome - thanks! | 19:55 |
| mordred | AJaeger, dmsimard: https://review.openstack.org/528800 Split doc requirements into their own file ... there's designateclient patch that depends-on the zuul-jobs patch | 19:55 |
| *** lukebrowning has quit IRC | 19:56 | |
| *** raissa has joined #openstack-infra | 19:56 | |
| frickler | mordred: you have "when: not sphinx_pbr_autodoc" twice, I think the second one should be without the "not"? | 19:56 |
| frickler | also I'm lacking a reference as to why autodoc is bad | 19:57 |
| *** gmmaha has joined #openstack-infra | 19:58 | |
| * fungi kinda likes autodoc | 19:58 | |
| *** lukebrowning has joined #openstack-infra | 19:59 | |
| dmsimard | I think it's mostly about using sphinx_build directly | 19:59 |
| dmsimard | because it seems like that's how python people tend to do it | 20:00 |
| dmsimard | and we're the special ones using tox and pbr and things | 20:00 |
| dmsimard | at least that's why I feel we're doing all these vast changes | 20:00 |
| *** ijw has joined #openstack-infra | 20:01 | |
| *** e0ne has joined #openstack-infra | 20:01 | |
| dmsimard | cause using tox was super convenient you know :D | 20:01 |
| *** lukebrowning has quit IRC | 20:03 | |
| fungi | well, that has nothing to do with autodoc afaik, more about avoiding pbr | 20:03 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual master: Better explain needed patchsets https://review.openstack.org/528375 | 20:04 |
| *** lukebrowning has joined #openstack-infra | 20:05 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Handle projects still using pbr autodoc_index_modules https://review.openstack.org/528796 | 20:06 |
| AJaeger | mordred: just removed wrong "not" ^ | 20:06 |
| *** ijw has quit IRC | 20:07 | |
| AJaeger | mordred: care to review again https://review.openstack.org/#/c/528580/ , please? | 20:08 |
| *** lukebrowning has quit IRC | 20:09 | |
| openstackgerrit | Merged openstack-infra/project-config master: Added initial jobs for monasca tempest plugin https://review.openstack.org/526847 | 20:10 |
| *** lukebrowning has joined #openstack-infra | 20:11 | |
| *** dave-mccowan has joined #openstack-infra | 20:12 | |
| *** dsariel has quit IRC | 20:12 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add initial jobs for trove tempest plugin https://review.openstack.org/527123 | 20:13 |
| *** slaweq_ has joined #openstack-infra | 20:15 | |
| *** lukebrowning has quit IRC | 20:16 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove swift legacy tox jobs https://review.openstack.org/528649 | 20:17 |
| openstackgerrit | Merged openstack-infra/project-config master: Add system-required jobs to congress-tempest-plugin https://review.openstack.org/525421 | 20:17 |
| openstackgerrit | Merged openstack-infra/project-config master: Add releasenotes and docs job to congress-dashboard https://review.openstack.org/528671 | 20:17 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy jobs from puppet openstack modules https://review.openstack.org/526983 | 20:17 |
| openstackgerrit | Merged openstack-infra/project-config master: add n8g-sfc as a required project for n8g-bagpipe https://review.openstack.org/527146 | 20:17 |
| openstackgerrit | Merged openstack-infra/project-config master: Added initial jobs for vitrage tempest plugin https://review.openstack.org/526837 | 20:17 |
| *** lukebrowning has joined #openstack-infra | 20:17 | |
| AJaeger | dmsimard: https://review.openstack.org/#/c/526863/ is ready as well - let's test the changes for gerrit/zuul serializations ;) Thanks a lot for reviewing! | 20:17 |
| AJaeger | dmsimard: wait, it now misses the main.yaml change ;( | 20:19 |
| *** jtomasek has joined #openstack-infra | 20:20 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add new repo for Telemetry tempest plugin https://review.openstack.org/526863 | 20:21 |
| AJaeger | restored changeset 4 ^ | 20:21 |
| AJaeger | dmsimard: ^ | 20:21 |
| *** armaan has quit IRC | 20:21 | |
| *** armaan has joined #openstack-infra | 20:22 | |
| *** lukebrowning has quit IRC | 20:22 | |
| openstackgerrit | Merged openstack-infra/project-config master: Adding jobs to new ec2api-tempest-plugin https://review.openstack.org/526854 | 20:22 |
| pabelanger | clarkb: i think we are ready to poweroff kdc02.o.o, dns removed ~90mins ago | 20:23 |
| clarkb | pabelanger: wfm | 20:24 |
| *** armax has joined #openstack-infra | 20:24 | |
| pabelanger | actually | 20:25 |
| pabelanger | 1 sec | 20:25 |
| AJaeger | mordred: https://review.openstack.org/528796 fails our tests ;8 | 20:25 |
| openstackgerrit | Merged openstack-infra/project-config master: Publish Zun-tempest-plugin's documentation https://review.openstack.org/527886 | 20:25 |
| openstackgerrit | Merged openstack-infra/project-config master: publish sphinx-feature-class docs & use storyboard https://review.openstack.org/526782 | 20:25 |
| AJaeger | mordred: you around to fix? | 20:25 |
| openstackgerrit | Merged openstack-infra/project-config master: Add requirements check to cinder-tempest-plugin repo https://review.openstack.org/527774 | 20:25 |
| AJaeger | mordred: I'm downloading... | 20:25 |
| *** ccamacho has quit IRC | 20:26 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add kdc04.o.o to server.pp https://review.openstack.org/528806 | 20:26 |
| pabelanger | clarkb: we should land ^ first | 20:26 |
| dmsimard | pabelanger: for https://review.openstack.org/#/c/526154/ I was thinking it'd probably be worth creating a variable for that so it's easier to change if need be | 20:26 |
| pabelanger | then, I can propose a follow up commit to remove kdc02 from system-config | 20:27 |
| dmsimard | pabelanger: not a blocker for merging it though | 20:27 |
| openstackgerrit | Merged openstack-infra/project-config master: networking-midonet: Remove some of legacy jobs https://review.openstack.org/522465 | 20:27 |
| openstackgerrit | Merged openstack-infra/project-config master: No longer consider "jenkins" votes when enqueuing https://review.openstack.org/528722 | 20:27 |
| pabelanger | dmsimard: we could, mostly we've just made changes directly in system-config, since we don't expect others to be using it | 20:28 |
| *** bobh_ has joined #openstack-infra | 20:28 | |
| pabelanger | dmsimard: might a review on 526154 | 20:29 |
| andreaf | jeblair: I know you've reviewed this already a couple of times, but would you mind giving one last go to https://review.openstack.org/#/q/status:open+project:openstack-dev/devstack+branch:master+topic:get_devstack_logs and https://review.openstack.org/#/c/528748/? | 20:29 |
| *** lukebrowning has joined #openstack-infra | 20:29 | |
| andreaf | that makes the single node job ready to be used by people - I would be happy to send out the email before the holidays :) | 20:30 |
| *** askb has quit IRC | 20:30 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Update README for neutron-horizon-hack https://review.openstack.org/528492 | 20:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Remove kdc02.o.o (replaced by kdc04.o.o) https://review.openstack.org/528807 | 20:31 |
| *** bobh has quit IRC | 20:31 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Handle projects still using pbr autodoc_index_modules https://review.openstack.org/528796 | 20:32 |
| AJaeger | mordred: ^ | 20:32 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: remove migrate storyboard-webclient jobs https://review.openstack.org/528334 | 20:33 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove python-glanceclient legacy jobs https://review.openstack.org/525046 | 20:33 |
| *** lukebrowning has quit IRC | 20:34 | |
| AJaeger | dmsimard: the change in https://review.openstack.org/#/c/527313/ could be ok - but let's see what tristanC comments on it... | 20:35 |
| dmsimard | AJaeger: yeah, if he says it's okay we can merge | 20:35 |
| dmsimard | tristanC is not super familiar with upstream jobs (yet) so making sure he knows so he doesn't needlessly troubleshoot | 20:36 |
| pabelanger | dmsimard: https://review.openstack.org/526157/ should be safe to land now, variables are valid in nodepool.yaml any more | 20:36 |
| *** lukebrowning has joined #openstack-infra | 20:36 | |
| AJaeger | dmsimard: fine with me... | 20:36 |
| *** d0ugal has quit IRC | 20:36 | |
| dmsimard | pabelanger: it's not taken into account at all ? so upstream nodepool has no api-timeout right now ? | 20:36 |
| dmsimard | I wanted to avoid landing changes in a way that would temporarily make it so nodepool had no api-timeout at all | 20:37 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove swift legacy tox jobs https://review.openstack.org/528649 | 20:37 |
| clarkb | dmsimard: its a clouds.yaml setting | 20:37 |
| dmsimard | yeah I know it is | 20:38 |
| *** d0ugal has joined #openstack-infra | 20:38 | |
| dmsimard | but right now we don't have it, right ? | 20:38 |
| clarkb | I don't know would have to check | 20:38 |
| dmsimard | until https://review.openstack.org/#/c/526154/ lands | 20:38 |
| dmsimard | brb | 20:38 |
| mordred | AJaeger: thanks for the updates to that! | 20:38 |
| *** lbragstad has quit IRC | 20:38 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Replace sphinx_check_warning_is_error.py with ini lookup https://review.openstack.org/528812 | 20:38 |
| clarkb | but if we've not had it setting it in a setting that nodepool ignores won't change that | 20:38 |
| *** wolverineav has quit IRC | 20:38 | |
| *** lbragstad has joined #openstack-infra | 20:39 | |
| mordred | dmsimard, AJaeger: ^^ there's the patch implementing the suggestion from the comment in the previous patch - but I don't think it's urgent or anything | 20:39 |
| dmsimard | ok, so we're running with no api-timeout then is what I asked | 20:39 |
| clarkb | looks like oscc doesn't set api_timeout by default | 20:39 |
| dmsimard | yeah, it's None :) | 20:39 |
| openstackgerrit | Merged openstack-infra/project-config master: Add all infra puppet modules to system-config queue https://review.openstack.org/528095 | 20:39 |
| dmsimard | I think pabelanger submitted that patch when we were troubleshooting issues from RDO's nodepool | 20:39 |
| mordred | yah - I think the suggestion was made to set a default, but I don't know that we got around to doing thatyet | 20:40 |
| AJaeger | clarkb, mordred, pabelanger, could either of you review a change to add some more descritions to our jobs, please? https://review.openstack.org/#/c/528166/ | 20:40 |
| *** lukebrowning has quit IRC | 20:40 | |
| mordred | AJaeger: love it | 20:40 |
| AJaeger | thanks, mordred | 20:41 |
| pabelanger | dmsimard: clarkb: right, I'd expect we have None now and when we next restart nodepool, it will be 60 | 20:41 |
| AJaeger | mordred: wrote it after seeing http://zuulv3.openstack.org/jobs.html - wanted to give a good example ;) | 20:41 |
| pabelanger | so, if 60 api_timeout is wrong, we can remove that from clouds.yaml | 20:41 |
| *** wolverineav has joined #openstack-infra | 20:41 | |
| pabelanger | but, we should land nodepool.yaml changes, since they are unused | 20:42 |
| *** wolverineav has quit IRC | 20:42 | |
| *** wolverineav has joined #openstack-infra | 20:42 | |
| *** lukebrowning has joined #openstack-infra | 20:42 | |
| AJaeger | config-core, dmsimard added a new repo and needs job, please review https://review.openstack.org/528360 | 20:42 |
| openstackgerrit | Merged openstack-infra/project-config master: Add missing job descriptions https://review.openstack.org/528166 | 20:44 |
| AJaeger | config-core, a simple cleanup patch: https://review.openstack.org/#/c/527776 | 20:45 |
| pabelanger | dmsimard: https://review.openstack.org/528806 helps bring kdc04.o.o online | 20:45 |
| AJaeger | infra-root, here's a change for devstack-gate tox jobs, please review https://review.openstack.org/528553 | 20:46 |
| *** lukebrowning has quit IRC | 20:47 | |
| *** lukebrowning has joined #openstack-infra | 20:48 | |
| openstackgerrit | Merged openstack-infra/system-config master: Move api_timeout into clouds.yaml for nodepool https://review.openstack.org/526154 | 20:49 |
| AJaeger | team, could you review this change to use common horizon tox jobs, please? https://review.openstack.org/528580 | 20:49 |
| AJaeger | and one more review for a simple cleanup: https://review.openstack.org/528503 - thanks. | 20:49 |
| * clarkb reviews all the AJaeger changes | 20:50 | |
| *** dsariel has joined #openstack-infra | 20:51 | |
| openstackgerrit | Merged openstack-infra/project-config master: remove duplicated jobs from cinder-tempest-plugin https://review.openstack.org/527776 | 20:51 |
| *** e0ne has quit IRC | 20:51 | |
| AJaeger | thanks, clarkb and others. Sorry, there was some backlog and I had some time to produce a few of my own ;) | 20:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/devstack-gate master: Rename run-tests and py3-run-tests https://review.openstack.org/528817 | 20:52 |
| mordred | AJaeger: ^^ your patch inspired me to write that | 20:52 |
| *** ChanServ has quit IRC | 20:52 | |
| clarkb | mordred: that won't work | 20:53 |
| clarkb | not with the current devstack-gate tox.ini | 20:53 |
| *** lukebrowning has quit IRC | 20:53 | |
| mordred | clarkb: it won't? | 20:53 |
| clarkb | mordred: nope the tox target is run-tests | 20:53 |
| mordred | clarkb: I changed that in the tox.ini too | 20:53 |
| smcginnis | Don't you still need the target defined? | 20:54 |
| clarkb | mordred: oh derp I'm just blind | 20:54 |
| mordred | smcginnis: nah - tox defines py27 and py35 for you if you reference them on the command line | 20:54 |
| *** lukebrowning has joined #openstack-infra | 20:54 | |
| clarkb | mordred: I think the reason we avoided py27/py35 is we aren't really running python unittests we are running shell tests that happen to run python | 20:55 |
| clarkb | but really in this case meh | 20:55 |
| smcginnis | Oh, I see what's going on there. | 20:55 |
| AJaeger | mordred: squeeze the two chagnes if you want - and then let's move the py27/py35 to project-config? | 20:55 |
| mordred | yah - I also don't feel strongly about this at all ... so we can shelve it too | 20:55 |
| mordred | AJaeger: I think we'll have to do it in multiple patches anyway because project-config has legacy jobs defined | 20:56 |
| AJaeger | mordred: yes, indeed. Feel free to take over my change... | 20:56 |
| clarkb | oh ya you'll need to add the env for py* and then remove the run-tests after removing the legacy jobs | 20:56 |
| mordred | AJaeger: but we could totally split it up differently so that we end up with the jobs defined in project-config if you prefer | 20:56 |
| smcginnis | I've got a weird one. releases repo docs jobs started failing. | 20:57 |
| clarkb | mordred: did you send email for ^ yet? | 20:57 |
| AJaeger | mordred: see https://review.openstack.org/528554 | 20:57 |
| smcginnis | Apparently because we are running py2 and we had some code doing open(..., encoding='utf-8') which isn't valid there. | 20:57 |
| AJaeger | mordred: yes, we could. Do you want to do it - or shall I ? | 20:58 |
| smcginnis | But yet hasn't changed for a while. But anyway, I put up a patch to change that.... | 20:58 |
| mordred | AJaeger: I got it | 20:58 |
| openstackgerrit | Merged openstack-infra/project-config master: Use horizon-tox jobs intead of legacy ones https://review.openstack.org/528580 | 20:58 |
| *** dprince has quit IRC | 20:58 | |
| mordred | clarkb: I was trying to squeeze in a fix for the pbr autoindex thing | 20:58 |
| smcginnis | But the job still fails on missing sphinxcontrib.datatemplates: http://logs.openstack.org/03/528803/1/check/build-openstack-sphinx-docs/c45a913/job-output.txt.gz#_2017-12-18_20_25_27_414258 | 20:58 |
| smcginnis | Which is defined in setup.cfg. | 20:58 |
| smcginnis | And the package is being installed: http://logs.openstack.org/03/528803/1/check/build-openstack-sphinx-docs/c45a913/job-output.txt.gz#_2017-12-18_20_25_10_224568 | 20:59 |
| clarkb | mordred: ah | 20:59 |
| smcginnis | At least I think. | 20:59 |
| mordred | clarkb: https://review.openstack.org/#/c/528800/ is the patch that validates the pbr autodoc fix works | 20:59 |
| smcginnis | So not sure what's changed there. | 20:59 |
| mordred | clarkb: https://review.openstack.org/#/c/528796/ is the fix patch | 20:59 |
| *** linkmark has joined #openstack-infra | 20:59 | |
| *** lukebrowning has quit IRC | 20:59 | |
| *** xarses_ has quit IRC | 20:59 | |
| pabelanger | infra-root: any objections if we tag grafyaml 0.0.6? We seems templating support never was released yet | 21:01 |
| *** lukebrowning has joined #openstack-infra | 21:01 | |
| jeblair | pabelanger: no objections | 21:01 |
| dmsimard | pabelanger: where's kdc03 ? :D | 21:01 |
| *** ChanServ has joined #openstack-infra | 21:01 | |
| *** barjavel.freenode.net sets mode: +o ChanServ | 21:01 | |
| pabelanger | dmsimard: not online yet :) | 21:02 |
| pabelanger | that will be our new master | 21:02 |
| pabelanger | but we need to migrate something | 21:02 |
| clarkb | mordred: I feel like I'm missing something important, how is an ini lookup in ansible more complicated than a completely special purpose python library? | 21:03 |
| clarkb | mordred: also one minor nit but I +2'd | 21:03 |
| clarkb | smcginnis: looking at ara that package doesn't get installed | 21:06 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove api-timeout from nodepool-launcher yaml file https://review.openstack.org/526157 | 21:06 |
| *** lukebrowning has quit IRC | 21:06 | |
| clarkb | smcginnis: http://paste.openstack.org/show/629245/ | 21:07 |
| smcginnis | clarkb: Any idea how that could have changed? I have a patch ready to add it to global-requirements, but this is really the only place it's used AFAIK. | 21:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/devstack-gate master: Import tox jobs https://review.openstack.org/528553 | 21:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/devstack-gate master: Remove run-tests and py3-run-tests https://review.openstack.org/528817 | 21:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/devstack-gate master: Move commands to the base testenv https://review.openstack.org/528819 | 21:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove devstack-gate specific tox jobs https://review.openstack.org/528554 | 21:07 |
| mordred | clarkb, AJaeger: ok - I think I have those sequenced right so that we can continue to verify that everything will work before we land the project-config changes | 21:07 |
| *** lukebrowning has joined #openstack-infra | 21:07 | |
| AJaeger | team, two more job removal changes for openstack-zuul-jobs: https://review.openstack.org/528581 and https://review.openstack.org/#/c/522471/ (still in check queue) | 21:07 |
| AJaeger | mordred: thanks - will review | 21:07 |
| smcginnis | None of the [extras] got installed (sphinx, oslosphinx, icalendar, and sphinxcontrib.datatemplates) | 21:07 |
| AJaeger | mordred: could you send your email, please? ^ | 21:08 |
| clarkb | smcginnis: I'm not sure how the job would know that releases has a special set of extras to install. aiui that is the purpose of the docs requirements file | 21:09 |
| clarkb | smcginnis: monty is going to send email for that shortly | 21:09 |
| *** ijw has joined #openstack-infra | 21:09 | |
| clarkb | (I am also not sure that is a regression? unless your tox venv target explicitly installed them?) | 21:10 |
| smcginnis | clarkb: I assumed they got installed from there in the past, since this has been working until very recently. | 21:10 |
| clarkb | smcginnis: ya that was it https://git.openstack.org/cgit/openstack/releases/tree/tox.ini#n52 so thats an abuse of the interface and why this wasn't caught/broke | 21:11 |
| openstackgerrit | Merged openstack-infra/project-config master: Add new repo for Telemetry tempest plugin https://review.openstack.org/526863 | 21:11 |
| *** r-daneel has quit IRC | 21:11 | |
| smcginnis | clarkb: So something changed with how that's being called in the job? | 21:11 |
| *** r-daneel has joined #openstack-infra | 21:11 | |
| *** e0ne has joined #openstack-infra | 21:11 | |
| clarkb | smcginnis: yes, the project testing interface has been updated to drop tox entirely for building docs. The jobs have since been updated to match the project testing interface | 21:12 |
| clarkb | smcginnis: in part because of this magic sauce that random projects have been using | 21:12 |
| clarkb | (there shouldn't be magic required to build docs) | 21:12 |
| AJaeger | smcginnis: http://lists.openstack.org/pipermail/openstack-dev/2017-November/124815.html | 21:12 |
| clarkb | but also to be more friendly to non python projects | 21:12 |
| *** lukebrowning has quit IRC | 21:12 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Ensure ara is updated on executors https://review.openstack.org/516740 | 21:12 |
| AJaeger | smcginnis: mordred has prepared an email that will give more details | 21:13 |
| *** jcoufal_ has joined #openstack-infra | 21:13 | |
| *** lukebrowning has joined #openstack-infra | 21:13 | |
| *** vhosakot has quit IRC | 21:14 | |
| *** vhosakot has joined #openstack-infra | 21:14 | |
| *** jcoufal has quit IRC | 21:15 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove devstack-gate specific tox jobs https://review.openstack.org/528554 | 21:16 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove devstack-gate specific tox jobs https://review.openstack.org/528554 | 21:16 |
| *** jcoufal_ has quit IRC | 21:17 | |
| *** vhosakot has quit IRC | 21:17 | |
| *** lukebrowning has quit IRC | 21:18 | |
| *** vhosakot has joined #openstack-infra | 21:18 | |
| *** vhosakot has quit IRC | 21:19 | |
| *** felipemonteiro_ has quit IRC | 21:19 | |
| *** lukebrowning has joined #openstack-infra | 21:19 | |
| jeblair | dmsimard, clarkb, fungi, mordred, pabelanger: given https://github.com/theforeman/puppet-dns/blob/4.1.0/manifests/config.pp#L42 -- is it impossible to manage that file ourselves? | 21:20 |
| *** jcoufal has joined #openstack-infra | 21:20 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add kdc04.o.o to server.pp https://review.openstack.org/528806 | 21:20 |
| *** catintheroof has quit IRC | 21:20 | |
| mordred | AJaeger, smcginnis, clarkb, fungi: ok - I added a section to the 'if your doc builds break all of a sudden' mentioning the pbr issue | 21:20 |
| *** kgiusti has left #openstack-infra | 21:21 | |
| jeblair | specifically, doesn't the file stanza at line 46 preclude us adding our own file stanza to lay down the content? | 21:21 |
| mordred | https://etherpad.openstack.org/p/URCnVSwY5v <-- smcginni, AJaeger, clarkb, fungi I *believe* it's *extra* good to go now | 21:21 |
| smcginnis | mordred: ++[2~ | 21:21 |
| clarkb | jeblair: I don't think so, the trick here is that the exec has a creates clause which means it won't run if the file already exists | 21:22 |
| smcginnis | Darn fat fingers.... | 21:22 |
| mordred | smcginnis: that's the best review vote I've ever gotten | 21:22 |
| clarkb | jeblair: and I think you can have a different file resource but you'll have to set the namevar to something different | 21:22 |
| jeblair | clarkb: does that somehow cause that file stanza not to apply | 21:22 |
| jeblair | clarkb: well, the name is the path, rightL | 21:22 |
| jeblair | ? | 21:22 |
| clarkb | jeblair: by default it is but you can do something like file { | 21:22 |
| clarkb | er | 21:22 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul feature/zuulv3: Fix docs building https://review.openstack.org/528822 | 21:23 |
| AJaeger | mordred, jeblair, zuul failed building docs ^ | 21:23 |
| clarkb | file { 'different_name_var: path => '/apth/here' } | 21:23 |
| jeblair | clarkb: yowza. ok. | 21:23 |
| AJaeger | see http://logs.openstack.org/14/525614/15/gate/build-openstack-sphinx-docs/f3af34b/job-output.txt.gz#_2017-12-18_21_08_00_532505 | 21:23 |
| clarkb | jeblair: if you don't want that owner, group and mode things likely get trickier I think | 21:23 |
| *** smatzek_ has quit IRC | 21:23 | |
| jeblair | nah that's fine | 21:23 |
| clarkb | pretty sure you can do that | 21:24 |
| *** jtomasek has quit IRC | 21:24 | |
| smcginnis | If anyone with requirements-core can help: https://review.openstack.org/528823 | 21:24 |
| *** robled has quit IRC | 21:24 | |
| AJaeger | mordred: sent it out, just fixed one typo | 21:24 |
| *** lukebrowning has quit IRC | 21:24 | |
| jeblair | Error: Cannot alias File[rndckeypath] to ["/etc/bind/rndc.key"] at /home/corvus/system-config/modules/openstack_project/manifests/master_nameserver.pp:68; resource ["File", "/etc/bind/rndc.key"] already declared at /etc/puppet/modules/dns/manifests/config.pp:50 | 21:26 |
| fungi | jeblair: can you elaborate on why you'd want to explicitly set our own rndc key? were you planning automation which spoke rndc over the network rather than locally on the nameserver? | 21:26 |
| prometheanfire | smcginnis: what's the big deal/rush? | 21:26 |
| *** smatzek has joined #openstack-infra | 21:26 | |
| clarkb | jeblair: bah so its a different error than the non unique namevar error | 21:26 |
| clarkb | thats annoying | 21:26 |
| jeblair | fungi: aiui that's also the tsig key for signing notifies and transfers ? | 21:26 |
| fungi | oh, really? i hadn't picked up on that | 21:27 |
| * fungi rtfms | 21:27 | |
| jeblair | fungi: or, maybe i can make a second key for that? | 21:27 |
| smcginnis | prometheanfire: Just blocking some releases repo patches. Not a huge rush, but something I would like to see cleared up soon-ish. | 21:27 |
| clarkb | jeblair: ya maybe the thing to do is point your config at a different key? | 21:27 |
| pabelanger | grafyaml 0.0.6 tagged and released | 21:27 |
| fungi | jeblair: i only ever knew it was used to authenticate to the rndc socket | 21:27 |
| clarkb | and just let the module generate an unused one? | 21:27 |
| fungi | gonna check my config and see what i ended up using on master/slave transfers | 21:28 |
| fungi | jeblair: aha! i only authenticate my slaves by ip address, i'm not using transaction signatures. that explains my confusion | 21:30 |
| prometheanfire | smcginnis: k | 21:30 |
| fungi | basically relying on tcp client addresses being hard to spoof | 21:30 |
| dmsimard | jeblair: hmmm, I've overidden stuff like that before.. it's pretty hacky | 21:30 |
| *** smatzek has quit IRC | 21:30 | |
| * dmsimard searches code | 21:30 | |
| *** jcoufal has quit IRC | 21:31 | |
| smcginnis | Actually, I wonder if this is going to work for openstack/releases. | 21:31 |
| smcginnis | We have some in-tree sphinx extensions. | 21:31 |
| clarkb | smcginnis: it does install your project | 21:31 |
| dmsimard | jeblair: you have to use the SPACESHIP OPERATOR (woot) like this: https://github.com/openstack/puppet-openstack-integration/blob/master/manifests/swift.pp#L29-L32 | 21:32 |
| jeblair | dmsimard, fungi, clarkb: i'll work on the assumption i can define a new key for tsig, and leave the auto-generated one for just local rndc ops | 21:32 |
| smcginnis | clarkb: Ah, but it doesn't call the tox job that was making this work before. Got it now. | 21:32 |
| *** ijw has quit IRC | 21:32 | |
| dmsimard | jeblair: and then you have special operators like +> which appends or other things.. | 21:32 |
| dmsimard | my puppet is rusty | 21:32 |
| *** jcoufal has joined #openstack-infra | 21:33 | |
| *** openstackgerrit has quit IRC | 21:33 | |
| *** openstackgerrit has joined #openstack-infra | 21:33 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul-base-jobs master: Initial boilerplate, packaging and testing https://review.openstack.org/526139 | 21:33 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul-base-jobs master: Add generic base and base-test jobs/playbooks https://review.openstack.org/526140 | 21:33 |
| jeblair | dmsimard: wow that's amazing, thanks :) | 21:35 |
| fungi | any hatters here happen to know what puppet module openshift is using for managing bind? looks like they have support for passing in (even multiple) tsig keys: https://access.redhat.com/documentation/en-us/openshift_enterprise/2/html/puppet_deployment_guide/generating_a_bind_tsig_key | 21:39 |
| fungi | oh, heh, it's on the previous page. https://github.com/openshift/puppet-openshift_origin.git | 21:40 |
| *** lukebrowning has joined #openstack-infra | 21:40 | |
| *** hashar has quit IRC | 21:41 | |
| fungi | looks all bespoke and monolithic | 21:41 |
| *** dprince has joined #openstack-infra | 21:43 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Handle projects still using pbr autodoc_index_modules https://review.openstack.org/528796 | 21:45 |
| *** lukebrowning has quit IRC | 21:45 | |
| *** slaweq_ has quit IRC | 21:48 | |
| *** wolverineav has quit IRC | 21:48 | |
| *** jamesmcarthur has quit IRC | 21:48 | |
| mordred | AJaeger: thanks - will hit send now | 21:49 |
| fungi | jeblair: at a minimum, you can configure the path to the default key for both the rndc command and bind's listening socket | 21:50 |
| AJaeger | anybody knows how to fix translation updates so that it does not fail in case nothing to upload? See http://logs.openstack.org/d8/d810928406eb2a95bb5f15a6d8437b377abde733/post/upstream-translation-update/cd42922/ - problem is that we do not translate the branch and therefore there's nothing to publish to tarballs.o.o. How can we skip playbooks/publish/openstack-artifacts.yaml in this case? | 21:50 |
| fungi | jeblair: so entirely possible for us to just ignore the one created by that puppet module, i think | 21:50 |
| *** lukebrowning has joined #openstack-infra | 21:51 | |
| clarkb | AJaeger: remove the post job from that branch? (I don't know if that works but seems like a good way to do it) | 21:51 |
| AJaeger | clarkb: yes, would work. But lots of work for each release ;( right now we always run the job and just not branch in zanata. | 21:52 |
| clarkb | AJaeger: I see, so problem is we want zanata to control it basically? | 21:52 |
| AJaeger | on the other hand that always running wastes resources | 21:52 |
| clarkb | AJaeger: maybe just do a curl against zanata/project/branch and check if it 404s? | 21:53 |
| AJaeger | clarkb: that's how we did it in the past ;) | 21:53 |
| AJaeger | clarkb: that's what we do already - and then the translation job exists with success. And then the post-run openstack-artifacts is called and finds nothing to upload | 21:53 |
| AJaeger | I mean: exits instead of exists | 21:54 |
| *** andreas_s has joined #openstack-infra | 21:54 | |
| *** rwsu has quit IRC | 21:54 | |
| AJaeger | So, we could have our own version of openstack-artificats somehow that checks first for content to upload. | 21:55 |
| clarkb | AJaeger: we can use the same condition in the upload from post-run can't we? | 21:55 |
| clarkb | ya | 21:55 |
| *** rloo has joined #openstack-infra | 21:55 | |
| * AJaeger will dig tomorrow into that if nobody beats him... | 21:55 | |
| AJaeger | thanks, clarkb | 21:55 |
| fungi | jeblair: also the fact that in bind 9.10 release notes they mention adding a tsig-keygen utility 'now available as an alternate command name to use for "ddns-confgen -q"; it randomly generates a TSIG key suitable for use in named.conf' makes me think it must be separable from rndc's default key | 21:55 |
| * AJaeger signs of. If anybody has some spare review cycles, here are two more job removal changes for openstack-zuul-jobs: https://review.openstack.org/528581 and https://review.openstack.org/#/c/522471/ | 21:56 | |
| *** lukebrowning has quit IRC | 21:56 | |
| * fungi needs to disappear for an errand, back later | 21:57 | |
| rloo | hi, has anyone seen sphinx job errors? I'm seeing eg http://logs.openstack.org/57/232257/17/check/build-openstack-sphinx-docs/190aefe/job-output.txt.gz#_2017-12-18_19_33_38_547307 | 21:57 |
| rloo | have seen it in 3 different ironic patches :-( Did some flag get turned on? | 21:58 |
| *** andreas_s has quit IRC | 21:59 | |
| *** bobh has joined #openstack-infra | 21:59 | |
| *** lukebrowning has joined #openstack-infra | 21:59 | |
| clarkb | rloo: check the latest message to the dev mailing list from monty | 21:59 |
| rloo | clarkb: thx | 22:00 |
| clarkb | rloo: long story short is the project testing interface for docs builds was updated. The jobs have been updated to match | 22:00 |
| jeblair | it's zuul meeting time in #openstack-meeting-alt | 22:00 |
| clarkb | rloo: if you jobs do something out of the ordinary or unexpected there may be problems | 22:00 |
| clarkb | rloo: feel free to ping us once you've read that message and we can help sort out the best way forward for you | 22:00 |
| rloo | clarkb: our jobs. out of the ordinary? NEVER? :D I'll take a look, I see Monty's email. thx! | 22:00 |
| *** trown|ruck is now known as trown|outtypewww | 22:01 | |
| *** jamesmcarthur has joined #openstack-infra | 22:02 | |
| *** bobh_ has quit IRC | 22:03 | |
| *** lukebrowning has quit IRC | 22:04 | |
| mordred | rloo: the patch to fix it has now landed, so you shoul dbe able to just recheck at this point | 22:05 |
| *** lukebrowning has joined #openstack-infra | 22:05 | |
| rloo | mordred: sweet! (I hope that is it cuz I'm still digesting your email) | 22:06 |
| *** jamesmcarthur has quit IRC | 22:07 | |
| mordred | rloo: yah - in GENERAL you shouldn't need to do anything - but you may have gotten lucky and failed some things in the bad period | 22:07 |
| rloo | mordred: hmm, i'm going to go buy a lotto ticket then ;) | 22:08 |
| *** pvaneck has joined #openstack-infra | 22:08 | |
| *** wolverineav has joined #openstack-infra | 22:09 | |
| mordred | rloo: :) | 22:09 |
| *** lukebrowning has quit IRC | 22:10 | |
| *** lukebrowning has joined #openstack-infra | 22:12 | |
| *** wolverineav has quit IRC | 22:13 | |
| *** lukebrowning has quit IRC | 22:16 | |
| *** lukebrowning has joined #openstack-infra | 22:18 | |
| SamYaple | can someone point me to the upstream elk stack log filters? im pretty sure those exist somewhere | 22:18 |
| SamYaple | the ones that do multiline correctly | 22:19 |
| clarkb | SamYaple: https://git.openstack.org/cgit/openstack-infra/logstash-filters/ they are fairly basic. we split them into their own repo so that we could involve the ops community more (this came out discussion in austin summit) but then that never happened | 22:19 |
| SamYaple | clarkb: danke. ive got to start doing this now, so i might be able to give back a bit :) | 22:20 |
| *** bobh has quit IRC | 22:22 | |
| *** lukebrowning has quit IRC | 22:23 | |
| *** lukebrowning has joined #openstack-infra | 22:24 | |
| SamYaple | this might be a question for oslo.log peeps, but does anyone have working configs that will let me keep debug on allthe time, but stream the logs to /dev/null? that way i can jump on a box and get real-time debug without killing my ELK? | 22:26 |
| clarkb | SamYaple: I don't know about it for openstack but infra does similar for all our python services just with normal python logging | 22:27 |
| clarkb | SamYaple: we have ti write all the logs including debug to a debug file, and a normal set of logs info and higher to another file | 22:27 |
| clarkb | you could index the normal log | 22:27 |
| clarkb | we use os-loganalyze to do similar filting for the gate jobs but not via oslo.log | 22:28 |
| SamYaple | debug to file doesnt kill the disk? | 22:28 |
| SamYaple | even with rotate and what not | 22:28 |
| *** lukebrowning has quit IRC | 22:29 | |
| *** lukebrowning has joined #openstack-infra | 22:30 | |
| *** askb has joined #openstack-infra | 22:34 | |
| clarkb | SamYaple: not for our services and we write a lot of logs | 22:35 |
| *** lukebrowning has quit IRC | 22:36 | |
| clarkb | SamYaple: I mean we have to rotate them and rotate aggressively | 22:36 |
| clarkb | zuul and nodepool are on 8 hour rotations now I Think | 22:36 |
| clarkb | and we keep 30 days? | 22:36 |
| clarkb | might be less than that | 22:36 |
| clarkb | SamYaple: another options is dump it all into systemd then have it filter for you when you pull out of it for ELK | 22:36 |
| SamYaple | ok. ill just need to make sure the io isn't too bad. but an aggressive rotation for debugis doable | 22:36 |
| *** lukebrowning has joined #openstack-infra | 22:37 | |
| *** e0ne has quit IRC | 22:37 | |
| SamYaple | clarkb: the syslog thing is something we ruled out for internal reasons unfortunately | 22:37 |
| clarkb | not syslog, journald | 22:37 |
| *** rcernin has joined #openstack-infra | 22:37 | |
| clarkb | but ya python with journald is apparently a bit clunky still | 22:38 |
| clarkb | since its a blocking call (though disk io will be too) | 22:38 |
| *** e0ne has joined #openstack-infra | 22:38 | |
| SamYaple | ah right were still on 14.04. when we move to 16.04 we can revist | 22:38 |
| *** e0ne has quit IRC | 22:39 | |
| SamYaple | though i hate the idea of binary logs.... in general journald has been good to me | 22:39 |
| SamYaple | i was hoping with some fancy /dev/null streaming i could avoid the blocking log writes | 22:39 |
| *** e0ne has joined #openstack-infra | 22:40 | |
| *** e0ne has quit IRC | 22:40 | |
| *** e0ne has joined #openstack-infra | 22:40 | |
| *** e0ne has quit IRC | 22:41 | |
| *** raissa has quit IRC | 22:42 | |
| *** lukebrowning has quit IRC | 22:42 | |
| *** eharney has quit IRC | 22:42 | |
| *** lukebrowning has joined #openstack-infra | 22:43 | |
| clarkb | I think the grand scheme of things log writes are such a tiny cost compared to python and sql server connections and talking over rabbit | 22:47 |
| *** lukebrowning has quit IRC | 22:48 | |
| *** lukebrowning has joined #openstack-infra | 22:49 | |
| *** robled has joined #openstack-infra | 22:50 | |
| *** robled has joined #openstack-infra | 22:50 | |
| *** wolverineav has joined #openstack-infra | 22:50 | |
| *** lukebrowning has quit IRC | 22:54 | |
| *** wolverineav has quit IRC | 22:55 | |
| *** jamesmcarthur has joined #openstack-infra | 22:58 | |
| *** e0ne has joined #openstack-infra | 22:59 | |
| *** apetrich has quit IRC | 22:59 | |
| *** lukebrowning has joined #openstack-infra | 23:00 | |
| *** dprince has quit IRC | 23:00 | |
| *** e0ne has quit IRC | 23:00 | |
| *** e0ne has joined #openstack-infra | 23:01 | |
| *** e0ne has quit IRC | 23:01 | |
| *** e0ne has joined #openstack-infra | 23:02 | |
| *** e0ne has quit IRC | 23:02 | |
| *** e0ne has joined #openstack-infra | 23:02 | |
| *** e0ne has quit IRC | 23:03 | |
| *** e0ne has joined #openstack-infra | 23:03 | |
| *** e0ne has quit IRC | 23:04 | |
| *** e0ne has joined #openstack-infra | 23:04 | |
| *** e0ne has quit IRC | 23:04 | |
| *** lukebrowning has quit IRC | 23:04 | |
| *** lukebrowning has joined #openstack-infra | 23:06 | |
| *** catinthe_ has joined #openstack-infra | 23:08 | |
| *** iyamahat has joined #openstack-infra | 23:11 | |
| *** iyamahat has quit IRC | 23:11 | |
| *** lukebrowning has quit IRC | 23:11 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings master: Move irc meetings tox job in-tree https://review.openstack.org/528498 | 23:12 |
| *** lukebrowning has joined #openstack-infra | 23:12 | |
| *** gouthamr has joined #openstack-infra | 23:13 | |
| *** catinthe_ has quit IRC | 23:13 | |
| *** lukebrowning has quit IRC | 23:17 | |
| *** lukebrowning has joined #openstack-infra | 23:19 | |
| *** iyamahat has joined #openstack-infra | 23:19 | |
| *** iyamahat has quit IRC | 23:20 | |
| *** iyamahat has joined #openstack-infra | 23:20 | |
| clarkb | pabelanger: looks like the api timeout change made it into cloud config and was removed from the launcher config | 23:22 |
| clarkb | pabelanger: nodepool launchers need a restart to pick up my bugfix that merged last week I'm not sure if they need a restart to pick up the cloud config change (I'm thinking they don't) | 23:22 |
| clarkb | what is process for doing that? just stop start right? | 23:23 |
| clarkb | jeblair: Shrews ^ | 23:23 |
| clarkb | er shrews is afk for a couple weeks | 23:23 |
| *** lukebrowning has quit IRC | 23:23 | |
| *** lukebrowning has joined #openstack-infra | 23:25 | |
| *** tonyb has quit IRC | 23:26 | |
| *** wolverineav has joined #openstack-infra | 23:28 | |
| *** lukebrowning has quit IRC | 23:30 | |
| *** jamesmcarthur has quit IRC | 23:31 | |
| *** wolverineav has quit IRC | 23:33 | |
| *** rloo has left #openstack-infra | 23:33 | |
| *** tonyb has joined #openstack-infra | 23:36 | |
| clarkb | any other infra-roots around? | 23:37 |
| clarkb | (don't want to restart nodepoo llaunchers if its just me at this point) | 23:37 |
| *** HeOS has quit IRC | 23:38 | |
| *** harlowja has quit IRC | 23:38 | |
| *** iyamahat has quit IRC | 23:38 | |
| *** jamesmcarthur has joined #openstack-infra | 23:42 | |
| jeblair | clarkb: should be start/stop. note we'll get new quota handling too. it may be best to wait until tomorrow unless folks are okay keeping an eye out for unintended impacts. | 23:46 |
| clarkb | hrm ya last restart was the 8th so that is new too | 23:47 |
| *** jamesmcarthur has quit IRC | 23:47 | |
| clarkb | I'll wait | 23:47 |
| clarkb | jeblair: in theory because we've not set any other limits we'll just use max-servers like before right? | 23:47 |
| *** rbrndt has quit IRC | 23:47 | |
| clarkb | I guess it will be checking max-servers against the instances quota though | 23:48 |
| jeblair | fungi: it looks like with bind you can either tsig or ip acl axfrs. doing both is either not possible or requires mental gymnastics (i found one blog post that suggested a way, but it included a double negation of an acl -- i'd need more convincing on that) | 23:48 |
| jeblair | clarkb: yeah, it shouldn't be a big impact for us until we drop max-servers or add smaller flavors, other than maybe causing fewer over-quota errors | 23:49 |
| jeblair | in theory | 23:49 |
| *** lukebrowning has joined #openstack-infra | 23:49 | |
| jeblair | i think it warrants an eye though because i don't think it's been tested at our scale yet | 23:49 |
| clarkb | ok | 23:49 |
| *** stakeda has joined #openstack-infra | 23:51 | |
| *** Goneri has quit IRC | 23:51 | |
| *** d0ugal has quit IRC | 23:51 | |
| ianw | sorry i'm back after an errand, but yeah, not caught up | 23:52 |
| ianw | also distracted by learning about RedHat's policy on cigar imports from Cuba | 23:53 |
| clarkb | ianw: you going to supply the holiday party with some? | 23:53 |
| *** lukebrowning has quit IRC | 23:54 | |
| *** pahuang has quit IRC | 23:54 | |
| ianw | oh no, i have learnt they're strictly verboten. don't try and bribe me either, i know all about that too :) | 23:55 |
| clarkb | the rules were being relaxed I thought but maybe corporate policies have't caught up (or maybe we unrelaxed the rules and I missed it) | 23:56 |
| ianw | yeah, that's what i thought about these ethics courses we have to take. they seem too unspecific for someone who might really end up in such positions, and fairly irrelevant to someone like me who barely know how to expense a coffee | 23:58 |
| *** jcoufal has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!