Thursday, 2018-05-24

openstackgerritTobias Henkel proposed openstack-infra/zuul master: Extend github testing using app auth  https://review.openstack.org/56329700:15
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Test parent-change-enqueued with github  https://review.openstack.org/56324200:15
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Optionally record created github clients in tests  https://review.openstack.org/56340200:15
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Limit search scope of getChangesDependingOn to tenant  https://review.openstack.org/56319600:15
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Remove getPullBySha from FakeGithubConnection  https://review.openstack.org/56341600:15
*** eumel8 has joined #zuul00:31
*** eumel8 has quit IRC01:16
*** D3VIATION has joined #zuul01:25
*** swest has quit IRC01:56
*** swest has joined #zuul02:12
*** rlandy|rover|bbl is now known as rlandy|rover02:26
*** D3VIATION has quit IRC02:27
*** rlandy|rover has quit IRC03:27
*** eumel8 has joined #zuul03:35
*** pcaruana has joined #zuul04:24
*** pcaruana has quit IRC04:29
*** openstackgerrit has quit IRC04:34
*** D3VIATION has joined #zuul05:27
*** D3VIATION has quit IRC05:31
*** dkranz has quit IRC06:06
*** quiquell|off is now known as quiquell06:15
*** jamielennox has joined #zuul06:31
*** eumel8 has quit IRC06:41
*** pcaruana has joined #zuul06:54
*** dkranz has joined #zuul06:58
*** ssbarnea_ has joined #zuul07:28
*** jpena|off is now known as jpena07:37
*** sshnaidm|off is now known as sshnaidm07:59
*** gtema has joined #zuul08:01
*** toabctl has quit IRC09:08
*** johanssone has quit IRC09:41
*** johanssone has joined #zuul09:44
*** ssbarnea_ has quit IRC10:42
*** jpena is now known as jpena|lunch10:58
*** jpena|lunch is now known as jpena|off11:10
*** eumel8 has joined #zuul11:52
*** jpena|off is now known as jpena11:58
*** quiquell is now known as quiquell|lunch12:12
*** openstackgerrit has joined #zuul12:24
openstackgerritArtem Goncharov proposed openstack-infra/zuul master: github approval type is approved  https://review.openstack.org/57037812:24
*** rlandy has joined #zuul12:28
*** rlandy is now known as rlandy|rover12:30
*** eumel8 has quit IRC12:32
*** quiquell|lunch is now known as quiquell12:41
*** eumel8 has joined #zuul12:48
openstackgerritArtem Goncharov proposed openstack-infra/zuul master: correct github review approval type is `approved`  https://review.openstack.org/57037812:53
*** myoung|off is now known as myoung13:03
*** D3VIATION has joined #zuul13:09
odyssey4mehi folks - is there a way for nodepool to execute a user_data file when building a node?14:55
odyssey4meI'm thinking of a situation where a cloud-image is used, not a diskimage14:55
clarkbodyssey4me: you would need to use a cloud init image or other image with a tool like cloud init14:56
clarkbthen set the metadata on the image?14:56
clarkbWe may have only done that for ssh keys now that I think about it14:56
odyssey4meyeah, not a whole lot of options in https://docs.openstack.org/infra/nodepool/configuration.html#cloud-images14:57
*** acozine1 has joined #zuul14:59
gtemaodyssey4me: if you want I can share a link to 'elements' I was using to build image with cloud_init - there are some tricks, which costed me some time14:59
odyssey4megtema in this case I'm using a cloud-image, not diskimage-builder... so thanks, but building the image myself with cloud-init doesn't help this use case at all :)15:01
gtemaok15:02
clarkbthe issue is nodepool doesnt currebtly have a mechanism to set the user data attribute on nodes15:02
clarkbprobabpy straightforward to add as long as shade does yhe base 64 encoding properly but will require cbanges to nodepool I think15:02
odyssey4meclarkb ok, thanks for the confirmation - that might just be something we work on15:03
tobiashadam_g: I think it could be a valid use case for requiring comments with certain text in it. So I think we should at least not remove that feature. We could extend it now or at a point in time when someone needs it.15:04
*** gtema has quit IRC15:14
*** gtema has joined #zuul15:15
*** pcaruana has quit IRC15:19
*** electrofelix has quit IRC15:32
*** GonZo2000 has joined #zuul15:36
*** eumel8 has quit IRC15:38
*** quiquell is now known as quiquell|off15:42
*** wei_liu_ has joined #zuul15:44
*** wei_liu_ has quit IRC15:50
*** wei_liu_ has joined #zuul15:51
*** eumel8 has joined #zuul15:54
*** wei_liu_ has quit IRC15:54
*** sshnaidm has quit IRC15:56
*** wei_liu_ has joined #zuul15:58
*** Jacktt has joined #zuul16:01
*** wei_liu_ has quit IRC16:01
*** Jacktt has quit IRC16:06
*** dmellado has quit IRC16:09
*** gouthamr has quit IRC16:09
pabelangerodyssey4me: clarkb: we did have the concept of a ready-script before in nodepool but was deprecated during zuulv3 development, that might have been a way in the past16:14
odyssey4mepabelanger yeah, seems to me that using the user_data for that sort of thing would be more cloudy ;)16:15
odyssey4methat way it's not nodepool that executes anything except a node build16:15
mordredodyssey4me: shade should totally support that - and if it doesn't it's definitely a bug16:16
mordredodyssey4me: although fwiw personally I stay as far away from cloud-init user_data scripts as humanly possible16:16
odyssey4mewe had a another little bit of fun - if you have time for a story, I'll tell it :)16:16
mordred(that's saying yes, we should totally support it if you want to use it, just as long as nothing grows an actual _dependency_ on using it)16:17
odyssey4memordred oh agreed, but it's handy to get a package installed for jenkins to be able to use the node - this is part of the jenkins <-> nodepool use-case which we're using16:17
mordred++16:17
mordredtotally16:17
odyssey4meso, I'm not sure how universal this is, but rax pubclous has a seperate quota for onmetal vs normal instances16:17
odyssey4menodepool, however, only cares about the instance quota16:18
odyssey4mewe had one provider with two pools - one instances, and one onmetal16:18
odyssey4menode requests for the onmetal nodes were being blocked because provisioning the node would exceed quota16:19
odyssey4meexcept that the onmetal quota would not be exceeded :p16:19
odyssey4meoh, and btw - this was a fun one to work out: https://github.com/openstack-infra/nodepool/blob/db87b73a508a91043d80109980b29a72cefd3c72/nodepool/driver/openstack/handler.py#L258-L25916:20
odyssey4meif it's not non-negative, then return false16:21
corvusodyssey4me: do you know how we can differentiate the two quotas?16:22
*** pcaruana has joined #zuul16:23
*** pcaruana has quit IRC16:32
odyssey4mecorvus well, I can't seem to get a good answer on what the api is - so I was thinking about an alternative route16:38
odyssey4mehow about having an option per pool or perhaps per provider (not sure which makes more sense) to disable the quota check and blindly accept max-servers only?16:39
corvusSpamapS, mordred, tobiash, tristanC, jhesketh, clarkb: now that we've got big picture stuff out of the way, are there more details about containers we should discuss today?16:39
SpamapSI'd definitely be interested in talking about container based deployment tooling.16:40
tobiashcorvus: my flight was rescheduled to today 12:30, happy to further participate if it doesn't conflict16:40
corvustobiash: some openstack-infra folks are chatting with kata folks over lunch today, so i think we won't have any container discussions during then :)16:42
tobiashyay16:42
corvusSpamapS: cool -- mordred has some thoughts/wip on that too16:42
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Remove getPullBySha from FakeGithubConnection  https://review.openstack.org/56341616:43
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Status branch protection checking for github  https://review.openstack.org/53568016:43
mordredSpamapS: I'd love to chat with you16:43
SpamapScool, I'm hiding in hotel at the moment, and heading to the airport after lunch16:43
SpamapSBut I'll be at the conf in about 45.16:44
corvusodyssey4me: i think the quotas are per provider, so it may be a bit of work to extend that to essentially make a synthetic per-pool quota.  but that sounds like a good solution to explore.16:44
odyssey4mecorvus ok cool, happy that it sounds at least reasonable16:45
corvusSpamapS, mordred: i'm on the second floor at the back by the windows, watching the sea planes, of course.  maybe we can meet up around here?16:46
odyssey4meI did go down a thought process of considering whether we should implement something in shade which understands quota types, etc... but I think that's a bit silly for what is most likely some sort of quota hack in the rax api. I think a quota bypass is simpler and more universal.16:46
SpamapScorvus: ACK, I'll make my way to that area.16:47
*** sshnaidm has joined #zuul16:49
*** sshnaidm is now known as sshnaidm|off16:50
odyssey4mecorvus we had some fun trying to understand how request routing is done and what the rules are - I've got to spend more time following the actual code path because we hit a weird situation where a secondary pool across two providers was not getting routing requests distributed across both - only one pool (the first one in the config) was getting all the requests16:50
odyssey4methat's one which will be harder to replicate to confirm, but we'll try :)16:51
odyssey4mehow keen would we be to have some docs on how nodepool actually does things internally (process flows, that sort of thing)? given I'll be mapping this stuff out, I figure it may be handy to push up to the docs16:52
*** gouthamr has joined #zuul17:04
corvusodyssey4me: i think that would be swell :)17:04
corvusodyssey4me: though i don't think a pool can span providers?  i think a pool is only a "part" of one provider17:05
odyssey4mecorvus oh yea, it didn't span... it was just a secondary pool in each provider which provided the same node names17:06
odyssey4meso think provider1 -> pool2 -> ubuntu-xenial, provider2 -> pool2 -> ubuntu-xenial17:06
corvusodyssey4me: ah thatk makes sense17:06
odyssey4meprovider1 -> pool2 got all the requests, while provider2 -> pool2 was bored17:06
odyssey4meanyway, lemme try to replicate the issue and work my way through how those requests actually get routed - yesterday was a long day and that situation may have just been something silly I did17:08
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Don't process lock files as refs in tests  https://review.openstack.org/57041717:15
*** jpena is now known as jpena|off17:28
Shrewsodyssey4me: requests aren't really "routed". rather, there is 1 thread per pool and each thread continuously goes through the request queue trying to grab any unhandled requests17:30
Shrewsthose threads can pause if they are at quota, but otherwise, first thread to grab the request wins17:31
*** eumel8 has quit IRC17:36
*** D3VIATION has quit IRC17:37
*** gtema has quit IRC18:00
*** eumel8 has joined #zuul18:00
*** wei_liu has joined #zuul18:10
*** wei_liu has quit IRC18:13
*** eumel8 has quit IRC18:21
*** eumel8 has joined #zuul18:34
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Add multilabel support to ZooKeeper Node model  https://review.openstack.org/57022718:39
SpamapSmordred: oops, missed you and corvus  ;)18:42
corvusSpamapS: i'm still in the back for now, don't know where mordred is18:44
*** eumel8 has quit IRC18:44
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Status branch protection checking for github  https://review.openstack.org/53568018:52
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Remove getRepoPermission fron FakeGithubConnection  https://review.openstack.org/57042818:52
tobiashadam_g: this adds the groundwork for counting the permission requests ^18:57
tobiashadam_g: I think counting should be easy to be added in FakeGithubSession.get(...)18:58
*** ChanServ has quit IRC19:07
*** ChanServ has joined #zuul19:12
*** barjavel.freenode.net sets mode: +o ChanServ19:12
*** ChanServ has quit IRC19:21
*** ChanServ has joined #zuul19:30
*** barjavel.freenode.net sets mode: +o ChanServ19:30
*** sc68cal is now known as Guest5713719:33
*** jlvacation is now known as Guest6555519:33
*** fungi is now known as Guest7769519:34
*** sdake is now known as Guest1473519:34
*** dmsimard is now known as Guest9444819:34
*** trishnag is now known as Guest6058919:34
*** kklimonda is now known as Guest1979419:34
*** kmalloc is now known as Guest7043719:34
*** tristanC is now known as Guest1524819:34
*** Guest77695 is now known as fungi19:35
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Add config read and node deletion notifications  https://review.openstack.org/56588219:37
*** rlandy|rover is now known as rlandy19:42
*** harlowja has joined #zuul19:42
*** rlandy is now known as rlandy|rover19:43
*** Guest94448 has quit IRC19:51
*** dmsimard has joined #zuul19:52
*** eumel8 has joined #zuul19:52
*** eumel8 has quit IRC20:09
*** eumel8 has joined #zuul20:45
*** acozine1 has quit IRC20:52
*** pwhalen_ has joined #zuul20:54
*** pwhalen has quit IRC20:57
*** pwhalen_ is now known as pwhalen20:57
*** pwhalen has quit IRC20:58
*** pwhalen has joined #zuul20:58
*** Guest70437 is now known as kmalloc21:02
*** kmalloc has quit IRC21:02
*** kmalloc has joined #zuul21:02
*** kmalloc has quit IRC21:02
*** kmalloc has joined #zuul21:02
*** kmalloc is now known as morgan21:03
*** morgan is now known as kmalloc21:03
*** eumel8 has quit IRC21:04
*** gothicmindfood has quit IRC21:11
*** gothicmindfood has joined #zuul21:11
*** gothicmindfood has quit IRC21:14
*** gothicmindfood has joined #zuul21:15
*** D3VIATION has joined #zuul21:29
*** Guest65555 is now known as jlvillal21:37
*** D3VIATION1 has joined #zuul22:23
*** D3VIATION has quit IRC22:24
*** D3VIATION1 has quit IRC22:38
*** D3VIATION has joined #zuul22:54
*** D3VIATION has quit IRC23:03
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Status branch protection checking for github  https://review.openstack.org/53568023:20
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Remove getRepoPermission fron FakeGithubConnection  https://review.openstack.org/57042823:20
*** rlandy|rover is now known as rlandy|rvr|bbl23:25

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!