Tuesday, 2018-01-16

*** sdague has quit IRC00:01
*** stakeda has joined #openstack-infra00:04
*** caphrim007_ has joined #openstack-infra00:05
*** caphrim007_ has quit IRC00:07
*** dingyichen has quit IRC00:07
*** rocky-shiyan has joined #openstack-infra00:07
*** caphrim007_ has joined #openstack-infra00:07
*** caphrim007_ has quit IRC00:08
*** caphrim007 has quit IRC00:09
*** dingyichen has joined #openstack-infra00:09
*** claudiub has quit IRC00:10
*** markvoelker has joined #openstack-infra00:11
*** abelur_ has quit IRC00:13
*** dingyichen has quit IRC00:16
*** dingyichen has joined #openstack-infra00:17
fungireminder, https://review.openstack.org/533807 (Add zuul-scheduler ansible group for zuul01) is needed to successfully launch the replacement scheduler, if anyone gets time to look at a one-liner change00:24
*** abelur_ has joined #openstack-infra00:25
*** rlandy has quit IRC00:27
corvusfungi: done00:28
fungithanks ianw and corvus100:29
fungis/1/!/00:29
*** sbra has quit IRC00:35
*** armax has joined #openstack-infra00:36
*** yamamoto has joined #openstack-infra00:36
*** Swami_ has quit IRC00:40
*** shu-mutou has joined #openstack-infra00:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Support cross-source dependencies  https://review.openstack.org/53080600:48
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Add cross-source tests  https://review.openstack.org/53269900:48
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Compress testr results.html before fetching it  https://review.openstack.org/53382800:49
*** tosky has quit IRC00:52
corvusokay, it looks like the cname thing is holding, and i'm able to send mail to lists.zuul-ci.org.  i think the new lists are ready for folks to subscribe; i'll send an email.00:52
mordreddmsimard, fungi, ianw, corvus: ^^ just saw some jobs fail from that. not sure how it made it through earlier testing00:53
mordredcorvus: \o/00:53
openstackgerritMerged openstack-infra/system-config master: Add zuul-scheduler ansible group for zuul01  https://review.openstack.org/53380700:54
*** Swami_ has joined #openstack-infra00:54
mordredinfra-root: anyone have any concerns with me self-approving 533828? all testr-based tox jobs using the unittest base job are broken without it01:05
corvusmordred: i guess most of our jobs fix that in a child job or something?01:06
corvusi'm confused about what's failing01:06
mordredcorvus: the break was just landed about an hour ago01:07
corvuswhat was the break?01:07
*** dhajare|BNE|Mtg has joined #openstack-infra01:07
mordredcorvus: 529339 - consolidated role for subunit introduced the bug - which is that it's trying to fetch a gzipped copy of testr_results.html but is not gzipping testr_results.html01:08
mordredcorvus: I'd also like to figure out why the tox-py35-on-zuul job didn't catch this01:08
corvusmordred: tbh my pref would be to revert the break until we understand the test failure01:09
mordredcorvus: butI see the top 4 keystone patches in the gate with post-failures on the tox jobs01:09
mordredhttp://logs.openstack.org/37/527537/1/gate/openstack-tox-py35/6144853/job-output.txt.gz#_2018-01-16_00_05_58_17094401:09
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Clarify provider manager vs provider config  https://review.openstack.org/53161801:09
*** liujiong has joined #openstack-infra01:10
mordredcorvus: I mean, I understand the failure perfectly well - I don't understand why a job that should have caught it didn't catch it01:10
mordredcorvus: but we can also revert if you'd prefer01:10
corvusmordred: yeah, that's what i mean.  it makes no sense01:10
corvusi don't have any confidence we're not just throwing a bunch of untested code into prod01:10
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Revert "Add consolidated role for processing subunit"  https://review.openstack.org/53383101:10
mordredcorvus: ^^ there's the revert01:11
corvusmordred: +201:11
*** dhajare|BNE|Mtg has quit IRC01:12
fungilooking01:12
fungiapprovidad01:13
mordredcorvus, fungi: fwiw, I see the bug in the original patch that caused it to fail open for tox-py35-on-zuul01:14
mordredcorvus, fungi: problem statement update - projects using stestr are broken by it, projects using testr will not fail but will also not get html reports01:14
*** caphrim007 has joined #openstack-infra01:15
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Revert "Revert "Add consolidated role for processing subunit""  https://review.openstack.org/53383401:17
mordredinfra-root: there is the revert-revert with the two needed fixes. we should verify that tox-py35-on-zuul has html report before approving that again ... but it is not urgent to approve the revert-revert01:18
*** ihrachys_ has joined #openstack-infra01:19
*** caphrim007 has quit IRC01:20
*** olaph has joined #openstack-infra01:20
*** olaph1 has quit IRC01:22
*** ihrachys has quit IRC01:22
*** ihrachys_ has quit IRC01:24
*** dhajare|BNE|Mtg has joined #openstack-infra01:25
*** Swami_ has quit IRC01:30
*** cuongnv has joined #openstack-infra01:31
*** camunoz has quit IRC01:31
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Adjust check for .stestr directory  https://review.openstack.org/53268801:33
*** liujiong has quit IRC01:39
*** liujiong has joined #openstack-infra01:41
*** kiennt26 has joined #openstack-infra01:46
*** ihrachys has joined #openstack-infra01:47
*** dhajare|BNE|Mtg has quit IRC01:48
*** zhurong has joined #openstack-infra01:51
openstackgerritMerged openstack-infra/zuul-jobs master: Revert "Add consolidated role for processing subunit"  https://review.openstack.org/53383101:55
*** olaph1 has joined #openstack-infra01:56
*** dhajare|BNE|Mtg has joined #openstack-infra01:56
*** hongbin has joined #openstack-infra01:56
*** olaph has quit IRC01:58
*** masber has joined #openstack-infra02:00
*** threestrands_ has joined #openstack-infra02:02
*** masuberu has quit IRC02:02
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Do pep8 housekeeping according to zuul rules  https://review.openstack.org/52294502:04
*** jappleii__ has quit IRC02:04
*** annp has joined #openstack-infra02:07
*** olaph has joined #openstack-infra02:28
*** olaph1 has quit IRC02:30
*** edmondsw has quit IRC02:34
*** ramishra has joined #openstack-infra02:41
*** cuongnv_ has joined #openstack-infra02:44
*** cuongnv has quit IRC02:46
*** dtruong2 has joined #openstack-infra02:46
konghi guys, i found the docker container created on the devstack host can not access to the host ip address, has anyone met with the same problem ever before?02:50
kongsorry, s/docker container/k8s container02:51
kongit works for my local devstack environment02:51
kongwhat i need is, allow the application inside the container to send http request to the services running on the host.02:53
*** hongbin has quit IRC02:53
*** hongbin has joined #openstack-infra02:54
kongappreciate any suggestions/hints02:54
*** olaph1 has joined #openstack-infra02:58
*** olaph has quit IRC03:00
*** ramishra has quit IRC03:07
*** ramishra has joined #openstack-infra03:08
clarkbkong: we configure a firewall in the gate03:11
clarkbmy first hunch is that you are hitting the firewall. This is because there isnt "local" routing with devstack by default so you have to hit the external interface iirc03:12
mat128Can any of you +W these changes? https://review.openstack.org/#/c/531604/ and https://review.openstack.org/#/c/531608/ :) tia03:13
*** markvoelker has quit IRC03:13
*** nicolasbock has quit IRC03:15
*** sree has joined #openstack-infra03:15
*** hongbin has quit IRC03:19
*** hongbin has joined #openstack-infra03:20
kongclarkb: thanks, any suggestion to work around?03:24
*** liujiong has quit IRC03:27
*** liujiong has joined #openstack-infra03:28
*** sree has quit IRC03:29
*** sree has joined #openstack-infra03:29
*** sree has quit IRC03:30
clarkbkong: open the firewall rules that you need03:30
*** sree has joined #openstack-infra03:30
*** caphrim007 has joined #openstack-infra03:35
*** caphrim007 has quit IRC03:35
*** dtruong2 has quit IRC03:37
*** bobh has joined #openstack-infra03:38
*** yamamoto_ has joined #openstack-infra03:39
*** yamamoto has quit IRC03:43
*** caphrim007 has joined #openstack-infra03:45
*** edmondsw has joined #openstack-infra03:47
*** namnh has joined #openstack-infra03:52
*** edmondsw has quit IRC03:52
*** liujiong has quit IRC03:55
*** liujiong has joined #openstack-infra03:56
*** bobh has quit IRC04:00
*** mpeterson has quit IRC04:02
*** caphrim007_ has joined #openstack-infra04:02
*** caphrim007 has quit IRC04:06
*** links has joined #openstack-infra04:06
*** dhajare|BNE|Mtg has quit IRC04:07
*** mpeterson has joined #openstack-infra04:08
*** jascott1 has joined #openstack-infra04:12
*** dave-mccowan has quit IRC04:15
*** jascott1 has quit IRC04:16
*** ramishra has quit IRC04:16
*** dtruong2 has joined #openstack-infra04:17
*** armaan has quit IRC04:18
*** dhajare|BNE|Mtg has joined #openstack-infra04:20
*** ramishra has joined #openstack-infra04:22
*** zhurong has quit IRC04:22
*** rosmaita has quit IRC04:23
*** owalsh_ has joined #openstack-infra04:24
*** SamYaple has quit IRC04:24
*** SamYaple has joined #openstack-infra04:24
*** dtruong2 has quit IRC04:26
*** pgadiya has joined #openstack-infra04:27
*** owalsh has quit IRC04:27
*** gridinv has quit IRC04:35
*** andreas_s has joined #openstack-infra04:35
*** gridinv has joined #openstack-infra04:36
*** andreas_s has quit IRC04:40
*** dtruong2 has joined #openstack-infra04:40
*** gyee has quit IRC04:42
*** ykarel|away has joined #openstack-infra04:44
*** ykarel|away is now known as ykarel04:47
*** cburgess has quit IRC05:02
*** hongbin has quit IRC05:04
*** cburgess has joined #openstack-infra05:08
*** janki has joined #openstack-infra05:10
*** cburgess has quit IRC05:12
*** cburgess has joined #openstack-infra05:13
*** markvoelker has joined #openstack-infra05:14
*** olaph1 has quit IRC05:15
*** ekcs has quit IRC05:16
*** olaph has joined #openstack-infra05:16
*** bhavik1 has joined #openstack-infra05:17
*** dtruong2 has quit IRC05:17
*** ekcs has joined #openstack-infra05:17
*** markvoelker has quit IRC05:18
*** sree_ has joined #openstack-infra05:20
*** sree_ has quit IRC05:20
*** namnh_ has joined #openstack-infra05:22
*** namnh_ has quit IRC05:22
*** sree has quit IRC05:23
*** namnh has quit IRC05:25
*** psachin has joined #openstack-infra05:26
*** jascott1 has joined #openstack-infra05:26
*** kjackal has joined #openstack-infra05:27
*** coolsvap has joined #openstack-infra05:28
*** claudiub has joined #openstack-infra05:30
*** cshastri has joined #openstack-infra05:34
*** jascott1 has quit IRC05:34
*** markvoelker has joined #openstack-infra05:44
*** markvoelker has quit IRC05:49
*** cshastri has quit IRC05:50
*** ekcs has quit IRC05:55
*** bhavik1 has quit IRC05:56
*** prometheanfire has quit IRC05:58
*** ekcs has joined #openstack-infra06:01
*** dtruong2 has joined #openstack-infra06:08
*** armax has quit IRC06:08
*** hemna_ has quit IRC06:11
*** jascott1 has joined #openstack-infra06:20
*** pgadiya has quit IRC06:22
*** dtruong2 has quit IRC06:24
*** jascott1 has quit IRC06:25
*** jascott1 has joined #openstack-infra06:27
*** prometheanfire has joined #openstack-infra06:32
*** pgadiya has joined #openstack-infra06:34
openstackgerrityuan liang proposed openstack/diskimage-builder master: Add biosdevname package for ironic agent element.  https://review.openstack.org/53412606:40
*** dtruong2 has joined #openstack-infra06:44
*** liujiong has quit IRC06:45
*** liujiong has joined #openstack-infra06:46
*** dtruong2 has quit IRC06:55
*** sree has joined #openstack-infra06:55
*** dhajare|BNE|Mtg has quit IRC06:58
*** cshastri has joined #openstack-infra07:04
*** jascott1 has quit IRC07:04
*** links has quit IRC07:06
*** rcernin has quit IRC07:14
*** jascott1 has joined #openstack-infra07:18
*** gema has joined #openstack-infra07:18
*** threestrands_ has quit IRC07:18
*** gema is now known as Guest474607:18
*** Guest4746 has quit IRC07:19
*** gema_ has joined #openstack-infra07:20
*** links has joined #openstack-infra07:23
*** edmondsw has joined #openstack-infra07:24
*** makowals has joined #openstack-infra07:24
*** andreas_s has joined #openstack-infra07:27
*** edmondsw has quit IRC07:28
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Remove testr and stestr specific roles  https://review.openstack.org/52934007:28
AJaegermordred: added missing pieces ^07:29
AJaegermordred: see https://review.openstack.org/#/q/topic:fetch-subunit for all changes07:29
AJaegerianw, frickler, can you review https://review.openstack.org/529000 (frickler's change), https://review.openstack.org/530101 , https://review.openstack.org/#/c/531382, https://review.openstack.org/#/c/531538/ , please?07:32
*** olaph1 has joined #openstack-infra07:35
*** slaweq has joined #openstack-infra07:36
*** slaweq has quit IRC07:36
*** olaph has quit IRC07:36
*** slaweq has joined #openstack-infra07:36
*** janki has quit IRC07:39
*** links has quit IRC07:39
*** Damnit__ has joined #openstack-infra07:39
*** kjackal has quit IRC07:42
*** armaan has joined #openstack-infra07:44
*** markvoelker has joined #openstack-infra07:46
Damnit__I have a real stupid question...07:48
*** cshastri has quit IRC07:49
Damnit__Where can i get cloud infrastructure architect experience for cheap? I really want to learn07:51
*** vsaienk0 has joined #openstack-infra07:51
Damnit__Cloud architects need experience with multiple programming languages, such as Java, Node.js, PHP, Python, Ruby on Rails, among others. They also need to integrate tools and services for all areas of cloud computing, such as data and networks.07:53
*** sree has quit IRC07:56
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/53415807:56
*** Damnit__ has left #openstack-infra07:59
*** tesseract has joined #openstack-infra08:05
*** sree has joined #openstack-infra08:08
*** slaweq has quit IRC08:13
*** slaweq has joined #openstack-infra08:13
*** florianf has joined #openstack-infra08:14
*** hashar has joined #openstack-infra08:14
*** links has joined #openstack-infra08:15
*** shardy has joined #openstack-infra08:17
*** slaweq has quit IRC08:18
*** markvoelker has quit IRC08:19
*** sree_ has joined #openstack-infra08:22
*** sree_ is now known as Guest7254808:22
*** olaph1 has quit IRC08:23
yamamoto_is this a known problem?  https://review.openstack.org/#/c/533977/08:23
yamamoto_change-id issue08:23
*** olaph has joined #openstack-infra08:23
*** dingyichen has quit IRC08:23
*** sree has quit IRC08:25
*** Guest72548 has quit IRC08:25
*** sree has joined #openstack-infra08:26
*** amoralej|off is now known as amoralej08:31
*** sree has quit IRC08:32
openstackgerritVasyl Saienko proposed openstack-infra/project-config master: Add networking-generic-switch-tempest-plugin repo  https://review.openstack.org/53254208:32
*** slaweq has joined #openstack-infra08:33
AJaegeryamamoto_: That change is completely bogus, openstackdocstheme 1.18.1 will fix the problem in *neutron-lib*08:33
*** sree has joined #openstack-infra08:34
openstackgerritMerged openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/53415808:36
*** sree has quit IRC08:39
*** sree has joined #openstack-infra08:40
*** ankkumar has joined #openstack-infra08:41
*** owalsh_ is now known as owalsh08:43
*** sree has quit IRC08:45
*** janki has joined #openstack-infra08:46
*** jpena|off is now known as jpena08:46
*** janki has quit IRC08:46
*** cshastri has joined #openstack-infra08:47
*** janki has joined #openstack-infra08:47
*** e0ne has joined #openstack-infra08:48
yamamoto_AJaeger: ?08:49
*** sree has joined #openstack-infra08:49
yamamoto_AJaeger: are you talking about https://review.openstack.org/#/c/533977/ or something else?08:49
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Use re2 for change_matcher  https://review.openstack.org/53419008:50
AJaegeryamamoto_: yes, about 53397708:50
AJaegeryamamoto_: NO, I was not. Sorry, somehow copy & paste did somethign wrong for me.08:51
AJaegeryamamoto_: checking now again08:51
AJaegeryamamoto_: no idea what happened there, I suggest you manually edit the commit message08:52
*** sree has quit IRC08:52
*** sree has joined #openstack-infra08:53
*** sree has quit IRC08:53
AJaegeryamamoto_: I think we had a race. PLease abandon 53397708:54
ankkumarHi I am trying to build openstack/ironic CI using zuul v308:54
ankkumarOn patch.. It is saying CI runs but not posting it back on to the patch whether it passes or fails08:55
yamamoto_AJaeger: abandoned. thank you08:56
*** priteau has joined #openstack-infra08:59
*** dsariel has joined #openstack-infra09:00
*** jpich has joined #openstack-infra09:00
*** pcichy has joined #openstack-infra09:03
*** pcichy has joined #openstack-infra09:04
*** sree has joined #openstack-infra09:04
*** kjackal has joined #openstack-infra09:07
*** gridinv has quit IRC09:10
*** sree has quit IRC09:12
*** edmondsw has joined #openstack-infra09:12
*** kjackal has quit IRC09:13
*** kjackal has joined #openstack-infra09:14
*** sree has joined #openstack-infra09:15
openstackgerritBernard Cafarelli proposed openstack-infra/release-tools master: bugs-fixed-since: add argument to list StoryBoard entries  https://review.openstack.org/53373009:16
*** edmondsw has quit IRC09:17
*** shu-mutou is now known as shu-mutou-AWAY09:19
*** ralonsoh has joined #openstack-infra09:20
*** sree has quit IRC09:21
*** armaan has quit IRC09:22
*** dsariel has quit IRC09:22
*** dsariel has joined #openstack-infra09:23
*** gridinv has joined #openstack-infra09:24
*** lewo`` has quit IRC09:29
*** lewo has joined #openstack-infra09:29
*** slaweq_ has joined #openstack-infra09:35
*** lucas-afk is now known as lucasagomes09:36
*** pcichy has quit IRC09:40
*** pcichy has joined #openstack-infra09:41
*** slaweq_ has quit IRC09:41
*** derekh has joined #openstack-infra09:44
*** armaan has joined #openstack-infra09:51
*** sshnaidm|afk is now known as sshnaidm09:52
*** danpawlik has quit IRC09:57
*** danpawlik has joined #openstack-infra09:57
*** slaweq_ has joined #openstack-infra09:58
*** saop has joined #openstack-infra09:58
saophello all09:58
*** stakeda has quit IRC09:58
saopI am trying to up HPE Proliant CI, facing some issue regarding, its posting the result on gerrit, but its not showing in CI list in gerrit?09:59
AJaegersaop: if you "Toggle CI", do you see it?09:59
saopAJaeger, Yes10:00
AJaegersaop: third party CI systems need a special format to us.10:00
AJaegersaop: see https://docs.openstack.org/infra/system-config/third_party.html for the complete description10:00
AJaeger"format to use for posting" I meant to type10:01
saopAJaeger, We already updated the CI according to that10:01
saopAJaeger, Do we need to set anything in zuul.conf?10:02
saopAJaeger, We are using zuul v310:02
AJaegersaop: sorry, can't help further.10:03
*** slaweq_ has quit IRC10:03
*** erlon has joined #openstack-infra10:04
saopAJaeger, This is the link where you can see our CI posting. https://review.openstack.org/#/c/534137/10:04
saopAJaeger, In toggle CI its giving the error : Patch Set 1:10:05
saopBuild failed.10:05
saoptest-basic finger://ubuntu/f3f5f726a27a480687b826d9bf6a3e57 : FAILURE in 22s10:05
*** gema_ has quit IRC10:05
*** kiennt26 has quit IRC10:11
*** priteau has quit IRC10:12
AJaegersaop: and that finger is not understood by the parser10:13
*** rossella_s has quit IRC10:16
*** markvoelker has joined #openstack-infra10:16
*** shardy has quit IRC10:19
*** shardy has joined #openstack-infra10:20
*** pbourke has quit IRC10:23
*** pbourke has joined #openstack-infra10:24
*** gema has joined #openstack-infra10:25
*** tpsilva has joined #openstack-infra10:25
*** AJaeger has quit IRC10:26
*** tosky has joined #openstack-infra10:27
*** ganso has joined #openstack-infra10:27
*** pcichy has quit IRC10:27
*** gema_ has joined #openstack-infra10:28
*** sree has joined #openstack-infra10:29
*** jascott1 has quit IRC10:31
*** AJaeger has joined #openstack-infra10:32
*** arxcruz|rover is now known as arxcruz|off10:33
*** psachin has quit IRC10:37
*** andreas_s has quit IRC10:37
*** b_bezak has joined #openstack-infra10:38
*** andreas_s has joined #openstack-infra10:42
*** psachin has joined #openstack-infra10:42
*** gcb has joined #openstack-infra10:46
*** alexchadin has joined #openstack-infra10:47
*** alexchadin has quit IRC10:49
*** alexchadin has joined #openstack-infra10:49
*** markvoelker has quit IRC10:50
*** kjackal has quit IRC10:50
*** andreas_s has quit IRC10:51
*** andreas_s has joined #openstack-infra10:53
*** liujiong has quit IRC10:56
*** olaph1 has joined #openstack-infra10:57
*** olaph has quit IRC10:58
*** kjackal has joined #openstack-infra10:58
*** ldnunes has joined #openstack-infra10:59
*** dtantsur|afk is now known as dtantsur11:00
*** gema_ has quit IRC11:00
*** edmondsw has joined #openstack-infra11:00
*** ramishra has quit IRC11:00
*** electrofelix has joined #openstack-infra11:01
*** andreas_s has quit IRC11:02
*** kjackal has quit IRC11:02
*** psachin has quit IRC11:04
*** sdague has joined #openstack-infra11:05
*** edmondsw has quit IRC11:05
*** ramishra has joined #openstack-infra11:07
*** cuongnv_ has quit IRC11:11
*** kjackal has joined #openstack-infra11:11
*** psachin has joined #openstack-infra11:13
*** andreas_s has joined #openstack-infra11:16
*** sree has quit IRC11:18
*** ramishra has quit IRC11:18
*** ramishra has joined #openstack-infra11:20
*** sree has joined #openstack-infra11:21
*** dbecker has joined #openstack-infra11:25
*** sree has quit IRC11:25
*** sree has joined #openstack-infra11:26
*** yamamoto_ has quit IRC11:27
*** wolverineav has joined #openstack-infra11:28
*** jascott1 has joined #openstack-infra11:31
*** olaph has joined #openstack-infra11:34
*** olaph1 has quit IRC11:37
*** rossella_s has joined #openstack-infra11:44
*** dimak has quit IRC11:48
ankkumarHi11:48
ankkumarFacing issue with ansible using zuulv3.. returning error Ansible complete, result RESULT_NORMAL code 211:48
*** oanson has quit IRC11:48
*** dimak- has joined #openstack-infra11:48
ankkumarfull log can be seen in http://paste.openstack.org/show/645705/11:48
*** oanson has joined #openstack-infra11:50
*** edmondsw has joined #openstack-infra12:03
*** sree has quit IRC12:05
*** wolverineav has quit IRC12:05
ankkumarDoes anyone have any idea regarding this?12:06
*** sree has joined #openstack-infra12:06
*** sambetts|afk is now known as sambetts12:06
*** annp has quit IRC12:10
*** oanson has quit IRC12:10
*** dimak- has quit IRC12:10
*** oanson has joined #openstack-infra12:12
*** armaan has quit IRC12:14
*** rossella_s has quit IRC12:15
*** rossella_s has joined #openstack-infra12:21
*** nicolasbock has joined #openstack-infra12:22
*** rfolco_nho has joined #openstack-infra12:22
*** shardy is now known as shardy_lunch12:25
*** yamamoto has joined #openstack-infra12:26
*** wolverineav has joined #openstack-infra12:27
*** prometheanfire has quit IRC12:32
*** smatzek has joined #openstack-infra12:32
*** lucasagomes is now known as lucas-hungry12:32
*** pcaruana has joined #openstack-infra12:33
*** rossella_s has quit IRC12:35
*** jpena is now known as jpena|lunch12:35
*** rossella_s has joined #openstack-infra12:37
*** adarazs is now known as adarazs_lunch12:40
*** rossella_s has quit IRC12:43
*** panda|ruck is now known as panda|ruck|lunch12:45
*** shardy_lunch is now known as shardy12:45
*** rossella_s has joined #openstack-infra12:45
*** markvoelker has joined #openstack-infra12:47
*** sree_ has joined #openstack-infra12:50
*** sree_ is now known as Guest8001612:51
*** sree has quit IRC12:51
*** camunoz has joined #openstack-infra12:54
*** b_bezak has quit IRC12:54
*** strigazi has quit IRC12:56
*** rochaporto has quit IRC12:56
*** weshay_PTO is now known as weshay13:01
*** rossella_s has quit IRC13:03
*** strigazi has joined #openstack-infra13:04
*** rossella_s has joined #openstack-infra13:07
*** fultonj has joined #openstack-infra13:08
*** dprince has joined #openstack-infra13:09
*** hichihara has joined #openstack-infra13:10
*** jcoufal has joined #openstack-infra13:10
*** dbecker has quit IRC13:11
*** dtantsur is now known as dtantsur|brb13:17
openstackgerritDoug Hellmann proposed openstack-infra/openstack-zuul-jobs master: [WIP] docs sitemap generation automation  https://review.openstack.org/52486213:18
*** panda|ruck|lunch is now known as panda|ruck13:18
*** trown|outtypewww is now known as trown13:20
*** lucas-hungry is now known as lucasagomes13:20
*** markvoelker has quit IRC13:20
*** askb has quit IRC13:21
*** rossella_s has quit IRC13:21
*** makowals has quit IRC13:22
*** sdague has quit IRC13:22
*** rossella_s has joined #openstack-infra13:22
*** amoralej is now known as amoralej|lunch13:24
*** rosmaita has joined #openstack-infra13:24
*** pgadiya has quit IRC13:24
*** makowals has joined #openstack-infra13:25
*** askb has joined #openstack-infra13:26
fungiwow, what's with the flood of third-party ci system operators today asking zuul v3 questions? i tried to remind everyone in the third-party ci meeting this week that it's still a beta only in use by early adopters who are collaborating on its further development13:28
*** bandini has quit IRC13:28
fungiit hasn't been released yet (it's not even being merged into master for a couple more days)13:29
*** rlandy has joined #openstack-infra13:30
*** rlandy_ has joined #openstack-infra13:30
*** rlandy_ has quit IRC13:30
*** adarazs_lunch is now known as adarazs13:30
*** yamamoto_ has joined #openstack-infra13:32
*** makowals has quit IRC13:33
*** markvoelker has joined #openstack-infra13:33
*** bandini has joined #openstack-infra13:35
*** yamamoto_ has quit IRC13:35
*** yamamoto has quit IRC13:35
*** makowals has joined #openstack-infra13:35
mmedvedeI'll convey that in the future third-party CI meetings more clearly13:36
*** jpena|lunch is now known as jpena13:39
*** rossella_s has quit IRC13:40
*** dave-mccowan has joined #openstack-infra13:40
fungiappreciated mmedvede13:41
fungii expanded on that thought a bit in #openstack-third-party-ci just now too13:41
*** rossella_s has joined #openstack-infra13:42
mmedvedenoted, thanks fungi13:43
*** yamamoto has joined #openstack-infra13:47
*** dave-mccowan has quit IRC13:47
fungimordred: i recall you'd been looking into pipenv as a future option for some of our dependency management and testing?13:48
*** kgiusti has joined #openstack-infra13:48
fungithe threads about it on the distutils-sig ml over the past couple days make it sound unsuitable for our use cases (at least at its present stage of development)13:49
mordredmorning fungi13:50
mordredfungi: yah - I think it's likely too early13:50
fungilooks like consensus is that it's targeted at python-based applications which support a single python version and single versions of all dependncies13:51
mordredwell, the second part is similar to our constraints system13:51
*** saop has quit IRC13:51
*** annp has joined #openstack-infra13:51
fungiyeah, but dissimilar to deployment on distributions13:51
mordredthey have a Pipfile and a Pipfile.lock - similar to yarn and cargo and whatnot13:51
*** yamamoto has quit IRC13:52
fungiwhat mostly got me is the assumption that you're going to tell your uses which specific version of python they need to install alongside your application, not attempt to support the python their platforms provide13:52
mordredit's also problematic right now for us because it only supports 2 sets of dependencies - regular and devel13:52
fungiwell, we have projects right now which want to support a couple versions of some deps and need to override constraints to make that possible (e.g., django major versions). granted we have poor answers to that problem too13:54
*** dsariel has quit IRC13:55
mordredfungi: there's also pyenv: https://github.com/pyenv/pyenv - which is about installing specific versions of python13:56
*** dave-mccowan has joined #openstack-infra13:57
*** dbecker has joined #openstack-infra13:57
*** kiennt26 has joined #openstack-infra13:58
openstackgerritBrian Rosmaita proposed openstack-infra/project-config master: Remove legacy jobs for glance_store  https://review.openstack.org/52695513:58
fungiyeah, i'm considering switching away from source builds of all modern python minor versions on my dev systems to using something like that13:58
*** esberglu has joined #openstack-infra13:59
efriedHowdy folks.  POST_FAILUREs over the past 14h or so - should I just be rechecking?  (Don't want to flood the queue, etc.)13:59
fungiright now i have a set of per-release instructions tracking the build deps and compile-time optimizations to enable for each of them, and it's mildly annoying to keep up with13:59
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove swift3 legacy tox jobs  https://review.openstack.org/53010113:59
*** eharney has joined #openstack-infra14:00
fungiefried: no idea. a specific and recent example would probably help. i'll be at a different computer where i can look into it more easily in another 20 minutes or so14:01
efriedfungi https://review.openstack.org/#/c/522409/ -- looks like some kind of rsync thing.14:02
efriedMore examples available on request :)14:02
efriedI don't know how "recent" I can get - I'm just looking at stuff I submitted last night before I signed off.14:03
mordredefried: looking14:03
mordredefried: yah - that bug should be fixed14:04
mordredefried: and sorry - that one was my fault14:04
efriedmordred Okay, thanks, will go recheck-crazy!14:04
*** links has quit IRC14:05
efriedfungi ^ all good14:05
*** ankkumar has quit IRC14:05
*** mihalis68 has joined #openstack-infra14:06
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove legacy-puppet-murano-puppet-beaker-rspec  https://review.openstack.org/53153814:07
*** rossella_s has quit IRC14:07
*** ralonsoh_ has joined #openstack-infra14:08
*** ralonsoh has quit IRC14:08
*** rossella_s has joined #openstack-infra14:10
*** jgr has joined #openstack-infra14:10
*** witek has joined #openstack-infra14:11
jgrHello14:11
jgrIs there a way to trigger rebuild of branch tarballs?14:11
*** psachin has quit IRC14:12
jgrFor we're currently scratching our heads over https://tarballs.openstack.org/monasca-ui/monasca-ui-stable-pike.tar.gz : It should contain https://github.com/openstack/monasca-ui/commit/8babb0a85ee1b27614d812ecdfa7703b149850b4 (current stable/pike HEAD), but it appears to be at https://github.com/openstack/monasca-ui/commit/7bb2cdceda7713455d972720c8491d1a0e8877ca (which is a few commits back...)14:12
*** ykarel has quit IRC14:12
*** b_bezak has joined #openstack-infra14:14
*** rossella_s has quit IRC14:15
*** coolsvap has quit IRC14:16
*** yamamoto has joined #openstack-infra14:17
*** rossella_s has joined #openstack-infra14:17
*** dtantsur|brb is now known as dtantsur14:18
fungiefried: mordred: awesome news then, thanks ;)14:18
*** andreas_s has quit IRC14:19
*** danpawlik has quit IRC14:19
*** andreas_s has joined #openstack-infra14:19
fungijgr: one of our zuul admins can reenqueue that commit in the post pipeline so the job gets rerun, but maybe first we should look at the logs from the recent failed builds (or determine whether they're missing, which may mean we lost the builds if they were still queued during an ungraceful scheduler restart)14:20
*** yamamoto has quit IRC14:22
*** amoralej|lunch is now known as amoralej14:22
*** andreas_s has quit IRC14:26
*** andreas_s has joined #openstack-infra14:27
fungijgr: according to http://zuul.openstack.org/builds.html the last time the publish-openstack-python-branch-tarball job ran for the openstack/monasca-ui project it succeeded, but that was back on december 5 (looks like it corresponds to the monasca-ui-master.tar.gz on tarballs.o.o)14:28
*** yamahata has quit IRC14:30
fungijgr: also, current stable/pike HEAD of openstack/monasca-ui is 7bb2cdc from what i can see, not 8babb0a14:31
fungimerged october 30 of last year too... so i doubt we have records back that far14:32
fungino, wait, we do14:32
*** dsariel has joined #openstack-infra14:32
fungithe zuul dashboard says there was a POST_FAILURE for a run of that job on october 3014:33
*** david-lyle has quit IRC14:33
fungihowever, we don't keep more than a month or two of job logs, so i can't tell what exactly broke when it ran14:34
fungii'll try a local sdist and wheel build first, and if that works i'll reenqueue that ref and we can see if it's working properly in the ci system14:35
AJaegerfungi, frickler, can we try again merging the subunit changes by mordred, please? https://review.openstack.org/#/c/533834/14:35
witekfungi: thanks for checking monasca-ui14:36
*** hongbin has joined #openstack-infra14:39
*** olaph has quit IRC14:39
*** olaph has joined #openstack-infra14:40
fungijgr: witek: local sdist and wheel builds of openstack/monasca-ui worked, so i've reenqueued 7bb2cdceda7713455d972720c8491d1a0e8877ca for refs/heads/stable/pike into the post pipeline. it looks like we have a backlog in post right now, so may be several hours until the publish-openstack-python-branch-tarball job runs for that14:45
openstackgerritDavid Shrewsbury proposed openstack-infra/puppet-zuul master: Update fingergw init script for command socket  https://review.openstack.org/53433314:45
Shrewspabelanger: ^^^14:46
pabelangerShrews: thanks, I dropped the ball there14:46
witekfungi: thanks again14:46
jgrfungi: thanks!14:46
Shrewspabelanger: teamwork!14:46
pabelanger+214:46
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Revert "Set infracloud chocolate to max-servers: 0"  https://review.openstack.org/53433414:48
pabelangerinfra-root: I've confirmed infracloud-chocolate is running the correct kernel now. If we want to bring it back online^14:49
AJaegerpabelanger: yeah, thanks!14:49
pabelangerand config-core: ^14:49
pabelangerneed me sonme coffee :)14:49
*** danpawlik has joined #openstack-infra14:50
mordredpabelanger: woot!14:51
dmsimardinfra-root: this patch needs a +3 to merge and we likely want this sooner than later (zuul scheduler backups) https://review.openstack.org/#/c/532955/14:52
openstackgerritDoug Hellmann proposed openstack-infra/openstack-zuul-jobs master: [WIP] docs sitemap generation automation  https://review.openstack.org/52486214:52
dmsimardcorvus had +2 a previous patchset14:52
*** felipemonteiro has joined #openstack-infra14:53
mordreddmsimard: +314:53
*** felipemonteiro_ has joined #openstack-infra14:54
*** sree has joined #openstack-infra14:56
AJaegerdmsimard: care to review https://review.openstack.org/#/c/533834/ again, please? It contains now a fix - and if you look at https://review.openstack.org/#/q/topic:fetch-subunit , we should be good testing wise...14:56
dhellmanncorvus, pabelanger, dmsimard : I added some debug steps to https://review.openstack.org/524862 to dump all of the settings being used by the job so I could figure out what variables are available to me. That seems like something that might be useful in the base job definition. If you're interested, let me know and I can put that patch together.14:56
*** felipemonteiro has quit IRC14:58
*** Guest80016 has quit IRC14:59
*** rossella_s has quit IRC14:59
*** hichihara has quit IRC15:00
*** uberjay_ has quit IRC15:00
*** annp has quit IRC15:00
dmsimarddhellmann: that reminds me, I was told you might have bumped into the same issue as we did -- something about trying to access a file outside of the work root ?15:02
*** rossella_s has joined #openstack-infra15:03
*** yamamoto has joined #openstack-infra15:03
*** yamamoto has quit IRC15:03
dhellmanndmsimard : https://review.openstack.org/#/c/524862/ contains a script that needs to be run as part of the job. I can't figure out how to refer to the path to the file inside the role directory to do that.15:03
*** armax has joined #openstack-infra15:04
*** uberjay has joined #openstack-infra15:04
*** felipemonteiro_ has quit IRC15:04
*** cshastri has quit IRC15:05
larsksdhellmann: there is a role_path variable that has the path to the current role...15:06
*** uberjay has quit IRC15:06
*** alexchadin has quit IRC15:07
dmsimarddhellmann: yeah so I looked yesterday and understood what the problem was, let me get some logs15:07
dhellmannlarsks : that path does not appear to exist on the executor at the point when we try to run the script using the "script" module.15:08
dmsimarddhellmann: here's the explanation of what is going on: http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2018-01-15.log.html#t2018-01-15T22:44:1315:08
dhellmanndmsimard : thanks. I'll take a look at that after I clean up from the cat that just hurled its breakfast up on the floor. yay.15:08
dmsimarddhellmann: I haven't looked at your particular patch (yet) but hopefully that makes sense and it's something we'll want to address in the future15:09
dmsimardfungi: I remember discussing hound with you -- it turns out someone ended up sending a pull request for exactly the feature I needed, I'll try it out and report back :) https://github.com/etsy/hound/pull/27515:10
larsksdhellmann: if you're using the `script` module, you're running on the remote host, so a variable referring to the local role path wouldn't make sense anyway, right?15:12
*** yamamoto has joined #openstack-infra15:12
corvusdhellmann: well, the short version of why i was suggesting you see if relative paths work is because if you specify the full path, zuul is likely to disallow it on security grounds currently -- that's the issue dmsimard mentioned.  so before searching for a variable that will let you build a full path, we should look at relative paths, since they are not likely to trigger the security check.15:12
dhellmannlarsks : I don't know enough about how any of this works to know what makes sense.15:13
corvuslarsks: in the script module, the source for the script is on the local host.15:13
larskscorvus: right, sure.15:13
dhellmanncorvus : the current version of the patch is using "copy" and "command" so we'll see how that goes15:13
*** uberjay has joined #openstack-infra15:15
*** bhavik1 has joined #openstack-infra15:16
corvusdhellmann: ack15:16
dhellmanncorvus : I looked yesterday for the source for the script module and couldn't find it in the ansible tree. have any hints on where I should be looking?15:17
*** yamamoto has quit IRC15:17
openstackgerritMerged openstack-infra/puppet-zuul master: Update merger / scheduler init script for zuulv3  https://review.openstack.org/52646315:18
dhellmannsince none of the ansible documentation examples for the script module show using a relative path, I wanted to see what sort of searching it might be doing15:19
tobiashdhellmann: https://github.com/ansible/ansible/blob/devel/lib/ansible/modules/commands/script.py15:21
dhellmanntobiash : that's all just documentation, no code15:21
dhellmannthat's what I did manage to find15:21
tobiashoh, you're right15:21
tobiashonly looked at the file name ;)15:21
*** shardy has quit IRC15:21
dhellmannis it maybe lib/ansible/plugins/action/script.py?15:21
*** shardy has joined #openstack-infra15:22
*** prometheanfire has joined #openstack-infra15:22
tobiashyes, that seems to be it15:23
corvusyep15:23
dhellmannok, that does use a search function and it seems to look in 'files' by default so maybe using the script name without any path at all would work15:24
dhellmannI'll try that after the current patch runs15:24
dhellmannwere you interested in having any of that debug stuff added to the base job?15:24
openstackgerritMerged openstack-infra/puppet-zuul master: Periodically retrieve and back up Zuul's status.json  https://review.openstack.org/53295515:25
tobiashdhellmann: it might be relative to the working dir of the ansible process: https://github.com/ansible/ansible/blob/cc343a4376a27927e0c7d31862dbb3108e101978/lib/ansible/plugins/connection/ssh.py#L95815:26
tobiashthe source seems to be passed unmodified until there15:26
dhellmanntobiash : ah, I was looking at https://github.com/ansible/ansible/blob/devel/lib/ansible/plugins/action/script.py#L81 and the implementation of _find_needle()15:28
dhellmannbut you're right, it takes the basename of the source value there15:28
dhellmannso where is the script relative to the working dir, which seems to be /home/zuul?15:29
*** links has joined #openstack-infra15:29
tobiashit's not inside the work dir15:29
corvusi'm pretty sure the working directory of ansible ends up being the playbook dir15:30
tobiashit should be in ../ansible/<somethere here>15:30
tobiashcorvus: the executor runs the ansible process with self.work_root as pwd15:31
corvustobiash: ansible changes it15:31
tobiashwhich is root/work15:31
tobiashah15:31
*** sree_ has joined #openstack-infra15:32
tobiashbut anyway I wouln't rely on that and just use "{{ role_path }}/files/myscript"15:32
corvustobiash: see the conversation yesterday that dmsimard linked to on why we think role_path may not work15:32
*** sree_ is now known as Guest4043415:32
tobiashoh, missed that15:32
*** esberglu has quit IRC15:32
dhellmannwhen I run a shell task with "pwd" in it, the output is /home/zuul15:33
dmsimardtobiash: http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2018-01-15.log.html#t2018-01-15T22:44:1315:33
*** sree has quit IRC15:33
corvusdhellmann: interesting.  that is what we set it to.  i'm sure we've seen behavior where ansible does't treat that as the pwd before, but i stand corrected.  :)15:34
*** caphrim007_ has quit IRC15:34
dhellmannwell, "shell" and "script" may be doing 2 different things.15:35
*** jcoufal has quit IRC15:35
dhellmannI have to say, the more I use ansible the more I like the idea and the less I like the implementation.15:35
*** gema has quit IRC15:35
corvusdhellmann: give them some slack -- you may have hit a corner case of ansible + zuul we need to work through.  :)15:35
*** rossella_s has quit IRC15:36
dhellmannoh, sure. I still use it a ton for my own stuff. The use case there is a lot simpler, though, so I seem to struggle less.15:36
fungiyeah, i get the impression that we shouldn't be treating the state of pwd inherited from ansible as any stable api element and make sure to set it explicitly in the scope of the task if we need to know its value15:36
corvusdhellmann: btw, did you try role_path and confirm our suspicions?15:36
dhellmannI can also do things like login to a server and see wtf is going on15:36
dhellmanncorvus : yes, role_path failed15:36
dhellmannI forget if it was "that does not exist" or "permission denied". I think the former.15:36
corvusdhellmann: hit the path not allowed error15:36
corvusdhellmann: yeah sounds about right.  ok.15:37
*** sbra has joined #openstack-infra15:37
*** hemna_ has joined #openstack-infra15:37
dhellmannthe current version does the 2 steps on its own because I think I know how both "copy" and "command" work15:37
dhellmannif that works, I'll try using script without a path prefix on the command name, because it sounds like the "script" module is basically a single action that does both the copy and the command step15:38
fungisounds likely15:38
*** bobh has joined #openstack-infra15:41
*** esberglu has joined #openstack-infra15:48
mordreddhellmann: yes - I believe that is correct15:48
*** david-lyle has joined #openstack-infra15:49
*** links has quit IRC15:51
mordredcorvus, dhellmann: re: pwd - shell tasks should always start with pwd == $HOME == /home/zuul - there are some cases where the copy module decides to calculate relative paths for the remote machine based on the pwd on the executor leading to carnage - but there's actualy no way for us to systemically change the remote pwd - it's always $HOME because that's the pwd that you get from ssh15:51
dhellmannmakes sense15:51
corvusmordred: oh right, i was confusing local and remote.  it's the local pwd which is the playbook path.  shell, of course, is a remote task.15:52
dhellmannin the current iteration I'm copying the script into src_project_root and then trying to run it from there15:52
corvusi stand uncorrected15:52
mordred(there are times I really wish we had the ability to set remote pwd in a more pervassive fashion - it would make some playbooks nicer to be able to say "cd {{ zuul_work_dir }}" and have the persist over the playbook15:52
*** jamesmcarthur has joined #openstack-infra15:52
corvusin my defense, i have not had breakfast15:52
*** dave-mccowan has quit IRC15:52
mordredcorvus: has anybody *really* had breakfast?15:52
corvusnot unless they've had grits15:53
* dhellmann had vegemite on toast15:53
fungiironically, i had marmite on toast (and also an umeboshi)15:56
clarkbmmedvede: did you see my email to the infra list late last week about possibly merging feature/zuulv3 into master? Looks like corvus wants to aim for a thursday merging. Any concerns with that?15:57
mmedvedeclarkb: yes, I have15:57
mmedvedeI have seen the email15:57
*** yamamoto has joined #openstack-infra15:58
AJaegerconfig-core: care to review https://review.openstack.org/#/c/533834/ (consolidate subunit roles), please? It contains now a fix for the initial problem - and if you look at https://review.openstack.org/#/q/topic:fetch-subunit , we should be good testing wise...15:58
mmedvedeclarkb: I can not speak for all the third-party CI operators, but I think it mostly should be fine. Operators should be not installing from master, but a few might. Not sure if there is a good way to ensure none break15:59
*** gema_ has joined #openstack-infra16:00
*** yamamoto has quit IRC16:01
*** dhill_ has joined #openstack-infra16:01
*** yamamoto has joined #openstack-infra16:01
*** yamamoto has quit IRC16:01
mordredwell - if an operator is installing from master at this point, the merge will flush them out and we'll know about them ... and luckily there should be an easy fix for them if we do break someone16:03
*** makowals has quit IRC16:05
*** kiennt26 has quit IRC16:06
*** yamahata has joined #openstack-infra16:08
*** bhavik1 has quit IRC16:09
clarkbpabelanger: did baremetal00 get rebooted too?16:09
clarkblooks like no16:09
*** gouthamr has joined #openstack-infra16:10
clarkbpabelanger: were you planning to do that or should I do it after my morning meeting?16:11
openstackgerritMatthew Treinish proposed openstack/os-testr master: Fix load command in pdb/no-discover path  https://review.openstack.org/53436516:12
pabelangerclarkb: Ah, didn't know we also need that. I can do it now16:13
clarkbpabelanger: saved it for last like puppetmaster as it was control for all the others16:13
clarkbI did check dmesg on it and it appears the hardware is happy compared to the other nodes16:14
pabelangerclarkb: yah, I don't see any HDD errors on it too16:14
pabelangerclarkb: so, think we can reboot now16:14
clarkbpabelanger: ya I think all the other nodes are done may as well go for it16:17
clarkbwe shouldn't need to backup anything as its all in puppet16:18
*** e0ne has quit IRC16:18
clarkb(host info and ipmi passwords etc)16:18
pabelangerk, rebooting16:19
pabelangerand agree, everything should be in puppet16:19
*** dave-mccowan has joined #openstack-infra16:21
*** rossella_s has joined #openstack-infra16:23
openstackgerritJeremy Stanley proposed openstack-infra/system-config master: Allow governance site content to include redirects  https://review.openstack.org/53437016:25
*** links has joined #openstack-infra16:25
fungittx: ^ there's what you needed16:25
*** b_bezak has quit IRC16:26
*** mihalis68 has quit IRC16:26
*** kjackal has quit IRC16:26
*** b_bezak has joined #openstack-infra16:26
ttxfungi: thx16:27
clarkbpabelanger: its up and kpti is enabled according to dmsg \o/16:28
*** janki has quit IRC16:29
*** b_bezak has quit IRC16:31
*** hashar has quit IRC16:32
*** ramishra has quit IRC16:33
*** krtaylor has quit IRC16:36
*** jpena is now known as jpena|off16:37
*** gouthamr has quit IRC16:38
pabelangerclarkb: yup, confirmed16:39
pabelangerclarkb: https://review.openstack.org/534334/ will also enable infra-cloud again16:39
clarkbpabelanger: approved16:40
*** gyee has joined #openstack-infra16:41
clarkbthe fix for ndoepool nto handling the cloud being down is up with a test in a child change. I need to address a comment from tristanC though16:41
*** yamamoto has joined #openstack-infra16:41
clarkbif you are interested in reviewing that too16:41
*** jpena|off is now known as jpena16:41
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Remove infra settings for retired evoque projects  https://review.openstack.org/53437616:44
pabelangerclarkb: yah, let me look again16:45
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Only decline requests if no cloud can service them  https://review.openstack.org/53337216:46
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Add test_launcher test  https://review.openstack.org/53377116:46
*** yamamoto has quit IRC16:46
clarkbpabelanger: ^ updated to address teh review comment16:46
*** andreas_s has quit IRC16:46
corvusclarkb: did you mean 'fail' rather than 'decline' in that commit message?16:46
*** andreas_s has joined #openstack-infra16:47
clarkbcorvus: yes! let me push another update to make that clear16:47
AJaegersmcginnis: what about abanding https://review.openstack.org/#/c/534376 and merging https://review.openstack.org/#/c/533698/ instead?16:48
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Only fail requests if no cloud can service them  https://review.openstack.org/53337216:48
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Add test_launcher test  https://review.openstack.org/53377116:48
clarkbthere16:48
AJaegersmcginnis: I can add another +A to 533698 to merge it...16:48
smcginnisAJaeger: Oops.16:48
dtantsurhey, can someone please approve https://review.openstack.org/#/c/531382/ ?16:48
AJaegersmcginnis: shall I +A?16:48
smcginnisAJaeger: I thought I had done that already, but was confusing myself with the other one I did.16:48
smcginnisAJaeger: I had already hit recheck on that one, unfortunately.16:49
corvusdmsimard: i'm getting a bounce message every 30 seconds from the zuul queue cron; can you /dev/null it please?16:49
AJaegersmcginnis: anvil is the one you still need to do, don't you?16:49
smcginnisHmm, thought I don't see it showing up.16:49
* clarkb breakfasts then will try to catch up on reviews16:50
corvusdmsimard: also, those of us with non-google mtas are also getting the actual output every 30 seconds16:50
smcginnisAJaeger: I think anvil is complete. But now I am second guessing myself, so I better doublce check.16:50
AJaeger;)16:50
dmsimardcorvus: oops16:50
clarkbcorvus: dmsimard can confirm16:50
corvuser, i guess it's every minute16:50
AJaegersmcginnis: yes, anvil is complete16:50
dmsimardI'm stepping away to pick up the kids from school *right now*, I'll be able to send a patch in ~20 minutes if no one has done so before then16:51
smcginnisAJaeger: Yep - https://review.openstack.org/#/c/532643/16:51
dmsimardsorry :(16:51
corvusdmsimard: ack, thanks16:51
smcginnisThat one was easier since it had already done most of the work. We just needed that final cleanup.16:51
AJaegeryep16:51
*** links has quit IRC16:54
openstackgerritJames E. Blair proposed openstack-infra/puppet-zuul master: Redirect curl stderr to /dev/null  https://review.openstack.org/53438016:57
*** caphrim007 has joined #openstack-infra16:57
corvusinfra-root: ^ could we maybe merge that quickly so i don't have to go write email filters? :)16:57
openstackgerritDoug Hellmann proposed openstack-infra/openstack-zuul-jobs master: [WIP] docs sitemap generation automation  https://review.openstack.org/52486216:58
fungicorvus: just redirecting stderr and not stdout?16:59
fungiwfm as long as it's not also chatty on stdout16:59
corvusfungi: i think stderr is the only thing showing up in the email; i guess we could do both for extra safety?  (or is it extra recklessness?)16:59
*** Guest40434 has quit IRC17:00
fungis/safety/sanity/ perhaps ;)17:00
*** gouthamr has joined #openstack-infra17:00
*** sree has joined #openstack-infra17:00
fungibut anyway, i'm fine with just redirecting fd2 if it's not spewing on fd117:00
*** andreas_s has quit IRC17:01
*** yamahata has quit IRC17:02
pabelangerwhat about curl --silent ?17:03
openstackgerritMerged openstack-infra/project-config master: Revert "Set infracloud chocolate to max-servers: 0"  https://review.openstack.org/53433417:03
corvusi'm happy with any revisions people want to make on top of my patch which i want to land asap :)17:03
*** sree has quit IRC17:05
dmsimardI'm back17:11
dmsimardWe can do 2>&1 >/dev/null... or pipe it to systemd-cat to log into the journal instead17:11
dmsimardWhatever works17:11
dmsimardthe most important part is that the backup actually works /me looks17:12
*** jascott1 has quit IRC17:12
clarkbdtantsur: done17:12
*** jascott1 has joined #openstack-infra17:12
dtantsurthanks!17:12
dmsimard97 backup'd status.jsons \o/17:12
AJaegerYeah!17:12
dmsimardhuh, that's interesting17:13
dmsimardzuulv3 has an additional partition but it's for /var/log/zuul instead of /var/lib/zuul17:13
dmsimard(I was keeping an eye on disk space for backups, we don't have *that* much space on /)17:13
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Add cross-source tests  https://review.openstack.org/53269917:15
fungiwe could probably stand to compress those too (i bet they compress well)17:15
fungithe status backups i mean17:15
dmsimardoh, sure -- we could do that inline curl | gz17:15
corvus++17:15
dmsimardhowever that also means we need to set up a json.gz mimetype for zuul-web's vhost so that we can use the actual URL when doing a restore of the queues17:16
dmsimardnot a huge deal17:16
*** lucasagomes is now known as lucas-pto17:17
*** iyamahat has joined #openstack-infra17:19
*** tesseract has quit IRC17:21
fungiwhy would we need to serve the backups from zuul-web's vhost? i probably missed the details of the implementation... was it meant to provide a fallback or merely a local convenience copy for the admin? if the latter, we could just adjust teh tool to allow you to point it at a local file path17:21
* fungi has to step away to run a quick errand, but will brb17:21
dmsimardfungi: my understanding is that /opt/zuul/tools/zuul-changes.py accepts an URL -- however the right fix might be to make it accept a filesystem location instead17:22
dmsimardand then if we do that, we can move backups elsewhere (and not bother with serving them through zuul-web)17:23
clarkbre pipfile conversation from before I'm not sure I follow why it wouldn't work for us? It does support multiple versions of python from reading their docs17:23
openstackgerritMerged openstack-infra/project-config master: Retire Evoque project  https://review.openstack.org/53369817:23
clarkbyou can even have markers and all that fun stuff17:23
clarkbthe only thing is we might have to publish different lock files for different platforms17:23
clarkb(but thats true of constraints too)17:23
clarkbmordred: fungi ^17:24
pabelangerdmsimard: yah, logs were getting pretty big on zuul. I think that is why the extra partition17:24
*** jpich has quit IRC17:30
dmsimardfungi: seems fairly easy (re: adding support for status.json file from filesystem rather than URL), I'll take a stab at it after I've wrapped up what I'm on17:31
*** zigo has quit IRC17:33
*** openstackgerrit has quit IRC17:33
*** sshnaidm is now known as sshnaidm|afk17:34
*** jascott1 has quit IRC17:34
*** sshnaidm|afk has quit IRC17:34
*** bhavik1 has joined #openstack-infra17:35
*** trown is now known as trown|lunch17:35
*** ldnunes has quit IRC17:35
*** bhavik1 has quit IRC17:35
clarkbcorvus: you good for me to delete jeblairtest now?17:35
clarkber jeblairtest01.openstack.org is the full instance name17:36
corvusclarkb: yep, sorry i dropped that17:36
*** ldnunes has joined #openstack-infra17:36
mordredclarkb: well, the main downside from my end looking at it so far is that it only supports two sets of depends - the normal ones and ones for 'develop'17:36
clarkbcorvus: np I'll delete it now17:36
*** yamahata has joined #openstack-infra17:37
pabelangerchocolate looks to be back online now17:37
mordredclarkb: it would be nice to be able to have arbitrary ones, so we could continue to keep docs split - although I suppose nothing is stopping us from keeping docs/requirements.txt - or even having a docs/Pipfile{,.lock}17:37
*** zigo has joined #openstack-infra17:37
*** openstackgerrit has joined #openstack-infra17:38
*** vsaienk0 has quit IRC17:38
openstackgerritMerged openstack-infra/project-config master: Adjust gerrit ACLs for networking-generic-switch  https://review.openstack.org/53138217:38
clarkbmordred: ya or just collapsing it again. Its nto a deal breaker in any case I don't think17:38
*** manjeets has joined #openstack-infra17:38
mordredclarkb: it would also be nice (and an improvement over today) if we could have arbitrary lists in Pipfile that correspond with extras17:38
mordredclarkb: no, I agree - docs isn't a dealbreaker17:38
clarkbcorvus: 'No server with a name or ID of 'jeblairtest01.openstack.org' exists.`17:38
corvusclarkb: do you mean you deleted it, or it was never there?17:39
mordredclarkb: but we will need to figure out how Pipfile.lock intersects with our constraints files17:39
*** ykarel has joined #openstack-infra17:39
clarkbcorvus: I deleted it17:40
clarkb(sorry if that was ambiguous)17:40
corvusclarkb: kk17:40
mordredI guess it would be worthwhile to suggest to the pipfile folks that the reason we'd like arbitrary named sets is mostly related to supporting extras (they currently only support devel 'for now, to see if anyone really needs the complexity')17:40
clarkbmordred: ya my reading of it is that the lock file largely replaces the constraints file17:40
*** rfolco_nho has quit IRC17:41
clarkbmordred: but we'd need to publish a python3 and python2 lock file and possibly different files for ubuntu and centos and so on17:41
clarkbthats the big that isn't entirely clear to me, how platform dependent it is17:41
pabelangerclarkb: mordred: https://review.openstack.org/511986/ and https://review.openstack.org/532615/ would be nice to land. Removes puppet syntax for zuulv3-dev and zuul-dev servers we've now deleted17:42
*** jascott1 has joined #openstack-infra17:42
*** yamamoto has joined #openstack-infra17:44
clarkbmordred: to have the ansible openstack inventory stuff rebuild its cache I just delete /var/cache/ansible-inventory/ansible-inventory.cache ?17:45
* clarkb is double checking meltdown patching before calling it done17:45
*** andreas_s has joined #openstack-infra17:47
clarkbpabelanger: 511986 conflicts with fungi's zuul01 change. Do we want to get zuul01 done first?17:47
*** ykarel has quit IRC17:47
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Remove infracloud-vanilla from nodepool  https://review.openstack.org/53439517:48
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Support cross-source dependencies  https://review.openstack.org/53080617:49
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add cross-source tests  https://review.openstack.org/53269917:49
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Documentation changes for cross-source dependencies  https://review.openstack.org/53439717:49
clarkbpabelanger: also did you want to delete kdc02 in ord?17:49
fungiclarkb: pabelanger: i can certainly rebase. i'm still fiddling with trying to get it to boot (i think there's still some weirdness with expand-groups even from a launch script context)17:50
*** ekcs has quit IRC17:52
*** florianf has quit IRC17:53
clarkbfungi: ah ok, I did +2 the change so pabelanger can approve if fungi is good with rebasing17:53
fungiclarkb: on pipenv, nick was also stating explicitly that they're really only considering application development and distribution use cases for now and that using it for dependencies of libraries is out of scope at this point17:53
pabelangerclarkb: fungi: great, will approve now17:54
fungiso could certainly make for some weirdness when wanting to package and test libraries themselves outside the context of a consuming application17:54
pabelangerclarkb: let me check kdc02, thought I did get it already17:54
mordredclarkb, fungi: well - I think the communication from rust/cargo about lock files for apps vs libraries holds here17:55
*** derekh has quit IRC17:55
mordredclarkb, fungi: which is that you should commit the .lock file for apps and should not commit it for libraries17:55
AJaegermordred: do you want to change  https://review.openstack.org/533834? See tobiash comment17:55
mordredclarkb, fungi: https://doc.rust-lang.org/cargo/guide/cargo-toml-vs-cargo-lock.html for reference17:56
pabelangerfungi: oh, it is trying to do something with infracloud-vanilla? I am not sure I removed it from all-clouds.yaml17:56
pabelangerlet me check quickly17:56
mordredAJaeger: yah - one sec17:56
fungipabelanger: no, seems like puppet still isn't finding the zuul-scheduler hiera group keys on the booted node17:56
pabelangerfungi: okay, i did remove vanilla, so that shouldn't be it17:56
mordredAJaeger: yah  on it17:57
*** ldnunes has quit IRC17:57
fungimordred: in the context of an application i agree that makes sense. but what if your library is both a stand-alone application and a dependency consumed by other applications? (perhaps don't do that is one answer) and what about when you want to test a library outside the context of a consuming application? (treat your test framework as an application perhaps)17:57
clarkbmordred: fungi gotcha so it would be useful for say nova in a devstack install but not necessarily for random unittests in some lib17:57
pabelangerfungi: odd, looks like groups.txt is right17:57
*** ldnunes has joined #openstack-infra17:58
clarkbcorvus: mordred http://paste.openstack.org/show/645743/ something is making apparmor for mysqld unhappy on cacti02. Any idea what that is?17:58
clarkblooks like possibly part of the puppet run?17:58
*** yamamoto has quit IRC17:58
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Revert "Revert "Add consolidated role for processing subunit""  https://review.openstack.org/53383417:58
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Adjust check for .stestr directory  https://review.openstack.org/53268817:58
mordredAJaeger: done. thanks!17:58
fungipabelanger: yeah, i'm going to try again now and if it's still failing then try to manually run expand-groups and have yet another go at it17:59
mordredclarkb, fungi: yah - and I think we'll need to figure out things like how/when to merge from a global pipfile.lock, etc17:59
clarkbpabelanger: thanks on kdc02 I think its the last thing we need for our control plane to be marked off on meltdown17:59
AJaegermordred: thanks. tobiash,do you want to review 533834  again?17:59
tobiashlooking17:59
AJaegerinfra-root, any one to review https://review.openstack.org/529000 Add neutron-tempest-plugin-api job - for frickler, please?18:00
AJaegerconfig-core, could you review https://review.openstack.org/#/c/513589/ Remove heat-templates jobs, please?18:00
pabelangerclarkb: yup, doing that now18:01
AJaegerclarkb, I won't be able to join the team meeting today18:01
clarkbAJaeger: no problem. Enjoy your evening18:02
pabelangerAh, kdc02.openstack.org was shutoff, not deleted18:02
clarkbpabelanger: ya18:02
pabelangerclarkb: okay, deleted now18:02
*** sshnaidm|afk has joined #openstack-infra18:03
clarkbinfra-root config-core friendly reminder we have an Infra meeting in an hour.18:03
clarkbpabelanger: tyty18:03
*** dsariel has quit IRC18:04
tobiashAJaeger, mordred +2 with comment/question18:04
*** andreas_s has quit IRC18:05
*** dtantsur is now known as dtantsur|afk18:05
clarkbfungi: is 2001:4800:7819:103:be76:4eff:fe04:9f30 new zuul server?18:06
clarkbother than ^ we look good on meltdown18:06
Zara:D18:06
*** shardy has quit IRC18:07
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove updateChange history from github driver  https://review.openstack.org/53190418:07
AJaegermordred: do you want to this as followup or update? dmsimard made the same comment in https://review.openstack.org/#/c/529339/1/roles/fetch-subunit-output/tasks/main.yaml18:07
* AJaeger leaves for now...18:08
fungiclarkb: good question, i don't know yet18:08
clarkbsshnaidm|afk: dmsimard can I remove the graphite data meeting topic from today's meeting? or have we discovered new stuff since last week that we want to talk about?18:08
sshnaidm|afkclarkb, you can remove18:08
*** david-lyle has quit IRC18:08
fungiclarkb: if that instance disappeared then it was an attempt at the new server. launching it failed and the launch script cleaned up the instance it had created18:09
clarkbfungi: ansible failed to ssh to it18:09
fungidid it have a name in the inventory?18:09
*** olaph1 has joined #openstack-infra18:09
*** olaph has quit IRC18:10
clarkbfungi: aha yup zuul0118:10
fungilikely a stale entry as that's not in the provider at this point18:11
mordredAJaeger: yah - lemme do that a followup18:11
fungipabelanger: what it's failing on is "Could not find data item gerrit_zuul_user_ssh_key_contents in any Hiera data file and no default supplied at /opt/system-config/production/manifests/site.pp:1450 on node zuul01.openstack.org"18:11
fungipabelanger: and that key exists in /etc/puppet/hieradata/production/group/zuul-scheduler.yaml on the puppetmaster18:12
fungiso i'm at a bit of a loss unless group expansion is broken or something18:13
*** jascott1 has quit IRC18:14
*** jascott1 has joined #openstack-infra18:15
corvusfungi: i agree i don't see what could be wrong... maybe worth setting --keep so we can poke at what ansipuppet is trying to do there?18:15
fungicorvus: yup, gonna try that next18:16
corvusfungi: oh wait, do you need to set $group in site.pp?18:17
*** links has joined #openstack-infra18:17
fungioh!18:17
fungii bet i do :/18:17
corvusi think you've told ansible to put that group file on the host, but puppet still needs to know to use it18:17
fungiso many moving parts. thanks!18:17
fungipatch inbound18:17
*** bobh has quit IRC18:21
openstackgerritJeremy Stanley proposed openstack-infra/system-config master: Set the zuul-scheduler group for zuul01  https://review.openstack.org/53440418:21
fungicorvus: pabelanger: ^18:21
* fungi feels sheepish18:21
pabelangerlooking18:22
pabelanger+218:22
clarkbapproved18:22
fungiappreciated18:22
*** armax has quit IRC18:25
*** armax has joined #openstack-infra18:26
*** gema_ has quit IRC18:29
pabelangerseem to be getting Error in creating the server: No valid host was found. from OVH again.18:33
pabelangerwonder if they moved some of our server out of our pool again18:33
*** links has quit IRC18:34
pabelangerI'll work up an email and send it along to OVH18:34
fungithanks pabelanger18:35
pabelangerdone18:36
*** links has joined #openstack-infra18:36
*** vsaienk0 has joined #openstack-infra18:37
*** trown|lunch is now known as trown18:39
*** sshnaidm|afk is now known as sshnaidm18:39
*** jpena is now known as jpena|off18:45
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Clarify provider manager vs provider config  https://review.openstack.org/53161818:46
*** jbadiapa_ has joined #openstack-infra18:46
*** vsaienk0 has quit IRC18:46
*** ekcs has joined #openstack-infra18:47
*** ralonsoh_ has quit IRC18:47
*** lbragstad_ has joined #openstack-infra18:47
*** jbadiapa has quit IRC18:48
mordreddmsimard: I feel like a while back you found a good way to do something like with_first_found except for finding files on the remote host (since with_first_found works on the executor)18:49
*** dbecker has quit IRC18:49
*** lbragstad has quit IRC18:49
dmsimardmordred: a good way is probably an overstatement but yeah18:49
*** lbragstad_ is now known as lbragstad18:50
mordreddmsimard: a way then. :)18:50
dmsimardmordred: let me see where that was18:50
dmsimardmordred: was for your sphinx stuff iirc18:50
openstackgerritMerged openstack-infra/system-config master: Remove zuulv3-dev.o.o  https://review.openstack.org/51198618:50
mordredah, right.18:50
mordreddmsimard: hahaha18:51
dmsimardmordred: https://github.com/openstack-infra/zuul-jobs/blob/master/roles/ensure-sphinx/tasks/main.yaml ? I don't see anything special there though18:51
mordreddmsimard: bash18:51
mordredyup18:51
dmsimardmordred: I think we gave up18:51
mordredworks for me18:51
mordredsometimes giving up is the right choice18:51
*** bobh has joined #openstack-infra18:52
dmsimardit would be great to use lookups remotely sometimes ..18:52
dmsimardmordred: we could probably write a module that basically does https://github.com/ansible/ansible/blob/devel/lib/ansible/plugins/lookup/first_found.py but remotely and then you can use the registered output of it18:52
mordreddmsimard: ++18:53
mordreddmsimard: also - honestly, being able to use lookups remotely would be awesome18:53
dmsimardit uses https://github.com/ansible/ansible/blob/6bca5e5a4ad7ca6120e002a00aef107c6f6be986/lib/ansible/plugins/lookup/__init__.py#L11118:53
dmsimardmordred: I don't remember why but bcoca was pretty against lookups in general18:54
mordredthey're weird18:54
dmsimardthey are18:54
mordredand they run in the local context when you're not expecting them too18:54
dmsimardopenstack-infra meeting in 5 minutes in #openstack-meeting18:54
dmsimardmordred: lookups are *always* local18:54
dmsimardmordred: like it'd be super helpful to do.. like.. lookup('file', 'some_file') but remotely -- instead you're stuck doing a registered command cat.. or a slurp with the base64 madness18:55
dmsimard¯\_(ツ)_/¯18:55
*** wolverineav has quit IRC18:56
*** wolverineav has joined #openstack-infra18:56
*** electrofelix has quit IRC18:57
*** bobh has quit IRC18:57
*** efried is now known as efried_nomnom18:57
*** ykarel has joined #openstack-infra18:58
*** eumel8 has quit IRC18:58
*** sambetts is now known as sambetts|afk18:58
*** electrofelix has joined #openstack-infra18:58
*** david-lyle has joined #openstack-infra18:59
openstackgerritMerged openstack-infra/system-config master: Remove zuul-dev.o.o  https://review.openstack.org/53261519:00
clarkbmeeting time19:00
*** spzala has joined #openstack-infra19:01
*** gouthamr has quit IRC19:06
*** links has quit IRC19:07
*** bobh has joined #openstack-infra19:11
*** andreas_s has joined #openstack-infra19:13
*** olaph has joined #openstack-infra19:16
*** olaph1 has quit IRC19:17
*** andreas_s has quit IRC19:17
*** andreas_s has joined #openstack-infra19:18
*** wolverineav has quit IRC19:22
*** wolverineav has joined #openstack-infra19:22
*** wolverineav has quit IRC19:23
*** wolverineav has joined #openstack-infra19:24
*** vsaienk0 has joined #openstack-infra19:32
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: import blog post "Things that StoryBoard does differently"  https://review.openstack.org/53441219:34
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: separate worklist instructions from theory  https://review.openstack.org/53441319:34
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: fix document cross-link syntax  https://review.openstack.org/53441419:34
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: fix syntax for toctree  https://review.openstack.org/53441519:34
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: fix literal block markup for blocks within bullet lists  https://review.openstack.org/53441619:35
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: escape an example URL as literal text to avoid build warning  https://review.openstack.org/53441719:35
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: fix field list markup syntax  https://review.openstack.org/53441819:35
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: highlight notes about permissions on API endpoints  https://review.openstack.org/53441919:35
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: import blog post "Mapping Launchpad to StoryBoard"  https://review.openstack.org/53442019:35
openstackgerritDoug Hellmann proposed openstack-infra/storyboard master: import blog post "Why StoryBoard for OpenStack?"  https://review.openstack.org/53442119:35
*** andreas_s has quit IRC19:35
fungidhellmann: thanks for importing those!19:37
dhellmannas I mentioned in #storyboard, the actual content probably needs some tone cleanup but at least it builds19:38
fungithat's stellar19:38
fungiand good low-hanging fruit for someone who feels up to editing prose19:39
pabelangerTIL: https://storyboard-blog.io/19:40
*** vsaienk0 has quit IRC19:42
*** andreas_s has joined #openstack-infra19:42
fungipabelanger: yeah, repeated attempts to publicize that fell flat, i'm afraid19:42
*** smatzek has quit IRC19:42
*** slaweq_ has joined #openstack-infra19:43
openstackgerritDoug Hellmann proposed openstack-infra/openstack-zuul-jobs master: [WIP] docs sitemap generation automation  https://review.openstack.org/52486219:43
*** smatzek has joined #openstack-infra19:44
*** harlowja has joined #openstack-infra19:44
smcginnisI found it interesting that there was objection to using storyboard based on its use of red as a graphical element. :?19:45
*** slaweq_ has quit IRC19:46
*** gema has joined #openstack-infra19:46
*** slaweq_ has joined #openstack-infra19:47
dhellmannyeah, that was a surprise19:48
dhellmannI hesitate to ask what color would be better. I mean, that's the definition of bike shed, isn't it?19:49
smcginnisNo kidding!19:49
*** pcaruana has quit IRC19:50
*** ykarel has quit IRC19:51
*** andreas_s has quit IRC19:51
*** slaweq_ has quit IRC19:52
*** dprince has quit IRC19:52
fungiat least it's themable19:52
openstackgerritMonty Taylor proposed openstack-infra/storyboard-webclient master: WIP Migrate to using webpack  https://review.openstack.org/53442419:52
*** gouthamr has joined #openstack-infra19:52
fungiwe could likely offer a "less offensive" stylesheet i suppose ;)19:53
openstackgerritMonty Taylor proposed openstack-infra/storyboard-webclient master: Update UI-Router  https://review.openstack.org/38455419:53
ZaraI have some irc logs for that discussion somewhere19:53
Zaraiirc I suggested one possible fix was changing monitor settings to black and white19:54
smcginnis:)19:54
funginice!19:54
Zarait seemed like an issue that could affect other websites.19:54
fungiand if you object to white, use an old green crt19:54
smcginnisOr use the Stylish browser plugin.19:55
*** david-lyle has quit IRC19:57
*** david-lyle has joined #openstack-infra19:57
*** bobh has quit IRC19:59
Zaraaha, http://eavesdrop.openstack.org/irclogs/%23storyboard/%23storyboard.2017-02-16.log.html20:01
clarkbianw: not sure if you saw but mtreinish apparently ahs arm64 hardware (knowing mtreinish he may be willing to help test your images once you are ready)20:01
* clarkb lunches20:01
mordredcorvus, clarkb, fungi: help me remember when we talk about renames - devstack currently also clones python-openstacksdk and so we might need to tee up a devstack patch as part of the rename20:02
fungimordred: k, i'll do my best to nail that one to my wall 'o memory20:02
ianwclarkb: ok, cool.  i actually have a little pine64 board that's largely unused, i've never actually looked at the details of how that boots, only just burnt a prebuilt image20:03
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Refactor fetch-subunit-output  https://review.openstack.org/53442720:04
mordredAJaeger: oh noes20:04
AJaegermordred, tobiash ^20:04
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Clean up when conditions in fetch-subunit-output  https://review.openstack.org/53442820:05
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Use subunit2html from tox envs instead of os-testr-env  https://review.openstack.org/53442920:05
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Make fetch-subunit-output work with multiple tox envs  https://review.openstack.org/53443020:05
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Move testr finding to a script  https://review.openstack.org/53443120:05
mordredAJaeger: I think we may have been hacking in parallel there20:05
AJaegermordred: shall I abandon mine again?20:05
AJaegermordred: seeing your stack: Yes, I'll abandon...20:06
AJaegermordred: at least I learned about blocks ;)20:06
mordredAJaeger: \o/20:06
*** smatzek has quit IRC20:06
mordredAJaeger: sorry - I should have pushed the patches up a little bit ago20:06
*** smatzek has joined #openstack-infra20:06
*** hashar has joined #openstack-infra20:07
mordredAJaeger: I went ahead and tried to fix the remaining TODO items in the code while poking - thus the length of the stack20:07
tobiashclassical race condition ;)20:07
mordredtobiash: :)20:07
mordreddmsimard: ^^ if you have a sec, https://review.openstack.org/#/q/topic:fetch-subunit has your name all over it20:07
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Enable python3 support on nb01 / nb02  https://review.openstack.org/53443220:07
*** smatzek has quit IRC20:08
AJaegermordred: your version is nicer than mine...20:08
mordredtobiash: you too, actually - I fixed a hardcoded openstack-infra thing in there too (the use of /usr/os-testr-env)20:08
*** smatzek has joined #openstack-infra20:09
openstackgerritMerged openstack-infra/puppet-zuul master: Redirect curl stderr to /dev/null  https://review.openstack.org/53438020:09
mordredI could probably squash that into less patches ...20:09
tobiashI like many small patches20:09
pabelangerinfra-root: ^534432 will help bring nb01 back online using feature/zuulv3 and python320:10
openstackgerritMerged openstack-infra/zuul-jobs master: Revert "Revert "Add consolidated role for processing subunit""  https://review.openstack.org/53383420:10
mordredtobiash: me too - but sometimes I overdo it :)20:10
mordred\o/20:10
mordredok. here's hoping that patch ^^ doesn't bomb this time like it did last time20:10
mordredpabelanger: +A20:11
dmsimardWow the gate is super backed up.. is there a reason in particular ?20:11
AJaegermordred: could you toggle your +A on https://review.openstack.org/534140 and https://review.openstack.org/534142  -that way I don't need to recheck...20:11
dmsimardlooks like executors are running at max capacity too.20:11
pabelangeralmost, they are still accepting jobs: http://grafana.openstack.org/dashboard/db/zuul-status we just have no more clouds20:12
*** dave-mccowan has quit IRC20:12
pabelangermust be release time20:12
toskyand/or catching up some earlier failures :)20:13
*** slaweq_ has joined #openstack-infra20:13
*** smatzek has quit IRC20:13
*** amoralej is now known as amoralej|off20:14
pabelangerinfra-root: one thing I forgot in the meeting today, is we still need to do rolling restarts on zuul-executors for tcp/79 to tcp/7900 and root to zuul user changes.  Currently only ze04 is running as zuul user / tcp/7900.20:14
mtreinishclarkb: well it wasn't the best test I booted a arm64 arch image on a rpi3 (it's not something you want to run 24/7 that way because of missing drivers)20:15
mordredAJaeger: yup20:15
clarkboh is rpi3 arm64? til20:15
mordredAJaeger: done!20:16
mtreinishclarkb: but I was able to mount the openstack.org afs stuff on it at least (it was really slow though, being a rpi that's not surprising)20:16
AJaegermordred: thanks20:16
mtreinishclarkb: it's not something that really works well, but you can boot it: https://archlinuxarm.org/platforms/armv8/broadcom/raspberry-pi-320:16
*** e0ne has joined #openstack-infra20:17
mtreinishclarkb: if fungi has real arm64 stuff that would probably be a better test20:17
*** ldnunes has quit IRC20:18
tobiashmordred: have a comment on 53443120:18
fungimtreinish: i ohly have armel and armhf, no arm6420:18
fungi(yet anyway)20:18
mordredtobiash: oh - hah! thank you20:20
mtreinishfungi: I'd totally be down for getting a arm64 dev board, but I leave for sydney on thurs. so probably won't be able to do it for a while20:20
fungimtreinish: i bet they have them in sydney too? ;)20:21
mtreinishheh, probably. But then they're likely more expensive20:22
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Move testr finding to a script  https://review.openstack.org/53443120:23
mordredtobiash: maybe that'll be better :)20:23
tobiashmordred: +2 with comment20:26
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Move testr finding to a script  https://review.openstack.org/53443120:28
mordredtobiash: good idea, thanks20:28
corvusdhellmann: ^ i think that matches your pattern20:31
mtreinishmordred: I'm really looking forward to landing: https://review.openstack.org/#/c/519751 and not needing that script in your patch anymore20:31
*** dsariel has joined #openstack-infra20:31
*** dprince has joined #openstack-infra20:31
mordredmtreinish: well - we'll still need the script since that's intended to be a general-purpose job that could be used by non-openstack people too20:32
mordredmtreinish: however - I also look forward to landing that patch20:32
*** dave-mccowan has joined #openstack-infra20:32
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Documentation changes for cross-source dependencies  https://review.openstack.org/53439720:33
*** e0ne has quit IRC20:33
mtreinishmordred: people use testr/stestr ouside of openstack? I maintain stestr and I find that surprising20:34
AJaegermtreinish: could you review mordred's change https://review.openstack.org/#/c/529341/ for devstack , please? Simple Zuul job change...20:35
corvusmtreinish: i thought you had windows users?20:35
mtreinishcorvus: I do, they do winstackers and hyperv nova third party ci20:35
mordredmtreinish: I'm sure that somewhere there's at least one other user :)20:36
mordredmtreinish: btw - thank you for including the why in that governance patch- I especially like the explanation of why we think it's important to follow the python unittest api model20:38
fungiyes, bravo, i think we rarely do a good enough job of explaining the "why" of our decisions on the project20:41
mtreinishsure np. I was actually asked why stestr a couple of times after that summit session, which just hit home that we need to write it down20:42
*** efried_nomnom is now known as efried20:42
* AJaeger is closing now the backlog etherpad he had, two final reviews: https://review.openstack.org/529000 (devstack-gate) and https://review.openstack.org/#/c/513589/ (openstack-zuul-jobs cleanup)20:43
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove updateChange history from github driver  https://review.openstack.org/53190420:44
openstackgerritIhar Hrachyshka proposed openstack-infra/system-config master: Adopt to new neutron functional / fullstack job names  https://review.openstack.org/53443620:45
*** bobh has joined #openstack-infra20:45
*** makowals has joined #openstack-infra20:45
dhellmannmordred : that does look similar to what I was trying to do20:47
openstackgerritIhar Hrachyshka proposed openstack-infra/system-config master: Capture logs for new neutron service names  https://review.openstack.org/53443720:50
dhellmanncorvus : (oops) that does look similar to what I was trying to do20:50
mordreddhellmann: woot! well - if it comes back green that can be a good source of cargo-culting20:50
*** bobh has quit IRC20:51
dhellmannyeah, I'm waiting for the jobs on https://review.openstack.org/#/c/524862/20 to see if that pattern works as expected, too, but I like the shorter form. hurray for testing in parallel!20:51
dhellmannwow, the queue must be pretty deep, that change has been waiting over an hour to start20:52
*** bobh has joined #openstack-infra20:54
openstackgerritJeremy Stanley proposed openstack-infra/system-config master: Update firewalls, zookeeper and cacti for zuul01  https://review.openstack.org/53378220:56
fungirebased ^20:56
corvusdhellmann: yeah, the new way to tell the queue depth is this chart, which says we're waiting on 1600 node requests: http://grafana.openstack.org/dashboard/db/zuul-status?panelId=17&fullscreen20:58
corvusnode requests are 1:1 jobs20:59
*** bobh has quit IRC20:59
fungidhellmann: i've got a one-line system-config patch uploaded (and approved) over 2.5 hours ago, still waiting on test results20:59
fungifrom the check pipline20:59
dhellmanncorvus , fungi : goodness.21:00
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add skipped CRD tests  https://review.openstack.org/53188721:01
corvuspabelanger is looking into whether we're suffering from a systemic inefficiency, or just really busy.21:01
fungiwhen i checked earlier today the backlog in the post pipeline was over 10 hours. haven't looked lately to see whether that's gaind any ground21:01
*** rlandy_ has joined #openstack-infra21:05
*** rlandy__ has joined #openstack-infra21:05
*** rlandy__ has left #openstack-infra21:05
*** armax has quit IRC21:10
*** bobh has joined #openstack-infra21:12
*** david-lyle has quit IRC21:12
*** threestrands_ has joined #openstack-infra21:18
*** david-lyle has joined #openstack-infra21:23
*** felipemonteiro has joined #openstack-infra21:35
dmsimardfungi: so it turns out that the hound pull request to make it able to select a default branch (instead of being hardcoded to master) works \o/21:36
dmsimardthank you internet stranger21:36
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix dependency cycle false positive  https://review.openstack.org/53444421:36
*** esberglu has quit IRC21:37
fungidmsimard: neat21:38
fungidmsimard: now if only internet stranger would become an active maintainer of hound or fork it for fun and profit21:39
dmsimardfungi: what this allows me to do is to have hound index local repositories instead (and on the right branches) of making it poke github to death21:39
dmsimardOpenStack repos are on git.o.o but we don't have that luxury for RDO21:39
dmsimardWell, technically we still have gerrit's repositories but those aren't very much advertised :)21:39
*** vhosakot has joined #openstack-infra21:39
dmsimardalso, github.com/openstack is 1600+ repositories, wow21:40
fungidmsimard: gerrit ls-projects returns 1855 results at the moment21:41
dmsimard16 pages of 100 results on github, I guess there's a few projects that aren't replicated21:41
fungiwe have other orgs on gh21:42
*** jascott1 has left #openstack-infra21:42
dmsimardoh, wait, openstack-infra and others yeah21:42
fungiyep21:42
corvusonly 1572 start with openstack/21:42
dmsimard"only"21:42
dmsimardI'm currently cloning all of that T_T21:42
fungi"a mere 1.6k"21:42
dmsimardI actually excluded deb-* which is a fair chunk21:43
*** dprince has quit IRC21:44
fungiif you want to exclude retired repos, you can do what we do with our other tools and parse gerrit/projects.yaml skipping any which use the shared acl for retirement21:47
openstackgerritMerged openstack-infra/system-config master: Set the zuul-scheduler group for zuul01  https://review.openstack.org/53440421:48
fungi^ finally!21:49
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Support cross-source dependencies  https://review.openstack.org/53080621:49
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add cross-source tests  https://review.openstack.org/53269921:49
fungiyay cross-source support!21:50
*** esberglu has joined #openstack-infra21:50
corvusnow we just need the docs change to land :)21:51
*** armax has joined #openstack-infra21:51
*** slaweq_ has quit IRC21:51
*** rossella_s has quit IRC21:53
fungiinfra-root: https://kb.isc.org/article/AA-01542 describes a denial of service vulnerability in isc bind, but we're only running it on adns1.o.o and based on my reading it's only triggerable on dnssec-validating recursive resolvers (adns1 doesn't allow recursion)21:54
*** rossella_s has joined #openstack-infra21:54
*** eharney has quit IRC21:55
fungiso shouldn't be an issue for us while we await the patches trickling into ubuntu21:56
*** caphrim007_ has joined #openstack-infra21:57
*** makowals has quit IRC21:57
*** dsariel has quit IRC21:57
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Add ComputeGetLimits API to nodepool provider dashboards  https://review.openstack.org/53445021:58
pabelangerShrews: mordred: corvus: clarkb: ^ quota API queries for grafana21:58
*** trown is now known as trown|outtypewww22:00
*** caphrim007 has quit IRC22:01
*** rossella_s has quit IRC22:04
*** vhosakot has quit IRC22:05
clarkbI just did package updates on my desktop and grub/efi is angry. So I'm going to yolo reboot (appears this may have happened once before in march so maybe its ok) as I Figure its easier to deal with this now than put it off22:07
clarkbso if I disappear for a bit that is why :) I still have a laptop I can use if things go super bad22:07
*** rossella_s has joined #openstack-infra22:08
*** bobh has quit IRC22:09
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix dependency cycle false positive  https://review.openstack.org/53444422:13
*** ganso has quit IRC22:18
fungizuul01 is still booting, but i need to step away for a couple minutes. will add it to dns when i get back (assuming it finishes, which it looks like it will this time)22:18
clarkbok back that was weird. reboot failed had to halt -fp then power back on but it booted up and subsequent reboots are happy22:22
*** gouthamr has quit IRC22:27
clarkbdmsimard: http://www.opendevconf.com/ is updated now22:27
dmsimardThat was fast :)22:27
clarkbI think they were already working on it :)22:27
dmsimardhaha22:29
*** rcernin has joined #openstack-infra22:31
*** jamesmcarthur has quit IRC22:36
*** olaph1 has joined #openstack-infra22:41
*** felipemonteiro has quit IRC22:42
*** olaph has quit IRC22:42
*** jamesmcarthur has joined #openstack-infra22:43
openstackgerritMerged openstack-infra/system-config master: Enable python3 support on nb01 / nb02  https://review.openstack.org/53443222:44
*** wolverineav has quit IRC22:45
*** wolverineav has joined #openstack-infra22:45
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix dependency cycle false positive  https://review.openstack.org/53444422:48
fungiinfra-root: the zuul01 server started with zuul-scheduler, zuul-web and zuul-fingergw running. i have stopped them for now22:48
fungii have it in dns and the ssh key accepted on puppetmaster. https://review.openstack.org/533782 should be clear to approve now22:49
corvusfungi: ++.  with no mergers, it probably wasn't able to do anything.22:49
*** wolverineav has quit IRC22:49
*** olaph1 is now known as olaph22:50
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Stop running tox-cover job  https://review.openstack.org/53445822:51
*** rossella_s has quit IRC22:52
*** jroll has quit IRC22:53
*** tpsilva has quit IRC22:54
*** edmondsw has quit IRC22:55
*** rossella_s has joined #openstack-infra22:55
*** caphrim007_ has quit IRC22:56
*** edmondsw has joined #openstack-infra22:56
*** caphrim007 has joined #openstack-infra22:56
*** dave-mccowan has quit IRC22:56
*** olaph1 has joined #openstack-infra22:57
*** jroll has joined #openstack-infra22:58
*** olaph has quit IRC22:58
*** jamesmcarthur has quit IRC22:59
*** edmondsw has quit IRC23:00
*** rossella_s has quit IRC23:00
*** jamesmcarthur has joined #openstack-infra23:00
*** rossella_s has joined #openstack-infra23:02
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Really change patchset column to string  https://review.openstack.org/53245923:05
*** rossella_s has quit IRC23:08
*** sbra has quit IRC23:08
*** camunoz has quit IRC23:11
*** rossella_s has joined #openstack-infra23:12
*** wolverineav has joined #openstack-infra23:20
*** wolverineav has quit IRC23:22
*** wolverineav has joined #openstack-infra23:22
fungiansibleites: are the patterns i'm using (zuul[0-9]+) sane for ansible host matches in playbooks/remote_puppet_git.yaml and playbooks/remote_puppet_else.yaml or do i need to use some other scheme?23:24
fungi(in the system-config repo)23:24
fungilooking at the way puppetmaster is grouping puppet apply runs, i get the impression that syntax is invalid23:25
openstackgerritMerged openstack-infra/project-config master: Add ComputeGetLimits API to nodepool provider dashboards  https://review.openstack.org/53445023:25
clarkbI think they are globs by default23:25
clarkband you ahve to use the ~ syntax or whatever it is to regex23:25
fungimaybe i should just collapse zuul01 and zuulv3 together as zuul* for simplicity?23:26
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient master: Enable link detection in the markdown parser  https://review.openstack.org/53446123:27
*** wolverineav has quit IRC23:28
corvushow does this message about the zuulv3 merge look? https://etherpad.openstack.org/p/4sX3qKYDBN23:28
clarkbfungi: or zuul0* and we can only have 1023:28
corvusfungi: zuul* for now sounds good -- i think we want them together at the moment due to sequencing things23:29
clarkbcorvus: one comment is its only the single_node_ci that updated the defaults in puppet-openstackci I think23:29
corvusclarkb: oh do we think that's sufficient?23:30
*** dhill_ has quit IRC23:30
clarkbmmedvede seemed to think so23:30
corvusi guess mmedvede does since it's written that way :)23:30
*** wolverineav has joined #openstack-infra23:31
clarkbI guess thats it the most popular way openstackci is used?23:31
clarkbI think it is worth calling out though23:31
*** claudiub has quit IRC23:31
corvusclarkb: how's that?23:32
clarkbcorvus: yup that looks good23:32
fungiannouncement lgtm23:37
corvussent23:39
corvuswelp, not so much to zuul-announce since i botched the address23:40
corvusi will resend an individual copy to that one23:40
corvusdropping the last pgraph23:41
openstackgerritJeremy Stanley proposed openstack-infra/system-config master: Glob zuulv3 and zuul01 as zuul* in playbooks  https://review.openstack.org/53446323:42
fungicorvus: clarkb: ^ as discussed23:42
*** sshnaidm is now known as sshnaidm|off23:42
corvus\o/ http://lists.zuul-ci.org/pipermail/zuul-announce/2018-January/000000.html23:42
*** wolverineav has quit IRC23:42
fungican haz zuulnoucements23:43
clarkbI need new email rules23:44
fungilooks like zuul-announce doesn't prefix subject lines. should it?23:44
fungigranted i don't care because i filter on list-id headers anyway23:44
mordredcorvus: \o/23:46
*** caphrim007_ has joined #openstack-infra23:46
*** stakeda has joined #openstack-infra23:46
*** caphrim00_ has joined #openstack-infra23:47
corvusfungi: i chose not to because everybody has a mua that can do that and it runs counter to my instincts as a mail admin and internet user.  but if folks have a pressing need for that, i'm open to discussion.23:48
*** caphrim00_ has quit IRC23:48
clarkbya I use list-id too23:48
*** andreas_s has joined #openstack-infra23:49
corvusi think gmail does as well23:49
*** caphrim007 has quit IRC23:49
fungiyeah, i'm squarely in the "would rather have room in my mua to see more of the subject in a message list" camp23:50
*** caphrim007_ has quit IRC23:50
fungigiven i squeeze mutt into 80 columns23:51
*** rossella_s has quit IRC23:51
corvusfungi: more than "Subject: [............][....][..][.....][....] Impor"23:51
fungiright, that23:51
mordredImpor is all you need23:51
* fungi kneels before Impor the Conqueror23:51
*** rlandy_ has quit IRC23:52
corvusgotta leave room for "Re: RE: RE: FYI: FYA: FWD:" too23:52
fungialso threading indicators23:52
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Use hotlink instead log url in github job report  https://review.openstack.org/53154523:53
*** andreas_s has quit IRC23:53
fungithough i suppose i only see a subject after └─> if someone changes the subject line mid-thread23:53
*** caphrim007 has joined #openstack-infra23:53
*** erlon has quit IRC23:53
*** rossella_s has joined #openstack-infra23:54
fungioh, or if it's the first message of the thread in my current view but not the first message in that thread in my message list23:54
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Disambiguate with Netflix and Javascript zuul  https://review.openstack.org/53129223:55
*** dingyichen has joined #openstack-infra23:55
fungithat's a fun one23:56
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add support for protected jobs  https://review.openstack.org/52298523:56
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Documentation changes for cross-source dependencies  https://review.openstack.org/53439723:56
*** caphrim007 has quit IRC23:58
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Remove updateChange history from github driver  https://review.openstack.org/53190423:58
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Handle sigterm in nodaemon mode  https://review.openstack.org/52864623:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!