| *** tosky has quit IRC | 00:03 | |
| fungi | clarkb: i wonder if the futureparser changes interpretation of the manifest somehow? maybe we guard that package with a conditional which is evaluating differently now? | 00:04 |
|---|---|---|
| clarkb | fungi: I think ti only shows up the once but ya could be something like that | 00:05 |
| fungi | haven't entirely found my weekend but am going back and forth between computer and caulk | 00:05 |
| clarkb | my read of it is that package should be installed | 00:07 |
| *** rascasoft has quit IRC | 00:07 | |
| clarkb | so puppet did the right thing there as far as I can tell. I'm more confused about how that package wouldn't have been installed prior to this update | 00:07 |
| *** diablo_rojo has quit IRC | 00:10 | |
| clarkb | hrm elastic-recheck is apparently unhappy again | 00:10 |
| clarkb | I'll likely have to look at that on monday though | 00:10 |
| clarkb | if I had to guess some very large files have snuck into being indexed and oom'd the workers (but I really haven't looked) | 00:10 |
| *** slaweq has joined #openstack-infra | 00:11 | |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Save registry logs https://review.openstack.org/638794 | 00:13 |
| *** ijw has quit IRC | 00:14 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: WIP Run zuul-preview https://review.openstack.org/637654 | 00:14 |
| *** ijw has joined #openstack-infra | 00:15 | |
| *** ijw has quit IRC | 00:19 | |
| *** ijw has joined #openstack-infra | 00:20 | |
| *** slaweq has quit IRC | 00:24 | |
| clarkb | oh I should mention it here before I forget (and add it to the meeting agenda) we have been asked if we want project update and or project onboarding sessions for the denver summit | 00:33 |
| clarkb | I'm personally leaning towards the update just to talk about all the wonderful work on config management changes (we are making real progress there ) as well as opendev (also real progress) | 00:33 |
| clarkb | fungi: ok the next run also says it installed that package | 00:36 |
| clarkb | fungi: I suspect possibly something wrong with the apt db? | 00:36 |
| *** mordred has quit IRC | 00:36 | |
| *** mordred has joined #openstack-infra | 00:37 | |
| fungi | clarkb: yeah, i just got back for another caulk break to look deeper into it, and puppet's been reinstalling php7.2-mysqlnd (or thinks it has) since long before this | 00:37 |
| fungi | probably an incorrect package name would be my guess | 00:38 |
| fungi | like specified a virtual package and the one getting chosen doesn't have a provides for that name or something along those lines | 00:38 |
| fungi | anyway, this is not a regression, it predates the futureparser change merging | 00:39 |
| clarkb | cool so we can move forward with the prod server next week | 00:40 |
| *** yamamoto has joined #openstack-infra | 00:44 | |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Save registry logs https://review.openstack.org/638794 | 00:44 |
| *** yamamoto has quit IRC | 00:48 | |
| *** markvoelker has joined #openstack-infra | 00:56 | |
| fungi | i believe so, yes | 00:58 |
| *** ijw has quit IRC | 00:58 | |
| clarkb | alright my service management chagne to puppet-kerberos applied and did what I expected | 00:58 |
| clarkb | with that I think I'm about ready to call ti a weekend | 00:58 |
| *** ijw has joined #openstack-infra | 00:59 | |
| *** ijw has quit IRC | 01:03 | |
| *** slaweq has joined #openstack-infra | 01:11 | |
| *** ijw has joined #openstack-infra | 01:11 | |
| *** sthussey has quit IRC | 01:13 | |
| corvus | clarkb, fungi: is it true that limestone-regionone is ipv6-only and ovh-bhs1 is ipv4-only? and therefore, if we have a job graph with a dependency where we expect one job to be able to communicate with another, they won't be able to if those two providers are used? | 01:14 |
| *** bhavikdbavishi has joined #openstack-infra | 01:17 | |
| logan- | limestone has outbound nat enabled so it would be able to reach ovh ipv4 public addresses. however, the limestone nodes only have public ingress over ipv6, so ovh would not be able to reach them over ipv4 unless the limestone node initiates the connection. | 01:18 |
| *** sdake has quit IRC | 01:20 | |
| clarkb | however ovh does ha e ipv6 its just impossible for the ovh node to know what its ipv6 address is | 01:22 |
| clarkb | we might be able to have nodepool write that data after boot and jobs could optionally configure it? | 01:22 |
| corvus | i can't seem to make an outbound ipv6 connection from ovh | 01:22 |
| clarkb | you have to co figure the static ipv6 addr that is only availabe from the neutron api | 01:23 |
| clarkb | and set the route based on their docs iirc | 01:23 |
| clarkb | (it isnt in the config drive which we also ignore :( ) | 01:23 |
| *** slaweq has quit IRC | 01:25 | |
| corvus | clarkb: is gra1 and bhs1 the same wrt this? | 01:25 |
| clarkb | yes | 01:26 |
| corvus | it looks like nodepool and therefore zuul actually do know that ipv6 address | 01:26 |
| corvus | how insane would it be to configure that in a base pre-playbook? | 01:26 |
| clarkb | ya its available via the api just not within thr node | 01:26 |
| clarkb | corvus shouldnt be too insane | 01:27 |
| clarkb | its a static addr and route pretty straightforward | 01:27 |
| clarkb | you just have to know a lot of stuff magically :/ | 01:27 |
| corvus | the two solutions i can think of for this problem are a) update zuul/nodepool to request all child job nodes from the same provider as parent. b) make sure that all our providers support outbund v4 and v6 connections. | 01:28 |
| corvus | a) is probably a good idea anyway, though i was thinking of implementing that as a *preference* not a *requirement*. but maybe it needs to be a requirement. | 01:28 |
| *** bhavikdbavishi has quit IRC | 01:29 | |
| *** markvoelker has quit IRC | 01:29 | |
| corvus | ((a) is a good idea because it reduces network traffic) | 01:29 |
| clarkb | I like a as an option | 01:29 |
| clarkb | for that reason | 01:29 |
| corvus | it probably means yet another week before we see this working :( | 01:29 |
| clarkb | also re ipv6 our non ubuntu nodes dont all ipv6 on rax | 01:30 |
| clarkb | we rely on router advertisements elsewhere for that to work | 01:30 |
| clarkb | corvus adding ipv6 to ovh nodes as you suggest and running jobs on ubuntu for now should work | 01:33 |
| clarkb | maybe that is good short term option | 01:33 |
| corvus | clarkb: i think we may have a similar problem with sjc1, though that should be temporary | 01:33 |
| *** eernst has joined #openstack-infra | 01:34 | |
| corvus | might not be fixed before we can implement the nodepool request thing though. | 01:34 |
| *** hwoarang has quit IRC | 01:34 | |
| *** hwoarang has joined #openstack-infra | 01:36 | |
| *** eernst has quit IRC | 01:37 | |
| *** eernst_ has joined #openstack-infra | 01:37 | |
| *** eernst_ has quit IRC | 01:41 | |
| *** rascasoft has joined #openstack-infra | 01:41 | |
| *** bhavikdbavishi has joined #openstack-infra | 01:47 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Request child nodes of paused jobs at higher priority https://review.openstack.org/638796 | 01:49 |
| corvus | clarkb: i was already writing that change today... we can build on that to add a provider requirement. | 01:50 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Request child nodes of paused jobs at higher priority https://review.openstack.org/638796 | 01:50 |
| *** rascasoft has quit IRC | 01:52 | |
| *** betherly has joined #openstack-infra | 01:54 | |
| *** gyee has quit IRC | 01:54 | |
| *** betherly has quit IRC | 01:58 | |
| *** slaweq has joined #openstack-infra | 02:11 | |
| *** sdake has joined #openstack-infra | 02:12 | |
| *** ijw has quit IRC | 02:15 | |
| *** ijw has joined #openstack-infra | 02:18 | |
| *** ijw has quit IRC | 02:23 | |
| *** slaweq has quit IRC | 02:24 | |
| *** ijw has joined #openstack-infra | 02:25 | |
| *** ijw has quit IRC | 02:29 | |
| *** bhavikdbavishi has quit IRC | 02:36 | |
| *** rascasoft has joined #openstack-infra | 02:37 | |
| *** jamesmcarthur has joined #openstack-infra | 02:40 | |
| *** ijw has joined #openstack-infra | 02:45 | |
| *** rascasoft has quit IRC | 02:47 | |
| cloudnull | clarkb sorry was afk - yup seems the instances are breaking when we setup some bridges. looking into it | 02:47 |
| *** wolverineav has joined #openstack-infra | 02:48 | |
| *** ijw has quit IRC | 02:49 | |
| *** wolverineav has quit IRC | 02:53 | |
| *** hwoarang has quit IRC | 03:01 | |
| *** hwoarang has joined #openstack-infra | 03:03 | |
| *** slaweq has joined #openstack-infra | 03:11 | |
| *** jamesmcarthur has quit IRC | 03:16 | |
| *** slaweq has quit IRC | 03:24 | |
| *** hurgleburgler has joined #openstack-infra | 03:25 | |
| *** whoami-rajat has joined #openstack-infra | 03:30 | |
| *** bhavikdbavishi has joined #openstack-infra | 03:31 | |
| *** hwoarang has quit IRC | 03:41 | |
| *** hwoarang has joined #openstack-infra | 03:42 | |
| *** wolverineav has joined #openstack-infra | 03:59 | |
| *** yamamoto has joined #openstack-infra | 04:00 | |
| *** rascasoft has joined #openstack-infra | 04:11 | |
| *** slaweq has joined #openstack-infra | 04:12 | |
| *** rascasoft has quit IRC | 04:18 | |
| *** slaweq has quit IRC | 04:24 | |
| *** hwoarang has quit IRC | 04:43 | |
| *** hwoarang has joined #openstack-infra | 04:45 | |
| *** yamamoto has quit IRC | 05:04 | |
| *** bhavikdbavishi has quit IRC | 05:08 | |
| *** slaweq has joined #openstack-infra | 05:11 | |
| *** rascasoft has joined #openstack-infra | 05:16 | |
| *** markvoelker has joined #openstack-infra | 05:20 | |
| *** rascasoft has quit IRC | 05:24 | |
| *** slaweq has quit IRC | 05:24 | |
| *** markvoelker has quit IRC | 05:25 | |
| *** hwoarang has quit IRC | 05:34 | |
| *** sdake has quit IRC | 05:34 | |
| *** hwoarang has joined #openstack-infra | 05:35 | |
| *** wolverineav has quit IRC | 05:36 | |
| *** wolverineav has joined #openstack-infra | 05:38 | |
| *** sdake has joined #openstack-infra | 05:39 | |
| *** whoami-rajat has quit IRC | 05:40 | |
| *** wolverineav has quit IRC | 05:41 | |
| *** wolverineav has joined #openstack-infra | 05:46 | |
| *** udesale has joined #openstack-infra | 05:48 | |
| *** kjackal has joined #openstack-infra | 06:01 | |
| *** udesale has quit IRC | 06:01 | |
| *** slaweq has joined #openstack-infra | 06:11 | |
| *** lpetrut has joined #openstack-infra | 06:16 | |
| *** markvoelker has joined #openstack-infra | 06:21 | |
| *** slaweq has quit IRC | 06:24 | |
| *** wolverineav has quit IRC | 06:28 | |
| *** hwoarang has quit IRC | 06:29 | |
| *** ykarel|away has joined #openstack-infra | 06:29 | |
| *** hwoarang has joined #openstack-infra | 06:30 | |
| *** bhavikdbavishi has joined #openstack-infra | 06:50 | |
| *** markvoelker has quit IRC | 06:54 | |
| *** bhavikdbavishi has quit IRC | 07:02 | |
| *** ykarel|away has quit IRC | 07:02 | |
| *** kjackal has quit IRC | 07:10 | |
| *** slaweq has joined #openstack-infra | 07:11 | |
| *** eharney has quit IRC | 07:13 | |
| *** slaweq has quit IRC | 07:24 | |
| *** owalsh_ has joined #openstack-infra | 07:28 | |
| *** eharney has joined #openstack-infra | 07:29 | |
| *** sdake has quit IRC | 07:39 | |
| *** kgiusti has quit IRC | 07:40 | |
| *** zul has quit IRC | 07:40 | |
| *** owalsh has quit IRC | 07:40 | |
| *** kgiusti has joined #openstack-infra | 07:41 | |
| *** mordred has quit IRC | 07:42 | |
| *** andreaf has quit IRC | 07:43 | |
| *** jmorgan1 has quit IRC | 07:44 | |
| *** andreaf has joined #openstack-infra | 07:45 | |
| *** wolverineav has joined #openstack-infra | 07:50 | |
| *** markvoelker has joined #openstack-infra | 07:52 | |
| *** wolverineav has quit IRC | 07:54 | |
| *** adriant has quit IRC | 07:54 | |
| *** adriant has joined #openstack-infra | 07:54 | |
| *** mordred has joined #openstack-infra | 07:56 | |
| *** pcaruana has joined #openstack-infra | 08:00 | |
| *** slaweq has joined #openstack-infra | 08:11 | |
| *** takamatsu_ has quit IRC | 08:16 | |
| *** bhavikdbavishi has joined #openstack-infra | 08:17 | |
| *** takamatsu_ has joined #openstack-infra | 08:18 | |
| *** markvoelker has quit IRC | 08:25 | |
| *** yamamoto has joined #openstack-infra | 08:36 | |
| *** takamatsu_ has quit IRC | 08:38 | |
| *** yamamoto has quit IRC | 08:41 | |
| *** whoami-rajat has joined #openstack-infra | 08:42 | |
| *** takamatsu_ has joined #openstack-infra | 08:44 | |
| *** takamatsu_ has quit IRC | 08:50 | |
| *** takamatsu_ has joined #openstack-infra | 08:55 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Encode zuul.message with base64 https://review.openstack.org/638801 | 08:57 |
| *** lpetrut has quit IRC | 09:03 | |
| *** yamamoto has joined #openstack-infra | 09:08 | |
| *** yamamoto has quit IRC | 09:11 | |
| *** hwoarang has quit IRC | 09:12 | |
| *** hwoarang has joined #openstack-infra | 09:14 | |
| *** yamamoto has joined #openstack-infra | 09:18 | |
| *** yamamoto has quit IRC | 09:19 | |
| *** markvoelker has joined #openstack-infra | 09:22 | |
| *** spotz has quit IRC | 09:24 | |
| openstackgerrit | Ivoline Ngong proposed openstack-infra/storyboard-webclient master: Most recently updated projects should be at top of stories list https://review.openstack.org/638690 | 09:48 |
| openstackgerrit | Ivoline Ngong proposed openstack-infra/storyboard-webclient master: Most recently updated projects should be at top of stories list https://review.openstack.org/638690 | 09:53 |
| *** markvoelker has quit IRC | 09:54 | |
| *** yamamoto has joined #openstack-infra | 09:59 | |
| *** yamamoto has quit IRC | 10:04 | |
| *** bhavikdbavishi has quit IRC | 10:22 | |
| *** lpetrut has joined #openstack-infra | 10:22 | |
| *** yamamoto has joined #openstack-infra | 10:33 | |
| *** yamamoto has quit IRC | 10:38 | |
| *** markvoelker has joined #openstack-infra | 10:52 | |
| *** whoami-rajat has quit IRC | 10:52 | |
| *** lpetrut has quit IRC | 11:00 | |
| *** jtomasek has joined #openstack-infra | 11:04 | |
| *** tosky has joined #openstack-infra | 11:13 | |
| *** ccamacho has joined #openstack-infra | 11:15 | |
| *** ccamacho has quit IRC | 11:15 | |
| *** markvoelker has quit IRC | 11:25 | |
| *** ccamacho has joined #openstack-infra | 11:27 | |
| *** ccamacho has quit IRC | 11:27 | |
| *** yamamoto has joined #openstack-infra | 11:35 | |
| *** yamamoto has quit IRC | 11:39 | |
| *** sc has quit IRC | 11:43 | |
| *** yamamoto has joined #openstack-infra | 12:07 | |
| *** markvoelker has joined #openstack-infra | 12:22 | |
| *** dave-mccowan has joined #openstack-infra | 12:41 | |
| *** Vadmacs has joined #openstack-infra | 12:46 | |
| *** bhavikdbavishi has joined #openstack-infra | 12:46 | |
| *** markvoelker has quit IRC | 12:55 | |
| openstackgerrit | Ivoline Ngong proposed openstack-infra/storyboard master: updated_at field in projects now contains a date that signifies the most recent date a task or story related to the project was last updated/created. Task: 24368 https://review.openstack.org/638840 | 13:05 |
| *** whoami-rajat has joined #openstack-infra | 13:21 | |
| *** markvoelker has joined #openstack-infra | 13:39 | |
| *** yamamoto has quit IRC | 13:39 | |
| *** yamamoto has joined #openstack-infra | 13:40 | |
| *** bhavikdbavishi has quit IRC | 13:44 | |
| *** lpetrut has joined #openstack-infra | 13:47 | |
| *** dave-mccowan has quit IRC | 13:47 | |
| *** kjackal has joined #openstack-infra | 14:13 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: docker: add state folder https://review.openstack.org/635618 | 14:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: doc: clarify sshkey option usage in github connection https://review.openstack.org/635640 | 14:21 |
| *** jtomasek has quit IRC | 14:26 | |
| *** kgiusti has left #openstack-infra | 14:31 | |
| openstackgerrit | Merged openstack-infra/zuul master: Show animated progress bar in preparation phase https://review.openstack.org/637810 | 14:37 |
| *** jtomasek has joined #openstack-infra | 14:49 | |
| *** bhavikdbavishi has joined #openstack-infra | 14:50 | |
| *** yamamoto has quit IRC | 15:04 | |
| *** wolverineav has joined #openstack-infra | 15:07 | |
| *** wolverineav has quit IRC | 15:11 | |
| *** jaosorior has quit IRC | 15:20 | |
| *** e0ne has joined #openstack-infra | 15:23 | |
| *** jtomasek has quit IRC | 15:24 | |
| *** e0ne has quit IRC | 15:25 | |
| *** EvilienM is now known as EmilienM | 15:26 | |
| *** yamamoto has joined #openstack-infra | 15:40 | |
| *** yamamoto has quit IRC | 15:51 | |
| *** sdake has joined #openstack-infra | 15:53 | |
| *** bhavikdbavishi has quit IRC | 16:13 | |
| *** lpetrut has quit IRC | 16:31 | |
| *** hwoarang has quit IRC | 16:39 | |
| *** markvoelker has quit IRC | 16:40 | |
| *** markvoelker has joined #openstack-infra | 16:41 | |
| *** hwoarang has joined #openstack-infra | 16:41 | |
| *** markvoelker has quit IRC | 16:45 | |
| openstackgerrit | Merged openstack-infra/zuul master: docker: add state folder https://review.openstack.org/635618 | 16:48 |
| openstackgerrit | Merged openstack-infra/zuul master: doc: clarify sshkey option usage in github connection https://review.openstack.org/635640 | 16:48 |
| *** tosky has quit IRC | 16:51 | |
| *** kjackal has quit IRC | 16:58 | |
| *** kjackal has joined #openstack-infra | 16:58 | |
| *** sdake has quit IRC | 17:11 | |
| *** jamesmcarthur has joined #openstack-infra | 17:14 | |
| *** jamesmcarthur has quit IRC | 17:40 | |
| *** markvoelker has joined #openstack-infra | 17:41 | |
| *** jamesmcarthur has joined #openstack-infra | 17:47 | |
| *** Vadmacs has quit IRC | 18:02 | |
| *** jamesmcarthur has quit IRC | 18:02 | |
| *** markvoelker has quit IRC | 18:15 | |
| openstackgerrit | Ivoline Ngong proposed openstack-infra/storyboard master: updated_at field in projects now contains a date that signifies the most recent date a task or story related to the project was last updated/created. Task: 24368 https://review.openstack.org/638840 | 18:44 |
| *** sdake has joined #openstack-infra | 18:46 | |
| *** kjackal has quit IRC | 18:51 | |
| *** kjackal has joined #openstack-infra | 18:58 | |
| *** sdake has quit IRC | 19:07 | |
| *** markvoelker has joined #openstack-infra | 19:13 | |
| *** yamamoto has joined #openstack-infra | 19:25 | |
| *** yamamoto has quit IRC | 19:30 | |
| *** markvoelker has quit IRC | 19:45 | |
| *** kjackal has quit IRC | 19:53 | |
| *** kjackal has joined #openstack-infra | 19:54 | |
| *** stevebaker has quit IRC | 19:59 | |
| *** dmellado has quit IRC | 20:00 | |
| *** gouthamr has quit IRC | 20:00 | |
| *** eharney has quit IRC | 20:05 | |
| *** jesusaur has quit IRC | 20:14 | |
| *** eharney has joined #openstack-infra | 20:18 | |
| *** jesusaur has joined #openstack-infra | 20:19 | |
| *** sdake has joined #openstack-infra | 20:27 | |
| *** hwoarang has quit IRC | 20:42 | |
| *** eharney has quit IRC | 20:43 | |
| *** hwoarang has joined #openstack-infra | 20:44 | |
| *** gouthamr has joined #openstack-infra | 21:06 | |
| *** whoami-rajat has quit IRC | 21:08 | |
| *** dmellado has joined #openstack-infra | 21:09 | |
| *** Adri2000 has quit IRC | 21:09 | |
| *** yamamoto has joined #openstack-infra | 21:13 | |
| *** Adri2000 has joined #openstack-infra | 21:13 | |
| *** sdake has quit IRC | 21:13 | |
| *** yamamoto has quit IRC | 21:18 | |
| *** stevebaker has joined #openstack-infra | 21:23 | |
| *** betherly has joined #openstack-infra | 21:26 | |
| *** betherly has quit IRC | 21:26 | |
| *** lpetrut has joined #openstack-infra | 21:29 | |
| *** markvoelker has joined #openstack-infra | 21:42 | |
| *** dklyle_ has joined #openstack-infra | 21:45 | |
| *** lpetrut has quit IRC | 21:46 | |
| *** david-lyle has quit IRC | 21:48 | |
| *** kjackal has quit IRC | 22:02 | |
| *** armax has joined #openstack-infra | 22:15 | |
| *** eharney has joined #openstack-infra | 22:15 | |
| *** markvoelker has quit IRC | 22:16 | |
| *** tosky has joined #openstack-infra | 22:28 | |
| *** yamamoto has joined #openstack-infra | 23:01 | |
| *** yamamoto has quit IRC | 23:06 | |
| *** armax has quit IRC | 23:10 | |
| *** markvoelker has joined #openstack-infra | 23:13 | |
| *** markvoelker has quit IRC | 23:45 | |
| *** armax has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!