| fungi | cname updated in dns | 00:00 |
|---|---|---|
| *** katyafervent_awa has quit IRC | 00:00 | |
| *** katyafervent_awa has joined #openstack-infra | 00:00 | |
| fungi | as soon as kick.sh comes back to me we're just in the process of waiting for the executors to finish stopping | 00:00 |
| clarkb | zuul has stopped on ze01 but there are still three ssh processes | 00:01 |
| fungi | yeah, we've had anecdotal evidence of leaking child processes on the executors. may be a good opportunity to take a look | 00:02 |
| fungi | kick.sh is still going, fwiw | 00:02 |
| corvus | wait 60s for ssh process to terminate after zuul | 00:03 |
| *** edmondsw has joined #openstack-infra | 00:04 | |
| corvus | those are the control persist processes | 00:04 |
| corvus | they time out automatically, and are intentionally outside the ansible process group | 00:04 |
| clarkb | these three are still running fwiw, been longer than a minute | 00:04 |
| corvus | neat. that may be a bug in openssh then | 00:06 |
| corvus | looks like one of them is selecting on a pipe with nothing on the other end. | 00:06 |
| fungi | kick.sh still hasn't completed yet and we're a few minutes over our 20-minute estimate for the window | 00:07 |
| corvus | oh, i didn't scotty that, sorry | 00:08 |
| fungi | no worries, i really didn't think this script would take quite so long | 00:08 |
| *** edmondsw has quit IRC | 00:08 | |
| clarkb | looks like ze01 puppeted about 5 minutes ago | 00:08 |
| clarkb | so it is moving? | 00:08 |
| fungi | also, probably nobody around to notice this tree falling | 00:08 |
| corvus | i'm not inclined to worry too much about the leaked ssh processes. | 00:09 |
| fungi | last update was for "TASK [puppet : copy system puppet modules]" with "changed: [localhost]" | 00:09 |
| clarkb | it also took ~45 seconds | 00:09 |
| fungi | about 5 minutes ago | 00:09 |
| clarkb | so not the fastest puppet run | 00:09 |
| fungi | it already got as far as "TASK [puppet : create environment.conf from template]" on pretty much everything, looks like | 00:09 |
| fungi | i expect it's puppeting servers now, but will dig in the process list to find out | 00:10 |
| *** rossella_s has quit IRC | 00:10 | |
| *** jamesmcarthur has quit IRC | 00:11 | |
| *** jamesmcarthur has joined #openstack-infra | 00:11 | |
| *** sbra has quit IRC | 00:12 | |
| *** rossella_s has joined #openstack-infra | 00:12 | |
| *** sree has joined #openstack-infra | 00:12 | |
| fungi | yeah, the process list is updating, churning through different ipv6 addresses of zm and ze servers | 00:14 |
| fungi | just taking a while i guess. maybe kick.sh doesn't parallelize them? | 00:14 |
| fungi | and there are 18 servers to get through | 00:15 |
| clarkb | I think it will do like 5 at a time? | 00:15 |
| clarkb | by default | 00:15 |
| corvus | oh i see the problem with the scheduler stop -- it's the git driver, which only checks whether it should stop every 2 hours | 00:15 |
| corvus | so, imean, it would *eventually* stop | 00:15 |
| clarkb | corvus: it is "technically" correct the best kind of correct | 00:16 |
| corvus | ++ | 00:16 |
| *** guest3828382 has joined #openstack-infra | 00:16 | |
| *** guest3828382 has left #openstack-infra | 00:16 | |
| fungi | hah | 00:17 |
| *** sree has quit IRC | 00:17 | |
| fungi | okay, kick.sh finally came back | 00:17 |
| fungi | error free, looks like | 00:18 |
| *** hongbin has quit IRC | 00:18 | |
| *** jamesmcarthur has quit IRC | 00:18 | |
| *** jamesmcarthur has joined #openstack-infra | 00:19 | |
| fungi | okay, so any processes on the executors looking like "ssh: /var/lib/zuul/builds/f4acf178be6e41f6b7d30940689a1b3e/.ansible/cp/eee147f973 [mux]" i should manually kill, or just ignore? | 00:19 |
| clarkb | yes I think you can ignore them | 00:20 |
| clarkb | killing them is also probably fine | 00:20 |
| corvus | yep, whichever you fancy | 00:21 |
| fungi | ignoring was less work | 00:21 |
| fungi | confirmed no other processes besides those running as the "zuul" user on any of the 10 executors | 00:21 |
| fungi | so it's time to start services on zuul01 i guess | 00:21 |
| clarkb | I'm ready if you are | 00:23 |
| fungi | i think the zuul-fingergw systemd unit doesn't get reloaded when updated. i had to `systemctl daemon-reload` | 00:24 |
| fungi | two scheduler daemons (one hopefully the gearman), a fingergw and a web show running in the process list on zuul01 now | 00:24 |
| fungi | i'll use ansible to start the mergers and executors back up now | 00:25 |
| fungi | mergers started | 00:26 |
| corvus | the errors about the null dereference are okay | 00:26 |
| fungi | executors started | 00:26 |
| corvus | sched config loaded | 00:27 |
| fungi | corvus: meaning the "AttributeError: 'NoneType' object has no attribute 'layout'" exceptions? | 00:27 |
| corvus | fungi: yep | 00:27 |
| *** caphrim007_ has joined #openstack-infra | 00:28 | |
| corvus | that's caused by zuul-web trying to get the status before the initial config is loaded | 00:28 |
| fungi | aha | 00:28 |
| corvus | status page is up | 00:28 |
| corvus | and we're running jobs | 00:28 |
| fungi | agreed, http://zuul.openstack.org/ shows jobs | 00:28 |
| fungi | as an aside, we have a zuul.o.o ssl cert we can apply to the vhost on zuul\d+.openstack.org nodes | 00:29 |
| fungi | though i may not get that change written until after next week | 00:29 |
| fungi | all safe to reenqueue exported pipelines now, i guess? | 00:29 |
| clarkb | looks like it to me | 00:30 |
| fungi | underway | 00:30 |
| *** caphrim007_ has quit IRC | 00:30 | |
| *** fried_rice is now known as efried | 00:30 | |
| *** caphrim007 has quit IRC | 00:30 | |
| *** caphrim007_ has joined #openstack-infra | 00:31 | |
| *** felipemonteiro__ has joined #openstack-infra | 00:31 | |
| fungi | looks like one of the openstack-helm jobs already completed successfully | 00:31 |
| fungi | that's a reassuring sign | 00:31 |
| fungi | okay, gate reenqueued, check underway | 00:31 |
| *** yamamoto has quit IRC | 00:33 | |
| clarkb | stopping the executors and scheduler like this releases all the test nodes so we don't have leaks like we used to right? | 00:33 |
| clarkb | thats a nice feature of the zk based node negotiation | 00:33 |
| fungi | agreed, spiffy | 00:34 |
| fungi | and convenient for lazy folk like myself | 00:34 |
| fungi | now reenqueuing check-tripleo | 00:35 |
| *** caphrim007_ has quit IRC | 00:35 | |
| fungi | hrm, that went quickly. it only had a few lingering i guess | 00:36 |
| fungi | #status log ze* and zm* hosts removed from emergency disable list now that maintenance has concluded | 00:37 |
| openstackstatus | fungi: finished logging | 00:37 |
| clarkb | hopefully this stabilizes zuul a bit more under load | 00:37 |
| fungi | and absorbs much larger clusters of config changes under test | 00:38 |
| corvus | i suspect https://review.openstack.org/530205 may also be responsible for lack of exiting in fingergw and scheduler | 00:42 |
| *** sree has joined #openstack-infra | 00:46 | |
| fungi | the node request graph is falling, so i expect we're in good shape | 00:50 |
| *** sree has quit IRC | 00:51 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Decommission zuulv3.openstack.org server https://review.openstack.org/535996 | 00:58 |
| fungi | clarkb: corvus: ^ cleanup change, lest i forget | 00:58 |
| * fungi winds down for the evening | 01:00 | |
| fungi | #status log the zuulv3.openstack.org server has been replaced by a larger zuul01.openstack.org server | 01:01 |
| openstackstatus | fungi: finished logging | 01:01 |
| *** sree has joined #openstack-infra | 01:01 | |
| *** sree has quit IRC | 01:05 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Create a StoryBoard gui manual https://review.openstack.org/325474 | 01:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Omnibus scheduler stop fixes https://review.openstack.org/535997 | 01:07 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Create a StoryBoard gui manual https://review.openstack.org/325474 | 01:09 |
| *** vsaienk0 has joined #openstack-infra | 01:11 | |
| *** jamesmcarthur has quit IRC | 01:13 | |
| *** tosky has quit IRC | 01:14 | |
| *** kiennt26 has joined #openstack-infra | 01:19 | |
| *** spzala has quit IRC | 01:20 | |
| *** spzala has joined #openstack-infra | 01:20 | |
| *** spzala has quit IRC | 01:24 | |
| *** vsaienk0 has quit IRC | 01:25 | |
| *** jamesmcarthur has joined #openstack-infra | 01:25 | |
| *** vsaienk0 has joined #openstack-infra | 01:32 | |
| *** yamamoto has joined #openstack-infra | 01:34 | |
| *** jkilpatr_ has quit IRC | 01:37 | |
| *** felipemonteiro__ has quit IRC | 01:37 | |
| *** yamahata has quit IRC | 01:41 | |
| *** yamamoto has quit IRC | 01:44 | |
| *** caphrim007 has joined #openstack-infra | 01:45 | |
| *** sree has joined #openstack-infra | 01:51 | |
| *** edmondsw has joined #openstack-infra | 01:52 | |
| *** r-daneel has quit IRC | 01:54 | |
| *** sree has quit IRC | 01:55 | |
| *** edmondsw has quit IRC | 01:57 | |
| *** markvoelker has quit IRC | 02:01 | |
| *** gyee has quit IRC | 02:03 | |
| *** kiennt26 has quit IRC | 02:04 | |
| *** jamesmcarthur has quit IRC | 02:12 | |
| *** jamesmcarthur has joined #openstack-infra | 02:15 | |
| pabelanger | clarkb: fungi: not sure if still around, but we can also land https://review.openstack.org/535869 nl01 no longer has any nodes from those providers now | 02:15 |
| *** bnemec has quit IRC | 02:18 | |
| *** sree has joined #openstack-infra | 02:20 | |
| *** bnemec has joined #openstack-infra | 02:20 | |
| *** sree has quit IRC | 02:25 | |
| rm_work | for shade, when you initialize stuff, is there a way to specify which identity-api-version to use? | 02:29 |
| rm_work | it seems like it's trying to use v2 but we need it to be using v3 | 02:29 |
| rm_work | for OSC I just export "OS_IDENTITY_API_VERSION=3" | 02:29 |
| rm_work | and it works | 02:29 |
| rm_work | but i don't know how to tell shade the same thing | 02:30 |
| rm_work | mordred: ^^ any idea? saw your name around in the shade stuff | 02:30 |
| pabelanger | rm_work: here is our clouds.yaml file: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/nodepool/clouds.yaml.erb#n83 | 02:31 |
| pabelanger | you can do the same | 02:31 |
| rm_work | oh that's a valid option now? | 02:32 |
| rm_work | identity_api_version: '3' | 02:32 |
| rm_work | didn't used to be | 02:32 |
| pabelanger | should be, we've used it for some time i think | 02:32 |
| *** smatzek has joined #openstack-infra | 02:32 | |
| rm_work | hmmm | 02:33 |
| rm_work | when i try to do anything it spits stuff like: | 02:33 |
| rm_work | BadRequest: Expecting to find domain in project - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) | 02:33 |
| rm_work | which is the exact message OSC gives me when i try to use it with identity version 2 | 02:33 |
| rm_work | hmmm | 02:35 |
| rm_work | OSC works fine with this clouds.yaml | 02:36 |
| rm_work | i mean, my clouds.yaml | 02:36 |
| rm_work | but shade gives me that | 02:36 |
| rm_work | which LOOKS like it's trying to pass v2 auth stuff to the v3 endpoint | 02:36 |
| mnaser | rm_work: where did you get this file from | 02:36 |
| rm_work | my clouds.yaml? | 02:36 |
| rm_work | I wrote it | 02:36 |
| mnaser | you're likely missing the project and user domain in it | 02:37 |
| rm_work | OSC defaults those | 02:37 |
| rm_work | does shade not? | 02:37 |
| rm_work | i assumed that was happening at a higher level | 02:37 |
| clarkb | there is no default in keystone aiui | 02:37 |
| rm_work | err... lower level? | 02:37 |
| rm_work | whatever | 02:37 |
| clarkb | so shade cant default to anything | 02:37 |
| rm_work | hmmm | 02:37 |
| rm_work | so OSC just behaves differently | 02:37 |
| rm_work | OSC defaults them to "Default" | 02:37 |
| mnaser | does it? | 02:37 |
| rm_work | yes | 02:37 |
| clarkb | if it does I think its relying in covention that may not be reliable | 02:38 |
| rm_work | k | 02:38 |
| rm_work | i mean, i don't know where/how it does, but it HAS TO | 02:38 |
| mnaser | i'm checking that because im curious | 02:38 |
| rm_work | because those are the values for my cloud | 02:38 |
| rm_work | and it works | 02:38 |
| rm_work | my clouds.yaml has used v3 and not listed domains ever :/ | 02:38 |
| rm_work | i added them at first but realized it was redundant and removed them | 02:39 |
| rm_work | i guess only redundant for OSC | 02:39 |
| mnaser | (fyi a discussion better suited for #openstack-sdks but i guess we can have it here for closure) | 02:39 |
| rm_work | ah yeah probably | 02:39 |
| mnaser | and speaking of channels, whats a good channel for nodepool related discussions | 02:42 |
| pabelanger | here or #zuul | 02:42 |
| *** jamesmcarthur has quit IRC | 02:42 | |
| *** jamesmcarthur has joined #openstack-infra | 02:43 | |
| *** rpittau has quit IRC | 02:46 | |
| *** jamesmcarthur has quit IRC | 02:53 | |
| *** jamesmcarthur has joined #openstack-infra | 02:54 | |
| *** jamesmcarthur has quit IRC | 02:56 | |
| corvus | mnaser: if your question is in the context of third-party ci, i think it may be worth considering that as jobs migrate to zuulv3-native, it will be easier for third-party ci's to directly use them if they are running zuulv3 | 02:59 |
| *** harlowja has quit IRC | 03:00 | |
| corvus | that's one of the advantages we anticipate with zuulv3 -- third-party ci systems directly sharing job content with upstream | 03:00 |
| *** larainema has joined #openstack-infra | 03:03 | |
| *** ganso has quit IRC | 03:10 | |
| *** gouthamr has joined #openstack-infra | 03:30 | |
| *** jamesmcarthur has joined #openstack-infra | 03:36 | |
| *** harlowja has joined #openstack-infra | 03:37 | |
| *** smatzek has quit IRC | 03:38 | |
| *** edmondsw has joined #openstack-infra | 03:40 | |
| *** jamesmcarthur has quit IRC | 03:41 | |
| *** edmondsw has quit IRC | 03:45 | |
| *** gouthamr has quit IRC | 03:46 | |
| *** jamesmcarthur has joined #openstack-infra | 03:53 | |
| *** armax has quit IRC | 03:57 | |
| *** armax has joined #openstack-infra | 03:58 | |
| *** armax has quit IRC | 03:58 | |
| *** pramodrj07 has quit IRC | 03:58 | |
| *** armax has joined #openstack-infra | 03:58 | |
| *** armax has quit IRC | 03:59 | |
| *** armax has joined #openstack-infra | 03:59 | |
| *** armax has quit IRC | 04:00 | |
| *** armax has joined #openstack-infra | 04:00 | |
| *** armax has quit IRC | 04:00 | |
| *** armax has joined #openstack-infra | 04:01 | |
| *** armax has quit IRC | 04:01 | |
| *** armax has joined #openstack-infra | 04:02 | |
| *** markvoelker has joined #openstack-infra | 04:02 | |
| *** armax has quit IRC | 04:02 | |
| *** jamesmcarthur has quit IRC | 04:11 | |
| *** bhavik1 has joined #openstack-infra | 04:17 | |
| *** sree has joined #openstack-infra | 04:21 | |
| *** spzala has joined #openstack-infra | 04:21 | |
| *** bhavik1 has quit IRC | 04:23 | |
| *** spzala has quit IRC | 04:25 | |
| *** yamamoto has joined #openstack-infra | 04:25 | |
| *** sree has quit IRC | 04:26 | |
| *** rosmaita has quit IRC | 04:28 | |
| *** jamesmcarthur has joined #openstack-infra | 04:32 | |
| *** ykarel|away has joined #openstack-infra | 04:32 | |
| *** markvoelker has quit IRC | 04:37 | |
| *** jamesmcarthur has quit IRC | 04:39 | |
| *** jamesmcarthur has joined #openstack-infra | 04:43 | |
| *** jamesmcarthur has quit IRC | 04:56 | |
| *** bobh has joined #openstack-infra | 05:00 | |
| *** jamesmcarthur has joined #openstack-infra | 05:12 | |
| *** jamesmcarthur has quit IRC | 05:16 | |
| *** bobh has quit IRC | 05:19 | |
| *** efried has quit IRC | 05:20 | |
| *** jamesmcarthur has joined #openstack-infra | 05:27 | |
| *** efried has joined #openstack-infra | 05:30 | |
| *** harlowja has quit IRC | 05:32 | |
| *** jamesmcarthur has quit IRC | 05:32 | |
| *** markvoelker has joined #openstack-infra | 05:33 | |
| *** spzala has joined #openstack-infra | 05:38 | |
| *** smatzek has joined #openstack-infra | 05:39 | |
| *** spzala has quit IRC | 05:39 | |
| *** smatzek has quit IRC | 05:43 | |
| *** abelur has quit IRC | 05:48 | |
| *** abelur has joined #openstack-infra | 05:55 | |
| *** markvoelker has quit IRC | 06:07 | |
| *** yamahata has joined #openstack-infra | 06:12 | |
| *** sree has joined #openstack-infra | 06:22 | |
| *** ekcs has joined #openstack-infra | 06:22 | |
| *** zhurong has joined #openstack-infra | 06:26 | |
| *** sree has quit IRC | 06:26 | |
| *** lamt has joined #openstack-infra | 06:30 | |
| *** ekcs has quit IRC | 06:41 | |
| *** ekcs has joined #openstack-infra | 06:42 | |
| *** yamamoto has quit IRC | 06:48 | |
| *** slaweq has joined #openstack-infra | 06:49 | |
| *** ekcs has quit IRC | 06:53 | |
| *** sree has joined #openstack-infra | 06:54 | |
| *** jamesmcarthur has joined #openstack-infra | 06:57 | |
| *** sree has quit IRC | 06:59 | |
| *** jamesmcarthur has quit IRC | 07:01 | |
| *** sree has joined #openstack-infra | 07:10 | |
| *** yamahata has quit IRC | 07:10 | |
| *** sree has quit IRC | 07:14 | |
| *** ykarel|away has quit IRC | 07:16 | |
| *** edmondsw has joined #openstack-infra | 07:17 | |
| *** sree has joined #openstack-infra | 07:18 | |
| *** slaweq has quit IRC | 07:20 | |
| *** edmondsw has quit IRC | 07:21 | |
| *** sree has quit IRC | 07:22 | |
| *** zhurong has quit IRC | 07:25 | |
| *** armaan has quit IRC | 07:28 | |
| *** armaan has joined #openstack-infra | 07:29 | |
| *** Nil_ has quit IRC | 07:29 | |
| *** Nil_ has joined #openstack-infra | 07:30 | |
| *** yamamoto has joined #openstack-infra | 07:34 | |
| *** yamamoto has quit IRC | 07:34 | |
| *** zhurong has joined #openstack-infra | 07:43 | |
| *** jamesmcarthur has joined #openstack-infra | 07:43 | |
| *** jamesmcarthur has quit IRC | 07:47 | |
| *** yamamoto has joined #openstack-infra | 07:49 | |
| *** yamamoto has quit IRC | 07:53 | |
| *** bradm has joined #openstack-infra | 08:00 | |
| *** yamamoto has joined #openstack-infra | 08:01 | |
| *** yamamoto has quit IRC | 08:01 | |
| *** markvoelker has joined #openstack-infra | 08:04 | |
| *** Nil_ has quit IRC | 08:07 | |
| *** Nil_ has joined #openstack-infra | 08:09 | |
| *** yamamoto has joined #openstack-infra | 08:11 | |
| *** e0ne has joined #openstack-infra | 08:15 | |
| *** yamamoto has quit IRC | 08:17 | |
| *** yamamoto has joined #openstack-infra | 08:18 | |
| *** yamamoto has quit IRC | 08:22 | |
| *** jbadiapa has joined #openstack-infra | 08:30 | |
| *** pcichy has joined #openstack-infra | 08:35 | |
| *** markvoelker has quit IRC | 08:37 | |
| *** jamesmcarthur has joined #openstack-infra | 08:40 | |
| *** yamamoto has joined #openstack-infra | 08:43 | |
| *** jamesmcarthur has quit IRC | 08:44 | |
| *** sree has joined #openstack-infra | 08:49 | |
| *** sree has quit IRC | 08:53 | |
| *** slaweq has joined #openstack-infra | 08:54 | |
| *** sree has joined #openstack-infra | 08:55 | |
| *** sree has quit IRC | 09:00 | |
| *** edmondsw has joined #openstack-infra | 09:05 | |
| *** e0ne has quit IRC | 09:07 | |
| *** edmondsw has quit IRC | 09:09 | |
| *** e0ne has joined #openstack-infra | 09:14 | |
| *** sree has joined #openstack-infra | 09:15 | |
| *** sree has quit IRC | 09:19 | |
| *** yamamoto has quit IRC | 09:20 | |
| *** yamamoto has joined #openstack-infra | 09:26 | |
| *** sree has joined #openstack-infra | 09:26 | |
| *** sree has quit IRC | 09:31 | |
| *** claudiub has joined #openstack-infra | 09:34 | |
| *** markvoelker has joined #openstack-infra | 09:34 | |
| *** zhurong has quit IRC | 09:38 | |
| *** sree has joined #openstack-infra | 09:41 | |
| *** sree has quit IRC | 09:46 | |
| *** abelur_ has quit IRC | 09:52 | |
| *** sree has joined #openstack-infra | 09:53 | |
| *** sree has quit IRC | 09:57 | |
| *** yamamoto has quit IRC | 09:58 | |
| *** markvoelker has quit IRC | 10:07 | |
| *** sbra has joined #openstack-infra | 10:10 | |
| *** e0ne has quit IRC | 10:15 | |
| *** sree has joined #openstack-infra | 10:28 | |
| *** pbourke has quit IRC | 10:29 | |
| *** pbourke has joined #openstack-infra | 10:30 | |
| *** yamamoto has joined #openstack-infra | 10:31 | |
| *** sree has quit IRC | 10:32 | |
| *** e0ne has joined #openstack-infra | 10:35 | |
| *** sree has joined #openstack-infra | 10:43 | |
| *** dhajare|BRB has joined #openstack-infra | 10:43 | |
| *** sree has quit IRC | 10:47 | |
| *** edmondsw has joined #openstack-infra | 10:53 | |
| *** edmondsw has quit IRC | 10:58 | |
| *** sree has joined #openstack-infra | 11:02 | |
| *** dhajare|BRB has quit IRC | 11:04 | |
| *** dhajare|BRB has joined #openstack-infra | 11:04 | |
| *** markvoelker has joined #openstack-infra | 11:05 | |
| *** sree has quit IRC | 11:06 | |
| *** dhajare|BRB has quit IRC | 11:12 | |
| *** dhajare|BRB has joined #openstack-infra | 11:13 | |
| openstackgerrit | Adrien Lebre proposed openstack-infra/irc-meetings master: Switch from MDC WG to FEMDC SiG https://review.openstack.org/536030 | 11:13 |
| openstackgerrit | Adrien Lebre proposed openstack-infra/irc-meetings master: Add Paul-Andre as a co-chair of the FEMDC SiG https://review.openstack.org/536031 | 11:13 |
| *** sree has joined #openstack-infra | 11:22 | |
| *** sree has quit IRC | 11:26 | |
| *** yamamoto has quit IRC | 11:33 | |
| *** yamamoto has joined #openstack-infra | 11:33 | |
| *** dhajare|BRB has quit IRC | 11:34 | |
| *** dhajare|BRB has joined #openstack-infra | 11:35 | |
| *** yamamoto has quit IRC | 11:37 | |
| *** markvoelker has quit IRC | 11:38 | |
| *** e0ne has quit IRC | 11:41 | |
| *** tosky has joined #openstack-infra | 11:41 | |
| *** yamamoto has joined #openstack-infra | 11:44 | |
| *** slaweq has quit IRC | 11:46 | |
| *** hamzy_ is now known as hamzy | 11:54 | |
| *** dhajare|BRB has quit IRC | 11:56 | |
| *** dhajare|BRB has joined #openstack-infra | 11:57 | |
| *** yamamoto has quit IRC | 11:58 | |
| hamzy | does anyone know what might be causing "FAILED with status: 137" for http://logs.openstack.org/83/535983/2/check/legacy-dsvm-nodepool-redhat-src/2b647f9/job-output.txt.gz | 11:58 |
| *** e0ne has joined #openstack-infra | 12:21 | |
| *** agopi has quit IRC | 12:26 | |
| *** dave-mcc_ has joined #openstack-infra | 12:27 | |
| *** jamesmcarthur has joined #openstack-infra | 12:41 | |
| *** edmondsw has joined #openstack-infra | 12:41 | |
| *** jamesmcarthur has quit IRC | 12:45 | |
| *** edmondsw has quit IRC | 12:46 | |
| *** yamamoto has joined #openstack-infra | 12:47 | |
| *** slaweq has joined #openstack-infra | 12:53 | |
| *** slaweq has quit IRC | 13:00 | |
| *** sree has joined #openstack-infra | 13:01 | |
| *** sree has quit IRC | 13:06 | |
| *** liusheng has quit IRC | 13:09 | |
| *** liusheng has joined #openstack-infra | 13:10 | |
| *** sree has joined #openstack-infra | 13:10 | |
| *** sree has quit IRC | 13:24 | |
| *** dhajare|BRB has quit IRC | 13:25 | |
| *** sbra has quit IRC | 13:27 | |
| pabelanger | hamzy: the job timed out for some reason. either due to bug or possible slower compute hardware | 13:28 |
| *** sree has joined #openstack-infra | 13:29 | |
| hamzy | pabelanger, thanks BTW this is hitting multiple patches of mine in DIB | 13:30 |
| *** sree has quit IRC | 13:30 | |
| *** sree has joined #openstack-infra | 13:30 | |
| pabelanger | hamzy: is it happening in the same cloud? | 13:30 |
| *** armaan has quit IRC | 13:31 | |
| *** armaan has joined #openstack-infra | 13:31 | |
| pabelanger | we should have an elastic-recheck query setup to track timeouts too | 13:31 |
| hamzy | pabelanger, I think so? http://logs.openstack.org/79/532279/3/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/e3fffdf/ | 13:32 |
| pabelanger | that runs in tripleo-test-cloud-rh1, I think there is ongoing issues with the cloud. Seen something on ML last night. | 13:33 |
| hamzy | yeah overheating or something? | 13:34 |
| pabelanger | yah | 13:34 |
| *** markvoelker has joined #openstack-infra | 13:35 | |
| *** slaweq has joined #openstack-infra | 13:35 | |
| *** slaweq has quit IRC | 13:38 | |
| openstackgerrit | Merged openstack-infra/project-config master: Clean up nl01.o.o configuration https://review.openstack.org/535869 | 13:42 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create nl04.o.o configuration https://review.openstack.org/536035 | 13:56 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Remove OVH from nl02.o.o https://review.openstack.org/536036 | 13:56 |
| *** eharney has quit IRC | 14:03 | |
| *** markvoelker has quit IRC | 14:09 | |
| *** agopi has joined #openstack-infra | 14:11 | |
| *** sree has quit IRC | 14:16 | |
| *** slaweq has joined #openstack-infra | 14:17 | |
| *** sree has joined #openstack-infra | 14:17 | |
| *** armaan has quit IRC | 14:20 | |
| *** armaan has joined #openstack-infra | 14:20 | |
| *** sree has quit IRC | 14:22 | |
| fungi | pabelanger: any idea whether tripleo actively using dib in those jobs any longer, or if we're just continuing to run them on dib changes out of habit? | 14:24 |
| *** sree has joined #openstack-infra | 14:25 | |
| pabelanger | fungi: no, I believe they still use DIB (maybe on stable branches) but know they are moving more into container / k8s area. But something I can follow-up with them to confirm | 14:28 |
| fungi | not a big deal, just making sure we weren't unnecessarily loading their cloud and hampering dib patches at the same time | 14:29 |
| *** bkero_ has joined #openstack-infra | 14:29 | |
| pabelanger | yah | 14:29 |
| *** bkero-lounge has quit IRC | 14:29 | |
| *** reed has quit IRC | 14:30 | |
| *** bkero is now known as bkero- | 14:31 | |
| *** sree has quit IRC | 14:31 | |
| *** bkero_ is now known as bkero | 14:32 | |
| *** slaweq has quit IRC | 14:32 | |
| *** bkero has quit IRC | 14:32 | |
| *** bkero has joined #openstack-infra | 14:32 | |
| *** sree has joined #openstack-infra | 14:36 | |
| *** sree has quit IRC | 14:40 | |
| *** markvoelker has joined #openstack-infra | 14:45 | |
| *** markvoelker has quit IRC | 14:50 | |
| *** jamesmcarthur has joined #openstack-infra | 14:55 | |
| *** e0ne has quit IRC | 14:58 | |
| *** jamesmcarthur has quit IRC | 14:59 | |
| *** e0ne has joined #openstack-infra | 15:00 | |
| *** sree has joined #openstack-infra | 15:02 | |
| *** slaweq has joined #openstack-infra | 15:03 | |
| *** e0ne has quit IRC | 15:05 | |
| *** sree has quit IRC | 15:07 | |
| *** slaweq has quit IRC | 15:08 | |
| *** sree has joined #openstack-infra | 15:20 | |
| *** sree has quit IRC | 15:25 | |
| AJaeger | fungi: seeing pabelanger's nl04, could you +2A https://review.openstack.org/#/c/535897/ so that we test those changes, please? | 15:27 |
| AJaeger | or any other config-core ^ | 15:28 |
| *** sree has joined #openstack-infra | 15:31 | |
| *** jtomasek has joined #openstack-infra | 15:34 | |
| *** sree has quit IRC | 15:36 | |
| *** slaweq has joined #openstack-infra | 15:41 | |
| *** jamesmcarthur has joined #openstack-infra | 15:45 | |
| *** slaweq has quit IRC | 15:46 | |
| *** markvoelker has joined #openstack-infra | 15:47 | |
| mordred | fungi: wow. I really do not understand how to fix the puppet-zuul rspec issues :( | 15:50 |
| *** d0ugal has joined #openstack-infra | 15:50 | |
| *** d0ugal has quit IRC | 15:50 | |
| *** d0ugal has joined #openstack-infra | 15:50 | |
| *** jamesmcarthur has quit IRC | 15:51 | |
| fungi | mordred: likely neither do i then, but have an example failure? | 15:52 |
| *** pcaruana has joined #openstack-infra | 15:52 | |
| openstackgerrit | Merged openstack-infra/project-config master: Test all nodepool files https://review.openstack.org/535897 | 15:52 |
| mordred | fungi: http://logs.openstack.org/00/535900/4/check/legacy-puppet-beaker-rspec-infra/1845477/job-output.txt.gz#_2018-01-20_01_44_35_893699 | 15:53 |
| fungi | might be a welcome break from wrestling with getting telnetlib to bypass option negotiation so i can test a server's ability to handle malformed iac sequences | 15:53 |
| mordred | fungi: this is for the update-puppet-zuul-for-zuulv3 stack: https://review.openstack.org/#/c/535966 | 15:53 |
| mordred | fungi: so far I understand that rspec does not have a matcher for testing something being installed with pip3 | 15:54 |
| mordred | so I'm pretty sure we need to write one -but my brain cannot figure that out | 15:54 |
| mordred | rm_work, clarkb: from yesterday - identity_api_version has nothing to do with whether one authenticates with v2 or v3 - it controls what version of the API is used for CRUD operations | 15:56 |
| mordred | rm_work, clarkb: if you want to be explicit about authenticating using v3 instead of v2 and you don't have domain information in your auth settings, 'auth_type: v3password' | 15:58 |
| mordred | rm_work: however, putting default in for user_domain_id and project_domain_id is the better bet | 15:59 |
| fungi | mordred: afraid i know next to nothing about rspec... where is the normal check_is_installed_by_pip defined? | 16:00 |
| fungi | there's some sort of rspec stdlib i suppose? | 16:01 |
| *** rosmaita has joined #openstack-infra | 16:01 | |
| mordred | fungi: yah. I'm trying to find that currently | 16:04 |
| *** bobh has joined #openstack-infra | 16:04 | |
| mordred | fungi: ooh. https://github.com/mizzy/specinfra/blob/master/lib/specinfra/command/base/package.rb#L38 | 16:04 |
| fungi | i wonder if we could (should?) hack around it by redefining "pip" in the execution path to pip3 (via alias, symlink, something) before those tests are executed | 16:05 |
| fungi | but that still seems like a dirty hack | 16:05 |
| *** jamesmcarthur has joined #openstack-infra | 16:07 | |
| *** armax has joined #openstack-infra | 16:07 | |
| fungi | so i guess the next question is how one extends Specinfra::Command::Base::Package | 16:08 |
| fungi | we're using Specinfra::Command::Debian::Base::Package so already extending it (though still from that stdlib) i guess? | 16:08 |
| fungi | https://github.com/mizzy/specinfra/blob/master/lib/specinfra/command/debian/base/package.rb | 16:09 |
| fungi | which inherits it via https://github.com/mizzy/specinfra/blob/master/lib/specinfra/command/linux/base/package.rb | 16:10 |
| *** jamesmcarthur has quit IRC | 16:11 | |
| *** claudiub has quit IRC | 16:11 | |
| mordred | fungi: yah - that's kind of where I've gotten ... | 16:13 |
| mordred | fungi: I also found this: https://blog.lorentzca.me/add-custom-matcher-of-serverspec/ | 16:14 |
| *** yamamoto has quit IRC | 16:14 | |
| fungi | good thing we're both fluent in japanese | 16:14 |
| mordred | ikr? | 16:15 |
| *** yamamoto has joined #openstack-infra | 16:15 | |
| fungi | so i suppose initially we can try embedding something along those lines into our basic_spec.rb file in the puppet-zuul repo | 16:16 |
| mordred | fungi: I gotta say, I'm not crazy about being this dependent on some technology that we literally don't understand at all | 16:17 |
| fungi | ganbatte, ne | 16:17 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Update spec acceptance to zuulv3 https://review.openstack.org/535966 | 16:18 |
| mordred | fungi: that ^^ is a COMPLETE guess | 16:19 |
| mordred | cmurphy: if you happen to be online on a saturday and have a few seconds to maybe point me in a better direction | 16:19 |
| fungi | adding some inline comments (in kanji?) would be a nice touch | 16:20 |
| mordred | right? | 16:20 |
| *** markvoelker has quit IRC | 16:20 | |
| fungi | maybe once we actually know how to describe what that does (and whether it even works at all) | 16:20 |
| mordred | perhaps 動作確認用コード says something about it that's useful | 16:20 |
| *** jamesmcarthur has joined #openstack-infra | 16:21 | |
| fungi | my universal translator says that means "operation confirmation code" but it's running low on roddenberrillium so who knows if it's accurate | 16:22 |
| mordred | ooh! "既存のリソースタイプにマッチャーを追加する覚書き" says "Memorandum to add a matcher to an existing resource type" | 16:22 |
| mordred | fungi: perhaps instead of User there I should be doing Specinfra::Command::Debian::Base::Package ? | 16:23 |
| fungi | d'oh, yes probably | 16:23 |
| mordred | let's try that | 16:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Update spec acceptance to zuulv3 https://review.openstack.org/535966 | 16:24 |
| mordred | fungi: if that works, I think we can probably put that custom matcher into puppet-openstack_infra_spec_helper | 16:25 |
| mordred | somehow | 16:25 |
| fungi | maybe something along the lines of "class Specinfra::Command::Custom::Base::Package < Specinfra::Command::Debian::Base::Package" | 16:25 |
| *** jamesmcarthur has quit IRC | 16:26 | |
| mordred | well - I **think** the japanese blog is showing us how to add more commands to existing resources? so I *think* Specinfra::Command::Base::User is existing, like Specinfra::Command::Debian::Base::Package is | 16:27 |
| fungi | ahh | 16:27 |
| mordred | so I **think** that this is a mechanism to add more things to an exxisting class? which seems weird, but if it is I'm not going to argue with it | 16:27 |
| fungi | so it's a subclassing of Specinfra::Command::Debian::Base::Package which extends that class in the current namespace? | 16:28 |
| mordred | *shrug* | 16:28 |
| mordred | fungi: describe 'puppet-zuul module', :if => ['debian', 'ubuntu'].include?(os[:family]) <-- | 16:28 |
| fungi | yeah, i was mostly just smashing random words together anyway | 16:28 |
| mordred | me too | 16:28 |
| fungi | on my (unrelated) telnet server testing problem, looks like https://docs.python.org/3/library/telnetlib.html#telnetlib.Telnet.get_socket will work for letting me operate on the raw socket, bypassing the iac escaping Telnwt.write() performs | 16:29 |
| mordred | oh - I may have missed the initial issues- what's the problem? | 16:29 |
| fungi | so i can still use telnetlib as a pseudo-baked telnet client for other parts of the tests but inject raw bytes when necessary | 16:29 |
| *** d0ugal has quit IRC | 16:30 | |
| fungi | i have custom telnet server, and in the process of fixing a regression in telopt negotiation handling i wanted to actually start directly testing some of the option handling routines (including its ability to ignore unrecognized iac commands and options), but my functional testing employed telnetlib as a client and it (as telnet clients are wont to do) doubles any raw iac byte in the input when | 16:32 |
| fungi | sending so as to escape it and therefore disambiguate it from option negotiation | 16:32 |
| *** d0ugal has joined #openstack-infra | 16:32 | |
| fungi | but anyway, with the get_socket() method i can just get a handle to the raw socket its using for the established session and inject whatever sorts of invalid noise i like in there | 16:35 |
| fungi | may also be a nice way to integrate some limited fuzz testing into my functional testsuite there | 16:37 |
| *** ekcs has joined #openstack-infra | 16:40 | |
| *** armax has quit IRC | 16:40 | |
| mordred | fungi: oh wow. you're having a fun saturday :) | 16:45 |
| clarkb | also known as avoiding packing | 16:50 |
| rosmaita | no wonder openstack works ... the infra team never sleeps | 16:51 |
| fungi | clarkb: yeah, it's really mostly that, i'll admit | 16:52 |
| fungi | rosmaita: i often go into a suspended standby mode of operation after prolonged idle periods, or if my sensors indicate imminent overheating | 16:54 |
| rosmaita | :) | 16:54 |
| *** sree has joined #openstack-infra | 16:58 | |
| *** sree has quit IRC | 17:02 | |
| *** markvoelker has joined #openstack-infra | 17:17 | |
| *** yamamoto has quit IRC | 17:20 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/devstack-gate master: Remove tempest-lib https://review.openstack.org/536042 | 17:21 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove tempest-lib install https://review.openstack.org/536043 | 17:25 |
| *** yamamoto has joined #openstack-infra | 17:28 | |
| *** slaweq has joined #openstack-infra | 17:30 | |
| AJaeger | andreaf, chandankumar, mtreinish, please double check these two ^ | 17:32 |
| *** yamamoto has quit IRC | 17:33 | |
| *** bobh has quit IRC | 17:35 | |
| *** wisekittenx1 has joined #openstack-infra | 17:35 | |
| *** ekcs has quit IRC | 17:39 | |
| *** armaan has quit IRC | 17:48 | |
| *** armaan has joined #openstack-infra | 17:48 | |
| cmurphy | mordred: whoa | 17:50 |
| *** markvoelker has quit IRC | 17:51 | |
| fungi | mordred: http://logs.openstack.org/66/535966/5/check/legacy-puppet-beaker-rspec-infra/5a87d15/job-output.txt.gz#_2018-01-20_16_47_25_063359 | 17:52 |
| fungi | "superclass mismatch for class Package" | 17:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Update spec acceptance to zuulv3 https://review.openstack.org/535966 | 17:55 |
| mordred | fungi: yah - Specinfra::Command::Linux::Base::Package is the base class I think: http://www.rubydoc.info/gems/specinfra/2.53.0/Specinfra/Command/Debian/Base/Package | 17:56 |
| *** slaweq has quit IRC | 17:56 | |
| mordred | fungi: updated to try that | 17:56 |
| mordred | cmurphy: are we on the right track at least? | 17:56 |
| cmurphy | mordred: no idea | 17:57 |
| mordred | oh - we might be able to make that more general ... check_is_installed_by_pip is in Specinfra::Command::Base::Package | 17:57 |
| cmurphy | mordred: i suggest drop the test | 17:57 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Try with Specinfra::Command::Base::Package https://review.openstack.org/536053 | 17:58 |
| mordred | cmurphy: well, that was my first thought :) | 17:58 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Use tempest-plugin-jobs project template for all tempest plugins https://review.openstack.org/531339 | 18:00 |
| *** armaan has quit IRC | 18:01 | |
| *** armaan has joined #openstack-infra | 18:02 | |
| *** hongbin has joined #openstack-infra | 18:04 | |
| *** e0ne has joined #openstack-infra | 18:05 | |
| *** yamamoto has joined #openstack-infra | 18:14 | |
| AJaeger | config-core, could you review the change above so that we test all plugins the same way, please? | 18:16 |
| *** snapiri- has joined #openstack-infra | 18:18 | |
| *** yamamoto has quit IRC | 18:18 | |
| mordred | fungi: woot! http://logs.openstack.org/53/536053/1/check/legacy-puppet-beaker-rspec-infra/cbd74a4/job-output.txt.gz worked | 18:19 |
| mordred | (I mean, it's unhappy that nothing is listening on the gear port - but other than that) | 18:19 |
| *** cinerama has quit IRC | 18:22 | |
| *** yamahata has joined #openstack-infra | 18:22 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Update spec acceptance to zuulv3 https://review.openstack.org/535966 | 18:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Add /connection to rewrite rules https://review.openstack.org/535900 | 18:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Add TODO about fixing ara idempotency https://review.openstack.org/535982 | 18:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Fix whitespace in ara install version checking https://review.openstack.org/535991 | 18:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Re-enable gearman port listening check https://review.openstack.org/536055 | 18:24 |
| mordred | fungi, clarkb: I think that stack should be green now | 18:25 |
| cmurphy | nice | 18:25 |
| *** agopi has quit IRC | 18:26 | |
| *** larainema has quit IRC | 18:31 | |
| *** hongbin_ has joined #openstack-infra | 18:34 | |
| *** snapiri- has quit IRC | 18:34 | |
| *** hongbin has quit IRC | 18:36 | |
| *** yamamoto has joined #openstack-infra | 18:44 | |
| *** e0ne has quit IRC | 18:47 | |
| *** markvoelker has joined #openstack-infra | 18:48 | |
| *** yamamoto has quit IRC | 18:48 | |
| *** slaweq has joined #openstack-infra | 18:51 | |
| *** slaweq has quit IRC | 18:57 | |
| *** sree has joined #openstack-infra | 18:59 | |
| *** hongbin_ has quit IRC | 18:59 | |
| *** sree has quit IRC | 19:03 | |
| *** ykarel|away has joined #openstack-infra | 19:08 | |
| *** rosmaita has quit IRC | 19:11 | |
| *** e0ne has joined #openstack-infra | 19:12 | |
| *** e0ne has quit IRC | 19:15 | |
| *** pcrews has quit IRC | 19:19 | |
| *** markvoelker has quit IRC | 19:21 | |
| *** wisekittenx1 has quit IRC | 19:22 | |
| *** andreas_s has joined #openstack-infra | 19:24 | |
| *** andreas_s has quit IRC | 19:28 | |
| *** armaan has quit IRC | 19:32 | |
| *** armaan has joined #openstack-infra | 19:33 | |
| *** armaan has quit IRC | 19:35 | |
| *** armaan has joined #openstack-infra | 19:37 | |
| *** slaweq has joined #openstack-infra | 19:37 | |
| *** yamahata has quit IRC | 19:39 | |
| pabelanger | seems we have jobs running in gate for 13hrs+, wonder if we lost an executor to live migration or something | 19:43 |
| pabelanger | I can't seem to ssh into ze01 | 19:45 |
| pabelanger | and ze09.o.o | 19:46 |
| pabelanger | err | 19:46 |
| pabelanger | ze08.o.o | 19:46 |
| pabelanger | checking console in rackspace now | 19:46 |
| *** _ari_ is now known as _ari_|DevConf | 19:49 | |
| pabelanger | yah, ze01.o.o looks to maybe have been migrated | 19:54 |
| pabelanger | I see OOM for executor and other hung_task_timeout_secs messages | 19:55 |
| pabelanger | I'll reboot it now | 19:55 |
| pabelanger | and same message about hung task on ze08 too | 19:56 |
| pabelanger | 'blocked for 120 seconds' echo 0 ... to disable | 19:57 |
| pabelanger | tasks look to be ansible-playbooks | 19:57 |
| pabelanger | Jan 20 07:54:00 ze01 systemd[24666]: Reached target Shutdown. | 19:58 |
| pabelanger | that is ze01 | 19:58 |
| pabelanger | then no other logs until reboot just now | 19:59 |
| *** yamahata has joined #openstack-infra | 20:00 | |
| pabelanger | and, because executors were not shutdown properly, we'll need to dump queues and restart scheduler | 20:00 |
| pabelanger | I can do that in a moment too | 20:00 |
| *** pcaruana has quit IRC | 20:04 | |
| openstackgerrit | Dmitrii Shcherbakov proposed openstack-infra/project-config master: add system-req template and jobs for charm-panko https://review.openstack.org/533274 | 20:09 |
| *** makowals has joined #openstack-infra | 20:10 | |
| pabelanger | #status notice zuul.openstack.org has been restarted due to an unexpected issue. We were able to save / reload queues however new patchsets during the restart may have been missed. Please recheck if needed. | 20:13 |
| openstackstatus | pabelanger: sending notice | 20:13 |
| *** yamamoto has joined #openstack-infra | 20:13 | |
| *** yamamoto has quit IRC | 20:13 | |
| -openstackstatus- NOTICE: zuul.openstack.org has been restarted due to an unexpected issue. We were able to save / reload queues however new patchsets during the restart may have been missed. Please recheck if needed. | 20:14 | |
| openstackstatus | pabelanger: finished sending notice | 20:16 |
| *** markvoelker has joined #openstack-infra | 20:18 | |
| *** agopi has joined #openstack-infra | 20:21 | |
| *** ykarel|away has quit IRC | 20:32 | |
| *** makowals has quit IRC | 20:32 | |
| *** sree has joined #openstack-infra | 20:43 | |
| *** yamamoto has joined #openstack-infra | 20:44 | |
| *** sree has quit IRC | 20:47 | |
| *** yamamoto has quit IRC | 20:49 | |
| *** markvoelker has quit IRC | 20:52 | |
| *** markvoelker has joined #openstack-infra | 20:53 | |
| *** jtomasek has quit IRC | 21:07 | |
| *** rfolco|rover|off has quit IRC | 21:11 | |
| *** jamesmcarthur has joined #openstack-infra | 21:23 | |
| *** e0ne has joined #openstack-infra | 21:24 | |
| *** e0ne has quit IRC | 21:28 | |
| *** toabctl has quit IRC | 21:29 | |
| *** rfolco has joined #openstack-infra | 21:40 | |
| *** jamesmcarthur has quit IRC | 21:41 | |
| *** jamesmcarthur has joined #openstack-infra | 21:43 | |
| *** yamamoto has joined #openstack-infra | 21:47 | |
| *** jamesmcarthur has quit IRC | 21:48 | |
| *** e0ne has joined #openstack-infra | 21:49 | |
| *** e0ne has quit IRC | 21:51 | |
| *** yamamoto has quit IRC | 21:57 | |
| *** e0ne has joined #openstack-infra | 21:58 | |
| jlvillal | Is http://zuulv3.openstack.org/ not working a known issue? | 22:02 |
| *** slaweq has quit IRC | 22:05 | |
| *** petems has quit IRC | 22:05 | |
| *** clarkb has quit IRC | 22:05 | |
| *** simonmcc has quit IRC | 22:05 | |
| *** lucas-afk has quit IRC | 22:05 | |
| *** weshay|rover has quit IRC | 22:05 | |
| *** serverascode has quit IRC | 22:05 | |
| *** kklimonda has quit IRC | 22:05 | |
| *** mtreinish has quit IRC | 22:05 | |
| *** zhenguo has quit IRC | 22:05 | |
| *** NobodyCam has quit IRC | 22:05 | |
| *** xyang has quit IRC | 22:05 | |
| *** xgerman_ has quit IRC | 22:05 | |
| *** adam_g has quit IRC | 22:05 | |
| *** afazekas has quit IRC | 22:05 | |
| *** evrardjp has quit IRC | 22:05 | |
| *** dhellmann has quit IRC | 22:05 | |
| *** melwitt has quit IRC | 22:05 | |
| *** mrodden has quit IRC | 22:05 | |
| *** ryotagami has quit IRC | 22:05 | |
| *** mgagne has quit IRC | 22:05 | |
| *** mtreinish_ has joined #openstack-infra | 22:05 | |
| *** melwitt has joined #openstack-infra | 22:05 | |
| *** evrardjp has joined #openstack-infra | 22:05 | |
| *** dhellmann has joined #openstack-infra | 22:05 | |
| *** afazekas_ has joined #openstack-infra | 22:05 | |
| *** adam_g has joined #openstack-infra | 22:05 | |
| *** clarkb has joined #openstack-infra | 22:05 | |
| *** mgagne has joined #openstack-infra | 22:06 | |
| *** mrodden_ has joined #openstack-infra | 22:06 | |
| *** xyang has joined #openstack-infra | 22:06 | |
| *** melwitt is now known as Guest67963 | 22:06 | |
| *** mgagne is now known as Guest28399 | 22:06 | |
| *** kklimonda has joined #openstack-infra | 22:06 | |
| *** mrodden_ is now known as mrodden | 22:06 | |
| *** ryotagami has joined #openstack-infra | 22:06 | |
| *** xgerman_ has joined #openstack-infra | 22:06 | |
| *** lucasagomes has joined #openstack-infra | 22:06 | |
| *** mtreinish_ is now known as mtreinish | 22:06 | |
| *** simonmcc has joined #openstack-infra | 22:06 | |
| *** NobodyCam has joined #openstack-infra | 22:06 | |
| *** zhenguo has joined #openstack-infra | 22:06 | |
| *** serverascode has joined #openstack-infra | 22:06 | |
| fungi | jlvillal: that was only ever a temporary url. zuul.openstack.org is the service you want | 22:07 |
| *** petems has joined #openstack-infra | 22:07 | |
| *** weshay has joined #openstack-infra | 22:07 | |
| jlvillal | fungi, Thanks. I wasn't aware of that. I've been using zuulv3 this whole time :) | 22:07 |
| fungi | there was at one point a (temporary, http 302) redirect from zuul to zuulv3 but that was supplanted by a cname once we were comfortable deleting the old zuul.o.o server itself | 22:07 |
| fungi | the redirect at the zuul tab on http://status.openstack.org/ also goes to the zuul cname, so should be working as intended | 22:08 |
| jlvillal | fungi, Thanks! | 22:08 |
| fungi | the server at zuulv3.o.o was finally deleted yesterday and replaced by a more permanent one (zuul01.o.o) | 22:09 |
| fungi | which probably explains why you only just noticed | 22:09 |
| fungi | jlvillal: no problem, and please let us know if you spot anything odd! | 22:10 |
| fungi | the first day after a major server swap is often interesting | 22:11 |
| jlvillal | fungi, Well do. Thanks again. I'm happy as I can see that zuul status :) | 22:11 |
| jlvillal | s/Well do/Will do/ | 22:11 |
| *** yamahata has quit IRC | 22:21 | |
| *** slaweq has joined #openstack-infra | 22:22 | |
| *** slaweq has quit IRC | 22:28 | |
| *** slaweq has joined #openstack-infra | 22:32 | |
| smcginnis | Hmm, didn't realize that either. | 22:33 |
| *** e0ne has quit IRC | 22:35 | |
| *** felipemonteiro__ has joined #openstack-infra | 22:37 | |
| *** felipemonteiro_ has joined #openstack-infra | 22:39 | |
| *** quite has quit IRC | 22:39 | |
| *** rkukura_ has joined #openstack-infra | 22:39 | |
| *** slaweq has quit IRC | 22:40 | |
| *** ihrachys has quit IRC | 22:41 | |
| *** rkukura has quit IRC | 22:42 | |
| *** rkukura_ is now known as rkukura | 22:42 | |
| *** felipemonteiro__ has quit IRC | 22:42 | |
| fungi | "...and knowing's half the battle" | 22:43 |
| smcginnis | Go Joe! | 22:43 |
| *** sree has joined #openstack-infra | 22:44 | |
| *** quite has joined #openstack-infra | 22:45 | |
| *** sree has quit IRC | 22:48 | |
| *** dhajare|BRB has joined #openstack-infra | 22:55 | |
| *** davidlenwell has quit IRC | 22:58 | |
| *** betherly has quit IRC | 22:58 | |
| *** simondodsley has quit IRC | 22:59 | |
| *** chrisyang_0660 has quit IRC | 22:59 | |
| *** electrical has quit IRC | 22:59 | |
| *** Ng has quit IRC | 22:59 | |
| *** icey has quit IRC | 22:59 | |
| *** chrisyang_0660 has joined #openstack-infra | 22:59 | |
| *** felipemonteiro_ has quit IRC | 22:59 | |
| *** davidlenwell has joined #openstack-infra | 22:59 | |
| *** simondodsley has joined #openstack-infra | 22:59 | |
| *** betherly has joined #openstack-infra | 22:59 | |
| *** Ng has joined #openstack-infra | 22:59 | |
| *** icey has joined #openstack-infra | 22:59 | |
| *** electrical has joined #openstack-infra | 22:59 | |
| *** felipemonteiro_ has joined #openstack-infra | 22:59 | |
| *** tdasilva has quit IRC | 23:00 | |
| *** thingee has quit IRC | 23:00 | |
| *** dtroyer has quit IRC | 23:00 | |
| *** nibalizer has quit IRC | 23:00 | |
| *** StevenK has quit IRC | 23:01 | |
| *** fungi has quit IRC | 23:01 | |
| *** masayukig[m] has quit IRC | 23:01 | |
| *** StevenK has joined #openstack-infra | 23:02 | |
| *** thingee has joined #openstack-infra | 23:02 | |
| *** dtroyer has joined #openstack-infra | 23:03 | |
| *** tdasilva has joined #openstack-infra | 23:03 | |
| *** nibalizer has joined #openstack-infra | 23:03 | |
| *** fungi has joined #openstack-infra | 23:03 | |
| *** bandini has quit IRC | 23:04 | |
| *** masayukig[m] has joined #openstack-infra | 23:04 | |
| *** caphrim007_ has joined #openstack-infra | 23:05 | |
| *** bandini has joined #openstack-infra | 23:06 | |
| *** dhajare|BRB has quit IRC | 23:06 | |
| *** caphrim007 has quit IRC | 23:09 | |
| *** felipemonteiro_ has quit IRC | 23:24 | |
| *** edmondsw has joined #openstack-infra | 23:31 | |
| *** edmondsw has quit IRC | 23:35 | |
| *** pcrews has joined #openstack-infra | 23:38 | |
| *** markvoelker has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!