*** tosky has quit IRC | 00:21 | |
*** dklyle has quit IRC | 00:51 | |
*** jamesmcarthur has quit IRC | 01:26 | |
*** jamesmcarthur has joined #openstack-infra | 01:27 | |
*** jamesmcarthur has quit IRC | 01:35 | |
*** jamesmcarthur has joined #openstack-infra | 01:38 | |
*** ThePherm has quit IRC | 01:41 | |
*** armax has joined #openstack-infra | 01:48 | |
*** zzzeek has quit IRC | 01:53 | |
*** zzzeek has joined #openstack-infra | 01:54 | |
*** jamesmcarthur has quit IRC | 02:23 | |
*** jamesmcarthur has joined #openstack-infra | 02:45 | |
*** jamesmcarthur has quit IRC | 02:48 | |
*** jamesmcarthur has joined #openstack-infra | 02:52 | |
*** yamamoto has quit IRC | 03:30 | |
*** rcernin has joined #openstack-infra | 03:32 | |
*** jamesmcarthur has quit IRC | 03:37 | |
*** jamesmcarthur has joined #openstack-infra | 03:43 | |
*** yamamoto has joined #openstack-infra | 03:44 | |
*** yamamoto has quit IRC | 03:44 | |
*** jamesmcarthur has quit IRC | 04:06 | |
*** yamamoto has joined #openstack-infra | 04:23 | |
*** ociuhandu has joined #openstack-infra | 04:30 | |
*** ociuhandu has quit IRC | 04:34 | |
*** yamamoto has quit IRC | 04:34 | |
*** rcernin has quit IRC | 04:37 | |
*** rcernin has joined #openstack-infra | 04:42 | |
*** rcernin has quit IRC | 04:56 | |
*** jamesmcarthur has joined #openstack-infra | 05:06 | |
*** zzzeek has quit IRC | 05:10 | |
*** jamesmcarthur has quit IRC | 05:11 | |
*** rcernin has joined #openstack-infra | 05:11 | |
*** zzzeek has joined #openstack-infra | 05:11 | |
*** yamamoto has joined #openstack-infra | 05:13 | |
*** rcernin has quit IRC | 05:21 | |
*** yamamoto has quit IRC | 05:31 | |
*** yamamoto has joined #openstack-infra | 05:32 | |
*** jamesmcarthur has joined #openstack-infra | 06:13 | |
*** jamesmcarthur has quit IRC | 06:23 | |
*** rcernin has joined #openstack-infra | 07:35 | |
*** rcernin has quit IRC | 07:40 | |
*** yamamoto has quit IRC | 08:13 | |
*** jamesmcarthur has joined #openstack-infra | 08:23 | |
*** jamesmcarthur has quit IRC | 08:28 | |
*** yamamoto has joined #openstack-infra | 09:29 | |
*** yamamoto has quit IRC | 09:38 | |
*** yamamoto has joined #openstack-infra | 09:58 | |
*** slaweq has joined #openstack-infra | 10:00 | |
*** ociuhandu has joined #openstack-infra | 11:20 | |
*** ociuhandu has quit IRC | 11:25 | |
*** ociuhandu has joined #openstack-infra | 11:29 | |
*** ociuhandu has quit IRC | 11:29 | |
*** rcernin has joined #openstack-infra | 12:04 | |
*** yamamoto has quit IRC | 12:08 | |
*** rcernin has quit IRC | 12:16 | |
*** yamamoto has joined #openstack-infra | 12:39 | |
*** yamamoto has quit IRC | 13:01 | |
*** tosky has joined #openstack-infra | 13:06 | |
*** yamamoto has joined #openstack-infra | 13:33 | |
*** yamamoto has quit IRC | 13:42 | |
*** ociuhandu has joined #openstack-infra | 14:21 | |
*** tbachman has joined #openstack-infra | 14:49 | |
*** ociuhandu has quit IRC | 15:04 | |
*** ociuhandu has joined #openstack-infra | 15:05 | |
*** dave-mccowan has joined #openstack-infra | 15:09 | |
*** ociuhandu has quit IRC | 15:09 | |
*** yamamoto has joined #openstack-infra | 15:43 | |
*** yamamoto has quit IRC | 15:54 | |
*** mgoddard has quit IRC | 15:54 | |
*** mgoddard has joined #openstack-infra | 15:57 | |
*** tbachman has quit IRC | 16:00 | |
*** tbachman has joined #openstack-infra | 16:02 | |
*** tbachman_ has joined #openstack-infra | 16:11 | |
*** tbachman has quit IRC | 16:12 | |
*** tbachman_ is now known as tbachman | 16:12 | |
*** ociuhandu has joined #openstack-infra | 16:26 | |
*** ociuhandu has quit IRC | 16:54 | |
*** ociuhandu has joined #openstack-infra | 16:55 | |
*** ociuhandu has quit IRC | 16:59 | |
*** ociuhandu has joined #openstack-infra | 17:00 | |
*** ociuhandu has quit IRC | 17:05 | |
*** armax has quit IRC | 17:12 | |
*** ociuhandu has joined #openstack-infra | 17:26 | |
*** dave-mccowan has quit IRC | 17:29 | |
*** ociuhandu has quit IRC | 17:31 | |
*** dave-mccowan has joined #openstack-infra | 17:33 | |
*** jamesmcarthur has joined #openstack-infra | 17:33 | |
*** dave-mccowan has quit IRC | 17:41 | |
*** ociuhandu has joined #openstack-infra | 17:42 | |
*** lamt has joined #openstack-infra | 17:42 | |
*** yamamoto has joined #openstack-infra | 17:54 | |
*** yamamoto has quit IRC | 17:58 | |
*** ociuhandu has quit IRC | 18:00 | |
*** tbachman has quit IRC | 18:02 | |
*** ociuhandu has joined #openstack-infra | 18:41 | |
*** ociuhandu has quit IRC | 18:47 | |
*** tbachman has joined #openstack-infra | 18:51 | |
*** jamesmcarthur has quit IRC | 18:56 | |
*** jamesmcarthur has joined #openstack-infra | 18:57 | |
*** ociuhandu has joined #openstack-infra | 19:00 | |
*** ociuhandu has quit IRC | 19:04 | |
*** ociuhandu has joined #openstack-infra | 19:15 | |
*** systemb is now known as systelz | 19:18 | |
*** ociuhandu has quit IRC | 19:20 | |
*** ociuhandu has joined #openstack-infra | 19:31 | |
*** rcernin has joined #openstack-infra | 19:35 | |
*** ociuhandu has quit IRC | 19:36 | |
*** rcernin has quit IRC | 19:40 | |
*** tbachman has quit IRC | 19:43 | |
*** ianychoi has quit IRC | 19:57 | |
*** ianychoi_ has joined #openstack-infra | 19:57 | |
*** tbachman has joined #openstack-infra | 20:04 | |
*** jamesmcarthur has quit IRC | 20:09 | |
* tbachman is wondering if there’s anyone around over the weekend | 20:09 | |
*** jamesmcarthur has joined #openstack-infra | 20:10 | |
fungi | tbachman: just us chickens | 20:13 |
---|---|---|
tbachman | heh | 20:13 |
fungi | need something? | 20:13 |
tbachman | I’ve got a weird failure in the gate | 20:13 |
fungi | got a link? i'll take a peek | 20:14 |
tbachman | my guess is it’s because we’re running gate jobs that weren’t meant to be maintained this long | 20:14 |
tbachman | One example: | 20:14 |
tbachman | https://review.opendev.org/c/x/group-based-policy/+/771934 | 20:14 |
tbachman | We’re running a devstack job | 20:14 |
tbachman | The stable/ussuri branch passed | 20:14 |
*** jamesmcarthur has quit IRC | 20:14 | |
tbachman | (and still passes) | 20:14 |
tbachman | but from train down to queens, it fails | 20:14 |
tbachman | The failing part is this: | 20:15 |
tbachman | http://paste.openstack.org/show/801911/ | 20:15 |
tbachman | and it looks like devstack gets tnis from some bootstrap URL? | 20:15 |
tbachman | You can see the failure here: | 20:15 |
tbachman | https://e2584841c6c61715ceb2-9e6f5b8cef02b3be85110d0c85a744d6.ssl.cf1.rackcdn.com/771934/1/check/legacy-group-based-policy-dsvm-aim/fa265e8/job-output.txt | 20:15 |
tbachman | what’s interesting is that this same patch passed this step recently (I say “this step”, b/c the patch was already failing due to a different reason, which has since been fixed) | 20:16 |
tbachman | Here’s the output from when it got passed that same point: | 20:16 |
tbachman | https://46050a1a8fa787c1d655-839a87b8a49ad5b15d7c39aaacbfa49e.ssl.cf5.rackcdn.com/771934/1/check/legacy-group-based-policy-dsvm-aim/4294ee4/job-output.txt | 20:16 |
tbachman | I looked in the devstack history, and nothing jumped out at me here | 20:16 |
fungi | tbachman: i wonder if it's trying to use python 2.7, get-pip.py as of today no longer supports 2.7 | 20:16 |
tbachman | ah | 20:17 |
tbachman | I’m guessing we have a winner | 20:17 |
tbachman | but interestingly, I did see other devstack-ish jobs in neutron train pass, as recently as this a.m. | 20:17 |
fungi | get-pip.py isn't part of devstack, just something it downloads, provided by the pip maintainers | 20:17 |
tbachman | but maybe they’ve already changed their jobs to avoid this path | 20:17 |
tbachman | fungi: in any case, you’ve given me a strong lead | 20:18 |
fungi | i want to say train was where we cut over from 2.7 to 3.x, if you have an example of a passing build to compare against we should be able to tell | 20:18 |
tbachman | I’ll see what I can chase down from there | 20:18 |
tbachman | ah, sure | 20:18 |
tbachman | just a sec... | 20:18 |
*** zzzeek has quit IRC | 20:19 | |
tbachman | fungi: https://review.opendev.org/c/x/group-based-policy/+/772210 | 20:19 |
fungi | yoctozepto sent something to the openstack-discuss ml today about pip releasing a new version that dropped 2.7 support and updating get-pip.py accordingly | 20:20 |
fungi | so kudos to him, i wouldn't probably have noticed until tomorrow | 20:20 |
*** ociuhandu has joined #openstack-infra | 20:21 | |
tbachman | sorry - I should have given you the specific link: https://0e7e9b21e39c3c78839b-0110f1490f3bd69d1304fd56d8b32309.ssl.cf5.rackcdn.com/772210/1/check/legacy-group-based-policy-dsvm-aim/c0193fe/job-output.txt | 20:22 |
fungi | that's change was a ussuri example btw, not train | 20:22 |
*** zzzeek has joined #openstack-infra | 20:22 | |
fungi | but does have a combination of passing and failing jobs at least | 20:22 |
tbachman | oh - sorfy | 20:22 |
tbachman | I misunderstood - I thought you were looking for an example of the same job on a branch that passes | 20:23 |
tbachman | sorry | 20:23 |
tbachman | (despite branch differences) | 20:23 |
tbachman | Let me see if I can see that in a neutron job | 20:23 |
tbachman | (on train) | 20:23 |
fungi | "cp: target '/opt/stack/new/devstack/exercises/' is not a directory" | 20:24 |
fungi | maybe that's a secondary error | 20:24 |
tbachman | ah | 20:24 |
tbachman | that may be old | 20:24 |
tbachman | we did do some code changes to work around that one | 20:24 |
tbachman | maybe some of our scripts still reference it | 20:24 |
fungi | it sounded like you were saying your stable/train changes had some passing and failing devstack jobs, so i was trying to see what might differ | 20:25 |
fungi | i can probably just fiddle with the zuul builds tab to find examples for the same branch | 20:25 |
tbachman | This neutron job for stable/train referenxces get-pip | 20:26 |
tbachman | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9ee/772106/1/check/openstacksdk-functional-devstack-networking/9ee6332/job-output.txt | 20:26 |
fungi | https://zuul.opendev.org/t/openstack/builds?project=x%2Fgroup-based-policy&branch=stable%2Ftrain | 20:26 |
fungi | you're interested in jobs running for x/group-based-policy or openstack/neutron? | 20:27 |
tbachman | heh | 20:27 |
tbachman | I think you’re just faster than I am here :) | 20:27 |
tbachman | I thought you were looking for an example of a devstack job on stable/train (independent of project) that was using get-pip | 20:28 |
tbachman | My guess is that neutron is passing b/c it’s using python3 for its devstack | 20:28 |
tbachman | I think you gave me the main clue though | 20:28 |
tbachman | we should look to use python3 for our devstack job | 20:28 |
tbachman | in train and older branches | 20:28 |
tbachman | my guess is that will fix it | 20:28 |
tbachman | fungi: thanks! | 20:29 |
fungi | yw, i'm around-ish if you have more questions | 20:29 |
tbachman | I have to drop for a bit. If I need something, it can wait until tomorrow | 20:30 |
tbachman | thanks for making yourself available over the weekend, and for the help1 | 20:30 |
*** ociuhandu has quit IRC | 20:30 | |
*** ociuhandu has joined #openstack-infra | 20:30 | |
fungi | sure thing, happy to help | 20:30 |
*** ociuhandu has quit IRC | 20:30 | |
*** jamesmcarthur has joined #openstack-infra | 20:32 | |
*** ociuhandu has joined #openstack-infra | 20:32 | |
*** ociuhandu has quit IRC | 20:33 | |
*** ociuhandu has joined #openstack-infra | 20:33 | |
*** ociuhandu has quit IRC | 20:33 | |
*** ociuhandu has joined #openstack-infra | 20:34 | |
*** ociuhandu has quit IRC | 20:35 | |
*** tbachman has quit IRC | 20:35 | |
*** ociuhandu has joined #openstack-infra | 20:35 | |
*** jamesmcarthur has quit IRC | 20:37 | |
*** ociuhandu has quit IRC | 20:41 | |
*** rcernin has joined #openstack-infra | 20:44 | |
*** jamesmcarthur has joined #openstack-infra | 20:49 | |
*** armax has joined #openstack-infra | 20:52 | |
*** ociuhandu has joined #openstack-infra | 20:52 | |
*** ociuhandu has quit IRC | 21:00 | |
*** ociuhandu has joined #openstack-infra | 21:13 | |
*** ociuhandu has quit IRC | 21:39 | |
*** tbachman has joined #openstack-infra | 21:45 | |
tbachman | fungi: it looks like other upstream jobs are hitting it | 21:46 |
tbachman | https://c59132c83f9f43501a5a-0343763e072aec8a44b36b196f4e6ba5.ssl.cf5.rackcdn.com/772192/1/check/neutron-tempest-plugin-api-rocky/ff77d9b/job-output.txt | 21:46 |
*** rcernin has quit IRC | 21:58 | |
*** ociuhandu has joined #openstack-infra | 22:06 | |
fungi | i wouldn't be surprised, i think devstack tries to install latest pip, so it's going to no longer work with python 2.7 | 22:11 |
fungi | tbachman: may be worth bringing up in #openstack-qa to see start brainstorming how they might want to handle continued python 2.7 support in stable branches | 22:12 |
tbachman | fungi: k. I’ll jump on there | 22:13 |
tbachman | thanks! | 22:13 |
fungi | any time. i'm in there too, so happy to continue discussing where the qa team can see what we're talking about more easily | 22:13 |
*** yamamoto has joined #openstack-infra | 22:14 | |
*** ociuhandu has quit IRC | 22:14 | |
*** jamesmcarthur has quit IRC | 22:18 | |
*** jamesmcarthur has joined #openstack-infra | 22:33 | |
*** jamesmcarthur has quit IRC | 22:47 | |
*** tkajinam has joined #openstack-infra | 22:59 | |
*** jamesmcarthur has joined #openstack-infra | 23:01 | |
*** fresta has quit IRC | 23:03 | |
*** rcernin has joined #openstack-infra | 23:04 | |
*** fresta has joined #openstack-infra | 23:05 | |
*** ociuhandu has joined #openstack-infra | 23:14 | |
*** ociuhandu has quit IRC | 23:27 | |
*** dchen has joined #openstack-infra | 23:33 | |
*** dychen has joined #openstack-infra | 23:39 | |
*** dchen has quit IRC | 23:39 | |
*** tosky has quit IRC | 23:42 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!