Wednesday, 2021-06-02

*** diablo_rojo_phone has joined #openstack-infra00:00
*** rlandy_ has joined #openstack-infra00:18
*** rlandy has quit IRC00:23
*** seongsoocho has joined #openstack-infra00:30
*** zxiiro has quit IRC00:56
opendevreviewIan Wienand proposed openstack/project-config master: Add promote-irc-meetings-ical  https://review.opendev.org/c/openstack/project-config/+/79407501:30
*** timburke has quit IRC01:38
*** timburke has joined #openstack-infra01:54
*** ramishra has quit IRC02:02
opendevreviewMerged openstack/project-config master: Add promote-irc-meetings-ical  https://review.opendev.org/c/openstack/project-config/+/79407502:04
*** ramishra has joined #openstack-infra02:11
*** brtknr has quit IRC03:00
*** brtknr has joined #openstack-infra03:00
*** yamak16 has joined #openstack-infra03:33
opendevreviewIan Wienand proposed openstack/project-config master: Remove publish-irc-meetings job  https://review.opendev.org/c/openstack/project-config/+/79409103:46
*** ykarel|away has joined #openstack-infra03:51
*** ykarel|away is now known as ykarel04:04
*** abhishekk has joined #openstack-infra04:39
*** abhishekk has quit IRC04:41
*** abhishekk has joined #openstack-infra04:41
*** vishalmanchanda has joined #openstack-infra05:13
*** rlandy_ has quit IRC05:14
opendevreviewOpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml  https://review.opendev.org/c/openstack/project-config/+/79413606:08
*** bhagyashris has joined #openstack-infra06:16
*** timburke has quit IRC06:20
*** dklyle has quit IRC06:49
opendevreviewIan Wienand proposed openstack/project-config master: Disable limestone due to mirror issues  https://review.opendev.org/c/openstack/project-config/+/79414206:51
opendevreviewIan Wienand proposed openstack/project-config master: Revert "Disable limestone due to mirror issues"  https://review.opendev.org/c/openstack/project-config/+/79414306:51
opendevreviewMerged openstack/project-config master: Disable limestone due to mirror issues  https://review.opendev.org/c/openstack/project-config/+/79414207:12
*** andrewbonney has joined #openstack-infra07:19
*** bhagyashris has quit IRC07:23
*** bhagyashris has joined #openstack-infra07:23
*** abhishekk has quit IRC07:24
*** bhagyashris_ has joined #openstack-infra07:38
*** bhagyashris has quit IRC07:44
*** jpena|off is now known as jpena07:58
*** gfidente has joined #openstack-infra08:06
*** ykarel_ has joined #openstack-infra08:07
*** ykarel has quit IRC08:13
*** lucasagomes has joined #openstack-infra08:14
*** ykarel_ is now known as ykarel08:16
*** lucasagomes has quit IRC08:19
*** derekh has joined #openstack-infra08:21
*** lucasagomes has joined #openstack-infra08:26
*** lucasagomes has quit IRC08:27
*** ykarel is now known as ykarel|lunch08:38
*** ykarel_ has joined #openstack-infra08:47
*** ykarel|lunch has quit IRC08:47
*** lucasagomes has joined #openstack-infra08:56
*** ramishra has quit IRC08:56
*** lucasagomes has quit IRC08:58
*** mgoddard_ has joined #openstack-infra09:14
*** ykarel_ has quit IRC09:15
*** mgoddard_ is now known as mgoddard09:18
*** abhishekk has joined #openstack-infra09:19
opendevreviewMerged openstack/project-config master: Normalize projects.yaml  https://review.opendev.org/c/openstack/project-config/+/79413609:24
*** odyssey4me has joined #openstack-infra09:25
opendevreviewMatthias Runge proposed openstack/project-config master: Re-add publish jobs after panko deprecation  https://review.opendev.org/c/openstack/project-config/+/79389109:27
*** ramishra has joined #openstack-infra09:29
*** lucasagomes has joined #openstack-infra09:34
*** gfidente has quit IRC09:35
*** lucasagomes has quit IRC09:37
*** lucasagomes has joined #openstack-infra09:42
*** lucasagomes has quit IRC09:44
*** ykarel_ has joined #openstack-infra10:20
*** ykarel_ is now known as ykarel10:21
*** lucasagomes has joined #openstack-infra10:32
*** lucasagomes has quit IRC10:47
*** lucasagomes has joined #openstack-infra10:51
*** icey has quit IRC10:59
*** yamak16 has quit IRC11:08
*** soniya29 has joined #openstack-infra11:14
*** ramishra has quit IRC11:14
*** ramishra has joined #openstack-infra11:14
*** ramishra has quit IRC11:15
*** ramishra has joined #openstack-infra11:19
*** ramishra has quit IRC11:21
*** soniya29 has quit IRC11:21
*** ramishra has joined #openstack-infra11:21
*** soniya29 has joined #openstack-infra11:21
*** ramishra has quit IRC11:22
*** ramishra has joined #openstack-infra11:23
*** ramishra has quit IRC11:24
*** ramishra has joined #openstack-infra11:25
*** ramishra has quit IRC11:26
*** ramishra has joined #openstack-infra11:26
*** jpena is now known as jpena|lunch11:33
*** icey has joined #openstack-infra11:33
*** lucasagomes has quit IRC11:35
*** lucasagomes has joined #openstack-infra11:37
*** rlandy has joined #openstack-infra11:48
*** soniya29 has quit IRC11:50
*** lucasagomes has quit IRC11:55
*** lucasagomes has joined #openstack-infra12:01
*** bhagyashris_ is now known as bhagyashris12:09
*** abhishekk has quit IRC12:15
*** jpena|lunch is now known as jpena12:32
*** soniya29 has joined #openstack-infra13:04
*** ykarel has quit IRC13:30
*** ykarel has joined #openstack-infra13:30
*** abhishekk has joined #openstack-infra13:31
*** abhishekk is now known as akekane|home13:32
*** akekane|home is now known as abhishekk13:32
*** lucasagomes has quit IRC13:38
*** soniya29 has quit IRC13:43
*** ramishra has quit IRC13:46
*** ramishra has joined #openstack-infra13:46
*** lucasagomes has joined #openstack-infra13:48
*** tosky has joined #openstack-infra13:54
*** zbr has quit IRC13:55
*** zbr has joined #openstack-infra13:55
*** tdasilva_ has joined #openstack-infra14:09
*** tdasilva has quit IRC14:09
opendevreviewMerged openstack/project-config master: Remove x/gearman-plugin from infrastructure  https://review.opendev.org/c/openstack/project-config/+/79345914:17
*** zxiiro has joined #openstack-infra14:36
*** walshh__ has joined #openstack-infra14:36
*** walshh__ has quit IRC14:38
*** opendevreview has quit IRC14:38
*** walshh_ has joined #openstack-infra14:39
*** ykarel is now known as ykarel|away14:44
*** dklyle has joined #openstack-infra14:53
*** david-lyle has joined #openstack-infra14:57
*** dklyle has quit IRC14:57
*** david-lyle is now known as dklyle15:00
*** ykarel|away has quit IRC15:11
*** timburke has joined #openstack-infra15:32
*** david-lyle has joined #openstack-infra15:45
*** dklyle has quit IRC15:45
*** ykarel|away has joined #openstack-infra16:11
*** lucasagomes has quit IRC16:13
*** bhagyashris_ has joined #openstack-infra16:26
*** timburke has quit IRC16:32
*** david-lyle is now known as dklyle16:33
*** david-lyle has joined #openstack-infra16:33
*** bhagyashris has quit IRC16:34
*** ykarel|away has quit IRC16:36
*** tosky has quit IRC16:48
*** david-lyle has quit IRC16:48
*** bhagyashris_ is now known as bhagyashris16:50
*** thiago__ has joined #openstack-infra16:51
*** tdasilva_ has quit IRC16:57
*** jpena is now known as jpena|off17:03
*** ykarel|away has joined #openstack-infra17:04
*** derekh has quit IRC17:06
*** erbarr has joined #openstack-infra17:08
*** ykarel|away has quit IRC17:21
*** timburke has joined #openstack-infra17:24
*** abhishekk has quit IRC17:30
*** erlon has joined #openstack-infra17:44
*** andrewbonney has quit IRC17:49
*** dklyle has quit IRC17:49
*** dklyle has joined #openstack-infra17:49
*** vishalmanchanda has quit IRC19:13
*** tosky has joined #openstack-infra19:23
*** zxiiro has quit IRC20:23
dansmithfungi: clarkb: I've seen this a couple times now: https://zuul.opendev.org/t/openstack/build/260aae54067d4db2a28deac43abb706820:34
dansmithpresumably it's known?20:34
dansmithReadTimeoutError("HTTPSConnectionPool(host='opendev.org', port=443): Read timed out20:34
*** slaweq has quit IRC20:34
clarkbdansmith: one of the backends had trouble today. I'm not completely sure its better now but can check20:39
dansmithclarkb: okay these are from the last hour20:40
clarkblooks like the one that had trouble is happy now. But I can check to see the others and make sure there isn't another20:40
fungii'll take a look through the backends again, but the earlier event was around 18:20-18:5020:41
clarkbfungi: cool thanks20:41
clarkb08 looks fine to me right now fwiw20:41
fungidansmith: was the error from the last hour, or is that just when the builds completed?20:41
dansmithI surely think I started them after 18:50, but let me look20:41
clarkb2021-06-02 18:45:30.283092 is dansmiths example which lines up with your timeline20:42
dansmithokay yeah I guess they were running for longer than I thought, so maybe that's it20:42
dansmithI'll recheck everything and see, just didn't want to if they were going to just fail again20:42
fungishould hopefully be fine now, but i'm checking through cacti graphs for all the backends just to be sure there's nothing new going on20:43
dansmithcool, thanks20:44
fungidansmith: sorry, sidetracked a bit by dinner prep, but i don't see any more recent anomalies on our resource graphs for the git servers, so things should be operating normally at the moment20:52
dansmithack20:53
dansmithsomething must still be wrong, because one of the test jobs I just rechecked claims my code is broken20:53
fungiyeah, that doesn't sound right20:54
dansmithhaha20:54
fungiit's probably the test20:54
dansmithwell, I wrote the test :/20:54
fungizing!20:54
*** thiago__ is now known as tdasilva21:00
*** david-lyle has joined #openstack-infra21:18
*** dklyle has quit IRC21:18
melwittdoes anyone know how/when $TARGET_BRANCH gets set? I had thought that was a way to refer to the stable branch being checked out during a job but it was unset21:34
melwittis ZUUL_BRANCH the only way to express "stable branch I'm on"?21:35
clarkbmelwitt: I think we may need more context. is this in grenade?21:36
melwittyes it's grenade21:37
clarkbI think this changed when grenade was converted to zuul native21:38
melwittgrenade jobs on our stable branches install ceph using the devstack-plugin-ceph and we want to checkout the matching stable branch of it,21:39
melwittwe verified we can use ZUUL_BRANCH for that but wondered if there's a more proper way. I had thought TARGET_BRANCH would work but it didn't21:39
toskymelwitt: where exactly?21:39
melwitttosky: it's this, we're trying to fix our grenade job on stable/wallaby through stable/train https://review.opendev.org/c/openstack/nova/+/794000/3/gate/live_migration/hooks/ceph.sh#521:39
melwitttosky: PS1 used ZUUL_BRANCH which worked but we wondered if there was a better variable we could use. I suggested TARGET_BRANCH and it was unset and I didn't know it would/could be empty on a stable branch devstack deploy21:41
melwitter sorry, that's wrong, it's not devstack doing it. it's our script21:41
toskymelwitt: so the question is: why isn't zuul cloning the repository?21:41
melwitttosky: it's our legacy grenade job, it's doing the zuul thing on the master branch onward21:41
toskyoh21:42
toskyOOH21:42
toskyI guess it's too late for train, but I think you can (should :) backport the native job at least back to ussuri21:42
melwitthm, ok, I didn't know that could be possible21:43
toskyit should be even possible to have it on train21:43
toskyas the base code is there in grenade21:43
toskyyep, I've backported it back to train21:43
toskybut at least for W, V and U it's better to just backport all native jobs (not just the grenade one)21:44
toskyit avoids you going crazy with those issues :)21:44
melwittok, I will look and see if we can do that. thanks for the tip21:44
timburkesay, why don't we include a bindep role as part of the test-release-openstack job? if we're hoping to build wheels, it seems like there's a non-trivial chance we'll need to compile against some C library...21:58
timburkefor context, it's preventing pyeclib from being able to update its README to change IRC networks in https://review.opendev.org/c/openstack/pyeclib/+/79398521:58
clarkbtimburke: I think that may be the first openstack project that needs external deps for building releaess21:59
timburkei mean, it doesn't (or, hasn't?) published wheels... but i'm not sure how to avoid that part in the test-release-openstack job21:59
clarkbtimburke: you'd probably need to modify test-release-openstack to do an optional bindep install (and then toggle it on for pyeclib)22:01
fungitimburke: also if it needs an external c library, wheel publication gets a little more complicated. we'd need an environment capable of creating manylinux* compliant wheels because pypi doesn't allow publishing platform-specific linux wheels22:15
clarkbfungi: timburke: though luckily I think we've already solved that problem outside of openstack22:15
clarkb(the pyca wheel builds for arm64 need all this)22:15
fungioh, interesting. are we building them in a manylinux-compliant container or something?22:16
clarkbyes22:16
clarkbyou have to22:16
clarkb(otherwise you're reinventing a lot of owrk unnecessarily and it gets complicate fast)22:17
fungisure, i just didn't know if it was a container or a basic chroot or something else entirely22:21
clarkbfungi: ya pypa publishes them for you22:26
fungi*if* openstack wanted to start publishing binary linux wheels for some stuff, then yeah we'd need to redo the release jobs to work similarly22:27
dansmithfungi: clarkb: yeah rechecks didn't fail on timeouts, so I guess that was it22:37
*** opendevreview has joined #openstack-infra22:41
opendevreviewMerged openstack/project-config master: Revert "Disable limestone due to mirror issues"  https://review.opendev.org/c/openstack/project-config/+/79414322:41
fungidansmith: thanks for confirming!22:58
*** tosky has quit IRC23:25
*** zxiiro has joined #openstack-infra23:55

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!