| openstackgerrit | Merged openstack/diskimage-builder master: disable autounmask for emerge https://review.opendev.org/669422 | 00:25 |
|---|---|---|
| openstackgerrit | Merged openstack/diskimage-builder master: set default sources conf for buster as it now has a release https://review.opendev.org/668549 | 00:31 |
| openstackgerrit | Merged openstack/diskimage-builder master: ironic-agent: Use targetcli & python3-devel on rhel8 https://review.opendev.org/668687 | 00:31 |
| *** imacdonn has quit IRC | 01:15 | |
| *** imacdonn has joined #openstack-infra | 01:15 | |
| *** makey has quit IRC | 01:24 | |
| *** yamamoto has quit IRC | 01:49 | |
| *** apetrich has quit IRC | 01:57 | |
| *** yamamoto has joined #openstack-infra | 02:05 | |
| *** yamamoto has quit IRC | 02:05 | |
| *** yamamoto has joined #openstack-infra | 02:05 | |
| *** yamamoto has quit IRC | 02:09 | |
| *** kevinz has joined #openstack-infra | 02:17 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:22 | |
| *** yamamoto has joined #openstack-infra | 02:23 | |
| *** yamamoto has quit IRC | 02:23 | |
| *** factor has joined #openstack-infra | 02:51 | |
| *** kevinz has quit IRC | 02:58 | |
| *** zhurong has joined #openstack-infra | 03:00 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 03:04 | |
| *** bhavikdbavishi has quit IRC | 03:05 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:05 | |
| *** yamamoto has joined #openstack-infra | 03:10 | |
| *** ykarel|away has joined #openstack-infra | 03:18 | |
| *** whoami-rajat has joined #openstack-infra | 03:24 | |
| *** dchen has quit IRC | 03:24 | |
| *** psachin has joined #openstack-infra | 03:25 | |
| *** dchen has joined #openstack-infra | 03:27 | |
| openstackgerrit | Qiu Fossen proposed openstack/pbr master: Add Python 3 Train unit tests https://review.opendev.org/670752 | 03:31 |
| *** markvoelker has joined #openstack-infra | 03:37 | |
| *** bhavikdbavishi has quit IRC | 03:38 | |
| openstackgerrit | Qiu Fossen proposed openstack/ptgbot master: Add Python 3 Train unit tests https://review.opendev.org/670753 | 03:39 |
| *** ricolin has joined #openstack-infra | 03:43 | |
| *** yamamoto has quit IRC | 03:45 | |
| *** yamamoto has joined #openstack-infra | 03:46 | |
| *** yamamoto has quit IRC | 03:46 | |
| *** ricolin has quit IRC | 03:49 | |
| *** udesale has joined #openstack-infra | 03:49 | |
| *** dchen has quit IRC | 03:49 | |
| *** dchen has joined #openstack-infra | 03:50 | |
| *** ricolin has joined #openstack-infra | 03:50 | |
| *** dchen has quit IRC | 03:52 | |
| *** dchen has joined #openstack-infra | 03:55 | |
| *** yamamoto has joined #openstack-infra | 04:13 | |
| *** bhavikdbavishi has joined #openstack-infra | 04:15 | |
| *** Lucas_Gray has joined #openstack-infra | 04:33 | |
| *** dchen has quit IRC | 04:38 | |
| *** yamamoto has quit IRC | 04:43 | |
| *** Wryhder has joined #openstack-infra | 04:48 | |
| *** Lucas_Gray has quit IRC | 04:49 | |
| *** Wryhder is now known as Lucas_Gray | 04:49 | |
| *** yamamoto has joined #openstack-infra | 04:54 | |
| *** ykarel|away has quit IRC | 05:03 | |
| *** kopecmartin has joined #openstack-infra | 05:12 | |
| *** yamamoto has quit IRC | 05:12 | |
| *** kjackal has joined #openstack-infra | 05:14 | |
| *** ykarel|away has joined #openstack-infra | 05:18 | |
| *** raukadah is now known as chandankumar | 05:26 | |
| *** Lucas_Gray has quit IRC | 05:27 | |
| *** rcernin has quit IRC | 05:27 | |
| *** Lucas_Gray has joined #openstack-infra | 05:30 | |
| *** ykarel|away is now known as ykarel | 05:32 | |
| *** dchen has joined #openstack-infra | 05:41 | |
| *** Lucas_Gray has quit IRC | 05:44 | |
| *** AJaeger has quit IRC | 05:49 | |
| *** AJaeger has joined #openstack-infra | 05:53 | |
| *** kjackal has quit IRC | 05:55 | |
| *** iurygregory has joined #openstack-infra | 06:11 | |
| *** gtema_ has quit IRC | 06:20 | |
| *** piotrowskim has joined #openstack-infra | 06:28 | |
| *** kjackal has joined #openstack-infra | 06:29 | |
| *** dpawlik has joined #openstack-infra | 06:31 | |
| *** pcaruana has joined #openstack-infra | 06:36 | |
| *** pcaruana has quit IRC | 06:40 | |
| *** rcernin has joined #openstack-infra | 06:44 | |
| *** pgaxatte has joined #openstack-infra | 06:46 | |
| *** whoami-rajat has quit IRC | 06:50 | |
| *** geekinutah has quit IRC | 06:50 | |
| *** zbr has quit IRC | 06:50 | |
| *** crodriguez has quit IRC | 06:50 | |
| *** fungi has quit IRC | 06:50 | |
| *** odyssey4me has quit IRC | 06:50 | |
| *** ajo has quit IRC | 06:50 | |
| *** verdurin has quit IRC | 06:50 | |
| *** dtantsur|afk has quit IRC | 06:50 | |
| *** cmurphy has quit IRC | 06:50 | |
| *** ildikov has quit IRC | 06:50 | |
| *** persia has quit IRC | 06:50 | |
| *** MarkMaglana has quit IRC | 06:50 | |
| *** mugsie has quit IRC | 06:50 | |
| *** piotrowskim has quit IRC | 06:50 | |
| *** AJaeger has quit IRC | 06:50 | |
| *** niceplace_ has quit IRC | 06:50 | |
| *** melwitt has quit IRC | 06:50 | |
| *** yikun has quit IRC | 06:50 | |
| *** rajinir has quit IRC | 06:50 | |
| *** mpjetta has quit IRC | 06:50 | |
| *** dims has quit IRC | 06:50 | |
| *** jhesketh has quit IRC | 06:50 | |
| *** georgk has quit IRC | 06:50 | |
| *** yamamoto has joined #openstack-infra | 07:01 | |
| *** aluria has joined #openstack-infra | 07:04 | |
| *** ginopc has joined #openstack-infra | 07:07 | |
| *** xek has joined #openstack-infra | 07:08 | |
| *** gtema has joined #openstack-infra | 07:13 | |
| *** piotrowskim has joined #openstack-infra | 07:16 | |
| *** AJaeger has joined #openstack-infra | 07:16 | |
| *** dims has joined #openstack-infra | 07:16 | |
| *** melwitt has joined #openstack-infra | 07:16 | |
| *** niceplace_ has joined #openstack-infra | 07:16 | |
| *** yikun has joined #openstack-infra | 07:16 | |
| *** rajinir has joined #openstack-infra | 07:16 | |
| *** mpjetta has joined #openstack-infra | 07:16 | |
| *** jhesketh has joined #openstack-infra | 07:16 | |
| *** georgk has joined #openstack-infra | 07:16 | |
| *** tosky has joined #openstack-infra | 07:16 | |
| *** whoami-rajat has joined #openstack-infra | 07:16 | |
| *** geekinutah has joined #openstack-infra | 07:16 | |
| *** zbr has joined #openstack-infra | 07:16 | |
| *** crodriguez has joined #openstack-infra | 07:16 | |
| *** fungi has joined #openstack-infra | 07:16 | |
| *** odyssey4me has joined #openstack-infra | 07:16 | |
| *** ajo has joined #openstack-infra | 07:16 | |
| *** verdurin has joined #openstack-infra | 07:16 | |
| *** cmurphy has joined #openstack-infra | 07:16 | |
| *** ildikov has joined #openstack-infra | 07:16 | |
| *** persia has joined #openstack-infra | 07:16 | |
| *** MarkMaglana has joined #openstack-infra | 07:16 | |
| *** mugsie has joined #openstack-infra | 07:16 | |
| *** openstackgerrit has quit IRC | 07:18 | |
| *** rpittau|afk is now known as rpittau | 07:19 | |
| *** panda has quit IRC | 07:19 | |
| *** Ng has quit IRC | 07:19 | |
| *** Ng has joined #openstack-infra | 07:20 | |
| *** panda has joined #openstack-infra | 07:21 | |
| *** zerick_ has quit IRC | 07:21 | |
| *** jtomasek has joined #openstack-infra | 07:22 | |
| *** zerick has joined #openstack-infra | 07:23 | |
| *** ykarel is now known as ykarel|lunch | 07:24 | |
| *** slaweq has joined #openstack-infra | 07:25 | |
| *** witek has joined #openstack-infra | 07:26 | |
| *** aedc has joined #openstack-infra | 07:29 | |
| *** ccamacho has joined #openstack-infra | 07:38 | |
| *** ricolin_ has joined #openstack-infra | 07:39 | |
| *** ricolin has quit IRC | 07:42 | |
| *** yamamoto has quit IRC | 07:43 | |
| *** iurygregory has quit IRC | 07:43 | |
| *** lucasagomes has joined #openstack-infra | 07:49 | |
| *** kjackal has quit IRC | 07:58 | |
| *** kjackal has joined #openstack-infra | 07:58 | |
| *** pkopec has joined #openstack-infra | 07:59 | |
| *** lpetrut has joined #openstack-infra | 08:00 | |
| *** ykarel|lunch is now known as ykarel | 08:12 | |
| *** dchen has quit IRC | 08:19 | |
| *** yamamoto has joined #openstack-infra | 08:20 | |
| *** iurygregory has joined #openstack-infra | 08:21 | |
| *** adriancz has joined #openstack-infra | 08:23 | |
| *** piotrowskim has quit IRC | 08:26 | |
| *** AJaeger has quit IRC | 08:26 | |
| *** niceplace_ has quit IRC | 08:26 | |
| *** melwitt has quit IRC | 08:26 | |
| *** yikun has quit IRC | 08:26 | |
| *** rajinir has quit IRC | 08:26 | |
| *** mpjetta has quit IRC | 08:26 | |
| *** dims has quit IRC | 08:26 | |
| *** jhesketh has quit IRC | 08:26 | |
| *** georgk has quit IRC | 08:26 | |
| *** pkopec has quit IRC | 08:27 | |
| *** Ng has quit IRC | 08:27 | |
| *** whoami-rajat has quit IRC | 08:27 | |
| *** geekinutah has quit IRC | 08:27 | |
| *** zbr has quit IRC | 08:27 | |
| *** crodriguez has quit IRC | 08:27 | |
| *** fungi has quit IRC | 08:27 | |
| *** odyssey4me has quit IRC | 08:27 | |
| *** ajo has quit IRC | 08:27 | |
| *** verdurin has quit IRC | 08:27 | |
| *** cmurphy has quit IRC | 08:27 | |
| *** ildikov has quit IRC | 08:27 | |
| *** persia has quit IRC | 08:27 | |
| *** MarkMaglana has quit IRC | 08:27 | |
| *** mugsie has quit IRC | 08:27 | |
| *** yamamoto has quit IRC | 08:27 | |
| *** yamamoto has joined #openstack-infra | 08:28 | |
| *** panda has quit IRC | 08:29 | |
| *** panda has joined #openstack-infra | 08:31 | |
| *** persia has joined #openstack-infra | 08:35 | |
| *** MarkMaglana has joined #openstack-infra | 08:35 | |
| *** Ng has joined #openstack-infra | 08:35 | |
| *** whoami-rajat has joined #openstack-infra | 08:35 | |
| *** pkopec has joined #openstack-infra | 08:36 | |
| *** zbr has joined #openstack-infra | 08:36 | |
| *** ildikov has joined #openstack-infra | 08:36 | |
| *** ajo has joined #openstack-infra | 08:36 | |
| *** odyssey4me has joined #openstack-infra | 08:36 | |
| *** niceplace has joined #openstack-infra | 08:36 | |
| *** mpjetta has joined #openstack-infra | 08:36 | |
| *** fungi has joined #openstack-infra | 08:36 | |
| *** AJaeger has joined #openstack-infra | 08:36 | |
| *** melwitt has joined #openstack-infra | 08:36 | |
| *** georgk has joined #openstack-infra | 08:36 | |
| *** dtantsur has joined #openstack-infra | 08:37 | |
| *** yikun has joined #openstack-infra | 08:37 | |
| *** mugsie has joined #openstack-infra | 08:37 | |
| *** dims has joined #openstack-infra | 08:37 | |
| *** jhesketh has joined #openstack-infra | 08:37 | |
| *** piotrowskim has joined #openstack-infra | 08:41 | |
| *** e0ne has joined #openstack-infra | 08:45 | |
| *** snierodz has joined #openstack-infra | 08:48 | |
| *** davidsha has joined #openstack-infra | 08:52 | |
| *** yamamoto has quit IRC | 08:52 | |
| *** rcernin has quit IRC | 08:55 | |
| *** e0ne has quit IRC | 09:00 | |
| *** ralonsoh has joined #openstack-infra | 09:02 | |
| *** lpetrut has quit IRC | 09:10 | |
| *** e0ne has joined #openstack-infra | 09:12 | |
| *** e0ne has quit IRC | 09:25 | |
| *** yamamoto has joined #openstack-infra | 09:26 | |
| sshnaidm | is there easy way to see which jobs are defined for each project from zuul API? without parsing repo files | 09:29 |
| *** sshnaidm is now known as sshnaidm|rover | 09:29 | |
| *** snapiri has quit IRC | 09:31 | |
| *** gtema_ has joined #openstack-infra | 09:33 | |
| *** gtema has quit IRC | 09:35 | |
| *** yamamoto has quit IRC | 09:35 | |
| *** derekh has joined #openstack-infra | 09:38 | |
| *** gtema_ has quit IRC | 09:39 | |
| *** gtema has joined #openstack-infra | 09:40 | |
| *** ricolin_ has quit IRC | 09:47 | |
| *** sean-k-mooney has joined #openstack-infra | 09:47 | |
| *** gtema has quit IRC | 09:56 | |
| *** gtema has joined #openstack-infra | 09:56 | |
| *** gtema has quit IRC | 09:58 | |
| *** kjackal has quit IRC | 09:58 | |
| *** gtema has joined #openstack-infra | 09:58 | |
| *** kjackal has joined #openstack-infra | 09:58 | |
| *** gtema has quit IRC | 10:01 | |
| *** gtema has joined #openstack-infra | 10:02 | |
| *** rpittau has quit IRC | 10:03 | |
| *** yamamoto has joined #openstack-infra | 10:06 | |
| *** johnsom has quit IRC | 10:06 | |
| *** rpittau has joined #openstack-infra | 10:06 | |
| *** johnsom has joined #openstack-infra | 10:07 | |
| *** yamamoto has quit IRC | 10:19 | |
| *** odicha has joined #openstack-infra | 10:21 | |
| *** kjackal has quit IRC | 10:33 | |
| zbr | sshnaidm|rover: sadly zuul-client is in fact just an admin tool. | 10:34 |
| sshnaidm|rover | zbr, we have zuul web api | 10:35 |
| sshnaidm|rover | zbr, but seems like it doesn't contain such info.. | 10:35 |
| zbr | i will wait for the experts to answer, as I am interested too about the same feature | 10:36 |
| *** pkopec has quit IRC | 10:42 | |
| *** ginopc has quit IRC | 10:44 | |
| *** yamamoto has joined #openstack-infra | 10:46 | |
| *** yamamoto has quit IRC | 10:46 | |
| *** yamamoto has joined #openstack-infra | 10:48 | |
| *** yamamoto has quit IRC | 10:53 | |
| *** pkopec has joined #openstack-infra | 10:53 | |
| *** ijw has joined #openstack-infra | 11:06 | |
| *** dchen has joined #openstack-infra | 11:10 | |
| *** ijw has quit IRC | 11:11 | |
| icey | looks like openstackgerrit is offline? | 11:14 |
| icey | rahter, went offline and then never rejoined channels? | 11:14 |
| icey | s/rahter/rather | 11:14 |
| *** yamamoto has joined #openstack-infra | 11:19 | |
| *** tesseract has joined #openstack-infra | 11:20 | |
| *** rh-jelabarre has joined #openstack-infra | 11:25 | |
| *** pcaruana has joined #openstack-infra | 11:32 | |
| *** rosmaita has joined #openstack-infra | 11:33 | |
| *** psachin has quit IRC | 11:36 | |
| *** udesale has quit IRC | 11:39 | |
| *** udesale has joined #openstack-infra | 11:40 | |
| *** kjackal has joined #openstack-infra | 11:41 | |
| *** snapiri has joined #openstack-infra | 11:42 | |
| *** tesseract has quit IRC | 11:48 | |
| *** weshay|rover is now known as weshay | 11:51 | |
| *** tesseract has joined #openstack-infra | 11:51 | |
| *** gfidente has joined #openstack-infra | 11:59 | |
| *** needssleep is now known as TheJulia | 12:04 | |
| *** goldyfruit has quit IRC | 12:05 | |
| lennyb | Hi, what is the best way to mirror x/project to github after merge? | 12:07 |
| *** ykarel is now known as ykarel|afk | 12:18 | |
| mordred | zbr, sshnaidm|rover: there is a stack of patches related to this task | 12:18 |
| mordred | zbr, sshnaidm|rover: https://review.opendev.org/#/q/status:open+project:zuul/zuul+branch:master+topic:freeze_job once it's done and landed, there will be an api call to get the frozen job list (turns out the jobs for a project are a bit dynamic) - as well as a cli tool for running a zuul job locally like it would be run by zuul | 12:20 |
| *** kjackal has quit IRC | 12:20 | |
| sshnaidm|rover | mordred, oh, it's related to zuul-runner | 12:21 |
| mordred | yeah. it's a pre-req for zuul-runner - because zuul-runner also needs to be able to know that same answer :) | 12:21 |
| mordred | oh - actually | 12:21 |
| mordred | looks like we landed the freeze jobs api endpoint | 12:22 |
| *** ykarel|afk has quit IRC | 12:22 | |
| sshnaidm|rover | mordred, what is it then? | 12:23 |
| mordred | sshnaidm|rover: so - I amend my answer - yes, there is an API for that | 12:23 |
| *** kjackal has joined #openstack-infra | 12:23 | |
| mordred | sshnaidm|rover: /api/tenant/{tenant}/pipeline/{pipeline}/project/{project}/branch/{branch}/freeze-jobs | 12:23 |
| mordred | sshnaidm|rover: for instance: curl https://zuul.opendev.org/api/tenant/openstack/pipeline/gate/project/openstack/openstacksdk/branch/master/freeze-jobs | 12:24 |
| *** apetrich has joined #openstack-infra | 12:26 | |
| *** dchen has quit IRC | 12:27 | |
| *** ricolin_ has joined #openstack-infra | 12:30 | |
| *** ricolin__ has joined #openstack-infra | 12:31 | |
| *** ricolin_ has quit IRC | 12:35 | |
| *** yamamoto has quit IRC | 12:35 | |
| *** electrofelix has joined #openstack-infra | 12:36 | |
| sshnaidm|rover | mordred, works great, thanks! | 12:40 |
| *** noonedeadpunk has joined #openstack-infra | 12:40 | |
| noonedeadpunk | Hi everyone | 12:41 |
| mordred | sshnaidm|rover: woot! | 12:41 |
| noonedeadpunk | I've noticed several missed patches by openstackgerrit bot on #openstack-ansible channel | 12:42 |
| noonedeadpunk | Is everything ok with bot?:) | 12:42 |
| noonedeadpunk | infra-root ^ | 12:45 |
| *** jbadiapa has joined #openstack-infra | 12:46 | |
| *** ykarel|afk has joined #openstack-infra | 12:47 | |
| *** ykarel|afk is now known as ykarel | 12:47 | |
| *** kaiokmo has joined #openstack-infra | 12:52 | |
| *** electrofelix has quit IRC | 12:56 | |
| *** yamamoto has joined #openstack-infra | 12:57 | |
| *** yamamoto has quit IRC | 12:57 | |
| *** lpetrut has joined #openstack-infra | 12:58 | |
| *** ekultails has joined #openstack-infra | 12:58 | |
| *** Lucas_Gray has joined #openstack-infra | 13:01 | |
| fungi | icey: noonedeadpunk: yes, looks like there was some freenode disruption between 06:50z and 07:19z (netsplits, rejoins...) and then the bot timed out. i've restarted it now so it should resume normal operation and join channels when it has something to announce in them | 13:07 |
| icey | thanks fungi | 13:07 |
| noonedeadpunk | thanks:) | 13:07 |
| fungi | #status log restarted gerritbot after freenode disruption/disconnect at 06:50-07:19 | 13:07 |
| openstackstatus | fungi: finished logging | 13:07 |
| fungi | lennyb: if a project in the "x" namespace on opendev.org wishes to replicate to github.com, we can help transfer the repository to whatever new gh org you want it controlled by. then it's just a matter of adding a zuul job with credentials to push to that repository | 13:20 |
| *** ginopc has joined #openstack-infra | 13:21 | |
| fungi | (that is, we can help transfer it from the openstack org on gh to whatever new gh org you want it controlled by) | 13:22 |
| mordred | oh - speaking of - maybe it's time to write that script to retire infra repos | 13:23 |
| *** openstackgerrit has joined #openstack-infra | 13:28 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: WIP: Route streams to different zones via finger gateway https://review.opendev.org/664965 | 13:28 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Support ssl encrypted fingergw https://review.opendev.org/664950 | 13:28 |
| *** ginopc has quit IRC | 13:28 | |
| *** electrofelix has joined #openstack-infra | 13:33 | |
| *** betherly has joined #openstack-infra | 13:35 | |
| *** witek has quit IRC | 13:36 | |
| *** aaronsheffield has joined #openstack-infra | 13:37 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: WIP: Route streams to different zones via finger gateway https://review.opendev.org/664965 | 13:37 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Support ssl encrypted fingergw https://review.opendev.org/664950 | 13:37 |
| *** betherly has quit IRC | 13:40 | |
| *** eharney has joined #openstack-infra | 13:45 | |
| *** jeremy_houser has joined #openstack-infra | 13:50 | |
| *** michael-beaver has joined #openstack-infra | 13:52 | |
| snierodz | Hey, our functional tests are currently failing due to the Depends-On link not being recognised. (tox-sibling issue) | 13:58 |
| snierodz | Link: https://review.opendev.org/#/c/636336/ | 13:58 |
| snierodz | I was wondering if anyone would have any tips for updating the zuul.yaml file or the Depends-On link to update the gate? | 13:59 |
| AJaeger | lennyb: this is documented now in the infra-manual, see https://docs.openstack.org/infra/manual/creators.html#mirroring-projects-to-git-mirrors | 13:59 |
| AJaeger | fungi, mordred, clarkb, could you review a few open infra-manual changes, please? https://review.opendev.org/668049 https://review.opendev.org/667802 https://review.opendev.org/665387 | 14:01 |
| *** goldyfruit has joined #openstack-infra | 14:01 | |
| AJaeger | snierodz: what do you mean with not being recognized? | 14:03 |
| *** rkukura has joined #openstack-infra | 14:05 | |
| *** rkukura has quit IRC | 14:05 | |
| snierodz | AJaeger: Some of the files were migrated to an openstack/neutron patch (currently in reviews). The error that's displayed is due to the lack of those migrated files in neutron classifier. | 14:05 |
| snierodz | AJaeger: To overcome this problem on my local environment I run 'source .tox/functional/bin/activate' and then 'pip install -e /opt/stack/neutron' and deactivate. Then the required 29 tox tests run properly and the actual errors come up. | 14:06 |
| snierodz | AJaeger: Not too sure how to resolve the issue online though. | 14:07 |
| *** gtema has quit IRC | 14:12 | |
| fungi | snierodz: have a link to the specific job where you don't see those changes getting incorporated? does the job install those dependencies from pypi? if so, you need a different job to use unreleased dependencies from source (and that's a general development workflow decision, whether you want your project testing exclusively against unreleased dependencies, at risk of releasing unusable source code | 14:12 |
| fungi | if you tag without confirming all the dependency features it needs are already also released) | 14:12 |
| snierodz | fungi: This is the exact link: http://logs.openstack.org/36/636336/30/check/neutron-classifier-functional-dsvm/06322b0/job-output.txt.gz#_2019-07-15_11_14_03_093950 | 14:15 |
| AJaeger | snierodz: so, neutron-classifier-functional-dsvm is NOT a tox job and tox-sibling is not used at all. STill check the job definition, does it have "Required-projects: openstack/neutron" and does it isntall from source? | 14:16 |
| AJaeger | snierodz: http://logs.openstack.org/36/636336/30/check/neutron-classifier-functional-dsvm/06322b0/job-output.txt.gz#_2019-07-15_11_01_23_599516 shows what it checked out for you, is that correct? | 14:18 |
| *** rkukura has joined #openstack-infra | 14:18 | |
| snierodz | AJaeger: Yeah that looks like the right patch number of the right commit. I am including openstack/neutron as the required project: https://review.opendev.org/#/c/636336/30/.zuul.yaml Am I missing something else? | 14:21 |
| AJaeger | snierodz: So, then the question becomes whether you install from source or via pypi? Sorry, no time to help further right now - time for another meeting... | 14:22 |
| *** eernst has joined #openstack-infra | 14:23 | |
| snierodz | AJaeger: No worries, thanks for the help! I'll look into whether source/pypi is being used | 14:24 |
| fungi | looking at http://logs.openstack.org/36/636336/30/check/neutron-classifier-functional-dsvm/06322b0/logs/pip2-freeze.txt.gz neutron isn't installed into the system python path, so my guess is this is happening in a virtualenv somewhere | 14:25 |
| *** goldyfruit has quit IRC | 14:26 | |
| fungi | here we go: http://logs.openstack.org/36/636336/30/check/neutron-classifier-functional-dsvm/06322b0/job-output.txt.gz#_2019-07-15_11_12_21_538535 | 14:27 |
| *** tesseract has quit IRC | 14:28 | |
| openstackgerrit | Slawek Kaplonski proposed ttygroup/gertty master: Update information about config file location https://review.opendev.org/655338 | 14:28 |
| *** dpawlik has quit IRC | 14:29 | |
| openstackgerrit | Merged openstack/infra-manual master: Update .gitreview wording in retire process https://review.opendev.org/668049 | 14:29 |
| openstackgerrit | Merged openstack/infra-manual master: Fix the link to the openSUSE's git-review package https://review.opendev.org/667802 | 14:29 |
| fungi | snierodz: and here's what it installed... http://logs.openstack.org/36/636336/30/check/neutron-classifier-functional-dsvm/06322b0/job-output.txt.gz#_2019-07-15_11_14_03_081377 | 14:29 |
| fungi | so it did install neutron-classifier from source correctly (-e /opt/stack/new/neutron-classifier) | 14:30 |
| *** tesseract has joined #openstack-infra | 14:30 | |
| fungi | but it installed neutron and neutron-lib releases from pypi because that's what pip normally does if not told otherwise | 14:30 |
| snierodz | fungi: should the change for the venv be made in the tox.ini file then? | 14:30 |
| fungi | snierodz: it looks like neutron/tools/configure_for_func_testing.sh may need to be updated, not sure | 14:31 |
| fungi | i don't know how much of what this job does is reused from neutron's functional testing tools, but it looks like it may be hard to update those to work with depends-on. probably need to get some of the folks who focus on neutron's ci jobs to weigh in on what your options are | 14:33 |
| fungi | is neutron-classifier normally developed against unreleased versions of neutron and neutron-lib? | 14:33 |
| fungi | like, do you have measures in place to avoid releasing with change 636336 merged until neutron is released with 636333 and neutron-lib with 636330? | 14:34 |
| clarkb | Looks like ianw got a dib release out and we rebuilt fedora-28 successfully and that has been uploaded to fn | 14:36 |
| clarkb | I think that concludes the saga of fixing build related problems we discovered in fn | 14:37 |
| snierodz | fungi: not really, there is a different neutron classifier patch made to restructure the repository to be included in neutron: https://review.opendev.org/#/c/670050/ so the structure might change. | 14:37 |
| *** dklyle has joined #openstack-infra | 14:38 | |
| AJaeger | snierodz: rewrite the job as Zuul v3 native job ;) | 14:38 |
| fungi | the neutron functest framework is ancient crufty stuff which has been cargo-culted around for years, and defeats much of zuul's flexibility | 14:39 |
| fungi | and yes, if it could be reworked to use the current devstack ansible playbooks and zuul-jobs tox role, then this would probably just work | 14:40 |
| *** irclogbot_3 has quit IRC | 14:40 | |
| snierodz | AJaeger: I've seen other people doing so alright - such as the networking-sfc commit by Bernard: https://opendev.org/openstack/networking-sfc/commit/2c500c9061ff980c565ed3473a128215a2da916c | 14:41 |
| snierodz | AJaeger: I don't think our repository has tempest tests though - is there another Zuul3 sample file I could base mine off of? | 14:41 |
| clarkb | as another quick sanity check the couple recent fn failure I've looekd at are not timeouts | 14:42 |
| *** mnencia has quit IRC | 14:43 | |
| fungi | snierodz: i don't know of any good examples of neutron functional tests being redone as zuul native jobs, but maybe folks in #openstack-neutron or #openstack-qa can suggest some | 14:43 |
| clarkb | looks like normal failures and the success:failure ratio appears in line with the 30% fail rate number my scan gerrit script spat out | 14:43 |
| clarkb | so that looks good overall for now | 14:43 |
| *** mnencia has joined #openstack-infra | 14:43 | |
| clarkb | fungi: and I guess we had to turn off limestone again because we tripped whatever that network issue is? | 14:43 |
| *** gtema has joined #openstack-infra | 14:44 | |
| fungi | clarkb: i don't think it's the same issue this time. there were no gaps in snmp polling for the mirror there | 14:44 |
| *** rkukura_ has joined #openstack-infra | 14:44 | |
| fungi | logan- mentioned something about timeouts, but it was the weekend and i didn't ask for details | 14:44 |
| clarkb | ah | 14:45 |
| logan- | i disabled the host aggregate, its still enabled in nodepool afaik. cacti shows no connectivity issue to mirror but the job log I saw showed a failed ssh connection between two nodes in a multinode job | 14:45 |
| *** rkukura_ has quit IRC | 14:45 | |
| snierodz | fungi: Thanks fungi Ill ask the openstack neutron folks | 14:45 |
| snierodz | fungi: And thanks for all the help! :) | 14:45 |
| logan- | need to pull hostids from that job and look into that today | 14:45 |
| fungi | logan-: ahh, so it *could* be the same problem but only impacting part of the cluster and this time the mirror instance was spared? | 14:46 |
| *** rkukura has quit IRC | 14:47 | |
| logan- | tough to say. l2pop has been iffy at times in the past. for intermittent intra-cluster connectivity that could be a culprit | 14:48 |
| *** ericyoung has quit IRC | 14:49 | |
| *** ericyoung has joined #openstack-infra | 14:49 | |
| *** irclogbot_2 has joined #openstack-infra | 14:50 | |
| *** eernst has quit IRC | 14:53 | |
| *** betherly has joined #openstack-infra | 14:55 | |
| AJaeger | thanks fungi for the infra-manual reviews | 14:57 |
| AJaeger | clarkb: could you review fungi's infra-manual change, please? https://review.opendev.org/#/c/665387 | 14:58 |
| openstackgerrit | Jeremy Stanley proposed zuul/zuul master: Correct git-review install in CentOS 7 quick-start https://review.opendev.org/670736 | 14:59 |
| *** yamamoto has joined #openstack-infra | 14:59 | |
| clarkb | AJaeger: done | 14:59 |
| AJaeger | thanks! | 14:59 |
| *** beekneemech is now known as bnemec | 15:01 | |
| *** ginopc has joined #openstack-infra | 15:01 | |
| *** josephrsandoval has joined #openstack-infra | 15:02 | |
| *** tesseract has quit IRC | 15:02 | |
| *** tesseract has joined #openstack-infra | 15:03 | |
| *** rkukura has joined #openstack-infra | 15:05 | |
| openstackgerrit | James E. Blair proposed openstack/diskimage-builder master: Add a nodepool job based on releases https://review.opendev.org/670859 | 15:06 |
| openstackgerrit | James E. Blair proposed opendev/glean master: Add a nodepool job based on releases https://review.opendev.org/670860 | 15:07 |
| openstackgerrit | Merged openstack/infra-manual master: Clarify need for two Zuul changes during creation https://review.opendev.org/665387 | 15:07 |
| *** yamamoto has quit IRC | 15:07 | |
| *** ricolin__ has quit IRC | 15:11 | |
| *** ricolin_ has joined #openstack-infra | 15:11 | |
| *** odicha has quit IRC | 15:12 | |
| *** verdurin has joined #openstack-infra | 15:14 | |
| *** chandankumar is now known as raukadah | 15:14 | |
| donnyd | clarkb: those failures were related to a hypervisor not functioning correctly | 15:16 |
| clarkb | donnyd: the read only fs problems from friday? | 15:16 |
| clarkb | donnyd: fwiw things look pretty good this morning after skimming logstash results | 15:17 |
| donnyd | Yea, those were from swapping out my backbone switch to 40G for everything | 15:17 |
| donnyd | I thought I had shut that instance down, but apparently I did not | 15:17 |
| clarkb | donnyd: as noted earlier (not sure you saw) fedora-28 should be happy now too | 15:18 |
| donnyd | The network changes to support this workload are finally completed. Installed new batteries in the UPS, so those issues should be sorted too | 15:18 |
| donnyd | It looks like its working to me as well | 15:18 |
| donnyd | Now for the noisy neighbor issue, its looks to me like CPU's can be overcommited.. but not by much | 15:19 |
| *** goldyfruit has joined #openstack-infra | 15:19 | |
| donnyd | I am running at 2.5:1 ATM so CPU uitl on the hypervisors sits about where it should 70-80% | 15:19 |
| donnyd | But the storage issue is still going to be a bottle neck till my nvme array comes today. | 15:20 |
| donnyd | Also I still have something weird going on with neutron | 15:20 |
| *** gtema has left #openstack-infra | 15:20 | |
| donnyd | I get random timeouts. Not sure if its a bad container, or something else is busted | 15:21 |
| donnyd | I am also working on a higher performance controller, so that stuff stops happening | 15:21 |
| donnyd | So there is still more tuning to be done here to get the cycle times down to as low as possible | 15:22 |
| donnyd | but I am much closer today than I was last week, and things seem to be quite a bit more stable | 15:22 |
| clarkb | yup things look quite good this morning (under admittedly low weekend load) | 15:23 |
| donnyd | So here is another interesting tidbit of info. I have been closely watching power and heat loads because I care greatly about them | 15:24 |
| donnyd | https://usercontent.irccloud-cdn.com/file/9rIvPgvu/image.png | 15:24 |
| donnyd | 50 instances are currently in use and 3 hypervisors are turned on... The power workload seems to only fluctuate a few hundred watts or so. Also the heat doesn't seem to change but +/- 1C | 15:25 |
| donnyd | So I thought it was interesting because over the weekend with no load.. that input power metric was around 2100W... so 200 watts for 50% load | 15:26 |
| donnyd | Not nearly what I thought would happen | 15:26 |
| clarkb | that seems good? less than a single gaming desktop? | 15:26 |
| clarkb | delta not total | 15:27 |
| *** igordc has joined #openstack-infra | 15:27 | |
| donnyd | Right.. you would think that idle and loaded would yield significant differences | 15:28 |
| *** Nick_A has joined #openstack-infra | 15:28 | |
| donnyd | So the next step is to sort out storage performance, so there will likley be some times this week where there are less resources | 15:29 |
| donnyd | but I should be able to cycle through them without much impact to workload | 15:29 |
| donnyd | I am trying to decide if I should break off dedicated NVME's for each hypervisor, or put them all in one big BA pool | 15:30 |
| *** Nick_A has left #openstack-infra | 15:31 | |
| *** gyee has joined #openstack-infra | 15:31 | |
| donnyd | The nerd in me wants to put them all in one array just to see what it does.. but then I worry I will be bottlenecked at some other process | 15:31 |
| openstackgerrit | Graham Hayes proposed zuul/nodepool master: Implement an Azure driver https://review.opendev.org/554432 | 15:32 |
| openstackgerrit | Merged zuul/zuul master: Build layout of non-live items with config updates https://review.opendev.org/670335 | 15:33 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add "supercedes" pipeline option https://review.opendev.org/670670 | 15:34 |
| donnyd | clarkb: this has been a great learning experience for me (mostly in what not to do). Optimizing for CI seems to lead down quite a different path from general purpose cloud | 15:35 |
| *** lpetrut has quit IRC | 15:36 | |
| clarkb | great. We like to think we can provide useful feedback to our donor clouds whetehr that is optomizing the tooling or acting as an early warning system or even debugging things (because we use openstack a bit) | 15:36 |
| openstackgerrit | Jeff Liu proposed zuul/zuul-operator master: [WIP] Verify Operator Pod Running https://review.opendev.org/670395 | 15:41 |
| *** cmurphy has joined #openstack-infra | 15:43 | |
| *** iurygregory has quit IRC | 15:45 | |
| *** pgaxatte has quit IRC | 15:50 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-base-jobs master: Add linter/docs jobs https://review.opendev.org/670872 | 15:52 |
| *** ykarel is now known as ykarel|away | 15:52 | |
| *** jamesmcarthur has joined #openstack-infra | 15:54 | |
| openstackgerrit | Merged zuul/zuul-base-jobs master: Add linter/docs jobs https://review.opendev.org/670872 | 15:57 |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: WIP test https://review.opendev.org/670873 | 15:57 |
| openstackgerrit | James E. Blair proposed zuul/zuul-base-jobs master: WIP: test https://review.opendev.org/670874 | 15:58 |
| *** josephrsandoval has quit IRC | 16:00 | |
| openstackgerrit | Merged openstack/pbr master: Resolve some issue with tox.ini, setup.cfg https://review.opendev.org/660297 | 16:00 |
| *** diablo_rojo has joined #openstack-infra | 16:00 | |
| *** ginopc has quit IRC | 16:01 | |
| corvus | clarkb, fungi: i suspect we just got another report in #zuul from a review.opendev.org user who did not see a giant error message from zuul because of hideci | 16:03 |
| corvus | may we please turn that off? | 16:04 |
| clarkb | happy to. I thought the change was in review and needed updates? | 16:04 |
| fungi | it needs me to figure out how to separate out how to hide all but the most recent comment (solving jhesketh's concern) and also to split up the rules used to build the results table from the rules used to filter the comments | 16:06 |
| fungi | sorry | 16:06 |
| corvus | https://review.opendev.org/655783 there it is | 16:06 |
| clarkb | maybe a shorter term solution is to default to it off rather than on? | 16:07 |
| corvus | is there something we can do quickly? | 16:07 |
| clarkb | then people can still turn it off if they want to but by default you get all the comments/ | 16:07 |
| fungi | it seemed very simple when i started, but that raised concerns about fairness and terminology and... | 16:07 |
| corvus | i have no concerns about fairness or terminology | 16:07 |
| corvus | i think clarkb's concern that the patch doesn't do what we think it does is spot on | 16:08 |
| fungi | i think i can work out how to use separate filter lists for the comments and results table easily, which will take care of clarkb's concern | 16:08 |
| clarkb | ya two different regex vars may do the trick there | 16:09 |
| clarkb | and I think with that update and renaming the button we should be good to go? | 16:09 |
| fungi | solving jhesketh's concerns about hiding earlier zuul comments and working out what we want to rename the button to may be more than i have time for | 16:09 |
| fungi | i'll give the regex split a go now | 16:09 |
| corvus | thanks! | 16:10 |
| clarkb | "Collapse Third Party CI Results" is probaby too wordy | 16:10 |
| clarkb | maybe hide ci is close enough and simple | 16:10 |
| fungi | "hide most ci" ;) | 16:10 |
| *** ijw has joined #openstack-infra | 16:11 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-base-jobs master: Add gate jobs https://review.opendev.org/670874 | 16:12 |
| *** kopecmartin is now known as kopecmartin|off | 16:13 | |
| openstackgerrit | Merged zuul/zuul-base-jobs master: Add gate jobs https://review.opendev.org/670874 | 16:14 |
| *** Lucas_Gray has quit IRC | 16:17 | |
| openstackgerrit | Jeremy Stanley proposed opendev/system-config master: Don't hide Zuul CI comments https://review.opendev.org/655783 | 16:20 |
| fungi | clarkb: corvus: jhesketh: ^ how about that? | 16:21 |
| fungi | if desired, i can make a new regex and use that instead for efficiency, if there are concerns | 16:22 |
| *** ijw_ has joined #openstack-infra | 16:25 | |
| openstackgerrit | Merged zuul/zuul-base-jobs master: Use opendev.org as git location https://review.opendev.org/667813 | 16:26 |
| *** lucasagomes has quit IRC | 16:28 | |
| openstackgerrit | Merged zuul/zuul master: Logging of reconfiguration durations in Zuul https://review.opendev.org/670773 | 16:28 |
| *** ijw_ has quit IRC | 16:29 | |
| *** ijw has quit IRC | 16:29 | |
| *** rpittau is now known as rpittau|afk | 16:30 | |
| openstackgerrit | Jeff Liu proposed zuul/zuul-operator master: [WIP] Verify Operator Pod Running https://review.opendev.org/670395 | 16:33 |
| openstackgerrit | Mark Goddard proposed openstack/project-config master: Add review priority for kayobe repos https://review.opendev.org/670778 | 16:36 |
| openstackgerrit | Jeremy Stanley proposed zuul/zuul master: Correct git-review install in CentOS 7 quick-start https://review.opendev.org/670736 | 16:38 |
| *** mattw4 has joined #openstack-infra | 16:42 | |
| openstackgerrit | Merged zuul/zuul master: Annotate canMerge check with event id https://review.opendev.org/670494 | 16:42 |
| *** ricolin_ has quit IRC | 16:50 | |
| *** davidsha has quit IRC | 16:51 | |
| *** rascasoft has quit IRC | 16:51 | |
| *** rascasoft has joined #openstack-infra | 16:51 | |
| *** josephrsandoval has joined #openstack-infra | 16:55 | |
| *** dtantsur is now known as dtantsur|afk | 16:55 | |
| *** udesale has quit IRC | 16:56 | |
| *** josephrsandoval has quit IRC | 17:00 | |
| *** AJaeger_ has joined #openstack-infra | 17:00 | |
| *** mattw4 has quit IRC | 17:02 | |
| *** josephrsandoval has joined #openstack-infra | 17:02 | |
| *** AJaeger has quit IRC | 17:03 | |
| *** derekh has quit IRC | 17:03 | |
| *** lpetrut has joined #openstack-infra | 17:03 | |
| *** igordc has quit IRC | 17:07 | |
| *** auristor has quit IRC | 17:09 | |
| *** e0ne has joined #openstack-infra | 17:12 | |
| openstackgerrit | Corey Bryant proposed openstack/os-testr master: Add Python 3 Train unit tests https://review.opendev.org/670636 | 17:12 |
| *** tosky has quit IRC | 17:13 | |
| *** tosky has joined #openstack-infra | 17:13 | |
| openstackgerrit | Corey Bryant proposed openstack/hacking master: Add Python 3 Train unit tests https://review.opendev.org/670632 | 17:18 |
| *** mattw4 has joined #openstack-infra | 17:19 | |
| *** ralonsoh has quit IRC | 17:22 | |
| *** auristor has joined #openstack-infra | 17:24 | |
| *** altlogbot_2 has quit IRC | 17:25 | |
| *** AJaeger_ is now known as AJaeger | 17:25 | |
| *** irclogbot_2 has quit IRC | 17:26 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Run cleanup playbooks in job thread https://review.opendev.org/670888 | 17:27 |
| *** josephrsandoval has quit IRC | 17:28 | |
| *** irclogbot_2 has joined #openstack-infra | 17:28 | |
| *** altlogbot_0 has joined #openstack-infra | 17:29 | |
| *** auristor has quit IRC | 17:29 | |
| *** altlogbot_0 has quit IRC | 17:31 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Run cleanup playbooks in job thread https://review.opendev.org/670888 | 17:31 |
| *** josephrsandoval has joined #openstack-infra | 17:31 | |
| *** irclogbot_2 has quit IRC | 17:32 | |
| *** lpetrut has quit IRC | 17:33 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Run cleanup playbooks in job thread https://review.opendev.org/670888 | 17:33 |
| *** gfidente has quit IRC | 17:34 | |
| *** auristor has joined #openstack-infra | 17:35 | |
| *** irclogbot_3 has joined #openstack-infra | 17:38 | |
| *** altlogbot_3 has joined #openstack-infra | 17:40 | |
| *** dpawlik has joined #openstack-infra | 17:41 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add a nodepool job based on releases https://review.opendev.org/670859 | 17:42 |
| openstackgerrit | Merged opendev/glean master: Add a nodepool job based on releases https://review.opendev.org/670860 | 17:42 |
| *** tesseract has quit IRC | 17:45 | |
| *** weifan has joined #openstack-infra | 17:49 | |
| openstackgerrit | Merged zuul/zuul master: Handle existing broken config in job updates https://review.opendev.org/670666 | 17:49 |
| gouthamr | hi folks, i've a gerrit patch that won't load - I can find it via search: https://review.opendev.org/#/q/status:merged+project:openstack/manila+branch:stable/queens+topic:bindep-fallback-stable/queens | 17:51 |
| *** dpawlik has quit IRC | 17:52 | |
| gouthamr | but clicking on the patch gives me this error: "The page you requested was not found, or you do not have permission to view this page." | 17:52 |
| *** dpawlik has joined #openstack-infra | 17:52 | |
| *** ijw has joined #openstack-infra | 17:53 | |
| gouthamr | on console, i see these errors: | 17:54 |
| gouthamr | Failed to load resource: the server responded with a status of 404 (Not Found): https://review.opendev.org/changes/667721/revisions/148e4730063a5807e215d497a531b2da65225e68/commit?links | 17:54 |
| gouthamr | this is the error message from the server: Multiple patch sets for "148e4730063a5807e215d497a531b2da65225e68": 667721,5; 667721,6 | 17:55 |
| *** diablo_rojo has quit IRC | 17:57 | |
| *** cyberpear has joined #openstack-infra | 17:59 | |
| fungi | gouthamr: oof, gerrit is supposed to prevent pushing multiple commits with the same git commit id | 18:03 |
| fungi | i wonder how that happened | 18:03 |
| *** igordc has joined #openstack-infra | 18:05 | |
| donnyd | clarkb: are any of the builds on FN timing out? | 18:06 |
| clarkb | donnyd: the ones I checked earlier were not | 18:08 |
| clarkb | I'll rerun my logstash query and skim the listagain | 18:08 |
| donnyd | Do you mind sharing your logstash query, so i can check? :) | 18:09 |
| fungi | i need to run out do do some grocery shopping now that meetings are done. should be back soon | 18:09 |
| clarkb | donnyd: node_provider:"fortnebula-regionone" AND filename:job-output.txt AND message:"Upload logs to log server" | 18:11 |
| clarkb | donnyd: that looks for an entry that shold happen only once for every job so you get one result per job (which is helpful) | 18:11 |
| clarkb | donnyd: and looks like the recent failures are timeouts | 18:12 |
| clarkb | so probably a loading problem. Since early this mornign would've been low load previously | 18:12 |
| *** josephrsandoval has quit IRC | 18:20 | |
| *** diablo_rojo has joined #openstack-infra | 18:21 | |
| clarkb | donnyd: maybe we decrease the max-servers value (or edit quota down) until it stablizes? | 18:21 |
| openstackgerrit | Merged zuul/nodepool master: Add functional jobs to gate https://review.opendev.org/670612 | 18:21 |
| *** sgw has joined #openstack-infra | 18:23 | |
| donnyd | Im about to have a fix for what I can see is the bottleneck (storage | 18:26 |
| sgw | cmurphy: dirk: I am playing around with a Zuul job to use the osc command to construct a project and send it to an OBS sandbox. I was able to run it in a local Zuul (quickstart based environment), but when I run it in the Zuul Infra osc complains about unknown command, the versions of osc are the same (0.162.1) between the 2 environments. It fails in both an opensuse and ubuntu node. Thoughts? Thanks | 18:27 |
| clarkb | donnyd: ok | 18:28 |
| cmurphy | sgw: is osc installed on the node? | 18:29 |
| *** electrofelix has quit IRC | 18:31 | |
| sgw | cmurphy: yes, I install osc on the node and run the --version, that repots 0.162.1 as noted. BTW this might be interesting for rpm-packaging in the future, I tool the basic ideas from the createproject script | 18:31 |
| cmurphy | sgw: do you have an example log where it's not working? | 18:31 |
| *** josephrsandoval has joined #openstack-infra | 18:31 | |
| AJaeger | sgw: I just commented, it looks to me as if your whole command is passed in as arg[1] and not split up properly. Could that be? | 18:32 |
| AJaeger | cmurphy: http://logs.openstack.org/63/670363/21/check/starlingx-obs-build/62af69e/job-output.txt.gz | 18:32 |
| cmurphy | thanks | 18:32 |
| sgw | AJaeger: I know I changed the quioting and it still appears to fail | 18:33 |
| cmurphy | i agree with AJaeger | 18:33 |
| cmurphy | oh hmm | 18:33 |
| sgw | I will try again, maybe the way ansible passes variables is not what OSC is exepecting. | 18:33 |
| sgw | cmurphy: AJaeger: Important Note: This did work correctly locally with both running ansible-playbook and a local instance of Zuul installed following the Zuul Quickstart document, so there might be something else going on | 18:35 |
| sgw | cmurphy: I removed the outer quotes, but it still appears to be quoted | 18:36 |
| cmurphy | sgw: log? | 18:36 |
| sgw | Log fragment (no external access): | 18:37 |
| sgw | 2019-07-10 23:34:52.081444 | TASK [osc : Run OSC with options]2019-07-10 23:34:54.551285 | ubuntu-bionic | ok: Runtime: 0:00:01.599810 2019-07-10 23:34:54.586351 | 2019-07-10 23:34:54.586562 | TASK [osc : Create temporary _meta file] 2019-07-10 23:34:54.946217 | ubuntu-bionic | changed | 18:37 |
| sgw | 2019-07-10 23:34:52.081444 | TASK [osc : Run OSC with options] | 18:37 |
| sgw | 2019-07-10 23:34:54.551285 | ubuntu-bionic | ok: Runtime: 0:00:01.599810 | 18:37 |
| sgw | 2019-07-10 23:34:54.586351 | | 18:37 |
| sgw | 2019-07-10 23:34:54.586562 | TASK [osc : Create temporary _meta file] | 18:37 |
| sgw | 2019-07-10 23:34:54.946217 | ubuntu-bionic | changed | 18:37 |
| *** weifan has quit IRC | 18:38 | |
| *** panda has quit IRC | 18:38 | |
| sgw | same tasks as what's in the public Zuul, BTW here is the gerrit review: https://review.opendev.org/#/c/670363/ | 18:38 |
| cmurphy | sgw: can you use http://paste.openstack.org/ for log snippets, your output seems to have been cut off after six lines | 18:39 |
| sgw | cmurphy: this is my first crack at ansible and ziuul, so execuse the poor organization! | 18:39 |
| *** panda has joined #openstack-infra | 18:40 | |
| gouthamr | fungi: ack, unsure how that happened too... iirc it was "rechecked" once. It merged, although the status didn't change to merged" since it didn't merge the first | 18:40 |
| * gouthamr gah can't type | 18:40 | |
| sgw | cmurphy: I just pasted the 6 lines that are from the good example (my local build) | 18:40 |
| cmurphy | sgw: i was looking for logs from where it was failing | 18:41 |
| gouthamr | fungi: ack, unsure how that happened too... iirc it was "rechecked" once. It merged into the tree, although the status on gerrit didn't change to "merged" - a "recheck" was issued to get the status to change. maybe that caused something? | 18:41 |
| sgw | cmurphy: ok: http://logs.openstack.org/63/670363/21/check/starlingx-obs-build/62af69e/job-output.txt.gz | 18:41 |
| sgw | I thought you looked at what AJaeger posted earlier and wanted the good example, sorry. search for rdelete in there | 18:42 |
| cmurphy | sgw: sorry, you said "I removed the outer quotes, but it still appears to be quoted" and I was looking for an example of that and thought that was something new from the original log | 18:42 |
| * sgw unfortunately I have to head to a dr appt back later this afternoon here, if I am able otherwise tomorrow | 18:43 | |
| cmurphy | for patchset 21 of this change you still have osc "{{ osc_options }}" so that still has quotes which make arg 1 still one long string | 18:43 |
| sgw | cmurphy: ah, I need to remove those quiotes then, let me give that a try | 18:44 |
| sgw | pushed and gone. | 18:44 |
| cmurphy | if that doesn't work i would check out the argv parameter documented here https://docs.ansible.com/ansible/latest/modules/command_module.html and see if that applies | 18:45 |
| *** josephrsandoval has quit IRC | 18:48 | |
| AJaeger | sgw: you might want to uncomment all the other jobs in your change to avoid running them on your WIP change to only run the new job | 18:54 |
| gouthamr | fungi: found a conversation between elod and corvus about this issue on 2019-07-08: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2019-07-08.log.html#t2019-07-08T14:18:46 | 18:55 |
| gouthamr | "https://review.opendev.org/#/c/667721/4 works, patchsets 5 and 6 are in the database and the refs are on disk, their commits are present. they have the same sha, which is curious. i believe ps6 is the merge from zuul, but i don't understand why gerrit would create a new ps with the same sha for a merge" | 18:56 |
| clarkb | gouthamr: I think the hunch at the time of your link was that using gerrit's built in edit feature during database backups meant the table was locked when gerrit tried to save to the db and that failed, but the on disk content were updated anyway? | 18:56 |
| gouthamr | clarkb: oh.. yes.. the repo isn't affected, the merge only happened once as you guys confirmed.. | 18:57 |
| *** ykarel|away has quit IRC | 19:00 | |
| *** 7JTAATE3D has joined #openstack-infra | 19:05 | |
| *** 7JTAATE3D has quit IRC | 19:05 | |
| *** weifan has joined #openstack-infra | 19:05 | |
| *** weifan has quit IRC | 19:06 | |
| *** weifan has joined #openstack-infra | 19:06 | |
| *** weifan has quit IRC | 19:07 | |
| *** weifan has joined #openstack-infra | 19:07 | |
| *** weifan has quit IRC | 19:08 | |
| *** weifan has joined #openstack-infra | 19:08 | |
| *** weifan has quit IRC | 19:08 | |
| *** weifan has joined #openstack-infra | 19:09 | |
| *** weifan has quit IRC | 19:09 | |
| *** weifan has joined #openstack-infra | 19:09 | |
| *** weifan has quit IRC | 19:10 | |
| *** weifan has joined #openstack-infra | 19:10 | |
| *** weifan has quit IRC | 19:11 | |
| *** weifan has joined #openstack-infra | 19:11 | |
| *** weifan has quit IRC | 19:12 | |
| *** weifan has joined #openstack-infra | 19:12 | |
| *** weifan has quit IRC | 19:12 | |
| *** weifan has joined #openstack-infra | 19:13 | |
| *** weifan has quit IRC | 19:13 | |
| *** weifan has joined #openstack-infra | 19:13 | |
| *** weifan has quit IRC | 19:14 | |
| *** weifan has joined #openstack-infra | 19:14 | |
| *** weifan has quit IRC | 19:15 | |
| *** weifan has joined #openstack-infra | 19:15 | |
| *** weifan has quit IRC | 19:16 | |
| *** weifan has joined #openstack-infra | 19:16 | |
| *** bhavikdbavishi has quit IRC | 19:16 | |
| *** weifan has quit IRC | 19:16 | |
| *** weifan has joined #openstack-infra | 19:17 | |
| *** weifan has quit IRC | 19:17 | |
| *** weifan has joined #openstack-infra | 19:17 | |
| *** weifan has quit IRC | 19:18 | |
| *** weifan has joined #openstack-infra | 19:18 | |
| *** weifan has quit IRC | 19:19 | |
| *** weifan has joined #openstack-infra | 19:19 | |
| *** weifan has quit IRC | 19:20 | |
| *** weifan has joined #openstack-infra | 19:26 | |
| *** diablo_rojo has quit IRC | 19:31 | |
| *** aedc has quit IRC | 19:35 | |
| clarkb | fungi: should we go ahead and approve the hide extra ci change? | 19:48 |
| clarkb | fungi: or do you want to test that on review-dev first or via manual edit of js in your browser or somethign? | 19:48 |
| clarkb | it has many +2s in any case and could be approved when you are ready | 19:48 |
| *** eharney has quit IRC | 19:49 | |
| *** jamesmcarthur has quit IRC | 19:51 | |
| *** e0ne has quit IRC | 19:52 | |
| *** e0ne has joined #openstack-infra | 19:53 | |
| *** josephrsandoval has joined #openstack-infra | 19:58 | |
| cloudnull | hey all, the thank you page for the user survey (https://www.openstack.org/user-survey/survey-2019/thank-you-end) provides a link at the end for survey analytics however the URL provided is to the 2012 summit call for speakers page (https://www.openstack.org/summit/san-diego-2012/call-for-speakers) where would I go to raise a bug for that ? | 20:01 |
| *** betherly has quit IRC | 20:02 | |
| *** altlogbot_3 has quit IRC | 20:10 | |
| clarkb | cloudnull: lone sec | 20:10 |
| clarkb | er one sec | 20:10 |
| clarkb | cloudnull: https://launchpad.net/openstack-org there. If you give me the bug number when filed I can pass it along too | 20:11 |
| *** altlogbot_3 has joined #openstack-infra | 20:13 | |
| clarkb | as a heads up it is looking like tomorrow is my hang out with oscon attendees day so I will probably not be around a whole lot but should be here for the meeting | 20:14 |
| cloudnull | clarkb on it | 20:16 |
| cloudnull | clarkb https://bugs.launchpad.net/openstack-org/+bug/1836645 | 20:20 |
| openstack | Launchpad bug 1836645 in openstack-org "thank you note has broken link to survey analytics" [Undecided,New] | 20:20 |
| clarkb | thanks apssing that along now | 20:21 |
| *** weifan has quit IRC | 20:27 | |
| *** weifan has joined #openstack-infra | 20:27 | |
| *** pcaruana has quit IRC | 20:29 | |
| donnyd | clarkb: How do I know if a job timed out. I am making the assumption it will say "timed out", but I don't know so figured it would be better to ask | 20:30 |
| clarkb | donnyd: one sec and in fact we should be able to tune a logstash query for it | 20:31 |
| donnyd | got the nvme storage up on two nodes, just waiting for the rest of the running jobs to cycle out | 20:31 |
| clarkb | donnyd: http://logs.openstack.org/18/670718/2/check/openstack-tox-py37/8ed0023/job-output.txt#_2019-07-15_17_54_49_292527 that is the magic string we are looking for. Let me make a logstash quesry | 20:31 |
| *** slaweq has quit IRC | 20:31 | |
| clarkb | donnyd: node_provider:"fortnebula-regionone" AND filename:job-output.txt AND message:"RUN END RESULT_TIMED_OUT" | 20:32 |
| donnyd | Ok, I see a couple in the last hour, so I will finish up swapping out backend storages and monitor for that | 20:33 |
| donnyd | clarkb: that is super slick BTW | 20:33 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add add-fileserver test job https://review.opendev.org/670201 | 20:33 |
| clarkb | donnyd: it is getting a bit old and due for a refresh but ya at peak it was indexing a billion log lines or so a day and is really helpful for digging into an assortment of issues | 20:34 |
| donnyd | Not sure if I am CPU bound or storage bound... by checking the available IOPS on a loaded server... everything points me to IO | 20:34 |
| *** diablo_rojo has joined #openstack-infra | 20:34 | |
| clarkb | ya wouldn't surprise me if it is io | 20:34 |
| *** dpawlik has quit IRC | 20:34 | |
| *** eharney has joined #openstack-infra | 20:41 | |
| *** jamesmcarthur has joined #openstack-infra | 20:42 | |
| fungi | clarkb: i could try hand-patching 655783 onto review-dev, though we don't have zuul reporting to it. maybe i should hand-patch it onto review.o.o instead (to save us a revert in case it needs a tweak)? | 20:47 |
| clarkb | oh thats a good point there won't be CI results there to filter | 20:47 |
| clarkb | fungi: you should be able to hand patch it into your browsers load of the js | 20:47 |
| clarkb | without modifying the server | 20:47 |
| fungi | can do in a few minutes if folks want. it seems fairly straightforward, but i'm a bull in a china shop when it comes to javascript | 20:48 |
| clarkb | I should probably figure that out myself since it seems like a generaly useful thing | 20:48 |
| * fungi attempts to pick up a fine crystal goblet with his hooves | 20:48 | |
| clarkb | apparently firefox may not allow this but chrome does? | 20:52 |
| *** kjackal has quit IRC | 20:52 | |
| *** xek has quit IRC | 20:52 | |
| *** kjackal has joined #openstack-infra | 20:55 | |
| clarkb | fungi: ok I managed to test it in chrome and it works there | 20:57 |
| clarkb | The way to do that is open the dev tools, load the page, then under sources -> static -> hideci.js edit the file then ^S and hit the toggle ci button | 20:58 |
| clarkb | the page isn't reloaded during that so it may not redraw the button text but the hide functionality leaves zuul in place as is | 20:58 |
| clarkb | so I think this is good to go | 20:58 |
| *** josephrsandoval has quit IRC | 21:00 | |
| *** e0ne has quit IRC | 21:03 | |
| fungi | awesome, thanks for testing! | 21:05 |
| clarkb | I'll have to add that to the very small list of things I need chrome for over firefox. Currently has flash, codecs that my suse install doesn't have, and editing js | 21:06 |
| fungi | i'm surprised the greasemonkey tools for firefox don't have a means of live editing javascript for a page | 21:07 |
| clarkb | oh they might. I'm just using the built in dev tools | 21:08 |
| fungi | i have the web developer tools and they include a style editor at least. one of these other doodads may be it | 21:09 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add add-gpgkey test job https://review.opendev.org/670206 | 21:13 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add add-launchpad-credentaials test job https://review.opendev.org/670207 | 21:14 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add add-sshkey test job https://review.opendev.org/670208 | 21:14 |
| fungi | i've found how to browse it in the debugger pane at least | 21:16 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add dstat graph roles https://review.opendev.org/670402 | 21:18 |
| *** e0ne has joined #openstack-infra | 21:19 | |
| *** e0ne has quit IRC | 21:20 | |
| fungi | the description of the debugger indicates it allows you to "modify" javascript, but from the docs it seems to be limited to setting breakpoints | 21:20 |
| fungi | from a modification standpoint | 21:20 |
| fungi | of course there are several popular ff extensions for modifying javascript on the fly | 21:21 |
| corvus | at the very least you can do stuff in the console, but that may be very painful | 21:21 |
| fungi | also the scratchpad, if you want to write it all from scratch | 21:22 |
| corvus | (depending on the amount you would have to redefine) | 21:22 |
| *** e0ne has joined #openstack-infra | 21:22 | |
| fungi | modifying one conditional on the fly seems to involve rather a lot of effort expended though | 21:22 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add mirror_info documentation https://review.opendev.org/669948 | 21:23 |
| *** e0ne has quit IRC | 21:24 | |
| *** e0ne has joined #openstack-infra | 21:24 | |
| clarkb | it wasn't too bad in chrom* but ya in FF seems like a lot of effort | 21:26 |
| clarkb | I'm pretty certain it works fine after testing in chrome though so I think we can approve it | 21:26 |
| corvus | mordred: it looks like it takes 0.3 seconds to make a project in gitea, 0.2 seconds to update the issue tracker url, and 0.2 seconds to set the master branch. a total of 0.7 seconds per project, which works out to about 24 minutes for 2k projects (which matches runtime) | 21:27 |
| corvus | mordred: i'm not seeing low-hanging fruit here | 21:27 |
| clarkb | are we able to process multiple projects per gitea server at the same time? | 21:29 |
| clarkb | Other than that I would agree it is unlikely to make it go faster tiven your numbers | 21:29 |
| corvus | clarkb: not that i know of, but i think that's worth looking into. the only other idea i have is whether we can make the http calls more efficient (requests session? pipelining?) | 21:30 |
| corvus | clarkb: oh, maybe we could have threads? | 21:31 |
| clarkb | ya we could possibly shard the input list then hand a different sublist to threads | 21:31 |
| corvus | clarkb: i read your suggestion as something like batch requests, but maybe you meanth threads | 21:31 |
| corvus | so there's 3 ideas | 21:32 |
| lifeless | http/2 | QUIC is another related thing, particularly if you're looking at threads. | 21:32 |
| clarkb | fungi: are you still trying to test the js chagnes locally or should I go ahead and approve the change? | 21:36 |
| corvus | i can't tell if macaron supports http/2 -- it's a brand new framework in go... do they not mention it because "of course it does!" or because they've never heard of it... | 21:36 |
| corvus | also, i hate searching for stuff about macaron even more than i hate searching for golang stuff, because i always get lots of pictures of sweets | 21:36 |
| corvus | and now i'm hungry | 21:37 |
| mordred | corvus: yes. I have this issue. also, over the weekend I was doing things with gatsby - googling for that sometimes works well, sometimes I learn alot about the jazz age | 21:38 |
| *** e0ne has quit IRC | 21:39 | |
| mordred | we're already using a requests session. so I think we'd need to play with http/2 - of course that would require figuring out http/2 client calls in python too | 21:39 |
| *** pkopec has quit IRC | 21:40 | |
| fungi | clarkb: go ahead and approve. my quest to gain familiarity with web browsers doesn't need to delay this | 21:41 |
| clarkb | done | 21:41 |
| lifeless | fortunately you know a great Python http/2 person :) | 21:41 |
| mordred | corvus: http://www.thefirstcode.com/how-to-use-python-requests-library-with-http2 | 21:41 |
| mordred | lifeless: do I? that's exciting! | 21:41 |
| lifeless | mordred: you hired him... | 21:41 |
| mordred | lifeless: there was a time, many ages ago, when I hired a lot of people ... | 21:42 |
| mordred | lifeless: :) | 21:42 |
| mordred | lifeless: is there a super-easy way to tell if a service supports http/2? | 21:42 |
| lifeless | mordred: the official thing is if there is an ALPN H2 response | 21:43 |
| fungi | (also how do i identify a great python http/2 person... look at them through an ultraviolet filter?0 | 21:43 |
| mordred | such as, the service at https://opendev.org/api/swagger | 21:43 |
| lifeless | fungi: cory benfield :) | 21:43 |
| fungi | ahh, a name filter. i shoulda known! | 21:44 |
| clarkb | I think we can just see if ff or chrome use http2 | 21:44 |
| * clarkb looks | 21:44 | |
| lifeless | mordred: https://github.com/stefanjudis/is-http2-cli perhaps :P | 21:45 |
| lifeless | though at 4 years old it may be a little stale | 21:45 |
| clarkb | firefox uses http 1.1 against gitea | 21:45 |
| clarkb | now trying to check with chrome | 21:45 |
| lifeless | hmm, looks like its just thunking into libraries so the age should be fairly irrelevant | 21:46 |
| clarkb | chrome's network panel seems mostly useless. Did they change it? | 21:47 |
| clarkb | bah I had it on websockets only | 21:47 |
| clarkb | chrome is 1.1 too | 21:47 |
| mordred | ok. so http/2 is unlikely to be a low-hanging-fruit fix here | 21:48 |
| mordred | lifeless: actually, I don't think I did hire him - I think gothicmindfood did right as I was leaving | 21:48 |
| lifeless | mordred: ah perhaps. | 21:49 |
| lifeless | mordred: well you should have! | 21:49 |
| mordred | lifeless: clearly :) | 21:50 |
| *** tosky has quit IRC | 21:50 | |
| johnsom | mordred What are you trying to solve with HTTP/2? Too many connections to the backend servers? | 22:01 |
| johnsom | clarkb Do you want me to propose a DIB release? I think you were talking about doing that today. | 22:02 |
| clarkb | johnsom: ianw already took care of it | 22:02 |
| clarkb | johnsom: we don't use the openstack releases process for our tools | 22:02 |
| *** diablo_rojo has quit IRC | 22:03 | |
| johnsom | Ah, ok. I was looking in gerrit and didn't see it. | 22:03 |
| mordred | johnsom: mostly were just brainstorming about quick low-hanging fruit for speeding up an operation that we don't do THAT much | 22:03 |
| clarkb | (there is a weird chicken and egg problem there where if we have to get releases out but to do so need a release change and jobs to all work we can get wedged) | 22:03 |
| *** whoami-rajat has quit IRC | 22:04 | |
| *** jamesmcarthur has quit IRC | 22:04 | |
| johnsom | mordred Ok. I was going to provide some haproxy advice if you were looking for a way to reduce backend server connections. Sounds like it was a different issue. | 22:05 |
| ianw | clarkb: could i get an eye on https://review.opendev.org/#/c/668832/ to export mirror logs; i'll watch it in today | 22:06 |
| corvus | mordred: i just started some local testing of 670060 and see some idempotency problems; i removed my +W; i'll keep digging and put up a patch | 22:06 |
| *** andreykurilin has quit IRC | 22:06 | |
| clarkb | fungi: wrote some notes on your TC resolution re project abandonment | 22:08 |
| clarkb | ianw: looks good, is ansible host var data up to date with the keytab so I can approve it now? | 22:10 |
| ianw | clarkb: yes thanks, should be | 22:10 |
| * clarkb checks | 22:10 | |
| clarkb | seems we have a group_vars/mirror-update.yaml~ in addition to host_vars/mirror-update01.opendev.org is that first one named properly for puppet? | 22:13 |
| * clarkb approves. | 22:13 | |
| ianw | oh that may be editor failure on my part | 22:13 |
| clarkb | ianw: k, unrelated to ^ last week in the meeting we wanted to talk about PPA management so that it is something that more than one person (or even better a computer) can do for us. I have that on the agenda for our meeting tomorrow if you'll make it. Wanted to give you a heads up since you were out last week | 22:14 |
| ianw | ok, sure. shoe-horning latest openafs upstream tarballs into the existing .deb frameworks, and fixing up little errors has been a very manual approach and isn't much fun | 22:18 |
| ianw | i think scripting that part might be a bit unnecessary; but if someone wants to sure. we could commit the source .debs, however, and have zuul sign them with a common key from secrets and dput them | 22:21 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Improve idempotency of gitea-git-repos https://review.opendev.org/670919 | 22:21 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Use a thread pool to create gitea repos faster https://review.opendev.org/670920 | 22:21 |
| corvus | mordred, clarkb, fungi: i *think* that showed improvements in my local testing. ^ | 22:21 |
| clarkb | I think even documenting the ppa and its credentials and stuff would be a good improvement since as you say things don't seem to change much? I haven't ever done anything to manage that sytem so am wrong person to ask | 22:22 |
| corvus | took something like 7m to do them all, and i'm pretty sure my local setup was pretty close to the same rate as the gate job (0.7s per repo) | 22:22 |
| *** icarusfactor has joined #openstack-infra | 22:22 | |
| *** factor has quit IRC | 22:22 | |
| ianw | clarkb: yes sure, i can quickly write something up so we have something to discuss tomorrow to start | 22:23 |
| ianw | really it comes down to your launchpad user being in the openstack team, and then you need to upload the package signed by the key you've put into your launchpad profile | 22:24 |
| clarkb | corvus: left a note on the first one | 22:25 |
| *** goldyfruit has quit IRC | 22:25 | |
| clarkb | corvus: for the second: any idea what error handling looks like? we may need to serialize errors back out of the future for ansible? | 22:26 |
| clarkb | ok comments put into gerrit | 22:27 |
| corvus | clarkb: replied on first. and on the second, yeah, all errors are masked, so we should do something about that. :) | 22:28 |
| clarkb | corvus: can you see my response on the first | 22:30 |
| *** factor has joined #openstack-infra | 22:32 | |
| corvus | clarkb: yes, that's a typo | 22:32 |
| *** factor has quit IRC | 22:33 | |
| *** icarusfactor has quit IRC | 22:34 | |
| *** ekultails has quit IRC | 22:34 | |
| *** mattmceuen has joined #openstack-infra | 22:38 | |
| mattmceuen | hi team, FYI that I've formally added myself as an Infra liaison for Airship: https://wiki.openstack.org/wiki/CrossProjectLiaisons#Infra | 22:39 |
| openstackgerrit | Merged opendev/system-config master: Don't hide Zuul CI comments https://review.opendev.org/655783 | 22:39 |
| mattmceuen | with the frequency I'm in here asking for things this probably isn't a surprise :) I will be going through the process to retire a dead airship project soon, so wanted to make that "official" | 22:40 |
| fungi | mattmceuen: thanks for the heads up, and welcome once again! | 22:42 |
| *** kjackal has quit IRC | 22:42 | |
| fungi | clarkb: much obliged for the notes on the openstack governance resolution. the main reason i brought it to your attention was the proposed timeline... if we want to move opendev things out of openstack governance we might want to consider trying to do that by the end of the train cycle (assuming that resolution passes in its present state) | 22:43 |
| fungi | also i'll try to keep an eye on gerrit when the hideci.js file gets updated to make sure the results table doesn't go missing and need a manual `touch ...` run | 22:44 |
| clarkb | fungi: I'm not sure we can commit to that with the openstack/project-config stuff that needs moving | 22:45 |
| clarkb | I imagine that will be piecemeal overtime as we are able to sneak things in with minimal disruption | 22:45 |
| fungi | clarkb: i think in the case of openstack/project-config it's not a repo moving out of openstack governance | 22:45 |
| clarkb | certainly the bulk of its content is moving but ya that repo may stay put for the other bits | 22:45 |
| *** yamamoto has joined #openstack-infra | 22:45 | |
| fungi | it's files moving out of that repo into one outside openstack governance, but files will still remain behind which are openstack-specific | 22:45 |
| fungi | so i wouldn't be as concerned about that one | 22:46 |
| fungi | more about the grey area of repos we have in the opendev namespace but still under openstack tc governance at the moment | 22:46 |
| clarkb | What else needs to move? | 22:46 |
| clarkb | everything in the opendev namespace is already moved and not subject to that resolution right? | 22:46 |
| clarkb | (resolution is specifically about the openstack/ namespace) | 22:46 |
| fungi | well, therein lies the rub, and could suggest an adjustment | 22:47 |
| openstackgerrit | Merged opendev/system-config master: mirror-update: export mirroring logs https://review.opendev.org/668832 | 22:47 |
| fungi | the resolution is about projects exiting governance, and requiring them to fork and move out of the openstack namespace when they do so | 22:47 |
| clarkb | the way I read it none of the moves we have already done to opendev/ are affected | 22:47 |
| clarkb | fungi: right but specifically only if they are part of the openstack/ namespace | 22:47 |
| fungi | it's a hole in the resolution which needs to be clarified, i think | 22:48 |
| clarkb | whcih these aren't except for project-config (and maybe one or two tohers I'm forgetting) | 22:48 |
| fungi | the resolution assumes all official openstack deliverable repositories are in the openstack namespace, but there are some in the opendev namespace too | 22:48 |
| fungi | so i suppose i can add a sentence or two to clarify | 22:48 |
| corvus | fungi: i think that's temporary? | 22:49 |
| fungi | just want to do so in a way which doesn't come across as declaring opendev's own repos exempt without reason | 22:49 |
| corvus | ie, i think everyone is on the same page that opendev/ repos aren't under openstack governance for the long haul | 22:49 |
| clarkb | dib is another I guess | 22:50 |
| fungi | corvus: right, i was suggesting that if it's only temporary until the end of the train cycle then the resolution doesn't need editing, but i can stick a carve-out in there for the things we already moved to the opendev namespace without removing from openstack governance | 22:50 |
| corvus | yeah, couldn't hurt | 22:50 |
| clarkb | fungi: fwiw I already read it that way with the existing resolution | 22:50 |
| clarkb | it specifically says this applies to oepnstack/ namespace repos | 22:50 |
| corvus | i expect openstack/project-config to remain under opestack governance, but i expect gerrit/projects.yaml to move from that repo to opendev/something | 22:51 |
| fungi | clarkb: i'm glad! that wasn't something i was thinking about when i wrote it, so i still ought to clarify it for people who read it the way i interpreted it in my head | 22:51 |
| fungi | just so nobody complains later | 22:52 |
| clarkb | corvus: ya as well as the bot configs and zuul main.yaml and so on | 22:52 |
| fungi | that aside, maybe soon we should bring up what a timeline for removing them from tc governance might look like | 22:52 |
| clarkb | I think dib is the other openstack/ repo we control | 22:52 |
| clarkb | whether or not that belongs as part of opendev itself I don't know | 22:53 |
| clarkb | (I guess we can just say we'll dev it as an openstack project?) | 22:53 |
| fungi | dib makes sense to continue being part of openstack | 22:53 |
| fungi | assuming the folks primarily putting in the effort on it agree | 22:53 |
| clarkb | fungi: sort of, the reason we ended up with it is because no one else in oepsntack wanted it | 22:53 |
| clarkb | somethign with tripleo abandoning it | 22:53 |
| openstackgerrit | Matt McEuen proposed openstack/project-config master: End Airship Utils gating https://review.opendev.org/670923 | 22:54 |
| fungi | well, the openstack infra team will continue being a thing, i expect, in some form | 22:54 |
| fungi | and can "own" stuff like dib | 22:54 |
| clarkb | fungi: ya it just doesn't make much sense in that arrangement beacuse it is actually opendev the service that depends on it | 22:54 |
| clarkb | not openstack specifically | 22:54 |
| fungi | well, opendev the service depends on openstack clouds too | 22:55 |
| clarkb | true, but those have other openstack users too. dib is largely us at this point I think (us == opendev) | 22:55 |
| fungi | and dib is used in openstack clouds and by some openstack projects which generate images | 22:55 |
| clarkb | oh thats a good point octavia is still actively using it | 22:56 |
| fungi | anyway, it's a grey area is what i'm saying. definitely worthy of further discussion | 22:57 |
| fungi | i thought trove was using it too? | 22:57 |
| fungi | not sure if other stuff like fwaas/vpnaas are | 22:58 |
| clarkb | there was a big schismy thing that happend a few years back where basically everything but octavia decided to use other tools to build their images | 22:58 |
| clarkb | I think it started with sahara? | 22:58 |
| clarkb | they all use the red hat thing now | 22:58 |
| clarkb | or were going to | 22:58 |
| johnsom | Trove is/was. FWaaS and VPNaaS no. There is one other OpenStack project.... | 22:58 |
| fungi | oh, right, i always forget about sahara | 22:58 |
| johnsom | Yeah Sahara I think | 22:59 |
| *** tkajinam has joined #openstack-infra | 22:59 | |
| clarkb | the point of contention seemed to be people not understanding how to modify existing images with dib even though the main distro elements do exactly that | 22:59 |
| clarkb | so they all went to guestfs tooling instead | 22:59 |
| clarkb | which of course depends on virt which makes it less useful for eg opendev | 23:00 |
| *** sgw has quit IRC | 23:01 | |
| corvus | clarkb, fungi, mordred: while the parallelization *worked* it seems to have produced some weird results; i think the web server's cache is incoherent. i get back what feels like an arbitrary set of 16 x/ repos and 33 openstack/repos when i try to list them. if i restart the system, i get the data i'm expecting. | 23:02 |
| corvus | i think it's still worth more investigation (maybe something about reusing the same web session with multiple creation requests), but it's not ready for prime-time | 23:03 |
| johnsom | Ironic still provides instructions for using DIB as well. | 23:03 |
| corvus | i'll fixup the first change which should be fine | 23:03 |
| clarkb | johnsom: oh really? I don't think they ever used dib? they used coreos and then something like alpine | 23:03 |
| fungi | corvus: that's... strange | 23:03 |
| johnsom | clarkb https://docs.openstack.org/ironic/latest/install/deploy-ramdisk.html#disk-image-builder | 23:04 |
| clarkb | johnsom: wow I wonder why we always got shot down for suggesting they use it for testing | 23:05 |
| clarkb | I just confirmed that trove is still using it too | 23:05 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Improve idempotency of gitea-git-repos https://review.opendev.org/670919 | 23:05 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: WIP: Use a thread pool to create gitea repos faster https://review.opendev.org/670920 | 23:06 |
| clarkb | https://opendev.org/openstack/trove/src/branch/master/integration/scripts/functions_qemu#L73-L80 | 23:06 |
| johnsom | There are a number of project hits doing a code search | 23:06 |
| clarkb | corvus: I wonder if that poinst at a gitea bug they'll want to fix anyway | 23:06 |
| clarkb | corvus: shouldn't expect that to get fixed for us to use the python project creator but still something we may want to report to them | 23:07 |
| fungi | i assume if multiple threads performing updates can cause this, then so can multiple web browsers on a very active deployment (though maybe not as often) | 23:12 |
| *** sgw has joined #openstack-infra | 23:18 | |
| *** mudpuppy has quit IRC | 23:21 | |
| *** mudpuppy has joined #openstack-infra | 23:22 | |
| *** rcernin has joined #openstack-infra | 23:29 | |
| *** e0ne has joined #openstack-infra | 23:31 | |
| *** mattw4 has quit IRC | 23:32 | |
| *** jamesmcarthur has joined #openstack-infra | 23:35 | |
| *** e0ne has quit IRC | 23:36 | |
| *** e0ne has joined #openstack-infra | 23:38 | |
| *** e0ne has quit IRC | 23:42 | |
| clarkb | donnyd: the last timeout was about 2 hours ago fwiw | 23:44 |
| donnyd | I think that is because the load has been low for the last few hours | 23:45 |
| *** yamamoto has quit IRC | 23:49 | |
| *** dchen has joined #openstack-infra | 23:51 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
