| *** SorinSen has joined #openstack-infra | 00:01 | |
| openstackgerrit | Merged openstack-infra/git-review master: expand help for --download option https://review.openstack.org/564224 | 00:02 |
|---|---|---|
| *** SorinSen_ has quit IRC | 00:04 | |
| *** dpawlik has joined #openstack-infra | 00:06 | |
| *** dpawlik has quit IRC | 00:10 | |
| *** dpawlik has joined #openstack-infra | 00:11 | |
| *** dingyichen has joined #openstack-infra | 00:11 | |
| *** aeng has joined #openstack-infra | 00:12 | |
| *** aeng has quit IRC | 00:13 | |
| *** dpawlik has quit IRC | 00:21 | |
| *** salv-orlando has joined #openstack-infra | 00:23 | |
| *** dpawlik has joined #openstack-infra | 00:26 | |
| *** salv-orlando has quit IRC | 00:27 | |
| *** edmondsw has joined #openstack-infra | 00:28 | |
| *** edmondsw has quit IRC | 00:33 | |
| *** dpawlik has quit IRC | 00:50 | |
| *** dpawlik has joined #openstack-infra | 00:51 | |
| *** yamamoto has joined #openstack-infra | 00:59 | |
| *** yamamoto has quit IRC | 01:04 | |
| *** dtantsur|afk has quit IRC | 01:08 | |
| *** dtantsur has joined #openstack-infra | 01:08 | |
| *** dpawlik has quit IRC | 01:10 | |
| *** dpawlik has joined #openstack-infra | 01:11 | |
| *** dpawlik has quit IRC | 01:15 | |
| *** dpawlik has joined #openstack-infra | 01:21 | |
| *** salv-orlando has joined #openstack-infra | 01:23 | |
| *** dpawlik has quit IRC | 01:25 | |
| *** dpawlik has joined #openstack-infra | 01:26 | |
| *** yamahata has joined #openstack-infra | 01:26 | |
| *** salv-orlando has quit IRC | 01:28 | |
| openstackgerrit | Ian Wienand proposed openstack-dev/pbr master: Don't poke in pip for requests https://review.openstack.org/565089 | 01:30 |
| *** krtaylor has quit IRC | 01:32 | |
| *** rfolco|off has joined #openstack-infra | 01:40 | |
| *** hongbin has joined #openstack-infra | 01:41 | |
| *** dpawlik has quit IRC | 01:50 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: mqtt: add basic reporter https://review.openstack.org/535543 | 01:52 |
| *** dpawlik has joined #openstack-infra | 01:56 | |
| *** agopi has joined #openstack-infra | 01:56 | |
| *** benj_ has joined #openstack-infra | 01:59 | |
| *** dpawlik has quit IRC | 02:00 | |
| *** yamamoto has joined #openstack-infra | 02:00 | |
| *** dpawlik has joined #openstack-infra | 02:01 | |
| *** yamamoto has quit IRC | 02:05 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: mqtt: add basic reporter https://review.openstack.org/535543 | 02:09 |
| *** dpawlik has quit IRC | 02:10 | |
| *** dpawlik has joined #openstack-infra | 02:11 | |
| *** edmondsw has joined #openstack-infra | 02:16 | |
| *** agopi has quit IRC | 02:18 | |
| *** edmondsw has quit IRC | 02:21 | |
| *** salv-orlando has joined #openstack-infra | 02:24 | |
| *** xarses has quit IRC | 02:25 | |
| *** xarses has joined #openstack-infra | 02:25 | |
| *** dpawlik has quit IRC | 02:25 | |
| *** dpawlik has joined #openstack-infra | 02:26 | |
| *** hongbin_ has joined #openstack-infra | 02:28 | |
| *** salv-orlando has quit IRC | 02:28 | |
| *** dpawlik has quit IRC | 02:30 | |
| *** hongbin has quit IRC | 02:31 | |
| *** dpawlik has joined #openstack-infra | 02:31 | |
| *** spsurya has joined #openstack-infra | 02:38 | |
| *** dpawlik has quit IRC | 02:40 | |
| *** dpawlik has joined #openstack-infra | 02:41 | |
| *** rfolco|off has quit IRC | 02:45 | |
| *** vivsoni__ has quit IRC | 02:47 | |
| *** d0ugal has quit IRC | 02:49 | |
| *** mguiney is now known as valkyrja | 02:50 | |
| *** d0ugal has joined #openstack-infra | 02:50 | |
| *** armaan has joined #openstack-infra | 03:00 | |
| *** dpawlik has quit IRC | 03:00 | |
| *** dpawlik has joined #openstack-infra | 03:01 | |
| *** yamamoto has joined #openstack-infra | 03:01 | |
| *** yamamoto has quit IRC | 03:06 | |
| *** slaweq has joined #openstack-infra | 03:08 | |
| *** slaweq has quit IRC | 03:12 | |
| *** agopi has joined #openstack-infra | 03:13 | |
| *** vivsoni has joined #openstack-infra | 03:15 | |
| *** agopi has quit IRC | 03:24 | |
| *** agopi has joined #openstack-infra | 03:24 | |
| *** salv-orlando has joined #openstack-infra | 03:25 | |
| *** sree has joined #openstack-infra | 03:26 | |
| *** dpawlik has quit IRC | 03:30 | |
| *** salv-orlando has quit IRC | 03:30 | |
| *** dpawlik has joined #openstack-infra | 03:31 | |
| *** agopi has quit IRC | 03:35 | |
| *** dpawlik has quit IRC | 03:41 | |
| *** dpawlik has joined #openstack-infra | 03:41 | |
| *** udesale has joined #openstack-infra | 03:41 | |
| *** vivsoni has quit IRC | 03:46 | |
| *** dpawlik has quit IRC | 03:50 | |
| *** dpawlik has joined #openstack-infra | 03:56 | |
| *** agopi has joined #openstack-infra | 03:59 | |
| *** dpawlik has quit IRC | 04:00 | |
| *** dpawlik has joined #openstack-infra | 04:01 | |
| *** yamamoto has joined #openstack-infra | 04:02 | |
| *** dpawlik has quit IRC | 04:05 | |
| *** armaan has quit IRC | 04:05 | |
| *** dpawlik has joined #openstack-infra | 04:06 | |
| *** vivsoni has joined #openstack-infra | 04:07 | |
| *** yamamoto has quit IRC | 04:08 | |
| *** ramishra has joined #openstack-infra | 04:10 | |
| *** yamahata has quit IRC | 04:18 | |
| *** hongbin_ has quit IRC | 04:22 | |
| *** ykarel_ has joined #openstack-infra | 04:22 | |
| *** ykarel_ is now known as ykarel | 04:22 | |
| *** dpawlik has quit IRC | 04:25 | |
| *** salv-orlando has joined #openstack-infra | 04:26 | |
| *** dpawlik has joined #openstack-infra | 04:26 | |
| *** agopi has quit IRC | 04:27 | |
| *** salv-orlando has quit IRC | 04:30 | |
| *** dpawlik has quit IRC | 04:35 | |
| *** dpawlik has joined #openstack-infra | 04:36 | |
| *** snapiri has joined #openstack-infra | 04:38 | |
| *** links has joined #openstack-infra | 04:39 | |
| *** dpawlik has quit IRC | 04:40 | |
| *** dpawlik has joined #openstack-infra | 04:41 | |
| *** dpawlik has quit IRC | 04:45 | |
| *** dpawlik has joined #openstack-infra | 04:46 | |
| *** dpawlik has quit IRC | 04:50 | |
| *** dpawlik has joined #openstack-infra | 04:51 | |
| *** pcichy has quit IRC | 04:55 | |
| *** dpawlik has quit IRC | 05:00 | |
| *** dpawlik has joined #openstack-infra | 05:01 | |
| *** yamamoto has joined #openstack-infra | 05:04 | |
| *** yamamoto has quit IRC | 05:08 | |
| *** dpawlik has quit IRC | 05:10 | |
| *** jaosorior has joined #openstack-infra | 05:12 | |
| *** dpawlik has joined #openstack-infra | 05:16 | |
| *** dpawlik has quit IRC | 05:20 | |
| *** dpawlik has joined #openstack-infra | 05:21 | |
| *** dpawlik has quit IRC | 05:25 | |
| *** dpawlik has joined #openstack-infra | 05:26 | |
| *** salv-orlando has joined #openstack-infra | 05:26 | |
| *** salv-orlando has quit IRC | 05:31 | |
| *** masber has joined #openstack-infra | 05:41 | |
| *** dpawlik has quit IRC | 05:45 | |
| *** d0ugal has quit IRC | 05:48 | |
| *** janki has joined #openstack-infra | 05:51 | |
| *** masuberu has joined #openstack-infra | 05:51 | |
| *** edmondsw has joined #openstack-infra | 05:53 | |
| *** d0ugal has joined #openstack-infra | 05:54 | |
| *** masber has quit IRC | 05:55 | |
| *** edmondsw has quit IRC | 05:58 | |
| *** bhavik1 has joined #openstack-infra | 05:58 | |
| *** masuberu has quit IRC | 06:02 | |
| *** yamamoto has joined #openstack-infra | 06:05 | |
| *** slaweq has joined #openstack-infra | 06:08 | |
| *** yamamoto has quit IRC | 06:11 | |
| *** dpawlik has joined #openstack-infra | 06:11 | |
| *** salv-orlando has joined #openstack-infra | 06:27 | |
| *** bhavik1 has quit IRC | 06:31 | |
| *** salv-orlando has quit IRC | 06:32 | |
| *** dpawlik has quit IRC | 06:36 | |
| *** dpawlik has joined #openstack-infra | 06:41 | |
| *** dpawlik has quit IRC | 06:45 | |
| *** dpawlik has joined #openstack-infra | 06:46 | |
| *** dpawlik has quit IRC | 06:50 | |
| *** dpawlik has joined #openstack-infra | 06:51 | |
| *** benj_ has quit IRC | 06:56 | |
| *** eumel8 has joined #openstack-infra | 06:56 | |
| *** benj_ has joined #openstack-infra | 06:58 | |
| *** armaan has joined #openstack-infra | 06:59 | |
| *** tosky has joined #openstack-infra | 07:03 | |
| *** yamamoto has joined #openstack-infra | 07:06 | |
| *** Guest1988 has joined #openstack-infra | 07:10 | |
| *** ccamacho has joined #openstack-infra | 07:11 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: [WIP] Add Zuulv3 functional tests https://review.openstack.org/565046 | 07:12 |
| *** yamamoto has quit IRC | 07:13 | |
| *** spsurya has quit IRC | 07:14 | |
| *** shardy has joined #openstack-infra | 07:14 | |
| *** Guest1988 has quit IRC | 07:17 | |
| *** salv-orlando has joined #openstack-infra | 07:28 | |
| *** salv-orlando has quit IRC | 07:33 | |
| *** zoli is now known as zoli|wfh | 07:33 | |
| *** zoli|wfh is now known as zoli | 07:33 | |
| *** ssbarnea_ has joined #openstack-infra | 07:35 | |
| *** amoralej|off is now known as amoralej | 07:38 | |
| *** sree has quit IRC | 07:41 | |
| *** edmondsw has joined #openstack-infra | 07:42 | |
| *** sree has joined #openstack-infra | 07:42 | |
| *** jpich has joined #openstack-infra | 07:43 | |
| *** sree has quit IRC | 07:47 | |
| *** edmondsw has quit IRC | 07:47 | |
| *** lucas-afk is now known as lucasagomes | 07:54 | |
| *** e0ne has joined #openstack-infra | 07:57 | |
| *** hashar has joined #openstack-infra | 08:05 | |
| *** yamamoto has joined #openstack-infra | 08:08 | |
| *** sree has joined #openstack-infra | 08:12 | |
| *** florianf has joined #openstack-infra | 08:14 | |
| *** yamamoto has quit IRC | 08:14 | |
| *** sree has quit IRC | 08:17 | |
| *** ykarel is now known as ykarel|lunch | 08:20 | |
| *** sree has joined #openstack-infra | 08:27 | |
| *** derekh has joined #openstack-infra | 08:29 | |
| *** salv-orlando has joined #openstack-infra | 08:29 | |
| *** dbecker has joined #openstack-infra | 08:30 | |
| *** sree has quit IRC | 08:31 | |
| *** salv-orlando has quit IRC | 08:33 | |
| *** jogo has quit IRC | 08:35 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: Improve zuul stream tests https://review.openstack.org/565169 | 08:38 |
| *** nmathew has joined #openstack-infra | 08:41 | |
| *** sree has joined #openstack-infra | 08:48 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/os-loganalyze master: Support ANSI coloring in logs https://review.openstack.org/563947 | 08:50 |
| *** salv-orlando has joined #openstack-infra | 08:51 | |
| *** sree has quit IRC | 08:52 | |
| *** sree has joined #openstack-infra | 08:58 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: Improve zuul stream tests https://review.openstack.org/565169 | 08:59 |
| *** jogo has joined #openstack-infra | 09:00 | |
| *** spsurya has joined #openstack-infra | 09:00 | |
| *** sree has quit IRC | 09:02 | |
| *** dingyichen has quit IRC | 09:03 | |
| *** electrofelix has joined #openstack-infra | 09:06 | |
| *** sree has joined #openstack-infra | 09:08 | |
| *** yamamoto has joined #openstack-infra | 09:10 | |
| *** ykarel|lunch is now known as ykarel | 09:10 | |
| *** sree has quit IRC | 09:13 | |
| *** yamamoto has quit IRC | 09:16 | |
| *** panda|ruck|off is now known as panda|ruck | 09:19 | |
| *** sree has joined #openstack-infra | 09:19 | |
| *** sree has quit IRC | 09:28 | |
| *** nmathew has quit IRC | 09:29 | |
| *** owalsh_ is now known as owalsh | 09:33 | |
| openstackgerrit | Ian Wienand proposed openstack-dev/pbr master: Special case long_description_content_type https://review.openstack.org/565177 | 09:33 |
| *** sree has joined #openstack-infra | 09:37 | |
| *** yolanda_ is now known as yolanda | 09:39 | |
| *** sree has quit IRC | 09:41 | |
| *** sree has joined #openstack-infra | 09:48 | |
| *** sree has quit IRC | 09:52 | |
| *** inc0 has quit IRC | 09:57 | |
| *** rosmaita has joined #openstack-infra | 10:00 | |
| rosmaita | #startmeeting glance_bs | 10:01 |
| openstack | Meeting started Mon Apr 30 10:01:27 2018 UTC and is due to finish in 60 minutes. The chair is rosmaita. Information about MeetBot at http://wiki.debian.org/MeetBot. | 10:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 10:01 |
| *** openstack changes topic to " (Meeting topic: glance_bs)" | 10:01 | |
| openstack | The meeting name has been set to 'glance_bs' | 10:01 |
| rosmaita | meeting is only 45 min long, but i don't think there's a way to tell the meetbot that | 10:02 |
| rosmaita | also, there may be no one here today, i think everyone is on holiday | 10:03 |
| rosmaita | #link https://etherpad.openstack.org/p/glance-bug-squad-meeting | 10:03 |
| frickler | rosmaita: wrong channel? | 10:03 |
| rosmaita | ha! yes indeed | 10:04 |
| rosmaita | this meeting is way too early in my time zone ... sorry about that | 10:04 |
| rosmaita | #endmeeting | 10:04 |
| *** openstack changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 10:04 | |
| openstack | Meeting ended Mon Apr 30 10:04:46 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 10:04 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/glance_bs/2018/glance_bs.2018-04-30-10.01.html | 10:04 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/glance_bs/2018/glance_bs.2018-04-30-10.01.txt | 10:04 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/glance_bs/2018/glance_bs.2018-04-30-10.01.log.html | 10:04 |
| *** armaan has quit IRC | 10:12 | |
| *** yamamoto has joined #openstack-infra | 10:12 | |
| *** armaan has joined #openstack-infra | 10:12 | |
| *** armaan has quit IRC | 10:12 | |
| *** hashar is now known as hasharAway | 10:16 | |
| *** salv-orlando has quit IRC | 10:17 | |
| *** salv-orlando has joined #openstack-infra | 10:17 | |
| *** yamamoto has quit IRC | 10:17 | |
| *** kjackal has joined #openstack-infra | 10:19 | |
| *** salv-orlando has quit IRC | 10:22 | |
| *** wolverineav has joined #openstack-infra | 10:27 | |
| *** nicolasbock has joined #openstack-infra | 10:30 | |
| *** kjackal has quit IRC | 10:33 | |
| *** Hal has joined #openstack-infra | 10:54 | |
| *** Hal is now known as Guest81711 | 10:55 | |
| *** jcoufal has joined #openstack-infra | 11:01 | |
| *** lucasagomes is now known as lucas-hungry | 11:04 | |
| *** armaan has joined #openstack-infra | 11:09 | |
| *** arxcruz is now known as arxcruz|pto | 11:11 | |
| *** yamamoto has joined #openstack-infra | 11:14 | |
| *** yamamoto has quit IRC | 11:19 | |
| *** dave-mccowan has joined #openstack-infra | 11:27 | |
| *** dave-mccowan has quit IRC | 11:31 | |
| *** dave-mcc_ has joined #openstack-infra | 11:31 | |
| *** bobh has joined #openstack-infra | 11:33 | |
| *** ldnunes has joined #openstack-infra | 11:34 | |
| *** rfolco|off has joined #openstack-infra | 11:35 | |
| *** yamamoto has joined #openstack-infra | 11:39 | |
| *** AJaeger is now known as AJaeger_away | 11:39 | |
| hwoarang | hello @infra. Any thoughts on https://review.openstack.org/#/c/554620/ it's been sitting there for a while :) | 11:43 |
| *** rfolco|off is now known as rfolco | 11:47 | |
| *** panda|ruck is now known as panda|lunch | 11:51 | |
| *** amoralej is now known as amoralej|lunch | 11:55 | |
| *** lucas-hungry is now known as lucasagomes | 11:57 | |
| *** hasharAway is now known as hashar | 11:58 | |
| *** bobh has quit IRC | 11:59 | |
| *** bhujay has joined #openstack-infra | 12:04 | |
| *** edmondsw has joined #openstack-infra | 12:07 | |
| *** tpsilva has joined #openstack-infra | 12:11 | |
| *** trown|outtypewww is now known as trown | 12:18 | |
| frickler | hwoarang: commented | 12:19 |
| hwoarang | frickler: good point thanks | 12:23 |
| *** kzaitsev_pi has quit IRC | 12:23 | |
| *** yamamoto has quit IRC | 12:25 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/system-config master: modules: openstack_project: Mirror some additional openSUSE repositories https://review.openstack.org/554620 | 12:26 |
| *** yamamoto has joined #openstack-infra | 12:26 | |
| *** panda|lunch is now known as panda|ruck | 12:28 | |
| *** kzaitsev_pi has joined #openstack-infra | 12:30 | |
| *** rlandy has joined #openstack-infra | 12:33 | |
| *** kgiusti has joined #openstack-infra | 12:36 | |
| *** amoralej|lunch is now known as amoralej | 12:36 | |
| dhellmann | infra-root: we have a release notes job failure with a problem we think we fixed in reno last week. is there some way to tell which version of reno was used in the job? it's not obvious from the logs. http://logs.openstack.org/b2/b2c635be0bcdf16f7fac256ef37c7f047efd769a/tag/publish-openstack-releasenotes/c81da3b/job-output.txt.gz | 12:38 |
| *** kzaitsev_pi has quit IRC | 12:39 | |
| *** kzaitsev_pi has joined #openstack-infra | 12:40 | |
| frickler | dhellmann: reno===2.9.1 (from -c /home/zuul/src/git.openstack.org/openstack/requirements/upper-constraints.txt hidden in http://logs.openstack.org/b2/b2c635be0bcdf16f7fac256ef37c7f047efd769a/tag/publish-openstack-releasenotes/c81da3b/ara-report/result/ca7de263-a73c-4ee5-bcca-7d15752536e2/ | 12:40 |
| mordred | yah. "cmd": "/home/zuul/.venv/bin/pip2 install -c /home/zuul/src/git.openstack.org/openstack/requirements/upper-constraints.txt reno", | 12:41 |
| dhellmann | ok, so we no longer put all of the details in the job output? we have to know which parts of the job to dig into in the ara reports? | 12:42 |
| dhellmann | frickler : how would I get to that data by starting from http://logs.openstack.org/b2/b2c635be0bcdf16f7fac256ef37c7f047efd769a/tag/publish-openstack-releasenotes/c81da3b/ara-report/ ? | 12:43 |
| *** jaosorior has quit IRC | 12:43 | |
| mordred | dhellmann: not on purpose - I would consider lack of that data in a reasonable place to be a bug | 12:43 |
| dhellmann | is that "install base doc building packages"? in one of 2 pre.yaml steps? | 12:43 |
| frickler | dhellmann: well, what I did is look for the first occurrence of "reno" in "job-output.txt.gz", that pointed me to the "ensure-sphinx" role. I looked for that in the ara-report | 12:44 |
| dhellmann | mordred : yeah, I wish we defaulted to using "set -x" as much as possible, too | 12:44 |
| dhellmann | frickler : ok, thanks for the tip. I know where to look in things I've written myself but I haven't yet built up the knowledge about how to track stuff down in other jobs | 12:45 |
| dhellmann | smcginnis : it does appear that job used the release we thought fixed the problem | 12:45 |
| dhellmann | I'll put that on my list for today | 12:45 |
| frickler | dhellmann: you can also look in job-output.json.gz, which should have all the output that ara-report has, too, just in slightly convoluted form | 12:45 |
| dhellmann | so the json file contains more output than the text file? | 12:46 |
| mordred | yah. we have a todo list item btw to render a more useful form of job-output.json | 12:46 |
| mordred | yes | 12:46 |
| dhellmann | ok, I didn't realize that eitehr | 12:46 |
| dhellmann | thanks for your help! | 12:46 |
| mordred | dhellmann: the json file has *everything* - the console output file has a subset of that which is what we produce for the purposes of live streaming (if we put everything into the live stream it would be unreadable) | 12:47 |
| dhellmann | ok, that makes sense | 12:47 |
| mordred | the aim for the future is to have a version of the console output that's built from the json to allow expanding and exposing all of the data when needed | 12:47 |
| mordred | but yeah - it can be a little wonk at the moment - sorry about that | 12:48 |
| dhellmann | most of the time I would honestly be happy with 1 big text file. I know they're big, but searching when you don't know how a job works is so much easier | 12:48 |
| *** finucannot is now known as stephenfin | 12:54 | |
| *** gouthamr has quit IRC | 12:59 | |
| *** jamesmcarthur has joined #openstack-infra | 12:59 | |
| *** dhill_ has quit IRC | 13:01 | |
| *** gouthamr has joined #openstack-infra | 13:02 | |
| frickler | infra-root: FYI, there's a bank holiday here tomorrow, so I mostly won't be online and probably skip the meeting, too | 13:05 |
| *** eharney has joined #openstack-infra | 13:06 | |
| *** salv-orlando has joined #openstack-infra | 13:09 | |
| *** salv-orlando has quit IRC | 13:10 | |
| *** salv-orlando has joined #openstack-infra | 13:10 | |
| *** agopi has joined #openstack-infra | 13:12 | |
| *** mriedem has joined #openstack-infra | 13:17 | |
| *** dhill_ has joined #openstack-infra | 13:21 | |
| *** ihar has joined #openstack-infra | 13:21 | |
| *** links has quit IRC | 13:22 | |
| *** kjackal has joined #openstack-infra | 13:24 | |
| *** anteaya has joined #openstack-infra | 13:26 | |
| *** camunoz has joined #openstack-infra | 13:26 | |
| *** superdan is now known as dansmith | 13:29 | |
| *** armaan has quit IRC | 13:31 | |
| *** esberglu has joined #openstack-infra | 13:31 | |
| *** armaan has joined #openstack-infra | 13:31 | |
| *** sree has joined #openstack-infra | 13:31 | |
| *** ssbarnea_ has quit IRC | 13:34 | |
| *** jroll has quit IRC | 13:36 | |
| *** ssbarnea_ has joined #openstack-infra | 13:36 | |
| *** lbragstad has joined #openstack-infra | 13:37 | |
| *** rh-jelabarre has quit IRC | 13:38 | |
| *** jroll has joined #openstack-infra | 13:38 | |
| *** armaan has quit IRC | 13:39 | |
| *** armaan has joined #openstack-infra | 13:39 | |
| *** armaan has quit IRC | 13:39 | |
| *** armaan has joined #openstack-infra | 13:40 | |
| *** gouthamr has quit IRC | 13:42 | |
| *** gouthamr has joined #openstack-infra | 13:45 | |
| *** rh-jelabarre has joined #openstack-infra | 13:46 | |
| *** r-daneel has joined #openstack-infra | 13:47 | |
| *** pbourke has quit IRC | 13:47 | |
| *** armaan has quit IRC | 13:55 | |
| *** pbourke has joined #openstack-infra | 13:56 | |
| *** armaan has joined #openstack-infra | 13:56 | |
| *** ykarel is now known as ykarel|away | 13:56 | |
| *** florianf has quit IRC | 13:57 | |
| *** xarses has quit IRC | 14:03 | |
| *** Swimingly has quit IRC | 14:04 | |
| *** Swimingly has joined #openstack-infra | 14:04 | |
| *** hongbin has joined #openstack-infra | 14:05 | |
| *** felipemonteiro has joined #openstack-infra | 14:05 | |
| *** sree has quit IRC | 14:06 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:07 | |
| *** felipemonteiro has quit IRC | 14:11 | |
| *** ykarel|away has quit IRC | 14:11 | |
| *** bobh has joined #openstack-infra | 14:14 | |
| *** janki has quit IRC | 14:16 | |
| *** jchhatbar has joined #openstack-infra | 14:16 | |
| *** eumel8 has quit IRC | 14:17 | |
| *** jchhatbar has quit IRC | 14:17 | |
| *** jchhatbar has joined #openstack-infra | 14:17 | |
| pabelanger | frickler: ack | 14:20 |
| *** eharney has quit IRC | 14:22 | |
| *** e0ne has quit IRC | 14:26 | |
| *** rajinir has joined #openstack-infra | 14:28 | |
| *** chandankumar is now known as chkumar|off | 14:30 | |
| *** armaan has quit IRC | 14:30 | |
| *** armaan has joined #openstack-infra | 14:31 | |
| *** hemna_ has joined #openstack-infra | 14:31 | |
| *** dpawlik has quit IRC | 14:35 | |
| *** armaan has quit IRC | 14:35 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/infra-specs master: Ansiblify control plane https://review.openstack.org/469983 | 14:39 |
| *** eernst has joined #openstack-infra | 14:44 | |
| *** jchhatbar has quit IRC | 14:45 | |
| *** eernst has quit IRC | 14:49 | |
| *** ykarel|away has joined #openstack-infra | 14:50 | |
| corvus | dhellmann: we fixed the problems we found after the restart on friday, and are now running zuul with the memory improvements. due to a quirk we weren't aware of, we accidentally tested it with the equivalent of 820 simultaneous dynamic configuration changes... so i think we can safely say that we no longer need to limit config changes due to memory usage. | 14:53 |
| corvus | EmilienM: ^ | 14:53 |
| *** eernst has joined #openstack-infra | 14:53 | |
| corvus | i'll send a note to -dev | 14:53 |
| *** jamesmcarthur has quit IRC | 14:53 | |
| EmilienM | o/ | 14:53 |
| EmilienM | corvus: in other words, I'll stop breaking zuul memory with my stupid patches? :-) | 14:54 |
| corvus | EmilienM: there are so many other great ways to break the system! use all the nodes! | 14:55 |
| EmilienM | you don't want to challenge me :-P | 14:55 |
| fungi | i have faith you'll find a way | 14:56 |
| fungi | ;) | 14:56 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Updated binary dependencies https://review.openstack.org/565235 | 14:57 |
| pabelanger | indeed, http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=64792 is most awesome now! Great work to all | 14:58 |
| *** smarcet has joined #openstack-infra | 14:58 | |
| smarcet | fungi: morning hope that everything is ok with you, just need a review here https://review.openstack.org/#/c/565235/, i discovered a missing dependency , and updated puppet script regards | 14:59 |
| fungi | smarcet: thanks for the heads up, i'll take a look now | 14:59 |
| *** beekneemech is now known as bnemec | 15:00 | |
| fungi | any other puppet-config-core available to take a quick look at a package addition to get openstackid builds back on track? https://review.openstack.org/565235 | 15:02 |
| *** persia has quit IRC | 15:03 | |
| dhellmann | corvus : nice, thanks for the heads-up :) | 15:05 |
| *** rh-jelabarre has quit IRC | 15:10 | |
| clarkb | corvus: re 820 changes to test it, when I figured out my local test env I used a quick naive patch to address that to test that I could run the tests and a lot of things failed. I must be missing some reliance on the layout generation in non live items | 15:12 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Static driver: Use node states defined in zk.py https://review.openstack.org/565238 | 15:14 |
| *** jamesmcarthur has joined #openstack-infra | 15:14 | |
| *** ykarel|away has quit IRC | 15:16 | |
| *** xinliang has quit IRC | 15:17 | |
| *** xinliang has joined #openstack-infra | 15:17 | |
| *** jamesmca_ has joined #openstack-infra | 15:17 | |
| fungi | heading out to grab a quick lunch but will be back shortly | 15:17 |
| *** jamesmcarthur has quit IRC | 15:17 | |
| clarkb | corvus: they appear to be test_crd_* tests so probably when the repos aren't the same? I'm letting it actually run now and will get a sense for what is going on | 15:17 |
| *** jamesmca_ has quit IRC | 15:18 | |
| *** jamesmcarthur has joined #openstack-infra | 15:19 | |
| *** felipemonteiro_ has quit IRC | 15:19 | |
| *** dpawlik has joined #openstack-infra | 15:20 | |
| *** smarcet has quit IRC | 15:21 | |
| *** janki has joined #openstack-infra | 15:22 | |
| *** hashar is now known as hasharAway | 15:23 | |
| *** larainema has joined #openstack-infra | 15:23 | |
| *** armaan has joined #openstack-infra | 15:23 | |
| *** smarcet has joined #openstack-infra | 15:23 | |
| *** jamesmcarthur has quit IRC | 15:23 | |
| *** smarcet has quit IRC | 15:23 | |
| *** armaan has quit IRC | 15:24 | |
| *** armaan has joined #openstack-infra | 15:24 | |
| *** dpawlik has quit IRC | 15:24 | |
| *** dpawlik has joined #openstack-infra | 15:26 | |
| *** dpawlik has quit IRC | 15:26 | |
| *** dpawlik has joined #openstack-infra | 15:27 | |
| *** dpawlik has quit IRC | 15:27 | |
| *** salv-orlando has quit IRC | 15:29 | |
| *** salv-orlando has joined #openstack-infra | 15:29 | |
| *** chkumar|off is now known as chandankumar | 15:29 | |
| *** smarcet has joined #openstack-infra | 15:31 | |
| *** salv-orlando has quit IRC | 15:34 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackid master: Updated binary dependencies https://review.openstack.org/565235 | 15:38 |
| mriedem | hmm, is there some reason the #openstack-placement irc channel isn't logged? http://eavesdrop.openstack.org/irclogs/%23openstack-placement/ | 15:39 |
| *** janki has quit IRC | 15:39 | |
| *** kjackal has quit IRC | 15:39 | |
| clarkb | mriedem: the openstack nick is what does the logging, I'm guessing that channel was never added to that bots config | 15:40 |
| mriedem | ok is that defined in project-config? | 15:40 |
| clarkb | mriedem: you want ot update openstack-infra/system-config/hiera/common.yaml's meetbot_channels key | 15:41 |
| *** janki has joined #openstack-infra | 15:41 | |
| mriedem | ack, thanks | 15:41 |
| *** caphrim007 has joined #openstack-infra | 15:41 | |
| clarkb | mriedem: https://docs.openstack.org/infra/system-config/irc.html should talk about base requirements for that too (channel permissions) | 15:42 |
| *** kjackal has joined #openstack-infra | 15:43 | |
| *** janki has quit IRC | 15:44 | |
| *** eharney has joined #openstack-infra | 15:44 | |
| *** janki has joined #openstack-infra | 15:45 | |
| *** jamesmcarthur has joined #openstack-infra | 15:45 | |
| *** M4g1c5t0rM_ has joined #openstack-infra | 15:45 | |
| *** M4g1c5t0rM has quit IRC | 15:48 | |
| *** janki has quit IRC | 15:52 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Static driver: Use node states defined in zk.py https://review.openstack.org/565238 | 15:53 |
| *** electrofelix has quit IRC | 15:54 | |
| mriedem | clarkb: docs look ok already https://docs.openstack.org/infra/system-config/irc.html#logging | 15:56 |
| mriedem | oh channel permissions | 15:56 |
| mriedem | i guess you're just telling me this was already documented, i just didn't see the docs | 15:57 |
| *** rkukura has joined #openstack-infra | 15:58 | |
| clarkb | mriedem: well wanted to make sure you saw the requirements | 15:58 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/system-config master: Register meetbot for #openstack-placement irc logging https://review.openstack.org/565246 | 15:58 |
| mriedem | i'm not really seeing anything in the docs about meetbot permissions; only thing in that doc about permissions is accessbot | 15:59 |
| *** janki has joined #openstack-infra | 15:59 | |
| *** dtantsur is now known as dtantsur|afk | 16:02 | |
| *** ramishra has quit IRC | 16:03 | |
| corvus | mriedem: i believe the channel has to appear in the accessbot configuration before the other bots can use it (accessbot will make sure perms are correct). placement is already there, so it's good. | 16:04 |
| openstackgerrit | Lenny Verkhovsky proposed openstack-infra/irc-meetings master: Cancelling weekly ThirdParty meeting. https://review.openstack.org/561804 | 16:06 |
| *** lucasagomes is now known as lucas-hungry | 16:08 | |
| mriedem | ah ok | 16:08 |
| *** ijw has joined #openstack-infra | 16:09 | |
| *** trown is now known as trown|lunch | 16:11 | |
| *** ijw has quit IRC | 16:12 | |
| *** felipemonteiro has joined #openstack-infra | 16:12 | |
| *** sree has joined #openstack-infra | 16:18 | |
| *** udesale has quit IRC | 16:18 | |
| *** thedac has joined #openstack-infra | 16:19 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Don't generate layouts on non live items https://review.openstack.org/565251 | 16:20 |
| *** armaan has quit IRC | 16:22 | |
| *** felipemonteiro_ has joined #openstack-infra | 16:26 | |
| *** felipemonteiro has quit IRC | 16:29 | |
| *** jpich has quit IRC | 16:32 | |
| *** jamesmcarthur has quit IRC | 16:32 | |
| *** zoli is now known as zoli|gone | 16:37 | |
| *** zoli|gone is now known as zoli | 16:37 | |
| *** jiapei_ has joined #openstack-infra | 16:39 | |
| *** sree_ has joined #openstack-infra | 16:41 | |
| *** sree_ is now known as Guest43034 | 16:41 | |
| *** bhujay has quit IRC | 16:42 | |
| *** sree has quit IRC | 16:44 | |
| *** sree has joined #openstack-infra | 16:45 | |
| *** felipemonteiro_ has quit IRC | 16:46 | |
| *** Guest43034 has quit IRC | 16:46 | |
| *** felipemonteiro_ has joined #openstack-infra | 16:46 | |
| *** jiapei_ is now known as jiapei | 16:49 | |
| ihar | when I try to change base for a stable/ocata with Rebase button, I get error 500 | 16:50 |
| ihar | I try to rebase https://review.openstack.org/#/c/561421/ on top of https://review.openstack.org/#/c/565255/ | 16:50 |
| clarkb | ihar: is there a merge conflict/ | 16:51 |
| *** ykarel has joined #openstack-infra | 16:52 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Cancelling weekly ThirdParty meeting. https://review.openstack.org/561804 | 16:52 |
| clarkb | ihar: they are different projects | 16:52 |
| clarkb | so 500 error is expected (though gerrit should be ebtter about explaining these errors to people) | 16:53 |
| ihar | clarkb: haha, oh well I mixed things. | 16:53 |
| openstackgerrit | Ben Nemec proposed openstack-dev/pbr master: Read description file as utf-8 https://review.openstack.org/564874 | 16:55 |
| *** armaan has joined #openstack-infra | 16:57 | |
| *** jamesmcarthur has joined #openstack-infra | 16:57 | |
| *** hasharAway is now known as hashar | 17:01 | |
| *** hashar is now known as hasharAway | 17:01 | |
| *** derekh has quit IRC | 17:02 | |
| *** spsurya has quit IRC | 17:04 | |
| *** panda|ruck is now known as panda|ruck|off | 17:04 | |
| *** salv-orlando has joined #openstack-infra | 17:08 | |
| pabelanger | clarkb: mind a +3 on https://review.openstack.org/564775/ want to start work to build fedora-28 images today if possible | 17:18 |
| mtreinish | clarkb: hah, you should probably add this to your python packaging talk: https://xkcd.com/1987/ | 17:24 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Don't generate layouts on non live items https://review.openstack.org/565251 | 17:24 |
| clarkb | mtreinish: ya, fitting considering the pip10 release (I'm guessing that they are related) | 17:25 |
| *** sree has quit IRC | 17:27 | |
| *** sree has joined #openstack-infra | 17:27 | |
| *** jcoufal_ has joined #openstack-infra | 17:31 | |
| *** sree has quit IRC | 17:32 | |
| fungi | it's cc-by-nc though, which may encumber your talk content | 17:32 |
| fungi | i love "another pip??" | 17:33 |
| *** jcoufal has quit IRC | 17:34 | |
| *** trown|lunch is now known as trown | 17:34 | |
| corvus | fungi, clarkb: probably not a major impediment: https://xkcd.com/license.html | 17:35 |
| openstackgerrit | Merged openstack-infra/system-config master: Updates for fedora-28 rsync https://review.openstack.org/564771 | 17:35 |
| fungi | corvus: yeah, more that the noncommercial use clause carries over to anyone who wants to repurpose the talk in other ways. but meh, it's probably not a big deal | 17:36 |
| *** ykarel is now known as ykarel|away | 17:37 | |
| *** sambetts is now known as sambetts|afk | 17:37 | |
| fungi | less challenging in some ways than parts of the gfdl | 17:37 |
| corvus | ya | 17:37 |
| *** salv-orlando has quit IRC | 17:39 | |
| *** yamahata has joined #openstack-infra | 17:39 | |
| *** amoralej is now known as amoralej|off | 17:40 | |
| *** salv-orlando has joined #openstack-infra | 17:40 | |
| *** salv-orlando has quit IRC | 17:44 | |
| *** shardy is now known as shardy_afk | 17:45 | |
| notmyname | where are the "bot reports project patches for XXX branch in IRC channel" stored? I need to make an update | 17:51 |
| notmyname | I only do it about once a year, so I never remember where | 17:51 |
| clarkb | notmyname: openstack-infra/project-config/gerritbot/channels.yaml | 17:52 |
| fungi | notmyname: openstack-infra/project-config gerritbot/channels.yaml | 17:52 |
| notmyname | thanks :-) | 17:52 |
| openstackgerrit | John Dickinson proposed openstack-infra/project-config master: change irc bot branch reporting: remove s3api and add deep-review https://review.openstack.org/565269 | 17:54 |
| *** kien-ha has joined #openstack-infra | 17:56 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Add Zuulv3 jobs for puppet functional testing https://review.openstack.org/565270 | 17:57 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: [WIP] Add Zuulv3 functional tests https://review.openstack.org/565046 | 17:57 |
| *** armaan has quit IRC | 17:58 | |
| *** ykarel|away has quit IRC | 18:02 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Add Zuulv3 jobs for puppet functional testing https://review.openstack.org/565270 | 18:03 |
| *** r-daneel has quit IRC | 18:06 | |
| *** r-daneel has joined #openstack-infra | 18:06 | |
| *** dave-mcc_ has quit IRC | 18:21 | |
| Shrews | pabelanger: oops, looking at wrong nb* logs | 18:23 |
| pabelanger | n | 18:23 |
| pabelanger | np* | 18:23 |
| pabelanger | it was /var/log/nodepool/builder-debug.log for people playing at home on nb03.o.o | 18:24 |
| *** smarcet has quit IRC | 18:24 | |
| Shrews | pabelanger: 2018-04-26 17:23:23,276 WARNING kazoo.client: Cannot resolve nodepool.openstack.org: [Errno -3] Temporary failure in name resolution | 18:27 |
| Shrews | pabelanger: iirc, that was the same thing i saw last time | 18:27 |
| Shrews | pabelanger: it probably hoses the python networking stack, forcing a restart to correct. My best guess, at least | 18:28 |
| *** felipemonteiro__ has joined #openstack-infra | 18:29 | |
| Shrews | pabelanger: i'd recommend moving off of arm, personally | 18:29 |
| *** dave-mccowan has joined #openstack-infra | 18:29 | |
| clarkb | Shrews: we'd have to figure cross building images for arm in that case | 18:30 |
| *** lathiat has quit IRC | 18:30 | |
| corvus | i very much doubt that error is related to arm | 18:30 |
| Shrews | clarkb: ah, good point | 18:30 |
| Shrews | corvus: i thought it was you (or maybe clarkb?) that mentioned odd networking issues on arm | 18:31 |
| corvus | if kazoo is caching something too agressively, maybe we should either see about fixing kazoo, or perhaps we can more forcibly restart the kazoo client ourselves | 18:31 |
| Shrews | either way, that's the obvious thing in common | 18:31 |
| corvus | Shrews: i don't think it was me, but i think a temporary dns failure is probably not something that should tank our server process | 18:32 |
| *** felipemonteiro_ has quit IRC | 18:32 | |
| pabelanger | Shrews: yah, the networking their isn't the best, it's in china | 18:32 |
| corvus | Shrews: it's more likely that our arm environment happens to be in a place with not-great networking | 18:32 |
| corvus | so the same thing could happen anywhere | 18:32 |
| pabelanger | there* | 18:33 |
| *** kien-ha has quit IRC | 18:35 | |
| *** eernst has quit IRC | 18:38 | |
| *** salv-orlando has joined #openstack-infra | 18:40 | |
| *** e0ne has joined #openstack-infra | 18:42 | |
| *** hasharAway is now known as hashar | 18:44 | |
| *** xinliang has quit IRC | 18:45 | |
| *** salv-orlando has quit IRC | 18:45 | |
| *** eharney has quit IRC | 18:46 | |
| *** janki has quit IRC | 18:52 | |
| *** xinliang has joined #openstack-infra | 18:57 | |
| *** xinliang has quit IRC | 18:57 | |
| *** xinliang has joined #openstack-infra | 18:57 | |
| *** eharney has joined #openstack-infra | 18:59 | |
| *** eernst has joined #openstack-infra | 19:08 | |
| tosky | uhm, I see an unexpected failure in a sahara-tests-scenario about a missing shade module; the same code was working until last week | 19:15 |
| tosky | and this time I'm pretty sure I didn't touch anything | 19:15 |
| tosky | compare: http://logs.openstack.org/77/565277/1/check/sahara-tests-scenario/1ac58f9/job-output.txt.gz#_2018-04-30_19_09_42_678854 | 19:15 |
| tosky | with http://logs.openstack.org/37/563537/3/check/sahara-tests-scenario/7641d18/job-output.txt.gz | 19:15 |
| *** inc0 has joined #openstack-infra | 19:20 | |
| *** hemna_ has quit IRC | 19:22 | |
| pabelanger | tosky: looks like shade is no longer installed for some reason | 19:25 |
| tosky | pabelanger: but it's in required-projects and even the devstack plugin is called | 19:25 |
| tosky | maybe something related to the changes in configuration caching? | 19:25 |
| clarkb | pabelanger: sorry reviewing fedora change now. Was using this morning as a local network hygiene day as things have become less reliable with the warmer weather (update all the things!) | 19:25 |
| pabelanger | tosky: not sure, I wonder if something in devstack changes recently | 19:26 |
| pabelanger | changed* | 19:27 |
| tosky | nothing apparently related | 19:28 |
| clarkb | required project will just ensure the code is checked out not installed | 19:28 |
| clarkb | it is up to the job itself to install shade | 19:28 |
| tosky | clarkb: calling the devstack plugin? | 19:30 |
| *** caphrim007 has quit IRC | 19:30 | |
| *** wolverineav has quit IRC | 19:31 | |
| Shrews | tosky: shade 1.28.0 was just released (https://review.openstack.org/564752) a few hours ago. not sure if that's related | 19:31 |
| tosky | uhm | 19:31 |
| *** wolverineav has joined #openstack-infra | 19:31 | |
| tosky | for the record: the same job was working for almost two months | 19:31 |
| clarkb | the enable plugin is gone in the local.conf | 19:32 |
| clarkb | if you compare the two | 19:32 |
| clarkb | so we need to work backwards on that and see why | 19:32 |
| tosky | ok, so either enable_plugin is now defined somewhere else and I need to define it for all nodes, or something else happened | 19:33 |
| clarkb | according to http://logs.openstack.org/77/565277/1/check/sahara-tests-scenario/1ac58f9/zuul-info/inventory.yaml it isn't configured on the job anymore | 19:33 |
| pabelanger | clarkb: thanks! | 19:34 |
| clarkb | https://git.openstack.org/cgit/openstack/sahara-tests/tree/.zuul.yaml#n72 is where it should be configured from | 19:34 |
| openstackgerrit | Merged openstack-infra/project-config master: Build fedora-28 DIBs with nodepool-builder https://review.openstack.org/564775 | 19:34 |
| *** eharney has quit IRC | 19:34 | |
| clarkb | http://logs.openstack.org/77/565277/1/check/sahara-tests-scenario/1ac58f9/zuul-info/inventory.yaml I would expect that to have devstack_plugins under the controller node's vars | 19:35 |
| *** wolverineav has quit IRC | 19:35 | |
| tosky | yep, like last week's run: http://logs.openstack.org/37/563537/3/check/sahara-tests-scenario/7641d18/zuul-info/inventory.yaml | 19:36 |
| clarkb | tosky: that one doesn't have it either | 19:37 |
| clarkb | tosky: look at the very end of the file | 19:37 |
| clarkb | tosky: I think controller: null is where there should be a controller: vars: stuff ? | 19:37 |
| tosky | clarkb: it's in vars: | 19:38 |
| clarkb | tosky: ya thats the top level vars from the old config | 19:38 |
| clarkb | https://review.openstack.org/#/c/547669/ is what changed things and it merged after that job you linked | 19:38 |
| clarkb | tosky: http://logs.openstack.org/69/547669/21/gate/sahara-tests-scenario/f85e8ce/zuul-info/inventory.yaml is what it should look like and its actually at the top of the file so I was wrong but on the right track | 19:39 |
| tosky | clarkb: it's the job that I was discussing last week, in fact, but if you see it worked after a recheck | 19:39 |
| tosky | and the base job did work | 19:39 |
| clarkb | so ya the issue appears to be we aren't getting the host specific devstack_plugins var set on the controller host | 19:40 |
| clarkb | corvus: ^ this may be related to configuration chagnes? | 19:40 |
| tosky | and it was working until something else happened | 19:40 |
| tosky | this is my original question: what did it change in zuul? :) | 19:41 |
| *** salv-orlando has joined #openstack-infra | 19:41 | |
| clarkb | sure, but we need to work backwards from that since any of millions of moving parts can change | 19:42 |
| clarkb | otherwise its navigating in the dark | 19:42 |
| corvus | clarkb: also we need to keep in mind the broken configuration from earlier | 19:43 |
| clarkb | corvus: if it were the broken configuration it should be better at this point and a recheck would be happy? | 19:44 |
| corvus | clarkb: i haven't verified | 19:44 |
| *** d0ugal has quit IRC | 19:45 | |
| *** salv-orlando has quit IRC | 19:46 | |
| *** d0ugal has joined #openstack-infra | 19:46 | |
| corvus | in addition to the config parsing changes, we also changed how host/group vars are laid down in the inventory file | 19:46 |
| corvus | pabelanger: ^ | 19:46 |
| openstackgerrit | Merged openstack-dev/pbr master: Don't poke in pip for requests https://review.openstack.org/565089 | 19:47 |
| clarkb | my reread of _deepUpdate is that it should be fine for this scenario | 19:47 |
| corvus | oh, nope that hasn't merged yet | 19:48 |
| *** caphrim007 has joined #openstack-infra | 19:48 | |
| corvus | https://review.openstack.org/559406 depends on https://review.openstack.org/559405 | 19:48 |
| *** armaan has joined #openstack-infra | 19:48 | |
| corvus | clarkb: have i understood correctly that https://git.openstack.org/cgit/openstack/sahara-tests/tree/.zuul.yaml#n72 says that there should be a devstack_plugins var under the controller section in http://logs.openstack.org/77/565277/1/check/sahara-tests-scenario/1ac58f9/zuul-info/inventory.yaml ? | 19:49 |
| clarkb | corvus: correct, and you can see it working at http://logs.openstack.org/69/547669/21/gate/sahara-tests-scenario/f85e8ce/zuul-info/inventory.yaml | 19:50 |
| clarkb | this is the log from the change that added the line 72 config to that job | 19:50 |
| corvus | clarkb: i wonder if https://review.openstack.org/559405 will fail a recheck now that my config changes landed | 19:51 |
| corvus | issued recheck and will run that test locally | 19:51 |
| clarkb | ok | 19:51 |
| corvus | check-hostvars: FAILURE | 19:52 |
| corvus | so... yay we have a failing test :) | 19:52 |
| *** caphrim007 has quit IRC | 19:52 | |
| *** diablo_rojo has joined #openstack-infra | 19:53 | |
| corvus | i have spotted an error in model.py -- it's combining host_vars and vars | 19:55 |
| corvus | that fixes it; patch inbound | 19:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Increase unit testing of host / group vars https://review.openstack.org/559405 | 19:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Inventory groups should be under children key https://review.openstack.org/559406 | 19:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fix host_vars https://review.openstack.org/565293 | 19:59 |
| corvus | bugfix, test, and pabelanger's new feature stacked in order | 19:59 |
| tosky | thanks | 19:59 |
| corvus | clarkb, pabelanger, mordred, tobias, tosky: ^ | 19:59 |
| corvus | tobiash even | 19:59 |
| openstackgerrit | Merged openstack-infra/zuul master: Don't generate layouts on non live items https://review.openstack.org/565251 | 20:00 |
| *** d0ugal_ has joined #openstack-infra | 20:00 | |
| clarkb | corvus: I'll look shortly. lunch is heating up now | 20:00 |
| corvus | tosky: sorry about that; i should have picked up on the importance of that test and nudged folks to review it sooner | 20:00 |
| *** rockyg has joined #openstack-infra | 20:01 | |
| *** dave-mccowan has quit IRC | 20:02 | |
| *** d0ugal has quit IRC | 20:02 | |
| *** sree has joined #openstack-infra | 20:03 | |
| clarkb | corvus: the last in the stack has all the +2s it needs, do we want to combine that into the restart I'm assuming we'll be doing soon? | 20:05 |
| corvus | clarkb: i think so | 20:06 |
| *** sree has quit IRC | 20:08 | |
| *** pcichy has joined #openstack-infra | 20:12 | |
| *** felipemonteiro__ has quit IRC | 20:12 | |
| *** jamesmcarthur has quit IRC | 20:14 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Freeze regex projects https://review.openstack.org/565294 | 20:14 |
| *** jamesmcarthur has joined #openstack-infra | 20:15 | |
| *** dave-mccowan has joined #openstack-infra | 20:16 | |
| *** hemna_ has joined #openstack-infra | 20:18 | |
| *** tpsilva has quit IRC | 20:18 | |
| *** d0ugal_ has quit IRC | 20:18 | |
| *** d0ugal_ has joined #openstack-infra | 20:19 | |
| *** jamesmcarthur has quit IRC | 20:19 | |
| *** kjackal has quit IRC | 20:23 | |
| openstackgerrit | Merged openstack-infra/zuul master: Fix host_vars https://review.openstack.org/565293 | 20:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Freeze regex projects https://review.openstack.org/565294 | 20:26 |
| *** slaweq_ has joined #openstack-infra | 20:27 | |
| *** eernst has quit IRC | 20:27 | |
| *** eernst has joined #openstack-infra | 20:28 | |
| *** eernst_ has joined #openstack-infra | 20:29 | |
| *** eernst has quit IRC | 20:29 | |
| *** jamesmcarthur has joined #openstack-infra | 20:30 | |
| *** larainema has quit IRC | 20:35 | |
| *** jamesmcarthur has quit IRC | 20:35 | |
| *** eernst_ has quit IRC | 20:36 | |
| *** d0ugal_ has quit IRC | 20:36 | |
| *** eernst has joined #openstack-infra | 20:36 | |
| *** eharney has joined #openstack-infra | 20:37 | |
| pabelanger | yay for unit tests | 20:39 |
| *** kgiusti has left #openstack-infra | 20:39 | |
| *** salv-orlando has joined #openstack-infra | 20:42 | |
| *** d0ugal_ has joined #openstack-infra | 20:43 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add waits to test_nodepool_priority https://review.openstack.org/565335 | 20:44 |
| *** pcichy has quit IRC | 20:45 | |
| *** salv-orlando has quit IRC | 20:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Set min-ready 1 for fedora-28 https://review.openstack.org/565337 | 20:47 |
| pabelanger | ianw: clarkb: brings fedora-28 nodes online, no issues building it: http://nb02.openstack.org/fedora-28-0000000001.log | 20:48 |
| pabelanger | we'll also be creating fedora-latest nodeset for jobs to use, like we did for debian-stable. That should help cutdown on the amount of jobs we have to modify every 6 months | 20:49 |
| *** slaweq has quit IRC | 20:50 | |
| fungi | well, i hope debian stable releases continue to come at about the same pace as ubuntu lts releases | 20:51 |
| efried | Hey, anybody know Matthieu Huin? | 20:53 |
| pabelanger | efried: mhu IRC handle | 20:53 |
| efried | pabelanger: Thanks! Any idea where/when he hangs out? | 20:54 |
| *** slaweq_ is now known as slaweq | 20:54 | |
| pabelanger | efried: #rdo / #softwarefactory IIRC | 20:54 |
| efried | pabelanger: Thank you. | 20:54 |
| pabelanger | np | 20:54 |
| *** dave-mccowan has quit IRC | 20:55 | |
| *** agopi has quit IRC | 20:59 | |
| *** eernst has quit IRC | 21:00 | |
| *** rockyg has quit IRC | 21:01 | |
| *** eernst_ has joined #openstack-infra | 21:02 | |
| ianw | pabelanger: cool, will look | 21:04 |
| *** hashar has quit IRC | 21:07 | |
| *** edmondsw has quit IRC | 21:07 | |
| *** trown is now known as trown|outtypewww | 21:10 | |
| *** armaan has quit IRC | 21:10 | |
| *** edmondsw_ has joined #openstack-infra | 21:11 | |
| *** jcoufal_ has quit IRC | 21:11 | |
| *** armaan has joined #openstack-infra | 21:11 | |
| *** armaan_ has joined #openstack-infra | 21:12 | |
| *** armaan has quit IRC | 21:12 | |
| *** ldnunes has quit IRC | 21:14 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: add test jobs to goal-tools repository https://review.openstack.org/565343 | 21:14 |
| *** edmondsw_ has quit IRC | 21:15 | |
| *** armaan_ has quit IRC | 21:22 | |
| *** esberglu has quit IRC | 21:22 | |
| *** aeng has joined #openstack-infra | 21:29 | |
| *** d0ugal_ has quit IRC | 21:32 | |
| *** d0ugal_ has joined #openstack-infra | 21:35 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add release note about config memory improvements https://review.openstack.org/565348 | 21:35 |
| *** d0ugal_ has quit IRC | 21:38 | |
| *** d0ugal_ has joined #openstack-infra | 21:39 | |
| *** felipemonteiro has joined #openstack-infra | 21:42 | |
| *** salv-orlando has joined #openstack-infra | 21:43 | |
| *** aeng has quit IRC | 21:44 | |
| *** aeng has joined #openstack-infra | 21:45 | |
| *** felipemonteiro_ has joined #openstack-infra | 21:46 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add regex support to project stanzas https://review.openstack.org/535713 | 21:47 |
| openstackgerrit | Merged openstack-infra/zuul master: Freeze regex projects https://review.openstack.org/565294 | 21:47 |
| *** salv-orlando has quit IRC | 21:48 | |
| *** felipemonteiro has quit IRC | 21:50 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add waits to test_nodepool_priority https://review.openstack.org/565335 | 21:51 |
| openstackgerrit | Merged openstack-infra/zuul master: Sometimes GitHub doesn't return repo permissions https://review.openstack.org/564666 | 21:51 |
| *** dhill_ has quit IRC | 21:52 | |
| *** dhill_ has joined #openstack-infra | 21:53 | |
| *** ssbarnea_ has quit IRC | 21:56 | |
| *** d0ugal_ has quit IRC | 21:57 | |
| *** slaweq has quit IRC | 21:58 | |
| *** d0ugal_ has joined #openstack-infra | 21:59 | |
| clarkb | corvus: I'm going to check if zuul install on zuul01 is updated yet | 22:02 |
| clarkb | which means I need to laod an ssh key will be a minute | 22:02 |
| *** e0ne has quit IRC | 22:03 | |
| clarkb | it just updated to zuul==3.0.3.dev35 # git sha 502f433 | 22:05 |
| clarkb | Merge "Sometimes GitHub doesn't return repo permissions" | 22:06 |
| corvus | clarkb: and includes "Fix host_vars" lgtm | 22:06 |
| clarkb | yup | 22:06 |
| clarkb | if we restart just the scheduler is it just dump queues and restart scheduler that needs to happen? | 22:06 |
| clarkb | corvus: ^ if that is what is required shall I go ahead and dump queues and restart zuul-scheduler then load queues again? | 22:09 |
| corvus | clarkb: yep and yes. but also, restart zuul-web after the scheduler restart. | 22:10 |
| corvus | it's still broken on gearman server restarts | 22:10 |
| clarkb | corvus: what about fingergw? | 22:11 |
| corvus | it's fine | 22:11 |
| clarkb | ok I've warned release team will proceed with restarting now | 22:11 |
| *** mriedem is now known as mriedem_away | 22:12 | |
| *** dklyle has joined #openstack-infra | 22:13 | |
| *** rcernin has joined #openstack-infra | 22:13 | |
| *** bobh has quit IRC | 22:14 | |
| clarkb | queuing now | 22:16 |
| corvus | i don't see anything alarming in the log so far | 22:16 |
| corvus | clarkb: i see you just issued a recheck on 565277 :) | 22:17 |
| clarkb | corvus: yup :) | 22:17 |
| corvus | clarkb: i'll work on sshing into that executor once it starts to inspect the inventory without waiting 30m | 22:18 |
| clarkb | corvus: thanks | 22:18 |
| *** eernst_ has quit IRC | 22:19 | |
| clarkb | corvus: do we also want to retry your 820 layout generation scenario? | 22:20 |
| corvus | clarkb: how about i just restore 3 changes and we'll verify it that way? | 22:21 |
| clarkb | corvus: wfm | 22:22 |
| corvus | 2018-04-30 22:21:59,129 INFO zuul.ExecutorClient: Execute job sahara-tests-scenario (uuid: 60431ea5a7d3402b9e544061f582f187) | 22:22 |
| corvus | there's our job | 22:22 |
| clarkb | requeueing is complete | 22:22 |
| corvus | rechecked 564908 | 22:24 |
| clarkb | it has already "run" one job but I Guess we should check the logs for completenss | 22:25 |
| clarkb | looks like they reach prepared a dynamic layout once | 22:26 |
| *** eernst has joined #openstack-infra | 22:26 | |
| clarkb | 906 then 907 and 908 and since they all queued idnependently taht looks right to me | 22:26 |
| corvus | i only rechecked 908 -- do we enqueue on change-restored? | 22:26 |
| *** slaweq has joined #openstack-infra | 22:26 | |
| clarkb | corvus: yes I think that is what happened | 22:26 |
| *** slaweq_ has joined #openstack-infra | 22:26 | |
| clarkb | the recheck was unnecessary but I'll double check that | 22:27 |
| corvus | clarkb: cool, then yeah, i agree that's the expected output | 22:27 |
| corvus | we can also do another recheck of 908 when it reports just to double check | 22:27 |
| clarkb | event: change-restored | 22:27 |
| clarkb | so ya | 22:27 |
| corvus | (no executor has picked up 60431ea5a7d3402b9e544061f582f187 yet; i expect they are... busy... right now) | 22:28 |
| *** slaweq_ has quit IRC | 22:28 | |
| corvus | (indeed, grafana shows 0 accepting executors) | 22:28 |
| *** eernst has quit IRC | 22:28 | |
| clarkb | corvus: http://zuul.openstack.org/stream.html?uuid=38ddf1b4b47a4af59d367d93c6c46a61&logfile=console.log that one may be child of the job we are concerned about | 22:30 |
| clarkb | I am double checking | 22:30 |
| clarkb | corvus: ya it is, so maybe look at that one (it is running) | 22:30 |
| clarkb | sahara-tests-scenario-modwsgi is the job name | 22:30 |
| corvus | ok | 22:30 |
| corvus | ze07 | 22:31 |
| *** eernst has joined #openstack-infra | 22:31 | |
| corvus | 2018-04-30 22:19:37,880 DEBUG zuul.Pipeline.openstack.check: Build <Build 38ddf1b4b47a4af59d367d93c6c46a61 of sahara-tests-scenario-modwsgi on <Worker ze07.openstack.org>> started | 22:31 |
| corvus | clarkb, tosky: looks good: http://paste.openstack.org/show/720163/ | 22:32 |
| tosky | thanks! | 22:32 |
| clarkb | cool | 22:33 |
| pabelanger | ianw: cool, I'll check back in a bit. configure-mirror on jobs will be broken until the released later today / tomorrow | 22:35 |
| pabelanger | we'll need to update fedora mirror to do that, then I'll go though the process again of updating jobs in the morning | 22:36 |
| *** eernst has quit IRC | 22:36 | |
| *** salv-orlando has joined #openstack-infra | 22:36 | |
| wznoinsk | fungi, mordred hi, 'check' failed on https://review.openstack.org/#/c/565229/ because of ARA stuff: http://logs.openstack.org/29/565229/2/check/tripleo-ci-centos-7-3nodes-multinode/df700bd/job-output.txt.gz , any chance you could +1V ? | 22:37 |
| wznoinsk | or maybe more timezone friendly clarkb, ^ | 22:38 |
| clarkb | wznoinsk: typically that is reserved for merging gate fixes | 22:39 |
| pabelanger | wznoinsk: which ARA stuff? it looks like the job might haved failed: http://logs.openstack.org/29/565229/2/check/tripleo-ci-centos-7-3nodes-multinode/df700bd/job-output.txt.gz#_2018-04-30_21_23_24_611052 | 22:39 |
| fungi | (./toci_quickstart.sh:191): exit 2 | 22:40 |
| wznoinsk | pabelanger, correct, with this error: http://paste.openstack.org/show/720164/ | 22:40 |
| fungi | ERROR: the main setup script run by this job failed - exit code: 2 | 22:40 |
| clarkb | ya then ara fails afterwards | 22:40 |
| fungi | that error from ara isn't why the job failed | 22:40 |
| wznoinsk | double checking | 22:40 |
| pabelanger | wznoinsk: it might also be with to convert tripleo jobs to use the new ARA wsgi app, IIRC, you just need to upload the sqlite database to logs.o.o, not all the ARA results | 22:40 |
| openstackgerrit | Merged openstack-infra/zuul master: Add release note about re2 https://review.openstack.org/564847 | 22:40 |
| *** lathiat has joined #openstack-infra | 22:41 | |
| fungi | overcloud-deploy.sh failed according to http://logs.openstack.org/29/565229/2/check/tripleo-ci-centos-7-3nodes-multinode/df700bd/logs/quickstart_install.txt.gz ? | 22:42 |
| clarkb | pabelanger: wznoinsk that has the additional benefit of reducing job runtimes too since rsync is much faster | 22:42 |
| fungi | i'm not quite sure how to navigate toci logs, unfortunately | 22:43 |
| openstackgerrit | Merged openstack-infra/zuul master: Fix some code description https://review.openstack.org/564862 | 22:43 |
| wznoinsk | fungi, right, I got caught be failed: 1 (in context of playbooks) vs. failed=1 (when it comes to task failures)... checking | 22:44 |
| wznoinsk | pabelanger, clarkb I wish, no spare time tho, OSP13 right around the corner | 22:45 |
| openstackgerrit | Merged openstack-infra/zuul master: Add debug info to test_slow_start https://review.openstack.org/564857 | 22:47 |
| *** rh-jelabarre has joined #openstack-infra | 22:51 | |
| corvus | nodepool 3.0.1 pushed | 22:53 |
| *** felipemonteiro_ has quit IRC | 22:56 | |
| *** slaweq has quit IRC | 22:56 | |
| *** slaweq has joined #openstack-infra | 22:56 | |
| *** hongbin has quit IRC | 22:59 | |
| *** slaweq has quit IRC | 23:01 | |
| *** felipemonteiro has joined #openstack-infra | 23:02 | |
| *** felipemonteiro_ has joined #openstack-infra | 23:02 | |
| *** lbragstad has quit IRC | 23:05 | |
| *** felipemonteiro has quit IRC | 23:06 | |
| *** rajinir has quit IRC | 23:08 | |
| *** SorinSen has quit IRC | 23:09 | |
| *** SorinSen has joined #openstack-infra | 23:09 | |
| *** r-daneel has quit IRC | 23:09 | |
| *** d0ugal__ has joined #openstack-infra | 23:11 | |
| *** d0ugal_ has quit IRC | 23:14 | |
| *** sree has joined #openstack-infra | 23:14 | |
| *** sree has quit IRC | 23:19 | |
| *** xarses has joined #openstack-infra | 23:20 | |
| openstackgerrit | Merged openstack-infra/storyboard master: Reorganize Docs https://review.openstack.org/559827 | 23:21 |
| *** felipemonteiro__ has joined #openstack-infra | 23:23 | |
| *** felipemonteiro_ has quit IRC | 23:23 | |
| *** rlandy has quit IRC | 23:24 | |
| *** slaweq has joined #openstack-infra | 23:26 | |
| clarkb | corvus: I rechecked your sandbox 908 test change and the only dynamic reconfigure is 2018-04-30 23:27:36,259 DEBUG zuul.Pipeline.openstack.check: Preparing dynamic layout for: <Change 0x7f5254b09cc0 564908,1> | 23:28 |
| clarkb | I think it is working as expected | 23:28 |
| *** smarcet has joined #openstack-infra | 23:28 | |
| *** salv-orlando has quit IRC | 23:28 | |
| corvus | clarkb: cool, thanks! | 23:28 |
| *** salv-orlando has joined #openstack-infra | 23:29 | |
| *** d0ugal__ has quit IRC | 23:29 | |
| *** jiapei has quit IRC | 23:32 | |
| *** salv-orlando has quit IRC | 23:33 | |
| *** sree has joined #openstack-infra | 23:35 | |
| *** slaweq has quit IRC | 23:36 | |
| *** slaweq has joined #openstack-infra | 23:37 | |
| *** jamesmcarthur has joined #openstack-infra | 23:38 | |
| *** sree has quit IRC | 23:40 | |
| *** slaweq has quit IRC | 23:41 | |
| *** jamesmcarthur has quit IRC | 23:43 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Install g++ on platform:rpm https://review.openstack.org/565070 | 23:46 |
| *** hemna_ has quit IRC | 23:48 | |
| *** smarcet has quit IRC | 23:49 | |
| *** larainema has joined #openstack-infra | 23:54 | |
| *** aeng has quit IRC | 23:56 | |
| *** imacdonn has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!