*** stevebaker has joined #openstack-infra | 00:01 | |
clarkb | Gerrit is the team name in github maybe it is case sensitive? | 00:01 |
---|---|---|
clarkb | or at least the search may be? | 00:01 |
clarkb | teams_dict = dict(zip([t.name.lower() for t in teams], teams)) would imply that is the case | 00:02 |
clarkb | (note the use of lower there) | 00:02 |
*** gyee has quit IRC | 00:02 | |
clarkb | I think we are ok here. But that bug should be fixed | 00:02 |
clarkb | (and double checked confirmed to actually be a bug) | 00:02 |
ianw | clarkb: umm, if you want to tell me exactly what to watch :) | 00:03 |
corvus | clarkb: does this mean... that we flip created on all the projects from true to false and false to true on every alternate run of the program? | 00:04 |
clarkb | corvus: no I think once it is false it stays false beacuse the get repo won't exception | 00:04 |
clarkb | ianw: /var/log/manage_projects on review01.o.o should be noops unless we add projects and the contents of the file edited in https://review.openstack.org/#/c/566170/ should be what that chagne says (I manually edited the file since review01 was in emergency) | 00:04 |
*** markvoelker has quit IRC | 00:05 | |
clarkb | ianw: more than happy to finish this up tomorrow if you don't want to deal with it | 00:05 |
*** tosky has quit IRC | 00:05 | |
clarkb | but I better work on a fire otherwise dinner will be late | 00:05 |
clarkb | corvus: its definitely buggy I think | 00:05 |
clarkb | corvus: we should set created to true if we either manage to create it or it already exists | 00:05 |
clarkb | and we should handle varying case in team names if necessary | 00:05 |
clarkb | we don't have a backup of queued gerrit processes so I don't think we broke replication to github | 00:06 |
clarkb | and spot checking a project it lgtm | 00:06 |
ianw | clarkb: alright i can monitor it. want me to take it out of emergency? | 00:06 |
clarkb | ianw: I'm good with it if you are | 00:07 |
corvus | clarkb: okay, so the gerrit-in-team bug causes created-in-github to be set to true the first time through; then the second time through, gerrit-in-team is cached, so created-in-github gets set to false, then stays false. | 00:07 |
clarkb | corvus: right | 00:07 |
*** jistr has quit IRC | 00:07 | |
corvus | clarkb: okay, so the fix is still to update created-in-github in that method (just like gerrit-in-team is) | 00:08 |
corvus | clarkb: and then also, fix the case issue for gerrit-in-team | 00:08 |
clarkb | yes I think so | 00:08 |
*** hamzy has joined #openstack-infra | 00:09 | |
ianw | clarkb: done and will monitor | 00:09 |
*** jistr has joined #openstack-infra | 00:13 | |
*** mpeterson has quit IRC | 00:16 | |
*** dingyichen has joined #openstack-infra | 00:20 | |
*** mpeterson has joined #openstack-infra | 00:23 | |
*** ssbarnea_ has quit IRC | 00:28 | |
*** gouthamr has quit IRC | 00:30 | |
*** dmellado has quit IRC | 00:31 | |
*** stevebaker has quit IRC | 00:33 | |
*** d0ugal has quit IRC | 00:36 | |
*** gouthamr has joined #openstack-infra | 00:38 | |
*** dmellado has joined #openstack-infra | 00:38 | |
*** camunoz has quit IRC | 00:38 | |
*** stevebaker has joined #openstack-infra | 00:39 | |
openstackgerrit | Kendall Nelson proposed openstack-infra/project-config master: Add Heat to StoryBoard https://review.openstack.org/566193 | 00:50 |
*** edmondsw has joined #openstack-infra | 00:53 | |
*** gouthamr has quit IRC | 00:58 | |
*** stevebaker has quit IRC | 00:59 | |
*** dmellado has quit IRC | 00:59 | |
*** d0ugal has joined #openstack-infra | 01:03 | |
openstackgerrit | Kendall Nelson proposed openstack-infra/project-config master: Add Heat to StoryBoard https://review.openstack.org/566193 | 01:04 |
*** edmondsw has quit IRC | 01:05 | |
*** markvoelker has joined #openstack-infra | 01:05 | |
*** anteaya has quit IRC | 01:12 | |
*** spsurya has joined #openstack-infra | 01:14 | |
*** dpawlik has joined #openstack-infra | 01:15 | |
*** annp has joined #openstack-infra | 01:16 | |
*** edmondsw has joined #openstack-infra | 01:18 | |
*** dpawlik has quit IRC | 01:20 | |
*** gouthamr has joined #openstack-infra | 01:23 | |
*** stevebaker has joined #openstack-infra | 01:24 | |
*** dmellado has joined #openstack-infra | 01:26 | |
*** yamahata has quit IRC | 01:30 | |
*** gouthamr has quit IRC | 01:32 | |
*** dmellado has quit IRC | 01:32 | |
*** stevebaker has quit IRC | 01:33 | |
*** rosmaita has quit IRC | 01:35 | |
*** mrjazzercise has quit IRC | 01:36 | |
*** VW has joined #openstack-infra | 01:39 | |
*** markvoelker has quit IRC | 01:40 | |
*** rlandy|bbl is now known as rlandy | 01:45 | |
*** hongbin has joined #openstack-infra | 01:51 | |
*** gouthamr has joined #openstack-infra | 01:56 | |
*** dmellado has joined #openstack-infra | 01:56 | |
*** stevebaker has joined #openstack-infra | 01:58 | |
*** dayou_ has joined #openstack-infra | 02:02 | |
*** r-daneel has quit IRC | 02:06 | |
*** dmellado has quit IRC | 02:09 | |
*** stevebaker has quit IRC | 02:09 | |
*** dmellado has joined #openstack-infra | 02:13 | |
*** stevebaker has joined #openstack-infra | 02:13 | |
*** armaan has joined #openstack-infra | 02:13 | |
*** armaan has quit IRC | 02:14 | |
*** hongbin has quit IRC | 02:17 | |
*** edmondsw has quit IRC | 02:18 | |
*** rcernin has quit IRC | 02:19 | |
*** rcernin has joined #openstack-infra | 02:20 | |
*** gouthamr has quit IRC | 02:22 | |
*** gouthamr has joined #openstack-infra | 02:23 | |
*** gouthamr has quit IRC | 02:27 | |
*** gouthamr has joined #openstack-infra | 02:32 | |
*** ykarel|away has joined #openstack-infra | 02:36 | |
*** markvoelker has joined #openstack-infra | 02:37 | |
*** gouthamr has quit IRC | 02:37 | |
*** stevebaker has quit IRC | 02:37 | |
*** hongbin has joined #openstack-infra | 02:37 | |
*** dmellado has quit IRC | 02:38 | |
*** germs has quit IRC | 02:39 | |
*** germs has joined #openstack-infra | 02:40 | |
*** zhangfei has joined #openstack-infra | 02:40 | |
*** psachin has joined #openstack-infra | 02:41 | |
*** ykarel|away has quit IRC | 02:44 | |
*** esberglu has quit IRC | 02:47 | |
*** yamamoto has quit IRC | 02:51 | |
*** yamamoto has joined #openstack-infra | 02:51 | |
*** VW has quit IRC | 02:51 | |
*** VW has joined #openstack-infra | 02:52 | |
*** zhangfei has quit IRC | 02:52 | |
dmsimard | clarkb: wow I had never seen this spec before https://specs.openstack.org/openstack-infra/infra-specs/specs/deploy-ci-dashboard.html | 02:55 |
*** VW has quit IRC | 02:57 | |
*** yamamoto has quit IRC | 02:58 | |
*** zhangfei has joined #openstack-infra | 03:07 | |
*** markvoelker has quit IRC | 03:10 | |
*** dave-mccowan has quit IRC | 03:14 | |
*** dpawlik has joined #openstack-infra | 03:16 | |
*** dhill_ has quit IRC | 03:16 | |
*** dpawlik has quit IRC | 03:21 | |
*** andreas_s has joined #openstack-infra | 03:30 | |
*** andreas_s has quit IRC | 03:34 | |
*** felipemonteiro__ has joined #openstack-infra | 03:36 | |
*** stevebaker has joined #openstack-infra | 03:37 | |
*** gouthamr has joined #openstack-infra | 03:38 | |
*** dmellado has joined #openstack-infra | 03:39 | |
*** felipemonteiro_ has joined #openstack-infra | 03:39 | |
dmsimard | http://ci-watch.tintri.com/project?project=nova o_O | 03:39 |
*** lpetrut has joined #openstack-infra | 03:41 | |
*** felipemonteiro__ has quit IRC | 03:43 | |
*** nicolasbock has quit IRC | 03:44 | |
*** felipemonteiro_ has quit IRC | 03:45 | |
*** gouthamr has quit IRC | 03:52 | |
*** mwarad has joined #openstack-infra | 03:57 | |
openstackgerrit | Ian Wienand proposed openstack-dev/pbr master: Special case long_description_content_type https://review.openstack.org/565177 | 03:59 |
*** yamamoto has joined #openstack-infra | 03:59 | |
*** rcernin has quit IRC | 03:59 | |
*** rcernin has joined #openstack-infra | 04:00 | |
*** edmondsw has joined #openstack-infra | 04:00 | |
*** germs has quit IRC | 04:02 | |
*** hongbin has quit IRC | 04:02 | |
*** germs has joined #openstack-infra | 04:02 | |
*** germs has quit IRC | 04:02 | |
*** germs has joined #openstack-infra | 04:02 | |
*** stevebaker has quit IRC | 04:03 | |
*** gyankum has joined #openstack-infra | 04:04 | |
*** dmellado has quit IRC | 04:04 | |
*** ykarel|away has joined #openstack-infra | 04:05 | |
*** edmondsw has quit IRC | 04:05 | |
*** ykarel|away is now known as ykarel | 04:05 | |
*** yamamoto has quit IRC | 04:06 | |
*** markvoelker has joined #openstack-infra | 04:08 | |
*** r-daneel has joined #openstack-infra | 04:10 | |
*** slaweq has joined #openstack-infra | 04:11 | |
*** slaweq has quit IRC | 04:15 | |
*** janki has joined #openstack-infra | 04:15 | |
*** lpetrut has quit IRC | 04:21 | |
*** lpetrut has joined #openstack-infra | 04:25 | |
*** pgadiya has joined #openstack-infra | 04:27 | |
*** r-daneel_ has joined #openstack-infra | 04:35 | |
*** r-daneel has quit IRC | 04:36 | |
*** r-daneel_ is now known as r-daneel | 04:36 | |
*** dmellado has joined #openstack-infra | 04:39 | |
*** gouthamr has joined #openstack-infra | 04:40 | |
*** markvoelker has quit IRC | 04:41 | |
*** Douhet has quit IRC | 04:41 | |
*** Douhet has joined #openstack-infra | 04:42 | |
*** jaosorior has joined #openstack-infra | 04:42 | |
*** stevebaker has joined #openstack-infra | 04:43 | |
*** lpetrut has quit IRC | 04:44 | |
*** gouthamr has quit IRC | 04:49 | |
*** gouthamr has joined #openstack-infra | 04:50 | |
*** gouthamr has quit IRC | 04:56 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove Bandit from Infrastructure Systems https://review.openstack.org/565537 | 04:57 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove Bandit from Infrastructure Systems https://review.openstack.org/565537 | 04:59 |
*** kjackal has joined #openstack-infra | 05:06 | |
*** ianw has quit IRC | 05:06 | |
*** ramishra has joined #openstack-infra | 05:07 | |
*** krtaylor has quit IRC | 05:09 | |
*** NobodyCam has quit IRC | 05:15 | |
*** berendt has quit IRC | 05:15 | |
*** patrickeast has quit IRC | 05:15 | |
*** sdake has quit IRC | 05:15 | |
*** TheJulia has quit IRC | 05:15 | |
*** pas-ha has quit IRC | 05:15 | |
*** srwilkers has quit IRC | 05:15 | |
*** hogepodge has quit IRC | 05:15 | |
*** vdrok has quit IRC | 05:15 | |
*** charz has quit IRC | 05:15 | |
*** udesale has joined #openstack-infra | 05:15 | |
*** sdake has joined #openstack-infra | 05:15 | |
*** sdake has quit IRC | 05:15 | |
*** sdake has joined #openstack-infra | 05:15 | |
*** charz has joined #openstack-infra | 05:15 | |
*** srwilkers has joined #openstack-infra | 05:16 | |
*** TheJulia has joined #openstack-infra | 05:16 | |
*** hogepodge has joined #openstack-infra | 05:16 | |
*** berendt_ has joined #openstack-infra | 05:16 | |
*** vdrok has joined #openstack-infra | 05:16 | |
*** pas-ha has joined #openstack-infra | 05:16 | |
*** NobodyCam has joined #openstack-infra | 05:16 | |
*** dpawlik has joined #openstack-infra | 05:17 | |
*** dpawlik has quit IRC | 05:21 | |
*** ramishra has quit IRC | 05:21 | |
*** lpetrut has joined #openstack-infra | 05:22 | |
*** lpetrut has quit IRC | 05:29 | |
*** Gorian has quit IRC | 05:34 | |
*** iranzo has joined #openstack-infra | 05:38 | |
*** markvoelker has joined #openstack-infra | 05:38 | |
*** dhajare has joined #openstack-infra | 05:40 | |
*** quiquell|off is now known as quiquell | 05:40 | |
*** Gorian has joined #openstack-infra | 05:42 | |
*** threestrands has quit IRC | 05:47 | |
*** slaweq has joined #openstack-infra | 05:47 | |
openstackgerrit | Merged openstack-infra/project-config master: Add horizon into required-projects for nodejs jobs for magnum-ui https://review.openstack.org/564711 | 05:51 |
*** slaweq has quit IRC | 05:52 | |
*** kjackal has quit IRC | 05:53 | |
openstackgerrit | Merged openstack-infra/project-config master: Trivial: Update pypi url to new url https://review.openstack.org/563049 | 05:55 |
*** ianw has joined #openstack-infra | 05:55 | |
*** ramishra has joined #openstack-infra | 05:56 | |
*** pgadiya has quit IRC | 05:57 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/566217 | 06:03 |
*** hemna_ has quit IRC | 06:07 | |
*** gfidente has joined #openstack-infra | 06:08 | |
*** gfidente has joined #openstack-infra | 06:08 | |
*** markvoelker has quit IRC | 06:11 | |
*** quiquell is now known as quiquell|afk | 06:12 | |
*** dayou_ has quit IRC | 06:20 | |
*** e0ne has joined #openstack-infra | 06:21 | |
*** pcichy has joined #openstack-infra | 06:23 | |
*** lpetrut has joined #openstack-infra | 06:28 | |
*** hashar has joined #openstack-infra | 06:28 | |
*** dbecker has quit IRC | 06:30 | |
*** dmsimard has quit IRC | 06:39 | |
*** dmsimard has joined #openstack-infra | 06:39 | |
*** yolanda_ has joined #openstack-infra | 06:42 | |
*** pcaruana has joined #openstack-infra | 06:43 | |
*** dbecker has joined #openstack-infra | 06:44 | |
*** yolanda has quit IRC | 06:45 | |
*** jtomasek has joined #openstack-infra | 06:45 | |
*** r-daneel has quit IRC | 06:49 | |
*** krtaylor has joined #openstack-infra | 06:50 | |
*** alex_xu has quit IRC | 06:50 | |
*** alex_xu has joined #openstack-infra | 06:51 | |
*** e0ne has quit IRC | 06:59 | |
*** stevebaker has quit IRC | 07:01 | |
*** dmellado has quit IRC | 07:01 | |
*** dayou_ has joined #openstack-infra | 07:04 | |
*** rcernin has quit IRC | 07:05 | |
*** slaweq has joined #openstack-infra | 07:05 | |
*** slaweq has quit IRC | 07:06 | |
*** slaweq has joined #openstack-infra | 07:06 | |
chrisyang_0660 | Hi team, I was testing our CI system and find that it just can't make a new build. | 07:07 |
chrisyang_0660 | I checked the zuul log and found that something seems wrong with the zuul-merger. | 07:07 |
chrisyang_0660 | The example of error message shows that "Unable to find commit for ref master/Zc35f3d1ca65f466283d5df2e44a8404f" | 07:07 |
chrisyang_0660 | Does anyone know what happens and how to fix this? | 07:07 |
chrisyang_0660 | The detail log of merge-debug.log is as follows: | 07:07 |
chrisyang_0660 | https://gist.github.com/yljh21328/cabc0726b05aceb06fd54e5e2012488e | 07:07 |
*** quiquell|afk is now known as quiquell | 07:08 | |
*** markvoelker has joined #openstack-infra | 07:08 | |
frickler | chrisyang_0660: just guessing, as this isn't obvious from your logs: the address of review.openstack.org has changed, do you have outgoing firewall rules that may need updating? | 07:10 |
*** dpawlik has joined #openstack-infra | 07:10 | |
*** dmellado has joined #openstack-infra | 07:12 | |
evrardjp | hello | 07:16 |
*** dpawlik has quit IRC | 07:16 | |
*** zoli is now known as zoli|wfh | 07:17 | |
evrardjp | may I have some reviews on https://review.openstack.org/#/c/562619/ now that their dependant patches have merged? | 07:17 |
*** dpawlik has joined #openstack-infra | 07:19 | |
*** tesseract has joined #openstack-infra | 07:20 | |
*** florianf has joined #openstack-infra | 07:20 | |
*** dmellado_ has joined #openstack-infra | 07:24 | |
*** ssbarnea_ has joined #openstack-infra | 07:25 | |
*** andreas_s has joined #openstack-infra | 07:25 | |
*** jaosorior has quit IRC | 07:25 | |
*** alexchadin has joined #openstack-infra | 07:32 | |
*** ykarel is now known as ykarel|lunch | 07:32 | |
*** dmellado_ has quit IRC | 07:34 | |
chrisyang_0660 | frickler: I have tried to flush the dns cache. But still get the same error message. | 07:34 |
*** amoralej|off is now known as amoralej | 07:34 | |
*** wolverineav has joined #openstack-infra | 07:34 | |
*** edmondsw has joined #openstack-infra | 07:36 | |
*** bauzas is now known as bauwser | 07:37 | |
*** edmondsw has quit IRC | 07:41 | |
*** markvoelker has quit IRC | 07:42 | |
*** kukacz has quit IRC | 07:46 | |
*** tosky has joined #openstack-infra | 07:47 | |
*** jpena|off is now known as jpena | 07:48 | |
*** ccamacho has joined #openstack-infra | 07:51 | |
*** jpich has joined #openstack-infra | 07:51 | |
*** kukacz_ has joined #openstack-infra | 07:55 | |
*** wolverineav has quit IRC | 07:57 | |
*** yamahata has joined #openstack-infra | 07:57 | |
*** wolverineav has joined #openstack-infra | 07:57 | |
*** janki has quit IRC | 07:57 | |
*** ssbarnea_ has quit IRC | 07:59 | |
*** kjackal has joined #openstack-infra | 08:00 | |
*** dmellado_ has joined #openstack-infra | 08:01 | |
*** kukacz_ has quit IRC | 08:01 | |
*** kukacz_ has joined #openstack-infra | 08:01 | |
*** wolverineav has quit IRC | 08:02 | |
*** dchen has joined #openstack-infra | 08:04 | |
*** dingyichen has quit IRC | 08:05 | |
*** pcichy has quit IRC | 08:05 | |
*** pcichy has joined #openstack-infra | 08:05 | |
*** lucas-afk is now known as lucasagomes | 08:07 | |
*** kukacz_ has quit IRC | 08:07 | |
*** kukacz_ has joined #openstack-infra | 08:11 | |
*** dmellado_ has quit IRC | 08:11 | |
*** kukacz_ has quit IRC | 08:14 | |
*** kukacz_ has joined #openstack-infra | 08:14 | |
*** ykarel|lunch is now known as ykarel | 08:15 | |
*** salv-orlando has joined #openstack-infra | 08:15 | |
*** salv-orlando has quit IRC | 08:15 | |
*** salv-orlando has joined #openstack-infra | 08:16 | |
*** yamahata has quit IRC | 08:23 | |
*** panda|off is now known as panda | 08:24 | |
*** derekh has joined #openstack-infra | 08:25 | |
*** pblaho has joined #openstack-infra | 08:28 | |
*** stephenfin is now known as finucannot | 08:29 | |
*** lyarwood has quit IRC | 08:34 | |
*** andreas_s has quit IRC | 08:38 | |
*** andreas_s has joined #openstack-infra | 08:39 | |
*** markvoelker has joined #openstack-infra | 08:39 | |
*** e0ne has joined #openstack-infra | 08:40 | |
*** germs has quit IRC | 08:43 | |
*** kjackal has quit IRC | 08:43 | |
*** germs has joined #openstack-infra | 08:44 | |
*** germs has quit IRC | 08:44 | |
*** germs has joined #openstack-infra | 08:44 | |
*** lbragstad has quit IRC | 08:45 | |
*** lbragstad has joined #openstack-infra | 08:45 | |
*** dmellado_ has joined #openstack-infra | 08:50 | |
*** stevebaker has joined #openstack-infra | 08:53 | |
*** salv-orlando has quit IRC | 08:53 | |
hwoarang | hello infra. anyone to look at https://review.openstack.org/#/c/554620/ again? thank you :) | 08:54 |
*** zhangfei has quit IRC | 08:54 | |
chrisyang_0660 | frickler: Our zuul credential seems not working with review.openstack.org. After re-configure, it works fine. :) | 08:55 |
frickler | hwoarang: +2, but don't have time to check the mirror run today, hope some other infra-root can pick this up later | 09:01 |
*** andreas_s has quit IRC | 09:01 | |
*** pcichy has quit IRC | 09:01 | |
hwoarang | thank you frickler much appreciated | 09:01 |
*** andreas_s has joined #openstack-infra | 09:02 | |
*** janki has joined #openstack-infra | 09:03 | |
*** vtapia has quit IRC | 09:08 | |
*** zhangfei has joined #openstack-infra | 09:10 | |
*** markvoelker has quit IRC | 09:12 | |
evrardjp | while we are at infra requests, I'd be super happy to have this reviewed too frickler :) https://review.openstack.org/#/c/562619/ | 09:15 |
*** ssbarnea_ has joined #openstack-infra | 09:18 | |
frickler | evrardjp: +2, too | 09:21 |
evrardjp | we are on a row! :) | 09:21 |
evrardjp | thanks frickler ! | 09:22 |
evrardjp | you're the deal! | 09:22 |
*** udesale_ has joined #openstack-infra | 09:29 | |
openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/566217 | 09:29 |
*** udesale__ has joined #openstack-infra | 09:31 | |
*** udesale has quit IRC | 09:32 | |
*** dtantsur|afk is now known as dtantsur | 09:33 | |
*** udesale_ has quit IRC | 09:34 | |
*** vabada has quit IRC | 09:38 | |
*** yamamoto has joined #openstack-infra | 09:49 | |
*** vtapia has joined #openstack-infra | 09:52 | |
*** yamamoto has quit IRC | 09:53 | |
*** salv-orlando has joined #openstack-infra | 09:57 | |
*** armaan has joined #openstack-infra | 10:04 | |
*** wolverineav has joined #openstack-infra | 10:07 | |
*** markvoelker has joined #openstack-infra | 10:08 | |
*** wolverineav has quit IRC | 10:12 | |
*** kjackal has joined #openstack-infra | 10:12 | |
openstackgerrit | Merged openstack-infra/project-config master: Add os_masakari repo base jobs https://review.openstack.org/562619 | 10:13 |
*** udesale_ has joined #openstack-infra | 10:13 | |
*** udesale__ has quit IRC | 10:16 | |
frickler | infra-root: FYI, not sure if we are using this anywhere, but if you are seeing ansible inventory runs fail, it could be this: https://bugs.launchpad.net/os-client-config/+bug/1768813 | 10:22 |
openstack | Launchpad bug 1768813 in os-client-config "config.get_cache_expiration_time() function missing in 1.31.0 release" [Undecided,New] | 10:22 |
*** zoli|wfh is now known as zoli|lunch | 10:22 | |
*** andreas_s has quit IRC | 10:25 | |
*** ethfci has joined #openstack-infra | 10:27 | |
*** andreas_s has joined #openstack-infra | 10:27 | |
*** r-daneel has joined #openstack-infra | 10:29 | |
*** salv-orlando has quit IRC | 10:31 | |
*** andreas_s has quit IRC | 10:35 | |
*** zhangfei has quit IRC | 10:35 | |
ianw | hwoarang / frickler : i've cherry-picked that and running it manually first to make sure it's ok, then we can commit | 10:35 |
*** kjackal has quit IRC | 10:36 | |
*** lpetrut has quit IRC | 10:39 | |
hwoarang | thank you ianw | 10:41 |
ianw | hwoarang: i don't have a heap of time to debug it, but i don't think it works :/ http://paste.openstack.org/show/720356/ | 10:42 |
*** markvoelker has quit IRC | 10:42 | |
hwoarang | looks like we are missing some mkdir -p | 10:44 |
ianw | the rsync doesn't do that? | 10:44 |
hwoarang | maybe not recursively | 10:45 |
ianw | it's always an adventure with rsync alphabet soup command options ... rsync -rlptDvz | 10:45 |
hwoarang | i see the script already does mkdir -p for the rest of the repos | 10:45 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/system-config master: modules: openstack_project: Mirror some additional openSUSE repositories https://review.openstack.org/554620 | 10:46 |
hwoarang | ianw: could you try that please ^^ | 10:46 |
ianw | hwoarang: yep, already running with that :) | 10:47 |
ianw | it seems happier | 10:47 |
hwoarang | good :) | 10:47 |
*** zhangfei has joined #openstack-infra | 10:47 | |
ianw | it's doing a bunch of aarch64/ppc64le etc stuff | 10:48 |
ianw | it's probably not big enough to worry about | 10:49 |
hwoarang | hmm that's in the containers repo | 10:50 |
hwoarang | that will go away after 42.3 is EOL so should be ok for now... it's not too big i think | 10:50 |
*** spsurya has quit IRC | 10:56 | |
*** lathiat has joined #openstack-infra | 10:57 | |
*** kjackal has joined #openstack-infra | 10:57 | |
*** lathiat_ has quit IRC | 10:58 | |
*** wolverineav has joined #openstack-infra | 11:02 | |
*** zoli|lunch is now known as zoli|wfh | 11:02 | |
*** andreas_s has joined #openstack-infra | 11:03 | |
*** alexchadin has quit IRC | 11:04 | |
*** salv-orlando has joined #openstack-infra | 11:07 | |
*** lpetrut has joined #openstack-infra | 11:09 | |
*** dave-mccowan has joined #openstack-infra | 11:13 | |
*** kjackal has quit IRC | 11:15 | |
*** alexchadin has joined #openstack-infra | 11:17 | |
*** lucasagomes is now known as lucas-pto | 11:17 | |
*** udesale__ has joined #openstack-infra | 11:22 | |
*** udesale__ has quit IRC | 11:22 | |
*** udesale__ has joined #openstack-infra | 11:23 | |
*** udesale__ has quit IRC | 11:24 | |
*** udesale_ has quit IRC | 11:24 | |
*** udesale__ has joined #openstack-infra | 11:24 | |
*** pcaruana has quit IRC | 11:27 | |
*** quiquell is now known as quiquell|lunch | 11:28 | |
*** udesale__ has quit IRC | 11:29 | |
*** salv-orlando has quit IRC | 11:31 | |
*** BobBall has quit IRC | 11:33 | |
*** markvoelker has joined #openstack-infra | 11:39 | |
*** pcaruana has joined #openstack-infra | 11:39 | |
*** nicolasbock has joined #openstack-infra | 11:42 | |
*** pbourke has quit IRC | 11:48 | |
*** linkmark has quit IRC | 11:51 | |
*** rosmaita has joined #openstack-infra | 11:53 | |
*** edmondsw has joined #openstack-infra | 11:53 | |
*** ldnunes has joined #openstack-infra | 11:53 | |
*** kaisers1 has joined #openstack-infra | 11:55 | |
*** kjackal has joined #openstack-infra | 11:55 | |
*** kaisers has quit IRC | 11:56 | |
*** annp has quit IRC | 11:57 | |
*** pcaruana has quit IRC | 11:59 | |
*** jpena is now known as jpena|lunch | 12:03 | |
*** jistr is now known as jistr|mtg | 12:11 | |
*** pcaruana has joined #openstack-infra | 12:12 | |
*** markvoelker has quit IRC | 12:12 | |
*** alexchadin has quit IRC | 12:15 | |
*** ssbarnea_ has quit IRC | 12:16 | |
*** dtantsur is now known as dtantsur|brb | 12:17 | |
*** ethfci has quit IRC | 12:21 | |
mnaser | morning infra :> | 12:21 |
*** markvoelker has joined #openstack-infra | 12:24 | |
*** quiquell|lunch is now known as quiquell | 12:24 | |
*** electrofelix has quit IRC | 12:26 | |
*** dhajare has quit IRC | 12:28 | |
*** kgiusti has joined #openstack-infra | 12:29 | |
*** jistr|mtg is now known as jistr | 12:31 | |
*** ssbarnea_ has joined #openstack-infra | 12:33 | |
*** rlandy has joined #openstack-infra | 12:34 | |
*** vivsoni_ has joined #openstack-infra | 12:35 | |
*** vivsoni has quit IRC | 12:35 | |
*** trown|outtypewww is now known as trown | 12:37 | |
*** armaan has quit IRC | 12:38 | |
*** armaan has joined #openstack-infra | 12:38 | |
openstackgerrit | Merged openstack-infra/project-config master: Stop gating on tripleo-incubator https://review.openstack.org/565836 | 12:43 |
odyssey4me | oh dear, it looks like the ara-report is giving a 500 error dmsimard - any idea what's up with that? | 12:44 |
*** udesale has joined #openstack-infra | 12:44 | |
dmsimard | odyssey4me: looking | 12:45 |
*** yamamoto has joined #openstack-infra | 12:46 | |
*** yamamoto has quit IRC | 12:48 | |
*** yamamoto has joined #openstack-infra | 12:49 | |
*** ssbarnea_ has quit IRC | 12:49 | |
odyssey4me | dmsimard an example: http://logs.openstack.org/78/564778/14/check/openstack-ansible-functional-ubuntu-xenial/933a197/logs/ara-report/ | 12:49 |
dmsimard | odyssey4me: yeah I reproduced the issue and found the problem, trying to see how to fix it | 12:49 |
*** kjackal has quit IRC | 12:50 | |
*** jcoufal has joined #openstack-infra | 12:53 | |
*** yamamoto has quit IRC | 12:53 | |
*** andreas_s has quit IRC | 12:54 | |
*** jpena|lunch is now known as jpena | 12:54 | |
*** udesale has quit IRC | 12:54 | |
*** udesale has joined #openstack-infra | 12:54 | |
*** alexchadin has joined #openstack-infra | 12:55 | |
*** felipemonteiro has joined #openstack-infra | 12:55 | |
*** andreas_s_ has joined #openstack-infra | 12:56 | |
*** andreas_s_ has quit IRC | 12:56 | |
*** andreas_s_ has joined #openstack-infra | 12:56 | |
*** ssbarnea_ has joined #openstack-infra | 12:57 | |
*** aojea has joined #openstack-infra | 12:59 | |
*** yamamoto has joined #openstack-infra | 13:00 | |
dmsimard | odyssey4me: it works now but I haven't found the root cause, I'll have to investigate more to understand | 13:01 |
*** efried is now known as fried_rice | 13:02 | |
dmsimard | ARA uses Ansible to load it's configuration and it was all of a sudden stack tracing: http://paste.openstack.org/raw/720366/ | 13:02 |
*** Goneri has joined #openstack-infra | 13:02 | |
dmsimard | However, logs-dev.o.o did not exhibit the issue and in theory the only difference is that logs-dev has this patch enabled https://review.openstack.org/#/c/558688/ | 13:03 |
openstackgerrit | Dan Radez proposed openstack-infra/project-config master: Add initial job to zuul for networking-ansible https://review.openstack.org/565373 | 13:05 |
dmsimard | asked #ansible-devel if it rings them a bell | 13:06 |
*** mriedem has joined #openstack-infra | 13:06 | |
dmsimard | infra-root: https://review.openstack.org/#/c/558688/ is ready to merge, it's currently applied manually and static.o.o is in the emergency file, see ^ for details on the issue | 13:06 |
*** dtantsur|brb is now known as dtantsur | 13:09 | |
*** gyankum has quit IRC | 13:09 | |
*** pbourke has joined #openstack-infra | 13:11 | |
*** amoralej is now known as amoralej|lunch | 13:12 | |
*** psachin has quit IRC | 13:13 | |
*** bobh has joined #openstack-infra | 13:14 | |
*** r-daneel has quit IRC | 13:16 | |
*** andreas_s_ has quit IRC | 13:17 | |
*** eharney has joined #openstack-infra | 13:18 | |
*** andreas_s_ has joined #openstack-infra | 13:19 | |
*** esberglu has joined #openstack-infra | 13:28 | |
*** zoli|wfh is now known as zoli|pto | 13:28 | |
*** zoli|pto is now known as zoli | 13:29 | |
*** gouthamr has joined #openstack-infra | 13:30 | |
pabelanger | dmsimard: it has 2 +2's if you want to monitor and +3, wfm | 13:34 |
dmsimard | ianw: thanks for the late +2 :) | 13:34 |
*** VW has joined #openstack-infra | 13:34 | |
*** VW has quit IRC | 13:34 | |
dmsimard | pabelanger: ack, thanks | 13:34 |
*** VW has joined #openstack-infra | 13:35 | |
*** andreas_s_ has quit IRC | 13:35 | |
*** camunoz has joined #openstack-infra | 13:36 | |
*** eernst has joined #openstack-infra | 13:36 | |
*** andreas_s has joined #openstack-infra | 13:37 | |
*** esberglu has quit IRC | 13:39 | |
*** esberglu has joined #openstack-infra | 13:39 | |
*** e0ne has quit IRC | 13:39 | |
*** andreas_s has quit IRC | 13:40 | |
*** andreas_s has joined #openstack-infra | 13:40 | |
*** pbourke has quit IRC | 13:41 | |
*** pbourke has joined #openstack-infra | 13:41 | |
*** e0ne has joined #openstack-infra | 13:43 | |
*** andreas_s has quit IRC | 13:44 | |
*** yamamoto has quit IRC | 13:45 | |
*** andreas_s_ has joined #openstack-infra | 13:46 | |
TheJulia | is the success stuff not working ? Seems last entry was the first of the month and I just tried it and nothing :( | 13:51 |
*** armaan has quit IRC | 13:52 | |
*** r-daneel has joined #openstack-infra | 13:52 | |
*** amoralej|lunch is now known as amoralej | 13:53 | |
openstackgerrit | Merged openstack-infra/puppet-openstackci master: Enable tuned WSGI settings for logs.openstack.org https://review.openstack.org/558688 | 13:54 |
dmsimard | TheJulia: success stuff ? you mean #thanks ? | 13:54 |
dmsimard | or maybe #success is a thing, I forget | 13:55 |
TheJulia | I think it was supposed to start with success | 13:55 |
TheJulia | no leading character | 13:55 |
TheJulia | at least that is the example I spotted | 13:55 |
TheJulia | gah, the example is wrong | 13:55 |
dmsimard | TheJulia: pretty sure it needs a leading # like most/all bot commands | 13:55 |
TheJulia | nevermind, ignore me | 13:55 |
dmsimard | TheJulia: send a patch if the doc is wrong :) | 13:56 |
dmsimard | mordred: I'm starting to understand why you use shade instead of openstackclient. Wow. | 13:57 |
*** rajinir has joined #openstack-infra | 13:57 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: WIP: Add fedora mirror to nodepool dsvm jobs https://review.openstack.org/566102 | 13:58 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Add fedora mirror to nodepool dsvm jobs https://review.openstack.org/566102 | 13:59 |
*** r-daneel has quit IRC | 13:59 | |
*** r-daneel has joined #openstack-infra | 13:59 | |
TheJulia | dmsimard: I think it was on a superuser page, I closed it to try and free memory on my laptop | 14:01 |
*** quiquell is now known as quiquell|off | 14:06 | |
mordred | dmsimard: it's just easier for me | 14:06 |
openstackgerrit | Merged openstack-infra/nodepool master: Fix test patching of clouds.yaml file locations https://review.openstack.org/566138 | 14:07 |
*** armaan has joined #openstack-infra | 14:08 | |
*** kiennt26 has joined #openstack-infra | 14:10 | |
*** bobh has quit IRC | 14:11 | |
*** bobh has joined #openstack-infra | 14:12 | |
*** Guest46098 has quit IRC | 14:13 | |
*** Guest46098 has joined #openstack-infra | 14:13 | |
*** melwitt is now known as jgwentworth | 14:15 | |
*** pcichy has joined #openstack-infra | 14:17 | |
fungi | nifra-root, config-core, infra-puppet-core et al... my internet service to the house is still out this morning with no eta for a fix (waiting on them to call me back to schedule sending out a tech to see what the road crew cut/crushed/shredded this time). i'm hobbling along on a very slow wireless modem in the meantime so may not be especially responsive | 14:17 |
fungi | erm infra-root ^ | 14:18 |
*** salv-orlando has joined #openstack-infra | 14:18 | |
*** salv-orlando has quit IRC | 14:18 | |
*** alexchadin has quit IRC | 14:19 | |
pabelanger | fungi: ack | 14:23 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Remove debian-jessie from nodepool dsvm testing https://review.openstack.org/566327 | 14:26 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Add fedora mirror to nodepool dsvm jobs https://review.openstack.org/566102 | 14:28 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Add fedora-28 to nodepool dsvm https://review.openstack.org/559211 | 14:28 |
*** hemna_ has joined #openstack-infra | 14:31 | |
*** e0ne has quit IRC | 14:32 | |
*** ramishra has quit IRC | 14:33 | |
*** lpetrut has quit IRC | 14:34 | |
*** ssbarnea_ has quit IRC | 14:35 | |
*** eernst has quit IRC | 14:36 | |
*** pbourke has quit IRC | 14:39 | |
*** germs has quit IRC | 14:39 | |
*** zhangfei has quit IRC | 14:40 | |
*** germs has joined #openstack-infra | 14:40 | |
*** germs has quit IRC | 14:40 | |
*** germs has joined #openstack-infra | 14:40 | |
*** andreas_s_ has quit IRC | 14:41 | |
*** woid has joined #openstack-infra | 14:41 | |
*** eharney has quit IRC | 14:42 | |
*** hongbin has joined #openstack-infra | 14:43 | |
*** armaan has quit IRC | 14:44 | |
*** agopi|out is now known as agopi | 14:44 | |
*** armaan has joined #openstack-infra | 14:45 | |
*** yamamoto has joined #openstack-infra | 14:45 | |
*** r-daneel has quit IRC | 14:45 | |
*** iranzo has quit IRC | 14:45 | |
*** agopi has quit IRC | 14:45 | |
*** agopi has joined #openstack-infra | 14:46 | |
*** e0ne has joined #openstack-infra | 14:46 | |
corvus | fungi: i believe the correct proword is 'nifty-root' | 14:47 |
fungi | now it will be, for sure | 14:47 |
fungi | may the fourth be with you all | 14:47 |
corvus | and also with you | 14:48 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Add tox-py36 jobs https://review.openstack.org/565881 | 14:48 |
*** jistr is now known as jistr|tpb | 14:49 | |
*** yamamoto has quit IRC | 14:52 | |
*** ssbarnea_ has joined #openstack-infra | 14:52 | |
*** r-daneel has joined #openstack-infra | 14:52 | |
*** andreas_s has joined #openstack-infra | 14:52 | |
*** dpawlik has quit IRC | 14:52 | |
*** pbourke has joined #openstack-infra | 14:53 | |
*** dhill_ has joined #openstack-infra | 14:53 | |
*** eernst has joined #openstack-infra | 14:53 | |
fungi | config-core: i'm about to start importing heat's lp bugs into storyboard, if anyone is up for a second +2 on https://review.openstack.org/566193 | 14:54 |
corvus | fungi: +2 | 14:56 |
fungi | thanks! | 14:56 |
*** dmellado has quit IRC | 14:57 | |
*** dmellado_ is now known as dmellado | 14:57 | |
openstackgerrit | Graham Hayes proposed openstack-infra/yaml2ical master: Allow for meeting to be schedualed every 4 weeks. https://review.openstack.org/566335 | 14:58 |
*** gyankum has joined #openstack-infra | 14:59 | |
*** Michael__ has joined #openstack-infra | 15:00 | |
*** Michael__ has quit IRC | 15:00 | |
*** andreas_s has quit IRC | 15:00 | |
*** michaeldorner has joined #openstack-infra | 15:00 | |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: Add support for Fedora 28, remove EOL Fedora 26 https://review.openstack.org/566337 | 15:01 |
michaeldorner | Hi there! Are there any documentation about the numbers of committers (developer with write access to the repository) in OpenStack? Thanks alot! | 15:01 |
*** armaan has quit IRC | 15:02 | |
*** armaan has joined #openstack-infra | 15:02 | |
*** jistr|tpb is now known as jistr | 15:05 | |
*** r-daneel has quit IRC | 15:06 | |
*** r-daneel has joined #openstack-infra | 15:06 | |
*** eharney has joined #openstack-infra | 15:07 | |
fungi | michaeldorner: we're not structured that way | 15:10 |
fungi | michaeldorner: we operate through a communal code review process | 15:10 |
fungi | michaeldorner: and technically only our continuous integration and gating system has write access to the git repositories we host | 15:11 |
fungi | (well, and some sysadmins for the code review system) | 15:11 |
*** pcaruana has quit IRC | 15:13 | |
fungi | michaeldorner: probably the closest thing we have to the concept of "committers" is core review teams, who are the contributors with responsibility of approving proposed changes to their respective repositories | 15:14 |
openstackgerrit | Merged openstack-infra/project-config master: Add Heat to StoryBoard https://review.openstack.org/566193 | 15:14 |
mnaser | michaeldorner: perhaps if we know what your end goal is we can help you get the right answer :) | 15:15 |
*** ramishra has joined #openstack-infra | 15:17 | |
*** anteaya has joined #openstack-infra | 15:17 | |
*** pbourke has quit IRC | 15:18 | |
fungi | michaeldorner: because you've got me curious, i'm doing a fresh run of https://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/who-approves.py to find out how many core reviewers (people with approval rights) there are across all official openstack team deliverable repositories | 15:19 |
fungi | i'll let you know once it's done, but may be ~15 minutes or so to complete the requisite queries | 15:19 |
openstackgerrit | Graham Hayes proposed openstack-infra/yaml2ical master: Allow for meeting to be schedualed every 4 weeks. https://review.openstack.org/566335 | 15:19 |
*** dave-mccowan has quit IRC | 15:20 | |
*** ramishra has quit IRC | 15:22 | |
*** pbourke has joined #openstack-infra | 15:26 | |
*** nicolasbock has quit IRC | 15:26 | |
*** dave-mccowan has joined #openstack-infra | 15:27 | |
*** dayou_ has quit IRC | 15:29 | |
*** e0ne has quit IRC | 15:31 | |
openstackgerrit | James E. Blair proposed openstack-infra/ansible-role-puppet master: Update to support puppet v5 https://review.openstack.org/566346 | 15:31 |
fungi | mmm, who-approves.py still wants to use the old gitweb interface we lost in the gerrit 2.13 upgrade | 15:33 |
openstackgerrit | James E. Blair proposed openstack-infra/ansible-role-puppet master: Update to support puppet v5 https://review.openstack.org/566346 | 15:33 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Support puppet 5 on ubuntu https://review.openstack.org/564898 | 15:34 |
corvus | we're going to find out if i've learned how to ansible :) | 15:34 |
radez | Hey folks, these groups were created for me yesterday: https://review.openstack.org/#/admin/groups/?filter=networking-ansible | 15:36 |
*** ykarel is now known as ykarel|away | 15:36 | |
*** hashar is now known as hasharAway | 15:36 | |
radez | is this the right venue to req to be added to them? re: https://review.openstack.org/#/c/565370/ | 15:37 |
clarkb | radez: yup I'll take a look momentarily | 15:37 |
radez | thx clarkb | 15:37 |
clarkb | fungi: I'm glad the recent road work here didn't lead to destroy the Internets | 15:39 |
clarkb | radez: done | 15:40 |
radez | clarkb++ | 15:40 |
radez | thx for the quick response | 15:40 |
*** nicolasbock has joined #openstack-infra | 15:40 | |
*** bnemec is now known as beekneemech | 15:42 | |
*** dansmith is now known as superdan | 15:45 | |
clarkb | radez: no problem. A quick and easy first task of the morning. | 15:45 |
clarkb | Now to double check that those ci jobs being accused of running on reused nodes didn't run on reused nodes | 15:46 |
*** armaan has quit IRC | 15:49 | |
*** armaan has joined #openstack-infra | 15:49 | |
openstackgerrit | Merged openstack-infra/project-config master: Add initial job to zuul for networking-ansible https://review.openstack.org/565373 | 15:50 |
*** dpawlik has joined #openstack-infra | 15:57 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Add fedora-28 to nodepool dsvm https://review.openstack.org/559211 | 15:57 |
*** michaeldorner has quit IRC | 15:59 | |
dhellmann | does the wiki still send email when watched pages are changed? I'm trying to figure out if I'm not receiving them or if they're not being sent. | 16:00 |
clarkb | dhellmann: it sent me mail as recently as may 1st for a page I watch | 16:00 |
*** gyee has joined #openstack-infra | 16:00 | |
clarkb | (the infra meeting agenda page) | 16:00 |
*** eernst has quit IRC | 16:01 | |
dhellmann | clarkb : can you give me a search string to help me find similar messages? looking for "wiki openstack" is not producing useful results | 16:01 |
clarkb | the from is noc@openstack.org mailed by wiki.openstack.org. Subject is "OpenStack page foo/bar/etc has been changed by $user" | 16:01 |
dhellmann | cool, thanks | 16:02 |
*** dpawlik has quit IRC | 16:02 | |
*** eernst has joined #openstack-infra | 16:04 | |
*** rkukura has joined #openstack-infra | 16:06 | |
*** germs has quit IRC | 16:08 | |
*** EmilienM is now known as EvilienM | 16:09 | |
rajinir | Zuul Merger on out thirdparty is starting to fail. Has anything chnaged? | 16:09 |
rajinir | ERROR zuul.Merger: Unable to reset repo <zuul.merger.merger.Repo object at 0x7f6e42f90e90> | 16:09 |
rajinir | ERROR zuul.Merger: Unable to reset repo <zuul.merger.merger.Repo object at 0x7f6e42f90e90> | 16:09 |
dhellmann | well, I'm not finding any wiki messages at all. I have a rule for that email address to sort them into a folder that exists. and I used to get email reliably. :-( | 16:10 |
clarkb | dhellmann: any idea when the last one you got was? | 16:10 |
dhellmann | no, I don't have any old ones (they expired out of the mailbox and were expunged) | 16:11 |
*** armaan has quit IRC | 16:11 | |
clarkb | dhellmann: and is it to a redhat mx? could be possible that specific destinations are filtering them out | 16:11 |
dhellmann | no, it's to my doughellmann.com address | 16:11 |
clarkb | dhellmann: we'll have to look at logs probably | 16:11 |
dhellmann | that's the email I have set up LP, and that's the email the wiki thinks I have | 16:11 |
*** armaan has joined #openstack-infra | 16:11 | |
mordred | I don't see any doughellmann entries in the exim logs | 16:11 |
clarkb | rajinir: zuulv3 work is fairly full steam ahead. Are you running v3 or v2? | 16:11 |
rajinir | v2 | 16:11 |
rajinir | clarkb: zull v2 | 16:12 |
dhellmann | is there a sandbox page I can use to trigger something? | 16:12 |
clarkb | rajinir: v2 shouldn't have changed at all since the last tag we made prior to v3 branch merging | 16:12 |
dhellmann | I didn't have the "send me emails I send to others" flag turned on for my most recent edit | 16:12 |
mordred | but I do see entries for cboylan | 16:12 |
*** Guest59082 has quit IRC | 16:12 | |
clarkb | rajinir: do those log entries come with tracebacks? | 16:12 |
rajinir | clarkb: Stopped working since May2 10.30 AM CST | 16:12 |
*** fried_rice is now known as fried_rolls | 16:13 | |
clarkb | dhellmann: I'm not aware of one but you could create one :) | 16:13 |
rajinir | Clark: error from merger-debug.log https://www.irccloud.com/pastebin/pPa6qmEN/Merger%20error | 16:13 |
mordred | dhellmann: I'm watching the exim logs at the moment | 16:13 |
*** r-daneel has quit IRC | 16:13 | |
clarkb | dhellmann: if you give me a link I can make edits too so that you can test the other user making changes approach | 16:13 |
dhellmann | let me make a change on the TC Tracker page | 16:13 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Fix typo with _logConsole function https://review.openstack.org/566356 | 16:13 |
mordred | ++ | 16:13 |
*** r-daneel has joined #openstack-infra | 16:13 | |
dhellmann | https://wiki.openstack.org/w/index.php?title=Technical_Committee_Tracker&action=edit | 16:14 |
dhellmann | ok, my edit was saved | 16:14 |
mordred | dhellmann: that sent an email to thierry | 16:14 |
clarkb | rajinir: stderr: 'fatal: Could not read from remote repository. is the clue we need. We moved our gerrit install and it has a new ip address now. You are likely getting firewall filtered? | 16:14 |
clarkb | rajinir: I would try testing connectivity to review.o.o independent of zuul and work from there | 16:15 |
*** kiennt26 has quit IRC | 16:15 | |
rajinir | clark: Is there a email that I missed. What was the old ip? | 16:15 |
mordred | dhellmann: do you have the right notifications set on https://wiki.openstack.org/wiki/Special:Preferences#mw-prefsection-echo ? | 16:16 |
rajinir | clark: ping of ping review.openstack.org works | 16:16 |
dhellmann | mordred as far as I can tell I have all notifications turned on | 16:16 |
clarkb | rajinir: there were many emails from pabelanger. ping uses icmp packets and not tcp to ports 443 and 29418 | 16:17 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Remove debian-jessie from nodepool dsvm testing https://review.openstack.org/566327 | 16:17 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Add fedora mirror to nodepool dsvm jobs https://review.openstack.org/566102 | 16:17 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Add fedora-28 to nodepool dsvm https://review.openstack.org/559211 | 16:17 |
clarkb | rajinir: I would try curl/wget for web traffic and ssh directly for ssh traffic | 16:17 |
dhellmann | enable email from other users; send me copies; email me when a page or a file is changed; email me for minor edits -- all checked yes | 16:17 |
dhellmann | email address as confirmed 2014 | 16:17 |
mordred | dhellmann: those are different options than I'm seeing on my preferences page | 16:18 |
dhellmann | I have no "real name" set; do I need that? | 16:18 |
mordred | oh - wow. there are two different sets of email settings | 16:18 |
dhellmann | mordred : ok, I went to my name at the top of the page and clicked "preferences" then scrolled down | 16:18 |
dhellmann | oh, yay | 16:18 |
dhellmann | how did you get to that page you linked earlier? | 16:18 |
mordred | dhellmann: there's the email settings on User Profile - but there's also a notifications panel | 16:18 |
pabelanger | clarkb: rajinir: here is one of the emails for IP information: http://lists.openstack.org/pipermail/openstack-dev/2018-May/130118.html | 16:18 |
rajinir | clarkb: ssh works. "ssh -p 29418 openstack-ironic-ci@review.openstack.org gerrit stream-events" , able to see responses | 16:19 |
dhellmann | ok, I have turned on all of those as well except "email from other user" which it won't let me set on | 16:19 |
*** derekh has quit IRC | 16:21 | |
clarkb | rajinir: from the merger host? what about `curl https://review.openstack.org` ? | 16:22 |
mordred | dhellmann: have you made any additional edits you would expect to email you? | 16:23 |
dhellmann | I'm going to do one now | 16:23 |
clarkb | and is now a good time for me to make an edit? | 16:23 |
rajinir | pabelanger, clarkb: "curl https://review.openstack.org" works | 16:23 |
dhellmann | I changed open-id to sync my email on each login, then logged out, and now I'm going to make an edit | 16:23 |
*** rpioso|afk is now known as rpioso | 16:23 | |
dhellmann | mordred : done | 16:24 |
clarkb | rajinir: what does `git remote -v` show you in that repo? | 16:24 |
mordred | dhellmann: I also edited the page - and I see that an email was sent to you | 16:24 |
clarkb | rajinir: specific for the origin remote | 16:24 |
dhellmann | mordred : I can confirm that I received it | 16:24 |
mordred | woot | 16:24 |
mordred | I do not know why it stopped working for you | 16:24 |
dhellmann | so I wonder which change was needed; the notifications thing or the open-id thing | 16:24 |
mordred | it's a mystery | 16:24 |
dhellmann | I received the email from your change, but not mine, but that's ok | 16:25 |
dhellmann | I don't need to be notified when I change a page | 16:25 |
mordred | dhellmann: not related to that - but thank you for your lower-constraints work - it totally just appropriately failed a test where I should have bumped a min | 16:25 |
dhellmann | \o/ | 16:25 |
dhellmann | mordred, clarkb : thanks for your help fixing my notification emails | 16:26 |
mordred | \o/ | 16:26 |
mordred | it's like a day of accomplishments | 16:26 |
rajinir | <clarkb> that repo error message cam from the merger-debug.log. I'm not sure where I should run the "git remote -v" in | 16:27 |
clarkb | rajinir: /var/lib/zuul/git/openstack/ironic says the log file | 16:28 |
rajinir | Ah: that folder is missing | 16:28 |
clarkb | rajinir: if you restart the merger I believe it will reclone missing repos | 16:29 |
clarkb | that might be the easiest fix if the problem is the repo does not exist | 16:29 |
frickler | rajinir: clarkb: maybe a restart of the merger is needed in order to pick up the new address from DNS? | 16:29 |
frickler | there was a similar issue earlier today | 16:30 |
*** jpich has quit IRC | 16:31 | |
rajinir | clarkb: same error, its not recloning the missing repos | 16:32 |
rajinir | clarkb: after the restart | 16:32 |
rajinir | clarkb: shall I manually clone it | 16:32 |
clarkb | rajinir: does /var/lib/zuul/git exist? | 16:32 |
*** dtantsur is now known as dtantsur|afk | 16:32 | |
clarkb | and and are permissions set to allow zuul to write to it? | 16:33 |
rajinir | yes | 16:33 |
rajinir | it has other projects | 16:33 |
rajinir | https://www.irccloud.com/pastebin/ueslbSjV/ | 16:33 |
clarkb | ya you can try manually cloning it, that shouldn't be necessary though so debugging why clones aren't happening may be useful | 16:33 |
fungi | dhellmann: sorry, catching back up... mediawiki doen't send you notifications of your own edits. that "send me copies of messages i send to other users" option is, i believe, for the mediawiki contact feature where you can send specific messages to other users. i don't believe it's associated at all with page watches | 16:34 |
dhellmann | fungi : ah, that makes more sense | 16:35 |
rajinir | clarkb: Ironic project is under the folder /var/lib/zuul/git/openstack | 16:35 |
rajinir | https://www.irccloud.com/pastebin/DKmmxpsL/ | 16:36 |
clarkb | rajinir: did you clone it or did it clone it? | 16:37 |
rajinir | clarkb: It was already there | 16:37 |
rajinir | clarkb: I missed it before sorry | 16:38 |
clarkb | rajinir: and when you were testing ssh before you were on that host? | 16:38 |
clarkb | since that remote says ssh that is what we need to ensure is working | 16:38 |
rajinir | clarkb: Yes same host | 16:38 |
*** eharney has quit IRC | 16:38 | |
pabelanger | maybe ssh -v review.openstack.org -p29418 | 16:38 |
pabelanger | see what the output says | 16:39 |
clarkb | the other thing to consider is the user and the ssh key | 16:39 |
clarkb | you'll want to test that as the zuul user to make sure it has access to the key | 16:39 |
pabelanger | yah, was thinking that too | 16:39 |
rajinir | pabelanger> :clarkb: permission denied "ssh -v review.openstack.org -p29418" | 16:40 |
clarkb | rajinir: you might have to specify the user | 16:41 |
rajinir | https://www.irccloud.com/pastebin/DwJPVQWX/ | 16:41 |
pabelanger | yah, you are trying root | 16:41 |
pabelanger | but you routed to review.o.o | 16:41 |
rajinir | pabelanger> the ssh keys for root and zuul are same, I can retry as zuul | 16:42 |
clarkb | rajinir: the problem isn't the local user its the remote user. You can't ssh to review.o.o as root on the review.o.o | 16:43 |
fungi | rajinir: running `ssh review.openstack.org ...` as the root account infers that you want to authenticate as root@review.openstack.org | 16:43 |
rajinir | oh sorry | 16:43 |
*** trown is now known as trown|lunch | 16:43 | |
pabelanger | ssh -v openstack-ironic-ci@review.openstack.org -p29418 | 16:43 |
rajinir | ssh -v openstack-ironic-ci@review.openstack.org -p29418 works fine | 16:43 |
rajinir | https://www.irccloud.com/pastebin/Ls70a7F6/ | 16:44 |
pabelanger | I'd try again as your zuul user to confirm | 16:44 |
*** shoogz has quit IRC | 16:44 | |
*** armaan has quit IRC | 16:45 | |
rajinir | pabelanger: zuul user has issue | 16:45 |
pabelanger | permission denied? | 16:45 |
rajinir | pabelanger:yes permission denied | 16:45 |
pabelanger | oh | 16:46 |
pabelanger | you might need to use -i to path of your private key | 16:46 |
pabelanger | will be value in /etc/zuul.conf | 16:46 |
pabelanger | otherwise, you private key might not be correct any more | 16:46 |
rajinir | pabelanger: "ssh -i /var/lib/zuul/ssh/id_rsa -v openstack-ironic-ci@review.openstack.org -p29418" worked | 16:48 |
pabelanger | okay, I'd expect zuul-merger to still work then | 16:48 |
rajinir | zuul.conf is referring to /var/lib/zuul/ssh/id_rsa | 16:48 |
rajinir | cd /etc | 16:49 |
rajinir | zuul.conf:server=review.openstack.org | 16:49 |
pabelanger | rajinir: and zuul-merger is running a zuul user? | 16:49 |
*** udesale has quit IRC | 16:50 | |
rajinir | Both are zuul and zuul-merger are running as root. It always was | 16:50 |
*** dkliban has left #openstack-infra | 16:50 | |
pabelanger | Ah, okay, they don't need to use root but that is a change for another day | 16:51 |
rajinir | pabelanger: ok | 16:51 |
rajinir | pabelanger: yes defintely a key issue | 16:53 |
rajinir | panelanger: When I run "git fetch --tags -v origin" in the openstack/ironic fit folder which the merger is doing, I see the same error | 16:53 |
pabelanger | and root user can read /var/lib/zuul/ssh/id_rsa ? | 16:54 |
pabelanger | eg | 16:54 |
pabelanger | # ssh -i /var/lib/zuul/ssh/id_rsa -v openstack-ironic-ci@review.openstack.org -p29418 | 16:54 |
pabelanger | as root | 16:54 |
*** shoogz has joined #openstack-infra | 16:55 | |
rajinir | Yes, root user can run that as well | 16:55 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: De-gitweb-ify who-approves.py https://review.openstack.org/566365 | 16:55 |
*** armaan has joined #openstack-infra | 16:55 | |
*** jpena is now known as jpena|off | 16:55 | |
fungi | michaeldorner: script needed some fixes ^ | 16:55 |
rajinir | pabelanger: .git/config | 16:56 |
rajinir | https://www.irccloud.com/pastebin/AlVbA6dw/ | 16:56 |
pabelanger | rajinir: and if you deleted the repo, zuul-merger won't reclone it? or get the same error | 16:56 |
fungi | michaeldorner: at present count we have 760 distinct people with permission to approve changes to one or more of the 801 deliverable repositories for official openstack project teams | 16:57 |
rajinir | pabelanger: I can rename it and restart to see if that fixes the problem | 16:57 |
pabelanger | I just checked zm01.o.o debug logs and can see no issue with ironic | 16:57 |
pabelanger | so, maybe something it breaking git connection on network? | 16:58 |
pabelanger | rajinir: this is corporate network? | 16:58 |
rajinir | pabelanger: nope, we have a special lab | 16:58 |
rajinir | with exceptions | 16:59 |
pabelanger | see if zuul-merger reclones, but might need to talk with NOC team and confirm new IP is whitelisted | 16:59 |
pabelanger | that's about the only thing I can think off | 16:59 |
clarkb | you can try running those git commands manually too | 17:00 |
clarkb | and even strace them to see what is going on | 17:00 |
rajinir | ok | 17:07 |
*** panda is now known as panda|off | 17:07 | |
rajinir | will try now | 17:07 |
*** tesseract has quit IRC | 17:09 | |
*** myoung|ruck is now known as myoung|ruck|biab | 17:13 | |
*** chandankumar is now known as huntman | 17:16 | |
*** huntman is now known as groot | 17:16 | |
*** esberglu has quit IRC | 17:17 | |
*** germs has joined #openstack-infra | 17:18 | |
*** germs has quit IRC | 17:18 | |
*** germs has joined #openstack-infra | 17:18 | |
*** germs has quit IRC | 17:19 | |
*** pblaho has quit IRC | 17:19 | |
*** germs has joined #openstack-infra | 17:19 | |
*** AR2018 has joined #openstack-infra | 17:20 | |
openstackgerrit | Eric Brown proposed openstack-infra/project-config master: Remove Bandit from Infrastructure Systems https://review.openstack.org/565537 | 17:20 |
pabelanger | clarkb: fungi: mind a review on https://review.openstack.org/565869/ removes some testing on trusty for system-config | 17:23 |
pabelanger | we also should figure out the next step to migrate the servers we missed last time we migrated from trusty -> xenial. We'll need to schedule outages for most of them | 17:24 |
pabelanger | eg: static.o.o / lists.o.o | 17:24 |
clarkb | etherpad and ethercalc | 17:24 |
pabelanger | yah | 17:25 |
clarkb | maybe we wait for post summit at this point for those | 17:25 |
clarkb | but ya | 17:25 |
clarkb | pabelanger: start by generating an up to date list of trusty nodes? | 17:25 |
pabelanger | sure | 17:25 |
fungi | lists.o.o we deliberately delayed as we're going to want to do an in-place upgrade on it like last time so we can preserve its ip address | 17:25 |
*** tosky has quit IRC | 17:27 | |
*** tosky has joined #openstack-infra | 17:30 | |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: WIP: Docker matrix build https://review.openstack.org/414347 | 17:31 |
openstackgerrit | Merged openstack-infra/nodepool master: Fix typo with _logConsole function https://review.openstack.org/566356 | 17:31 |
pabelanger | clarkb: do you remember the syntax you used? lsb_release -d on all hosts? | 17:33 |
clarkb | I think -c ? | 17:34 |
pabelanger | -c works too | 17:34 |
pabelanger | clarkb: ianw: any objections is I delete the old mirror-update.openstack.org server from rax? I think we can say mirror-update01.o.o is working fine | 17:37 |
clarkb | I'm fine with it | 17:38 |
pabelanger | ack, will delete | 17:38 |
*** groot is now known as chandankumar | 17:39 | |
fungi | wfm | 17:43 |
*** ykarel|away has quit IRC | 17:43 | |
*** rkukura has quit IRC | 17:44 | |
*** yamamoto has joined #openstack-infra | 17:50 | |
*** trown|lunch is now known as trown | 17:52 | |
*** pcaruana has joined #openstack-infra | 17:54 | |
*** yamamoto has quit IRC | 17:54 | |
*** eharney has joined #openstack-infra | 17:56 | |
*** aojea has quit IRC | 17:58 | |
*** dpawlik has joined #openstack-infra | 17:58 | |
*** dpawlik has quit IRC | 18:03 | |
pabelanger | fungi: clarkb: okay, I've started work on https://etherpad.openstack.org/p/infra-sprint-xenial-upgrades-part2 even included link to ethercalc for us to decided when to next have virtual sprint | 18:05 |
pabelanger | there is about 30 servers left to upgrade to xenial | 18:05 |
rajinir | pabelanger> Temporarily I changed the remote url to use https to get it working | 18:07 |
pabelanger | rajinir: ack, good to know | 18:08 |
*** pcichy has quit IRC | 18:13 | |
rajinir | <pabelanger,clarkb> Thank you for your time to narrow down the issue. | 18:14 |
*** Goneri has quit IRC | 18:14 | |
mordred | pabelanger, fungi, clarkb: this may be a dumb question - but should we consider upgrading those services directly to bionic? | 18:16 |
fungi | mordred: perhaps? i mean, for lists.o.o almost certainly (that's what we did for precise-trusty) but in general rebuilding from scratch has been good hygiene to help us track down bootstrap-oriented regressions in our configuration management | 18:18 |
clarkb | mordred: we don't currently have a puppet option for bionic (corvus is working through that) | 18:19 |
clarkb | mordred: hence the we need to sort out future of config management | 18:19 |
mordred | fungi: oh - yeah, I mean doing a rebuild - but on bionic | 18:19 |
*** janki has quit IRC | 18:19 | |
clarkb | if we had working puppet I think we would but right now getting to xenial is probably a bigger leap in general | 18:20 |
mordred | clarkb: and yes, this is an excellent point ... I guess maybe what I should have said is "maybe we should wait to do this sprint until we know what the future of config management is, and then once we know, perhaps we should just rebuild the new services directly on bionic" | 18:20 |
clarkb | xienal to bionic seems mostly the same from a server standpoint | 18:20 |
clarkb | all the changes were desktop side of house | 18:20 |
mordred | but we can also do trusty-xenial and then later xenail-bionic too | 18:20 |
fungi | mordred: oh! asking whether we should skip from trusty to bionic? | 18:22 |
*** rosmaita has quit IRC | 18:22 | |
clarkb | fungi: yes | 18:22 |
*** dtruong2 has joined #openstack-infra | 18:22 | |
*** dtruong2 has joined #openstack-infra | 18:22 | |
fungi | seems kinda soon to be putting production workloads on bionic, and unfortunately it's mostly important systems remaining | 18:23 |
*** kgiusti has quit IRC | 18:27 | |
corvus | we have a year of trusty left -- i think deferring until we have future-of-config-mgmt sorted out seems reasonable, because, especially if we go a non-puppet route, a jump from trusty to bionic seems like it might work out well | 18:32 |
*** owalsh is now known as owalsh-afk | 18:32 | |
corvus | i mean, hopefully we'll have that question answered within the next couple of weeks at most anyway, then we can make a plan based on that | 18:32 |
corvus | (i say especially for a non-puppet route because both non-puppet options mean our operating system version is less (or not at all) tied to our config management version) | 18:33 |
mordred | corvus: ++ | 18:34 |
fungi | but also if we end up deciding to switch to non-puppet that helps us not have to worry about <bionic support in whatever we have to write from scratch | 18:35 |
mordred | yup | 18:37 |
*** eernst has quit IRC | 18:38 | |
*** gyankum has quit IRC | 18:49 | |
*** fried_rolls is now known as fried_rice | 18:49 | |
openstackgerrit | Monty Taylor proposed openstack-infra/nodepool master: Add openstacksdk to nodepool-functional-py35-src https://review.openstack.org/566387 | 18:50 |
*** eernst has joined #openstack-infra | 18:57 | |
*** dtruong2 has quit IRC | 18:59 | |
*** rosmaita has joined #openstack-infra | 19:00 | |
*** pcaruana has quit IRC | 19:10 | |
pabelanger | heads up, power is out here. I'm tethered to a GSM modem ATM | 19:14 |
fungi | pabelanger: woo! at least i have power so i don't have to worry about my gsm modem running out of battery | 19:16 |
pabelanger | fungi: yah, I have 1hr still but going to offline for a bit to conserve | 19:18 |
*** florianf has quit IRC | 19:18 | |
pabelanger | I'll check back periodically | 19:18 |
*** Goneri has joined #openstack-infra | 19:19 | |
clarkb | I'm worried what is going to happen to me now | 19:19 |
*** eernst has quit IRC | 19:20 | |
*** eernst has joined #openstack-infra | 19:20 | |
fungi | we're all being strategically targeted as part of some coordinated scheme to take down the infrastructure | 19:20 |
*** eernst has quit IRC | 19:28 | |
clarkb | so I've poked around possible options for infra team dinner. I think Monday is our best scheduling option. As far as venues go I'm having a hard time finding places that will take groups and not make a giant production out of it | 19:31 |
clarkb | however tap and barrel and craft beer market seems like maybe they would work | 19:31 |
clarkb | EvilienM: ^ it was mentioned i should bug you | 19:31 |
fungi | one of those where we just sort of all show up and head to different tables? | 19:31 |
clarkb | ya it may be, otherwise its paying deposits for set dinners and I'm not in the mood for setting that up or figuring out how to pay for it | 19:32 |
fungi | agreed. somethnig informal where we don't all have one huge table nor necessarily get seated/served at exactly the same time seems fine to me | 19:34 |
dmsimard | +1 | 19:34 |
EvilienM | clarkb: me or the evil? | 19:37 |
clarkb | EvilienM: the bar hopping french canadian :P | 19:38 |
bkero | Danger, danger | 19:39 |
* fungi wonders if EvilienM looks like EmilienM with a mustache and goatee, a la the star trek "mirror mirror" episode | 19:40 | |
bkero | Almost certainly. Can we get a gimp edit to prove it? :D | 19:41 |
*** eernst has joined #openstack-infra | 19:42 | |
openstackgerrit | Anita Kuno proposed openstack-infra/system-config master: This patch impliments the survey spec: I3c389596373b94459a32a4e540d514a2941acbb1 https://review.openstack.org/557979 | 19:44 |
EvilienM | clarkb: I'll come back to you after my lunch | 19:47 |
EvilienM | but I have a lot of options for you | 19:47 |
openstackgerrit | Anita Kuno proposed openstack-infra/system-config master: This patch impliments the survey spec: I3c389596373b94459a32a4e540d514a2941acbb1 https://review.openstack.org/557979 | 19:47 |
anteaya | pabelanger, what is wrong with the power where you are? | 19:51 |
anteaya | how did it happen that it is absent? | 19:52 |
*** ykarel|away has joined #openstack-infra | 19:53 | |
* fungi expects it is faced with an insurmountable insulator | 19:55 | |
anteaya | ha ha ha | 19:56 |
anteaya | perhaps a racoon | 19:56 |
anteaya | ah, they have a wind warning: https://weather.gc.ca/city/pages/on-147_metric_e.html | 19:57 |
anteaya | yes, a tree taking out a line would be quite the insulator | 19:57 |
TheJulia | Well, it might not be insulating... where as it could be shunting back ground instead | 19:58 |
*** e0ne has joined #openstack-infra | 19:59 | |
anteaya | TheJulia, good point | 19:59 |
*** dpawlik has joined #openstack-infra | 19:59 | |
fungi | i'm heading out to get some food, back later | 20:01 |
openstackgerrit | Anita Kuno proposed openstack-infra/system-config master: This patch impliments the survey spec: I3c389596373b94459a32a4e540d514a2941acbb1 https://review.openstack.org/557979 | 20:03 |
*** dpawlik has quit IRC | 20:04 | |
*** bgmccollum_ is now known as bgmccollum | 20:08 | |
clarkb | corvus: I'm going to finish up lunch but then I think it would probably be a good time ti restart the zuul scheduler to pick up the config inclusions fix | 20:14 |
clarkb | more of a heads up than anything else I guess | 20:14 |
clarkb | mordred: ^ also pinging you as you were workign on getting openstacksdk type fixes out the door? | 20:14 |
corvus | clarkb: sounds good; things don't seem crazy busy | 20:16 |
*** jcoufal has quit IRC | 20:18 | |
*** gfidente has quit IRC | 20:20 | |
*** armaan has quit IRC | 20:23 | |
*** armaan has joined #openstack-infra | 20:23 | |
TheJulia | anteaya: Of course, the happy medium between the two is the voltage getting high enough to jump the air gap and arc | 20:24 |
anteaya | TheJulia, oh that sounds fun | 20:24 |
anteaya | actually it sounds like large arcs are headed my way | 20:24 |
anteaya | so I think I may be unplugging for a bit until it finishes | 20:25 |
*** anteaya has quit IRC | 20:26 | |
*** Goneri has quit IRC | 20:29 | |
EvilienM | clarkb, fungi : I have some suggestions for you then, based on what you want. Feel free to look on their websites: | 20:31 |
EvilienM | http://www.elephantcastle.com/marine_bldg | 20:32 |
EvilienM | http://donnellygroup.ca/the-blackbird/ this one is good but not if you're a lot | 20:33 |
EvilienM | https://theportsidepub.com/ is really nice but might be noisy, probably not too busy for a Monday | 20:33 |
EvilienM | and my favourite place: http://www.joefortes.ca/ | 20:34 |
EvilienM | this place is AMAZING | 20:34 |
EvilienM | on my list, there is https://www.backandforthbar.com/ as well. The food isn't amazing (more snacks than actual meals) but a good place to hangout | 20:35 |
*** hasharAway is now known as hashar | 20:36 | |
*** ykarel|away has quit IRC | 20:44 | |
*** camunoz has quit IRC | 20:45 | |
clarkb | EvilienM: thanks! | 20:49 |
EvilienM | I hope it helped | 20:49 |
clarkb | corvus: ok I'm just about ready to restart the scheduler. I'm gonna double check with release team as there was earlier mention of maybe doing some bug fix releases for modred | 20:52 |
corvus | clarkb: cool. pipelines look clear | 20:52 |
clarkb | corvus: zuul==3.0.3.dev64 # git sha 7816dfc looks correct to me on zuul01 | 20:54 |
corvus | ayup | 20:54 |
clarkb | release team says go for it | 20:54 |
clarkb | corvus: dump queues then stop, start zuul-scheduler then restart zuul-web and reenqueue once openstack tenant is ready? | 20:55 |
corvus | clarkb: yep. see if zuul-web survives though. | 20:55 |
clarkb | ok I'm starting that now | 20:56 |
corvus | i thought it might have last time we restarted, though i know of no fix. so it's just more data collection. | 20:56 |
clarkb | scheduler is starting back up again | 20:57 |
clarkb | zuul web seems happy other than the tenant isn't ready yet | 20:57 |
*** bobh has quit IRC | 20:57 | |
*** trown is now known as trown|outtypewww | 20:57 | |
*** bobh has joined #openstack-infra | 20:58 | |
clarkb | enqueuing jobs now | 21:00 |
corvus | yep, and my status page refreshed without incident | 21:00 |
clarkb | took about 4 minutes to laod which seems about right ( so I think theory about gerrit caches is probably accurate) | 21:01 |
corvus | cool, that's actually even a little fast i think (i had 6m in my mind) | 21:01 |
clarkb | enqueueing of check is done now too | 21:05 |
clarkb | (gate was done first) | 21:05 |
clarkb | corvus: I wonder if the asyncio gearman is what makes zuul-web happy now | 21:05 |
clarkb | it may still be blocking on those old connections until the timeout but new connections hit new gearman server and all is happy | 21:06 |
*** VW_ has joined #openstack-infra | 21:09 | |
*** e0ne has quit IRC | 21:11 | |
*** mriedem is now known as mriedem_yard | 21:13 | |
corvus | clarkb: could be! | 21:13 |
*** VW has quit IRC | 21:13 | |
openstackgerrit | Merged openstack-infra/zuul master: Add zuul systemd drop-in files for CentOS 7 https://review.openstack.org/565074 | 21:13 |
openstackgerrit | Merged openstack-infra/zuul master: Skip attempting python3-devel installation on CentOS 7 https://review.openstack.org/565080 | 21:13 |
*** VW_ has quit IRC | 21:13 | |
*** ldnunes has quit IRC | 21:17 | |
openstackgerrit | Merged openstack-infra/zuul master: Add start and end timestamp to task and play result in zuul_json callback https://review.openstack.org/563888 | 21:17 |
*** myoung|ruck|biab is now known as myoung|ruck | 21:18 | |
pabelanger | and power is back | 21:19 |
*** dave-mccowan has quit IRC | 21:19 | |
*** felipemonteiro has quit IRC | 21:20 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add logo to docs https://review.openstack.org/566406 | 21:22 |
pabelanger | clarkb: I think glean is broken on tumbleweed: http://logs.openstack.org/11/559211/5/experimental/nodepool-functional-py35-suse-src/7973ce7/controller/logs/screen-nodepool-launcher.txt.gz | 21:22 |
pabelanger | I'll maybe give it a go on monday see if I can find anything specific | 21:23 |
*** bobh has quit IRC | 21:23 | |
pabelanger | also, any ideas how we can avoid the double timestamps? | 21:23 |
pabelanger | May 04 17:04:30.154714 ubuntu-xenial-inap-mtl01-0003873903 nodepool-launcher[25044]: 2018-05-04 17:04:30,154 DEBUG nodepool.ProviderManager: Creating new ProviderManager object for devstack | 21:23 |
clarkb | pabelanger: re timestamps I believe expectation is systemd provides them for devstack services. To fix it we can stop adding timestamps to our log formatters when run under devstack | 21:24 |
pabelanger | clarkb: kk, I'll look at the logging handlers | 21:25 |
clarkb | and ya looks like it starts glean for ens3 but then it doesn't finish successfully/ | 21:26 |
*** dbecker has quit IRC | 21:38 | |
*** hashar has quit IRC | 21:42 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add logo to docs https://review.openstack.org/566406 | 21:47 |
*** edmondsw has quit IRC | 21:47 | |
*** edmondsw has joined #openstack-infra | 21:47 | |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool master: Remove initial stub release note https://review.openstack.org/566409 | 21:48 |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool master: Add logo to docs https://review.openstack.org/566410 | 21:48 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add logo to docs https://review.openstack.org/566411 | 21:50 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul-base-jobs master: Add logo to docs https://review.openstack.org/566412 | 21:51 |
*** hamzy_ has joined #openstack-infra | 21:51 | |
*** edmondsw has quit IRC | 21:52 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul-sphinx master: Add logo to docs https://review.openstack.org/566413 | 21:52 |
*** hamzy has quit IRC | 21:54 | |
*** wolverineav has quit IRC | 21:54 | |
*** wolverineav has joined #openstack-infra | 21:55 | |
*** AR2018 has quit IRC | 21:55 | |
*** wolverineav has quit IRC | 21:59 | |
openstackgerrit | Clark Boylan proposed openstack-infra/jeepyb master: Cache created-in-github properly https://review.openstack.org/566416 | 22:01 |
openstackgerrit | Clark Boylan proposed openstack-infra/jeepyb master: Check github groups case insensitively https://review.openstack.org/566417 | 22:01 |
clarkb | corvus: fungi pabelanger ^ followup from yesterday. I am going to WIP those because I want to test them probably on review-dev first then review.o.o before we merge | 22:01 |
clarkb | however I think they are ready for review if you want ot take a look given what we learned yesterday | 22:01 |
openstackgerrit | James E. Blair proposed openstack-infra/puppet-mailman master: Exit 0 if MAILMAN_SITE_DIR is not set https://review.openstack.org/566418 | 22:02 |
*** slaweq has quit IRC | 22:03 | |
corvus | clarkb, fungi, pabelanger: ^ that should get things working on lists.o.o again. I manually tried it with an "apt-get upgrade" there and it completes now. | 22:03 |
clarkb | corvus: another approach may be to have a default site dir that dpkg can update? | 22:04 |
clarkb | but maybe best to avoid getting out of sync across site dirs | 22:04 |
corvus | clarkb: we don't actually care about anything it's doing anyway. | 22:05 |
corvus | clarkb: it's just trying to figure out what languages are used, but we manage that ourselves | 22:05 |
corvus | clarkb: comment on that first change; second lgtm. | 22:07 |
*** ccamacho has quit IRC | 22:10 | |
*** jtomasek has quit IRC | 22:10 | |
clarkb | aha! the return value is really replicate or not, that also explains why we set it to true if we add gerrit to the group | 22:11 |
*** ccamacho has joined #openstack-infra | 22:12 | |
*** AR2018 has joined #openstack-infra | 22:16 | |
openstackgerrit | Clark Boylan proposed openstack-infra/jeepyb master: Check github groups case insensitively https://review.openstack.org/566417 | 22:18 |
openstackgerrit | Clark Boylan proposed openstack-infra/jeepyb master: Cache created-in-github properly https://review.openstack.org/566416 | 22:18 |
clarkb | corvus: ^ I reordered them since I realized that created-in-github change is much bigger and likely to go in second | 22:19 |
*** AR2018 has quit IRC | 22:19 | |
*** r-daneel has quit IRC | 22:21 | |
*** AR2018 has joined #openstack-infra | 22:24 | |
*** markvoelker has quit IRC | 22:29 | |
*** AR2018 has quit IRC | 22:29 | |
*** rlandy has quit IRC | 22:30 | |
clarkb | doesn't look like manage_projects has ever been run on new review-dev | 22:41 |
*** rosmaita has quit IRC | 22:41 | |
*** wolverineav has joined #openstack-infra | 22:41 | |
clarkb | not surprising, but means we don't have any existing cache data there either which is likely a good thing (means we can watch it through that progression) | 22:41 |
clarkb | I'll work on that next week | 22:41 |
clarkb | now the good weather is calling me to get some work done outside | 22:41 |
*** ssbarnea_ has quit IRC | 22:43 | |
*** wolverineav has quit IRC | 22:45 | |
fungi | okay, i'm done with friday shenanigans and catching up | 22:47 |
*** wolverineav has joined #openstack-infra | 22:49 | |
*** rpioso is now known as rpioso|afk | 22:50 | |
*** linkmark has joined #openstack-infra | 22:52 | |
*** wolverineav has quit IRC | 22:53 | |
*** fried_rice is now known as efried | 22:57 | |
*** hongbin has quit IRC | 23:01 | |
*** wolverineav has joined #openstack-infra | 23:03 | |
*** wolverineav has quit IRC | 23:05 | |
*** bobh has joined #openstack-infra | 23:06 | |
*** wolverineav has joined #openstack-infra | 23:06 | |
openstackgerrit | Merged openstack-infra/puppet-mailman master: Exit 0 if MAILMAN_SITE_DIR is not set https://review.openstack.org/566418 | 23:08 |
*** wolverineav has quit IRC | 23:10 | |
*** slaweq has joined #openstack-infra | 23:11 | |
*** krtaylor has quit IRC | 23:13 | |
*** slaweq has quit IRC | 23:15 | |
*** bobh has quit IRC | 23:17 | |
*** yamamoto has joined #openstack-infra | 23:21 | |
*** VW has joined #openstack-infra | 23:24 | |
*** wolverineav has joined #openstack-infra | 23:26 | |
*** yamamoto has quit IRC | 23:26 | |
*** wolverineav has quit IRC | 23:31 | |
*** VW has quit IRC | 23:34 | |
*** wolverineav has joined #openstack-infra | 23:34 | |
*** VW has joined #openstack-infra | 23:35 | |
*** eernst has quit IRC | 23:37 | |
*** wolverineav has quit IRC | 23:39 | |
*** wolverineav has joined #openstack-infra | 23:40 | |
*** wolverineav has quit IRC | 23:40 | |
*** wolverineav has joined #openstack-infra | 23:40 | |
*** wolverin_ has joined #openstack-infra | 23:43 | |
*** wolverineav has quit IRC | 23:45 | |
*** wolverin_ has quit IRC | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!