| openstackgerrit | Mohammed Naser proposed openstack-infra/zuul master: Hide queue headers for empty queues when filtering https://review.openstack.org/572588 | 00:02 |
|---|---|---|
| *** iyamahat has joined #openstack-infra | 00:03 | |
| *** yamamoto has joined #openstack-infra | 00:03 | |
| *** yamamoto has quit IRC | 00:09 | |
| *** iyamahat_ has joined #openstack-infra | 00:10 | |
| *** iyamahat has quit IRC | 00:10 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: project-config-grafyaml: pass source to tox https://review.openstack.org/572251 | 00:10 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Fix race in slow start test https://review.openstack.org/572584 | 00:16 |
| *** iyamahat_ has quit IRC | 00:20 | |
| *** iyamahat has joined #openstack-infra | 00:20 | |
| anteaya | thanks for the review ianw | 00:23 |
| openstackgerrit | Merged openstack-infra/project-config master: Use tox for grafyaml validation https://review.openstack.org/572252 | 00:25 |
| openstackgerrit | Merged openstack-infra/project-config master: Initial grafana AFS dashboard https://review.openstack.org/572083 | 00:25 |
| *** iyamahat has quit IRC | 00:25 | |
| clarkb | anteaya: and approved | 00:25 |
| anteaya | thanks clarkb | 00:25 |
| *** rnoriega_ has joined #openstack-infra | 00:28 | |
| *** weshay_ has joined #openstack-infra | 00:28 | |
| *** rasca_ has joined #openstack-infra | 00:28 | |
| *** pabelanger_ has joined #openstack-infra | 00:28 | |
| *** otherwiseguy_ has joined #openstack-infra | 00:28 | |
| *** haleyb_ has joined #openstack-infra | 00:28 | |
| ianw | i'm just bringing up a clone of grafana01 to manually see if updating explodes or is vaguely possible | 00:29 |
| *** _ari__ has joined #openstack-infra | 00:29 | |
| ianw | we are about 3-4 years behind trunk, so, hopes aren't super high | 00:30 |
| clarkb | we deploy using system packages right? | 00:30 |
| *** otherwiseguy has quit IRC | 00:30 | |
| *** rasca has quit IRC | 00:30 | |
| clarkb | at least I seem to recall getting an update due to that at one time | 00:30 |
| ianw | from debs they provide | 00:31 |
| *** rnoriega has quit IRC | 00:31 | |
| *** myoung|off has quit IRC | 00:31 | |
| *** pabelanger has quit IRC | 00:31 | |
| *** haleyb has quit IRC | 00:31 | |
| *** _ari_ has quit IRC | 00:32 | |
| *** weshay has quit IRC | 00:32 | |
| clarkb | ah | 00:32 |
| *** myoung has joined #openstack-infra | 00:33 | |
| *** jesslampe has quit IRC | 00:36 | |
| *** jesslampe has joined #openstack-infra | 00:36 | |
| *** diablo_rojo has quit IRC | 00:38 | |
| *** mriedem_afk has quit IRC | 00:40 | |
| *** pabelanger has joined #openstack-infra | 00:42 | |
| *** rasca has joined #openstack-infra | 00:42 | |
| *** rasca_ has quit IRC | 00:42 | |
| openstackgerrit | Merged openstack-infra/system-config master: Update survey.pp for Puppet 4 https://review.openstack.org/572587 | 00:43 |
| *** rnoriega has joined #openstack-infra | 00:43 | |
| *** _ari_ has joined #openstack-infra | 00:43 | |
| *** pabelanger_ has quit IRC | 00:43 | |
| *** haleyb has joined #openstack-infra | 00:43 | |
| *** myoung_ has joined #openstack-infra | 00:43 | |
| *** weshay has joined #openstack-infra | 00:43 | |
| *** otherwiseguy_ has quit IRC | 00:44 | |
| *** haleyb_ has quit IRC | 00:44 | |
| *** weshay_ has quit IRC | 00:44 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Fix race in slow start test https://review.openstack.org/572584 | 00:44 |
| *** _ari__ has quit IRC | 00:44 | |
| *** rnoriega_ has quit IRC | 00:44 | |
| *** myoung has quit IRC | 00:44 | |
| *** otherwiseguy has joined #openstack-infra | 00:47 | |
| *** eharney has quit IRC | 00:47 | |
| *** mriedem has joined #openstack-infra | 00:51 | |
| *** edmondsw has joined #openstack-infra | 00:51 | |
| *** diablo_rojo has joined #openstack-infra | 00:54 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/system-config master: Survey Documentation https://review.openstack.org/571536 | 00:55 |
| *** edmondsw has quit IRC | 00:55 | |
| *** rpioso is now known as rpioso|afk | 00:59 | |
| *** yamamoto has joined #openstack-infra | 01:06 | |
| ianw | ahh the joy of cloud ... server is stuck building | 01:08 |
| *** harlowja has quit IRC | 01:10 | |
| anteaya | and zuul is happy with me again, at least for the moment | 01:11 |
| *** yamamoto has quit IRC | 01:11 | |
| *** xinliang has quit IRC | 01:12 | |
| *** kjackal has quit IRC | 01:19 | |
| *** namnh has joined #openstack-infra | 01:22 | |
| *** kjackal has joined #openstack-infra | 01:28 | |
| *** jbadiapa has joined #openstack-infra | 01:30 | |
| *** threestrands_ has joined #openstack-infra | 01:33 | |
| *** threestrands has quit IRC | 01:36 | |
| *** aeng has quit IRC | 01:44 | |
| *** notmyname has quit IRC | 01:45 | |
| *** gyee has quit IRC | 01:46 | |
| *** notmyname has joined #openstack-infra | 01:47 | |
| *** hongbin has joined #openstack-infra | 01:48 | |
| *** jesslampe has quit IRC | 01:49 | |
| *** yolanda_ has joined #openstack-infra | 01:56 | |
| *** yolanda_ has quit IRC | 01:57 | |
| *** jamesmcarthur has joined #openstack-infra | 01:58 | |
| *** yolanda_ has joined #openstack-infra | 01:58 | |
| *** yolanda has quit IRC | 01:59 | |
| *** yamahata has quit IRC | 01:59 | |
| *** jamesmcarthur has quit IRC | 02:02 | |
| *** mriedem is now known as mriedem_away | 02:04 | |
| *** yamamoto has joined #openstack-infra | 02:07 | |
| *** jamesmcarthur has joined #openstack-infra | 02:11 | |
| *** yamamoto has quit IRC | 02:12 | |
| *** jcoufal has joined #openstack-infra | 02:15 | |
| *** dbecker has joined #openstack-infra | 02:18 | |
| *** jcoufal has quit IRC | 02:25 | |
| *** roman_g has quit IRC | 02:27 | |
| *** jesslampe has joined #openstack-infra | 02:28 | |
| *** SumitNaiksatam has joined #openstack-infra | 02:29 | |
| *** dbecker has quit IRC | 02:32 | |
| *** ramishra has joined #openstack-infra | 02:38 | |
| *** psachin has joined #openstack-infra | 02:39 | |
| *** edmondsw has joined #openstack-infra | 02:39 | |
| *** heyongli has joined #openstack-infra | 02:40 | |
| *** heyongli has quit IRC | 02:43 | |
| *** heyongli has joined #openstack-infra | 02:44 | |
| *** SumitNaiksatam has quit IRC | 02:44 | |
| *** edmondsw has quit IRC | 02:44 | |
| *** jamesmcarthur has quit IRC | 02:44 | |
| *** chrisyang_0660 has joined #openstack-infra | 02:45 | |
| *** SumitNaiksatam has joined #openstack-infra | 02:50 | |
| *** heyongli has quit IRC | 02:54 | |
| *** heyongli has joined #openstack-infra | 02:54 | |
| *** rosmaita has quit IRC | 02:56 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Fix race in slow start test https://review.openstack.org/572584 | 03:00 |
| *** heyongli has quit IRC | 03:04 | |
| *** heyongli has joined #openstack-infra | 03:04 | |
| *** yamamoto has joined #openstack-infra | 03:08 | |
| *** rajinir has quit IRC | 03:11 | |
| *** yamamoto has quit IRC | 03:14 | |
| *** heyongli has quit IRC | 03:14 | |
| *** heyongli has joined #openstack-infra | 03:14 | |
| *** heyongli has quit IRC | 03:24 | |
| *** heyongli has joined #openstack-infra | 03:25 | |
| *** ramishra has quit IRC | 03:33 | |
| *** ramishra has joined #openstack-infra | 03:34 | |
| *** jesslampe has quit IRC | 03:34 | |
| *** heyongli has quit IRC | 03:35 | |
| *** heyongli has joined #openstack-infra | 03:35 | |
| *** VW has joined #openstack-infra | 03:36 | |
| *** VW has quit IRC | 03:41 | |
| *** VW has joined #openstack-infra | 03:42 | |
| *** r-daneel has joined #openstack-infra | 03:42 | |
| *** iyamahat has joined #openstack-infra | 03:43 | |
| *** udesale has joined #openstack-infra | 03:44 | |
| *** lpetrut has joined #openstack-infra | 03:44 | |
| *** iyamahat_ has joined #openstack-infra | 03:44 | |
| *** heyongli has quit IRC | 03:45 | |
| *** heyongli has joined #openstack-infra | 03:45 | |
| *** VW has quit IRC | 03:46 | |
| *** iyamahat has quit IRC | 03:47 | |
| *** yamahata has joined #openstack-infra | 03:48 | |
| *** bhavik1 has joined #openstack-infra | 03:51 | |
| *** heyongli has quit IRC | 03:55 | |
| *** heyongli has joined #openstack-infra | 03:55 | |
| *** germs has quit IRC | 04:00 | |
| *** germs has joined #openstack-infra | 04:00 | |
| *** germs has quit IRC | 04:00 | |
| *** germs has joined #openstack-infra | 04:00 | |
| *** aeng has joined #openstack-infra | 04:02 | |
| *** links has joined #openstack-infra | 04:02 | |
| *** masuberu has quit IRC | 04:04 | |
| *** germs has quit IRC | 04:04 | |
| *** heyongli has quit IRC | 04:05 | |
| *** heyongli has joined #openstack-infra | 04:06 | |
| *** boris_42_ has quit IRC | 04:06 | |
| *** rlandy|rover|bbl is now known as rlandy|rover | 04:10 | |
| *** yamamoto has joined #openstack-infra | 04:10 | |
| *** jbadiapa has quit IRC | 04:12 | |
| *** hongbin has quit IRC | 04:13 | |
| *** s-shiono has joined #openstack-infra | 04:14 | |
| *** Bhujay has joined #openstack-infra | 04:14 | |
| *** lpetrut has quit IRC | 04:15 | |
| *** yamamoto has quit IRC | 04:16 | |
| *** heyongli has quit IRC | 04:16 | |
| *** heyongli has joined #openstack-infra | 04:16 | |
| *** harlowja has joined #openstack-infra | 04:17 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Update puppet-grafana https://review.openstack.org/572667 | 04:23 |
| *** bhavik1 has quit IRC | 04:24 | |
| *** heyongli has quit IRC | 04:26 | |
| *** heyongli has joined #openstack-infra | 04:26 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Install later grafana on graphite02 https://review.openstack.org/572668 | 04:27 |
| *** edmondsw has joined #openstack-infra | 04:27 | |
| ianw | so grafana 5.1.3 works --> http://grafana02.openstack.org/d/T6vSHcSik/zuul-status?orgId=1 | 04:29 |
| *** edmondsw has quit IRC | 04:32 | |
| *** heyongli has quit IRC | 04:36 | |
| *** heyongli has joined #openstack-infra | 04:36 | |
| *** kjackal has quit IRC | 04:37 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/project-config master: Import new repos to openstack-ansible https://review.openstack.org/572551 | 04:40 |
| *** s-shiono_ has joined #openstack-infra | 04:44 | |
| *** harlowja has quit IRC | 04:45 | |
| *** heyongli has quit IRC | 04:46 | |
| *** s-shiono has quit IRC | 04:46 | |
| *** heyongli has joined #openstack-infra | 04:47 | |
| *** jesslampe has joined #openstack-infra | 04:48 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Update puppet-grafana https://review.openstack.org/572667 | 04:54 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Install later grafana on graphite02 https://review.openstack.org/572668 | 04:54 |
| *** cshastri has joined #openstack-infra | 04:55 | |
| *** udesale has quit IRC | 04:56 | |
| *** yamamoto has joined #openstack-infra | 04:56 | |
| *** heyongli has quit IRC | 04:57 | |
| *** heyongli has joined #openstack-infra | 04:57 | |
| *** udesale has joined #openstack-infra | 04:57 | |
| *** udesale has quit IRC | 04:57 | |
| *** armaan has quit IRC | 04:58 | |
| *** udesale has joined #openstack-infra | 04:58 | |
| *** armaan has joined #openstack-infra | 04:58 | |
| evrardjp | that would be cool if I could have eyes on https://review.openstack.org/#/c/572551/ before M2 I guess :) | 05:02 |
| *** heyongli has quit IRC | 05:07 | |
| *** heyongli has joined #openstack-infra | 05:07 | |
| *** pgadiya has joined #openstack-infra | 05:11 | |
| *** pgadiya has quit IRC | 05:11 | |
| *** nmathew has joined #openstack-infra | 05:14 | |
| *** heyongli has quit IRC | 05:17 | |
| *** lpetrut has joined #openstack-infra | 05:17 | |
| *** heyongli has joined #openstack-infra | 05:17 | |
| *** Bhujay has quit IRC | 05:21 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add a job variable to control javascript link copying https://review.openstack.org/572542 | 05:23 |
| *** lpetrut has quit IRC | 05:27 | |
| *** heyongli has quit IRC | 05:27 | |
| *** heyongli has joined #openstack-infra | 05:28 | |
| *** Bhujay has joined #openstack-infra | 05:28 | |
| *** e0ne has joined #openstack-infra | 05:32 | |
| *** links has quit IRC | 05:33 | |
| *** heyongli has quit IRC | 05:38 | |
| *** heyongli has joined #openstack-infra | 05:38 | |
| *** cshastri has quit IRC | 05:39 | |
| *** sshnaidm|brq has joined #openstack-infra | 05:42 | |
| *** psachin has quit IRC | 05:43 | |
| *** sshnaidm|brq has quit IRC | 05:47 | |
| *** heyongli has quit IRC | 05:48 | |
| *** heyongli has joined #openstack-infra | 05:48 | |
| AJaeger | evrardjp: have a cool day ;) | 05:48 |
| *** links has joined #openstack-infra | 05:49 | |
| *** nmathew- has joined #openstack-infra | 05:52 | |
| *** jaosorior has joined #openstack-infra | 05:52 | |
| *** e0ne has quit IRC | 05:54 | |
| *** nmathew has quit IRC | 05:56 | |
| *** e0ne has joined #openstack-infra | 05:56 | |
| *** Bhujay has quit IRC | 05:56 | |
| *** e0ne has quit IRC | 05:56 | |
| *** cshastri has joined #openstack-infra | 05:57 | |
| *** iranzo has joined #openstack-infra | 05:57 | |
| openstackgerrit | Merged openstack-infra/project-config master: Import new repos to openstack-ansible https://review.openstack.org/572551 | 05:58 |
| *** heyongli has quit IRC | 05:58 | |
| *** heyongli has joined #openstack-infra | 05:59 | |
| *** dklyle has quit IRC | 05:59 | |
| *** germs has joined #openstack-infra | 06:01 | |
| *** germs has quit IRC | 06:01 | |
| *** germs has joined #openstack-infra | 06:01 | |
| *** masber has joined #openstack-infra | 06:04 | |
| *** dpawlik has joined #openstack-infra | 06:05 | |
| AJaeger | evrardjp: please rebase https://review.openstack.org/#/c/572558 - and recheck once the repos are setup in our infrastructure | 06:05 |
| *** germs has quit IRC | 06:05 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Added release notes for Change 568697 https://review.openstack.org/570978 | 06:06 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/572677 | 06:07 |
| *** heyongli has quit IRC | 06:08 | |
| *** heyongli has joined #openstack-infra | 06:09 | |
| *** dpawlik has quit IRC | 06:09 | |
| *** dhajare has joined #openstack-infra | 06:11 | |
| *** dpawlik has joined #openstack-infra | 06:13 | |
| *** edmondsw has joined #openstack-infra | 06:15 | |
| *** heyongli has quit IRC | 06:19 | |
| *** heyongli has joined #openstack-infra | 06:19 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Use surrogateescape with outfilter.py https://review.openstack.org/570489 | 06:20 |
| openstackgerrit | Merged openstack/diskimage-builder master: Reduce path length in PS4 for debug https://review.openstack.org/570282 | 06:20 |
| *** edmondsw has quit IRC | 06:20 | |
| *** aeng has quit IRC | 06:21 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add new OSA project base jobs https://review.openstack.org/572558 | 06:22 |
| AJaeger | evrardjp: oh, I could rebase it myself... | 06:22 |
| *** cshastri has quit IRC | 06:24 | |
| *** cshastri has joined #openstack-infra | 06:25 | |
| *** heyongli has quit IRC | 06:29 | |
| *** heyongli has joined #openstack-infra | 06:29 | |
| *** andreas_s has joined #openstack-infra | 06:29 | |
| *** ccamacho has joined #openstack-infra | 06:29 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Save and close stdout on exit https://review.openstack.org/570094 | 06:30 |
| *** heyongli has quit IRC | 06:39 | |
| *** heyongli has joined #openstack-infra | 06:39 | |
| *** slaweq has joined #openstack-infra | 06:43 | |
| *** links has quit IRC | 06:44 | |
| *** pcaruana has joined #openstack-infra | 06:44 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix deprecation warning of ansible-2.5 https://review.openstack.org/571996 | 06:47 |
| *** jaosorior has quit IRC | 06:47 | |
| *** aojea has joined #openstack-infra | 06:48 | |
| *** nmathew has joined #openstack-infra | 06:48 | |
| *** heyongli has quit IRC | 06:49 | |
| *** heyongli has joined #openstack-infra | 06:50 | |
| *** ykarel|training has joined #openstack-infra | 06:50 | |
| *** nmathew- has quit IRC | 06:51 | |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/572677 | 06:52 |
| *** janki has joined #openstack-infra | 06:55 | |
| evrardjp | thanks AJaeger | 06:56 |
| evrardjp | and ianw :) | 06:57 |
| *** heyongli has quit IRC | 07:00 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/glean master: glean: cmd: Improve SUSE support and add new IDs for Leap 15 and Tumbleweed https://review.openstack.org/572424 | 07:00 |
| *** heyongli has joined #openstack-infra | 07:00 | |
| *** zoli|gone is now known as zoli | 07:01 | |
| *** lifeless has quit IRC | 07:02 | |
| *** lifeless has joined #openstack-infra | 07:02 | |
| *** links has joined #openstack-infra | 07:03 | |
| openstackgerrit | Merged openstack-infra/project-config master: Import openstackclient to Chef OpenStack https://review.openstack.org/571496 | 07:06 |
| *** rcernin has quit IRC | 07:07 | |
| *** jbadiapa has joined #openstack-infra | 07:09 | |
| hwoarang | ianw: hello. will debug glean today. could you pass me on the network metadata from the config drive if possible? thanks! | 07:09 |
| *** heyongli has quit IRC | 07:10 | |
| *** heyongli has joined #openstack-infra | 07:10 | |
| *** links has quit IRC | 07:12 | |
| *** armaan has quit IRC | 07:15 | |
| *** jbadiapa has quit IRC | 07:17 | |
| *** jbadiapa has joined #openstack-infra | 07:17 | |
| hwoarang | sorry just saw the pm | 07:18 |
| *** openstackgerrit has quit IRC | 07:19 | |
| *** diablo_rojo_ has joined #openstack-infra | 07:20 | |
| *** diablo_rojo_ has quit IRC | 07:20 | |
| *** heyongli has quit IRC | 07:20 | |
| *** heyongli has joined #openstack-infra | 07:20 | |
| *** sshnaidm|brq has joined #openstack-infra | 07:21 | |
| *** lifeless has quit IRC | 07:22 | |
| *** diablo_rojo has quit IRC | 07:26 | |
| *** masber has quit IRC | 07:27 | |
| *** diablo_rojo has joined #openstack-infra | 07:27 | |
| *** ralonsoh has joined #openstack-infra | 07:27 | |
| *** lifeless has joined #openstack-infra | 07:28 | |
| *** tosky has joined #openstack-infra | 07:28 | |
| *** alexchadin has joined #openstack-infra | 07:30 | |
| *** heyongli has quit IRC | 07:30 | |
| *** heyongli has joined #openstack-infra | 07:31 | |
| *** links has joined #openstack-infra | 07:33 | |
| *** armaan has joined #openstack-infra | 07:33 | |
| *** masber has joined #openstack-infra | 07:35 | |
| *** masuberu has joined #openstack-infra | 07:39 | |
| *** openstackgerrit has joined #openstack-infra | 07:39 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-askbot master: Add systemd support https://review.openstack.org/559601 | 07:39 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-askbot master: Don't require virtualenv package https://review.openstack.org/559622 | 07:39 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-askbot master: Ensure more correct ordering https://review.openstack.org/559623 | 07:39 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-askbot master: Pin stopforumspam https://review.openstack.org/572549 | 07:39 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-askbot master: Use earlier six release https://review.openstack.org/559624 | 07:39 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-askbot master: Add rspec test https://review.openstack.org/558991 | 07:39 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-askbot master: Add idempotentcy rspec test https://review.openstack.org/572553 | 07:39 |
| *** heyongli has quit IRC | 07:41 | |
| *** amoralej|off is now known as amoralej | 07:41 | |
| *** heyongli has joined #openstack-infra | 07:41 | |
| *** hashar has joined #openstack-infra | 07:41 | |
| *** masber has quit IRC | 07:43 | |
| zigo | Looks like http://zuul.openstack.org/stream.html is broken. | 07:44 |
| zigo | At least, it doesn't show logs for me. | 07:44 |
| zigo | Is it related to mnaser broken patch of yesterday? | 07:45 |
| *** jesslampe has quit IRC | 07:50 | |
| *** heyongli has quit IRC | 07:51 | |
| *** dhajare has quit IRC | 07:51 | |
| *** heyongli has joined #openstack-infra | 07:51 | |
| *** e0ne has joined #openstack-infra | 07:51 | |
| *** jpena|off is now known as jpena | 07:52 | |
| *** jpich has joined #openstack-infra | 07:55 | |
| *** dklyle has joined #openstack-infra | 07:57 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix encoding issue during processing output https://review.openstack.org/548958 | 07:58 |
| *** heyongli has quit IRC | 08:01 | |
| *** germs has joined #openstack-infra | 08:01 | |
| *** germs has quit IRC | 08:01 | |
| *** germs has joined #openstack-infra | 08:01 | |
| *** heyongli has joined #openstack-infra | 08:01 | |
| *** threestrands_ has quit IRC | 08:03 | |
| *** edmondsw has joined #openstack-infra | 08:03 | |
| *** shardy has joined #openstack-infra | 08:05 | |
| *** armaan has quit IRC | 08:06 | |
| *** germs has quit IRC | 08:06 | |
| *** edmondsw has quit IRC | 08:08 | |
| *** dklyle has quit IRC | 08:09 | |
| *** heyongli has quit IRC | 08:11 | |
| *** dklyle has joined #openstack-infra | 08:12 | |
| *** heyongli has joined #openstack-infra | 08:12 | |
| *** armaan has joined #openstack-infra | 08:13 | |
| *** armaan has quit IRC | 08:17 | |
| *** heyongli has quit IRC | 08:22 | |
| *** heyongli has joined #openstack-infra | 08:22 | |
| *** lxkong has quit IRC | 08:29 | |
| *** jesslampe has joined #openstack-infra | 08:29 | |
| *** dklyle has quit IRC | 08:29 | |
| *** s-shiono_ has quit IRC | 08:29 | |
| *** dklyle has joined #openstack-infra | 08:29 | |
| *** iyamahat_ has quit IRC | 08:29 | |
| *** dhajare has joined #openstack-infra | 08:29 | |
| *** heyongli has quit IRC | 08:32 | |
| *** zhangfei has joined #openstack-infra | 08:32 | |
| *** heyongli has joined #openstack-infra | 08:32 | |
| *** armaan has joined #openstack-infra | 08:32 | |
| *** e0ne has quit IRC | 08:34 | |
| *** e0ne has joined #openstack-infra | 08:35 | |
| *** derekh has joined #openstack-infra | 08:36 | |
| *** roman_g has joined #openstack-infra | 08:37 | |
| *** mpeterson_ is now known as mpeterson | 08:39 | |
| *** heyongli has quit IRC | 08:42 | |
| *** heyongli has joined #openstack-infra | 08:42 | |
| *** electrofelix has joined #openstack-infra | 08:49 | |
| *** e0ne_ has joined #openstack-infra | 08:50 | |
| *** e0ne has quit IRC | 08:51 | |
| *** heyongli has quit IRC | 08:52 | |
| *** heyongli has joined #openstack-infra | 08:53 | |
| *** alexchadin has quit IRC | 08:53 | |
| *** alexchadin has joined #openstack-infra | 08:54 | |
| *** e0ne has joined #openstack-infra | 09:00 | |
| *** e0ne_ has quit IRC | 09:00 | |
| *** heyongli has quit IRC | 09:03 | |
| *** gfidente has joined #openstack-infra | 09:03 | |
| *** heyongli has joined #openstack-infra | 09:03 | |
| *** lifeless has quit IRC | 09:05 | |
| *** diablo_rojo has quit IRC | 09:07 | |
| ianw | zigo: what's the build id? | 09:07 |
| zigo | ianw: http://zuul.openstack.org/stream.html?uuid=41ce30e65e6c4fd59397c2d1b12d3e0e&logfile=console.log | 09:08 |
| zigo | Though it looks like finished already. | 09:08 |
| *** andreas_s has quit IRC | 09:08 | |
| ianw | zigo: yeah, i've seen some work and some not clicking on it just now | 09:09 |
| ianw | oh, actually, it just seemed to take a while to get going | 09:10 |
| zigo | ianw: So long that it never prints for me... | 09:10 |
| zigo | It used not to be this way. | 09:11 |
| ianw | function zuul_finger { | 09:11 |
| ianw | url="$1" | 09:11 |
| ianw | finger $(echo "$1" | awk -F '[?=&]' '{print $3}')@zuul.openstack.org | 09:11 |
| ianw | } | 09:11 |
| ianw | in your bashrc might help :) | 09:11 |
| ianw | yeah, http://zuul.openstack.org/stream.html?uuid=eb36357473774714b00b7e88370a3670&logfile=console.log did load after a long pause once for me, but not now | 09:11 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/glean master: glean: Fix SUSE support for bridges and vlan configurations. https://review.openstack.org/572424 | 09:12 |
| zigo | I fail to understand how a .bashrc function will help stuff in my browser ... | 09:12 |
| ianw | i mean to get the logs streaming over finger, i usually just zuul_finger 'paste-url-from-status-page' | 09:13 |
| *** diablo_rojo has joined #openstack-infra | 09:13 | |
| *** heyongli has quit IRC | 09:13 | |
| ianw | but yeah, i think there's something up; clarkb is probably the person who is context switched into it the most atm | 09:13 |
| *** heyongli has joined #openstack-infra | 09:14 | |
| zigo | Oh ok ! :) | 09:14 |
| zigo | Cheers mate. | 09:14 |
| *** lpetrut has joined #openstack-infra | 09:16 | |
| *** andreas_s has joined #openstack-infra | 09:17 | |
| *** heyongli has quit IRC | 09:23 | |
| *** heyongli has joined #openstack-infra | 09:23 | |
| *** andreas_s has quit IRC | 09:24 | |
| *** andreas_s has joined #openstack-infra | 09:24 | |
| *** heyongli has quit IRC | 09:33 | |
| *** zoli is now known as zoli|lunch | 09:33 | |
| *** heyongli has joined #openstack-infra | 09:34 | |
| *** jesslampe has quit IRC | 09:36 | |
| *** armaan has quit IRC | 09:37 | |
| *** armaan has joined #openstack-infra | 09:37 | |
| *** links has quit IRC | 09:39 | |
| *** alexchad_ has joined #openstack-infra | 09:41 | |
| *** pbourke has quit IRC | 09:41 | |
| *** pbourke has joined #openstack-infra | 09:42 | |
| *** lifeless has joined #openstack-infra | 09:42 | |
| *** armaan has quit IRC | 09:43 | |
| *** alexchadin has quit IRC | 09:43 | |
| *** armaan has joined #openstack-infra | 09:43 | |
| *** heyongli has quit IRC | 09:44 | |
| *** heyongli has joined #openstack-infra | 09:44 | |
| *** hashar is now known as hasharAway | 09:50 | |
| *** edmondsw has joined #openstack-infra | 09:52 | |
| *** armaan has quit IRC | 09:52 | |
| *** armaan has joined #openstack-infra | 09:52 | |
| *** andreas_s has quit IRC | 09:53 | |
| *** andreas_s has joined #openstack-infra | 09:54 | |
| *** heyongli has quit IRC | 09:54 | |
| *** heyongli has joined #openstack-infra | 09:54 | |
| *** alexchad_ has quit IRC | 09:56 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Add a loading_errors info to {tenant}/info endpoint https://review.openstack.org/553873 | 09:56 |
| *** edmondsw has quit IRC | 09:56 | |
| *** links has joined #openstack-infra | 09:57 | |
| *** andreas_s has quit IRC | 10:01 | |
| *** andreas_s has joined #openstack-infra | 10:01 | |
| *** germs has joined #openstack-infra | 10:02 | |
| *** germs has quit IRC | 10:02 | |
| *** germs has joined #openstack-infra | 10:02 | |
| *** heyongli has quit IRC | 10:04 | |
| *** heyongli has joined #openstack-infra | 10:04 | |
| *** armaan has quit IRC | 10:07 | |
| *** armaan has joined #openstack-infra | 10:07 | |
| *** germs has quit IRC | 10:07 | |
| *** jaosorior has joined #openstack-infra | 10:08 | |
| hwoarang | clarkb: ianw i am starting to thing that the nodepool jobs are not testing the correct glean sha | 10:11 |
| hwoarang | http://logs.openstack.org/16/572416/5/experimental/nodepool-functional-py35-suse-src/1a4cad9/controller/logs/builds/opensuse-150-0000000001_log.txt.gz#_2018-06-06_07_37_50_105 | 10:11 |
| hwoarang | '55b01bc Merge "Add networkd support" ' is not the HEAD of the dependant patch. so dib images are being built with the wrong glean :/ | 10:12 |
| hwoarang | ohhh I had 'Depends' instead of 'Depends-On' | 10:12 |
| hwoarang | :( | 10:12 |
| hwoarang | pfff | 10:13 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/nodepool master: Add opensuse-150 to nodepool dsvm https://review.openstack.org/572416 | 10:13 |
| * ianw sighs in relief that all our assumptions aren't broken (touch wood :) | 10:13 | |
| *** heyongli has quit IRC | 10:14 | |
| *** heyongli has joined #openstack-infra | 10:15 | |
| *** links has quit IRC | 10:16 | |
| *** namnh has quit IRC | 10:16 | |
| *** rh-jelabarre has joined #openstack-infra | 10:20 | |
| *** annp has quit IRC | 10:21 | |
| *** e0ne_ has joined #openstack-infra | 10:22 | |
| *** e0ne has quit IRC | 10:24 | |
| *** heyongli has quit IRC | 10:25 | |
| *** heyongli has joined #openstack-infra | 10:25 | |
| *** lifeless has quit IRC | 10:26 | |
| *** lifeless has joined #openstack-infra | 10:27 | |
| *** andreas_s has quit IRC | 10:28 | |
| *** andreas_s has joined #openstack-infra | 10:28 | |
| *** links has joined #openstack-infra | 10:29 | |
| *** heyongli has quit IRC | 10:35 | |
| *** heyongli has joined #openstack-infra | 10:35 | |
| *** jamesdenton has quit IRC | 10:35 | |
| *** andreas_s has quit IRC | 10:37 | |
| *** lxkong has joined #openstack-infra | 10:45 | |
| *** priteau has joined #openstack-infra | 10:45 | |
| *** heyongli has quit IRC | 10:45 | |
| *** heyongli has joined #openstack-infra | 10:45 | |
| *** andreas_s has joined #openstack-infra | 10:46 | |
| openstackgerrit | Elod Illes proposed openstack-infra/project-config master: WIP: Add networking-odl for bgpvpn stable jobs https://review.openstack.org/572495 | 10:52 |
| *** zoli|lunch is now known as zoli | 10:54 | |
| *** dtantsur|afk is now known as dtantsur | 10:54 | |
| *** heyongli has quit IRC | 10:55 | |
| *** heyongli has joined #openstack-infra | 10:56 | |
| *** lifeless_ has joined #openstack-infra | 10:57 | |
| *** lifeless has quit IRC | 10:57 | |
| *** andreas_s has quit IRC | 10:59 | |
| *** yolanda_ has quit IRC | 11:00 | |
| *** yolanda_ has joined #openstack-infra | 11:00 | |
| *** njohnston has joined #openstack-infra | 11:01 | |
| *** dklyle has quit IRC | 11:02 | |
| *** heyongli has quit IRC | 11:06 | |
| *** jpena is now known as jpena|lunch | 11:06 | |
| *** heyongli has joined #openstack-infra | 11:06 | |
| *** andreas_s has joined #openstack-infra | 11:08 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Add a loading_errors info to {tenant}/info endpoint https://review.openstack.org/553873 | 11:11 |
| *** edmondsw has joined #openstack-infra | 11:12 | |
| *** dpawlik has quit IRC | 11:15 | |
| *** heyongli has quit IRC | 11:16 | |
| *** heyongli has joined #openstack-infra | 11:16 | |
| *** edmondsw has quit IRC | 11:16 | |
| *** edmondsw has joined #openstack-infra | 11:20 | |
| *** heyongli has quit IRC | 11:26 | |
| *** heyongli has joined #openstack-infra | 11:26 | |
| *** armaan has quit IRC | 11:27 | |
| *** jesslampe has joined #openstack-infra | 11:28 | |
| *** armaan has joined #openstack-infra | 11:28 | |
| *** ldnunes has joined #openstack-infra | 11:29 | |
| hwoarang | ianw: clarkb suse boots fine with the latest glean changes please get them in when you have the time. and we also need a new glean release i suppose :) Thank you very much for the help and the tips during this leap 15 journey | 11:30 |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config master: Add magnum to storyboard https://review.openstack.org/572440 | 11:30 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/glean master: glean: Fix SUSE support for bridges and vlan configurations. https://review.openstack.org/572424 | 11:31 |
| *** dtantsur is now known as dtantsur|brb | 11:31 | |
| *** felipemonteiro has joined #openstack-infra | 11:31 | |
| *** dklyle has joined #openstack-infra | 11:36 | |
| *** heyongli has quit IRC | 11:36 | |
| *** heyongli has joined #openstack-infra | 11:37 | |
| *** zhangfei has quit IRC | 11:40 | |
| *** amoralej is now known as amoralej|lunch | 11:41 | |
| *** dpawlik has joined #openstack-infra | 11:43 | |
| *** dpawlik has quit IRC | 11:44 | |
| *** jamesdenton has joined #openstack-infra | 11:46 | |
| *** heyongli has quit IRC | 11:47 | |
| *** heyongli has joined #openstack-infra | 11:47 | |
| *** felipemonteiro has quit IRC | 11:48 | |
| *** felipemonteiro has joined #openstack-infra | 11:49 | |
| *** dpawlik has joined #openstack-infra | 11:49 | |
| *** heyongli has quit IRC | 11:57 | |
| *** heyongli has joined #openstack-infra | 11:57 | |
| *** rosmaita has joined #openstack-infra | 11:58 | |
| mnaser | zigo: yes I broke it :( but if you open in a new tab it should be okay. | 12:02 |
| zigo | mnaser: Well, with some chance, after maybe 15 minutes, then it displays ... :P | 12:02 |
| *** germs has joined #openstack-infra | 12:03 | |
| *** germs has quit IRC | 12:03 | |
| *** germs has joined #openstack-infra | 12:03 | |
| *** felipemonteiro has quit IRC | 12:04 | |
| *** felipemonteiro has joined #openstack-infra | 12:04 | |
| *** rfolco_ is now known as rfolco | 12:04 | |
| *** hemna_ has joined #openstack-infra | 12:05 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: I18n: convert weekly meeting to office hours https://review.openstack.org/572517 | 12:07 |
| *** heyongli has quit IRC | 12:07 | |
| *** heyongli has joined #openstack-infra | 12:07 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: Add OpenShift templates https://review.openstack.org/572746 | 12:08 |
| *** germs has quit IRC | 12:08 | |
| *** jpena|lunch is now known as jpena | 12:10 | |
| *** pcichy has joined #openstack-infra | 12:11 | |
| *** dbecker has joined #openstack-infra | 12:12 | |
| *** heyongli has quit IRC | 12:17 | |
| *** heyongli has joined #openstack-infra | 12:18 | |
| *** trown|outtypewww is now known as trown | 12:20 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Remove direct tagging/branching for QA repos https://review.openstack.org/572750 | 12:20 |
| *** r-daneel has quit IRC | 12:22 | |
| AJaeger | config-core, could you review https://review.openstack.org/#/c/571926/ , https://review.openstack.org/572065 , https://review.openstack.org/572505 , https://review.openstack.org/563326 , https://review.openstack.org/569605 , https://review.openstack.org/572017 , https://review.openstack.org/572276 , please? | 12:27 |
| AJaeger | cmurphy: want to rebase https://review.openstack.org/#/c/571937/ ? Your stack has some merge conflicts... | 12:28 |
| *** heyongli has quit IRC | 12:28 | |
| *** heyongli has joined #openstack-infra | 12:28 | |
| *** armaan has quit IRC | 12:28 | |
| *** armaan has joined #openstack-infra | 12:28 | |
| cmurphy | AJaeger: yes...let me do some surgery | 12:29 |
| *** tpsilva has joined #openstack-infra | 12:30 | |
| *** hasharAway is now known as hashar | 12:32 | |
| *** r-daneel has joined #openstack-infra | 12:32 | |
| *** links has quit IRC | 12:33 | |
| *** eharney has joined #openstack-infra | 12:34 | |
| *** felipemonteiro_ has joined #openstack-infra | 12:35 | |
| *** heyongli has quit IRC | 12:38 | |
| *** felipemonteiro has quit IRC | 12:38 | |
| *** heyongli has joined #openstack-infra | 12:38 | |
| *** shardy has quit IRC | 12:39 | |
| *** andreas_s has quit IRC | 12:41 | |
| *** andreas_s has joined #openstack-infra | 12:41 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Remove unused puppet beaker job templates https://review.openstack.org/571925 | 12:42 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Convert infra's beaker jobs for zuulv3 https://review.openstack.org/571929 | 12:42 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Convert puppet-openstackci jobs to zuulv3 https://review.openstack.org/571937 | 12:42 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Make openstackci-beaker xenial jobs voting https://review.openstack.org/571965 | 12:42 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Add experimental puppet 4 beaker-rspec jobs https://review.openstack.org/571966 | 12:42 |
| cmurphy | AJaeger: ^ | 12:42 |
| *** shardy has joined #openstack-infra | 12:43 | |
| *** amoralej|lunch is now known as amoralej | 12:44 | |
| *** armaan has quit IRC | 12:45 | |
| *** kjackal has joined #openstack-infra | 12:45 | |
| *** armaan has joined #openstack-infra | 12:45 | |
| *** heyongli has quit IRC | 12:48 | |
| *** heyongli has joined #openstack-infra | 12:48 | |
| *** neiloy has joined #openstack-infra | 12:50 | |
| *** kgiusti has joined #openstack-infra | 12:53 | |
| *** mriedem_away is now known as mriedem | 12:53 | |
| AJaeger | cmurphy: let's get them in - with help of config-core ;) | 12:56 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove jobs from beaker-* projects https://review.openstack.org/571926 | 12:56 |
| *** hongbin has joined #openstack-infra | 12:57 | |
| AJaeger | frickler: thanks for your reviews - could you push https://review.openstack.org/#/c/571925 on your list as well, please? | 12:58 |
| *** efried has quit IRC | 12:58 | |
| *** heyongli has quit IRC | 12:58 | |
| *** heyongli has joined #openstack-infra | 12:59 | |
| frickler | AJaeger: yes, I saw that, but not sure I'll get to it today, just squeezing some of these in while running unit tests ;) | 13:01 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Make openstackci-beaker xenial jobs voting https://review.openstack.org/571965 | 13:02 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Add experimental puppet 4 beaker-rspec jobs https://review.openstack.org/571966 | 13:02 |
| openstackgerrit | Merged openstack-infra/project-config master: Add kata-containers/proxy to zuul https://review.openstack.org/572451 | 13:03 |
| openstackgerrit | Merged openstack-infra/project-config master: Sort zuul/main.yaml https://review.openstack.org/572505 | 13:03 |
| *** jcoufal has joined #openstack-infra | 13:04 | |
| openstackgerrit | Merged openstack-infra/system-config master: Creates StarlingX mailing lists https://review.openstack.org/569545 | 13:04 |
| *** felipemonteiro_ has quit IRC | 13:06 | |
| *** felipemonteiro_ has joined #openstack-infra | 13:07 | |
| *** heyongli has quit IRC | 13:09 | |
| *** Bhujay has joined #openstack-infra | 13:09 | |
| *** heyongli has joined #openstack-infra | 13:09 | |
| *** jesslampe has quit IRC | 13:11 | |
| *** felipemonteiro_ has quit IRC | 13:11 | |
| *** camunoz has joined #openstack-infra | 13:15 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add openstack-dns repo jobs https://review.openstack.org/563326 | 13:15 |
| *** lifeless_ has quit IRC | 13:16 | |
| *** kjackal has quit IRC | 13:17 | |
| *** heyongli has quit IRC | 13:19 | |
| *** heyongli has joined #openstack-infra | 13:19 | |
| *** jaosorior has quit IRC | 13:20 | |
| *** myoung_ is now known as myoung | 13:21 | |
| *** jesslampe has joined #openstack-infra | 13:24 | |
| *** heyongli has quit IRC | 13:29 | |
| *** heyongli has joined #openstack-infra | 13:29 | |
| *** bhupesh has joined #openstack-infra | 13:29 | |
| *** bhupesh has quit IRC | 13:30 | |
| *** nicolasbock has joined #openstack-infra | 13:30 | |
| *** dpawlik has quit IRC | 13:32 | |
| *** udesale has quit IRC | 13:32 | |
| *** kambiz has quit IRC | 13:33 | |
| *** kambiz has joined #openstack-infra | 13:33 | |
| *** caphrim007 has joined #openstack-infra | 13:38 | |
| *** Roamer` has quit IRC | 13:39 | |
| *** Roamer` has joined #openstack-infra | 13:39 | |
| *** heyongli has quit IRC | 13:39 | |
| *** heyongli has joined #openstack-infra | 13:40 | |
| fungi | #status log added lists.starlingx.io cname to lists.openstack.org and started the mailman-starlingx service on the server now that https://review.openstack.org/569545 has been applied | 13:43 |
| openstackstatus | fungi: finished logging | 13:43 |
| mtreinish | fungi: did we ever switch the logrotate config over for mosquitto on firehose.o.o? | 13:45 |
| fungi | i don't recall. has it died again? | 13:46 |
| *** nmathew has quit IRC | 13:46 | |
| mtreinish | no, I just was thinking about it | 13:46 |
| *** heyongli has quit IRC | 13:50 | |
| *** heyongli has joined #openstack-infra | 13:50 | |
| *** david-lyle has joined #openstack-infra | 13:56 | |
| *** caphrim007_ has joined #openstack-infra | 13:57 | |
| *** dklyle has quit IRC | 13:58 | |
| *** zhipeng has joined #openstack-infra | 13:58 | |
| *** dtantsur|brb is now known as dtantsur | 13:58 | |
| *** dave-mccowan has joined #openstack-infra | 13:59 | |
| *** caphrim007 has quit IRC | 14:00 | |
| *** heyongli has quit IRC | 14:00 | |
| rlandy|rover | clarkb: thanks for your work on the logging issue - much appreciated | 14:00 |
| *** heyongli has joined #openstack-infra | 14:00 | |
| *** dpawlik has joined #openstack-infra | 14:07 | |
| *** dave-mcc_ has joined #openstack-infra | 14:08 | |
| *** dave-mccowan has quit IRC | 14:08 | |
| *** efried has joined #openstack-infra | 14:09 | |
| *** felipemonteiro has joined #openstack-infra | 14:09 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Create a base Driver class https://review.openstack.org/571585 | 14:09 |
| *** hashar is now known as hasharAway | 14:09 | |
| *** heyongli has quit IRC | 14:10 | |
| *** heyongli has joined #openstack-infra | 14:10 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:11 | |
| *** dpawlik has quit IRC | 14:12 | |
| openstackgerrit | Tin Lam proposed openstack-infra/project-config master: Add tox coverage job https://review.openstack.org/572785 | 14:13 |
| *** kiennt26 has joined #openstack-infra | 14:14 | |
| *** kien-ha has joined #openstack-infra | 14:14 | |
| *** esberglu has joined #openstack-infra | 14:14 | |
| *** pkovar1 has joined #openstack-infra | 14:15 | |
| *** felipemonteiro has quit IRC | 14:15 | |
| *** pkovar1 has quit IRC | 14:20 | |
| *** heyongli has quit IRC | 14:20 | |
| *** heyongli has joined #openstack-infra | 14:21 | |
| *** felipemonteiro_ has quit IRC | 14:22 | |
| *** kiennt26 has quit IRC | 14:23 | |
| *** felipemonteiro has joined #openstack-infra | 14:23 | |
| *** pkovar has joined #openstack-infra | 14:24 | |
| pkovar | hi infra team | 14:26 |
| pkovar | may i request removing all of outdated files in https://docs.openstack.org/project-install-guide/baremetal/ from the disk? | 14:26 |
| pkovar | apologies, just https://docs.openstack.org/project-install-guide/baremetal/draft/ NOT all of https://docs.openstack.org/project-install-guide/baremetal/ | 14:27 |
| pkovar | or should i file a bug? | 14:27 |
| *** cshastri has quit IRC | 14:29 | |
| *** armaan has quit IRC | 14:30 | |
| *** heyongli has quit IRC | 14:31 | |
| *** heyongli has joined #openstack-infra | 14:31 | |
| *** sambetts|afk is now known as sambetts | 14:31 | |
| *** armaan has joined #openstack-infra | 14:32 | |
| fungi | AJaeger: ^ do the install guide jobs not clear those out automatically? | 14:32 |
| AJaeger | fungi: those publish to ... baremetal/queens etc - but not to /draft anymore | 14:32 |
| AJaeger | fungi: so, this is an exception | 14:33 |
| pkovar | we got a redirect set up for /draft recently so we can safely remove the files now | 14:33 |
| fungi | got it. any objection to me manually removing the draft directory in that case? | 14:33 |
| fungi | sounds safe enough | 14:33 |
| AJaeger | go ahead, fungi! Thanks! | 14:34 |
| pkovar | thanks, fungi | 14:34 |
| openstackgerrit | Tin Lam proposed openstack-infra/project-config master: Add tox coverage job https://review.openstack.org/572785 | 14:34 |
| *** felipemonteiro has quit IRC | 14:37 | |
| *** felipemonteiro has joined #openstack-infra | 14:37 | |
| *** kjackal has joined #openstack-infra | 14:38 | |
| *** rpioso|afk is now known as rpioso | 14:40 | |
| *** heyongli has quit IRC | 14:41 | |
| *** heyongli has joined #openstack-infra | 14:41 | |
| openstackgerrit | Dean Troyer proposed openstack-infra/system-config master: Add git.starlingx.io https://review.openstack.org/572793 | 14:42 |
| *** kjackal has quit IRC | 14:43 | |
| *** iranzo has quit IRC | 14:44 | |
| *** r-daneel has quit IRC | 14:46 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Summit Selection Plans Model Update https://review.openstack.org/572796 | 14:47 |
| *** shardy has quit IRC | 14:47 | |
| *** shardy has joined #openstack-infra | 14:47 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Summit Selection Plans Model Update https://review.openstack.org/572796 | 14:47 |
| smcginnis | Are there known issues with loading something like http://zuul.openstack.org/builds.html?job_name=cinder-tempest-dsvm-lvm-lio-barbican in chrome/chromium? | 14:49 |
| smcginnis | Never loads for me in chromium but comes up right away in Firefox. | 14:49 |
| *** sthussey has joined #openstack-infra | 14:49 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:50 | |
| fungi | infra-root: i'm spacing on how to remove files from the docs tree in afs... i used to do it from a zuul executor but now not finding the relevant keytab. trying to follow our instructions in system-config i see that i've neglected to remember my kerberos password and don't see a good example in our docs for resetting that either (do i delete my user principal and add a new one?) | 14:50 |
| *** heyongli has quit IRC | 14:51 | |
| *** kjackal has joined #openstack-infra | 14:51 | |
| *** heyongli has joined #openstack-infra | 14:51 | |
| fungi | i'm guessing that there's no static keytab on the executor filesystems any longer because we're using zuul secrets to store those instead (and that was a cheat anyway, i'll readily admit) | 14:52 |
| AJaeger | smcginnis: works for me in chromium and firefox | 14:52 |
| *** Bhujay has quit IRC | 14:53 | |
| fungi | smcginnis: there were some recent interface updates which could be at odds with cached javascript in your browser. tried to force a page refresh? | 14:53 |
| smcginnis | Hmm. I left it waiting, but still never loaded. Oh well, guess now I know for me I should just use Firefox. | 14:53 |
| *** felipemonteiro has quit IRC | 14:53 | |
| smcginnis | fungi: Good idea, let me try that. | 14:54 |
| smcginnis | Winner winner | 14:54 |
| smcginnis | Thanks fungi, that did the trick. | 14:54 |
| AJaeger | \o/ | 14:54 |
| fungi | awesome | 14:54 |
| clarkb | fungi: I've always used my admin principal and havent lost that passwd yet. I think you may be able to do a localauth type thing on the fileservers like we do for large initial vos releases | 14:55 |
| *** eernst has joined #openstack-infra | 14:55 | |
| clarkb | smcginnis: fungi I had to hard refresh the bas estatus page to get the links to work after we fixed them | 14:56 |
| fungi | yeah, i was trying to work out how to do that too, but afs isn't mounted on afs01.dfw | 14:56 |
| *** dave-mcc_ has quit IRC | 14:56 | |
| smcginnis | I seem to recall needing to hard refresh after past updates, but forgot to try that in this case. | 14:56 |
| fungi | given we get semi-frequent requests to manually delete things from docs, i'll add an example process to our afs operational documentation once i work out what it should be | 14:57 |
| fungi | as for resetting my principal password, i'm guessing i can do that via kadmin.local on one of our kdcs, just need to work out the right command (there's kpasswd, which i'm reading up on next) | 14:59 |
| fungi | somethnig like `kpasswd -principal fungi@OPENSTACK.ORG` | 15:00 |
| *** dbecker has quit IRC | 15:01 | |
| *** dbecker has joined #openstack-infra | 15:01 | |
| *** heyongli has quit IRC | 15:01 | |
| *** heyongli has joined #openstack-infra | 15:02 | |
| openstackgerrit | Tin Lam proposed openstack-infra/project-config master: Add tox coverage job https://review.openstack.org/572785 | 15:05 |
| *** dave-mccowan has joined #openstack-infra | 15:07 | |
| openstackgerrit | Dean Troyer proposed openstack-infra/project-config master: Set up cgit aliases for StarlingX https://review.openstack.org/572801 | 15:07 |
| *** pahuang has quit IRC | 15:08 | |
| clarkb | fungi: remember it is the admin principal for deletion | 15:08 |
| clarkb | I always forget that... | 15:08 |
| fungi | yeah, kpasswd isn't a subcommand in the kadmin.local shell, there is no kpasswd.local and regular kpasswd wants to know my previous password first | 15:09 |
| fungi | yay! change_password or cpw _is_ a command in the kadmin shell | 15:10 |
| fungi | that seems to have done the trick | 15:10 |
| *** heyongli has quit IRC | 15:12 | |
| *** heyongli has joined #openstack-infra | 15:12 | |
| *** lxkong has quit IRC | 15:12 | |
| *** kiennt26 has joined #openstack-infra | 15:14 | |
| *** jesslampe has quit IRC | 15:17 | |
| *** jesslampe has joined #openstack-infra | 15:17 | |
| *** jesslampe has quit IRC | 15:17 | |
| *** pahuang has joined #openstack-infra | 15:18 | |
| *** jesslampe has joined #openstack-infra | 15:18 | |
| *** jesslampe has quit IRC | 15:18 | |
| *** jesslampe has joined #openstack-infra | 15:18 | |
| *** pblaho has quit IRC | 15:20 | |
| *** heyongli has quit IRC | 15:22 | |
| *** janki has quit IRC | 15:22 | |
| *** heyongli has joined #openstack-infra | 15:22 | |
| *** pcaruana has quit IRC | 15:23 | |
| *** r-daneel has joined #openstack-infra | 15:27 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v6) https://review.openstack.org/551989 | 15:29 |
| *** rajinir has joined #openstack-infra | 15:29 | |
| *** heyongli has quit IRC | 15:32 | |
| *** heyongli has joined #openstack-infra | 15:32 | |
| *** jbadiapa has quit IRC | 15:33 | |
| *** zhipeng has quit IRC | 15:34 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Translate zuulStartStream into typescript https://review.openstack.org/558618 | 15:35 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Shift log streaming code into StreamComponent https://review.openstack.org/558619 | 15:35 |
| *** sshnaidm|brq has quit IRC | 15:37 | |
| *** germs has joined #openstack-infra | 15:37 | |
| *** germs has quit IRC | 15:37 | |
| *** germs has joined #openstack-infra | 15:37 | |
| *** germs has quit IRC | 15:37 | |
| *** germs has joined #openstack-infra | 15:38 | |
| *** germs has quit IRC | 15:38 | |
| *** germs has joined #openstack-infra | 15:38 | |
| *** kiennt26 has quit IRC | 15:38 | |
| *** felipemonteiro_ has quit IRC | 15:38 | |
| *** ramishra has quit IRC | 15:39 | |
| *** ykarel|training has quit IRC | 15:39 | |
| *** eernst has quit IRC | 15:41 | |
| *** eernst has joined #openstack-infra | 15:42 | |
| *** heyongli has quit IRC | 15:42 | |
| *** heyongli has joined #openstack-infra | 15:43 | |
| *** jpich has quit IRC | 15:44 | |
| fungi | okay, still trying to figure out how to use my fungi.admin principal from my workstation... i can `kinit` normally with my non-admin principal, but `kinit fungi.admin` results in the following error: | 15:48 |
| fungi | kinit: Client 'fungi.admin@OPENSTACK.ORG' not found in Kerberos database while getting initial credentials | 15:48 |
| *** andreas_s has quit IRC | 15:48 | |
| clarkb | fungi/admin maybe? or ADMIN ? | 15:48 |
| fungi | yep, just realized that | 15:48 |
| *** janki has joined #openstack-infra | 15:49 | |
| fungi | bos and pts list the account as fungi.admin but kerberos expects fungi/admin | 15:49 |
| clarkb | afs doesn't use / because it is the fs delimiter iirc | 15:49 |
| fungi | finally! | 15:51 |
| fungi | #status log deleted /afs/.openstack.org/docs/project-install-guide/baremetal/draft at the request of pkovar | 15:52 |
| openstackstatus | fungi: finished logging | 15:52 |
| AJaeger | thanks, fungi ! | 15:52 |
| *** heyongli has quit IRC | 15:53 | |
| pkovar | ta | 15:53 |
| *** heyongli has joined #openstack-infra | 15:53 | |
| *** roman_g has quit IRC | 15:53 | |
| fungi | okay, got the kerberos user and admin principal password reset doc addition written, now working on the afs file deletion section | 15:54 |
| *** roman_g has joined #openstack-infra | 15:55 | |
| pkovar | looks like i triggered much more than what i originally intended :) | 15:57 |
| auristor | afs doesn´t use user/admin because all of its naming is Kerberos v4 not Kerberos v5 | 15:57 |
| clarkb | ah | 15:58 |
| fungi | auristor: makes sense. i realized that we have a note that we've remapped user.admin manually to user/admin kerberos principals | 15:58 |
| auristor | Kerberos v5 principal names must be converted to Kerberos v4 names before they can be looked up in the PT service or in the UserList | 15:58 |
| clarkb | this reminds me tumbleweed has openafs pacakges now that I should get working | 15:58 |
| openstackgerrit | Michael Johnson proposed openstack-infra/zuul-jobs master: Collect the coverage report for npm test jobs https://review.openstack.org/570260 | 16:00 |
| *** hasharAway is now known as hashar | 16:01 | |
| *** lpetrut has quit IRC | 16:03 | |
| *** shardy has quit IRC | 16:03 | |
| *** heyongli has quit IRC | 16:03 | |
| *** heyongli has joined #openstack-infra | 16:03 | |
| *** shardy has joined #openstack-infra | 16:04 | |
| *** dbecker has quit IRC | 16:08 | |
| *** trown is now known as trown|lunch | 16:09 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Document Kerberos password reset process https://review.openstack.org/572820 | 16:09 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Document an example for deleting content from AFS https://review.openstack.org/572821 | 16:09 |
| *** hongbin has quit IRC | 16:10 | |
| *** roman_g has quit IRC | 16:12 | |
| *** zoli is now known as zoli|gone | 16:12 | |
| *** zoli|gone is now known as zoli | 16:12 | |
| *** heyongli has quit IRC | 16:13 | |
| *** heyongli has joined #openstack-infra | 16:13 | |
| clarkb | fungi: comment on 572821 | 16:14 |
| *** yamamoto has quit IRC | 16:14 | |
| *** yamamoto has joined #openstack-infra | 16:14 | |
| fungi | thanks! | 16:15 |
| *** yamamoto has quit IRC | 16:17 | |
| *** yamamoto has joined #openstack-infra | 16:19 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Document an example for deleting content from AFS https://review.openstack.org/572821 | 16:20 |
| fungi | clarkb: ^ | 16:20 |
| *** Kevin_Zheng has quit IRC | 16:22 | |
| *** heyongli has quit IRC | 16:23 | |
| *** heyongli has joined #openstack-infra | 16:24 | |
| *** VW has joined #openstack-infra | 16:25 | |
| *** kjackal has quit IRC | 16:28 | |
| *** heyongli has quit IRC | 16:34 | |
| *** heyongli has joined #openstack-infra | 16:34 | |
| *** apetrich has quit IRC | 16:34 | |
| *** pkovar has quit IRC | 16:35 | |
| *** apetrich has joined #openstack-infra | 16:35 | |
| openstackgerrit | Artem Goncharov proposed openstack-infra/nodepool master: retire shade in favor of openstacksdk https://review.openstack.org/572829 | 16:37 |
| *** armaan has quit IRC | 16:38 | |
| *** armaan has joined #openstack-infra | 16:38 | |
| *** roman_g has joined #openstack-infra | 16:39 | |
| *** armaan has quit IRC | 16:43 | |
| *** SumitNaiksatam has quit IRC | 16:43 | |
| *** heyongli has quit IRC | 16:44 | |
| *** heyongli has joined #openstack-infra | 16:44 | |
| *** myoung is now known as myoung|lunch | 16:50 | |
| auristor | fungi: I left some feedback on your AFS example | 16:51 |
| fungi | thanks! | 16:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v6) https://review.openstack.org/551989 | 16:52 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix adding qcow2 format without need https://review.openstack.org/572836 | 16:53 |
| *** eernst has quit IRC | 16:54 | |
| *** heyongli has quit IRC | 16:54 | |
| *** heyongli has joined #openstack-infra | 16:54 | |
| fungi | heading out to grab some lunch and run errands, back around 19:00z | 16:57 |
| *** david-lyle has quit IRC | 16:59 | |
| *** e0ne_ has quit IRC | 17:01 | |
| *** iyamahat has joined #openstack-infra | 17:01 | |
| *** trown|lunch is now known as trown | 17:03 | |
| *** heyongli has quit IRC | 17:04 | |
| *** heyongli has joined #openstack-infra | 17:05 | |
| *** derekh has quit IRC | 17:06 | |
| *** janki has quit IRC | 17:09 | |
| *** yamamoto has quit IRC | 17:10 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fix race in slow start test https://review.openstack.org/572842 | 17:12 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Make test_slow_start more robust https://review.openstack.org/572843 | 17:12 |
| *** shardy has quit IRC | 17:13 | |
| *** yamamoto has joined #openstack-infra | 17:13 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:13 | |
| *** lpetrut has joined #openstack-infra | 17:14 | |
| *** heyongli has quit IRC | 17:15 | |
| *** heyongli has joined #openstack-infra | 17:15 | |
| dtantsur | folks, I don't know if something is wrong with zuul or I am crazy.. but it looks like for 'command' stderr gets squashed in stdout | 17:17 |
| dtantsur | like, see the task before the failed one in http://logs.openstack.org/25/572825/1/check/metalsmith-integration-glance/09a1447/ara-report/ | 17:18 |
| *** yamamoto has quit IRC | 17:18 | |
| *** dbecker has joined #openstack-infra | 17:19 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v6) https://review.openstack.org/551989 | 17:22 |
| *** ralonsoh has joined #openstack-infra | 17:23 | |
| *** heyongli has quit IRC | 17:25 | |
| *** heyongli has joined #openstack-infra | 17:25 | |
| *** dhajare has quit IRC | 17:26 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fix race in slow start test https://review.openstack.org/572842 | 17:26 |
| *** yamamoto has joined #openstack-infra | 17:28 | |
| openstackgerrit | Ben Nemec proposed openstack-dev/pbr master: Move pbr-installation jobs in-tree https://review.openstack.org/571571 | 17:29 |
| *** yamamoto has quit IRC | 17:30 | |
| *** yamamoto has joined #openstack-infra | 17:30 | |
| *** gyee has joined #openstack-infra | 17:30 | |
| *** bhavik1 has joined #openstack-infra | 17:32 | |
| *** edmondsw has quit IRC | 17:32 | |
| *** lpetrut has quit IRC | 17:33 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Add timestamps to multiline debug message logs https://review.openstack.org/572845 | 17:33 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Treat ::1 as localhost in addition to 127.0.0.1 https://review.openstack.org/572847 | 17:34 |
| *** heyongli has quit IRC | 17:35 | |
| *** heyongli has joined #openstack-infra | 17:35 | |
| *** dpawlik has joined #openstack-infra | 17:37 | |
| dtantsur | clarkb, mordred, any opinion/comment on the question above? | 17:38 |
| openstackgerrit | Artem Goncharov proposed openstack-infra/nodepool master: retire shade in favor of openstacksdk https://review.openstack.org/572829 | 17:38 |
| *** jpena is now known as jpena|off | 17:40 | |
| *** eernst has joined #openstack-infra | 17:40 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix adding qcow2 format without need https://review.openstack.org/572836 | 17:40 |
| *** dklyle has joined #openstack-infra | 17:40 | |
| clarkb | dtantsur: can you link directly to what is wrong? I'm nto sure I understand. Generally though since we have a single output stderr would be part of stdout wouldn't it? | 17:41 |
| dtantsur | clarkb: well, if we want to break the 'command' command to being barely useful - then yes, otherwise no | 17:41 |
| dtantsur | I mean, stdout and stderr are essentially different things | 17:42 |
| dtantsur | if we squash them, it means getting back to writing long shell scripts inside of our ansible playbooks (similar to zuul v2 era) | 17:42 |
| *** dpawlik has quit IRC | 17:42 | |
| clarkb | oh this is ara not the job output log | 17:43 |
| clarkb | in the context of the job output log there isn't anywhere else to write it, its a single output | 17:43 |
| dtantsur | ah, okay, we're talking about different things | 17:43 |
| clarkb | in the context of ara that might be a better question for dmsimard ? as far as I know we aren't doing anything special with ara | 17:43 |
| dtantsur | so, lemme try to rephrase it | 17:43 |
| *** yamamoto_ has joined #openstack-infra | 17:43 | |
| dtantsur | I'm not sure the problem is with ara itself, but it may be | 17:43 |
| clarkb | ara runs its own callback in zuul and we dno't modify that as far as I know | 17:44 |
| clarkb | if ara isn't splitting it for you that would likely be a bug in ara, but happy for someone to show me otherwise | 17:44 |
| dtantsur | okay, but I have a feeling that the bug is not there. lemme try to find something more obvious | 17:45 |
| *** edmondsw has joined #openstack-infra | 17:45 | |
| clarkb | it would help to have a specific example | 17:45 |
| *** heyongli has quit IRC | 17:45 | |
| *** heyongli has joined #openstack-infra | 17:46 | |
| *** neiloy has quit IRC | 17:46 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Remove unnecessary method in test_slow_start https://review.openstack.org/572850 | 17:46 |
| dtantsur | clarkb: okay, please open http://logs.openstack.org/25/572825/1/check/metalsmith-integration-glance/09a1447/job-output.json.gz and scroll to the huuuge debug output closer to the end | 17:47 |
| dtantsur | clarkb: if you get to its beginning, you'll see that it ends up in stdout, while it's actually stderr (just tried locally) | 17:47 |
| *** yamamoto has quit IRC | 17:47 | |
| clarkb | dtantsur: you can do deep links with ara too which amy be easier | 17:47 |
| dtantsur | yep, I wanted to show the same without ara | 17:47 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/ansible-role-puppet master: Stop setting pluginsync=true https://review.openstack.org/572851 | 17:47 |
| *** bhavik1 has quit IRC | 17:47 | |
| clarkb | I'm not sure what I'm supposed to be looking at in the json file | 17:48 |
| clarkb | firefox collapses everything by default | 17:48 |
| *** lpetrut has joined #openstack-infra | 17:48 | |
| corvus | clarkb, dtantsur, mordred: the zuul version of the ansible command module does combine stderr with stdout: https://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/ansible/library/command.py#n337 | 17:48 |
| dtantsur | OUCH | 17:48 |
| clarkb | ah its happeing outside of the callback | 17:48 |
| dtantsur | well, with ara http://logs.openstack.org/25/572825/1/check/metalsmith-integration-glance/09a1447/ara-report/result/a4588c76-7636-47be-820f-9501aba5f694/ | 17:49 |
| dtantsur | this long thing should be inside of stderr (it's standard python logging) | 17:49 |
| clarkb | but that explains why ara is affected | 17:49 |
| dtantsur | the same is with job-output.json, I just cannot link to it :) | 17:50 |
| dtantsur | anyway, I have a feeling that this affects the playbook itself. so, after enabling the debug output, I cannot process the stdout (e.g. with |from_json) | 17:50 |
| clarkb | dtantsur: because it has non json mixed in from stderr? | 17:51 |
| dtantsur | yep | 17:51 |
| *** dave-mccowan has quit IRC | 17:52 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix adding qcow2 format without need https://review.openstack.org/572836 | 17:52 |
| clarkb | mordred was the original author of that code right? or was it corvus. In any case I expect the intent there was to make job-output.txt sane | 17:52 |
| clarkb | but maybe we need to do the stream combining in our callback instead | 17:53 |
| clarkb | or in the streamer thing we fork | 17:54 |
| *** amoralej is now known as amoralej|off | 17:54 | |
| corvus | i think mordred and i may have joint responsibility for this; it actually dates to the v2.5 code, but we intentionally kept it the same way because we felt changing it was very difficult or impossible. unfortunately i don't think we wrote down the details on that. at any rate, i agree this is undesirable, and we should take another look. a lot has changed since then. | 17:55 |
| corvus | clarkb: the command module writes out the file that the streamer reads, so i think the solution would still be in the command module | 17:55 |
| clarkb | ah | 17:55 |
| * mordred is wrapping head around conversation real quick | 17:55 | |
| corvus | it's just that we need to follow *two* streams within there, then multiplex them into one... | 17:55 |
| *** aojea has quit IRC | 17:55 | |
| clarkb | ya which may break ordering whereas at least now its somewhat ordered sanely | 17:55 |
| corvus | i *think* the thing that was impossible was correct multiplexing. | 17:56 |
| *** heyongli has quit IRC | 17:56 | |
| corvus | clarkb: yeah, i think you're on to it | 17:56 |
| mordred | yah. that's the issue - for streaming if we don't squash them, then they won't be interleaved appropriately | 17:56 |
| *** heyongli has joined #openstack-infra | 17:56 | |
| corvus | we'll get an approximation of stdout/stderr multiplexing based on the nuances of thread switching | 17:56 |
| corvus | the only way we could find make the console look like what you'd see on a terminal was to have stdout/stderr be the same pipe. | 17:57 |
| dtantsur | yep, but then we cannot parse output of anything that has debug logging or even warnings | 17:58 |
| *** e0ne has joined #openstack-infra | 17:58 | |
| corvus | dtantsur: yeah, and i agree that's a problem | 17:58 |
| dtantsur | time for 3 streams? :) | 17:58 |
| dtantsur | 2 real, one combined for displaying? | 17:59 |
| clarkb | you could do it with a shell task but you'd be losing the stderr | 17:59 |
| corvus | i wonder if there's a way to hook something up to the other end of the stdout/stderr pipes that can record what's written to it with very accurate timestamps | 17:59 |
| clarkb | right? | 17:59 |
| corvus | dtantsur: is there a way to do that with exec() ? | 17:59 |
| * dtantsur thinks | 17:59 | |
| corvus | clarkb: shell task? | 18:00 |
| clarkb | corvus: ya so shell: 'some command 2>/dev/null' | json or whatever | 18:00 |
| clarkb | thats not working ansible | 18:01 |
| dtantsur | I guess it's not straightforward with exec() only | 18:01 |
| dtantsur | we need something like tee | 18:01 |
| corvus | clarkb: ah, yeah. that still sort of fails the "plain ansible should work in zuul" test too though. | 18:01 |
| clarkb | corvus: yup | 18:01 |
| clarkb | more brainstorming an immediate work around for dtantsur | 18:01 |
| corvus | i agree it may be a temporary workaround | 18:01 |
| corvus | dtantsur: yeah, maybe we can exec "tee" or something like it and hook its file descriptors up to the command exec? | 18:03 |
| * dtantsur wonders how tee is implemented | 18:03 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/ansible-role-puppet master: Add parser = future config option to puppet.conf https://review.openstack.org/572856 | 18:06 |
| *** heyongli has quit IRC | 18:06 | |
| *** heyongli has joined #openstack-infra | 18:07 | |
| *** boris_42_ has joined #openstack-infra | 18:07 | |
| dmsimard | dtantsur: hey, reading backlog about your ara question | 18:08 |
| dtantsur | well, it predictably just reads from one source and writes to many | 18:08 |
| dtantsur | dmsimard: no worries, it's not really about ara | 18:08 |
| *** electrofelix has quit IRC | 18:10 | |
| dmsimard | dtantsur: so I'm looking at http://logs.openstack.org/25/572825/1/check/metalsmith-integration-glance/09a1447/ara-report/result/a4588c76-7636-47be-820f-9501aba5f694/ | 18:10 |
| mnaser | http://zuul.openstack.org/stream.html?uuid=a239ce53a0db404683c9484ca4b0a0ce&logfile=console.log | 18:10 |
| mnaser | is this showing anything to anyone? | 18:10 |
| dmsimard | and there's no stderr, but you're saying there is ? | 18:10 |
| dmsimard | mnaser: pitch black | 18:11 |
| dtantsur | dmsimard: well, this whole output is in stderr in reality | 18:11 |
| mnaser | is this a known issue? i keep running into this :( | 18:11 |
| dtantsur | but it's apparently not ara's fault | 18:11 |
| openstackgerrit | Merged openstack-infra/zuul master: Fix race in slow start test https://review.openstack.org/572842 | 18:11 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Create a base Driver class https://review.openstack.org/571585 | 18:11 |
| corvus | dtantsur, clarkb, mordred: maybe we should just go ahead and implement a select loop in python to interleave them. it will probably produce coarser chunks than the same thing would in native code. but maybe that's the best compromise for now, and maybe we look at writing some C code later if it's a problem? | 18:12 |
| clarkb | mnaser: I dont' see stuff either | 18:13 |
| * dtantsur can commit to writing some rust code if python becomes a problem :D | 18:13 | |
| dtantsur | but yes, it may be The Solution for the time being | 18:13 |
| mnaser | clarkb: well there's a job running there so i'm not sure, i've seen this happen a few times today/yesterday | 18:13 |
| mordred | corvus: yah. I think that's probably not a bad idea | 18:14 |
| corvus | clarkb, mnaser: re streaming: i saw a bunch of stuff yesterday about streaming and timeouts; did that all get merged and restarted, or are things still pending? | 18:15 |
| mordred | corvus: https://review.openstack.org/#/q/topic:keepalive-log-connection+status:open | 18:16 |
| mordred | corvus: I left a +A off the first one in case you wanted to check it | 18:16 |
| clarkb | corvus: the timeouts fixes got merged and executors were restarted | 18:16 |
| *** heyongli has quit IRC | 18:16 | |
| mnaser | does it help if i provide a link everytime i run into a job that is doing this? | 18:16 |
| *** heyongli has joined #openstack-infra | 18:16 | |
| clarkb | I think what we want to do is track backwards to the executor and into the job ndoe and make sure the chain si working | 18:17 |
| clarkb | this is how I debugged the timeouts issue | 18:17 |
| mnaser | the interesting thing is | 18:18 |
| *** yamamoto_ has quit IRC | 18:18 | |
| mnaser | finger a239ce53a0db404683c9484ca4b0a0ce@zuul.openstack.org works | 18:18 |
| clarkb | oh in that case it may be a zuul-web bug | 18:18 |
| *** myoung|lunch is now known as myoung | 18:18 | |
| clarkb | since finger will bypass that portion of the streaming | 18:18 |
| mnaser | yeah i thought so, yesterday black screens also i could see things in there | 18:18 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/infra-specs master: Complete puppet_4_prelim_testing spec https://review.openstack.org/563592 | 18:19 |
| Shrews | clarkb: were tests not passing without https://review.openstack.org/572574 ? | 18:19 |
| openstackgerrit | Merged openstack-infra/zuul master: Remove unnecessary method in test_slow_start https://review.openstack.org/572850 | 18:19 |
| Shrews | clarkb: oh, nm. i see what's up now | 18:20 |
| corvus | mnaser: i eventually got output | 18:20 |
| mnaser | corvus: oh yes, that is also something i've noticed. sometimes it just magically appears after a while | 18:20 |
| mnaser | probably not magically, but yeah :) | 18:20 |
| corvus | mnaser, clarkb, mordred: hypothesis: i did something to zuul-web that made the part where it catches up on previously output data slow. | 18:21 |
| corvus | mnaser: does it seem to happen on jobs that have been running for a while? | 18:22 |
| mnaser | this job has been running for close to an hour or even more | 18:22 |
| mnaser | it's a long job | 18:22 |
| mnaser | builds openstack and deploys it with ansible (osa job) | 18:22 |
| mnaser | on that theory, i picked a random tripleo job and same thing here -- http://zuul.openstack.org/stream.html?uuid=65e7a66947c14f5693736cca193fcdce&logfile=console.log | 18:22 |
| mordred | corvus: that theory seems like a reasonale theory | 18:23 |
| mordred | although I don't know what, specifically, that thing would be | 18:23 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Move QuotaInformation to driver utils https://review.openstack.org/572860 | 18:23 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Add support for turning on the future parser https://review.openstack.org/572861 | 18:24 |
| *** dhajare has joined #openstack-infra | 18:25 | |
| *** heyongli has quit IRC | 18:26 | |
| *** heyongli has joined #openstack-infra | 18:27 | |
| *** yamamoto has joined #openstack-infra | 18:28 | |
| *** rajinir has quit IRC | 18:29 | |
| *** dtantsur is now known as dtantsur|afk | 18:30 | |
| *** yamahata has quit IRC | 18:31 | |
| *** hongbin has joined #openstack-infra | 18:32 | |
| *** robled has quit IRC | 18:32 | |
| *** yamamoto has quit IRC | 18:32 | |
| *** iyamahat has quit IRC | 18:35 | |
| *** yamamoto has joined #openstack-infra | 18:36 | |
| corvus | i'm not sure our apache caching of the status page is actually doing anything | 18:36 |
| *** robled has joined #openstack-infra | 18:36 | |
| *** robled has joined #openstack-infra | 18:36 | |
| corvus | i'm seeing multiple requests/second for the status json in both apache and zuul-web | 18:37 |
| *** heyongli has quit IRC | 18:37 | |
| *** heyongli has joined #openstack-infra | 18:37 | |
| *** sambetts is now known as sambetts|afk | 18:38 | |
| clarkb | I was just looking at how we serve those files last night to help debug a problem unrelated to opnstack and we don't seem to proxy them to zuul-web at all so weird that we would see requests there | 18:40 |
| *** dave-mccowan has joined #openstack-infra | 18:41 | |
| corvus | clarkb: i mean the json data | 18:45 |
| clarkb | ah | 18:45 |
| corvus | apache is configured to cache it | 18:45 |
| corvus | but every request is a cache miss | 18:45 |
| *** caphrim007_ has quit IRC | 18:45 | |
| *** heyongli has quit IRC | 18:47 | |
| *** heyongli has joined #openstack-infra | 18:47 | |
| *** iyamahat has joined #openstack-infra | 18:49 | |
| clarkb | apache is picky about what it will cache by default | 18:51 |
| *** yamahata has joined #openstack-infra | 18:51 | |
| clarkb | I wonder if we aren't setting the appropraite headers to make it cache things | 18:51 |
| mordred | corvus: maybe we're sending a cache header incorrecty - or not sending a cache header | 18:51 |
| mordred | what clarkb said | 18:51 |
| corvus | or maybe it's because our expiration is 1 second, and perhaps it takes longer than that to deal with the request | 18:53 |
| corvus | after lunch, i'll try debugging both that as well as the stream problem mnaser reported | 18:55 |
| *** iyamahat has quit IRC | 18:55 | |
| *** iyamahat has joined #openstack-infra | 18:56 | |
| *** caphrim007 has joined #openstack-infra | 18:56 | |
| *** heyongli has quit IRC | 18:57 | |
| *** heyongli has joined #openstack-infra | 18:57 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Translate zuulStartStream into typescript https://review.openstack.org/558618 | 18:58 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Shift log streaming code into StreamComponent https://review.openstack.org/558619 | 18:58 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Have Drivers create Providers https://review.openstack.org/571586 | 18:58 |
| *** caphrim007_ has joined #openstack-infra | 19:02 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Revert "Add Zuulv3 jobs for puppet functional testing" https://review.openstack.org/570804 | 19:04 |
| *** r-daneel_ has joined #openstack-infra | 19:04 | |
| *** r-daneel has quit IRC | 19:04 | |
| *** r-daneel_ is now known as r-daneel | 19:04 | |
| *** jesslampe has quit IRC | 19:05 | |
| *** caphrim007 has quit IRC | 19:06 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Add beaker check of vhost template https://review.openstack.org/570991 | 19:06 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Use httpd::vhost $content parameter https://review.openstack.org/570825 | 19:06 |
| *** dhajare has quit IRC | 19:07 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/project-config master: Use updated openstackci beaker jobs https://review.openstack.org/571938 | 19:07 |
| *** heyongli has quit IRC | 19:07 | |
| *** heyongli has joined #openstack-infra | 19:08 | |
| *** dave-mccowan has quit IRC | 19:10 | |
| *** priteau has quit IRC | 19:11 | |
| *** dave-mccowan has joined #openstack-infra | 19:11 | |
| *** neiloy has joined #openstack-infra | 19:14 | |
| *** SumitNaiksatam has quit IRC | 19:15 | |
| *** kjackal has joined #openstack-infra | 19:15 | |
| *** SumitNaiksatam has joined #openstack-infra | 19:15 | |
| *** heyongli has quit IRC | 19:18 | |
| *** rajinir has joined #openstack-infra | 19:18 | |
| *** heyongli has joined #openstack-infra | 19:18 | |
| AJaeger | team, here's a revert - should we merge that? https://review.openstack.org/#/c/570804/ "Revert "Add Zuulv3 jobs for puppet functional testing"" | 19:21 |
| *** e0ne has quit IRC | 19:22 | |
| *** kien-ha has quit IRC | 19:24 | |
| *** heyongli has quit IRC | 19:28 | |
| *** heyongli has joined #openstack-infra | 19:28 | |
| *** lifeless has joined #openstack-infra | 19:35 | |
| *** heyongli has quit IRC | 19:38 | |
| *** heyongli has joined #openstack-infra | 19:38 | |
| *** slaweq has quit IRC | 19:39 | |
| *** dpawlik has joined #openstack-infra | 19:39 | |
| *** slaweq_ has joined #openstack-infra | 19:42 | |
| *** dpawlik has quit IRC | 19:43 | |
| *** slaweq has joined #openstack-infra | 19:44 | |
| clarkb | AJaeger: considering cmurphy is/has been driving that work I'll defer on that | 19:46 |
| clarkb | er defer to cmurphy on that | 19:46 |
| clarkb | I'm happy to revert | 19:46 |
| *** r-daneel has quit IRC | 19:46 | |
| *** SumitNaiksatam has quit IRC | 19:46 | |
| *** r-daneel has joined #openstack-infra | 19:47 | |
| *** heyongli has quit IRC | 19:48 | |
| *** heyongli has joined #openstack-infra | 19:49 | |
| cmurphy | that was my idea to replace beaker but if we're considering puppet on life support then i don't want to be writing a new kind of test for every module | 19:49 |
| *** kjackal has quit IRC | 19:49 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Include hostnames in /etc/hosts https://review.openstack.org/572313 | 19:51 |
| *** slaweq has quit IRC | 19:51 | |
| *** yamamoto has quit IRC | 19:51 | |
| *** dave-mcc_ has joined #openstack-infra | 19:52 | |
| *** dave-mccowan has quit IRC | 19:53 | |
| corvus | time is short, but should we send a note to openstack-dev letting folks know we plan on upgrading zuul's ansible to 2.5 tomorrow and there may be breakage? | 19:54 |
| *** slaweq has joined #openstack-infra | 19:54 | |
| fungi | oh, right, that's what "thursday" meant | 19:54 |
| *** slaweq__ has joined #openstack-infra | 19:54 | |
| *** slaweq__ has quit IRC | 19:54 | |
| *** slaweq has quit IRC | 19:54 | |
| fungi | not a bad idea | 19:54 |
| clarkb | is it already wednesday? ++ to sending email about it | 19:54 |
| openstackgerrit | Merged openstack-infra/nodepool master: Create a base Driver class https://review.openstack.org/571585 | 19:54 |
| *** slaweq has joined #openstack-infra | 19:54 | |
| *** slaweq__ has joined #openstack-infra | 19:55 | |
| *** slaweq has quit IRC | 19:55 | |
| AJaeger | clarkb, cmurphy : I gave my +2 then on https://review.openstack.org/#/c/570804 - cmurphy has a large list of changes, let's help moving those in... | 19:55 |
| *** slaweq__ has quit IRC | 19:55 | |
| *** slaweq has joined #openstack-infra | 19:55 | |
| AJaeger | oh, clarkb gave his +2 - then +2A... | 19:55 |
| openstackgerrit | Merged openstack-infra/nodepool master: Have Drivers create Providers https://review.openstack.org/571586 | 19:55 |
| corvus | if anyone else has time to draft that, that'd be great; i've in a pile of debugging right now | 19:56 |
| clarkb | I can do it | 19:56 |
| *** slaweq_ has quit IRC | 19:56 | |
| *** slaweq has quit IRC | 19:57 | |
| hwoarang | clarkb could you have a look on https://review.openstack.org/#/c/572424/ when you have the time (and possibly push a new release?). Then I can look into the openafs+wheels for suse (tomorrow or friday that is) | 19:57 |
| *** SumitNaiksatam has joined #openstack-infra | 19:57 | |
| hwoarang | (mordred too ^ who voted on an earlier revision) | 19:57 |
| hwoarang | TIA! | 19:57 |
| *** yamamoto has joined #openstack-infra | 19:58 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Fix adding qcow2 format without need https://review.openstack.org/572836 | 19:58 |
| *** heyongli has quit IRC | 19:59 | |
| *** heyongli has joined #openstack-infra | 19:59 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Add beaker check of vhost template https://review.openstack.org/570991 | 20:00 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Use httpd::vhost $content parameter https://review.openstack.org/570825 | 20:00 |
| openstackgerrit | Merged openstack-infra/project-config master: Replace neutron ovsfw job with iptables_hybrid https://review.openstack.org/572386 | 20:00 |
| clarkb | infra-root https://etherpad.openstack.org/p/MB1XyZ5c4s how does that look? | 20:00 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Revert "Add Zuulv3 jobs for puppet functional testing" https://review.openstack.org/570804 | 20:01 |
| corvus | clarkb: lgtm | 20:01 |
| *** e0ne has joined #openstack-infra | 20:01 | |
| clarkb | hwoarang: I'll take a look after lunch, you don't happen to have a link to a working test job do you? | 20:02 |
| *** yamamoto has quit IRC | 20:02 | |
| corvus | i'm going to periodically restart zuul-web with additional debugging. i don't expect more than very brief outages. | 20:04 |
| hwoarang | clarkb: this is the testing job https://review.openstack.org/#/c/572416/ (which can also go in) | 20:04 |
| hwoarang | thank you | 20:04 |
| mnaser | its back | 20:05 |
| mnaser | cool | 20:05 |
| *** heyongli has quit IRC | 20:09 | |
| *** heyongli has joined #openstack-infra | 20:09 | |
| *** dave-mcc_ has quit IRC | 20:15 | |
| fungi | clarkb: lgtm, thanks! | 20:18 |
| *** heyongli has quit IRC | 20:19 | |
| *** heyongli has joined #openstack-infra | 20:19 | |
| *** yamamoto has joined #openstack-infra | 20:20 | |
| *** yamamoto has quit IRC | 20:20 | |
| *** SumitNaiksatam_ has joined #openstack-infra | 20:23 | |
| *** SumitNaiksatam has quit IRC | 20:23 | |
| *** SumitNaiksatam_ is now known as SumitNaiksatam | 20:23 | |
| clarkb | ok ansible notice sent | 20:25 |
| *** heyongli has quit IRC | 20:29 | |
| *** e0ne has quit IRC | 20:30 | |
| *** heyongli has joined #openstack-infra | 20:30 | |
| Shrews | clarkb: what time do we plan to do the ansible upgrade? | 20:30 |
| corvus | aha. we're not caching because status.json exceeds the default max apache disk cache file size | 20:31 |
| fungi | yikes | 20:31 |
| corvus | or -- in other words -- we're only caching when it's small :) | 20:31 |
| fungi | or -- in other words --- that's a lot of json! | 20:32 |
| corvus | yeah. some day i hope we can make it use websockets or something similar to subscribe to events on changes, but we're a ways away from that. | 20:32 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-zuul master: Increase apache disk cache max size https://review.openstack.org/572997 | 20:35 |
| *** lpetrut has quit IRC | 20:35 | |
| *** hemna_ has quit IRC | 20:39 | |
| *** heyongli has quit IRC | 20:40 | |
| *** heyongli has joined #openstack-infra | 20:40 | |
| *** esberglu_ has joined #openstack-infra | 20:42 | |
| clarkb | Shrews: probably going to depend in when the zuul change merges more than anything else | 20:44 |
| *** esberglu has quit IRC | 20:44 | |
| clarkb | I'll be around at 8am pacific ish to get started | 20:45 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Add beaker check of vhost template https://review.openstack.org/570991 | 20:46 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Use httpd::vhost $content parameter https://review.openstack.org/570825 | 20:46 |
| corvus | cool, let's aim to have it merged by then, that way we can restart our zuul as soon as clarkb and i are around | 20:46 |
| *** VW_ has joined #openstack-infra | 20:47 | |
| clarkb | do we need to restart ? | 20:48 |
| *** jcoufal has quit IRC | 20:48 | |
| clarkb | seems like new zuul will be installed pulling in deps which will then use new ansible because we fork it? | 20:48 |
| corvus | oh, erm, i guess not... | 20:48 |
| corvus | so i guess merging the change will cause us to start using it shortly after | 20:48 |
| clarkb | actually we may need to restart to load up the new monkey patched stuff? | 20:49 |
| clarkb | except no thats all in the forked processes too | 20:49 |
| *** VW has quit IRC | 20:50 | |
| corvus | well, we copy it into a location at startup | 20:50 |
| corvus | so we probably do need a restart to get the right patched ansible modules in place | 20:50 |
| *** heyongli has quit IRC | 20:50 | |
| *** heyongli has joined #openstack-infra | 20:50 | |
| *** kjackal has joined #openstack-infra | 20:50 | |
| *** VW_ has quit IRC | 20:51 | |
| fungi | i'm double-booked for meetings from 15:00-16:00z but can help out after that (so basically starting at 9am pdt) | 20:51 |
| clarkb | in that case we may want to put ze* into the emergency file, merge zuul chagnes for 2.5, then stop executors, install new zuul, start executors | 20:51 |
| corvus | clarkb: that sounds like a plan | 20:52 |
| fungi | yeah, seems entirely workable | 20:52 |
| fungi | and odds are any subtle breakage won't bubble up until after my meetings end anyway | 20:53 |
| clarkb | hwoarang: question about the glean change, does leap <=42 use network-scripts and >=15 + tumbleweed use network or do they all use network and this was broken? | 20:54 |
| clarkb | hwoarang: looks like _network_files wasn't updated implying that there wasn't a switch and it was just broken all along | 20:55 |
| *** esberglu_ has quit IRC | 20:56 | |
| *** rh-jelabarre has quit IRC | 20:56 | |
| fungi | ugh... the apache 2.4 docs are taking forever to load for me | 20:56 |
| *** iyamahat has quit IRC | 20:57 | |
| *** trown is now known as trown|outtypewww | 20:57 | |
| fungi | and now they're back, including some pages i was getting a 404 on earlier | 20:57 |
| *** kgiusti has left #openstack-infra | 20:57 | |
| fungi | must have been a server-side problem (oh the irony) | 20:58 |
| *** iyamahat has joined #openstack-infra | 20:58 | |
| clarkb | corvus: re apache caching, is 2MB ish enough? how big are our status.json files? | 20:58 |
| corvus | clarkb: 1.2M today | 20:59 |
| fungi | https://httpd.apache.org/docs/2.4/mod/mod_cache_disk.html#cachemaxfilesize says the default is 1mb | 20:59 |
| fungi | which is why i was trying to get to the docs | 20:59 |
| clarkb | corvus: do we maybe want to cache up to 10MB and not worry about it for a while? | 20:59 |
| corvus | clarkb: wfm | 20:59 |
| corvus | i think i'm making progress on the stream issue, but it'll take a little bit | 20:59 |
| clarkb | I expect our browsers will be angry with 10MB files before apache is | 21:00 |
| clarkb | whereas 1.2MB vs little less than 2MB may result in sadness again in the future | 21:00 |
| *** heyongli has quit IRC | 21:00 | |
| fungi | yeah, 10000000 seems like a nice round number to me as it's an order of magnitude greater than the default | 21:00 |
| *** rh-jelabarre has joined #openstack-infra | 21:01 | |
| *** heyongli has joined #openstack-infra | 21:01 | |
| clarkb | corvus: should I go ahead and quickly make that edit so you can keep debugging streaming? | 21:01 |
| corvus | clarkb: yes thx | 21:01 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-zuul master: Increase apache disk cache max size https://review.openstack.org/572997 | 21:02 |
| *** eernst has quit IRC | 21:02 | |
| *** felipemonteiro has joined #openstack-infra | 21:02 | |
| *** camunoz has quit IRC | 21:02 | |
| *** felipemonteiro_ has joined #openstack-infra | 21:03 | |
| *** eernst has joined #openstack-infra | 21:03 | |
| *** eernst has quit IRC | 21:06 | |
| *** myoung is now known as myoung|off | 21:06 | |
| *** felipemonteiro has quit IRC | 21:07 | |
| *** felipemonteiro_ has quit IRC | 21:09 | |
| *** edmondsw has quit IRC | 21:09 | |
| *** heyongli has quit IRC | 21:10 | |
| *** heyongli has joined #openstack-infra | 21:11 | |
| hwoarang | clarkb: yeah it was broken all along for bridges and vlans | 21:14 |
| *** nicolasbock has quit IRC | 21:14 | |
| clarkb | hwoarang: tahnk you for confirming | 21:14 |
| *** ldnunes has quit IRC | 21:15 | |
| clarkb | hwoarang: ianw as for the change to add a suse leap 15 nodepool itnegration job I think corvus has expressed a desire to move those job defs out of nodepool itself and have it just consume a single integration job from somewhere like dib | 21:15 |
| clarkb | we probably want to work on doing that rather than adding new stuff to nodepool | 21:15 |
| ianw | clarkb: not opposed to doing that, but it is in the "production" builders right now so my preference would be to have it in the test | 21:16 |
| *** jcoufal has joined #openstack-infra | 21:16 | |
| clarkb | have it in the test == have it in the nodepool test suite? | 21:17 |
| *** neiloy has quit IRC | 21:17 | |
| ianw | yeah | 21:17 |
| *** neiloy has joined #openstack-infra | 21:17 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Fix adding qcow2 format without need https://review.openstack.org/572836 | 21:18 |
| *** jcoufal has quit IRC | 21:18 | |
| clarkb | I'm not opposed to it, but also trying to keep nodepool devs happy | 21:18 |
| clarkb | Shrews: corvus ^ fyi | 21:18 |
| corvus | maybe let's grandfather this one in? :) | 21:18 |
| *** yamamoto has joined #openstack-infra | 21:20 | |
| *** heyongli has quit IRC | 21:21 | |
| *** john_studarus has joined #openstack-infra | 21:21 | |
| *** heyongli has joined #openstack-infra | 21:21 | |
| corvus | please don't add any more images though | 21:21 |
| fungi | i agree it's not reasonable to expect to test every possible image build on a nodepool change. we could start to look critically at the current set and pick a representative subset to keep on | 21:22 |
| ianw | well it is really just the set of images that are live in the gate | 21:22 |
| corvus | oh i didn't think we were talking about testing things on nodepool cahnges? | 21:22 |
| john_studarus | What's the spin-up rate for zuul on an infra cloud? I'm doing some performance testing on a public infra cloud and want to simulate what Zuul may do. Spin up an instance per second? Multiple a second? | 21:22 |
| *** lifeless_ has joined #openstack-infra | 21:22 | |
| corvus | i thought this was just the "dib's test suite is actually in the nodepool repo" issue | 21:22 |
| clarkb | corvus: its mostly that, they are in nodepools experimental queue | 21:23 |
| clarkb | corvus: but will primarily be consumed by dib | 21:23 |
| ianw | it's in experimental for nodepool | 21:23 |
| *** lifeless has quit IRC | 21:23 | |
| fungi | ahh, i didn't realize we don't run all of those in check for nodepool itself | 21:23 |
| clarkb | john_studarus: it varies based on demand, but it isn't out of the qusetion for nodepool to ask for all of the quota in a region to be fulfilled in a short period of time | 21:23 |
| clarkb | john_studarus: that typically happens when we restart services and have to restart job runs | 21:24 |
| john_studarus | ok - so 100 instances all at once... | 21:24 |
| fungi | john_studarus: we have a delay/throttle knob of sorts to limit how quickly nodepool can make api calls, but no direct rate limiting on the rate of boot calls in particular | 21:24 |
| ianw | i'm very close to finishing off the zuulv3 native jobs for dib. i just want to do some more bindep tweaking to clear that up. after that i can look at moving the job into dib if we like | 21:24 |
| clarkb | corvus: ianw sounds like a plan to me and in the meantime we update config to tes leap 15 in existing suse job | 21:25 |
| clarkb | this wn't update what checks/gates nodepool | 21:25 |
| john_studarus | Spinning up 100 all at once isn't an issue. It's the control plane of spinning up then down dozens at once where I'm seeing slowdowns. | 21:25 |
| ianw | clarkb: right, but it will gate on that for dib so we don't break the production image | 21:25 |
| clarkb | ianw: ya | 21:25 |
| clarkb | corvus: if that sounds reasonable to you I'll go ahead and approve the change | 21:26 |
| fungi | john_studarus: we tend to only rapidly boot/delete if there are problems preventing the instances from being reachable. under typical use our nodes tend to have lifespans of at least 5 minutes | 21:26 |
| corvus | clarkb, ianw:++ | 21:27 |
| john_studarus | can I find the base image & flavor description somewhere? | 21:27 |
| clarkb | john_studarus: https://docs.openstack.org/infra/system-config/contribute-cloud.html has a rough guide for the instances flavors jsut based on what we use in other clouds. 8vcpu, 8gb ram, 80gb disk | 21:28 |
| ianw | if i could get a couple of eyes on https://review.openstack.org/572667 and https://review.openstack.org/572668 that would be great. it updates puppet-grafana and installs a later version on grafana02, which is running @ http://grafana02.openstack.org | 21:28 |
| clarkb | john_studarus: the base images are built by diskimagebuilder and we build ubuntu trusty, xenial, bionic, centos 7, current fedora, current debian, and current suse | 21:28 |
| dtroyer | infra folk: With the starlingx repos created, I think I need to be added to the groups to finish setting them up: starlingx-core and starlingx-release | 21:29 |
| clarkb | john_studarus: https://nb01.openstack.org/images/ has copies of images (though its a self signed ssl cert) | 21:29 |
| clarkb | dtroyer: are you the appropriate user to add to the groups? | 21:29 |
| dtroyer | yes | 21:29 |
| clarkb | dtroyer: one sec | 21:29 |
| clarkb | dtroyer: and done | 21:30 |
| dtroyer | clarkb: thanks! | 21:30 |
| *** heyongli has quit IRC | 21:31 | |
| *** heyongli has joined #openstack-infra | 21:31 | |
| fungi | john_studarus: nodepool regenerates those images roughly daily to glance in each provider where we have accounts for ephemeral ci nodes. we rotate them out and only keep the most recent two for each platform | 21:32 |
| fungi | er, regenerates and uploads to glance | 21:32 |
| clarkb | ianw: done | 21:32 |
| *** yamamoto has quit IRC | 21:33 | |
| john_studarus | fungi: fantastic! I'll pull in those images into my test script. | 21:34 |
| ianw | clarkb: thanks! i'm quite interested in seeing how alerts work with this new version. i think we might be able to setup alerts in grafyaml, and have a useful email or possibly irc ping sent out | 21:35 |
| *** eernst has joined #openstack-infra | 21:35 | |
| fungi | john_studarus: also i'm in the process of resetting the passwords you e-mailed me, and will reply to you in a bit once i have those done and recorded. thanks! | 21:35 |
| *** eernst_ has joined #openstack-infra | 21:37 | |
| *** eernst has quit IRC | 21:37 | |
| clarkb | ianw: interesting | 21:37 |
| john_studarus | fungi: ok! | 21:37 |
| *** dpawlik has joined #openstack-infra | 21:40 | |
| *** heyongli has quit IRC | 21:41 | |
| *** heyongli has joined #openstack-infra | 21:41 | |
| *** dpawlik has quit IRC | 21:44 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Increase apache disk cache max size https://review.openstack.org/572997 | 21:44 |
| *** neiloy has quit IRC | 21:47 | |
| *** dpawlik has joined #openstack-infra | 21:47 | |
| openstackgerrit | Merged openstack-infra/system-config master: Document Kerberos password reset process https://review.openstack.org/572820 | 21:47 |
| openstackgerrit | Merged openstack-infra/system-config master: Update puppet-grafana https://review.openstack.org/572667 | 21:49 |
| openstackgerrit | Merged openstack-infra/system-config master: Install later grafana on graphite02 https://review.openstack.org/572668 | 21:50 |
| *** camunoz has joined #openstack-infra | 21:51 | |
| *** heyongli has quit IRC | 21:51 | |
| *** dpawlik has quit IRC | 21:51 | |
| *** heyongli has joined #openstack-infra | 21:52 | |
| *** rcernin has joined #openstack-infra | 21:54 | |
| fungi | clarkb: our /etc/openstack/all-clouds.yaml and /etc/openstack/clouds.yaml files on the puppetmaster are just hand-maintained right? not templated in puppet somewhere? | 21:56 |
| clarkb | fungi: they are in puppet in system-config | 21:56 |
| clarkb | openstack_project/templates/puppetmaster and openstack_project/templates/nodepool for the respective hosts that clouds.yaml | 21:57 |
| fungi | ahh | 21:58 |
| fungi | thanks | 21:58 |
| *** r-daneel has quit IRC | 21:58 | |
| *** r-daneel has joined #openstack-infra | 21:59 | |
| fungi | i knew about nodepool but didn't realize the one on clouds.yaml on puppetmaster was also coming from there | 21:59 |
| clarkb | fungi: I do a git grep on a cloud name like limestone to find them everytime | 22:00 |
| *** lxkong has joined #openstack-infra | 22:01 | |
| *** heyongli has quit IRC | 22:02 | |
| *** heyongli has joined #openstack-infra | 22:02 | |
| fungi | yeah, i shoulda | 22:02 |
| clarkb | I will tag the glean update once it merges since the last commit was also tagged that is a nice small delta | 22:04 |
| *** edmondsw has joined #openstack-infra | 22:06 | |
| ianw | json to yaml | 22:09 |
| *** dbecker has quit IRC | 22:09 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Template credentials for Packet Host/Platform 9 https://review.openstack.org/573021 | 22:09 |
| fungi | oh, i guess i need to plumb those variables in from the global site manifest/hiera too | 22:10 |
| *** gfidente has quit IRC | 22:10 | |
| *** edmondsw has quit IRC | 22:10 | |
| openstackgerrit | Merged openstack-infra/glean master: glean: Fix SUSE support for bridges and vlan configurations. https://review.openstack.org/572424 | 22:11 |
| clarkb | fungi: yup | 22:12 |
| clarkb | ok there is the merge I need to tag | 22:12 |
| *** heyongli has quit IRC | 22:12 | |
| *** heyongli has joined #openstack-infra | 22:12 | |
| dmsimard | is there a good way to test graphite/grafana queries before submitting a grafyaml patch ? | 22:13 |
| clarkb | infra-root thinking the tag will be 1.11.1 as the above change is a bug fix for suse distros | 22:14 |
| clarkb | that sounds right to everyone? | 22:14 |
| clarkb | dmsimard: you can test them against graphite directly | 22:14 |
| clarkb | using the api or the wizard thing | 22:14 |
| ianw | clarkb: ++ | 22:15 |
| dmsimard | clarkb: yeah I got the graphite queries, it's the grafana things I'm not sure about | 22:16 |
| ianw | dmsimard: yeah, in graphite. you being you, you can also find the admin password and fiddle manually | 22:16 |
| ianw | i will say it is quite difficult to figure out what to put into grafyaml, unless you're working backwards from a working dashboard | 22:17 |
| dmsimard | ianw: exactly my point :) | 22:18 |
| clarkb | hwoarang: ianw tag pushed | 22:19 |
| ianw | dmsimard: yep; i'm just looking at the alerting stuff, and converting the json the gui produces back to yaml | 22:22 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Template credentials for Packet Host/Platform 9 https://review.openstack.org/573021 | 22:22 |
| *** heyongli has quit IRC | 22:22 | |
| ianw | intersting, the load average panel on the zuul overview produces a graphite traceback | 22:22 |
| ianw | i wonder if that's new | 22:22 |
| *** heyongli has joined #openstack-infra | 22:23 | |
| ianw | http://grafana.openstack.org/dashboard/db/zuul-status?panelId=22&fullscreen | 22:23 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Handle more than one websocket streamer at a time https://review.openstack.org/573023 | 22:25 |
| *** caphrim007_ has quit IRC | 22:26 | |
| corvus | clarkb, mnaser: ^ i misunderstood the ws4py api. i think that should correct it. i'll pull that onto zuul.o.o now and test it out. | 22:26 |
| *** caphrim007 has joined #openstack-infra | 22:26 | |
| corvus | (it seems everyone's idea of how a websocket "should" behave is different) | 22:26 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Handle more than one websocket streamer at a time https://review.openstack.org/573023 | 22:28 |
| corvus | okay, that's running now, and i'm able to stream more than one job now :) | 22:30 |
| clarkb | https://pypi.org/project/glean/#history new glean on pypi hopefully that lets hwoarang and suse move things along | 22:31 |
| clarkb | corvus: cool, I'm just starting to look at the change | 22:31 |
| *** heyongli has quit IRC | 22:32 | |
| *** heyongli has joined #openstack-infra | 22:33 | |
| *** lifeless_ has quit IRC | 22:34 | |
| *** lifeless has joined #openstack-infra | 22:34 | |
| *** rlandy|rover is now known as rlandy|rover|bbl | 22:37 | |
| *** tpsilva has quit IRC | 22:40 | |
| fungi | that turned out to be an interesting cause | 22:40 |
| corvus | fungi: yeah, there seems to have been an error with the programmer | 22:41 |
| *** heyongli has quit IRC | 22:43 | |
| *** heyongli has joined #openstack-infra | 22:43 | |
| *** rh-jelabarre has quit IRC | 22:43 | |
| * fungi chooses to interpret that as a fault in the eeprom writing device | 22:44 | |
| *** rh-jelabarre has joined #openstack-infra | 22:47 | |
| *** threestrands has joined #openstack-infra | 22:51 | |
| clarkb | corvus: left a comment that I don't think is critical based on tests passing but probably worth a considering | 22:51 |
| clarkb | *consideration | 22:51 |
| *** heyongli has quit IRC | 22:53 | |
| *** heyongli has joined #openstack-infra | 22:53 | |
| corvus | clarkb: replied | 22:53 |
| clarkb | ah ok, I think ws supports unicode to some degree and so you can get unicode straight out of some implementations or maybe I'm misremembering | 22:56 |
| *** eandersson_ is now known as eandersson | 22:59 | |
| clarkb | corvus: what are the other possible types of message if is_text is false? | 22:59 |
| clarkb | ah proper binary vs text as binary | 23:00 |
| *** hashar has quit IRC | 23:00 | |
| *** heyongli has quit IRC | 23:03 | |
| *** heyongli has joined #openstack-infra | 23:03 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Handle websocket client hangups better https://review.openstack.org/573034 | 23:06 |
| *** rajinir has quit IRC | 23:09 | |
| *** jesslampe has joined #openstack-infra | 23:11 | |
| *** aeng has joined #openstack-infra | 23:12 | |
| openstackgerrit | Merged openstack-infra/zuul master: Handle more than one websocket streamer at a time https://review.openstack.org/573023 | 23:12 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fix zuul-web sql connections https://review.openstack.org/572210 | 23:13 |
| *** heyongli has quit IRC | 23:13 | |
| *** heyongli has joined #openstack-infra | 23:14 | |
| *** heyongli has quit IRC | 23:24 | |
| *** heyongli has joined #openstack-infra | 23:24 | |
| *** iyamahat_ has joined #openstack-infra | 23:25 | |
| *** iyamahat has quit IRC | 23:29 | |
| john_studarus | Should http://nodepool.openstack.org/ return real data? It's just showing an empty directory listing right now. Is there a list of all the nodes being run by nodepool anywhere? | 23:31 |
| *** tosky has quit IRC | 23:31 | |
| clarkb | john_studarus: that node is only a zookeeper server at this point, try http://nl01.openstack.org instead | 23:31 |
| clarkb | heh apache default page we should clean that up | 23:31 |
| clarkb | ianw: ^where is our node listing or do we not do that? | 23:32 |
| *** hongbin has quit IRC | 23:33 | |
| clarkb | john_studarus: http://grafana.openstack.org/dashboard/db/nodepool that may be interesting too | 23:33 |
| ianw | clarkb / john_studarus : we don't expose the active node list | 23:33 |
| ianw | we show the current dib images (dib-image-list) and the uploaded images to providers (image-list) but not all nodes | 23:33 |
| *** heyongli has quit IRC | 23:34 | |
| *** heyongli has joined #openstack-infra | 23:34 | |
| john_studarus | thanks | 23:34 |
| corvus | clarkb, fungi: 572210 and 573034 are both ready to merge; if you could approve them asap, we can revert back to running zuul-web from master | 23:36 |
| ianw | urgh, why does show-paren-mode not work in yaml | 23:39 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: zuul grafana: fix load average graph https://review.openstack.org/573038 | 23:41 |
| *** camunoz has quit IRC | 23:42 | |
| ianw | clarkb: re that nodepool page too, it wasn't supposed to return json to browsers. i need to look at the rules for all that again. it's using requests mime preferences iirc | 23:43 |
| *** heyongli has quit IRC | 23:44 | |
| *** heyongli has joined #openstack-infra | 23:44 | |
| *** sthussey has quit IRC | 23:45 | |
| *** lifeless has quit IRC | 23:46 | |
| ianw | ooohhh, i wonder if our proxy-via-apache fiddles request handlers before nodepool sees it? | 23:46 |
| *** lifeless has joined #openstack-infra | 23:46 | |
| *** r-daneel has quit IRC | 23:47 | |
| *** dpawlik has joined #openstack-infra | 23:48 | |
| clarkb | corvus: they should be headed to the gate now | 23:49 |
| corvus | w00t | 23:50 |
| *** dpawlik has quit IRC | 23:53 | |
| *** edmondsw has joined #openstack-infra | 23:54 | |
| *** heyongli has quit IRC | 23:54 | |
| *** heyongli has joined #openstack-infra | 23:55 | |
| *** edmondsw has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!