| openstackgerrit | Samuel Cassiba proposed openstack-infra/project-config master: Chef: adds basic multinode integration tests https://review.openstack.org/446294 | 00:02 |
|---|---|---|
| openstackgerrit | Merged openstack-infra/devstack-gate master: Keep working to clean up PROJECTS list https://review.openstack.org/446623 | 00:04 |
| *** claudiub has quit IRC | 00:09 | |
| *** ssbarnea has quit IRC | 00:09 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Revert "Configure regional mirrors for our jobs" https://review.openstack.org/446786 | 00:13 |
| *** erikmwilson has quit IRC | 00:13 | |
| *** ihrachys has quit IRC | 00:13 | |
| *** erikmwilson has joined #openstack-infra | 00:16 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create run-cover role https://review.openstack.org/441332 | 00:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create zuul_workspace_root job variable https://review.openstack.org/441441 | 00:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Organize playbooks folder https://review.openstack.org/441547 | 00:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Rename prepare-workspace role to bootstrap https://review.openstack.org/441440 | 00:18 |
| *** tosky has quit IRC | 00:18 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add run-docs role and tox-docs job https://review.openstack.org/441345 | 00:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add net-info to bootstrap role https://review.openstack.org/441617 | 00:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add revoke-sudo role and update tox jobs https://review.openstack.org/441467 | 00:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-tarball job https://review.openstack.org/441609 | 00:18 |
| *** zz_dimtruck is now known as dimtruck | 00:19 | |
| *** kzaitsev_mb has joined #openstack-infra | 00:20 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Update Common Classification Framework meeting https://review.openstack.org/441068 | 00:22 |
| *** kzaitsev_mb has quit IRC | 00:25 | |
| *** Jeffrey4l has quit IRC | 00:25 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Updating Meeting Information for UC https://review.openstack.org/407856 | 00:26 |
| *** wolverineav has quit IRC | 00:28 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Bump nl01.o.o to 10 servers https://review.openstack.org/446791 | 00:28 |
| *** wolverineav has joined #openstack-infra | 00:29 | |
| *** kgiusti has quit IRC | 00:33 | |
| *** wolverineav has quit IRC | 00:33 | |
| *** csomerville has joined #openstack-infra | 00:35 | |
| *** cody-somerville has quit IRC | 00:35 | |
| *** amotoki has joined #openstack-infra | 00:37 | |
| *** gouthamr has joined #openstack-infra | 00:38 | |
| *** amotoki has quit IRC | 00:41 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: fallback to old method on stable branches https://review.openstack.org/445461 | 00:42 |
| *** ym200 has joined #openstack-infra | 00:42 | |
| *** esikachev has joined #openstack-infra | 00:46 | |
| *** _Cyclone_ has quit IRC | 00:46 | |
| *** esikachev has quit IRC | 00:50 | |
| *** esikachev has joined #openstack-infra | 00:55 | |
| *** Julien-zte has joined #openstack-infra | 00:56 | |
| *** john-davidge has joined #openstack-infra | 00:56 | |
| *** rkukura has joined #openstack-infra | 00:57 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Port SQLAlchemy reporter to v3 driver structure https://review.openstack.org/442114 | 00:58 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Remove more swift configurations https://review.openstack.org/446056 | 00:58 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Move alembic into sql driver https://review.openstack.org/442124 | 00:58 |
| *** rkukura has quit IRC | 00:58 | |
| *** esikachev has quit IRC | 01:00 | |
| *** MasterOfBugs has quit IRC | 01:01 | |
| *** john-davidge has quit IRC | 01:01 | |
| *** esikachev has joined #openstack-infra | 01:02 | |
| *** Julien-zte has quit IRC | 01:06 | |
| *** Apoorva has quit IRC | 01:06 | |
| *** Julien-zte has joined #openstack-infra | 01:08 | |
| *** esikachev has quit IRC | 01:08 | |
| *** esikachev has joined #openstack-infra | 01:09 | |
| *** ym200 has quit IRC | 01:12 | |
| *** armax has quit IRC | 01:13 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Port SQLAlchemy reporter to v3 driver structure https://review.openstack.org/442114 | 01:13 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Remove more swift configurations https://review.openstack.org/446056 | 01:13 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Move alembic into sql driver https://review.openstack.org/442124 | 01:13 |
| *** esikachev has quit IRC | 01:13 | |
| *** liujiong has joined #openstack-infra | 01:13 | |
| *** baoli has joined #openstack-infra | 01:14 | |
| *** rkukura has joined #openstack-infra | 01:16 | |
| *** sshnaidm is now known as sshnaidm|off | 01:19 | |
| *** kzaitsev_mb has joined #openstack-infra | 01:21 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Run dib-run-parts out of /tmp https://review.openstack.org/446769 | 01:23 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't provide dib-run-parts https://review.openstack.org/446285 | 01:23 |
| openstackgerrit | Jamie Lennox proposed openstack-infra/zuul feature/zuulv3: Re-add the ability to set username on zuul-executor https://review.openstack.org/446308 | 01:24 |
| *** tphummel has quit IRC | 01:26 | |
| *** Julien-zte has quit IRC | 01:26 | |
| *** vhosakot has joined #openstack-infra | 01:28 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder master: Add note regarding a bug with !include-raw-escape https://review.openstack.org/446773 | 01:31 |
| *** ym200 has joined #openstack-infra | 01:33 | |
| *** ym200 has quit IRC | 01:38 | |
| *** Sukhdev has quit IRC | 01:40 | |
| *** funzo has joined #openstack-infra | 01:41 | |
| *** amotoki has joined #openstack-infra | 01:45 | |
| *** funzo has quit IRC | 01:45 | |
| *** Julien-zte has joined #openstack-infra | 01:46 | |
| *** esikachev has joined #openstack-infra | 01:50 | |
| *** amotoki has quit IRC | 01:50 | |
| *** Jeffrey4l has joined #openstack-infra | 01:53 | |
| *** esikachev has quit IRC | 01:54 | |
| *** jamielennox is now known as jamielennox|away | 01:56 | |
| *** rfolco_ has joined #openstack-infra | 01:57 | |
| *** rfolco_ has quit IRC | 01:57 | |
| *** jamielennox|away is now known as jamielennox | 02:01 | |
| *** dimtruck is now known as zz_dimtruck | 02:06 | |
| *** knangia has quit IRC | 02:11 | |
| *** ym200 has joined #openstack-infra | 02:11 | |
| *** ym200 has quit IRC | 02:11 | |
| *** erikmwilson has quit IRC | 02:11 | |
| *** erikmwilson has joined #openstack-infra | 02:11 | |
| *** ym200 has joined #openstack-infra | 02:12 | |
| *** ym200 has quit IRC | 02:12 | |
| *** esikachev has joined #openstack-infra | 02:13 | |
| *** ym200 has joined #openstack-infra | 02:14 | |
| *** Jeffrey4l has quit IRC | 02:14 | |
| *** Jeffrey4l has joined #openstack-infra | 02:14 | |
| *** esikachev has quit IRC | 02:19 | |
| *** esikachev has joined #openstack-infra | 02:20 | |
| *** masber has joined #openstack-infra | 02:26 | |
| *** esikachev has quit IRC | 02:28 | |
| *** esikachev has joined #openstack-infra | 02:29 | |
| *** vhosakot has quit IRC | 02:32 | |
| *** vhosakot has joined #openstack-infra | 02:32 | |
| *** esikachev has quit IRC | 02:34 | |
| *** igormarnat has quit IRC | 02:34 | |
| *** igormarnat has joined #openstack-infra | 02:34 | |
| *** yamahata has quit IRC | 02:35 | |
| *** winggundamth has joined #openstack-infra | 02:37 | |
| *** liujiong_lj has joined #openstack-infra | 02:39 | |
| *** Jeffrey4l has quit IRC | 02:41 | |
| *** liujiong has quit IRC | 02:41 | |
| *** Jeffrey4l has joined #openstack-infra | 02:41 | |
| *** funzo has joined #openstack-infra | 02:42 | |
| *** funzo has quit IRC | 02:46 | |
| *** esikachev has joined #openstack-infra | 02:48 | |
| *** liujiong_lj is now known as liujiong | 02:48 | |
| *** Wei_Liu has quit IRC | 02:49 | |
| *** Wei_Liu has joined #openstack-infra | 02:50 | |
| *** hongbin_ has joined #openstack-infra | 02:50 | |
| *** esikachev has quit IRC | 02:52 | |
| *** gildub_ has joined #openstack-infra | 02:55 | |
| *** esikachev has joined #openstack-infra | 02:56 | |
| *** gildub has quit IRC | 02:56 | |
| *** john-davidge has joined #openstack-infra | 02:57 | |
| *** ggnel_t has joined #openstack-infra | 02:59 | |
| *** knangia has joined #openstack-infra | 03:00 | |
| *** esikachev has quit IRC | 03:00 | |
| *** gouthamr has quit IRC | 03:01 | |
| *** esikachev has joined #openstack-infra | 03:01 | |
| *** john-davidge has quit IRC | 03:02 | |
| *** yuanying has quit IRC | 03:03 | |
| *** erikmwilson has quit IRC | 03:03 | |
| *** esikachev has quit IRC | 03:06 | |
| *** erikmwilson has joined #openstack-infra | 03:08 | |
| *** esikachev has joined #openstack-infra | 03:13 | |
| *** ihrachys has joined #openstack-infra | 03:14 | |
| *** sree has joined #openstack-infra | 03:14 | |
| *** ihrachys has quit IRC | 03:15 | |
| *** sree_ has joined #openstack-infra | 03:16 | |
| *** sree has quit IRC | 03:17 | |
| *** sree_ is now known as Guest86435 | 03:17 | |
| *** esikachev has quit IRC | 03:18 | |
| *** ihrachys has joined #openstack-infra | 03:22 | |
| *** rwsu has joined #openstack-infra | 03:23 | |
| *** ihrachys has quit IRC | 03:23 | |
| *** chlong has quit IRC | 03:25 | |
| *** erikmwilson has quit IRC | 03:25 | |
| *** Julien-zte has quit IRC | 03:26 | |
| openstackgerrit | Samuel Cassiba proposed openstack-infra/project-config master: Chef: adds basic multinode integration tests https://review.openstack.org/446294 | 03:27 |
| *** zz_dimtruck is now known as dimtruck | 03:27 | |
| *** Julien-zte has joined #openstack-infra | 03:28 | |
| *** Julien-zte has quit IRC | 03:28 | |
| openstackgerrit | Cao Xuan Hoang proposed openstack-infra/project-config master: Add neutron-fwaas docs pub job to zuul layout https://review.openstack.org/446835 | 03:33 |
| *** adriant has joined #openstack-infra | 03:34 | |
| *** funzo has joined #openstack-infra | 03:42 | |
| *** nicolasbock has quit IRC | 03:43 | |
| *** dhajare has joined #openstack-infra | 03:43 | |
| *** vhosakot_ has joined #openstack-infra | 03:44 | |
| *** vhosakot has quit IRC | 03:46 | |
| *** amotoki has joined #openstack-infra | 03:46 | |
| *** ym200 has quit IRC | 03:47 | |
| *** funzo has quit IRC | 03:47 | |
| *** dkehn has quit IRC | 03:48 | |
| *** ijw has quit IRC | 03:50 | |
| *** ijw has joined #openstack-infra | 03:50 | |
| *** amotoki has quit IRC | 03:51 | |
| *** ijw has quit IRC | 03:52 | |
| *** markvoelker_ has quit IRC | 03:53 | |
| *** john-davidge has joined #openstack-infra | 03:58 | |
| *** ym200 has joined #openstack-infra | 03:58 | |
| *** ym200 has quit IRC | 03:59 | |
| *** dkehn has joined #openstack-infra | 04:00 | |
| *** vsaienko has quit IRC | 04:00 | |
| *** vsaienko has joined #openstack-infra | 04:02 | |
| *** john-davidge has quit IRC | 04:02 | |
| *** tinwood has quit IRC | 04:05 | |
| *** tinwood has joined #openstack-infra | 04:06 | |
| *** yamahata has joined #openstack-infra | 04:14 | |
| *** vsaienko has quit IRC | 04:17 | |
| *** alex_xu has quit IRC | 04:17 | |
| *** kzaitsev_mb has quit IRC | 04:18 | |
| *** dhajare has quit IRC | 04:18 | |
| *** Daisy has joined #openstack-infra | 04:19 | |
| *** xarses has joined #openstack-infra | 04:20 | |
| *** Daisy has quit IRC | 04:20 | |
| *** vsaienko has joined #openstack-infra | 04:21 | |
| *** xarses_ has quit IRC | 04:21 | |
| *** alex_xu has joined #openstack-infra | 04:23 | |
| openstackgerrit | Jamie Lennox proposed openstack-infra/nodepool feature/zuulv3: Split webapp into its own nodepool application https://review.openstack.org/445675 | 04:27 |
| *** gongysh has joined #openstack-infra | 04:27 | |
| openstackgerrit | Jamie Lennox proposed openstack-infra/nodepool feature/zuulv3: Refactor nodepool apps into base app https://review.openstack.org/445674 | 04:27 |
| *** psachin has joined #openstack-infra | 04:29 | |
| openstackgerrit | Cao Xuan Hoang proposed openstack-infra/project-config master: Add neutron-fwaas docs pub job to zuul layout https://review.openstack.org/446835 | 04:33 |
| *** dimtruck is now known as zz_dimtruck | 04:35 | |
| *** vsaienko has quit IRC | 04:38 | |
| *** hongbin_ has quit IRC | 04:39 | |
| openstackgerrit | Jamie Lennox proposed openstack-infra/nodepool feature/zuulv3: Allow loading logging config from yaml https://review.openstack.org/445656 | 04:41 |
| *** vsaienko has joined #openstack-infra | 04:42 | |
| *** funzo has joined #openstack-infra | 04:43 | |
| *** funzo has quit IRC | 04:47 | |
| *** ihrachys has joined #openstack-infra | 04:49 | |
| *** esikachev has joined #openstack-infra | 04:49 | |
| *** ihrachys has quit IRC | 04:50 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:52 | |
| *** bhavik1 has joined #openstack-infra | 04:53 | |
| *** cody-somerville has joined #openstack-infra | 04:54 | |
| *** csomerville has quit IRC | 04:54 | |
| *** yuanying has joined #openstack-infra | 04:56 | |
| *** vsaienko has quit IRC | 04:56 | |
| *** kzaitsev_mb has quit IRC | 04:56 | |
| *** csomerville has joined #openstack-infra | 04:58 | |
| *** cody-somerville has quit IRC | 04:58 | |
| *** vsaienko has joined #openstack-infra | 05:02 | |
| *** asilenkov has quit IRC | 05:02 | |
| *** katyafervent_awa has quit IRC | 05:03 | |
| *** katyafervent_awa has joined #openstack-infra | 05:04 | |
| *** asilenkov has joined #openstack-infra | 05:05 | |
| *** dhajare has joined #openstack-infra | 05:08 | |
| *** csomerville has quit IRC | 05:12 | |
| *** bhavik1 has quit IRC | 05:15 | |
| *** vsaienko has quit IRC | 05:15 | |
| *** Wei_Liu has quit IRC | 05:19 | |
| *** Wei_Liu has joined #openstack-infra | 05:19 | |
| *** vsaienko has joined #openstack-infra | 05:22 | |
| *** vikrant has joined #openstack-infra | 05:24 | |
| openstackgerrit | Cao Xuan Hoang proposed openstack-infra/project-config master: Add neutron-fwaas docs pub job to zuul layout https://review.openstack.org/446835 | 05:29 |
| *** sree has joined #openstack-infra | 05:30 | |
| *** Guest86435 has quit IRC | 05:34 | |
| *** erlon has quit IRC | 05:35 | |
| *** vsaienko has quit IRC | 05:39 | |
| *** nadya has joined #openstack-infra | 05:41 | |
| *** vsaienko has joined #openstack-infra | 05:43 | |
| *** nadya has quit IRC | 05:46 | |
| *** dingyichen has joined #openstack-infra | 05:47 | |
| *** Wei_Liu1 has joined #openstack-infra | 05:49 | |
| *** Wei_Liu has quit IRC | 05:50 | |
| *** Wei_Liu1 is now known as Wei_Liu | 05:50 | |
| *** ijw has joined #openstack-infra | 05:51 | |
| *** ijw_ has joined #openstack-infra | 05:54 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:55 | |
| *** ijw_ has quit IRC | 05:56 | |
| *** ijw_ has joined #openstack-infra | 05:56 | |
| *** ijw has quit IRC | 05:58 | |
| *** john-davidge has joined #openstack-infra | 05:59 | |
| *** vsaienko has quit IRC | 05:59 | |
| *** ijw_ has quit IRC | 06:01 | |
| *** Jeffrey4l has quit IRC | 06:02 | |
| *** vsaienko has joined #openstack-infra | 06:03 | |
| *** Julien-zte has joined #openstack-infra | 06:03 | |
| *** john-davidge has quit IRC | 06:03 | |
| *** jascott1- is now known as jascott1 | 06:06 | |
| *** Julien-zte has quit IRC | 06:11 | |
| *** tuanluong has joined #openstack-infra | 06:11 | |
| *** Julien-zte has joined #openstack-infra | 06:11 | |
| *** Jeffrey4l has joined #openstack-infra | 06:17 | |
| openstackgerrit | Merged openstack-infra/project-config master: switch releases repo to gate on python 3.5 https://review.openstack.org/441459 | 06:19 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Run dib-run-parts out of /tmp https://review.openstack.org/446769 | 06:19 |
| *** zhurong has joined #openstack-infra | 06:21 | |
| *** sree has quit IRC | 06:26 | |
| *** vsaienko has quit IRC | 06:26 | |
| *** camunoz has quit IRC | 06:30 | |
| *** adriant has quit IRC | 06:34 | |
| *** ssbarnea has joined #openstack-infra | 06:38 | |
| *** gildub_ has quit IRC | 06:38 | |
| *** pgadiya has joined #openstack-infra | 06:42 | |
| *** ssbarnea has quit IRC | 06:43 | |
| *** funzo has joined #openstack-infra | 06:45 | |
| *** yolanda has joined #openstack-infra | 06:45 | |
| *** pgadiya has left #openstack-infra | 06:45 | |
| *** funzo has quit IRC | 06:49 | |
| *** sflanigan is now known as sflanigan_afk | 06:51 | |
| *** ssbarnea has joined #openstack-infra | 06:52 | |
| *** andreas_s has joined #openstack-infra | 06:53 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 06:56 | |
| *** ssbarnea has quit IRC | 06:57 | |
| *** claudiub has joined #openstack-infra | 07:01 | |
| openstackgerrit | Cao Xuan Hoang proposed openstack-infra/project-config master: Add neutron-vpnaas docs pub job to zuul layout https://review.openstack.org/446835 | 07:01 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: oooq quickstart: Add STABLE_RELEASE env variable to subnodes https://review.openstack.org/446746 | 07:05 |
| *** gongysh has quit IRC | 07:07 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/tripleo-ci master: [TEST JOB] test tempest-12.2.0 for Mitaka https://review.openstack.org/446868 | 07:08 |
| *** gongysh has joined #openstack-infra | 07:10 | |
| *** slaweq has quit IRC | 07:10 | |
| *** knangia has quit IRC | 07:11 | |
| *** alexchadin has joined #openstack-infra | 07:11 | |
| *** markus_z has joined #openstack-infra | 07:12 | |
| *** pepijn has joined #openstack-infra | 07:13 | |
| pepijn | i am facing an issue in gerrit and three changes having the same change-id, who should i contact to get this fixed? | 07:14 |
| *** kzaitsev_mb has quit IRC | 07:16 | |
| *** jaosorior has joined #openstack-infra | 07:16 | |
| *** e0ne has joined #openstack-infra | 07:16 | |
| *** GregHouse has quit IRC | 07:17 | |
| *** Julien-zte has quit IRC | 07:19 | |
| *** JayF has quit IRC | 07:20 | |
| *** mrhillsman has quit IRC | 07:20 | |
| *** nadya has joined #openstack-infra | 07:21 | |
| *** jbernard has quit IRC | 07:23 | |
| *** jbernard has joined #openstack-infra | 07:23 | |
| *** GregHouse has joined #openstack-infra | 07:24 | |
| *** vhosakot_ has quit IRC | 07:25 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab https://review.openstack.org/444586 | 07:25 |
| *** zz_dimtruck is now known as dimtruck | 07:26 | |
| *** nadya_ has joined #openstack-infra | 07:27 | |
| *** nadya has quit IRC | 07:29 | |
| *** ccamacho has joined #openstack-infra | 07:29 | |
| *** JayF has joined #openstack-infra | 07:33 | |
| *** EricGonczer_ has quit IRC | 07:33 | |
| *** liujiong has quit IRC | 07:33 | |
| *** mrhillsman has joined #openstack-infra | 07:33 | |
| *** tesseract has joined #openstack-infra | 07:34 | |
| *** EricGonczer_ has joined #openstack-infra | 07:34 | |
| *** vsaienko has joined #openstack-infra | 07:35 | |
| *** dimtruck is now known as zz_dimtruck | 07:36 | |
| claudiub | AJaeger: hi. | 07:38 |
| *** e0ne has quit IRC | 07:40 | |
| *** pcaruana has joined #openstack-infra | 07:43 | |
| *** Julien-zte has joined #openstack-infra | 07:45 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 07:45 |
| *** funzo has joined #openstack-infra | 07:46 | |
| *** amotoki has joined #openstack-infra | 07:48 | |
| *** sree has joined #openstack-infra | 07:48 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:48 | |
| *** funzo has quit IRC | 07:50 | |
| *** vsaienko has quit IRC | 07:51 | |
| *** amotoki has quit IRC | 07:52 | |
| *** sree has quit IRC | 07:52 | |
| *** ssbarnea has joined #openstack-infra | 07:53 | |
| *** matrohon has joined #openstack-infra | 07:54 | |
| *** ssbarnea has quit IRC | 07:58 | |
| *** john-davidge has joined #openstack-infra | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** Julien-zte has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** john-davidge has quit IRC | 08:04 | |
| AJaeger | claudiub: good morning. Feel free to just ask here in the round and others wil answer | 08:05 |
| *** rossella_s has joined #openstack-infra | 08:05 | |
| AJaeger | pepijn: which changes? | 08:05 |
| AJaeger | pepijn: and what problem? | 08:05 |
| claudiub | AJaeger: sure. anyways, I wanted to ask to be added to the python-hnv-core / python-hnv-release teams, the repo got approved a few days ago. | 08:07 |
| claudiub | https://review.openstack.org/#/admin/groups/1726,members & https://review.openstack.org/#/admin/groups/1727,members | 08:07 |
| AJaeger | claudiub: you need an infra admin for that - and I'm not one. I cannot help. PLease reference the change that created those as well and I hope somebody picks it up. | 08:08 |
| *** beslemon has joined #openstack-infra | 08:09 | |
| claudiub | ah, i see. the change is: https://review.openstack.org/#/c/441810/ | 08:09 |
| openstackgerrit | Merged openstack-infra/project-config master: Revert "Add a non-voting job testing ironic with new "ipmi" driver" https://review.openstack.org/446723 | 08:09 |
| *** beslemon_ has joined #openstack-infra | 08:11 | |
| openstackgerrit | Merged openstack-infra/project-config master: Fix OSC jobs local config https://review.openstack.org/446504 | 08:12 |
| openstackgerrit | Merged openstack-infra/project-config master: Add Kolla failure rate graphs https://review.openstack.org/446697 | 08:12 |
| openstackgerrit | Merged openstack-infra/project-config master: tripleo: run scenario001 when touching cinder files https://review.openstack.org/444533 | 08:13 |
| strigazi | gerrit is very slow for me. I do revied -d and I wait for minutes. Has anyone else the same issue? | 08:13 |
| strigazi | I started to have this problem this week | 08:14 |
| *** beslemon has quit IRC | 08:14 | |
| *** ssbarnea has joined #openstack-infra | 08:15 | |
| *** Julien-zte has joined #openstack-infra | 08:15 | |
| *** chem has quit IRC | 08:16 | |
| *** chem has joined #openstack-infra | 08:16 | |
| AJaeger | strigazi: gerrit works just fine for me. If it's slow, it's slow for everyone and only for a short time (until a restart). | 08:16 |
| AJaeger | so, if this is ongoing for some days, it's not the usual problem ;) | 08:17 |
| *** hashar has joined #openstack-infra | 08:17 | |
| *** florianf has joined #openstack-infra | 08:18 | |
| openstackgerrit | Merged openstack-infra/project-config master: experimental multinode job for sahara https://review.openstack.org/442382 | 08:21 |
| *** apetrich has quit IRC | 08:21 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove non-voting glare gates from murano. https://review.openstack.org/445626 | 08:23 |
| pepijn | AJaeger: changes 445486, 445489, 445520, change-id I356912a39e1cb08ac58c1208f27d1e93b7cad2fe | 08:23 |
| pepijn | AJaeger: i marked 445486 and 445489 as abandoned | 08:23 |
| openstackgerrit | Merged openstack-infra/project-config master: Voting functional py3x octavia test https://review.openstack.org/446148 | 08:24 |
| AJaeger | pepijn: those are on different branches. So, that is perfectly fine. What is your problem then? | 08:25 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: oooq quickstart: Add STABLE_RELEASE env variable to subnodes https://review.openstack.org/446746 | 08:26 |
| *** s-shiono has quit IRC | 08:26 | |
| AJaeger | pepijn: read the first paragraph of https://docs.openstack.org/infra/manual/developers.html#understanding-changes-and-patch-sets | 08:27 |
| *** zhurong has quit IRC | 08:27 | |
| *** dizquierdo has joined #openstack-infra | 08:31 | |
| pepijn | AJaeger: the problem is 'git review' giving me [remote rejected] ... I356912a39e1cb08ac58c1208f27d1e93b7cad2fe has duplicates | 08:31 |
| *** ym200 has joined #openstack-infra | 08:31 | |
| AJaeger | that is for the abandoned changes only | 08:32 |
| AJaeger | not sure how you manged that. | 08:32 |
| *** kzaitsev_mb has quit IRC | 08:32 | |
| AJaeger | the tuploe Change-ID, branch, project should be unique and you broke that with your one change. | 08:33 |
| *** apetrich has joined #openstack-infra | 08:33 | |
| AJaeger | there are all on master? | 08:33 |
| AJaeger | How did you manage that at all? | 08:33 |
| pepijn | AJaeger: i am not sure either, but it seemed the remote/network was experiencing some problems at the time i submitted, it responed with timeouts | 08:33 |
| AJaeger | pepijn: now I see - it's all three on master | 08:34 |
| AJaeger | pepijn: this needs some further help from the admins. Let me leave a message... | 08:34 |
| pepijn | thanks | 08:34 |
| AJaeger | fungi, clarkb, could either of you check pepijn's problem: https://review.openstack.org/#/q/I356912a39e1cb08ac58c1208f27d1e93b7cad2fe,n,z is three changes - all on master and same project. Somehow gerrit broke this. What's the best way to fix this? Abandon all three and start a new change with new change-id? | 08:35 |
| AJaeger | pepijn: both should be around later today (US time) | 08:35 |
| *** ym200 has quit IRC | 08:36 | |
| AJaeger | so, best to wait, they'll normally answer once they're around when reading backscroll | 08:36 |
| pepijn | AJaeger: ack, thanks for your time | 08:36 |
| pepijn | i have been thinking to submit it as a new change, but it would actually be nice to keep the history on the last change, as well as the +2 review ;) | 08:37 |
| *** amoralej|off is now known as amoralej | 08:38 | |
| *** sree has joined #openstack-infra | 08:39 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config master: telemetry: switch to default driver https://review.openstack.org/444390 | 08:40 |
| AJaeger | pepijn: let's wait what they suggest... | 08:41 |
| *** aarefiev_afk is now known as aarefiev | 08:43 | |
| *** funzo has joined #openstack-infra | 08:46 | |
| *** ym200 has joined #openstack-infra | 08:46 | |
| *** ym200 has quit IRC | 08:51 | |
| *** funzo has quit IRC | 08:51 | |
| *** dkehn has quit IRC | 08:52 | |
| *** dkehn has joined #openstack-infra | 08:53 | |
| *** dizquierdo has quit IRC | 08:54 | |
| *** yamamoto has quit IRC | 08:57 | |
| *** shardy has joined #openstack-infra | 09:01 | |
| *** bhavik1 has joined #openstack-infra | 09:04 | |
| *** dtantsur|sick is now known as dtantsur | 09:10 | |
| *** bhavik1 has quit IRC | 09:10 | |
| *** john-davidge has joined #openstack-infra | 09:13 | |
| *** chem has quit IRC | 09:13 | |
| *** saibarspeis has joined #openstack-infra | 09:13 | |
| *** jesusaur has quit IRC | 09:13 | |
| *** jesusaur has joined #openstack-infra | 09:15 | |
| *** david-lyle_ has joined #openstack-infra | 09:18 | |
| *** david-lyle has quit IRC | 09:18 | |
| strigazi | AJaeger I think I suffer from something like this: https://phabricator.wikimedia.org/T103990 git-upload-pack takes for ever | 09:19 |
| strigazi | maybe we load gerrit because of the above. | 09:20 |
| *** neiljerram has joined #openstack-infra | 09:24 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 09:26 | |
| *** Julien-zte has quit IRC | 09:29 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:29 | |
| *** dizquierdo has joined #openstack-infra | 09:30 | |
| *** chem has joined #openstack-infra | 09:34 | |
| *** yamamoto has joined #openstack-infra | 09:35 | |
| *** yamamoto has quit IRC | 09:38 | |
| *** yamamoto has joined #openstack-infra | 09:38 | |
| *** xarses_ has joined #openstack-infra | 09:41 | |
| *** yamamoto has quit IRC | 09:42 | |
| *** xarses has quit IRC | 09:45 | |
| *** funzo has joined #openstack-infra | 09:47 | |
| *** amotoki has joined #openstack-infra | 09:48 | |
| *** funzo has quit IRC | 09:52 | |
| *** amotoki has quit IRC | 09:53 | |
| *** e0ne has joined #openstack-infra | 09:54 | |
| *** nadya_ has quit IRC | 09:56 | |
| *** pahuang has quit IRC | 09:56 | |
| *** mriedem has quit IRC | 09:58 | |
| *** mriedem has joined #openstack-infra | 09:58 | |
| openstackgerrit | Thomas Herve proposed openstack-infra/project-config master: Swith Heat amqp job to Ubuntu https://review.openstack.org/446929 | 10:02 |
| *** nadya has joined #openstack-infra | 10:03 | |
| *** mriedem has quit IRC | 10:03 | |
| *** rcernin has joined #openstack-infra | 10:04 | |
| *** tosky has joined #openstack-infra | 10:05 | |
| *** pbourke has quit IRC | 10:05 | |
| *** pbourke has joined #openstack-infra | 10:05 | |
| *** alexchadin has quit IRC | 10:09 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP oooq quickstart: Add STABLE_RELEASE env variable to subnodes https://review.openstack.org/446746 | 10:10 |
| *** nicolasbock has joined #openstack-infra | 10:11 | |
| *** kzaitsev_mb has quit IRC | 10:12 | |
| *** andreww has joined #openstack-infra | 10:12 | |
| *** dhajare has quit IRC | 10:14 | |
| *** xarses_ has quit IRC | 10:16 | |
| openstackgerrit | Martin André proposed openstack-infra/project-config master: Move undercloud-containers job to check-tripleo-undercloud-jobs pipeline https://review.openstack.org/446940 | 10:17 |
| *** jianghuaw has quit IRC | 10:22 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 10:26 |
| *** dhajare has joined #openstack-infra | 10:30 | |
| *** saibarspeis has quit IRC | 10:37 | |
| *** john-davidge has quit IRC | 10:37 | |
| *** john-dav_ has joined #openstack-infra | 10:37 | |
| *** florianf has quit IRC | 10:38 | |
| *** yamamoto has joined #openstack-infra | 10:41 | |
| *** dhajare has quit IRC | 10:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix repositories setup https://review.openstack.org/446949 | 10:42 |
| *** tuanluong has quit IRC | 10:44 | |
| *** yuanying has quit IRC | 10:45 | |
| *** rcernin has quit IRC | 10:46 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/storyboard master: Increase project and project group name length limitation https://review.openstack.org/445965 | 10:48 |
| *** funzo has joined #openstack-infra | 10:48 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/storyboard master: Increase project and project group name length limitation https://review.openstack.org/445965 | 10:48 |
| *** florianf has joined #openstack-infra | 10:49 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/storyboard master: Increase project and project group name length limitation https://review.openstack.org/445965 | 10:51 |
| openstackgerrit | Jakub Libosvar proposed openstack-infra/project-config master: ovsdbapp: Add functional-nv job to check queue https://review.openstack.org/446953 | 10:52 |
| *** funzo has quit IRC | 10:53 | |
| *** jkilpatr has quit IRC | 10:53 | |
| *** yamahata has quit IRC | 10:54 | |
| *** john-dav_ has quit IRC | 10:54 | |
| *** dhajare has joined #openstack-infra | 10:55 | |
| *** jaosorior has quit IRC | 10:55 | |
| *** gongysh has quit IRC | 10:56 | |
| *** jaosorior has joined #openstack-infra | 10:56 | |
| AJaeger | sdague: is https://review.openstack.org/#/c/446698/ the right way forward? Are you deprecating DEVSTACK_LOCAL_CONFIG - or should I allow new useage in project-config? | 10:59 |
| *** rcarrillocruz has quit IRC | 11:00 | |
| *** john-davidge has joined #openstack-infra | 11:03 | |
| sdague | AJaeger: I think that's the right way forward | 11:04 |
| sdague | for single line stuff, using the var is probably fine | 11:04 |
| sdague | however, for multi line stuff, the new stanza is definitely prefered | 11:05 |
| sdague | so we don't have all those \n encoding bugs | 11:05 |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Add undercloud-containers job to cistatus https://review.openstack.org/446957 | 11:07 |
| AJaeger | Unfortunately for jobs that set up LOCAL_CONFIG with conditionals, it will be a bit harder to do. | 11:07 |
| *** kzaitsev_mb has joined #openstack-infra | 11:08 | |
| AJaeger | sdague: or do you have a good way for expanding the file? ^ | 11:12 |
| *** zhurong has joined #openstack-infra | 11:12 | |
| sdague | AJaeger: not really, I honestly think that project-config is the wrong place for conditionals | 11:15 |
| sdague | given that it's not testable before committed | 11:15 |
| sdague | plus, it also kind of means that jobs of the same name do different things | 11:16 |
| sdague | which... is weird | 11:16 |
| openstackgerrit | Jakub Libosvar proposed openstack-infra/project-config master: ovsdbapp: Add functional-nv job to check queue https://review.openstack.org/446953 | 11:17 |
| AJaeger | sdague, not really jobs of the same name - see http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/ceilometer.yaml#n30 . One template, depending on parameter the config is different | 11:18 |
| sdague | AJaeger: sure. Well, it's a limitation. At every point you could say things could be templates with conditionals, or 2 jobs | 11:23 |
| sdague | honestly, I think that using a name variable just to trigger a branch condition as less than ideal. Typically that was being used to fill out a project name or distro or branch that is a more fundamental concept | 11:24 |
| *** ym200 has joined #openstack-infra | 11:25 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP oooq quickstart: Add STABLE_RELEASE env variable to subnodes https://review.openstack.org/446746 | 11:25 |
| *** ym200 has quit IRC | 11:25 | |
| AJaeger | sdague: I see. Guess we'll have some more discussion about these, let's see how it involves. If you're fine with 446698, please put it onyour review queue. | 11:26 |
| *** jkilpatr has joined #openstack-infra | 11:26 | |
| *** ym200 has joined #openstack-infra | 11:27 | |
| sdague | AJaeger: +2 | 11:30 |
| sdague | AJaeger: so I'm not sure how all of this is going to evolve. I think the current complexity of some of these jobs can get quite dense. This is a conduit for getting a more straight forward set of variables into the devstack config during runtime | 11:32 |
| AJaeger | sdague: ok, thanks | 11:32 |
| sdague | we were definitely missing a concrete way to do that in the past, so I was committed to paving the way there so that every setting that people want to make in devstack runs don't require changing devstack-gate / devstack to just set a config option | 11:34 |
| *** ldnunes has joined #openstack-infra | 11:34 | |
| *** yuanying has joined #openstack-infra | 11:40 | |
| *** winggundamth has quit IRC | 11:40 | |
| *** kzaitsev_mb has quit IRC | 11:42 | |
| *** saibarspeis has joined #openstack-infra | 11:47 | |
| *** funzo has joined #openstack-infra | 11:49 | |
| *** amotoki has joined #openstack-infra | 11:49 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP oooq quickstart: Add STABLE_RELEASE env variable to subnodes https://review.openstack.org/446746 | 11:51 |
| *** funzo has quit IRC | 11:53 | |
| *** amotoki has quit IRC | 11:53 | |
| *** ijw has joined #openstack-infra | 11:54 | |
| *** neiljerram has quit IRC | 11:55 | |
| *** neiljerram has joined #openstack-infra | 11:58 | |
| *** ijw has quit IRC | 11:58 | |
| *** _Cyclone_ has joined #openstack-infra | 11:58 | |
| *** alexchadin has joined #openstack-infra | 11:59 | |
| *** ijw_ has joined #openstack-infra | 12:00 | |
| *** jaosorior is now known as jaosorior_brb | 12:01 | |
| *** Hal has quit IRC | 12:01 | |
| *** rhallisey has joined #openstack-infra | 12:03 | |
| *** rhallisey has quit IRC | 12:04 | |
| *** shardy is now known as shardy_lunch | 12:04 | |
| *** ijw_ has quit IRC | 12:04 | |
| *** ccamacho is now known as ccamacho|lunch | 12:04 | |
| *** nadya has quit IRC | 12:04 | |
| rm_work | ianw: interesting debate on https://review.openstack.org/#/c/446139/ | 12:06 |
| *** aysyd has joined #openstack-infra | 12:06 | |
| rm_work | ianw: do you really not feel that a co-gate would be useful for both octavia AND dib? | 12:06 |
| rm_work | I feel like being able to see direct feedback about how patches affect real downstream projects would be a positive thing | 12:07 |
| *** rossella_s has quit IRC | 12:11 | |
| *** dprince has joined #openstack-infra | 12:12 | |
| *** rossella_s has joined #openstack-infra | 12:12 | |
| *** vsaienko has joined #openstack-infra | 12:13 | |
| *** sflanigan_afk has quit IRC | 12:13 | |
| *** aglarendil has quit IRC | 12:21 | |
| *** aglarendil has joined #openstack-infra | 12:21 | |
| *** zaro has quit IRC | 12:21 | |
| *** zaro has joined #openstack-infra | 12:24 | |
| *** esikachev has quit IRC | 12:27 | |
| *** wolverineav has joined #openstack-infra | 12:30 | |
| *** ym200 has quit IRC | 12:30 | |
| *** vsaienko has quit IRC | 12:30 | |
| *** nadya has joined #openstack-infra | 12:31 | |
| *** gordc has joined #openstack-infra | 12:31 | |
| *** tphummel has joined #openstack-infra | 12:32 | |
| mnaser | morning mordred -- would you happen to know anything about shade failing to install on ubuntu xenial? | 12:33 |
| mnaser | http://logs.openstack.org/45/446645/3/check/gate-kolla-dsvm-build-ubuntu-source-ubuntu-xenial/491986d/console.html#_2017-03-17_12_14_44_932837 | 12:33 |
| *** erlon has joined #openstack-infra | 12:33 | |
| mnaser | > TypeError: __init__() got an unexpected keyword argument 'encoding' .. seems to be related to html5lib? forgive the poorly formatter errors :( | 12:33 |
| *** wolverineav has quit IRC | 12:34 | |
| *** markvoelker has joined #openstack-infra | 12:35 | |
| openstackgerrit | Jakub Libosvar proposed openstack-infra/project-config master: ovsdbapp: Add functional job to check queue https://review.openstack.org/446953 | 12:37 |
| mnaser | http://paste.openstack.org/show/603120/ | 12:38 |
| mnaser | looking at a bit more sane of a traceback.. it looks like a pip issue? | 12:38 |
| *** kzaitsev_mb has joined #openstack-infra | 12:38 | |
| openstackgerrit | Jordan Pittier proposed openstack-infra/devstack-gate master: Don't run nova-cert by default https://review.openstack.org/446986 | 12:39 |
| *** tphummel has quit IRC | 12:39 | |
| *** trown|outtypewww is now known as trown | 12:39 | |
| *** rlandy has joined #openstack-infra | 12:39 | |
| *** ym200 has joined #openstack-infra | 12:39 | |
| *** fandi has joined #openstack-infra | 12:39 | |
| *** ym200 has quit IRC | 12:40 | |
| *** ym200 has joined #openstack-infra | 12:41 | |
| vsaienk0 | infra team please help with the following issue: ironic-lib tempest jobs are failing with error that some projects are missing from PROJECTS variable http://logs.openstack.org/50/446950/2/check/gate-tempest-dsvm-ironic-lib-wholedisk-pxe_ipmitool-ubuntu-xenial/c7c7cad/logs/devstacklog.txt.gz#_2017-03-17_12_24_42_708 but console.log shows that they were set http://logs.openstack.org/50/446950/2/check/gate-tempest-dsvm-ironic-lib-wholedisk-pxe_ipmi | 12:42 |
| *** rafaels has joined #openstack-infra | 12:46 | |
| *** nadya has quit IRC | 12:47 | |
| *** felipemonteiro_ has joined #openstack-infra | 12:48 | |
| *** jaypipes is now known as leakypipes | 12:49 | |
| *** funzo_ has joined #openstack-infra | 12:49 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Refactor nodepool apps into base app https://review.openstack.org/445674 | 12:51 |
| *** rcarrillocruz has joined #openstack-infra | 12:51 | |
| *** sree_ has joined #openstack-infra | 12:52 | |
| *** sree_ is now known as Guest52417 | 12:52 | |
| *** sree has quit IRC | 12:54 | |
| *** funzo_ has quit IRC | 12:54 | |
| *** mriedem has joined #openstack-infra | 12:55 | |
| *** yamamoto has quit IRC | 12:55 | |
| *** sree has joined #openstack-infra | 12:55 | |
| *** yamamoto has joined #openstack-infra | 12:56 | |
| *** askb has quit IRC | 12:56 | |
| *** Guest52417 has quit IRC | 12:57 | |
| *** sree has quit IRC | 13:01 | |
| *** rhallisey has joined #openstack-infra | 13:01 | |
| *** sree has joined #openstack-infra | 13:02 | |
| *** psachin has quit IRC | 13:03 | |
| *** baoli has quit IRC | 13:03 | |
| *** mat128` has joined #openstack-infra | 13:04 | |
| *** esikachev has joined #openstack-infra | 13:04 | |
| *** sree has quit IRC | 13:06 | |
| *** sree has joined #openstack-infra | 13:06 | |
| *** dizquierdo has quit IRC | 13:07 | |
| *** mdrabe has joined #openstack-infra | 13:08 | |
| *** Goneri has joined #openstack-infra | 13:10 | |
| *** ganso has joined #openstack-infra | 13:10 | |
| *** sree has quit IRC | 13:10 | |
| *** nadya has joined #openstack-infra | 13:11 | |
| *** ccamacho|lunch is now known as ccamacho | 13:13 | |
| *** esberglu has joined #openstack-infra | 13:14 | |
| erlon | clarkb: ping | 13:14 |
| erlon | clarkb: hey | 13:14 |
| *** mat128 has quit IRC | 13:14 | |
| *** mat128` is now known as mat128 | 13:15 | |
| *** rafaels has quit IRC | 13:15 | |
| *** mat128 has quit IRC | 13:16 | |
| *** mat128 has joined #openstack-infra | 13:16 | |
| *** jcoufal has joined #openstack-infra | 13:17 | |
| *** ociuhandu has quit IRC | 13:20 | |
| *** nadya has quit IRC | 13:20 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 13:22 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: add sahara's experimental job also to sahara-tests https://review.openstack.org/446994 | 13:23 |
| *** gouthamr has joined #openstack-infra | 13:23 | |
| *** ym200 has quit IRC | 13:24 | |
| *** kzaitsev_mb has quit IRC | 13:24 | |
| *** nadya has joined #openstack-infra | 13:25 | |
| *** ihrachys has joined #openstack-infra | 13:27 | |
| *** nadya_ has joined #openstack-infra | 13:27 | |
| *** ym200 has joined #openstack-infra | 13:28 | |
| *** nadya has quit IRC | 13:28 | |
| *** amotoki has joined #openstack-infra | 13:29 | |
| *** rfolco has joined #openstack-infra | 13:29 | |
| *** dave-mccowan has joined #openstack-infra | 13:30 | |
| *** mat128 has quit IRC | 13:30 | |
| *** esikachev has quit IRC | 13:30 | |
| *** mat128 has joined #openstack-infra | 13:32 | |
| *** chlong has joined #openstack-infra | 13:33 | |
| *** nadya_ has quit IRC | 13:33 | |
| *** baoli has joined #openstack-infra | 13:33 | |
| *** amotoki has quit IRC | 13:33 | |
| *** nadya has joined #openstack-infra | 13:34 | |
| *** john-davidge has quit IRC | 13:36 | |
| *** john-davidge has joined #openstack-infra | 13:36 | |
| *** ihrachys has quit IRC | 13:38 | |
| *** eharney has joined #openstack-infra | 13:38 | |
| *** ihrachys_ has joined #openstack-infra | 13:39 | |
| pabelanger | mnaser: https://github.com/Kozea/WeasyPrint/issues/334 seems to indicate html5lib is broken | 13:39 |
| *** weshay_pto is now known as weshay_sick | 13:40 | |
| *** dingyichen has quit IRC | 13:41 | |
| AJaeger | vsaienk0: look at http://logs.openstack.org/50/446950/2/check/gate-tempest-dsvm-ironic-lib-wholedisk-pxe_ipmitool-ubuntu-xenial/c7c7cad/logs/devstack-gate-setup-host.txt.gz - and check the PROJECTS variable. Somehow that does not take your changes in. | 13:42 |
| *** andreas_s has quit IRC | 13:43 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 13:44 |
| vsaienk0 | AJaeger: openstack/ironic is in PROJECTS var | 13:44 |
| AJaeger | vsaienk0: indeeed, missed it. | 13:44 |
| AJaeger | vsaienk0: then I have no idea ;( Best ask devstack-gate and devstack experts | 13:45 |
| sc` | if tox -e jjb/jenkins-project/zuul all check out, does that mean jobs will actually fire when things are merged? | 13:45 |
| *** mat128 has quit IRC | 13:46 | |
| *** aysyd has quit IRC | 13:46 | |
| AJaeger | sc`: once a project-config change merges, the next puppet run will update our servers. So, wait an hour and then the changes should be deployed | 13:46 |
| sc` | ah. okay | 13:47 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: Revert "Keep working to clean up PROJECTS list" https://review.openstack.org/447004 | 13:47 |
| sc` | i'm nearly to that point. jenkins +1'd everything | 13:47 |
| *** bh526r has joined #openstack-infra | 13:48 | |
| *** ociuhandu has joined #openstack-infra | 13:50 | |
| *** jaosorior_brb is now known as jaosorior | 13:50 | |
| *** funzo_ has joined #openstack-infra | 13:50 | |
| *** ijw has joined #openstack-infra | 13:55 | |
| *** ijw has quit IRC | 13:55 | |
| *** funzo_ has quit IRC | 13:55 | |
| *** vsaienko has joined #openstack-infra | 13:56 | |
| *** shardy_lunch is now known as shardy | 13:56 | |
| sc` | :D | 13:56 |
| *** zhurong has quit IRC | 13:56 | |
| sc` | AJaeger: i assumed things would not work, given my lack of adequate testing environments. thanks for the eyes | 13:58 |
| AJaeger | ;) | 13:58 |
| *** esikachev has joined #openstack-infra | 13:58 | |
| AJaeger | sc`: and if it does not work, let's iterate ;) | 13:58 |
| sc` | yep :D | 13:58 |
| *** thomas_oneill has left #openstack-infra | 13:59 | |
| sc` | AJaeger: should i be using that zuul-git-prep for my allinone, too? | 14:00 |
| sc` | it has gerrit-git-prep, which has worked for however long it's been there | 14:00 |
| sc` | years-ish? | 14:01 |
| AJaeger | gerrit-git-prep and zuul-git-prep do the same, just the implementation is different. Switching to zuul... is preferred | 14:04 |
| sc` | excellent. thanks | 14:04 |
| *** diltram has quit IRC | 14:05 | |
| *** gongysh has joined #openstack-infra | 14:06 | |
| vsaienk0 | AJaeger: clarkb reverting https://review.openstack.org/#/c/447004/ seems to be solving problem, wondered why | 14:06 |
| openstackgerrit | Merged openstack-infra/odsreg master: Fix LOGIN_URL to match new style https://review.openstack.org/446576 | 14:07 |
| openstackgerrit | Merged openstack-infra/odsreg master: Add missing makemigrations step https://review.openstack.org/446577 | 14:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Rename NodeCleanupWorker to DeletedNodeWorker https://review.openstack.org/446649 | 14:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Split DeleteNodeWorker into two threads https://review.openstack.org/446651 | 14:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Create BaseCleanupWorker class https://review.openstack.org/446650 | 14:07 |
| openstackgerrit | Merged openstack-infra/odsreg master: Disable scheduling module https://review.openstack.org/446578 | 14:07 |
| openstackgerrit | Merged openstack-infra/odsreg master: Remove hardcoded references to 'Design Summit' https://review.openstack.org/446579 | 14:08 |
| openstackgerrit | Merged openstack-infra/odsreg master: Rename 'Preapproved' to 'Approved' https://review.openstack.org/446580 | 14:08 |
| openstackgerrit | Merged openstack-infra/odsreg master: Simplify UI in case there is just one topic https://review.openstack.org/446581 | 14:08 |
| *** hongbin has joined #openstack-infra | 14:08 | |
| openstackgerrit | Samuel Cassiba proposed openstack-infra/project-config master: Chef: adds basic multinode integration tests https://review.openstack.org/446294 | 14:09 |
| *** dkehn has quit IRC | 14:11 | |
| *** ccamacho is now known as ccamacho|afk | 14:11 | |
| *** alexchadin has quit IRC | 14:13 | |
| *** nadya has quit IRC | 14:19 | |
| *** ijw has joined #openstack-infra | 14:20 | |
| *** rbrndt__ has joined #openstack-infra | 14:20 | |
| *** dkehn has joined #openstack-infra | 14:20 | |
| *** kzaitsev_mb has joined #openstack-infra | 14:21 | |
| *** prateek has quit IRC | 14:22 | |
| *** florianf has quit IRC | 14:23 | |
| *** diltram_ has joined #openstack-infra | 14:23 | |
| *** chlong has quit IRC | 14:23 | |
| ianychoi | AJaeger, hello! one question - in pot file, [msgid ""No Nodes To Register""] => duplicating double quotes is fine? | 14:25 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix repositories setup https://review.openstack.org/446949 | 14:26 |
| ianychoi | It seems that tripleo-ui project generates invalid format of pot file | 14:26 |
| AJaeger | ianychoi: that looks wrong to me, I doubt it works - but try it with gettext... | 14:27 |
| *** panda|zZ has quit IRC | 14:28 | |
| ianychoi | AJaeger, http://paste.openstack.org/show/603141/ is the top part of what I extracted from tripleo-ui and http://paste.openstack.org/show/603140/ is the result of running msgfmt command | 14:28 |
| ianychoi | I am not sure whether msgfmt also validates pot files or not - po files are okay :) | 14:29 |
| ianychoi | Hmm it is curious - http://tarballs.openstack.org/translation-source/tripleo-ui/master/i18n/messages.pot => It would mean that Zanata accepts two duplicated double quotes.. | 14:30 |
| AJaeger | ianychoi: I sent an eamail to jpichon, she will look at it next week. | 14:30 |
| AJaeger | ianychoi: should I include you in the thread? | 14:31 |
| *** zz_dimtruck is now known as dimtruck | 14:31 | |
| ianychoi | AJaeger, you don't have to include me :) I just thought that it would be an important problem on infra and wanted to help | 14:32 |
| AJaeger | ianychoi: let's see what the tripleo folks came up with ;) | 14:32 |
| AJaeger | ianychoi: thanks | 14:32 |
| ianychoi | AJaeger, one thing I was worried about yesterday was that what if the problem was related to Zanata upgrade on prouction. | 14:33 |
| AJaeger | ianychoi: no, doesn't look like that - based on what jpichon said in her email | 14:34 |
| ianychoi | AJaeger, would Zanata upgrade relate with the problem? I think it would be possible if new Zanata instance more validates json formats | 14:34 |
| *** panda has joined #openstack-infra | 14:34 | |
| *** amoralej is now known as amoralej|lunch | 14:34 | |
| ianychoi | AJaeger, aha then it would be fine to delete the old Zanata production instance but I would like to wait for resolving tripleo-ui to make sure that the problem is not related with Zanata upgrade. | 14:35 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add ansible-lint to tox (pep8) https://review.openstack.org/438276 | 14:36 |
| *** florianf has joined #openstack-infra | 14:38 | |
| ianychoi | AJaeger, I have seen your forwarded e-mail. Interesting - [msgid ""No Nodes To Register""] string was already landed in Zanata and the time period when tripleo-ui sync did not work is very similar with Zanata upgrade | 14:38 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: add sahara's experimental job also to sahara-tests https://review.openstack.org/446994 | 14:39 |
| *** gongysh has quit IRC | 14:39 | |
| ianychoi | AJaeger, I will ask it to Zanata dev team (I will not revert the old production instance but let's better identify the root cause of problems..). | 14:39 |
| AJaeger | ianychoi: thanks for double checking | 14:40 |
| *** vikrant has quit IRC | 14:40 | |
| ianychoi | AJaeger, :) Have a good Friday! | 14:41 |
| pabelanger | AJaeger: regarding zuul-git-prep-upper-constraints, I was hoping to make a change to the marco. Rather then copying the upper-constraints.txt file into the working directory for the project, then calling tox. I'd like to change it to export UPPER_CONSTRAINTS_FILE=$REQS_DIR/upper-constraints.txt and update our run-tox.sh script to read the variable. | 14:42 |
| pabelanger | AJaeger: reason for this, it avoids making the current working directory dirty (untracked file) and a little easier for zuulv3 playbooks | 14:43 |
| *** Julien-zte has joined #openstack-infra | 14:43 | |
| *** yamamoto has quit IRC | 14:43 | |
| *** tosky has quit IRC | 14:43 | |
| *** tosky has joined #openstack-infra | 14:44 | |
| *** yamamoto has joined #openstack-infra | 14:45 | |
| *** sc68cal has quit IRC | 14:47 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 14:47 |
| *** trown is now known as trown|brb | 14:49 | |
| *** yamamoto has quit IRC | 14:50 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: Revert "Keep working to clean up PROJECTS list" https://review.openstack.org/447004 | 14:51 |
| AJaeger | pabelanger: I would +2 such a change - but I fear that one or the other test will not respect the environment variable and use the current path instead. So, would be good to do a bit of research whether we find any and can fix them | 14:51 |
| *** funzo_ has joined #openstack-infra | 14:51 | |
| *** trown|brb is now known as trown | 14:52 | |
| *** esikachev has quit IRC | 14:53 | |
| *** fandi has quit IRC | 14:53 | |
| *** dprince has quit IRC | 14:54 | |
| *** funzo_ has quit IRC | 14:55 | |
| cmurphy | good morning infra-root, would it be possible to get feedback on https://review.openstack.org/#/c/445991/ and perhaps a +W + apache restart? | 14:56 |
| *** xarses has joined #openstack-infra | 14:56 | |
| *** Dinesh_Bhor has quit IRC | 14:56 | |
| *** dangers_away has joined #openstack-infra | 14:57 | |
| *** xarses_ has joined #openstack-infra | 14:57 | |
| *** panda_ has joined #openstack-infra | 14:57 | |
| *** esikachev has joined #openstack-infra | 14:57 | |
| *** marst has quit IRC | 14:58 | |
| *** panda is now known as Guest88783 | 14:59 | |
| *** panda_ is now known as panda | 14:59 | |
| *** wolverineav has joined #openstack-infra | 15:00 | |
| *** trown is now known as trown|mtg | 15:00 | |
| *** xarses has quit IRC | 15:00 | |
| *** Guest88783 has quit IRC | 15:01 | |
| *** xarses has joined #openstack-infra | 15:02 | |
| *** xarses_ has quit IRC | 15:02 | |
| *** ldnunes has quit IRC | 15:02 | |
| *** markus_z has quit IRC | 15:02 | |
| *** wolverin_ has joined #openstack-infra | 15:02 | |
| *** sree has joined #openstack-infra | 15:03 | |
| *** xarses_ has joined #openstack-infra | 15:03 | |
| *** marst has joined #openstack-infra | 15:04 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: Revert "Keep working to clean up PROJECTS list" https://review.openstack.org/447004 | 15:04 |
| *** neiljerram has quit IRC | 15:04 | |
| *** marst has quit IRC | 15:05 | |
| *** marst has joined #openstack-infra | 15:05 | |
| *** burgerk has joined #openstack-infra | 15:05 | |
| *** wolverineav has quit IRC | 15:05 | |
| *** saibarspeis has quit IRC | 15:06 | |
| *** esikachev has quit IRC | 15:06 | |
| *** xarses has quit IRC | 15:06 | |
| *** kzaitsev_mb has quit IRC | 15:07 | |
| *** xarses has joined #openstack-infra | 15:07 | |
| *** xarses_ has quit IRC | 15:08 | |
| ianychoi | AJaeger, oh now I suspect [role's] part - there is no corresponding single quote. I can test but it might not be a good idea to manually modify a pot file and test from my local environment. I now do not have access to translate-dev.o.o because of openstackid-dev test. Now I think do not need to ask to Zanata dev team. Thanks :) | 15:08 |
| jlvillal | clarkb, So vsaienk0 proposed: https://review.openstack.org/#/c/447004/ as it is breaking the ironic-lib gate | 15:09 |
| jlvillal | Or better, fixes the ironic-lib gate. reverts patch which is breaking ironic-lib gate | 15:09 |
| *** mriedem is now known as mriedem_afk | 15:10 | |
| *** dansmith is now known as superdan | 15:10 | |
| *** dhajare has quit IRC | 15:11 | |
| clarkb | do we know why? | 15:12 |
| *** armax has joined #openstack-infra | 15:12 | |
| *** dprince has joined #openstack-infra | 15:12 | |
| clarkb | eg is there a simple proper fix we can use? I half expected somethibg will break but we really need to stop configure all those git repos on every job | 15:12 |
| jlvillal | vsaienk0, ^^^ ??? | 15:12 |
| *** amoralej|lunch is now known as amoralej | 15:13 | |
| *** dangers_away has quit IRC | 15:14 | |
| *** dizquierdo has joined #openstack-infra | 15:15 | |
| jeblair | yeah, if we know which projects that job needs, we can just add them to that job. bonus: that's probably faster than the devstack-gate revert. :) | 15:15 |
| jlvillal | clarkb, I see openstack/ironic in PROJECTS http://logs.openstack.org/50/446950/1/check/gate-tempest-dsvm-ironic-lib-wholedisk-agent_ipmitool-ubuntu-xenial/40a4d2f/logs/reproduce.sh | 15:15 |
| *** dave-mccowan has quit IRC | 15:15 | |
| clarkb | eg are yoy relying on one of those libs from git without setting libs from git? | 15:15 |
| *** dangers_away has joined #openstack-infra | 15:15 | |
| jlvillal | clarkb, Maybe?? | 15:15 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Do not merge: Test python-heat-agents package build https://review.openstack.org/439178 | 15:16 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Do not merge: Test python-heat-agents package build https://review.openstack.org/439178 | 15:16 |
| vsaienk0 | clarkb: so what you suggesting add all ironic projects to PROJECTS here https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L73 ? | 15:18 |
| jeblair | clarkb, vsaienk0, jlvillal: this looks weird: http://logs.openstack.org/50/446950/2/check/gate-tempest-dsvm-ironic-lib-wholedisk-agent_ipmitool-ubuntu-xenial/f73e493/logs/devstack-gate-setup-workspace-new.txt.gz#_2017-03-17_12_18_14_070 | 15:19 |
| jeblair | like there's an empty-string project | 15:19 |
| jlvillal | clarkb, So on a "ironic" job (not ironic-lib) I notice reproduce.sh does NOT set DEVSTACK_PROJECT_FROM_GIT http://logs.openstack.org/44/446844/1/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-pxe_ipmitool-tinyipa-ubuntu-xenial/02f0b9b/logs/reproduce.sh | 15:19 |
| jlvillal | jeblair, Could that be because: DEVSTACK_PROJECT_FROM_GIT="ironic-lib," ? | 15:21 |
| clarkb | oh if there is a trailong comma we may not handle that properly | 15:22 |
| jlvillal | I'm not sure where it is getting the name to clone from | 15:23 |
| jeblair | yeah, if there's a trailing comma, you get an openstack/ at the end | 15:23 |
| jeblair | if it's the empty string, you also get openstack/ at the end | 15:23 |
| jeblair | i guess that's not a fatal error though? | 15:24 |
| clarkb | ya I dont think it should be fatal (but noisy) | 15:24 |
| jeblair | http://logs.openstack.org/50/446950/2/check/gate-tempest-dsvm-ironic-lib-wholedisk-agent_ipmitool-ubuntu-xenial/f73e493/logs/devstacklog.txt.gz#_2017-03-17_12_18_34_121 | 15:25 |
| jeblair | i guess that's the fatal error | 15:25 |
| jlvillal | But it is in PROJECTS (with a trailing space) | 15:25 |
| jlvillal | http://logs.openstack.org/50/446950/1/check/gate-tempest-dsvm-ironic-lib-wholedisk-agent_ipmitool-ubuntu-xenial/40a4d2f/logs/reproduce.sh | 15:25 |
| jeblair | oh, maybe it is fatal? | 15:26 |
| jlvillal | And: http://logs.openstack.org/50/446950/1/check/gate-tempest-dsvm-ironic-lib-wholedisk-agent_ipmitool-ubuntu-xenial/40a4d2f/_zuul_ansible/scripts/09-4cd5444eae4345dfa2f26697fa531d18.sh | 15:26 |
| jeblair | we prepend processed_from_git to projects | 15:26 |
| *** Julien-zte has quit IRC | 15:27 | |
| jeblair | the last "repo" it set up was "openstack/" which means that it stopped processing the projects list at the end of processed_from_git, and didn't get to the normal projects list? | 15:27 |
| *** Julien-zte has joined #openstack-infra | 15:27 | |
| clarkb | shouldn't it keep going? | 15:28 |
| * jlvillal admits to being confused | 15:28 | |
| *** bhavik1 has joined #openstack-infra | 15:28 | |
| *** Julien-zte has quit IRC | 15:28 | |
| ianychoi | clarkb, good morning! Now I want to experience translate-dev.o.o to test Zanata. So my idea is: 1. change openstackid-dev to openstackid 2. assign my new Zanata ID with openstackid-dev (smarcet helped it) as Zanata admin and 3. switch again from openstackid to openstack-dev if smarcet wants to test more with openstackid-dev. Are you fine with my proposal? | 15:28 |
| clarkb | huh ya looks like it short circuitede | 15:28 |
| *** dave-mccowan has joined #openstack-infra | 15:28 | |
| clarkb | jeblair: jlvillal we test -n $DEVSTACK_LIB_FROM_GIT to make sure we don't add openstack/ on empty string. So I think its just trailing comma that is a problem? | 15:30 |
| *** Julien-zte has joined #openstack-infra | 15:30 | |
| *** Julien-zte has quit IRC | 15:30 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Fix setfiles command https://review.openstack.org/447033 | 15:30 |
| jeblair | clarkb: yeah, i agree | 15:31 |
| *** armax has quit IRC | 15:32 | |
| *** esikachev has joined #openstack-infra | 15:32 | |
| jlvillal | clarkb, jeblair: I notice in devstack they do something like this | 15:33 |
| jlvillal | for service in ${ENABLED_SERVICES//,/ }; do | 15:33 |
| * jlvillal goes and reads bash man page to understand | 15:33 | |
| *** trown|mtg is now known as trown | 15:34 | |
| *** jcoufal has quit IRC | 15:34 | |
| jlvillal | ${parameter/pattern/string} | 15:34 |
| jlvillal | Pattern substitution. The pattern is expanded to produce a pattern just as in pathname expansion. Parameter is expanded and the longest match of pattern against its value is replaced with string. If pattern begins with /, all matches of pattern are replaced with string. Normally only the | 15:34 |
| jlvillal | first match is replaced. If pattern begins with #, it must match at the beginning of the expanded value of parameter. If pattern begins with %, it must match at the end of the expanded value of parameter. If string is null, matches of pattern are deleted and the / following pattern may be | 15:34 |
| jlvillal | omitted. If parameter is @ or *, the substitution operation is applied to each positional parameter in turn, and the expansion is the resultant list. If parameter is an array variable subscripted with @ or *, the substitution operation is applied to each member of the array in turn, and | 15:34 |
| jlvillal | the expansion is the resultant list. | 15:34 |
| pabelanger | woah | 15:34 |
| *** Apoorva has joined #openstack-infra | 15:34 | |
| thomasem | wow | 15:34 |
| fungi | it's a sign of the coming bashpocalypse | 15:35 |
| *** felipemonteiro_ has quit IRC | 15:35 | |
| jlvillal | :) | 15:36 |
| jeblair | it looks like the trailing comma would be pretty hard to remove from the way the jjb templates/builders are set up in ironic.yaml | 15:36 |
| jeblair | so it may be easiest to handle that in devstack-gate | 15:36 |
| clarkb | ya I have a sed patch incoming | 15:36 |
| clarkb | but trying ro grok bash magic above | 15:36 |
| jlvillal | Awesome, thanks :) | 15:36 |
| *** ijw has quit IRC | 15:37 | |
| *** ijw has joined #openstack-infra | 15:39 | |
| mordred | clarkb: I feel like there was a point in my past where I was a bash god. then I looked away for a second and it grew a million features and now I don't know how bash works any more | 15:40 |
| mordred | one of these days I will fix that | 15:40 |
| jlvillal | clarkb, | 15:40 |
| jlvillal | for project_git in ${DEVSTACK_PROJECT_FROM_GIT//,/ }; do | 15:40 |
| jlvillal | PROJECTS="openstack/${project_git} $PROJECTS" | 15:40 |
| jlvillal | echo $project_git | 15:40 |
| jlvillal | done | 15:40 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Handle trailing commas in source libs list https://review.openstack.org/447037 | 15:40 |
| jlvillal | Or that :) | 15:40 |
| *** ijw_ has joined #openstack-infra | 15:41 | |
| *** ijw_ has quit IRC | 15:42 | |
| *** mriedem_afk is now known as mriedem | 15:42 | |
| *** ijw_ has joined #openstack-infra | 15:42 | |
| *** ijw has quit IRC | 15:43 | |
| fungi | clarkb: that looks fine, or you can even skip the backref and just s/,$// instead | 15:43 |
| clarkb | oh right | 15:44 |
| clarkb | let me push that as its easier to read | 15:44 |
| jlvillal | clarkb, I left a comment also. | 15:44 |
| fungi | should we get a throwaway ironic change up with a depends-on to this, or just hurry it through? | 15:45 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Handle trailing commas in source libs list https://review.openstack.org/447037 | 15:45 |
| clarkb | I think vsaienk0 must have already had one to confirm the revert fixed it | 15:45 |
| clarkb | jlvillal: IMO no beacuse it relies on dark bash magic. But thats my personal perspective having spent years avoiding bashism and relying on other tools | 15:46 |
| jlvillal | clarkb, Okay :) | 15:46 |
| clarkb | jlvillal: I am still pre caffeine this morning and I cannot parse wtf bash is trying to do there based on the pasted text (though I grok it in the context it is written) | 15:46 |
| jlvillal | clarkb, Me too. I'll admit I understand the 2nd sed iteration. The first one I was going, hmmmmmm..... | 15:47 |
| *** ZZelle has joined #openstack-infra | 15:47 | |
| fungi | you can even do that with multiple -e expressions to the one sed invocation which was there, e.g. sed -e 's/,$//' -e 's/,/ openstack\//g' | 15:48 |
| clarkb | fungi: ya, I thouight the descriptive variable names would help readablity though | 15:48 |
| fungi | but what you have is nice an explicit | 15:48 |
| jlvillal | clarkb, Have you heard of the Talk Python To Me podcast? As a note, he is a fellow Portland Metropolitan area person :) | 15:48 |
| *** yamamoto has joined #openstack-infra | 15:48 | |
| clarkb | jlvillal: I haven't | 15:49 |
| jlvillal | clarkb, Some good stuff. They did Episode 100 a week or two ago. Had Guido on. | 15:49 |
| jeblair | when i read "chomp" i was hoping clarkb had switched to using perl | 15:50 |
| jlvillal | /kickban jeblair ;) | 15:50 |
| openstackgerrit | Merged openstack-infra/system-config master: Tweak mpm_worker settings https://review.openstack.org/445991 | 15:50 |
| clarkb | jeblair: it still bugs me python calls it strip | 15:51 |
| jeblair | jlvillal: if you want to argue that *bash* is the better place to do regex based string manipulation, i'll happily defend perl. :) | 15:51 |
| *** aarefiev is now known as aarefiev_afk | 15:51 | |
| jlvillal | jeblair, True :) | 15:51 |
| pepijn | clarkb: can you help we with a gerrit/duplicate change-id issue? | 15:51 |
| clarkb | jlvillal: I can't figure out how replacing empty strings with commas helps here (and thats what should be happening if I read the text pasted above properly) | 15:52 |
| *** funzo_ has joined #openstack-infra | 15:52 | |
| clarkb | pepijn: maybe? | 15:52 |
| clarkb | pepijn: I can try | 15:52 |
| pepijn | clarkb: changes 445486, 445489, 445520, change-id I356912a39e1cb08ac58c1208f27d1e93b7cad2fe | 15:52 |
| pepijn | clarkb: i think because of timeouts during the initial git review, those got duplicated | 15:53 |
| jlvillal | clarkb, Yeah, I'm not quite sure either. My test bash script works, but reading the man page makes me scratch my head. | 15:53 |
| clarkb | jlvillal: probably a docs bug :) | 15:53 |
| pepijn | clarkb: i abandoned the first two, and there is some history and voting on the last i'd like to keep | 15:53 |
| clarkb | pepijn: ok you should be able to use the last one in an unabandoned state? | 15:55 |
| clarkb | also odd that gerrit let that happen in the first place. Areyou using git-review? | 15:55 |
| pepijn | clarkb: yes, i use git review, and yes, strange it happened, but i am not able to use the last one | 15:56 |
| jlvillal | clarkb, Ah, it isn't an empty string. Pattern is "/," | 15:56 |
| *** aysyd has joined #openstack-infra | 15:56 | |
| jlvillal | If pattern begins with /, all matches of pattern are replaced with string. | 15:56 |
| clarkb | jlvillal: wow ok so its deleting all of the commas | 15:56 |
| jlvillal | And replacing them with spaces | 15:56 |
| clarkb | and string is empty so thats whitespace or null? | 15:56 |
| pepijn | clarkb: gerrit returns remote rejected, I356912a39e1cb08ac58c1208f27d1e93b7cad2fe has duplicates | 15:56 |
| *** yamamoto has quit IRC | 15:56 | |
| *** funzo_ has quit IRC | 15:57 | |
| clarkb | pepijn: right thats what should've happened the first time the duplicate push was attempted | 15:57 |
| jlvillal | ${ENABLED_SERVICES//,/ } | 15:57 |
| clarkb | pepijn: in that case I don't know what we can do. The data is essetnailly corrupt | 15:57 |
| jeblair | clarkb: your change has 2x+2, but no +3 in case you want to wait for tests and then +w | 15:57 |
| clarkb | jlvillal: ya I think I prefer the sed :) | 15:57 |
| clarkb | jeblair: thanks. let me see if I can find vsaienk0's test change | 15:57 |
| jlvillal | clarkb, Yeah, the "cognitive load" adds up on that one :) | 15:57 |
| pepijn | ok, so i should just abondan the change-id and start anew | 15:58 |
| fungi | pepijn: were there response timeouts associated with the pushes which resulted in those "extra" changes? | 15:58 |
| pepijn | fungi: yes | 15:58 |
| vsaienk0 | clarkb: https://review.openstack.org/#/c/446950/ | 15:58 |
| fungi | pepijn: that makes sense. if gerrit times out attempting to query its database in relationship to a commit write, we've seen strange behaviors result | 15:58 |
| pepijn | i should have abandoned the change-id when i discovered this, of course | 15:59 |
| fungi | something like gerrit tries to look for duplicates, the sql query times out due to network issues reaching the db or high load on the system or a myriad of other possible reasons, and then instead of retrying ot temporarily rejecting it treats that as an empty query response and goes ahead with thw write | 16:01 |
| clarkb | how do you publish an edit in gerrit? ... this shouldn't be so hard | 16:01 |
| * clarkb pulls with git and does it like normal | 16:01 | |
| pepijn | could possible be fixed by 'fixing' the change-id in the commit messages from the abonded changes | 16:02 |
| clarkb | oh vsaienk0 got it first cool | 16:02 |
| *** kzaitsev_mb has joined #openstack-infra | 16:03 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add dracut-regenerate elements https://review.openstack.org/447047 | 16:04 |
| *** nicolasbock has quit IRC | 16:04 | |
| fungi | looks like pepijn's "duplicate" changes were pushed when we were experiencing the gerrit denial of service from that one ci system | 16:04 |
| fungi | which makes sense | 16:04 |
| clarkb | ah | 16:04 |
| clarkb | (speaking of has anyone heard from that group of CIs/users) | 16:05 |
| clarkb | oh I have new email from 2 hours ago yay | 16:05 |
| fungi | yep. i was about to mention that | 16:05 |
| fungi | erlon replied | 16:06 |
| pepijn | fungi,clarkb: but you guys can't fix this on your side? | 16:06 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 16:06 |
| clarkb | erlon: if you are around it might be easier to test/debug interactively rather than async on email. Thinking we could allow your packets through again and watch it real time | 16:06 |
| clarkb | pepijn: I don't think so. The changes are corrupt. Not sure what we would change them to to fix it | 16:07 |
| fungi | pepijn: i think that change id string is used as a foreign key in multiple tables in the backend database | 16:07 |
| clarkb | pepijn: I'd mostly worry about making it worse | 16:07 |
| pepijn | ok, i'll just try with removing the change-id from the commit and start a new change | 16:08 |
| fungi | gerrit upstream doesn't consider out-of-band database manipulation a sane solution, since it has lots of secondary search indexing and other caches in the running jvm | 16:08 |
| *** jianghuaw-m has joined #openstack-infra | 16:08 | |
| *** jianghuaw-m_ has joined #openstack-infra | 16:09 | |
| *** jianghuaw-m has quit IRC | 16:09 | |
| fungi | we still do it for some relatively "simple" cases like repository renaming or untangling openids, but even then the process can be labor-intensive | 16:10 |
| *** nadya has joined #openstack-infra | 16:10 | |
| fungi | and is risky | 16:10 |
| *** beslemon_ has quit IRC | 16:11 | |
| ganso | clarkb: Hi Clark. Sorry to interrupt, but just a heads up that Erlon sent an email to the mailing list about the Hitachi CIs being deactivated. We believe we fixed the issue and are waiting for it to be activated back. Thanks in advance. | 16:11 |
| *** jianghuaw-m_ has quit IRC | 16:11 | |
| clarkb | ganso: yes I just asked erlon if we could do things synchronously here rather than async on ml (but haven't responded to the email) that way we can debug further if it isn't actually fixed | 16:12 |
| ganso | clarkb: great | 16:12 |
| *** sree has quit IRC | 16:12 | |
| clarkb | ganso: erlon what we observed were thousands of new connections coming in over time that all sat idle without properly authenticating | 16:12 |
| *** Apoorva has quit IRC | 16:12 | |
| *** knangia has joined #openstack-infra | 16:12 | |
| clarkb | ganso: erlon is that behavior what you would expect given the situation you described on your end? | 16:12 |
| clarkb | ganso: are you able to be around here for the next little bit? if so I can open the firewall back up again | 16:14 |
| ganso | clarkb: no, definitely not what we expected. We have some traffic due to having 7 accounts under the same IP address, and then we expected that traffic to double, not to hit thousands. But since it was a duplicate of our zuul server, maybe it was misbehaving without us noticing and getting authentication failures. But that just peaked while we were testing, | 16:14 |
| ganso | and it is turned off now | 16:14 |
| clarkb | fungi: ^ anything else you want to have checked before I restart iptables-persistent? | 16:14 |
| ganso | clarkb: yes, for the next half hour | 16:14 |
| *** adrianofr_ has joined #openstack-infra | 16:14 | |
| clarkb | ganso: great I am going to remove the drop firewall rule now | 16:16 |
| clarkb | ganso: its gone new connections should be able to be made now | 16:16 |
| *** MasterOfBugs has joined #openstack-infra | 16:17 | |
| ganso | clarkb: ok I see a big burst of new connections in my tcpdump, probably due to all accounts being able to fetch gerrit changes and content that they were not previously being able to | 16:17 |
| *** dizquierdo has quit IRC | 16:18 | |
| *** vsaienko has quit IRC | 16:18 | |
| clarkb | ganso: we currently have 28 connections from your IP | 16:18 |
| clarkb | lets wait a few minutes and see if that settles out or if it continues to climb | 16:19 |
| ganso | clarkb: ok, great, thanks! | 16:19 |
| *** jcoufal has joined #openstack-infra | 16:19 | |
| clarkb | now up to 36 | 16:19 |
| *** dizquierdo has joined #openstack-infra | 16:19 | |
| clarkb | and the vast majority of them don't have an account associated which is what we saw previously | 16:19 |
| clarkb | ganso: any chance you can see where all those connections are originating from on your end? | 16:20 |
| clarkb | since I think this must be doing NAT for you | 16:20 |
| clarkb | I have a hunch its a single unhappy client that is unable to auth or something | 16:20 |
| *** vsaienko has joined #openstack-infra | 16:20 | |
| ganso | clarkb: yes it is doing NAT, we are debugging through zuul debug log and tcpdump | 16:21 |
| clarkb | up over 50 now | 16:21 |
| *** dizquierdo has quit IRC | 16:21 | |
| ganso | clarkb: while it was blocked we were unable to find any request with an unassociated account | 16:21 |
| ganso | clarkb: we had exactly 1 timeout error for each connection | 16:21 |
| ganso | clarkb: so, it looks like we have an improper zuul configuration | 16:21 |
| clarkb | ya without being able to make the connections I think it would've been ahrder to track down | 16:21 |
| *** rossella_s has quit IRC | 16:22 | |
| clarkb | ganso: you can probably very easily tell what the source is by dumping your nat state table | 16:22 |
| clarkb | then just see who has all the connections open | 16:22 |
| ganso | clarkb: ok give me a minute please | 16:22 |
| *** bnemec is now known as beekneemech | 16:23 | |
| clarkb | jlvillal: vsaienk0 tempest is running on the ironic-lib change with the depends on so I will go ahead and approve the d-g change now | 16:25 |
| fungi | clarkb: seems safe to go ahead | 16:25 |
| jlvillal | clarkb, Thank you | 16:25 |
| ganso | clarkb: ok I stopped zuul, let's see if the connections stop increasing, it is possible that this is not even related to our CIs | 16:25 |
| *** smarcet has joined #openstack-infra | 16:25 | |
| clarkb | ganso: connections dropped to 2 | 16:25 |
| ganso | clarkb: whoa! | 16:26 |
| clarkb | so must be related to that zuul | 16:26 |
| fungi | ganso: we were also seeing lots og gerrit change queries from one of those ci accounts... i'll see if that's still the case | 16:26 |
| *** mdrabe has quit IRC | 16:26 | |
| clarkb | jeblair: ^ you may be interested in this as it appears zuul is DoSing us | 16:26 |
| *** vsaienko has quit IRC | 16:26 | |
| *** mdrabe has joined #openstack-infra | 16:26 | |
| *** bhavik1 has quit IRC | 16:27 | |
| fungi | i'm not seeing the large query volume in the sshd logs this time, at least | 16:28 |
| clarkb | fungi: ya I think its failign to auth at all | 16:28 |
| clarkb | which is why we don't get usernames associated to the connections, just the IP | 16:28 |
| fungi | makes sense | 16:28 |
| *** marst has quit IRC | 16:28 | |
| ganso | clarkb: we are restarting zuul with all accounts disabled | 16:28 |
| ganso | clarkb: I don't see any request now | 16:29 |
| clarkb | ya I am not seeing new connections | 16:29 |
| ganso | clarkb: we are going to enable one by one now | 16:29 |
| clarkb | ok | 16:29 |
| ganso | clarkb: restarted with 1 additional account | 16:31 |
| *** vsaienko has joined #openstack-infra | 16:31 | |
| clarkb | we are up to 3 connections, lets let it sit a minute just to be sure it doesn't create a bunch more | 16:32 |
| ganso | clarkb: cool | 16:32 |
| clarkb | still just 3 I think this account is fine, ready to try the next one? | 16:33 |
| ganso | clarkb: yup, going to restart again now with 1 more | 16:33 |
| clarkb | it is up to 4 now | 16:35 |
| ganso | clarkb: ok, let's wait 1 minute, I'll prepare the activation of the next one | 16:35 |
| clarkb | kk | 16:35 |
| openstackgerrit | Dirk Mueller proposed openstack-infra/system-config master: Bump puppet-ntp to 4.2.0 https://review.openstack.org/447058 | 16:36 |
| ganso | clarkb: we already found something that may be causing the problem here, it is likely to be related to the next activation. Once we confirm this, we will make a change here and see if the problem goes away | 16:36 |
| clarkb | cool, current accuont still at 4 total conenctions so ready to move on when you are | 16:37 |
| ganso | clarkb: ok, restarting again | 16:37 |
| clarkb | (er thats connections from the NAT address) | 16:37 |
| clarkb | up to 7 now | 16:38 |
| clarkb | lets watch and see if it rises steadily | 16:38 |
| clarkb | yup up to 11 now | 16:38 |
| clarkb | ganso: so I think you are right its this account that was just activated | 16:39 |
| ganso | clarkb: ok, I'll disable it here, and try to fix the problem, give me 2 minutes please | 16:39 |
| clarkb | ok | 16:39 |
| AJaeger | clarkb: do you want to merge https://review.openstack.org/#/c/417555/ now? That's python3 devstack change | 16:39 |
| clarkb | AJaeger: sure | 16:39 |
| clarkb | AJaeger: though maybe let the ironic fix through first? | 16:40 |
| ganso | clarkb: ok, restarted | 16:40 |
| *** trown is now known as trown|lunch | 16:40 | |
| clarkb | ganso: currently there are 5 connections total from the IP | 16:40 |
| *** panda is now known as panda|bbl | 16:41 | |
| ganso | clarkb: ok, it shouldn't increase now | 16:41 |
| clarkb | yup still 5 | 16:41 |
| clarkb | so what was the issue? seems like a zuul bug that maybe needs fixing too | 16:41 |
| ganso | clarkb: cool, so the problem is now probably fixed | 16:41 |
| ganso | clarkb: yea so, one of our private key files was with wrong permissions set | 16:42 |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Run nova functional tests on upper-constraints.txt changes https://review.openstack.org/437150 | 16:42 |
| ganso | clarkb: so, after the firewall was unblocked, we could see permission denied errors in the debug log | 16:42 |
| clarkb | jeblair: ^ fyi, apparently zuul can dos a gerrit if the ssh key isn't correct | 16:42 |
| clarkb | ganso: this was filesystem permissions for the file on disk? | 16:43 |
| ganso | clarkb: before, while we were blocked, it seems it wouldn't touch the private key file to notice it had the wrong permissions set | 16:43 |
| ganso | clarkb: no, just a single file | 16:43 |
| ganso | clarkb: yes, sorry, filesystem permissions for the file | 16:43 |
| AJaeger | clarkb: sure... | 16:43 |
| ganso | clarkb: only for the single file | 16:43 |
| ganso | clarkb: of that account | 16:43 |
| clarkb | ganso: was it not readable or was it too permissive? | 16:43 |
| clarkb | ganso: want to make sure we get the specific details so hopefully zuul/paramiko/something can be fixed | 16:44 |
| ganso | clarkb: not readable, owner was set to root instead of zuul | 16:44 |
| clarkb | ganso: thanks | 16:44 |
| jeblair | clarkb, ganso: ah thanks. i'll file a story | 16:44 |
| clarkb | ganso: you should be all set now. I still see 5 connections total | 16:44 |
| clarkb | ganso: thanks for helping debug | 16:44 |
| ganso | clarkb: so, I guess Zuul project can be improved to not attempt to authenticate insanely when it gets permission denied on the key | 16:44 |
| clarkb | ganso: ya | 16:45 |
| clarkb | should be fixable with a nice error log message for users too | 16:45 |
| ganso | clarkb: Thank you Clark! Thanks for notifying us of this problem and working together on this, it is great to have our CI up again | 16:45 |
| clarkb | ERROR cannot read id_rsa private key file or something | 16:45 |
| ganso | clarkb: and sorry for ending up DoSing gerrit for such a dumb mistake on our end | 16:46 |
| jeblair | why is gerrit leaving those connections open without authentication? | 16:46 |
| clarkb | jeblair: I don't know | 16:46 |
| clarkb | jeblair: they did appear to have an 8 hour life or so though | 16:46 |
| clarkb | so possibly its a very unaggressive timeout | 16:46 |
| jeblair | ganso, clarkb: https://storyboard.openstack.org/#!/story/2000923 | 16:47 |
| clarkb | jeblair: I am working on a quick zuul side patch | 16:47 |
| jeblair | clarkb: oh thanks :) | 16:47 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Decrypt secrets and plumb to Ansible https://review.openstack.org/446688 | 16:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Serve public keys through webapp https://review.openstack.org/446756 | 16:48 |
| *** jianghuaw-m has joined #openstack-infra | 16:51 | |
| *** funzo_ has joined #openstack-infra | 16:52 | |
| *** jianghuaw-m has quit IRC | 16:55 | |
| *** jaosorior has quit IRC | 16:55 | |
| *** kzaitsev_mb has quit IRC | 16:56 | |
| *** funzo_ has quit IRC | 16:57 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Check ssh keyfile readability up front https://review.openstack.org/447066 | 16:58 |
| clarkb | jeblair: ganso ^ note its pushed against master since this was hit with third party CI | 16:59 |
| *** dizquierdo has joined #openstack-infra | 16:59 | |
| *** e0ne has quit IRC | 16:59 | |
| *** armax has joined #openstack-infra | 17:01 | |
| *** ganso has left #openstack-infra | 17:02 | |
| clarkb | with that /me wanders off to go get caffeine | 17:04 |
| *** Apoorva has joined #openstack-infra | 17:05 | |
| erlon | clarkb: hey Clark, thanks for helping! have just got from lunch | 17:07 |
| erlon | clarkb: missed all the action :( | 17:08 |
| *** beslemon has joined #openstack-infra | 17:08 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements https://review.openstack.org/447047 | 17:09 |
| jeblair | clarkb: oh you know, we probably need to do the client.close() thing like in nodepool | 17:12 |
| clarkb | oh! ya that could be the actual issue | 17:13 |
| *** dtantsur is now known as dtantsur|afk | 17:13 | |
| clarkb | do you want me to rewrite to do it that way or maybe we wnt both things? | 17:13 |
| *** matrohon has quit IRC | 17:13 | |
| jeblair | clarkb: i think maybe we should rewrite it that way rather than the explicit read check, that way we're protected from any error | 17:13 |
| clarkb | wfm will get new patchset up shortly | 17:14 |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Start building opensuse based nodepool images https://review.openstack.org/412065 | 17:14 |
| jeblair | clarkb: i *think* a simple try/finally set up will work there | 17:15 |
| *** nt has quit IRC | 17:15 | |
| *** nt has joined #openstack-infra | 17:15 | |
| jeblair | well, for the watcher at least, maybe not for the connection that's used for queries | 17:15 |
| *** erhudy has left #openstack-infra | 17:16 | |
| *** smarcet has left #openstack-infra | 17:17 | |
| *** ijw has joined #openstack-infra | 17:18 | |
| *** pcaruana has quit IRC | 17:18 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 17:20 |
| *** nadya has quit IRC | 17:20 | |
| *** ijw has quit IRC | 17:21 | |
| *** ijw_ has quit IRC | 17:22 | |
| clarkb | jeblair: yup, working on connection. I think I see an simple way to do it there too | 17:23 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Always execute autorelabel https://review.openstack.org/447076 | 17:23 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Close paramiko connections explicitly https://review.openstack.org/447066 | 17:25 |
| clarkb | jeblair: ^ something like that maybe. I think it can still leak one connection but only one | 17:25 |
| clarkb | #status log 201.48.5.193 is no longer opening thousands of connections and the drop firewall rule has been removed. Underlying cause was Zuul not being able to read its ssh private key for talking to gerrit. | 17:27 |
| jeblair | clarkb: one comment, but generally looks good | 17:31 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul master: Close paramiko connections explicitly https://review.openstack.org/447066 | 17:34 |
| clarkb | jeblair: ^ is that better? | 17:34 |
| *** csomerville has joined #openstack-infra | 17:36 | |
| *** dhajare has joined #openstack-infra | 17:37 | |
| jeblair | clarkb: ++ | 17:39 |
| fungi | out to lunch, bbiaw | 17:41 |
| *** trown|lunch is now known as trown | 17:44 | |
| *** beslemon has quit IRC | 17:44 | |
| *** yamahata has joined #openstack-infra | 17:44 | |
| *** dizquierdo is now known as dizquierdo_afk | 17:44 | |
| *** hashar has quit IRC | 17:46 | |
| openstackgerrit | Merged openstack-infra/zuul master: Close paramiko connections explicitly https://review.openstack.org/447066 | 17:46 |
| *** csomerville has quit IRC | 17:47 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Do not merge: Test python-heat-agents package build https://review.openstack.org/439178 | 17:47 |
| *** rbrndt__ has quit IRC | 17:50 | |
| *** funzo_ has joined #openstack-infra | 17:53 | |
| *** kzaitsev_mb has joined #openstack-infra | 17:54 | |
| *** nicolasbock has joined #openstack-infra | 17:55 | |
| *** funzo_ has quit IRC | 17:58 | |
| *** Sukhdev has joined #openstack-infra | 17:58 | |
| *** gyee has joined #openstack-infra | 17:59 | |
| *** Sukhdev has quit IRC | 18:00 | |
| mnaser | is there a common workaround for avoiding keyserver connectivity problems that has been done in other jobs? | 18:10 |
| mnaser | http://logs.openstack.org/53/447053/1/check/gate-kolla-dsvm-build-ubuntu-binary-ubuntu-xenial-nv/23cde4b/console.html#_2017-03-17_16_26_59_937285 | 18:10 |
| *** armax has quit IRC | 18:10 | |
| mnaser | or do other projects just throw a recheck and move on? | 18:11 |
| *** Sukhdev has joined #openstack-infra | 18:11 | |
| clarkb | mnaser: most jobs use our mirrors (which are currently unsigned because reprepro) | 18:12 |
| *** nadya has joined #openstack-infra | 18:12 | |
| mnaser | clarkb hmm, i see.. probably a bit harder to do this in our case - https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L248-L255 | 18:12 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Isolate encryption-related methods https://review.openstack.org/447087 | 18:12 |
| mnaser | and the keys are being added regardless | 18:12 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Augment references of pkcs1 with oaep https://review.openstack.org/447088 | 18:12 |
| mnaser | i'll give this thought | 18:12 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-db jobs https://review.openstack.org/447089 | 18:13 |
| *** armax has joined #openstack-infra | 18:14 | |
| vkmc | hey infra team! I'd need to register a new IRC channel and add a forwarder to it, could someone point me towards the right direction for doing that? | 18:14 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-db jobs https://review.openstack.org/447089 | 18:14 |
| *** ociuhandu has quit IRC | 18:14 | |
| pleia2 | vkmc: this page has everything you need, at the bottom it explains how to set up a forwarder https://docs.openstack.org/infra/system-config/irc.html | 18:15 |
| vkmc | pleia2, thanks! | 18:15 |
| *** e0ne has joined #openstack-infra | 18:16 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Use stevedore for module config of block device https://review.openstack.org/447090 | 18:16 |
| *** nadya has quit IRC | 18:17 | |
| clarkb | mnaser: I wonder if you are getting rate limited | 18:17 |
| clarkb | especially if being forced through ipv4 nat and other jobs doing the same at the same time | 18:18 |
| *** ym200 has quit IRC | 18:18 | |
| mnaser | clarkb i guess that could be a reason for failures | 18:18 |
| mnaser | i am not a gpg expert so im not sure if we can maintain these keys in repo | 18:18 |
| clarkb | mnaser: pretty sure you can | 18:19 |
| clarkb | apt-key add $filename | 18:19 |
| mnaser | clarkb ill look into it :> | 18:20 |
| mnaser | i dont know how kolla folks feel about maintaining these keys in repo | 18:20 |
| clarkb | mnaser: honestly its not much different than maintaining the key fingerprint directly right? | 18:21 |
| clarkb | fungi: ^ can you confirm that? | 18:21 |
| *** Sukhdev has quit IRC | 18:21 | |
| clarkb | basically fingerprint maps directly to key aiui so you are maintaining it either way | 18:21 |
| mnaser | okay so a fingerprint is aliased or something like that | 18:21 |
| mnaser | *isnt | 18:21 |
| clarkb | https://packages.elastic.co/GPG-KEY-elasticsearch is elasticsaerch's key | 18:21 |
| *** mdrabe has quit IRC | 18:22 | |
| clarkb | nibalizer: you likely also know^, if fetching keys by fingerprint from keyserver and those fingerprints are hardcoded today is that significantly different than just storing the entire key locally and loading it? | 18:23 |
| clarkb | nibalizer: either way if key chagnes something has to be updated where hardcoded ya? | 18:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-db jobs https://review.openstack.org/447089 | 18:25 |
| *** burgerk_ has joined #openstack-infra | 18:26 | |
| *** rbrndt__ has joined #openstack-infra | 18:28 | |
| *** pblaho has quit IRC | 18:29 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-db jobs https://review.openstack.org/447089 | 18:29 |
| *** burgerk has quit IRC | 18:29 | |
| *** rbrndt__ has quit IRC | 18:30 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Do not merge: Test python-heat-agents package build https://review.openstack.org/439178 | 18:32 |
| clarkb | the fedora job we run against d-g changes takes a really really long time to fail | 18:32 |
| *** mdrabe has joined #openstack-infra | 18:34 | |
| *** rbrndt__ has joined #openstack-infra | 18:37 | |
| *** rhallisey has quit IRC | 18:37 | |
| *** esikachev has quit IRC | 18:38 | |
| *** rhallisey has joined #openstack-infra | 18:38 | |
| *** ihrachys has joined #openstack-infra | 18:38 | |
| *** annegentle has joined #openstack-infra | 18:41 | |
| *** john-davidge has quit IRC | 18:41 | |
| *** ihrachys_ has quit IRC | 18:41 | |
| *** Gravious has joined #openstack-infra | 18:42 | |
| *** trown is now known as trown|brb | 18:43 | |
| *** david-lyle_ is now known as david-lyle | 18:43 | |
| *** e0ne has quit IRC | 18:45 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-db jobs https://review.openstack.org/447089 | 18:47 |
| *** tesseract has quit IRC | 18:50 | |
| *** funzo has joined #openstack-infra | 18:54 | |
| *** kaisers has quit IRC | 18:54 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Don't run nova-cert by default https://review.openstack.org/446986 | 18:55 |
| *** annegentle has quit IRC | 18:56 | |
| *** annegentle has joined #openstack-infra | 18:57 | |
| *** cody-somerville has joined #openstack-infra | 18:57 | |
| *** tosky has quit IRC | 18:58 | |
| *** funzo has quit IRC | 18:59 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Use stevedore for module config of block device https://review.openstack.org/447090 | 18:59 |
| *** IRCFReAK has joined #openstack-infra | 18:59 | |
| *** Sukhdev has joined #openstack-infra | 19:00 | |
| *** burgerk_ has quit IRC | 19:01 | |
| *** IRCFReAK has quit IRC | 19:01 | |
| *** csomerville has joined #openstack-infra | 19:02 | |
| *** ssbarnea has quit IRC | 19:03 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: [WIP] Create tox-db jobs https://review.openstack.org/447089 | 19:04 |
| *** ssbarnea has joined #openstack-infra | 19:04 | |
| *** cody-somerville has quit IRC | 19:05 | |
| *** aspiers has quit IRC | 19:06 | |
| *** IRCFReAK has joined #openstack-infra | 19:06 | |
| *** aspiers has joined #openstack-infra | 19:07 | |
| *** amoralej is now known as amoralej|off | 19:09 | |
| *** kaisers has joined #openstack-infra | 19:11 | |
| *** florianf has quit IRC | 19:12 | |
| *** esikachev has joined #openstack-infra | 19:12 | |
| *** IRCFReAK has joined #openstack-infra | 19:16 | |
| *** esikachev has quit IRC | 19:16 | |
| AJaeger | sdague, mriedem: Could you review this change since it adds a new job for nova, please? https://review.openstack.org/#/c/437150/3 | 19:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: [WIP] Create tox-db jobs https://review.openstack.org/447089 | 19:17 |
| *** ssbarnea has quit IRC | 19:17 | |
| mriedem | AJaeger: that runs on the requirements repo, not nova | 19:18 |
| AJaeger | sdague, mriedem : Sorry, it runs on requirements - | 19:18 |
| mriedem | it's running the nova functional job | 19:18 |
| mriedem | yeah :) | 19:18 |
| *** IRCFReAK has quit IRC | 19:18 | |
| mriedem | so i'm fine with it | 19:18 |
| AJaeger | mriedem: yeah, got confused ;( | 19:18 |
| AJaeger | mriedem: thanks | 19:18 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Create run-cover role https://review.openstack.org/441332 | 19:18 |
| *** esikachev has joined #openstack-infra | 19:19 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add run-docs role and tox-docs job https://review.openstack.org/441345 | 19:20 |
| fungi | mnaser: clarkb: `apt-key add ...` is sorta deprecated these days. you can just add raw (not ascii-armored) public archive keys one per file in the /etc/apt/trusted.gpg.d/ directory | 19:21 |
| mnaser | fungi oh i see | 19:22 |
| mnaser | i did a bunch of apt-key add's instead | 19:22 |
| mnaser | i figured there was a way to do that | 19:22 |
| fungi | but regardless, if you already know the key fingerprint there's little reason for automation to grab the key every time. the key corresponding to a fingerprint will never change fundamentally (the keyservers may have some extra signatures attached to it, but that's irrelevant unless you're a human doing some trust analysis) | 19:23 |
| *** vsaienko has quit IRC | 19:23 | |
| clarkb | fungi: manpage doesn't say anything about deprecation :( | 19:23 |
| mnaser | fungi the whole reason behind this is to eliminate keyserver.ubuntu.com from causing failures to a job pretty much | 19:23 |
| mnaser | how i went about it but i'm open for better ways - https://review.openstack.org/#/c/447101/ | 19:23 |
| fungi | clarkb: hence the "sorta" | 19:24 |
| fungi | it's a lot of unnecessary wrapper any more | 19:24 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Isolate encryption-related methods https://review.openstack.org/447087 | 19:24 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Augment references of pkcs1 with oaep https://review.openstack.org/447088 | 19:24 |
| *** esikachev has quit IRC | 19:24 | |
| mnaser | i mean i can just copy stuff directly in, instead of copying, apt-key add, delete tmp files | 19:24 |
| mnaser | so it would be much cleaner | 19:24 |
| clarkb | mnaser: thats how I would've done it based on reading docs, but fungi's suggestion would be cleaner | 19:25 |
| * fungi is finding the not-too-recent debian-devel discussion about that | 19:25 | |
| openstackgerrit | Merged openstack-infra/project-config master: Run nova functional tests on upper-constraints.txt changes https://review.openstack.org/437150 | 19:26 |
| *** ssbarnea has joined #openstack-infra | 19:26 | |
| openstackgerrit | Terry Wilson proposed openstack-infra/project-config master: ovsdbapp: Add functional job to check queue https://review.openstack.org/446953 | 19:27 |
| * mnaser can't find a way to generate the needed file in trusted.gpg.d :X | 19:28 | |
| *** vsaienko has joined #openstack-infra | 19:28 | |
| *** psachin has joined #openstack-infra | 19:29 | |
| *** esikachev has joined #openstack-infra | 19:29 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create zuul_workspace_root job variable https://review.openstack.org/441441 | 19:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Organize playbooks folder https://review.openstack.org/441547 | 19:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add net-info to bootstrap role https://review.openstack.org/441617 | 19:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add revoke-sudo role and update tox jobs https://review.openstack.org/441467 | 19:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-tarball job https://review.openstack.org/441609 | 19:30 |
| fungi | mnaser: if you have an ascii-armored (result of gpg --export --armor) public key, you can use gpg --dearmor on it to switch it to regular binary form | 19:30 |
| *** dizquierdo_afk has quit IRC | 19:31 | |
| *** esikachev has quit IRC | 19:34 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Reduce infracloud-vanilla max-servers by 10 https://review.openstack.org/447108 | 19:34 |
| fungi | aha, it's called out in the add section of more recent versions of the apt-key manpage: https://manpages.debian.org/unstable/apt/apt-key.8.en.html#COMMANDS | 19:36 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add infracloud-vanilla to nl01.o.o https://review.openstack.org/447109 | 19:37 |
| fungi | looks like that note was added between jessie and stretch | 19:37 |
| fungi | apparently you can also add them in ascii-armored format if you use a .asc extension on the file instead of .gpg | 19:38 |
| clarkb | which is probably nicer for people using git | 19:38 |
| fungi | yup | 19:38 |
| *** bh526r has quit IRC | 19:38 | |
| fungi | and /etc/apt/trusted.gpg.d exists on ubuntu at least as far back as precise | 19:39 |
| fungi | i don't have any systems older than that handy to check | 19:39 |
| mnaser | it exists on xenial and tahts what matters for us | 19:39 |
| mnaser | ill try copying them over and see what happens (with .asc extension) | 19:40 |
| fungi | oh... .asc files look like they need gpg 1.4 or later and xenial is still 1.2.19 :( | 19:41 |
| *** john-davidge has joined #openstack-infra | 19:41 | |
| fungi | so according to https://manpages.debian.org/testing/apt/apt-key.8.en.html#SUPPORTED_KEYRING_FILES you need to use regular binary --export (--dearmor if you're converting from the result of --export --armor) with the apt release on ubuntu xenial | 19:42 |
| fungi | only ubuntu zesty is new enough to support that | 19:43 |
| fungi | i meant apt 1.4 or later of course, not gpg 1.4 or later | 19:43 |
| *** shardy has quit IRC | 19:44 | |
| *** dhajare has quit IRC | 19:44 | |
| fungi | so .gpg (binary) file support should work as far back as we're able to test, but .asc file support is very new | 19:44 |
| fungi | so you're either stuck checking binary files into git, or relying on hiera's yaml binhex translation, or running gpg --dearmor on the file before installing the result | 19:45 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Always execute autorelabel https://review.openstack.org/447076 | 19:46 |
| fungi | sticking the binary .gpg files into hiera is probably the cleanest option | 19:46 |
| mnaser | i guess i could revise the patch to do that | 19:46 |
| fungi | since the representation in hiera will be ascii but puppet will get the binary version | 19:46 |
| *** vhosakot has joined #openstack-infra | 19:46 | |
| *** john-davidge has quit IRC | 19:46 | |
| mnaser | so how could i consume this in a CI job for example? | 19:47 |
| fungi | depends a lot on what your test framework looks like, i think | 19:47 |
| *** vsaienko has quit IRC | 19:48 | |
| fungi | my hiera mention was assuming this was being handled in a puppet module, but i likely missed some of the backstory | 19:48 |
| fungi | how are you setting up the alternative repos you're using? | 19:48 |
| fungi | in the test environment | 19:49 |
| *** esikachev has joined #openstack-infra | 19:50 | |
| *** xyang1 has joined #openstack-infra | 19:52 | |
| *** vsaienko has joined #openstack-infra | 19:52 | |
| *** trown|brb is now known as trown | 19:54 | |
| *** funzo has joined #openstack-infra | 19:55 | |
| *** d0ugal has quit IRC | 19:56 | |
| *** dimtruck is now known as zz_dimtruck | 19:58 | |
| openstackgerrit | Merged openstack-infra/infra-specs master: Zuul v3: remove references to swift https://review.openstack.org/443984 | 19:58 |
| *** funzo has quit IRC | 19:59 | |
| openstackgerrit | Merged openstack-infra/infra-specs master: Zuul v3: update job trees to graphs https://review.openstack.org/443985 | 20:02 |
| *** vsaienko has quit IRC | 20:07 | |
| *** dave-mccowan has quit IRC | 20:07 | |
| *** vsaienko has joined #openstack-infra | 20:08 | |
| *** vgridnev has joined #openstack-infra | 20:09 | |
| *** IRCFReAK has joined #openstack-infra | 20:10 | |
| *** psachin has quit IRC | 20:10 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate master: Enable memory_tracker in gate for Pike https://review.openstack.org/434474 | 20:11 |
| *** d0ugal has joined #openstack-infra | 20:12 | |
| *** vsaienko has quit IRC | 20:13 | |
| *** IRCFReAK has quit IRC | 20:13 | |
| *** Goneri has quit IRC | 20:13 | |
| mnaser | fungi sorry disappeared - https://review.openstack.org/#/c/447101/ | 20:13 |
| *** vsaienko has joined #openstack-infra | 20:15 | |
| fungi | aha, so jinja-based | 20:15 |
| *** Sukhdev has quit IRC | 20:15 | |
| openstackgerrit | Merged openstack-infra/infra-specs master: Zuulv3: clarify job dependencies example https://review.openstack.org/445022 | 20:16 |
| openstackgerrit | Corey O'Brien proposed openstack/diskimage-builder master: Don't unmount missing paths If the path is missing, unmount_dir fails and skips the EXTRA_DETACH and EXTRA_UNMOUNT steps https://review.openstack.org/446621 | 20:16 |
| fungi | mnaser: so i guess in that case, unless jinja has an internal ascii-based representation of binary blobs it can use, i guess you're stuck either calling out to apt-key add or gpg --dearmor redirected into /etc/apt/trusted.gpg.d/something.gpg so probably equally messy | 20:17 |
| mnaser | fungi: or i could dearmor them and store the dearmored values and copy them in.. but that seems like it would make it harder to maintain and store in git | 20:18 |
| fungi | but either of those is way better than pulling it over the network every job run | 20:18 |
| fungi | mnaser: yeah, storing the binary blobs directly in git is a third option, agreed (with the downsides that brings) | 20:18 |
| mnaser | fungi: thanks for your thoughts about this, im trying to put in as much effort to make kolla tests have to be rechecked often | 20:19 |
| fungi | when you can eventually stop caring about apt < 1.4, you can just write the armored keys directly into trusted.gpg.d instead but that's probably a couple years away | 20:19 |
| *** Sukhdev has joined #openstack-infra | 20:21 | |
| mnaser | likely the bets route to take | 20:21 |
| mnaser | best* | 20:21 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Use stevedore for module config of block device https://review.openstack.org/447090 | 20:25 |
| *** yolanda has quit IRC | 20:26 | |
| *** yolanda has joined #openstack-infra | 20:26 | |
| openstackgerrit | Victoria Martinez de la Cruz proposed openstack-infra/system-config master: Move #openstack-opw to #openstack-outreachy https://review.openstack.org/447125 | 20:27 |
| *** zz_dimtruck is now known as dimtruck | 20:30 | |
| *** IRCFReAK has joined #openstack-infra | 20:30 | |
| *** vgridnev has quit IRC | 20:30 | |
| *** uberjay has quit IRC | 20:31 | |
| vkmc | pleia2, I don't have permissions to do this, I only have op access https://docs.openstack.org/infra/system-config/irc.html#renaming-an-irc-channel | 20:31 |
| *** uberjay has joined #openstack-infra | 20:32 | |
| vkmc | pleia2, openstackinfra should have FOP access, so if you can do that for me, I'd be grateful | 20:32 |
| *** ihrachys has quit IRC | 20:32 | |
| *** kzaitsev_mb has quit IRC | 20:32 | |
| *** IRCFReAK has quit IRC | 20:32 | |
| *** john-davidge has joined #openstack-infra | 20:34 | |
| * pleia2 has a look | 20:34 | |
| *** IRCFReAK has joined #openstack-infra | 20:35 | |
| pleia2 | vkmc: I think you need to temporarily op me in #openstack-outreachy for me to finish | 20:36 |
| vkmc | pleia2, sure thing | 20:36 |
| pleia2 | ok, all done :) | 20:37 |
| pleia2 | people who try to join -opw will be redirected | 20:37 |
| *** panda|bbl is now known as panda | 20:37 | |
| vkmc | awesome | 20:37 |
| vkmc | thanks pleia2! | 20:37 |
| *** esikachev has quit IRC | 20:38 | |
| pleia2 | vkmc: you'll also need to update project-config for accessbot so it adds all the right owners: http://git.openstack.org/cgit/openstack-infra/project-config/tree/accessbot/channels.yaml#n187 | 20:39 |
| vkmc | pleia2, great, I'm on it | 20:39 |
| *** jcoufal has quit IRC | 20:39 | |
| *** IRCFReAK has joined #openstack-infra | 20:40 | |
| *** IRCFReAK has left #openstack-infra | 20:40 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Handle trailing commas in source libs list https://review.openstack.org/447037 | 20:41 |
| *** xyang1 has quit IRC | 20:42 | |
| openstackgerrit | Victoria Martinez de la Cruz proposed openstack-infra/project-config master: Move #openstack-opw to #openstack-outreachy https://review.openstack.org/447131 | 20:43 |
| *** esikachev has joined #openstack-infra | 20:43 | |
| *** IRCFReAK has joined #openstack-infra | 20:43 | |
| *** IRCFReAK has quit IRC | 20:45 | |
| *** xyang1 has joined #openstack-infra | 20:46 | |
| *** dprince has quit IRC | 20:46 | |
| *** IRCFReAK has joined #openstack-infra | 20:48 | |
| *** esikachev has quit IRC | 20:49 | |
| *** neiljerram has joined #openstack-infra | 20:49 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Decrypt secrets and plumb to Ansible https://review.openstack.org/446688 | 20:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Isolate encryption-related methods https://review.openstack.org/447087 | 20:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add secret top-level config object https://review.openstack.org/446156 | 20:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Improve job dependencies using graph instead of tree https://review.openstack.org/443973 | 20:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Augment references of pkcs1 with oaep https://review.openstack.org/447088 | 20:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Associate secrets with jobs https://review.openstack.org/446687 | 20:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add per-repo public and private keys https://review.openstack.org/406382 | 20:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Serve public keys through webapp https://review.openstack.org/446756 | 20:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add support for job allowed-projects https://review.openstack.org/447134 | 20:49 |
| *** IRCFReAK has quit IRC | 20:50 | |
| *** csomerville has quit IRC | 20:50 | |
| *** csomerville has joined #openstack-infra | 20:50 | |
| *** esikachev has joined #openstack-infra | 20:52 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: DNR/TMP Increase tempest concurrency to 4 https://review.openstack.org/447136 | 20:54 |
| clarkb | vsaienk0: TEMPEST_CONCURRENCY should default to 4 on our 8 vcpu instances iirc | 20:55 |
| clarkb | vsaienk0: I wouldn't hard code it to 4 though as we may end up with hosts with fewer or more vcpus at some point in the future | 20:55 |
| *** funzo has joined #openstack-infra | 20:55 | |
| *** Sukhdev has quit IRC | 20:56 | |
| *** esikachev has quit IRC | 20:57 | |
| *** IRCFReAK has joined #openstack-infra | 20:58 | |
| *** funzo has quit IRC | 21:00 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add support for job allowed-projects https://review.openstack.org/447134 | 21:01 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add 'allow-secrets' pipeline attribute https://review.openstack.org/447138 | 21:01 |
| *** IRCFReAK has joined #openstack-infra | 21:02 | |
| * IRCFReAK i beliv i can fly | 21:02 | |
| *** IRCFReAK has quit IRC | 21:02 | |
| *** eharney has quit IRC | 21:03 | |
| *** vgridnev has joined #openstack-infra | 21:04 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: Hot fix: export DEVSTACK_GATE_SAHARA in scripts https://review.openstack.org/447140 | 21:04 |
| vgridnev | Folks, please review hot fix for Sahara's jobs ^^ | 21:04 |
| *** aysyd has quit IRC | 21:05 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Decrypt secrets and plumb to Ansible https://review.openstack.org/446688 | 21:05 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add 'allow-secrets' pipeline attribute https://review.openstack.org/447138 | 21:05 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Isolate encryption-related methods https://review.openstack.org/447087 | 21:05 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add secret top-level config object https://review.openstack.org/446156 | 21:05 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Improve job dependencies using graph instead of tree https://review.openstack.org/443973 | 21:05 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Augment references of pkcs1 with oaep https://review.openstack.org/447088 | 21:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Associate secrets with jobs https://review.openstack.org/446687 | 21:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add support for job allowed-projects https://review.openstack.org/447134 | 21:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add per-repo public and private keys https://review.openstack.org/406382 | 21:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Serve public keys through webapp https://review.openstack.org/446756 | 21:06 |
| *** jkilpatr has quit IRC | 21:07 | |
| *** givemeparttt2000 has joined #openstack-infra | 21:08 | |
| *** trown is now known as trown|outtypewww | 21:08 | |
| *** givemeparttt2000 has quit IRC | 21:09 | |
| *** john-davidge has quit IRC | 21:09 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes https://review.openstack.org/447142 | 21:09 |
| *** gugl has joined #openstack-infra | 21:10 | |
| gugl | fungi, are you there? | 21:10 |
| *** john-davidge has joined #openstack-infra | 21:11 | |
| *** annegentle has quit IRC | 21:11 | |
| *** rlandy has quit IRC | 21:11 | |
| *** givemeparttt2000 has joined #openstack-infra | 21:14 | |
| *** givemeparttt2000 has quit IRC | 21:15 | |
| *** vsaienko has quit IRC | 21:17 | |
| *** vsaienko has joined #openstack-infra | 21:19 | |
| *** givemeparttt2000 has joined #openstack-infra | 21:20 | |
| *** vgridnev has quit IRC | 21:20 | |
| openstackgerrit | Jamie Lennox proposed openstack-infra/nodepool feature/zuulv3: Split webapp into its own nodepool application https://review.openstack.org/445675 | 21:20 |
| *** givemeparttt2000 has quit IRC | 21:21 | |
| *** esikachev has joined #openstack-infra | 21:23 | |
| fungi | gugl: regarding the conversation in #openstack-horizon i guess? | 21:24 |
| fungi | what was the e-mail address it went to? i can resend/reroute it for you | 21:24 |
| *** alex_xu has quit IRC | 21:25 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Rename NodeCleanupWorker to DeletedNodeWorker https://review.openstack.org/446649 | 21:26 |
| *** pradk has quit IRC | 21:26 | |
| openstackgerrit | Jamie Lennox proposed openstack-infra/nodepool feature/zuulv3: Allow loading logging config from yaml https://review.openstack.org/445656 | 21:27 |
| mnaser | would anyone @ infra have any suggestion for tools which can help troubleshoot profile network access in jobs? | 21:27 |
| jeblair | clarkb, fungi: https://review.openstack.org/447140 | 21:27 |
| *** esikachev has quit IRC | 21:27 | |
| mnaser | kolla centos build jobs take twice as long as xenial.. so im just trying to scope out if its more things being downloaded from out-of-mirrors or what | 21:28 |
| clarkb | mnaser: what is "profile network access" | 21:28 |
| *** alex_xu has joined #openstack-infra | 21:28 | |
| clarkb | oh general profiling derp | 21:28 |
| mnaser | ex: is this build spending most of its time downloading things that can be mirrored type of thing | 21:28 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Create BaseCleanupWorker class https://review.openstack.org/446650 | 21:28 |
| mnaser | so we're slowing down because we're hitting $mirror | 21:28 |
| clarkb | mnaser: just off the top of my head, yum is really really slow | 21:29 |
| fungi | mnaser: maybe you could just dump interface counters at the start and end... might help you get a baseline comparison on overall network utilization | 21:29 |
| mnaser | fungi: true, but i think the problem here is that this would still make it hard to know if we're hitting mirrors or not :( | 21:29 |
| mnaser | by mirrors => region local mirrors | 21:29 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Split DeleteNodeWorker into two threads https://review.openstack.org/446651 | 21:30 |
| fungi | mnaser: true. for that you might want some sort of flow-based stats | 21:30 |
| *** gordc has quit IRC | 21:30 | |
| mnaser | fungi and my googling was either most tools had some weird licensing (ntop, etc) or havent been touched for years (fprobe, ipt-netflow) :p | 21:31 |
| mnaser | hence me asking if perhaps someone had any luck in the past | 21:31 |
| clarkb | mnaser: the first thing I would check is if you are using the local mirror properly | 21:31 |
| clarkb | that should be fairly easy to confirm (check yum config/output) | 21:31 |
| *** esikachev has joined #openstack-infra | 21:32 | |
| mnaser | as silly as it sounds i wanted to try and setup a local squid proxy, point http_proxy to it and see what requests go where | 21:32 |
| mnaser | i believe we're good on that (mostly) https://github.com/openstack/kolla/blob/master/tools/setup_gate.sh#L35-L81 | 21:32 |
| *** gouthamr has quit IRC | 21:33 | |
| *** tosky has joined #openstack-infra | 21:33 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Improve job dependencies using graph instead of tree https://review.openstack.org/443973 | 21:33 |
| gugl | fungi, yes, please resend it to my new email address gloria.fang.gu@suse.com | 21:35 |
| *** Jeffrey4l has quit IRC | 21:35 | |
| fungi | gugl: i need to know what the old address was as well so i can look up the right code for you | 21:35 |
| openstackgerrit | Merged openstack-infra/project-config master: Hot fix: export DEVSTACK_GATE_SAHARA in scripts https://review.openstack.org/447140 | 21:36 |
| *** Jeffrey4l has joined #openstack-infra | 21:36 | |
| gugl | fungi, gloria.gu@hpe.com | 21:37 |
| *** esikachev has quit IRC | 21:37 | |
| gugl | fungi, or gloria-fang.gu@hpe.com | 21:37 |
| clarkb | mnaser: if you compare http://logs.openstack.org/19/447119/1/check/gate-tempest-dsvm-neutron-full-centos-7-nv/7967f19/logs/devstacklog.txt.gz#_2017-03-17_20_20_06_552 to http://logs.openstack.org/19/447119/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/bd62fe3/logs/devstacklog.txt.gz#_2017-03-17_20_15_46_299 the apt get time vs yum time is the same for those jobs | 21:38 |
| fungi | gugl: looks like it was that first one which received it. i'll resend it to your new address in just a minute | 21:38 |
| *** IRCFrEAK has joined #openstack-infra | 21:38 | |
| *** esikachev has joined #openstack-infra | 21:39 | |
| gugl | fungi, thanks | 21:39 |
| david-lyle | thanks fungi | 21:40 |
| *** esberglu has quit IRC | 21:41 | |
| fungi | gugl: check your e-mail, it's sent and should arrive shortly. if it doesn't, please let me know | 21:41 |
| *** baoli has quit IRC | 21:42 | |
| *** leakypipes has quit IRC | 21:43 | |
| *** IRCFrEAK has quit IRC | 21:43 | |
| *** esikachev has quit IRC | 21:43 | |
| openstackgerrit | Luigi Toscano proposed openstack-infra/project-config master: tempest/layer4: explicitly enable Sahara and Trove https://review.openstack.org/447147 | 21:44 |
| *** vsaienko has quit IRC | 21:45 | |
| openstackgerrit | James E. Blair proposed openstack/gertty master: Allow negative comparison on null topics https://review.openstack.org/447148 | 21:46 |
| jeblair | it's been a while since i've had a bugfix in the search parser | 21:47 |
| gugl | fungi, got it thanks! | 21:47 |
| fungi | gugl: you're welcome--enjoy the summit! | 21:47 |
| gugl | fungi, :) | 21:48 |
| *** xyang1 has quit IRC | 21:48 | |
| *** cody-somerville has joined #openstack-infra | 21:49 | |
| *** vsaienko has joined #openstack-infra | 21:49 | |
| *** csomerville has quit IRC | 21:51 | |
| clarkb | jroll: JayF dtantsur|afk hey I am fiddling with enabling kernel samepage merging in gate jobs and was wondering where does ironic set up its libvirt based "baremetal" and do you think there would be a benefit to having those VMs share pages? | 21:52 |
| clarkb | eg you are running more than 1 now right? | 21:52 |
| *** esikachev has joined #openstack-infra | 21:53 | |
| *** dkehn_ has joined #openstack-infra | 21:55 | |
| amrith | clarkb, I'm confused by https://review.openstack.org/#/c/447147/ and https://review.openstack.org/#/c/447140/. should trove do like sahara and push an explict setting of flags, or will the change from 447147 persist so trove doesn't need to do anything | 21:56 |
| *** funzo has joined #openstack-infra | 21:56 | |
| clarkb | amrith: do your jobs not already set the flag? | 21:56 |
| tosky | amrith: 447147 is only for the layer4 job; you may want to enable it on your jobs | 21:57 |
| *** gouthamr has joined #openstack-infra | 21:57 | |
| clarkb | you'll need to set the flag or we should remove the flag as the public d-g interface if its not desired | 21:57 |
| amrith | hmm | 21:57 |
| tosky | amrith: either enable DEVSTACK_GATE_TROVE, or explicitly populate PROJECTS | 21:57 |
| amrith | ok, will look into it over the weekend | 21:57 |
| clarkb | basically d-g has a flag for enabling trove | 21:57 |
| amrith | the failure I'm getting appears to be weird http://logs.openstack.org/68/445768/2/check/gate-trove-functional-dsvm-mysql-ubuntu-xenial/9b94bfb/console.html#_2017-03-17_02_03_27_114094 | 21:57 |
| clarkb | it apparently isnt being used so we should remove it or decide its useful and use it | 21:58 |
| amrith | I'm not positive it is the same thing | 21:58 |
| amrith | let me dig into it some more | 21:58 |
| jeblair | amrith: i think that's a red herring; i see it a lot | 21:58 |
| amrith | but it is st patrick's day, and if it is a religious holiday (which includes beer) I am going to celebrate it with gusto | 21:58 |
| jeblair | amrith: (i think it's a harmless error in diagnostic code in the cleanup phase) | 21:58 |
| amrith | thanks jeblair | 21:59 |
| amrith | will dig into it more | 21:59 |
| amrith | I assume that the real failure is http://logs.openstack.org/68/445768/2/check/gate-trove-functional-dsvm-mysql-ubuntu-xenial/9b94bfb/logs/devstacklog.txt.gz#_2017-03-17_02_03_25_967 | 21:59 |
| jeblair | amrith: yeah, this error suggests that the flag needs to be added http://logs.openstack.org/68/445768/2/check/gate-trove-functional-dsvm-mysql-ubuntu-xenial/9b94bfb/logs/devstacklog.txt.gz#_2017-03-17_02_03_25_967 | 22:00 |
| amrith | which is what this set of changes above relates to | 22:00 |
| jeblair | amrith: yep | 22:00 |
| amrith | YUP, on that note. it is beer o'clock | 22:00 |
| jeblair | amrith: cheers | 22:00 |
| amrith | happy st. patrick's day weekend y'all | 22:00 |
| amrith | jeblair, clarkb I will raise a pitcher to you | 22:00 |
| amrith | please raise a barrel or two for me | 22:00 |
| jeblair | amrith: you got it :) | 22:00 |
| *** esikachev has quit IRC | 22:01 | |
| *** funzo has quit IRC | 22:01 | |
| clarkb | I only have 4 cans of guiness | 22:02 |
| clarkb | that will have to be sufficient | 22:02 |
| *** vsaienko has quit IRC | 22:03 | |
| openstackgerrit | Merged openstack-infra/project-config master: tempest/layer4: explicitly enable Sahara and Trove https://review.openstack.org/447147 | 22:04 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/zuul feature/zuulv3: Reenable test_build_configuration_conflict https://review.openstack.org/446275 | 22:07 |
| *** dkehn_ has quit IRC | 22:08 | |
| *** vsaienko has joined #openstack-infra | 22:09 | |
| *** yamahata has quit IRC | 22:10 | |
| amrith | clarkb, that'll do just fine :) | 22:13 |
| *** mdrabe has quit IRC | 22:15 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Create zuul_workspace_root job variable https://review.openstack.org/447152 | 22:17 |
| *** xarses has quit IRC | 22:19 | |
| *** IRCFrEAK has joined #openstack-infra | 22:29 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/devstack-gate master: Add sahara to features.yaml in subnode https://review.openstack.org/447158 | 22:30 |
| *** IRCFrEAK has quit IRC | 22:31 | |
| *** vsaienko has quit IRC | 22:34 | |
| *** IRCFrEAK has joined #openstack-infra | 22:37 | |
| *** vsaienko has joined #openstack-infra | 22:38 | |
| *** gongysh has joined #openstack-infra | 22:40 | |
| *** IRCFrEAK has quit IRC | 22:41 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 22:43 |
| *** timello has quit IRC | 22:44 | |
| *** Sukhdev has joined #openstack-infra | 22:44 | |
| *** ssbarnea has quit IRC | 22:45 | |
| *** timello has joined #openstack-infra | 22:47 | |
| *** dimtruck is now known as zz_dimtruck | 22:51 | |
| *** esikachev has joined #openstack-infra | 22:51 | |
| *** vsaienko has quit IRC | 22:54 | |
| *** ociuhandu has joined #openstack-infra | 22:54 | |
| *** john-dav_ has joined #openstack-infra | 22:55 | |
| *** john-davidge has quit IRC | 22:55 | |
| *** asselin has joined #openstack-infra | 22:55 | |
| *** esikachev has quit IRC | 22:56 | |
| *** superdan is now known as dansmith | 22:57 | |
| *** funzo has joined #openstack-infra | 22:57 | |
| *** vsaienko has joined #openstack-infra | 22:59 | |
| *** esikachev has joined #openstack-infra | 22:59 | |
| *** ociuhandu has quit IRC | 22:59 | |
| *** IRCFrEAK has joined #openstack-infra | 23:00 | |
| *** john-dav_ has quit IRC | 23:01 | |
| *** jbadiapa has quit IRC | 23:01 | |
| *** funzo has quit IRC | 23:02 | |
| mnaser | clarkb thanks for looking @ that, 3 minute difference between xenial and centos 7 means that the issue could stem in kolla | 23:02 |
| *** IRCFrEAK has quit IRC | 23:02 | |
| mnaser | ill try to spend sometime this weekend seeing where we can benefit from speedups | 23:03 |
| clarkb | mnaser: are you building into a filesystem? | 23:05 |
| *** esikachev has quit IRC | 23:05 | |
| *** ociuhandu has joined #openstack-infra | 23:05 | |
| clarkb | mnaser: er, "nested" filesystem? wonder if possibly some layering there is causing problems | 23:05 |
| *** vsaienko has quit IRC | 23:05 | |
| mnaser | clarkb i think kolla uses btrfs in gate | 23:06 |
| mnaser | but docker docs say "As far as Docker on the Linux platform goes, many people see the btrfs storage driver as a potential long-term replacement for the devicemapper storage driver. However, at the time of writing, the devicemapper storage driver should be considered safer, more stable, and more production ready. You should only consider the btrfs driver for production deployments if you understand it well and have existing experience with | 23:06 |
| mnaser | Btrfs." | 23:06 |
| mnaser | in my experience devicemapper is much more powerful | 23:07 |
| mnaser | i think now that im thinking, it could be that. because the kernels in xenial are much newer, btrfs could perform much better | 23:07 |
| *** ociuhandu has quit IRC | 23:09 | |
| fungi | i got burned by btrfs a few years back when i ran into some filesystem corruption and it didn't have a fsck yet. at least i had backups other than btrfs snapshotting | 23:10 |
| fungi | i gather it's improved a lot in more recent years though, so should probably give it another shot | 23:11 |
| clarkb | I took the btrfs plunge on my tumbleweed box (and have explicitly avoided putting data I care about on it | 23:11 |
| *** rbrndt__ has quit IRC | 23:11 | |
| clarkb | its been fine so far, and the snapshot integration wtih package manager is neat | 23:11 |
| clarkb | but I haven't really needed ti for anything either | 23:11 |
| fungi | yeah, even years ago it worked great for me... until one morning it didn't | 23:11 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Simplify the log url https://review.openstack.org/438028 | 23:11 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove url_pattern config parameter https://review.openstack.org/447165 | 23:11 |
| fungi | when it broke though, it broke with a vengeance | 23:12 |
| *** jamesdenton has joined #openstack-infra | 23:12 | |
| clarkb | I also had to ninja fix xmonad the other day which ws fun. havn'et had to read/write haskell in a while | 23:13 |
| *** erlon has quit IRC | 23:15 | |
| *** jamesden_ has joined #openstack-infra | 23:16 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Port SQLAlchemy reporter to v3 driver structure https://review.openstack.org/442114 | 23:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove more swift configurations https://review.openstack.org/446056 | 23:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: [WIP] Create tox-db jobs https://review.openstack.org/447089 | 23:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move alembic into sql driver https://review.openstack.org/442124 | 23:18 |
| *** adrianofr_ has quit IRC | 23:19 | |
| *** jamesdenton has quit IRC | 23:19 | |
| *** gugl has quit IRC | 23:19 | |
| *** nicolasbock has quit IRC | 23:22 | |
| *** Julien-zte has joined #openstack-infra | 23:24 | |
| *** claudiub has quit IRC | 23:25 | |
| *** IRCFrEAK has joined #openstack-infra | 23:26 | |
| *** markvoelker has quit IRC | 23:26 | |
| *** ijw has joined #openstack-infra | 23:26 | |
| *** zz_dimtruck is now known as dimtruck | 23:29 | |
| *** dimtruck is now known as zz_dimtruck | 23:33 | |
| *** IRCFrEAK has quit IRC | 23:37 | |
| *** zz_dimtruck is now known as dimtruck | 23:37 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Port SQLAlchemy reporter to v3 driver structure https://review.openstack.org/442114 | 23:47 |
| *** marst has joined #openstack-infra | 23:50 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_stuck_job_cleanup https://review.openstack.org/446783 | 23:56 |
| *** wolverin_ has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!