| *** jamielennox|away is now known as jamielennox | 00:00 | |
| *** gyee has quit IRC | 00:01 | |
| *** wfoster has quit IRC | 00:02 | |
| mordred | clarkb: cool. I'll let it sit there for a bit then | 00:02 |
|---|---|---|
| mordred | clarkb: just making sure it wasn't oversight | 00:02 |
| amrith | anybody having issues with git? | 00:02 |
| amrith | unable to git review ... hangs | 00:03 |
| *** slagle has joined #openstack-infra | 00:03 | |
| clarkb | amrith: daily db backups | 00:03 |
| odyssey4me | hmm, it seems like I'm getting no response from POST operations on gerrit | 00:04 |
| amrith | thx clarkb. oddly if I ctrl-C it leaves my client side out of whack with the server and it won't allow me to retry | 00:04 |
| amrith | it just hangs | 00:04 |
| openstackgerrit | Merged openstack-infra/glean: Append to interface definition for multi-address https://review.openstack.org/366862 | 00:04 |
| odyssey4me | pretty much just a hang | 00:04 |
| amrith | yup | 00:04 |
| clarkb | yes daily db backups | 00:04 |
| smcginnis | odyssey4me: Seeing the same thing. | 00:04 |
| odyssey4me | ah, just got a 500 | 00:04 |
| amrith | hmm, let's wait. if it is the backup, it should be a shor tthing | 00:04 |
| *** rook has quit IRC | 00:04 | |
| amrith | i'll wait, back off, drink another glass of wine. really honey, have to have another glass of wine, gerrit is getting a backup :) | 00:05 |
| smcginnis | odyssey4me: Ah, better now. | 00:05 |
| odyssey4me | yep, it does seem better now | 00:05 |
| *** gyee has joined #openstack-infra | 00:05 | |
| smcginnis | amrith: Er, I mean, no, it's still having trouble. Really should be OK in about 10-15 minutes. ;) | 00:05 |
| *** rook has joined #openstack-infra | 00:06 | |
| *** rook is now known as Guest8952 | 00:06 | |
| *** wfoster has joined #openstack-infra | 00:07 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: DNM NOOP testing https://review.openstack.org/370488 | 00:09 |
| amrith | worked for me now, thanks | 00:09 |
| amrith | back to wine :) | 00:09 |
| *** sai has quit IRC | 00:10 | |
| openstackgerrit | Varun Gadiraju proposed openstack-infra/project-config: Migrating vars that devstack_gate uses to vars in DEVSTACK_LOCAL_CONFIG https://review.openstack.org/354344 | 00:10 |
| *** lucas-dinner has quit IRC | 00:10 | |
| *** adrian_otto has quit IRC | 00:11 | |
| *** wfoster has quit IRC | 00:12 | |
| *** Guest8952 has quit IRC | 00:12 | |
| pabelanger | clarkb: mordred: it was likely an oversight on my behalf. I can update based on clarks comments, but that won't be for tonight | 00:12 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/system-config: Add an option to limit owner statistics to a single project https://review.openstack.org/370490 | 00:12 |
| clarkb | pabelanger: well Ithink the old code neglects it too | 00:12 |
| clarkb | but I am pretty sure we want that so that rax works on first boot | 00:12 |
| pabelanger | I can dive more into it in a follow up patch if needed. I didn't really dive into what alot of the code did, just appened ipv6 bits when possible | 00:13 |
| *** adrian_otto has joined #openstack-infra | 00:13 | |
| *** kjorgensen has quit IRC | 00:14 | |
| clarkb | pabelanger: kk feel free to self approve that as is then (its why I +2d rather than -1) | 00:14 |
| pabelanger | clarkb: Right, i didn't test gentoo in rack, maybe prometheanfire could confirm | 00:15 |
| clarkb | ya I think it will work elsewhere just not if relying on config drive network info like in rax | 00:15 |
| clarkb | but I also think it was always that way so didn't -1 | 00:15 |
| clarkb | in other news grenade just failed in the gate on the same issue my change did so now I can worry about it less | 00:16 |
| *** lucasagomes has joined #openstack-infra | 00:16 | |
| *** rook_ has joined #openstack-infra | 00:16 | |
| pabelanger | clarkb: ack | 00:16 |
| *** wfoster has joined #openstack-infra | 00:16 | |
| *** sai has joined #openstack-infra | 00:16 | |
| *** thorst has joined #openstack-infra | 00:17 | |
| *** kjorgensen has joined #openstack-infra | 00:17 | |
| *** Swami__ has joined #openstack-infra | 00:19 | |
| *** tqtran has quit IRC | 00:19 | |
| *** kjorgens_ has joined #openstack-infra | 00:20 | |
| *** fguillot is now known as fguillot_afk | 00:20 | |
| *** fguillot_afk has quit IRC | 00:20 | |
| *** kjorgensen has quit IRC | 00:21 | |
| *** Swami_ has quit IRC | 00:22 | |
| *** thorst has quit IRC | 00:24 | |
| *** kjorgens_ has quit IRC | 00:24 | |
| *** gyee has quit IRC | 00:25 | |
| *** _sarob has quit IRC | 00:25 | |
| *** sarob has joined #openstack-infra | 00:25 | |
| *** kaisers has joined #openstack-infra | 00:31 | |
| *** kaisers3 has joined #openstack-infra | 00:32 | |
| *** annegentle has joined #openstack-infra | 00:33 | |
| *** ddieterly has joined #openstack-infra | 00:33 | |
| *** ddieterly is now known as ddieterly[away] | 00:33 | |
| *** ddieterly[away] is now known as ddieterly | 00:33 | |
| *** kaisers2 has quit IRC | 00:34 | |
| *** kaisers1 has quit IRC | 00:34 | |
| *** Swami__ has quit IRC | 00:36 | |
| *** Swami__ has joined #openstack-infra | 00:37 | |
| *** jlvillal has quit IRC | 00:41 | |
| *** fguillot has joined #openstack-infra | 00:46 | |
| *** jlvillal has joined #openstack-infra | 00:46 | |
| *** jlvillal has quit IRC | 00:47 | |
| *** jlvillal has joined #openstack-infra | 00:47 | |
| *** jlvillal has quit IRC | 00:47 | |
| *** jlvillal has joined #openstack-infra | 00:47 | |
| *** akshai has joined #openstack-infra | 00:51 | |
| *** akshai has quit IRC | 00:53 | |
| *** gongysh has joined #openstack-infra | 00:55 | |
| *** pahuang has quit IRC | 01:04 | |
| *** tuanla_ has joined #openstack-infra | 01:07 | |
| *** itsuugo has quit IRC | 01:08 | |
| *** roxanaghe has quit IRC | 01:09 | |
| *** itsuugo has joined #openstack-infra | 01:10 | |
| *** roxanaghe has joined #openstack-infra | 01:12 | |
| *** mmedvede has joined #openstack-infra | 01:13 | |
| *** kzaitsev_mb has quit IRC | 01:14 | |
| *** itsuugo has quit IRC | 01:15 | |
| *** sarob has quit IRC | 01:15 | |
| *** itsuugo has joined #openstack-infra | 01:16 | |
| *** ijw has quit IRC | 01:17 | |
| *** adrian_otto has quit IRC | 01:17 | |
| *** pahuang has joined #openstack-infra | 01:19 | |
| *** ddieterly has quit IRC | 01:21 | |
| *** thorst has joined #openstack-infra | 01:21 | |
| *** itsuugo has quit IRC | 01:22 | |
| *** vinaypotluri has quit IRC | 01:22 | |
| *** itsuugo has joined #openstack-infra | 01:22 | |
| *** ijw has joined #openstack-infra | 01:25 | |
| *** itsuugo has quit IRC | 01:27 | |
| *** itsuugo has joined #openstack-infra | 01:28 | |
| *** thorst has quit IRC | 01:29 | |
| *** ddieterly has joined #openstack-infra | 01:31 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: enable the trove pylint job https://review.openstack.org/370506 | 01:33 |
| openstackgerrit | amrith proposed openstack-infra/project-config: enable the trove pylint job https://review.openstack.org/370506 | 01:35 |
| *** thorst has joined #openstack-infra | 01:35 | |
| *** Sukhdev has quit IRC | 01:37 | |
| *** hongbin has joined #openstack-infra | 01:39 | |
| *** baoli has joined #openstack-infra | 01:39 | |
| *** baoli has quit IRC | 01:41 | |
| *** salv-orlando has joined #openstack-infra | 01:41 | |
| *** baoli has joined #openstack-infra | 01:41 | |
| *** roxanaghe has quit IRC | 01:42 | |
| openstackgerrit | Pete Zaitcev proposed openstack-infra/git-review: Fix b'12345' in -l under py3 https://review.openstack.org/370507 | 01:42 |
| *** salv-orl_ has quit IRC | 01:43 | |
| *** rbergero1 has joined #openstack-infra | 01:44 | |
| *** thorst has quit IRC | 01:45 | |
| *** baoli has quit IRC | 01:46 | |
| *** gongysh has quit IRC | 01:47 | |
| *** roxanaghe has joined #openstack-infra | 01:48 | |
| *** itsuugo has quit IRC | 01:48 | |
| *** woodster_ has quit IRC | 01:50 | |
| *** itsuugo has joined #openstack-infra | 01:50 | |
| *** itsuugo has quit IRC | 01:55 | |
| *** ijw has quit IRC | 01:56 | |
| *** itsuugo has joined #openstack-infra | 01:57 | |
| *** Apoorva_ has joined #openstack-infra | 02:01 | |
| *** Apoorva has quit IRC | 02:04 | |
| *** ijw has joined #openstack-infra | 02:05 | |
| *** Apoorva_ has quit IRC | 02:06 | |
| *** itsuugo has quit IRC | 02:08 | |
| *** itsuugo has joined #openstack-infra | 02:09 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:10 | |
| *** roxanaghe has quit IRC | 02:10 | |
| *** ddieterly has quit IRC | 02:11 | |
| *** 32NABYP9K has joined #openstack-infra | 02:14 | |
| *** itsuugo has quit IRC | 02:16 | |
| *** itsuugo has joined #openstack-infra | 02:17 | |
| *** fguillot is now known as fguillot_afk | 02:19 | |
| *** fguillot_afk has quit IRC | 02:19 | |
| *** itsuugo has quit IRC | 02:22 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: enable the trove pylint job https://review.openstack.org/370506 | 02:22 |
| *** itsuugo has joined #openstack-infra | 02:23 | |
| *** fguillot has joined #openstack-infra | 02:23 | |
| *** ddieterly has joined #openstack-infra | 02:24 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: enable the trove pylint job https://review.openstack.org/370506 | 02:24 |
| *** itsuugo has quit IRC | 02:29 | |
| *** itsuugo has joined #openstack-infra | 02:30 | |
| *** itsuugo has quit IRC | 02:35 | |
| *** itsuugo has joined #openstack-infra | 02:36 | |
| *** annegentle has quit IRC | 02:38 | |
| *** itsuugo has quit IRC | 02:43 | |
| *** inc0 has joined #openstack-infra | 02:43 | |
| *** itsuugo has joined #openstack-infra | 02:44 | |
| *** rlandy has quit IRC | 02:44 | |
| *** thorst has joined #openstack-infra | 02:47 | |
| *** yuanying has quit IRC | 02:47 | |
| *** itsuugo has quit IRC | 02:48 | |
| *** mriedem has quit IRC | 02:49 | |
| *** itsuugo has joined #openstack-infra | 02:50 | |
| *** gongysh has joined #openstack-infra | 02:50 | |
| *** sdake has joined #openstack-infra | 02:53 | |
| *** ddieterly has quit IRC | 02:53 | |
| *** thorst has quit IRC | 02:56 | |
| *** sdake has quit IRC | 02:58 | |
| *** rbergero1 is now known as rbergeron | 03:00 | |
| *** rbergeron has joined #openstack-infra | 03:00 | |
| *** itsuugo has quit IRC | 03:01 | |
| *** sdake has joined #openstack-infra | 03:01 | |
| *** megm has quit IRC | 03:02 | |
| *** itsuugo has joined #openstack-infra | 03:03 | |
| *** megm has joined #openstack-infra | 03:04 | |
| *** aeng has quit IRC | 03:04 | |
| *** ijw has quit IRC | 03:04 | |
| *** ijw has joined #openstack-infra | 03:05 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Grafana Neutron: fix Grenade dashboard https://review.openstack.org/370521 | 03:07 |
| *** itsuugo has quit IRC | 03:08 | |
| *** itsuugo has joined #openstack-infra | 03:10 | |
| *** yamahata has quit IRC | 03:11 | |
| *** ijw has quit IRC | 03:13 | |
| *** itsuugo has quit IRC | 03:17 | |
| *** itsuugo has joined #openstack-infra | 03:18 | |
| *** gouthamr has quit IRC | 03:19 | |
| *** aeng has joined #openstack-infra | 03:20 | |
| *** gongysh has quit IRC | 03:21 | |
| *** itsuugo has quit IRC | 03:23 | |
| *** itsuugo has joined #openstack-infra | 03:24 | |
| *** gongysh has joined #openstack-infra | 03:25 | |
| *** roxanaghe has joined #openstack-infra | 03:26 | |
| prometheanfire | hi? | 03:28 |
| prometheanfire | clarkb: pabelanger what's up? | 03:28 |
| *** kjorgensen has joined #openstack-infra | 03:29 | |
| prometheanfire | pabelanger: ipv4 netmask is prefered to be cidr as well for gentoo | 03:30 |
| prometheanfire | clarkb: pabelanger commented | 03:32 |
| *** kjorgensen has quit IRC | 03:33 | |
| *** fguillot has quit IRC | 03:33 | |
| *** itsuugo has quit IRC | 03:33 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Grafana Neutron: fix Grenade dashboard https://review.openstack.org/370521 | 03:34 |
| *** itsuugo has joined #openstack-infra | 03:36 | |
| *** roxanaghe has quit IRC | 03:37 | |
| *** itsuugo has quit IRC | 03:41 | |
| *** itsuugo has joined #openstack-infra | 03:42 | |
| *** vikrant has joined #openstack-infra | 03:44 | |
| *** thorst has joined #openstack-infra | 03:44 | |
| *** inc0 has quit IRC | 03:45 | |
| *** vinaypotluri has joined #openstack-infra | 03:45 | |
| *** thorst has quit IRC | 03:46 | |
| *** ijw_ has joined #openstack-infra | 03:49 | |
| *** jkilpatr has quit IRC | 03:49 | |
| *** yuanying has joined #openstack-infra | 03:51 | |
| *** tsg has joined #openstack-infra | 03:51 | |
| *** itsuugo has quit IRC | 03:51 | |
| *** itsuugo has joined #openstack-infra | 03:52 | |
| *** ijw_ has quit IRC | 03:54 | |
| *** itsuugo has quit IRC | 03:59 | |
| *** itsuugo has joined #openstack-infra | 04:00 | |
| *** Shrews has quit IRC | 04:07 | |
| *** phschwartz has quit IRC | 04:07 | |
| *** kzaitsev_mb has quit IRC | 04:08 | |
| *** mordred has quit IRC | 04:08 | |
| *** mordred has joined #openstack-infra | 04:10 | |
| *** itsuugo has quit IRC | 04:10 | |
| *** phschwartz has joined #openstack-infra | 04:11 | |
| *** Shrews has joined #openstack-infra | 04:11 | |
| *** itsuugo has joined #openstack-infra | 04:12 | |
| *** hongbin has quit IRC | 04:14 | |
| *** kjorgensen has joined #openstack-infra | 04:14 | |
| *** itsuugo has quit IRC | 04:16 | |
| *** itsuugo has joined #openstack-infra | 04:18 | |
| *** kjorgensen has quit IRC | 04:18 | |
| *** psachin has joined #openstack-infra | 04:21 | |
| *** Swami__ has quit IRC | 04:21 | |
| *** itsuugo has quit IRC | 04:23 | |
| *** yamamoto_ has joined #openstack-infra | 04:24 | |
| *** itsuugo has joined #openstack-infra | 04:24 | |
| *** ociuhandu has joined #openstack-infra | 04:24 | |
| *** camunoz has quit IRC | 04:26 | |
| *** megm has quit IRC | 04:27 | |
| *** itsuugo has quit IRC | 04:29 | |
| *** thorst has joined #openstack-infra | 04:29 | |
| *** itsuugo has joined #openstack-infra | 04:29 | |
| *** megm has joined #openstack-infra | 04:29 | |
| *** Genek has quit IRC | 04:30 | |
| *** itsuugo has quit IRC | 04:34 | |
| *** coolsvap has joined #openstack-infra | 04:34 | |
| *** itsuugo has joined #openstack-infra | 04:35 | |
| *** abregman has joined #openstack-infra | 04:38 | |
| *** thorst has quit IRC | 04:39 | |
| *** itsuugo has quit IRC | 04:40 | |
| *** adriant has quit IRC | 04:40 | |
| *** itsuugo has joined #openstack-infra | 04:41 | |
| *** tsg has quit IRC | 04:43 | |
| *** tsg has joined #openstack-infra | 04:43 | |
| *** aeng has quit IRC | 04:43 | |
| *** thorst has joined #openstack-infra | 04:45 | |
| *** jaosorior has joined #openstack-infra | 04:47 | |
| *** asselin_ has quit IRC | 04:52 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:52 | |
| *** itsuugo has quit IRC | 04:53 | |
| *** itsuugo has joined #openstack-infra | 04:54 | |
| *** aeng has joined #openstack-infra | 04:56 | |
| *** thorst has quit IRC | 04:58 | |
| openstackgerrit | Sridhar Ramaswamy proposed openstack-infra/project-config: Make tacker python3 jobs voting https://review.openstack.org/370388 | 04:58 |
| *** thorst has joined #openstack-infra | 04:58 | |
| *** Jeffrey4l__ has joined #openstack-infra | 05:00 | |
| *** jaosorior has quit IRC | 05:01 | |
| *** jaosorior has joined #openstack-infra | 05:02 | |
| *** sdake has quit IRC | 05:03 | |
| *** itsuugo has quit IRC | 05:03 | |
| *** Jeffrey4l_ has quit IRC | 05:04 | |
| *** itsuugo has joined #openstack-infra | 05:04 | |
| *** pahuang has quit IRC | 05:06 | |
| *** thorst has quit IRC | 05:07 | |
| *** yamamoto_ has quit IRC | 05:07 | |
| *** yamamoto_ has joined #openstack-infra | 05:09 | |
| *** thorst has joined #openstack-infra | 05:09 | |
| *** kzaitsev_mb has quit IRC | 05:09 | |
| *** itsuugo has quit IRC | 05:10 | |
| *** itsuugo has joined #openstack-infra | 05:10 | |
| *** thorst has quit IRC | 05:13 | |
| *** roxanaghe has joined #openstack-infra | 05:14 | |
| *** florianf has joined #openstack-infra | 05:15 | |
| *** thorst has joined #openstack-infra | 05:15 | |
| *** pgadiya has joined #openstack-infra | 05:16 | |
| *** tqtran has joined #openstack-infra | 05:17 | |
| *** rcernin has joined #openstack-infra | 05:17 | |
| *** yamamoto_ has quit IRC | 05:19 | |
| *** thorst has quit IRC | 05:19 | |
| *** itsuugo has quit IRC | 05:20 | |
| *** itsuugo has joined #openstack-infra | 05:21 | |
| *** sdake has joined #openstack-infra | 05:22 | |
| *** tqtran has quit IRC | 05:22 | |
| *** roxanaghe has quit IRC | 05:22 | |
| *** itsuugo has quit IRC | 05:26 | |
| *** itsuugo has joined #openstack-infra | 05:28 | |
| *** adriant has joined #openstack-infra | 05:29 | |
| *** dahoo has joined #openstack-infra | 05:29 | |
| *** dimtruck is now known as zz_dimtruck | 05:31 | |
| *** gouthamr has joined #openstack-infra | 05:31 | |
| *** thorst has joined #openstack-infra | 05:34 | |
| *** itsuugo has quit IRC | 05:37 | |
| *** itsuugo has joined #openstack-infra | 05:38 | |
| *** markvoelker has quit IRC | 05:41 | |
| *** thorst has quit IRC | 05:42 | |
| *** itsuugo has quit IRC | 05:43 | |
| *** itsuugo has joined #openstack-infra | 05:43 | |
| *** thorst has joined #openstack-infra | 05:44 | |
| openstackgerrit | Sridhar Ramaswamy proposed openstack-infra/project-config: Make tacker python3 jobs voting https://review.openstack.org/370388 | 05:46 |
| *** thorst has quit IRC | 05:49 | |
| *** tsg has quit IRC | 05:49 | |
| *** thorst has joined #openstack-infra | 05:50 | |
| *** itsuugo has quit IRC | 05:51 | |
| *** itsuugo has joined #openstack-infra | 05:51 | |
| *** zz_dimtruck is now known as dimtruck | 05:52 | |
| *** thorst has quit IRC | 05:55 | |
| *** itsuugo has quit IRC | 05:56 | |
| *** oanson has joined #openstack-infra | 05:56 | |
| *** thorst has joined #openstack-infra | 05:56 | |
| *** yuval has joined #openstack-infra | 05:57 | |
| *** itsuugo has joined #openstack-infra | 05:58 | |
| *** thorst has quit IRC | 06:01 | |
| *** aeng has quit IRC | 06:01 | |
| *** nherciu has joined #openstack-infra | 06:02 | |
| *** thorst has joined #openstack-infra | 06:02 | |
| *** itsuugo has quit IRC | 06:03 | |
| *** dimtruck is now known as zz_dimtruck | 06:03 | |
| *** yamamoto_ has joined #openstack-infra | 06:03 | |
| *** itsuugo has joined #openstack-infra | 06:03 | |
| *** pcaruana has joined #openstack-infra | 06:04 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:06 | |
| *** thorst has quit IRC | 06:07 | |
| *** thorst has joined #openstack-infra | 06:08 | |
| *** whoops has quit IRC | 06:10 | |
| *** whoops has joined #openstack-infra | 06:10 | |
| *** jtomasek has joined #openstack-infra | 06:12 | |
| *** pcaruana is now known as pcaruana|afk| | 06:13 | |
| *** claudiub has joined #openstack-infra | 06:15 | |
| *** thorst has quit IRC | 06:17 | |
| *** itsuugo has quit IRC | 06:18 | |
| *** thorst has joined #openstack-infra | 06:19 | |
| *** itsuugo has joined #openstack-infra | 06:19 | |
| *** dtardivel has joined #openstack-infra | 06:21 | |
| *** vinaypotluri has quit IRC | 06:22 | |
| *** zz_dimtruck is now known as dimtruck | 06:22 | |
| *** roxanaghe has joined #openstack-infra | 06:23 | |
| *** isaacb has joined #openstack-infra | 06:24 | |
| *** thorst has quit IRC | 06:24 | |
| *** thorst has joined #openstack-infra | 06:25 | |
| *** kjorgensen has joined #openstack-infra | 06:26 | |
| *** roxanaghe has quit IRC | 06:28 | |
| *** itsuugo has quit IRC | 06:28 | |
| AJaeger | zigo, read the eavesdrop archive on what needs to be done for novnc. And then either propose a new change that fixes it properly - or we cleanup the broken state we have right now. | 06:28 |
| *** asettle has joined #openstack-infra | 06:29 | |
| *** thorst has quit IRC | 06:30 | |
| *** andreas_s has joined #openstack-infra | 06:30 | |
| *** kjorgensen has quit IRC | 06:30 | |
| *** itsuugo has joined #openstack-infra | 06:30 | |
| *** adriant has quit IRC | 06:32 | |
| *** thorst has joined #openstack-infra | 06:32 | |
| *** dimtruck is now known as zz_dimtruck | 06:32 | |
| *** asettle has quit IRC | 06:34 | |
| *** sdake has quit IRC | 06:36 | |
| *** thorst has quit IRC | 06:36 | |
| *** itsuugo has quit IRC | 06:37 | |
| *** itsuugo has joined #openstack-infra | 06:38 | |
| *** mikelk has joined #openstack-infra | 06:39 | |
| *** sshnaidm|afk is now known as sshnaidm | 06:40 | |
| *** pcaruana|afk| is now known as pcaruana | 06:40 | |
| *** gouthamr has quit IRC | 06:41 | |
| *** itsuugo has quit IRC | 06:44 | |
| *** thorst has joined #openstack-infra | 06:44 | |
| *** rwsu has joined #openstack-infra | 06:44 | |
| *** jamielennox is now known as jamielennox|away | 06:45 | |
| *** itsuugo has joined #openstack-infra | 06:45 | |
| *** berendt has joined #openstack-infra | 06:45 | |
| *** berendt has quit IRC | 06:45 | |
| *** berendt has joined #openstack-infra | 06:46 | |
| *** jascott1_ has joined #openstack-infra | 06:47 | |
| *** jascott1 has quit IRC | 06:49 | |
| *** dahoo has quit IRC | 06:49 | |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder: Update xunit plugin https://review.openstack.org/370560 | 06:50 |
| odyssey4me | morning all | 06:50 |
| *** salv-orlando has quit IRC | 06:50 | |
| odyssey4me | yolanda when you're in, a review of https://review.openstack.org/369405 would be appreciated | 06:51 |
| *** salv-orlando has joined #openstack-infra | 06:51 | |
| *** thorst has quit IRC | 06:52 | |
| *** thorst has joined #openstack-infra | 06:54 | |
| yolanda | hi odyssey4me , review time now | 06:57 |
| AJaeger | morning, yolanda and odyssey4me ! | 06:57 |
| yolanda | good morning | 06:58 |
| *** thorst has quit IRC | 06:59 | |
| *** itsuugo has quit IRC | 07:00 | |
| *** thorst has joined #openstack-infra | 07:00 | |
| *** esikachev has joined #openstack-infra | 07:02 | |
| *** kzaitsev_mb has quit IRC | 07:02 | |
| *** itsuugo has joined #openstack-infra | 07:02 | |
| *** Na3iL has joined #openstack-infra | 07:03 | |
| *** thorst has quit IRC | 07:05 | |
| *** florianf has quit IRC | 07:05 | |
| *** drifterza has joined #openstack-infra | 07:07 | |
| *** tqtran has joined #openstack-infra | 07:08 | |
| openstackgerrit | Merged openstack-infra/project-config: Promote OSA os_swift multi-region tests to voting https://review.openstack.org/369405 | 07:08 |
| *** berendt has quit IRC | 07:08 | |
| *** larainema has quit IRC | 07:08 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Switch ironic-pxe_ipa-postgres-nv to Xenial https://review.openstack.org/370570 | 07:08 |
| *** berendt has joined #openstack-infra | 07:09 | |
| *** zul has joined #openstack-infra | 07:10 | |
| *** larainema has joined #openstack-infra | 07:10 | |
| *** thorst has joined #openstack-infra | 07:11 | |
| AJaeger | dtantsur|afk, clarkb : Please review https://review.openstack.org/#/c/370570 for an Ironic Xenial change - this looks strange to me. | 07:13 |
| *** Ravikiran_K has joined #openstack-infra | 07:13 | |
| *** florianf has joined #openstack-infra | 07:14 | |
| *** itsuugo has quit IRC | 07:17 | |
| *** thorst has quit IRC | 07:17 | |
| *** thorst has joined #openstack-infra | 07:18 | |
| *** itsuugo has joined #openstack-infra | 07:18 | |
| vsaienko | morning AJaeger: why it looks strange? | 07:19 |
| *** jed56 has joined #openstack-infra | 07:19 | |
| *** shardy has joined #openstack-infra | 07:20 | |
| *** thorst_ has joined #openstack-infra | 07:21 | |
| *** Hal1 has quit IRC | 07:21 | |
| *** zhurong has joined #openstack-infra | 07:21 | |
| AJaeger | vsaienko: we follow a different model of converting to xenial. And that job has been run on stable releases and now you change the OS below it - that's something we normally don't do. | 07:22 |
| AJaeger | vsaienko: I let dtantsur|afk and clarkb look at it, they're working on the big picture here. | 07:22 |
| *** samuelBartel has joined #openstack-infra | 07:22 | |
| *** nmagnezi_ has joined #openstack-infra | 07:22 | |
| *** nmagnezi_ has quit IRC | 07:22 | |
| *** thorst has quit IRC | 07:23 | |
| *** itsuugo has quit IRC | 07:23 | |
| vsaienko | AJaeger: I see, I will contact dtantsur to get more details, thanks! | 07:23 |
| *** nmagnezi has joined #openstack-infra | 07:24 | |
| *** matrohon has joined #openstack-infra | 07:24 | |
| *** itsuugo has joined #openstack-infra | 07:24 | |
| *** thorst_ has quit IRC | 07:25 | |
| AJaeger | thanks, vsaienko | 07:27 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: Test oooq with osinfra https://review.openstack.org/370437 | 07:27 |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: fix typo in bridge config for trusty https://review.openstack.org/370199 | 07:28 |
| *** abregman_ has joined #openstack-infra | 07:28 | |
| *** itsuugo has quit IRC | 07:29 | |
| *** jlanoux has joined #openstack-infra | 07:29 | |
| openstackgerrit | Merged openstack-infra/project-config: puppet-tripleo: remove puppet-manager-core core permissions https://review.openstack.org/370260 | 07:30 |
| *** abregman has quit IRC | 07:30 | |
| *** itsuugo has joined #openstack-infra | 07:30 | |
| *** abregman_ has quit IRC | 07:30 | |
| openstackgerrit | Merged openstack-infra/project-config: Add gate-tripleo-buildimage-overcloud-full-centos-7-nv to check https://review.openstack.org/370414 | 07:32 |
| *** abregman has joined #openstack-infra | 07:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Skip magnum identity v3 test job on docs changes https://review.openstack.org/370408 | 07:32 |
| *** moravec has quit IRC | 07:33 | |
| *** amoralej|off is now known as amoralej | 07:34 | |
| *** itsuugo has quit IRC | 07:35 | |
| *** itsuugo has joined #openstack-infra | 07:35 | |
| *** jpich has joined #openstack-infra | 07:36 | |
| *** chem has joined #openstack-infra | 07:36 | |
| *** hichihara has joined #openstack-infra | 07:36 | |
| *** moravec has joined #openstack-infra | 07:37 | |
| *** asettle has joined #openstack-infra | 07:37 | |
| *** cody-somerville has quit IRC | 07:37 | |
| *** cody-somerville has joined #openstack-infra | 07:38 | |
| *** Hal has joined #openstack-infra | 07:38 | |
| *** abregman is now known as abregman|mtg | 07:39 | |
| *** asettle has quit IRC | 07:39 | |
| *** gongysh has quit IRC | 07:40 | |
| *** salv-orl_ has joined #openstack-infra | 07:40 | |
| *** markvoelker has joined #openstack-infra | 07:42 | |
| *** salv-orlando has quit IRC | 07:43 | |
| *** e0ne has joined #openstack-infra | 07:44 | |
| *** Rockyg has quit IRC | 07:45 | |
| *** jlanoux has quit IRC | 07:46 | |
| *** jlanoux_ has joined #openstack-infra | 07:46 | |
| *** itsuugo has quit IRC | 07:47 | |
| *** markvoelker has quit IRC | 07:48 | |
| *** itsuugo has joined #openstack-infra | 07:49 | |
| openstackgerrit | Tomas Sedovic proposed openstack-infra/project-config: Publish docs for tripleo-validations https://review.openstack.org/369487 | 07:53 |
| *** dtantsur|afk is now known as dtantsur | 07:55 | |
| *** zul has quit IRC | 07:57 | |
| *** jamielennox|away is now known as jamielennox | 07:57 | |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder: Update checkstyle plugin https://review.openstack.org/370592 | 07:58 |
| *** hashar has joined #openstack-infra | 07:58 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:58 | |
| *** bethwhite_ has joined #openstack-infra | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| openstackgerrit | Shu Muto proposed openstack-infra/project-config: Change JS test jobs to 'voting' for Magnum-UI https://review.openstack.org/370594 | 08:01 |
| *** jascott1_ has quit IRC | 08:05 | |
| *** dizquierdo has joined #openstack-infra | 08:05 | |
| zigo | AJaeger: Where to find the eavesdrop archive? | 08:11 |
| *** sree has joined #openstack-infra | 08:13 | |
| *** yamahata has joined #openstack-infra | 08:13 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton https://review.openstack.org/323750 | 08:14 |
| *** amotoki has joined #openstack-infra | 08:14 | |
| *** sheeprine has quit IRC | 08:15 | |
| openstackgerrit | Merged openstack-infra/project-config: Grafana Neutron: fix Grenade dashboard https://review.openstack.org/370521 | 08:16 |
| *** Ravikiran_K has quit IRC | 08:17 | |
| *** ccamacho has joined #openstack-infra | 08:17 | |
| *** sheeprine has joined #openstack-infra | 08:18 | |
| openstackgerrit | Merged openstack-infra/project-config: update api-ref to be a ./ path, not a symbolic name https://review.openstack.org/370333 | 08:19 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/370607 | 08:22 |
| *** zz_dimtruck is now known as dimtruck | 08:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Make subunit2sql py35 jobs voting https://review.openstack.org/370322 | 08:25 |
| openstackgerrit | Merged openstack-infra/project-config: add zuul-cloner location to $PATH https://review.openstack.org/370210 | 08:25 |
| dtantsur | AJaeger, hey! do we have a framework in place to conditionally switch nodes to xenial on branches? | 08:26 |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/project-config: Added new repos for Murano chef cookbook https://review.openstack.org/366729 | 08:26 |
| dtantsur | AJaeger, I don't really want us to end up duplicating all jobs in the same way tox jobs are duplicated right now.. | 08:26 |
| openstackgerrit | Merged openstack-infra/project-config: Move ARA integration jobs to Xenial, remove Trusty https://review.openstack.org/369482 | 08:27 |
| *** kzaitsev_mb has quit IRC | 08:29 | |
| *** bethwhite_ has quit IRC | 08:29 | |
| AJaeger | zigo: eavesdrop.openstack.org/irclogs/%23openstack-infra/ | 08:31 |
| AJaeger | dtantsur: that duplication is how we do it right now - best talk with clarkb later | 08:31 |
| *** itsuugo has quit IRC | 08:32 | |
| dtantsur | AJaeger, clarkb, we can duplicate a couple of jobs, then switch them all at once, I guess. we can't afford running all jobs duplicated in parallel. | 08:32 |
| *** dimtruck is now known as zz_dimtruck | 08:33 | |
| *** itsuugo has joined #openstack-infra | 08:34 | |
| AJaeger | dtantsur: sorry, don't have time for now to help here - please discuss with clarkb. I'll happily review afterwards ;) | 08:34 |
| dtantsur | fine, thanks | 08:35 |
| dtantsur | vsaienko, let's start with duplicating one job and making sure it at least works. we don't have too much time to fix issues in newton.. | 08:36 |
| *** tkelsey has joined #openstack-infra | 08:36 | |
| vsaienko | dtantsur: ok, I will upload a new patch | 08:37 |
| *** kjorgensen has joined #openstack-infra | 08:38 | |
| *** kjorgensen has quit IRC | 08:42 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/project-config: Added new repos for Murano chef cookbook https://review.openstack.org/366729 | 08:43 |
| *** electrofelix has joined #openstack-infra | 08:43 | |
| *** itsuugo has quit IRC | 08:46 | |
| apuimedo | where can we get the images used for gates? | 08:46 |
| *** derekh has joined #openstack-infra | 08:46 | |
| apuimedo | gate-kuryr-libnetwork-dsvm-fullstack-nv | 08:46 |
| *** itsuugo has joined #openstack-infra | 08:46 | |
| *** shu-mutou is now known as shu-mutou-AFK | 08:49 | |
| *** itsuugo has quit IRC | 08:51 | |
| *** itsuugo has joined #openstack-infra | 08:52 | |
| *** asettle has joined #openstack-infra | 08:52 | |
| *** tuanla has joined #openstack-infra | 08:54 | |
| *** ihrachys has joined #openstack-infra | 08:55 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Also set Haproxy addresses in no_proxy https://review.openstack.org/370623 | 08:57 |
| *** tuanla_ has quit IRC | 08:57 | |
| *** asettle has quit IRC | 08:57 | |
| *** asettle has joined #openstack-infra | 08:58 | |
| *** abregman_ has joined #openstack-infra | 08:59 | |
| AJaeger | apuimedo: you need to build them yourself - project-config/tools/build-image.sh | 09:01 |
| apuimedo | AJaeger: very well, thanks! | 09:01 |
| *** abregman|mtg has quit IRC | 09:02 | |
| *** hichihara has quit IRC | 09:04 | |
| *** itsuugo has quit IRC | 09:06 | |
| *** itsuugo has joined #openstack-infra | 09:08 | |
| *** jtomasek has quit IRC | 09:08 | |
| *** watanabe_isao has joined #openstack-infra | 09:08 | |
| *** jtomasek has joined #openstack-infra | 09:09 | |
| tobiash | hi, does someone know what's the default expiration time for the server cache in shade? | 09:09 |
| *** tuanla_ has joined #openstack-infra | 09:09 | |
| tobiash | looks like wait_for_server in my nodepool instance waits much longer than the vm takes time to boot | 09:10 |
| *** jordanP has joined #openstack-infra | 09:11 | |
| *** tuanla has quit IRC | 09:11 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: tripleo.sh: log overcloud deploy command arguments before deploy https://review.openstack.org/370632 | 09:15 |
| *** itsuugo has quit IRC | 09:18 | |
| *** rossella_ has quit IRC | 09:18 | |
| *** itsuugo has joined #openstack-infra | 09:19 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/370607 | 09:19 |
| *** rossella_ has joined #openstack-infra | 09:19 | |
| *** yaume has joined #openstack-infra | 09:21 | |
| *** adrian_otto has joined #openstack-infra | 09:22 | |
| *** zhurong has quit IRC | 09:24 | |
| *** sambetts|afk is now known as sambetts | 09:25 | |
| *** tqtran has quit IRC | 09:26 | |
| *** alex_xu has quit IRC | 09:26 | |
| *** gildub has quit IRC | 09:26 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:26 | |
| *** alex_xu has joined #openstack-infra | 09:27 | |
| *** jlanoux_ has quit IRC | 09:30 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove horizon coverage jobs https://review.openstack.org/370641 | 09:30 |
| *** jlanoux has joined #openstack-infra | 09:30 | |
| *** kzaitsev_mb has quit IRC | 09:32 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/puppet-apps_site: [wip] Glare support for app-catalog https://review.openstack.org/359029 | 09:32 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add experimental scenario jobs to OpenStack-Ansible https://review.openstack.org/370646 | 09:36 |
| *** thorst has joined #openstack-infra | 09:38 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:39 | |
| *** gnuoy` has joined #openstack-infra | 09:39 | |
| openstackgerrit | Simon McCartney proposed openstack-infra/puppet-jenkins: Enable a specific version of jenkins to be installed https://review.openstack.org/366803 | 09:39 |
| *** gnuoy has quit IRC | 09:40 | |
| *** sree has quit IRC | 09:41 | |
| *** HeOS has quit IRC | 09:43 | |
| *** markvoelker has joined #openstack-infra | 09:44 | |
| *** kzaitsev_mb has quit IRC | 09:44 | |
| *** tosky has joined #openstack-infra | 09:44 | |
| *** yamahata has quit IRC | 09:49 | |
| *** adrian_otto has quit IRC | 09:49 | |
| *** markvoelker has quit IRC | 09:49 | |
| openstackgerrit | Igor Duarte Cardoso proposed openstack-infra/irc-meetings: Update Neutron Classification Framework Meeting https://review.openstack.org/370653 | 09:49 |
| *** sree has joined #openstack-infra | 09:51 | |
| odyssey4me | AJaeger yolanda when you have a moment, a review of https://review.openstack.org/370646 would be appreciated | 09:52 |
| *** sree has quit IRC | 09:56 | |
| *** hashar has quit IRC | 09:58 | |
| *** roxanaghe has joined #openstack-infra | 09:59 | |
| *** itsuugo has quit IRC | 10:00 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Adding support for Manual Build Trigger https://review.openstack.org/202543 | 10:00 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Consolidate trigger-manual and trigger-parameterized-builds https://review.openstack.org/314108 | 10:00 |
| *** salv-orl_ has quit IRC | 10:01 | |
| *** itsuugo has joined #openstack-infra | 10:01 | |
| *** gnuoy has joined #openstack-infra | 10:01 | |
| *** gnuoy` has quit IRC | 10:02 | |
| *** gnuoy has quit IRC | 10:03 | |
| *** gnuoy has joined #openstack-infra | 10:03 | |
| *** roxanaghe has quit IRC | 10:04 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Allow using lockfile per jenkins master https://review.openstack.org/293631 | 10:09 |
| *** gongysh has joined #openstack-infra | 10:10 | |
| electrofelix | zaro: Is my response on https://review.openstack.org/#/c/312885/2/git_review/cmd.py about difference between '--all' for 'pull' versus 'fetch' for why I removed it in that review sufficient to answer you're -1 query? | 10:10 |
| *** itsuugo has quit IRC | 10:11 | |
| *** itsuugo has joined #openstack-infra | 10:12 | |
| *** hashar has joined #openstack-infra | 10:12 | |
| *** HeOS has joined #openstack-infra | 10:15 | |
| *** acoles_ is now known as acoles | 10:18 | |
| *** sarob has joined #openstack-infra | 10:18 | |
| *** sarob has quit IRC | 10:23 | |
| *** adrian_otto has joined #openstack-infra | 10:23 | |
| *** zz_dimtruck is now known as dimtruck | 10:24 | |
| *** itsuugo has quit IRC | 10:25 | |
| *** itsuugo has joined #openstack-infra | 10:27 | |
| *** itsuugo has quit IRC | 10:32 | |
| *** ramishra has quit IRC | 10:32 | |
| *** _degorenko|afk is now known as degorenko | 10:32 | |
| *** itsuugo has joined #openstack-infra | 10:32 | |
| *** dimtruck is now known as zz_dimtruck | 10:33 | |
| *** ramishra has joined #openstack-infra | 10:33 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Add comment about proxy env pass through https://review.openstack.org/271244 | 10:34 |
| *** dtantsur is now known as dtantsur|bbl | 10:39 | |
| *** itsuugo has quit IRC | 10:39 | |
| *** itsuugo has joined #openstack-infra | 10:41 | |
| *** itsuugo has quit IRC | 10:46 | |
| *** itsuugo has joined #openstack-infra | 10:46 | |
| *** rtheis has joined #openstack-infra | 10:48 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/project-config: Added new repos for Murano chef cookbook https://review.openstack.org/366729 | 10:48 |
| *** asselin_ has joined #openstack-infra | 10:48 | |
| *** chem` has joined #openstack-infra | 10:49 | |
| *** asselin__ has joined #openstack-infra | 10:49 | |
| *** chem has quit IRC | 10:50 | |
| *** sree has joined #openstack-infra | 10:50 | |
| *** asselin_ has quit IRC | 10:52 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:55 | |
| *** sree has quit IRC | 10:55 | |
| *** apetrich has quit IRC | 10:56 | |
| *** shardy has quit IRC | 10:57 | |
| *** pilgrimstack has quit IRC | 10:58 | |
| *** pilgrimstack has joined #openstack-infra | 11:00 | |
| *** sdague has joined #openstack-infra | 11:01 | |
| *** electrofelix has quit IRC | 11:01 | |
| *** yamamoto_ has quit IRC | 11:01 | |
| *** salv-orlando has joined #openstack-infra | 11:02 | |
| *** vsaienko has quit IRC | 11:03 | |
| *** lucasagomes is now known as lucas-hungry | 11:06 | |
| *** salv-orlando has quit IRC | 11:06 | |
| *** adrian_otto has quit IRC | 11:09 | |
| *** apetrich has joined #openstack-infra | 11:11 | |
| *** EricGonczer_ has joined #openstack-infra | 11:12 | |
| *** jlanoux has quit IRC | 11:14 | |
| *** jlanoux has joined #openstack-infra | 11:15 | |
| *** jlanoux has quit IRC | 11:17 | |
| *** jlanoux has joined #openstack-infra | 11:17 | |
| *** jkilpatr has joined #openstack-infra | 11:18 | |
| openstackgerrit | Anton Arefiev proposed openstack-infra/project-config: Fix missing '$' sign in ironic-inspector-enabled builder https://review.openstack.org/370705 | 11:22 |
| *** itsuugo has quit IRC | 11:23 | |
| *** itsuugo has joined #openstack-infra | 11:25 | |
| *** thorst has quit IRC | 11:27 | |
| *** salv-orlando has joined #openstack-infra | 11:28 | |
| *** asettle has quit IRC | 11:30 | |
| *** vsaienk0 has joined #openstack-infra | 11:33 | |
| *** pgadiya has quit IRC | 11:35 | |
| *** yamamoto has joined #openstack-infra | 11:38 | |
| *** yamamoto has quit IRC | 11:41 | |
| *** edmondsw has joined #openstack-infra | 11:42 | |
| *** amitgandhinz has quit IRC | 11:43 | |
| *** itsuugo has quit IRC | 11:43 | |
| *** itsuugo has joined #openstack-infra | 11:44 | |
| *** markvoelker has joined #openstack-infra | 11:45 | |
| *** ldnunes has joined #openstack-infra | 11:47 | |
| *** kzaitsev_mb has quit IRC | 11:47 | |
| *** yamamoto has joined #openstack-infra | 11:47 | |
| *** rfolco has joined #openstack-infra | 11:49 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci: Remove forced delorean dib build https://review.openstack.org/370724 | 11:49 |
| *** baoli has joined #openstack-infra | 11:49 | |
| *** markvoelker has quit IRC | 11:50 | |
| *** yamamoto has quit IRC | 11:51 | |
| *** yamamoto has joined #openstack-infra | 11:52 | |
| *** trown|outtypewww is now known as trown | 11:52 | |
| *** gnuoy has quit IRC | 11:56 | |
| *** gnuoy has joined #openstack-infra | 11:56 | |
| *** yamamoto has quit IRC | 11:57 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:57 | |
| *** baoli_ has joined #openstack-infra | 11:58 | |
| *** gordc has joined #openstack-infra | 11:59 | |
| *** pgadiya has joined #openstack-infra | 11:59 | |
| *** baoli has quit IRC | 12:01 | |
| *** jkraj has joined #openstack-infra | 12:04 | |
| *** amoralej is now known as amoralej|lunch | 12:07 | |
| *** psilvad has joined #openstack-infra | 12:08 | |
| *** jlanoux has quit IRC | 12:09 | |
| *** sree has joined #openstack-infra | 12:10 | |
| *** gongysh has quit IRC | 12:12 | |
| *** Na3iL has quit IRC | 12:12 | |
| *** xyang1 has joined #openstack-infra | 12:12 | |
| *** pradk has joined #openstack-infra | 12:13 | |
| *** sree has quit IRC | 12:14 | |
| *** amitgandhinz has joined #openstack-infra | 12:15 | |
| *** claudiub has quit IRC | 12:16 | |
| *** lucas-hungry is now known as lucasagomes | 12:17 | |
| *** asselin__ has quit IRC | 12:17 | |
| openstackgerrit | Mike Fedosin proposed openstack-infra/project-config: Create glare-specs project https://review.openstack.org/370749 | 12:19 |
| *** sarob has joined #openstack-infra | 12:19 | |
| *** pgadiya has quit IRC | 12:19 | |
| *** itsuugo has quit IRC | 12:23 | |
| *** itsuugo has joined #openstack-infra | 12:23 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: enable the trove pylint job https://review.openstack.org/370506 | 12:23 |
| *** sarob has quit IRC | 12:24 | |
| amrith | AJaeger, https://review.openstack.org/#/c/370506/ with changes (some of them) that you requested. | 12:24 |
| *** zz_dimtruck is now known as dimtruck | 12:24 | |
| AJaeger | amrith: LGTM | 12:25 |
| openstackgerrit | amrith proposed openstack-infra/project-config: add newton gate jobs for trove https://review.openstack.org/368067 | 12:26 |
| amrith | Thanks AJaeger | 12:26 |
| amrith | I've also pushed the commit (above) for the newton gate jobs | 12:27 |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci: Remove forced delorean dib build https://review.openstack.org/370724 | 12:27 |
| *** kgiusti has joined #openstack-infra | 12:27 | |
| amrith | you'd commented on it earlier; I just update commit message with a depends-on on the trove rc1 tag commit | 12:27 |
| *** dizquierdo has quit IRC | 12:27 | |
| *** esberglu has joined #openstack-infra | 12:28 | |
| *** itsuugo has quit IRC | 12:28 | |
| *** itsuugo has joined #openstack-infra | 12:29 | |
| *** yamamoto has joined #openstack-infra | 12:30 | |
| *** asettle has joined #openstack-infra | 12:30 | |
| amrith | hi infra, may I have a review/approval on https://review.openstack.org/#/c/368067/ and https://review.openstack.org/#/c/370506/ please. we just tagged RC1 and if there are any failures resulting, I'd like to start getting them caught early so we can fix them in an RC2. thanks! | 12:30 |
| *** yamamoto has quit IRC | 12:31 | |
| *** yamamoto has joined #openstack-infra | 12:31 | |
| *** dimtruck is now known as zz_dimtruck | 12:34 | |
| *** ccamacho is now known as ccamacho|lunch | 12:35 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: do not prompt before submitting multiple reviews https://review.openstack.org/370769 | 12:35 |
| *** esberglu_ has joined #openstack-infra | 12:36 | |
| *** rhallisey has joined #openstack-infra | 12:36 | |
| *** asettle has quit IRC | 12:36 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/puppet-apps_site: [wip] Glare support for app-catalog https://review.openstack.org/359029 | 12:37 |
| *** esberglu has quit IRC | 12:37 | |
| *** esberglu_ is now known as esberglu | 12:37 | |
| *** yamamoto has quit IRC | 12:37 | |
| *** sdake has joined #openstack-infra | 12:38 | |
| *** markvoelker has joined #openstack-infra | 12:38 | |
| *** tuanla_ has quit IRC | 12:38 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: fixes stable/2.2 branch gate breakage https://review.openstack.org/369300 | 12:38 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: add upgrade testing jobs https://review.openstack.org/369164 | 12:38 |
| *** yamamoto has joined #openstack-infra | 12:38 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: do not prompt before submitting multiple reviews https://review.openstack.org/370769 | 12:39 |
| sileht | AJaeger, can you re-approve https://review.openstack.org/#/c/369300/ ? I removed the patch dependencies that was blocking it to be merged | 12:39 |
| sileht | yolanda, ^ | 12:43 |
| *** mriedem has joined #openstack-infra | 12:44 | |
| *** burgerk has joined #openstack-infra | 12:45 | |
| *** itsuugo has quit IRC | 12:45 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: Remove grenade testing jobs https://review.openstack.org/369163 | 12:45 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: add upgrade testing jobs https://review.openstack.org/369164 | 12:45 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: fixes stable/2.2 branch gate breakage https://review.openstack.org/369300 | 12:45 |
| sileht | mordred, I'm stupid I have put the patches in reverse order, sorry: https://review.openstack.org/369300 | 12:46 |
| *** itsuugo has joined #openstack-infra | 12:46 | |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Make dib job a template https://review.openstack.org/370781 | 12:47 |
| *** jamesdenton has joined #openstack-infra | 12:48 | |
| *** shardy has joined #openstack-infra | 12:50 | |
| *** rlandy has joined #openstack-infra | 12:50 | |
| *** dtantsur|bbl is now known as dtantsur | 12:51 | |
| zigo | AJaeger: I fixed the deb-novnc repository on Alioth. | 12:51 |
| zigo | The way to fix it was described here: https://www.perforce.com/blog/150109/git-out-vulnerability-out-fire | 12:52 |
| zigo | I'm bookmarking the URL this time... | 12:52 |
| *** Goneri has joined #openstack-infra | 12:53 | |
| *** annegentle has joined #openstack-infra | 12:53 | |
| *** electrofelix has joined #openstack-infra | 12:53 | |
| *** vikrant has quit IRC | 12:55 | |
| *** burgerk has quit IRC | 12:56 | |
| *** yamamoto has quit IRC | 12:56 | |
| *** fguillot has joined #openstack-infra | 12:57 | |
| *** yamamoto has joined #openstack-infra | 12:58 | |
| *** askb has quit IRC | 13:00 | |
| *** ociuhandu has quit IRC | 13:01 | |
| *** itsuugo has quit IRC | 13:01 | |
| *** bethwhite_ has joined #openstack-infra | 13:02 | |
| *** jaosorior has quit IRC | 13:02 | |
| *** jaosorior has joined #openstack-infra | 13:02 | |
| *** itsuugo has joined #openstack-infra | 13:02 | |
| mtreinish | yolanda, fungi, pabelanger: if you get a sec I've got a simple doc patch: https://review.openstack.org/#/c/237268/ | 13:03 |
| *** burgerk has joined #openstack-infra | 13:03 | |
| mtreinish | that one kinda slipped through the cracks. Heh, it's been open for almost a year | 13:03 |
| mtreinish | rcarrillocruz: ^^^ | 13:03 |
| *** psilvad has quit IRC | 13:05 | |
| *** psilvad has joined #openstack-infra | 13:05 | |
| *** oanson has quit IRC | 13:06 | |
| *** cardeois has joined #openstack-infra | 13:07 | |
| *** yamamoto has quit IRC | 13:07 | |
| *** yamamoto has joined #openstack-infra | 13:07 | |
| *** bexelbie_ has joined #openstack-infra | 13:09 | |
| *** psilvad has quit IRC | 13:09 | |
| *** bexelbie_ has left #openstack-infra | 13:09 | |
| *** psilvad has joined #openstack-infra | 13:09 | |
| *** akshai has joined #openstack-infra | 13:10 | |
| *** drawsmcgraw has left #openstack-infra | 13:10 | |
| *** annegentle has quit IRC | 13:11 | |
| *** moravec has quit IRC | 13:11 | |
| *** moravec has joined #openstack-infra | 13:12 | |
| *** drawsmcgraw has joined #openstack-infra | 13:12 | |
| *** fguillot has quit IRC | 13:13 | |
| *** sdake_ has joined #openstack-infra | 13:14 | |
| *** asselin__ has joined #openstack-infra | 13:14 | |
| *** amoralej|lunch is now known as amoralej | 13:15 | |
| *** salv-orlando has quit IRC | 13:15 | |
| *** sdake has quit IRC | 13:16 | |
| pabelanger | still a little early for hacking on glean :) | 13:16 |
| pabelanger | moar coffee | 13:16 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate: DNM: validate that low network_device_mtu on Nova side breaks gate https://review.openstack.org/370810 | 13:17 |
| *** sarob has joined #openstack-infra | 13:17 | |
| *** psilvad has quit IRC | 13:17 | |
| *** krtaylor has joined #openstack-infra | 13:18 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate: DNM: validate that low network_device_mtu on Nova side does not break gate https://review.openstack.org/370813 | 13:18 |
| *** psilvad has joined #openstack-infra | 13:18 | |
| *** rossella_ has quit IRC | 13:18 | |
| *** rossella_ has joined #openstack-infra | 13:19 | |
| *** pblaho has quit IRC | 13:21 | |
| *** sarob has quit IRC | 13:21 | |
| *** mdrabe has joined #openstack-infra | 13:22 | |
| *** ccamacho|lunch is now known as ccamacho | 13:22 | |
| *** shardy has quit IRC | 13:22 | |
| *** matt-borland has joined #openstack-infra | 13:23 | |
| *** Na3iL has joined #openstack-infra | 13:23 | |
| *** yamahata has joined #openstack-infra | 13:23 | |
| *** gouthamr has joined #openstack-infra | 13:24 | |
| openstackgerrit | Merged openstack-infra/system-config: Add documentation about openstack-health deployment https://review.openstack.org/237268 | 13:25 |
| vsaienk0 | devstack-gate: please review https://review.openstack.org/#/c/352909 the patch fixes enabled services on subnode. Needed for ironic multinode job | 13:25 |
| zxiiro | electrofelix: waynr: I rebased all the remaining api2.0 changes. There's only 5 left and I don't think they should take much time. We probably should consider any other things we want to get done for the code sprint tomorrow | 13:26 |
| mordred | sileht: no worries! | 13:26 |
| zxiiro | electrofelix: waynr: I'd really like to see views support added and am working on some new patches to get it working. I'm going to see if I can break up the current patch into something smaller. | 13:28 |
| *** mriedem has quit IRC | 13:29 | |
| electrofelix | zxiiro: cheers, both views and folders would be useful, might want to check what is in python-jenkins so far for both as well | 13:29 |
| zxiiro | electrofelix: agreed, folders would be handy too. | 13:29 |
| openstackgerrit | Pete Zaitcev proposed openstack-infra/git-review: Fix the outout of -l under py3 https://review.openstack.org/370507 | 13:31 |
| *** asettle has joined #openstack-infra | 13:33 | |
| openstackgerrit | Merged openstack-infra/project-config: gnocchi: fixes stable/2.2 branch gate breakage https://review.openstack.org/369300 | 13:34 |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Make dib job a template https://review.openstack.org/370781 | 13:35 |
| *** roxanaghe has joined #openstack-infra | 13:35 | |
| *** tsg has joined #openstack-infra | 13:36 | |
| asselin__ | mordred, quick review on this please? https://review.openstack.org/#/c/363074/ | 13:36 |
| *** eharney has joined #openstack-infra | 13:36 | |
| *** asettle has quit IRC | 13:37 | |
| *** yamamoto has quit IRC | 13:38 | |
| mordred | asselin__: looks fine to me - but I think we should also get opinion from fungi and clarkb ... I have a nagging memory that we didn't do delete on purpose, but I do not remember for the life of me what it was or if I'm hallucinating | 13:38 |
| openstackgerrit | Merged openstack-infra/project-config: gnocchi: Remove grenade testing jobs https://review.openstack.org/369163 | 13:39 |
| *** roxanaghe has quit IRC | 13:40 | |
| *** trown is now known as trown|afk | 13:40 | |
| *** EricGonczer_ has quit IRC | 13:41 | |
| openstackgerrit | Ryan Moats proposed openstack-infra/project-config: Fix the experimental VPNaaS rally job https://review.openstack.org/370838 | 13:41 |
| openstackgerrit | Mike Fedosin proposed openstack-infra/project-config: Create glare-specs project https://review.openstack.org/370749 | 13:42 |
| *** e0ne has quit IRC | 13:44 | |
| *** akshai has quit IRC | 13:44 | |
| *** esikache1 has joined #openstack-infra | 13:44 | |
| *** e0ne has joined #openstack-infra | 13:44 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul: Add async action plugin to override upstream async https://review.openstack.org/370309 | 13:44 |
| mordred | jeblair: ^^ works for both normal and async tasks now | 13:44 |
| *** artmr has joined #openstack-infra | 13:45 | |
| *** inc0 has joined #openstack-infra | 13:46 | |
| *** degorenko has quit IRC | 13:46 | |
| *** itsuugo has quit IRC | 13:46 | |
| *** amitgandhinz has quit IRC | 13:47 | |
| *** esikachev has quit IRC | 13:47 | |
| *** degorenko has joined #openstack-infra | 13:47 | |
| *** amitgandhinz has joined #openstack-infra | 13:48 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use sequence znodes for image build numbers https://review.openstack.org/370435 | 13:48 |
| *** akshai has joined #openstack-infra | 13:48 | |
| *** itsuugo has joined #openstack-infra | 13:48 | |
| *** eharney_ has joined #openstack-infra | 13:49 | |
| *** eharney has quit IRC | 13:49 | |
| *** eharney_ is now known as eharney | 13:49 | |
| *** akshai has quit IRC | 13:50 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Workaround patch to bring CI back https://review.openstack.org/370724 | 13:50 |
| phschwartz | Morning infra | 13:50 |
| *** amitgandhinz has quit IRC | 13:50 | |
| *** gongysh has joined #openstack-infra | 13:51 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Try Mistral API with 4 workers https://review.openstack.org/370847 | 13:51 |
| *** tonytan4ever has joined #openstack-infra | 13:51 | |
| *** amitgandhinz has joined #openstack-infra | 13:51 | |
| *** hongbin has joined #openstack-infra | 13:52 | |
| *** dizquierdo has joined #openstack-infra | 13:52 | |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Make dib job a template https://review.openstack.org/370781 | 13:53 |
| *** baoli has joined #openstack-infra | 13:54 | |
| *** akshai has joined #openstack-infra | 13:55 | |
| *** gongysh has quit IRC | 13:55 | |
| *** tonytan_brb has joined #openstack-infra | 13:56 | |
| *** baoli__ has joined #openstack-infra | 13:56 | |
| *** akshai has quit IRC | 13:57 | |
| *** baoli_ has quit IRC | 13:57 | |
| *** ddieterly has joined #openstack-infra | 13:57 | |
| *** akshai has joined #openstack-infra | 13:58 | |
| *** tonytan4ever has quit IRC | 13:58 | |
| *** yamamoto has joined #openstack-infra | 13:59 | |
| *** baoli has quit IRC | 13:59 | |
| *** ddieterly has quit IRC | 14:00 | |
| *** akshai has quit IRC | 14:01 | |
| *** ramishra has quit IRC | 14:01 | |
| *** ddieterly has joined #openstack-infra | 14:02 | |
| *** mriedem has joined #openstack-infra | 14:03 | |
| *** akshai has joined #openstack-infra | 14:03 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Delete default plan before cli deployment https://review.openstack.org/370857 | 14:03 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Delete default plan before cli deployment https://review.openstack.org/370857 | 14:04 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Add helper tag to join arbitrary lists into strings https://review.openstack.org/265926 | 14:05 |
| *** gouthamr has quit IRC | 14:07 | |
| *** drifterza has quit IRC | 14:07 | |
| *** ramishra has joined #openstack-infra | 14:08 | |
| *** asettle has joined #openstack-infra | 14:09 | |
| fungi | mordred: asselin__: i'm not personally aware of any reason we don't delete unmanaged files from /etc/puppet but perhaps clarkb knows why we shouldn't? | 14:09 |
| *** claudiub has joined #openstack-infra | 14:09 | |
| *** andreww has quit IRC | 14:10 | |
| fungi | if anything, i can see where having stuff we deleted in our git repos linger on the machines getting puppet apply run might cause subtle and hard to diagnose issues? | 14:11 |
| asselin__ | fungi, I agree...I don't remember what issue I ran into (if any) when I made that change to my local setup. But the behavior should be consistent with what the puppet master would have done. | 14:12 |
| electrofelix | waynr zxiiro: I'd like to also see if we can pick up https://review.openstack.org/#/c/194497 - JJB DSL, to hammer out some of the details as I think https://review.openstack.org/#/c/179459/ might warrant trying to add a warning about future behaviour change or hiding the behaviour behind a config option for a V2 preview? | 14:12 |
| *** zz_dimtruck is now known as dimtruck | 14:12 | |
| *** ddieterly has quit IRC | 14:13 | |
| asselin__ | fungi, it's possible I was just testing stuff and noticing files I added not get deleted. | 14:13 |
| *** burgerk has quit IRC | 14:14 | |
| *** asettle has quit IRC | 14:15 | |
| fungi | asselin__: yeah, i think it's probably an improvement but i'll let clarkb approve it if he agrees once around | 14:15 |
| *** ddieterly has joined #openstack-infra | 14:16 | |
| zxiiro | electrofelix: agreed, I think those would be useful to work in considering Jenkins 2.0 has those as major features now | 14:16 |
| *** nmagnezi has quit IRC | 14:16 | |
| *** psilvad has quit IRC | 14:17 | |
| *** fguillot has joined #openstack-infra | 14:17 | |
| zxiiro | electrofelix: waynr I'm taking care of the views feature at the moment. If someone wants to take care of the other ones. Or we can sync up tomorrow and figure out what's important | 14:17 |
| *** psilvad has joined #openstack-infra | 14:17 | |
| cloudnull | mornings | 14:19 |
| *** OferBarber has quit IRC | 14:21 | |
| *** rajinir has joined #openstack-infra | 14:23 | |
| waynr | zxiiro electrofelix i've been traveling for a week now and won't be home until pretty late tonight, i should be able to look into the things you are mentioning tomorrow morning though. | 14:24 |
| zxiiro | waynr: cool no worries | 14:24 |
| sdague | this is a new git error I've never seen before - http://logs.openstack.org/02/369502/2/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/6485b8e/logs/devstack-gate-setup-workspace-old.txt.gz#_2016-09-15_04_08_14_325 | 14:25 |
| *** flepied1 has joined #openstack-infra | 14:25 | |
| *** annegentle has joined #openstack-infra | 14:26 | |
| *** flepied has quit IRC | 14:26 | |
| *** jheroux has joined #openstack-infra | 14:27 | |
| sdague | http://logs.openstack.org/02/369502/2/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/6485b8e/logs/devstack-gate-setup-workspace-old.txt.gz#_2016-09-15_04_08_14_325 maybe it's the "Unexpected end of command stream" | 14:27 |
| *** yamamoto has quit IRC | 14:28 | |
| *** yamamoto has joined #openstack-infra | 14:29 | |
| *** yamamoto has quit IRC | 14:30 | |
| *** andreww has joined #openstack-infra | 14:30 | |
| *** trown|afk is now known as trown | 14:30 | |
| *** sree has joined #openstack-infra | 14:31 | |
| electrofelix | waynr: lets plan for tomorrow afternoon, I'm finding the reserve 4 hours for JJB exclusively at the same time every 2 weeks to be reasonably good | 14:31 |
| electrofelix | zxiiro: ^^ work for you? | 14:31 |
| clarkb | fungi: mordred asselin__ I would have to do testing but there is all sorts of stuff un /etc/puppet we dont want deleted on the puppetmaster | 14:32 |
| fungi | clarkb: oh, great point | 14:33 |
| asselin__ | clarkb, this doesn't delete on the puppet master, it deletes on the puppet slave so that it's consistent with what was already deleted on the master | 14:33 |
| *** yamamoto has joined #openstack-infra | 14:34 | |
| clarkb | asselin__: yes but we treat the master as a slave too | 14:34 |
| fungi | asselin__: we run puppet apply on our bastion | 14:34 |
| clarkb | so it runs the same sync code I think | 14:34 |
| asselin__ | yes that's true...so rsync with itself shouldn't delete anything AFAIK | 14:34 |
| *** yamamoto has quit IRC | 14:35 | |
| *** flepied1 is now known as flepied | 14:35 | |
| fungi | why wouldn't rsync delete anything? is it not called with --delete? | 14:35 |
| *** sree has quit IRC | 14:35 | |
| asselin__ | fungi, no, not by default (when called via ansible) | 14:36 |
| asselin__ | http://docs.ansible.com/ansible/synchronize_module.html | 14:36 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Reinstate the page size modification control in result-set-pager https://review.openstack.org/370310 | 14:38 |
| *** watanabe_isao has quit IRC | 14:39 | |
| fungi | sdague: i'm not entirely convinced the "Couldn't find remote ref refs/zuul/master/Z599be3eec71646acbabb6471d0b15c74" for neutron there is related, as the change triggering that job was for nova and may not have had any neutron changes ahead of it in the gate when it ran | 14:39 |
| *** tsg has quit IRC | 14:41 | |
| fungi | sdague: yeah, confirmed, the playbook indicates the only changes for that job were the one that triggered it, so it was just tested with that applied to nova's master branch tip, and all other involved projects have no zuul refs for that run | 14:42 |
| *** pradk has quit IRC | 14:42 | |
| sdague | fungi: ok, but why was it pulling master on old on a grenade job? | 14:43 |
| fungi | sdague: oh, now that's an excellent question. it did try to pull mitaka first | 14:43 |
| *** thiagolib has joined #openstack-infra | 14:44 | |
| fungi | rather, it tried Couldn't find remote ref refs/zuul/stable/mitaka/Z599be3eec71646acbabb6471d0b15c74 | 14:44 |
| openstackgerrit | Emily Hugenbruch proposed openstack-infra/irc-meetings: Change WOS-mentoring meetings to weekly https://review.openstack.org/370899 | 14:44 |
| openstackgerrit | Dougal Matthews proposed openstack-infra/tripleo-ci: [TESTING] Force debug on tripleo.sh https://review.openstack.org/370900 | 14:45 |
| *** pradk has joined #openstack-infra | 14:45 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Delete default plan before cli deployment https://review.openstack.org/370857 | 14:45 |
| *** jed56 has quit IRC | 14:45 | |
| *** ddieterly has quit IRC | 14:46 | |
| *** akshai has quit IRC | 14:49 | |
| fungi | sdague: strange that it's calling git fetch directly too... for some reason i thought we'd already converted devstack-gate to use zuul-cloner for this logic? | 14:50 |
| fungi | but i guess not http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n237 | 14:50 |
| *** chem` is now known as chem | 14:50 | |
| *** isaacb has quit IRC | 14:51 | |
| *** burgerk has joined #openstack-infra | 14:51 | |
| *** akshai has joined #openstack-infra | 14:51 | |
| *** akshai has quit IRC | 14:51 | |
| *** akshai has joined #openstack-infra | 14:53 | |
| fungi | and yeah, the "Your branch is based on 'origin/master', but the upstream is gone." seems to indicate that somehow the origin remote was unset in the local clone of neutron there (or for other reasons it thinks the remote has no branch named master) | 14:54 |
| *** baoli has joined #openstack-infra | 14:54 | |
| fungi | sdague: have you looked to see whether this is widespread or just a one-off failure? | 14:55 |
| *** baoli__ has quit IRC | 14:55 | |
| sdague | I have not yet | 14:56 |
| *** Zhongjun__ has joined #openstack-infra | 14:56 | |
| fungi | i'm poking in logstash now in that case | 14:56 |
| *** tonytan_brb is now known as tonytan4ever | 14:57 | |
| *** edtubill has joined #openstack-infra | 14:57 | |
| *** rbrndt has joined #openstack-infra | 14:57 | |
| *** edtubill has quit IRC | 14:57 | |
| fungi | sdague: weird, in the past 24 hours it hit two jobs, both at almost exactly the same time and for the same change | 14:58 |
| *** edtubill has joined #openstack-infra | 14:58 | |
| fungi | the aforementioned gate-grenade-dsvm-neutron-ubuntu-trusty run and also gate-tempest-dsvm-full-devstack-plugin-ceph-ubuntu-xenial | 14:59 |
| fungi | matching log entries are 40 seconds apart | 14:59 |
| *** edtubill has quit IRC | 15:00 | |
| clarkb | gate-greande-dsvm-neutron-ubuntu-trusty is super flaky recently for other reasons | 15:00 |
| *** berendt has quit IRC | 15:03 | |
| fungi | sdague: yeah, looks like logstash only has those two hits over the past week, so i'm inclined to blame clouds and the internet. amusingly one ran in osic-cloud1 and the other in bluebox-sjc1 | 15:04 |
| fungi | so presumably this was an issue locally in rackspace-dfw or a hiccup on one specific server | 15:05 |
| sdague | fungi: yeh | 15:05 |
| *** yamahata has quit IRC | 15:06 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo: disable voting on gate-tripleo-ci-centos-7-nonha-multinode https://review.openstack.org/370922 | 15:06 |
| *** yuval has quit IRC | 15:06 | |
| fungi | sdague: maybe https://status.rackspace.com/index/viewincidents?group=21&start=1473825600 | 15:06 |
| EmilienM | hi Infra, we're having a critical problem in tripleo right now, and we're working on it. Until we fix our bug, we need this job non voting asap ^ -- thanks for your review | 15:06 |
| *** regXboi has joined #openstack-infra | 15:07 | |
| *** baoli_ has joined #openstack-infra | 15:07 | |
| zxiiro | electrofelix: sounds reasonable to me. let's go with that | 15:07 |
| fungi | sdague: hrm, no unless they got the filing date wrong on that incident, it's about 24 hours too early | 15:07 |
| *** mtanino has joined #openstack-infra | 15:08 | |
| mordred | fungi: is any way to distinguish between "I talked to the remote and it did not have the ref you requested" and "I could not reach the remote" ? | 15:09 |
| mordred | because not being able to reach the remote for a sec then falling back to master seems like a bad fallback | 15:09 |
| fungi | mordred: not sure. needs some research | 15:10 |
| *** baoli has quit IRC | 15:10 | |
| *** asettle has joined #openstack-infra | 15:11 | |
| *** zul has joined #openstack-infra | 15:12 | |
| *** rbrndt_ has joined #openstack-infra | 15:14 | |
| * regXboi wanders in | 15:14 | |
| jroll | fungi: without trying to parse scrollback, dfw had some control plane issues overnight, if that could be related | 15:14 |
| jeblair | fungi, mordred: zuul-cloner does have that capability | 15:14 |
| jeblair | so switching d-g to use z-c would improve that condition | 15:15 |
| mordred | jeblair: ok. so the answer is "migrate to z-c" | 15:15 |
| regXboi | ola - I've posted https://review.openstack.org/#/c/370838/ to start fixing the rally job for neutron-vpnaas - would like some eyes on it when people have cycles | 15:15 |
| *** gouthamr has joined #openstack-infra | 15:15 | |
| *** csomerville has joined #openstack-infra | 15:16 | |
| jroll | hrm, probably not control plane issues :/ | 15:16 |
| fungi | jroll: the issue we recorded was minor, fleeting and vague so could be caused almost anything | 15:16 |
| *** asettle has quit IRC | 15:16 | |
| jroll | ah, ok | 15:16 |
| *** gouthamr has quit IRC | 15:17 | |
| *** gouthamr has joined #openstack-infra | 15:17 | |
| *** mtanin___ has joined #openstack-infra | 15:17 | |
| *** spzala has joined #openstack-infra | 15:17 | |
| *** jaosorior has quit IRC | 15:18 | |
| *** mtanino has quit IRC | 15:18 | |
| *** cody-somerville has quit IRC | 15:19 | |
| *** pcaruana has quit IRC | 15:19 | |
| *** rbrndt has quit IRC | 15:19 | |
| *** salv-orlando has joined #openstack-infra | 15:19 | |
| *** andreas_s has quit IRC | 15:19 | |
| *** adrian_otto has joined #openstack-infra | 15:20 | |
| *** M-docaedo_vector has quit IRC | 15:21 | |
| *** salv-orlando has quit IRC | 15:22 | |
| *** yaume has quit IRC | 15:22 | |
| *** zul has quit IRC | 15:22 | |
| *** EricGonczer_ has joined #openstack-infra | 15:23 | |
| *** tsg has joined #openstack-infra | 15:25 | |
| *** kjorgensen has joined #openstack-infra | 15:25 | |
| *** ddieterly has joined #openstack-infra | 15:25 | |
| *** ddieterly has quit IRC | 15:26 | |
| *** ddieterly has joined #openstack-infra | 15:26 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use sequence znodes for image build numbers https://review.openstack.org/370435 | 15:28 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo: disable voting on gate-tripleo-ci-centos-7-nonha-multinode https://review.openstack.org/370922 | 15:29 |
| EmilienM | mordred: I had to do a small change again - thx for your +2, very helpful ^ | 15:29 |
| *** sree has joined #openstack-infra | 15:29 | |
| *** mikelk has quit IRC | 15:30 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Delete default plan before cli deployment https://review.openstack.org/370857 | 15:30 |
| *** mdrabe has quit IRC | 15:32 | |
| *** sree has quit IRC | 15:34 | |
| *** EricGonczer_ has quit IRC | 15:35 | |
| *** yamamoto has joined #openstack-infra | 15:35 | |
| *** woodster_ has joined #openstack-infra | 15:36 | |
| *** mtanino has joined #openstack-infra | 15:36 | |
| *** mtanin___ has quit IRC | 15:37 | |
| *** mdrabe has joined #openstack-infra | 15:38 | |
| zigo | mordred: I have the feeling that ftp.fr.debian.org has a script to ban us or something. The sbuild setup script sometimes fails to fetch the Release file... :/ | 15:39 |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Make dib job a template https://review.openstack.org/370781 | 15:39 |
| zigo | mordred: Failure to download from Debian repositories is the majority of our problems. I hope we can switch to a real Debian mirror soon. | 15:40 |
| mordred | zigo: I think pabelanger has the patch done to add sources to our mirror | 15:40 |
| mordred | and yah | 15:40 |
| mordred | the rsync | 15:40 |
| zigo | Yup. | 15:40 |
| zigo | We need signed repo to be able to setup sbuild. | 15:40 |
| zigo | I was using httpredir.debian.org, and there was too many errors, so I switched to ftp.fr.debian.org. | 15:40 |
| mordred | zigo: it's good to know that our work of making mirrors is not wasted effort :) | 15:41 |
| mordred | and is, in fact, _very_ necessary | 15:41 |
| *** yamamoto has quit IRC | 15:42 | |
| *** vinaypotluri has joined #openstack-infra | 15:48 | |
| *** itsuugo has quit IRC | 15:48 | |
| *** salv-orlando has joined #openstack-infra | 15:49 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test dib build removal and temprevert together https://review.openstack.org/370961 | 15:49 |
| *** priteau has joined #openstack-infra | 15:49 | |
| *** Hal has quit IRC | 15:49 | |
| *** itsuugo has joined #openstack-infra | 15:49 | |
| *** jgriffith has quit IRC | 15:52 | |
| *** tsg has quit IRC | 15:54 | |
| *** andreww is now known as xarses | 15:56 | |
| *** dizquierdo has quit IRC | 15:56 | |
| *** jkraj has quit IRC | 15:58 | |
| *** tphummel has joined #openstack-infra | 15:58 | |
| *** drifterza has joined #openstack-infra | 15:59 | |
| *** matbu is now known as matbu|brb | 15:59 | |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 16:00 | |
| *** tsg has joined #openstack-infra | 16:00 | |
| pleia2 | thanks for bug sprint things yesterday, everyone :) | 16:00 |
| *** abregman__ has joined #openstack-infra | 16:00 | |
| pleia2 | I'll write up a summary email momentarily | 16:00 |
| *** abregman_ has quit IRC | 16:00 | |
| EmilienM | can anyone approve this patch please? this is outstanding for tripleo group https://review.openstack.org/#/c/370922/ | 16:00 |
| dmsimard | Is it possible to filter on a particular topic in Zuul layout ? Somewhat like how we filter jobs on particular branches. | 16:00 |
| *** abregman__ has quit IRC | 16:01 | |
| pabelanger | mordred: zigo: can talk about it next week at mid-cycle, but ftp-mirror script from debian will work. But, it will mirror all distros | 16:01 |
| *** abregman has joined #openstack-infra | 16:01 | |
| zigo | pabelanger: You mean sid and experimental? That's a good thing, I also need those to do backports. | 16:02 |
| mgagne | pabelanger: so we added better caching for images. lets wait and see if it fixes the problem | 16:02 |
| mgagne | (at internap-mtl01) | 16:02 |
| EmilienM | pabelanger: can you review https://review.openstack.org/#/c/370922/ when you can please? we're trying to unblock tripleo CI and we need this patch (we found the root cause of the problem) | 16:03 |
| clarkb | dmsimard: the topic is included in the change attributes https://review.openstack.org/Documentation/json.html#change so it should at least be possible but not sure if zuul supports that /me reads zuul docs | 16:04 |
| fungi | dmsimard: if you mean gerrit topic, no zuul doesn't pay attention to gerrit topics at all (and they're also highly malleable so it would probably be dangerous if it did anyway) | 16:04 |
| mordred | pabelanger: wow, we can't pick releases? oh - is it because of the pool structure? | 16:04 |
| dmsimard | fungi: ack, thanks | 16:04 |
| mordred | pabelanger: basically it's going to mirror the whole pool I guess? | 16:04 |
| fungi | dmsimard: oh, though clarkb makes a good point there... it may be that zuul treats all change attributes the same in that regard | 16:05 |
| dmsimard | fungi: well, there /are/ slight mentions of topic in Zuul code (i.e, https://github.com/openstack-infra/zuul/blob/c19d3d9eff8921d7a76abd58729a3acb08d3e1e5/tests/base.py#L295 ) but it's not clear | 16:05 |
| *** Hal has joined #openstack-infra | 16:05 | |
| dmsimard | I guess there is only one way to find out for sure | 16:05 |
| dmsimard | (This is in RDO's Zuul instance) | 16:06 |
| *** adrian_otto has quit IRC | 16:06 | |
| clarkb | based on http://docs.openstack.org/infra/zuul/triggers.html#gerrit it doesn't look like theyare arbitrary in the zuul config | 16:06 |
| *** abregman has quit IRC | 16:06 | |
| clarkb | so you'll have to add that ot zuul if you want it | 16:06 |
| *** abregman has joined #openstack-infra | 16:06 | |
| *** gyee has joined #openstack-infra | 16:06 | |
| fungi | dmsimard: yeah, i think the mentions of "topic" in zuul's unit test framework are there so that we have an accurate depiction of a gerrit change event | 16:07 |
| * dmsimard nods | 16:07 | |
| pleia2 | EmilienM: looking now | 16:07 |
| *** mdrabe has quit IRC | 16:08 | |
| EmilienM | thanks | 16:08 |
| *** mdrabe has joined #openstack-infra | 16:08 | |
| *** samuelBartel has quit IRC | 16:08 | |
| *** Apoorva has joined #openstack-infra | 16:09 | |
| pleia2 | lgtm | 16:10 |
| clarkb | logstash says 7 gate resets in the last 24 hours due to the neutron grenade issue | 16:10 |
| *** piet has joined #openstack-infra | 16:10 | |
| *** jgriffith has joined #openstack-infra | 16:11 | |
| * clarkb puts keystone up next on the xenialification ride | 16:12 | |
| *** asettle has joined #openstack-infra | 16:12 | |
| jeblair | dmsimard: what fungi says is true. what's your use case? | 16:12 |
| mtreinish | clarkb: is that in e-r yet? | 16:13 |
| pleia2 | oomichi: great email, thank you! | 16:13 |
| dmsimard | jeblair: disabling certain jobs when a review is on a particular topic | 16:13 |
| dmsimard | (or the reverse logic of that) | 16:14 |
| jeblair | dmsimard: what's the underlying reason you want to disable/enable those jobs? | 16:14 |
| *** Hal has quit IRC | 16:14 | |
| dmsimard | jeblair: long running irrelevant jobs on trivial reviews in a particular topic | 16:15 |
| jeblair | dmsimard: (i'm wearing my architect hat at the moment while i ask these questions :) | 16:15 |
| dmsimard | jeblair: that would otherwise be relevant if not for that topic | 16:15 |
| *** yamahata has joined #openstack-infra | 16:15 | |
| dmsimard | jeblair: It's not a huge deal, we're going to disable these particular jobs while we crunch out these reviews and re-enable them afterwards | 16:16 |
| dmsimard | it's a one time deal | 16:16 |
| jeblair | dmsimard: is the topic truly an indicator of thes (like, all changes for the "cleanup-whitespace" topic shouldn't run these jobs) or is that a topic seems like a convenient piece of metadata to put a control like "topic: dont-run-slow-jobs") | 16:16 |
| *** dizquierdo has joined #openstack-infra | 16:17 | |
| *** asettle has quit IRC | 16:17 | |
| openstackgerrit | Sudipta Biswas proposed openstack/diskimage-builder: ppc64el: fix for grub2 missing package https://review.openstack.org/370980 | 16:17 |
| dmsimard | jeblair: a little bit of column A and a little bit of column B ? | 16:18 |
| jeblair | dmsimard: heh, what's the nature of these reviews you need to crunch out? | 16:18 |
| dmsimard | jeblair: I think in the case of "B" we can have a basic set of jobs and then have a trigger "check slow-jobs" to trigger them | 16:18 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test dib build removal and temprevert together https://review.openstack.org/370961 | 16:18 |
| clarkb | mtreinish: I don't know I had to run away last night to do family things | 16:18 |
| *** docaedo4 has quit IRC | 16:18 | |
| dmsimard | jeblair: not unlike "check experimental" | 16:18 |
| clarkb | mtreinish: build_name:"gate-grenade-dsvm-neutron-ubuntu-trusty" AND filename:"console.html" AND message:"tempest.lib.exceptions.SSHTimeout: Connection to the" AND build_queue:"gate" is my query | 16:18 |
| clarkb | mtreinish: I have to run off again now to run pre trip errands | 16:18 |
| jeblair | dmsimard: (yeah, i agree that's a good way to handle that) | 16:18 |
| mtreinish | mriedem, armax: ^^^ do we have a bug and/or e-r query for that issue? | 16:19 |
| sdague | mtreinish: I don't know there is a particular deep signature, I was kevinbenton noticed it as well | 16:19 |
| sdague | http://tinyurl.com/zdpx7rh | 16:19 |
| armax | mtreinish: nope | 16:19 |
| sdague | he was going to dive in | 16:19 |
| armax | I got a bug report though | 16:19 |
| armax | qw | 16:19 |
| jeblair | dmsimard: would a branch be a useful construct for this series of changes? | 16:19 |
| kevinbenton | sdague: what's weird is that it's not very consistent in where it fails | 16:19 |
| *** matrohon has quit IRC | 16:19 | |
| kevinbenton | sdague: i had one make it through the first vm fine | 16:19 |
| armax | we’re still fishing for potential causes | 16:19 |
| kevinbenton | sdague: and then die | 16:20 |
| kevinbenton | on the second | 16:20 |
| armax | bug 1623732 | 16:20 |
| openstack | bug 1623732 in neutron "failed: route add -net "0.0.0.0/0" gw "10.1.0.1" leads to test_network_basic_ops to fail with SSHTimeout" [Critical,Confirmed] https://launchpad.net/bugs/1623732 | 16:20 |
| dmsimard | jeblair: let's go to #zuul :) | 16:20 |
| sdague | kevinbenton: right, the ssh connect issues tend to be like that | 16:20 |
| pabelanger | mordred: yes, for stable, testing and unstable | 16:20 |
| kevinbenton | sdague: i mean it's not even necessarily ssh | 16:20 |
| kevinbenton | sdague: sometimes the VM can't get dhcp | 16:20 |
| kevinbenton | sdague: sometimes it can be reached with ssh | 16:20 |
| jeblair | pabelanger, mordred, fungi: can you pls review afs-docs changes https://review.openstack.org/369738 and child? | 16:21 |
| openstackgerrit | Merged openstack-infra/project-config: tripleo: disable voting on gate-tripleo-ci-centos-7-nonha-multinode https://review.openstack.org/370922 | 16:21 |
| sdague | kevinbenton: you know, randomness like that in network land makes me wonder if there is a different mtu regression | 16:21 |
| sdague | kevinbenton: are we failing on old side or new side? | 16:21 |
| jeblair | AJaeger: i think i have the marker stuff worked out from yesterday, and i think we can proceed the way we were planning. | 16:21 |
| armax | clarkb: it’d be great if we could get hold of a node that’s failing on that jpb | 16:21 |
| armax | job | 16:21 |
| mriedem | mtreinish: http://status.openstack.org//elastic-recheck/index.html#1355573 ? | 16:22 |
| mriedem | mtreinish: http://status.openstack.org//elastic-recheck/index.html#1349617 ? | 16:22 |
| jeblair | AJaeger: see updated code comments in https://review.openstack.org/369738 for details; though nothing substantial changed except i think it will actually work now :) | 16:22 |
| *** tobiash has quit IRC | 16:22 | |
| kevinbenton | sdague: new side | 16:22 |
| fungi | jeblair: you read my mind. i had just pulled 369738 back up from last night | 16:22 |
| armax | mriedem: those are not catching what’s been seen in the last 24 hours | 16:23 |
| *** tobiash has joined #openstack-infra | 16:23 | |
| armax | as far as I can tell | 16:24 |
| *** kzaitsev_mb has quit IRC | 16:24 | |
| *** lucasagomes is now known as lucas-dinner | 16:24 | |
| *** dtantsur is now known as dtantsur|afk | 16:25 | |
| *** florianf has quit IRC | 16:25 | |
| mriedem | armax: and bug https://bugs.launchpad.net/neutron/+bug/1623732 is the one we're talking about yes? | 16:26 |
| openstack | Launchpad bug 1623732 in neutron "failed: route add -net "0.0.0.0/0" gw "10.1.0.1" leads to test_network_basic_ops to fail with SSHTimeout" [Critical,Confirmed] | 16:26 |
| armax | yea | 16:26 |
| armax | mriedem: at least that’s the one I have been seeing burning in the house | 16:26 |
| *** rcernin has quit IRC | 16:26 | |
| stevemar | clarkb: what's the xenialification ride? | 16:26 |
| *** inc0 has quit IRC | 16:26 | |
| *** e0ne has quit IRC | 16:26 | |
| mriedem | ok, i'm dangerously close to lunch time | 16:27 |
| *** inc0 has joined #openstack-infra | 16:27 | |
| *** jascott1 has joined #openstack-infra | 16:27 | |
| stevemar | mriedem: and we won't like you when you're hangry? | 16:27 |
| mriedem | you'll probably like me equally | 16:27 |
| *** florianf has joined #openstack-infra | 16:30 | |
| *** jascott1 has quit IRC | 16:30 | |
| *** asettle has joined #openstack-infra | 16:31 | |
| *** jascott1 has joined #openstack-infra | 16:31 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test dib build removal and temprevert together https://review.openstack.org/370961 | 16:31 |
| *** jpich has quit IRC | 16:32 | |
| *** itsuugo has quit IRC | 16:32 | |
| *** adrian_otto has joined #openstack-infra | 16:33 | |
| prometheanfire | pabelanger: clarkb: about the glean reveiw, I do think we should enable each interface, but because of the way interfaces in gentoo works, we only need to enable interfaces that have config info | 16:33 |
| *** itsuugo has joined #openstack-infra | 16:34 | |
| prometheanfire | pabelanger: clarkb: an example of this is a bond and two eths, the bond has config info and depends on the two eths, so it will automatically bring the two eths up before bringing up/configuring the bond | 16:34 |
| prometheanfire | it's similiar for vlans | 16:34 |
| prometheanfire | https://review.openstack.org/367487 | 16:34 |
| *** kzaitsev_mb has joined #openstack-infra | 16:34 | |
| *** baoli_ has quit IRC | 16:34 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add files01.openstack.org https://review.openstack.org/370990 | 16:36 |
| jeblair | fungi, pabelanger, mordred: ^ | 16:36 |
| *** asettle has quit IRC | 16:36 | |
| clarkb | stevemar: migrating your tests that run on newton to xenial | 16:36 |
| clarkb | stevemar: its mostly done except for your functional jobs many of which are non voting looks like | 16:36 |
| *** adrian_otto has quit IRC | 16:37 | |
| *** esikache1 has quit IRC | 16:37 | |
| erlon | hi clarkb | 16:37 |
| *** drifterza has quit IRC | 16:38 | |
| erlon | clarkb: does the gate changes the working if add this patch as dependency? https://review.openstack.org/#/c/369519/ | 16:38 |
| erlon | clarkb: I tryed but id didn't worked | 16:38 |
| *** spzala has quit IRC | 16:39 | |
| erlon | clarkb: added a depends-on here: https://review.openstack.org/#/c/147186/ | 16:39 |
| erlon | clarkb: but the gate seems to be sending the same job | 16:39 |
| *** roxanaghe has joined #openstack-infra | 16:39 | |
| *** spzala has joined #openstack-infra | 16:39 | |
| *** adrian_otto has joined #openstack-infra | 16:40 | |
| *** jordanP has quit IRC | 16:40 | |
| *** gouthamr has quit IRC | 16:40 | |
| *** fguillot has quit IRC | 16:41 | |
| amrith | hi infra, may I have a second review/approval on https://review.openstack.org/#/c/368067/ and https://review.openstack.org/#/c/370506/ please. we just tagged RC1 and if there are any failures resulting, I'd like to start getting them caught early so we can fix them in an RC2. thanks! | 16:42 |
| *** tonytan4ever has quit IRC | 16:42 | |
| clarkb | erlon: changes to the jjb configs are not self testing | 16:43 |
| stevemar | clarkb: does this have anything to do with why my stable/newton grenade job is failin? | 16:43 |
| *** gouthamr has joined #openstack-infra | 16:43 | |
| stevemar | clarkb: https://review.openstack.org/#/q/status:open+project:openstack/keystone+branch:stable/newton+topic:create-newton | 16:43 |
| erlon | clarkb: hmm, as I guessed | 16:43 |
| *** adrian_otto has quit IRC | 16:43 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add Experiemental PDNS job on xenial https://review.openstack.org/370996 | 16:43 |
| erlon | clarkb: do you have +2 powers? | 16:43 |
| stevemar | clarkb: http://logs.openstack.org/77/370877/1/check/gate-grenade-dsvm-neutron-ubuntu-xenial/5d1b019/logs/grenade.sh.txt.gz#_2016-09-15_14_39_01_546 | 16:43 |
| stevemar | WARNING: this script has not been tested on xenial :) | 16:43 |
| erlon | clarkb: even if not, when possible, can you check that patch? | 16:44 |
| *** roxanaghe has quit IRC | 16:44 | |
| *** priteau has quit IRC | 16:44 | |
| *** tobiash has quit IRC | 16:44 | |
| pabelanger | mgagne: great, thanks for looking into it | 16:44 |
| *** yamamoto has joined #openstack-infra | 16:44 | |
| *** regXboi has quit IRC | 16:44 | |
| clarkb | stevemar: no thatd likely due to all thr branches not existing yet and grenad ebeing silly and failing on untested platforms | 16:44 |
| *** yamamoto has quit IRC | 16:44 | |
| *** asselin_ has joined #openstack-infra | 16:44 | |
| *** docaedo4 has joined #openstack-infra | 16:45 | |
| *** asselin__ has quit IRC | 16:45 | |
| *** tobiash has joined #openstack-infra | 16:45 | |
| *** adrian_otto has joined #openstack-infra | 16:46 | |
| stevemar | clarkb: advice on fixing it? :) | 16:46 |
| clarkb | stevemar: all ptojects need newton brnaches and grenade should stop failing if it doesnt recog ize the distro | 16:46 |
| clarkb | it says "warning" then exits non zero iirc | 16:47 |
| pabelanger | prometheanfire: okay, so we need to make a change to 367487 or we are good for now? If you'd like to make an update, I have no issues. I don't have the bandwidth to upload a gentoo image in to rax right now. Also, I've never used it before, so going to be some learning curve there for me too | 16:47 |
| clarkb | having a warning is fine buy it shouldnt error | 16:47 |
| prometheanfire | pabelanger: I'll try to test tonight at home or on osic | 16:47 |
| prometheanfire | pabelanger: because of the way networks depend on one another it's 'odd' | 16:48 |
| *** adrian_otto has joined #openstack-infra | 16:48 | |
| pabelanger | prometheanfire: ack | 16:48 |
| prometheanfire | but at least glean can be run over and over to live test | 16:48 |
| *** spzala has quit IRC | 16:49 | |
| *** derekh has quit IRC | 16:49 | |
| *** vhosakot has joined #openstack-infra | 16:49 | |
| *** senk has joined #openstack-infra | 16:51 | |
| *** annegentle has quit IRC | 16:52 | |
| openstackgerrit | Jerry Zhao proposed openstack-infra/project-config: remove requirements check for networking-fortinet https://review.openstack.org/370470 | 16:53 |
| *** adrian_otto1 has joined #openstack-infra | 16:53 | |
| *** asettle has joined #openstack-infra | 16:55 | |
| mordred | jeblair: typo-oopsie in afs patch | 16:55 |
| jeblair | mordred: ya just noticed that | 16:55 |
| jeblair | mordred: the www_root/base thing? | 16:55 |
| mordred | jeblair: yup | 16:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add files01.openstack.org https://review.openstack.org/370990 | 16:56 |
| jeblair | mordred: there we go! pabelanger ^ | 16:56 |
| *** tosky has quit IRC | 16:56 | |
| jeblair | (yay apply test!) | 16:56 |
| pabelanger | clearly a better reviewer them me | 16:56 |
| pabelanger | then* | 16:56 |
| jeblair | i think he had help | 16:56 |
| *** adrian_otto has quit IRC | 16:57 | |
| *** bethwhite_ has quit IRC | 16:57 | |
| *** maishsk has joined #openstack-infra | 16:57 | |
| *** yamahata has quit IRC | 16:58 | |
| *** yamahata has joined #openstack-infra | 16:58 | |
| *** sree has joined #openstack-infra | 16:58 | |
| mordred | ssssh | 16:58 |
| *** asettle has quit IRC | 17:01 | |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: add AFS publisher https://review.openstack.org/369738 | 17:02 |
| *** sree has quit IRC | 17:03 | |
| *** rfolco has quit IRC | 17:03 | |
| *** tsg_ has joined #openstack-infra | 17:03 | |
| *** hashar has quit IRC | 17:04 | |
| *** rfolco has joined #openstack-infra | 17:04 | |
| *** dahoo has joined #openstack-infra | 17:04 | |
| *** adrian_otto1 has quit IRC | 17:04 | |
| *** adrian_otto has joined #openstack-infra | 17:05 | |
| fungi | oh, whoops. i guess i double-approved the k5start one | 17:05 |
| *** esikache1 has joined #openstack-infra | 17:05 | |
| jeblair | fungi: unrelated, but would you mind aprving https://review.openstack.org/370448 so we can roll it into the same restart? | 17:06 |
| fungi | looking | 17:06 |
| fungi | oh, right-o, that one | 17:06 |
| *** tsg has quit IRC | 17:07 | |
| JayF | We have a spammer in #openstack-ironic | 17:07 |
| JayF | can someone with access do the needful | 17:07 |
| JayF | fungi: jeblair: pabelanger: ^ help? | 17:07 |
| JayF | oh, jroll can do it | 17:07 |
| JayF | fixed, jroll wins :D | 17:07 |
| dstanek | spammer in #openstack-keystone too | 17:09 |
| *** esikache1 has quit IRC | 17:11 | |
| fungi | yeah, i just added them to the akick list there | 17:11 |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: run k5start in playbook https://review.openstack.org/370235 | 17:12 |
| openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: format ipv6 urls [correctly] https://review.openstack.org/370448 | 17:13 |
| *** esikache1 has joined #openstack-infra | 17:13 | |
| *** dizquierdo has quit IRC | 17:13 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: remove DIB workaround https://review.openstack.org/369792 | 17:14 |
| *** senk has quit IRC | 17:18 | |
| *** rossella_ has quit IRC | 17:18 | |
| *** rossella_ has joined #openstack-infra | 17:19 | |
| *** esikache1 has quit IRC | 17:22 | |
| *** bethwhite_ has joined #openstack-infra | 17:22 | |
| jeblair | fungi, pabelanger, mordred, ianw: we currently have 3 documentation websites (docs, api, developer). i made a 'docs' volume and rooted it at /afs/o.o/docs. i'm thinking that maybe what we want is a volume for each of those sites, and to mount them at /afs/o.o/web/<site>. eg /afs/o.o/web/docs. | 17:22 |
| fungi | jeblair: i believe api is just a redirect now | 17:22 |
| fungi | to developer | 17:23 |
| sc68cal | ]/w 26 | 17:23 |
| *** abregman has quit IRC | 17:23 | |
| sc68cal | whoops, thanks irssi | 17:23 |
| fungi | jeblair: or at least that's how it looked when i was digging in cloudsites configuration anyway | 17:23 |
| jeblair | fungi: hrm. it still has a jjb site configuration and a job that publishes there. maybe it only publishes .htaccess files or something? | 17:24 |
| jeblair | it certainly does redirect :) | 17:24 |
| fungi | yeah, attempting to browse to apps.openstack.org just redirects me to http://developer.openstack.org/ and yes i believe te redirect is done via a .htaccess file | 17:24 |
| jeblair | fungi: you mean api.o.o, right? | 17:24 |
| fungi | because you can't set redirect-style aliases for sites in cloudsites | 17:24 |
| fungi | grr, yes api | 17:24 |
| fungi | i'm also in the app catalogue meeting discussing their glare support implementation at the same time, sorry | 17:25 |
| jeblair | ok cool, so probably we can drop a bunch of stuff by just making that an apache redirect. | 17:25 |
| openstackgerrit | Merged openstack-infra/system-config: Add files01.openstack.org https://review.openstack.org/370990 | 17:26 |
| *** fguillot has joined #openstack-infra | 17:26 | |
| *** megm has quit IRC | 17:26 | |
| jeblair | hrm. i'm less enthused by my subdir idea atm. | 17:26 |
| jeblair | maybe we should just stick with /docs and make /developer-docs a sibling. | 17:27 |
| jeblair | (this is all fairly easy to change later, thanks to multiple mounts) | 17:27 |
| *** megm has joined #openstack-infra | 17:28 | |
| *** trown is now known as trown|lunch | 17:28 | |
| *** jascott1 has quit IRC | 17:29 | |
| *** M-docaedo_vector has joined #openstack-infra | 17:29 | |
| *** jascott1 has joined #openstack-infra | 17:29 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add afs sites to zuul-launchers https://review.openstack.org/371018 | 17:29 |
| *** chem has quit IRC | 17:29 | |
| *** chem has joined #openstack-infra | 17:30 | |
| *** chem has quit IRC | 17:30 | |
| *** chem has joined #openstack-infra | 17:30 | |
| *** e0ne has joined #openstack-infra | 17:30 | |
| *** sambetts is now known as sambetts|afk | 17:30 | |
| *** electrofelix has quit IRC | 17:31 | |
| jeblair | fungi, mordred, pabelanger: i think it's safe to land that ^ before the launcher restart; that way it will restart with the necessary configuration. it should even be safe to do before we install the keytab. | 17:32 |
| pabelanger | LGTM | 17:33 |
| *** jascott1 has quit IRC | 17:34 | |
| fungi | agreed | 17:35 |
| *** degorenko is now known as _degorenko|afk | 17:35 | |
| *** adrian_otto has quit IRC | 17:36 | |
| *** tonytan4ever has joined #openstack-infra | 17:37 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:38 | |
| *** tosky has joined #openstack-infra | 17:39 | |
| *** inc0 has quit IRC | 17:41 | |
| *** Zhongjun__ has quit IRC | 17:41 | |
| *** ihrachys has quit IRC | 17:43 | |
| *** amoralej is now known as amoralej|off | 17:43 | |
| *** Na3iL has quit IRC | 17:43 | |
| *** tkelsey has quit IRC | 17:45 | |
| *** yamamoto has joined #openstack-infra | 17:45 | |
| openstackgerrit | Merged openstack-infra/system-config: Add afs sites to zuul-launchers https://review.openstack.org/371018 | 17:45 |
| *** jascott1 has joined #openstack-infra | 17:46 | |
| *** andrewbogott has quit IRC | 17:47 | |
| *** andrewbogott has joined #openstack-infra | 17:47 | |
| *** kjorgens_ has joined #openstack-infra | 17:49 | |
| *** adrian_otto has joined #openstack-infra | 17:52 | |
| *** yamamoto has quit IRC | 17:52 | |
| *** esikachev has joined #openstack-infra | 17:53 | |
| *** kjorgensen has quit IRC | 17:53 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Re-enable temprevert/cherry-pick/pin functionality https://review.openstack.org/370961 | 17:54 |
| *** gyee has quit IRC | 17:54 | |
| *** adrian_otto1 has joined #openstack-infra | 17:56 | |
| *** adrian_otto has quit IRC | 17:57 | |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Make dib job a template https://review.openstack.org/370781 | 17:57 |
| *** adrian_otto1 has quit IRC | 17:57 | |
| *** jascott1 has quit IRC | 17:58 | |
| *** jascott1 has joined #openstack-infra | 17:58 | |
| *** jascott1 has quit IRC | 17:59 | |
| *** jascott1 has joined #openstack-infra | 17:59 | |
| *** jascott1_ has joined #openstack-infra | 17:59 | |
| *** jascott1 has quit IRC | 18:01 | |
| *** eeiden has quit IRC | 18:03 | |
| *** eeiden has joined #openstack-infra | 18:06 | |
| *** rook_ is now known as rook | 18:07 | |
| AJaeger | jeblair: great to see the progress. I won't be able to help today, will just do a few reviews now... | 18:09 |
| *** tqtran has joined #openstack-infra | 18:10 | |
| *** tsg_ has quit IRC | 18:10 | |
| *** eeiden has quit IRC | 18:11 | |
| *** yamahata has quit IRC | 18:13 | |
| *** asettle has joined #openstack-infra | 18:13 | |
| *** EricGonczer_ has joined #openstack-infra | 18:13 | |
| *** tsg_ has joined #openstack-infra | 18:13 | |
| AJaeger | zigo, then please propose a revert of fungi's change so that we can setup deb-novnc again | 18:14 |
| *** hasharAway is now known as hashar | 18:14 | |
| AJaeger | jeblair: api and developer is the same website. We renamed it. Developer is the site, api an alias. | 18:18 |
| *** bethwhite_ has quit IRC | 18:19 | |
| *** kzaitsev_mb has quit IRC | 18:19 | |
| AJaeger | ah, fungi said it as well ;) | 18:19 |
| jeblair | AJaeger: yeah, we have some things in project-config we can probably clean up after this is done by just making api.o.o an apache redirect | 18:20 |
| openstackgerrit | Paul Hummer proposed openstack-infra/project-config: Add publish-to-pypi for the nova-lxd project to zuul https://review.openstack.org/370286 | 18:20 |
| *** psachin has quit IRC | 18:20 | |
| jeblair | AJaeger: so i'm just going to ignore api.o.o for now and plan on us having done that by the time we retire the ftp sites :) | 18:20 |
| *** acoles is now known as acoles_ | 18:20 | |
| *** jascott1_ has quit IRC | 18:21 | |
| AJaeger | sileht: why are you rebasing 369164 twice? There's no need to rebase at all unless you have a merge conflict | 18:22 |
| *** jascott1 has joined #openstack-infra | 18:22 | |
| AJaeger | jeblair, let's try that ;) | 18:22 |
| fungi | or maybe the docs team will decide that a couple years of permanent redirecting is long enough to just retire api.openstack.org entirely | 18:22 |
| *** rodrigods has quit IRC | 18:22 | |
| *** rodrigods has joined #openstack-infra | 18:22 | |
| *** pcaruana has joined #openstack-infra | 18:22 | |
| *** EricGonczer_ has quit IRC | 18:23 | |
| AJaeger | fungi: Let's just do that. | 18:23 |
| *** EricGonczer_ has joined #openstack-infra | 18:24 | |
| AJaeger | jeblair: where do we have stuff for api.o.o in project-config? My grep does not show anything - is yours better? | 18:24 |
| *** spzala_ has joined #openstack-infra | 18:25 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/371034 | 18:25 |
| sileht | AJaeger, I have a branch with all Gnocchi changes I haven't send patches in correct order | 18:25 |
| AJaeger | sileht: ah... | 18:25 |
| *** ddieterly is now known as ddieterly[away] | 18:25 | |
| sileht | AJaeger, and I have moved the one that was fixing the stable branch of Gnocchi on bootom | 18:26 |
| AJaeger | sileht: ok, understood now | 18:26 |
| *** annegentle has joined #openstack-infra | 18:26 | |
| *** sdake_ is now known as sdake | 18:26 | |
| *** dtardivel has quit IRC | 18:27 | |
| *** spzala_ has quit IRC | 18:27 | |
| odyssey4me | project config cores, I'd appreciate a second review of https://review.openstack.org/370646 | 18:27 |
| *** spzala has joined #openstack-infra | 18:28 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use sequence znodes for image upload numbers https://review.openstack.org/371045 | 18:29 |
| *** asettle has quit IRC | 18:34 | |
| dhellmann | does this pypi upload error mean anything to anyone here? http://logs.openstack.org/42/4222da0a5911845dcaeef1e695915e010190245d/pre-release/murano-agent-pypi-both-upload/6787944/console.html | 18:34 |
| *** kjorgens_ has quit IRC | 18:35 | |
| dhellmann | a 400 error on the home_page? | 18:35 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/puppet-statusbot: Add Twitter support https://review.openstack.org/368238 | 18:35 |
| *** sarob has joined #openstack-infra | 18:36 | |
| *** tongli has joined #openstack-infra | 18:39 | |
| *** florianf has quit IRC | 18:40 | |
| *** maishsk has quit IRC | 18:41 | |
| *** maishsk has joined #openstack-infra | 18:41 | |
| *** _sarob has joined #openstack-infra | 18:41 | |
| dhellmann | nevermind, I figured out the murano-agent issue | 18:42 |
| fungi | dhellmann: what did it wind up being? i just started to dig into it | 18:42 |
| *** itsuugo has quit IRC | 18:42 | |
| *** xarses has quit IRC | 18:42 | |
| dhellmann | fungi : they have a bad home-page url in their setup.cfg (htt:// or some other invalid scheme) | 18:42 |
| dhellmann | fungi : https://review.openstack.org/371050 | 18:43 |
| fungi | got it | 18:43 |
| fungi | that's a fun one | 18:43 |
| mordred | that's awesome | 18:43 |
| *** trown|lunch is now known as trown | 18:43 | |
| *** fguillot has quit IRC | 18:44 | |
| fungi | i had some notes at one point on a check we can implement to figure out if we have invalid dist metadata from pypi's perspective, but seem to have misplaced it now | 18:44 |
| *** itsuugo has joined #openstack-infra | 18:44 | |
| fungi | dstufft: ^ is the set of things pypi will reject an upload over libified in any way we could dry-run locally? | 18:44 |
| mordred | fungi: seems like a good candidate for a thing to add to the pep8 check :) | 18:45 |
| dstufft | fungi: not currently | 18:45 |
| *** sarob has quit IRC | 18:45 | |
| fungi | i think my earlier notes were only for checking that trove classifiers are valid | 18:45 |
| *** yamahata has joined #openstack-infra | 18:46 | |
| fungi | dstufft: ahh, i guess if warehouse behaves similarly down the road, maybe that's a good candidate for abstracting into a lib | 18:46 |
| *** florianf has joined #openstack-infra | 18:46 | |
| dstufft | fungi: you're probably already using Warehouse to upload :D | 18:46 |
| dstufft | but yea that'd probably make a reasonable thing to extract into a lib, similar to readme_renderer | 18:46 |
| fungi | dstufft: we are, though still to the old legacy url (unless my change to upload to pypi.org has merged now) | 18:47 |
| *** AnarchyAo has joined #openstack-infra | 18:47 | |
| fungi | but yeah, i more meant "if this is a behavior warehouse retains when old cheeseshop pypi is no longer relevant" | 18:47 |
| *** spzala has quit IRC | 18:47 | |
| *** maishsk has quit IRC | 18:48 | |
| jeblair | AJaeger: there's at least one job that publishes to the 'jenkins' api site | 18:48 |
| fungi | at least for our use case, it would be awesome to know before we tag a new release whether what we're tagging is in a state that it will be uploadable, to keep from burning through additional releases just to figure out what's finally in shape to upload | 18:48 |
| *** florianf has quit IRC | 18:50 | |
| *** fguillot has joined #openstack-infra | 18:50 | |
| *** fguillot has quit IRC | 18:51 | |
| *** baoli has joined #openstack-infra | 18:52 | |
| *** fguillot has joined #openstack-infra | 18:52 | |
| *** cardeois has quit IRC | 18:54 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run keystone jobs on xenial https://review.openstack.org/371060 | 18:54 |
| clarkb | stevemar: ^ thats what I had in mind | 18:54 |
| *** cardeois has joined #openstack-infra | 18:55 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/371034 | 18:57 |
| *** maishsk has joined #openstack-infra | 18:58 | |
| clarkb | AJaeger: if you are still around reviews on 371060 would be great | 18:59 |
| * clarkb fixes the topic on it | 18:59 | |
| *** Rockyg has joined #openstack-infra | 18:59 | |
| stevemar | clarkb: ah, not what i had in mind | 19:00 |
| *** jascott1_ has joined #openstack-infra | 19:00 | |
| stevemar | clarkb: i better go bug the qa folks | 19:00 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run keystone jobs on xenial https://review.openstack.org/371060 | 19:01 |
| *** ijw has joined #openstack-infra | 19:03 | |
| *** e0ne has quit IRC | 19:03 | |
| *** jascott1 has quit IRC | 19:04 | |
| *** krtaylor has quit IRC | 19:07 | |
| *** salv-orlando has quit IRC | 19:07 | |
| *** matrohon has joined #openstack-infra | 19:07 | |
| *** abregman has joined #openstack-infra | 19:08 | |
| *** akshai has quit IRC | 19:09 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config: Run neutron-linuxbridge job on nova libvirt/vif.py changes https://review.openstack.org/371065 | 19:10 |
| mriedem | sdague: ^ can you check my regex there? | 19:10 |
| sdague | mriedem: sure, let me look | 19:10 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Fix grenade job selection for newton https://review.openstack.org/371066 | 19:10 |
| *** EricGonczer_ has quit IRC | 19:10 | |
| sdague | mriedem: you need an | in there | 19:10 |
| *** akshai has joined #openstack-infra | 19:11 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Revert "Pin bundler to 1.12.5 for some jobs" https://review.openstack.org/371067 | 19:11 |
| mriedem | sdague: i think that makes it infinite and hit nothing | 19:11 |
| mriedem | it's messed up | 19:11 |
| clarkb | stevemar: https://review.openstack.org/371066 should make grenade things better for you. Sorry about that | 19:11 |
| mriedem | it's a skip-if not | 19:11 |
| clarkb | sdague: maybe you can also look at ^ | 19:11 |
| fungi | mriedem: more if a skip-if knot | 19:11 |
| fungi | er, of | 19:11 |
| clarkb | infra-root 371066 would be a good one to get in before more projects get newton branches | 19:11 |
| mriedem | fungi: i see what you were trying there | 19:12 |
| sdague | mriedem: explain in english what you are trying to do | 19:12 |
| sdague | clarkb: looking | 19:12 |
| fungi | yeah, not my day for typing accuracy in jokes | 19:12 |
| pleia2 | I think my statusbot patches for the twitter are a bit tangled up 368238 and 368239 (the second definitely depends on the first, but the first is also unhappy), any thoughts? | 19:12 |
| stevemar | clarkb: that makes it all sorts of better for me :) | 19:13 |
| mriedem | sdague: we want to conditionally run the linuxbridge job for nova changes in nova/network/* or nova/virt/libvirt/vif.py | 19:13 |
| mriedem | the ! is because of the skip-if | 19:13 |
| mriedem | something like a skip-unless would mean we'd need to OR with | | 19:14 |
| sdague | clarkb: https://review.openstack.org/#/c/371066/1/zuul/layout.yaml seems fine ... though I would change the negative assertion on branch to a possitive one so that it has to change less over time for stable | 19:14 |
| sdague | so instead of branch: ^(?!stable/(liberty|ocata)).*$ | 19:14 |
| mriedem | skipUnless(nova/network/* OR nova/virt/libvirt/vif.py) | 19:14 |
| *** rkukura_ has joined #openstack-infra | 19:14 | |
| clarkb | sd ya we explicitly list mitaka newton and master | 19:14 |
| sdague | branch: stable/(mitaka|newton) | 19:14 |
| mriedem | what i'm trying to do is: skipIf(!(nova/network/* AND nova/virt/libvirt/vif.py)) | 19:15 |
| mriedem | s/AND/OR/ there :P | 19:15 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Fix grenade job selection for newton https://review.openstack.org/371066 | 19:15 |
| clarkb | sdague: ^ that look better? | 19:15 |
| sdague | clarkb: you are missing a / | 19:16 |
| clarkb | bah | 19:16 |
| *** rkukura has quit IRC | 19:16 | |
| *** rkukura_ is now known as rkukura | 19:16 | |
| *** r-mibu has quit IRC | 19:16 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Fix grenade job selection for newton https://review.openstack.org/371066 | 19:16 |
| clarkb | now with more slash | 19:16 |
| *** r-mibu has joined #openstack-infra | 19:17 | |
| sdague | clarkb: that seems correct to me | 19:17 |
| sdague | ok, back to mriedem's thing | 19:17 |
| *** jimbaker has quit IRC | 19:17 | |
| *** jimbaker has joined #openstack-infra | 19:17 | |
| fungi | clarkb: your todo comment on 371066 is now slightly skewed from reality, but i'm happy to approve in the current state unless you really feel strongly about correcting it | 19:19 |
| *** tsg_ has quit IRC | 19:19 | |
| openstackgerrit | Isaku Yamahata proposed openstack-infra/project-config: networking-odl: add job for OpenDaylight carbon https://review.openstack.org/363356 | 19:19 |
| fungi | i think it's close enough that someone else can figure out what you mean if they take over that task | 19:19 |
| clarkb | fungi: I don't I think that the commit message + the commetn should make the intent clear | 19:19 |
| clarkb | so anyone spelunking should sort it out without much trouble | 19:19 |
| fungi | approvidado then | 19:20 |
| sdague | mriedem: so, honestly, what about making it a new job name and not using the skip-if but instead use the files: thing to include it in | 19:21 |
| sdague | the skip-if / not logic hurts my head | 19:21 |
| fungi | that goes for me too | 19:21 |
| *** abregman has quit IRC | 19:21 | |
| fungi | skip-if is a bit too magical, and too easy to screw up | 19:22 |
| mriedem | meh | 19:22 |
| mriedem | it works in http://www.regexpal.com/ | 19:22 |
| mriedem | with testing nova/compute/manager.py | 19:22 |
| sdague | fungi: does files: patterns have the ability to scope to project? | 19:22 |
| mriedem | and nova/network/os_vif_util.py | 19:22 |
| mriedem | sdague: i think jeblair told me awhile back that it doesn't yet | 19:22 |
| mriedem | when i was originally adding what's already there | 19:22 |
| fungi | sdague: ahh, no but making it a separate job would let you scope that job to a different project | 19:22 |
| sdague | mriedem: yeh, it doesn't look like it in looking at layout | 19:22 |
| sdague | fungi: yeh, that's what I'm thinking | 19:23 |
| sdague | mriedem: that would be my suggestion, because I'm sure we're going to have to change this again, and this is way too much brain power to get right :) | 19:23 |
| fungi | by where i mean separately named job based on the same job template with no substantive alteration other than the job name | 19:23 |
| *** mhickey has joined #openstack-infra | 19:23 | |
| *** matt-borland has quit IRC | 19:23 | |
| *** kjorgensen has joined #openstack-infra | 19:23 | |
| mriedem | that's why i test it on ^ | 19:24 |
| fungi | i don't feel so strongly about it that i downvote changes using skip-if, i simply let others take responsibility for reviewing those | 19:24 |
| *** ddieterly[away] has quit IRC | 19:26 | |
| fungi | mostly because we've seen plenty of bugs slip into projects because they tried to get fancy with skipping jobs they didn't think would be influenced by changes to certain files, only to discover that either their assumptions or their patterns were wrong | 19:26 |
| *** esikachev has quit IRC | 19:27 | |
| *** kjorgensen has quit IRC | 19:28 | |
| fungi | and in particular, skip-if has been a magnet for people obsessing over premature optimization about when to run their jobs | 19:29 |
| AJaeger | jeblair: do you know which job? | 19:29 |
| *** pcaruana has quit IRC | 19:32 | |
| *** kzaitsev_mb has joined #openstack-infra | 19:33 | |
| *** tsg_ has joined #openstack-infra | 19:33 | |
| *** ddieterly has joined #openstack-infra | 19:33 | |
| *** davidlenwell has quit IRC | 19:34 | |
| *** asettle has joined #openstack-infra | 19:34 | |
| *** cardeois has quit IRC | 19:37 | |
| *** jimbaker is now known as jimbaker_ | 19:38 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix grenade job selection for newton https://review.openstack.org/371066 | 19:38 |
| *** tongli has quit IRC | 19:38 | |
| *** jimbaker_ is now known as jimbaker` | 19:39 | |
| *** jimbaker` is now known as jimbaker | 19:39 | |
| *** asettle has quit IRC | 19:40 | |
| *** david-lyle has quit IRC | 19:40 | |
| *** david-lyle has joined #openstack-infra | 19:40 | |
| *** Apoorva has quit IRC | 19:40 | |
| *** kjorgensen has joined #openstack-infra | 19:41 | |
| sdague | clarkb or anyone, we're trying to wrap our heads around this - http://logs.openstack.org/32/370132/4/check/gate-tempest-dsvm-full-ubuntu-xenial/8e4da50/logs/screen-n-cpu.txt.gz#_2016-09-15_14_54_49_539 | 19:46 |
| sdague | it seems like something is forcing the daemons to run in an ascii mode | 19:46 |
| sdague | so printing unicode goes bonkers | 19:46 |
| sdague | but it's not locally reproducable, so I'm wondering if there is something in the gate that makes it that way | 19:47 |
| *** davidlenwell has joined #openstack-infra | 19:47 | |
| sdague | I've been playing with some locale settings, and it's not really changing much | 19:47 |
| *** cardeois has joined #openstack-infra | 19:48 | |
| *** sdake has quit IRC | 19:49 | |
| *** sdake_ has joined #openstack-infra | 19:49 | |
| clarkb | I think jeblair decided not to set locale in zuul? | 19:50 |
| *** esikachev has joined #openstack-infra | 19:50 | |
| *** jascott1_ has quit IRC | 19:51 | |
| pabelanger | Ah one point, it was handled by bindep | 19:51 |
| pabelanger | I think we had some discussions about adding it to DIB directly | 19:51 |
| sdague | clarkb: ok, but even when I set it in stack.sh, which spawns all this, it still doesn't seem to take | 19:52 |
| *** jascott1 has joined #openstack-infra | 19:52 | |
| sdague | https://review.openstack.org/#/c/370132/ actually gets all brutal about setting it | 19:52 |
| *** jascott1 has quit IRC | 19:52 | |
| *** jascott1 has joined #openstack-infra | 19:52 | |
| *** rcernin has joined #openstack-infra | 19:53 | |
| *** jascott1 has quit IRC | 19:53 | |
| *** itsuugo has quit IRC | 19:53 | |
| clarkb | thsts not for the stack user though right? | 19:53 |
| *** jascott1 has joined #openstack-infra | 19:54 | |
| sdague | why wouldn't it be? | 19:54 |
| clarkb | well you only write to the file if it exists | 19:55 |
| *** itsuugo has joined #openstack-infra | 19:55 | |
| clarkb | not sure it exists | 19:55 |
| jeblair | clarkb, sdague: i'm not up to speed yet, but to perhaps clarify -- the zuul launcher attempts to give you the locale that you would get if you logged into the test node directly (like, on the console). | 19:56 |
| clarkb | and everything else is user env for current user | 19:56 |
| *** baoli has quit IRC | 19:56 | |
| jeblair | (and of course the job can change it after that if it needs to) | 19:56 |
| sdague | clarkb: but I also export it | 19:56 |
| clarkb | sdague: does that get into the stack user env? | 19:56 |
| *** baoli has joined #openstack-infra | 19:56 | |
| *** krtaylor has joined #openstack-infra | 19:56 | |
| jeblair | (but it will vary otherwise -- ie, you may get a different locale on fedora24 than you would on trusty) | 19:57 |
| sdague | this is the stack user | 19:57 |
| clarkb | I think its jenkins | 19:57 |
| clarkb | then devstack makes stack later | 19:57 |
| *** jascott1 has quit IRC | 19:57 | |
| sdague | jeblair: sure, I get this isn't a generic fix right now, I'm just trying to figure this one out | 19:57 |
| sdague | clarkb: hmmmm | 19:57 |
| sdague | clarkb: https://github.com/openstack-infra/devstack-gate/blob/e8b15e7627feceab7ffe9768a01a4b5650f2ca3f/devstack-vm-gate.sh#L631-L633 | 19:58 |
| sdague | looks like stack user to me | 19:58 |
| jeblair | sdague: yep, i don't have an opinion on any fixes; i'm just trying to backfill context to (hopefully) help you out so you know what effect zuul might be having on this [hopefully none]. :) | 19:58 |
| *** asettle has joined #openstack-infra | 19:58 | |
| sdague | jeblair: yeh, fair | 20:00 |
| *** artmr has quit IRC | 20:00 | |
| clarkb | hrm not sure then. if its starting as stack user and runs that way the exports should be sufficient. Its possible the images don't have that locale installed and thus callback to C or something? | 20:01 |
| *** maishsk has quit IRC | 20:02 | |
| pabelanger | that is possible, we manage language-pack-en with bindep right now | 20:02 |
| sdague | clarkb: well, the locale-gen seems to think it's a thing | 20:03 |
| clarkb | are we using screen? screen by default is not utf8 friendly (or wasn't for forever maybe modern screen is better) | 20:04 |
| sdague | clarkb: not in the gate | 20:04 |
| sdague | also, screen locally works fine | 20:04 |
| clarkb | you ahve to do screen -U iirc otherwise it doesn't unicode | 20:05 |
| fungi | later screen packages are like running screen -U by default if memory serves | 20:05 |
| sdague | right, but we stopped using screen in the gate and we just launch with bash directly | 20:05 |
| sdague | because screen command push sometimes doesn't work | 20:05 |
| fungi | hrm, actually manpage for screen on trusty at least seems to indicate -U is still not default behavior... but regardless as sdague says not related to this | 20:06 |
| *** Apoorva has joined #openstack-infra | 20:06 | |
| *** mhickey has quit IRC | 20:06 | |
| *** Apoorva_ has joined #openstack-infra | 20:07 | |
| *** xarses has joined #openstack-infra | 20:07 | |
| fungi | so... for unit test jobs and the like, our bindep fallback list installs language-pack-en explicitly http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/data/bindep-fallback.txt#n29 | 20:07 |
| clarkb | looking at logs for ps4 I don't see where any of this is getting logged | 20:07 |
| sdague | clarkb: which ? | 20:08 |
| clarkb | sdague: the locale-gen | 20:08 |
| sdague | it's in devstack-early | 20:08 |
| sdague | it's before devstack starts explicit logging | 20:08 |
| sdague | http://logs.openstack.org/32/370132/4/check/gate-tempest-dsvm-full-ubuntu-xenial/8e4da50/logs/devstack-early.txt.gz | 20:08 |
| clarkb | can we get that to be set -x ? | 20:08 |
| clarkb | looks like we just have the output to go by | 20:09 |
| sdague | it is | 20:09 |
| sdague | or it should be | 20:09 |
| sdague | https://github.com/openstack-dev/devstack/blob/233fce71da6d58d39b40b8c073c78c0e58ea8e16/stack.sh#L25 | 20:09 |
| clarkb | looks liek its all split up | 20:09 |
| clarkb | the end of the file has the commands and the beginning has the output? | 20:10 |
| *** Apoorva has quit IRC | 20:10 | |
| fungi | i don't see language-pack-en in any of the packages lists in devstack | 20:10 |
| fungi | so it's almost certainly not installed unless it gets dragged in as a dependency of some other package | 20:11 |
| *** ijw has quit IRC | 20:11 | |
| *** ijw has joined #openstack-infra | 20:11 | |
| sdague | fungi: ok, I can try installing that. You think that will impact things? | 20:12 |
| clarkb | C.UTF-8 is what we set it to on our xenial instances in /etc/default/locale | 20:12 |
| fungi | but yeah, localegen seems to act like it is at least, so maybe it's a dep of something else | 20:12 |
| sdague | fungi: it's not in the package list | 20:12 |
| sdague | http://logs.openstack.org/32/370132/4/check/gate-tempest-dsvm-full-ubuntu-xenial/8e4da50/logs/dpkg-l.txt.gz | 20:12 |
| clarkb | and if I su to stack it has C.UTF-8 | 20:13 |
| fungi | sdague: i believe we put language-pack-en in our bindep fallback list because it was preinstalled on rackspace's base images but wasn't on our dib-based ubuntu-minimal images | 20:13 |
| clarkb | so it should be running in a unicoded env by default | 20:13 |
| *** asselin__ has joined #openstack-infra | 20:13 | |
| sdague | clarkb: ok, so I don't understand why we'd get an ascii decode error | 20:14 |
| clarkb | sdague: where is the error? | 20:14 |
| sdague | in the original link | 20:14 |
| fungi | and yeah, default on xenial will be C.utf-8 because that's built into the libc | 20:14 |
| sdague | http://logs.openstack.org/32/370132/4/check/gate-tempest-dsvm-full-ubuntu-xenial/8e4da50/logs/screen-n-cpu.txt.gz#_2016-09-15_14_54_49_539 | 20:14 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/371034 | 20:14 |
| clarkb | I am going to guess beacuse something somewhere has decided to treat that as a string not a u'' string | 20:15 |
| clarkb | so python is doing its best then failing | 20:15 |
| sdague | clarkb: ok, except, it's not locally reproducable unless you force to a non utf8 locale | 20:16 |
| sdague | this is because the instance name in a debug message is utf8 | 20:16 |
| *** ijw has quit IRC | 20:16 | |
| *** rhallisey has quit IRC | 20:16 | |
| sdague | https://bugs.launchpad.net/nova/+bug/1580728 | 20:17 |
| openstack | Launchpad bug 1580728 in OpenStack Compute (nova) "UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 386: ordinal not in range(128) in nova.virt.libvirt.vif:unplug with unicode instance.display_name" [Medium,Triaged] | 20:17 |
| *** asselin_ has quit IRC | 20:17 | |
| *** asettle has quit IRC | 20:18 | |
| fungi | yeah, given this is xenial which will have a utf-8 locale available even if you don't install any optional locales, i doubt it's an issue of a missing package | 20:19 |
| clarkb | looking at /proc/$pid/environ for a nova compute started by devstack on an infra xenail instance you have LC_ALL=C and LC_MESSAGES=C.UTF-8 | 20:20 |
| clarkb | I don't see any other lang/locale vars | 20:20 |
| *** hamzy has quit IRC | 20:20 | |
| clarkb | so it is getting C somehow for LC_ALL | 20:20 |
| fungi | the default stackrc has it | 20:21 |
| *** kzaitsev_mb has quit IRC | 20:21 | |
| fungi | or does in my checkout | 20:21 |
| *** xarses has quit IRC | 20:21 | |
| clarkb | oh right thats what sdague's chagne changes | 20:22 |
| clarkb | so I'd need to inspect the hosts his change is running on /me looks | 20:22 |
| fungi | oh, it moved to stack.sh | 20:22 |
| fungi | https://git.openstack.org/cgit/openstack-dev/devstack/tree/stack.sh#n34 | 20:22 |
| *** kgiusti has left #openstack-infra | 20:22 | |
| sdague | fungi: right, but I'm changing this | 20:22 |
| fungi | aha | 20:23 |
| sdague | that's the point of this patch | 20:23 |
| clarkb | the d-g projects has LC_ALL=C.UTF-8 | 20:23 |
| sdague | to try to change that so we don't push back to LC_ALL=C, but my approaches do not seem to be taking | 20:23 |
| clarkb | so it starts the way we expect it to at least | 20:23 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Don't use cached images in tripleoclient changes https://review.openstack.org/371115 | 20:24 |
| sdague | yeh | 20:24 |
| fungi | yeah, it's going to be fiddly at a minimum... ubuntu-trusty, ubuntu-xenial, centos-7 and fedora-24 are all going to behave differently here i think | 20:24 |
| clarkb | the stack.sh's have that too so they look good that far along | 20:25 |
| clarkb | no nova processes yet though | 20:25 |
| fungi | because there's been a lot of upheaval in distros over the past few years on what locales to make available by default and whether to guarantee an available utf-8 locale | 20:25 |
| sdague | fungi sure | 20:25 |
| sdague | but I can't seem to eliminate this in the "easy" case | 20:25 |
| fungi | so the default locale on one won't even be a viable locale on another, and one might require packages to make utf-8 available at all while another won't | 20:26 |
| sdague | also, I can't reproduce the issue with a base ubuntu | 20:26 |
| fungi | tried setting LC_ALL=C.utf-8 ? i expect that to work on xenial at least | 20:26 |
| sdague | fungi: right, that's fine, I'm trying to figure out what that combination of things is. Because honestly, if we aren't running in a utf8 supporting mode in our services, that's kind of problematic | 20:26 |
| sdague | fungi: I did not yet, because it looks like en_US.UTF-8 is there | 20:27 |
| clarkb | apache is reseting keystone to LANG=C | 20:27 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Revert "tripleo: disable voting on gate-tripleo-ci-centos-7-nonha-multinode" https://review.openstack.org/371133 | 20:28 |
| *** fguillot has quit IRC | 20:28 | |
| clarkb | still waiting on the nova processes | 20:28 |
| *** _sarob has quit IRC | 20:28 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Revert "Temporarily remove deb-novnc from projects.yaml" https://review.openstack.org/371134 | 20:28 |
| sdague | clarkb: ok, that's interesting, and something we should probably fix | 20:28 |
| *** abregman has joined #openstack-infra | 20:28 | |
| zigo | fungi: ^ | 20:28 |
| clarkb | sdague: I checked that the root apache process is lang=c too and it is | 20:28 |
| fungi | oh, that too. apache will expect very explicit locale configuration if you want anything other than c ascii behavior | 20:28 |
| sdague | fungi: sure | 20:28 |
| sdague | this is n-compute though | 20:28 |
| sdague | it's an evently daemon | 20:28 |
| clarkb | ya waiting for devstack to start that one | 20:28 |
| sdague | eventlet | 20:29 |
| *** jascott1 has joined #openstack-infra | 20:29 | |
| *** fguillot has joined #openstack-infra | 20:29 | |
| sdague | fungi: but it is a good point to put on the list. It was also something that came up in the ops summit. Our utf8 testing is definitely pretty spotty, so there ends up being commands where people set users or projects with utf8 chars, and then api calls or clis sometimes crash | 20:30 |
| sdague | so I wanted to make sure we were utf8 fully in devstack at least to make it easier to even know | 20:30 |
| fungi | sdague: i completely agree we should be figuring out whatever is needed to test utf-8 end-to-end | 20:30 |
| *** kzaitsev_mb has joined #openstack-infra | 20:31 | |
| *** sarob has joined #openstack-infra | 20:32 | |
| fungi | looking at that exception, which of those has the non-ascii content? is it the format string or one of the args list? | 20:32 |
| clarkb | fungi: its the instance name apparently so oen of the args list I think | 20:32 |
| *** ijw has joined #openstack-infra | 20:33 | |
| *** abregman has quit IRC | 20:33 | |
| fungi | yeah, i never can remember which direction that particular decoding exception indicates | 20:33 |
| clarkb | neutron server is running with LC_ALL=en_US.UTF-8 | 20:33 |
| sdague | fungi: https://github.com/openstack/nova/blob/bad2497b70605b66ada28960d9ccd9796a0867ee/nova/virt/libvirt/vif.py#L1009-L1012 this is what's triggering it | 20:33 |
| sdague | the instance has a unicode name when that happens | 20:34 |
| clarkb | and nova compute too | 20:34 |
| clarkb | so its working fine | 20:34 |
| *** sarob has quit IRC | 20:35 | |
| * clarkb will paste the full env stuff for nova compute in a minute | 20:35 | |
| *** zzzeek has quit IRC | 20:35 | |
| sdague | clarkb: ok, well lets see what the end of the run looks like | 20:35 |
| *** esikachev has quit IRC | 20:35 | |
| sdague | that iteration had the additional package install | 20:36 |
| clarkb | http://paste.openstack.org/show/577708/ | 20:36 |
| *** sarob has joined #openstack-infra | 20:37 | |
| *** xarses has joined #openstack-infra | 20:37 | |
| fungi | i wonder if making that u'vif_type=... would alter the behavior at all | 20:37 |
| *** EricGonczer_ has joined #openstack-infra | 20:37 | |
| *** _sarob has joined #openstack-infra | 20:37 | |
| clarkb | ya thats what I was saying | 20:37 |
| *** Apoorva_ has quit IRC | 20:37 | |
| *** ijw has quit IRC | 20:38 | |
| clarkb | you are trying to put unicode in a bytestring. Not sure if python will like that | 20:38 |
| fungi | or a liberal helping of six.texttype | 20:38 |
| *** Apoorva has joined #openstack-infra | 20:38 | |
| sdague | so if that was the case, I would think you'd see this locally as well | 20:38 |
| *** ddieterly is now known as ddieterly[away] | 20:39 | |
| sdague | also, that's going to suck a lot if we need to u'' every string | 20:39 |
| fungi | having a format string interpolate unicode parameters totally works as written there in py3k, but not so simple in 2.7 | 20:39 |
| sdague | I can run that experiment in parallel | 20:39 |
| *** zzzeek has joined #openstack-infra | 20:39 | |
| fungi | i mean, this (unicode support by default) is one of the main reasons why py3k happened | 20:40 |
| sdague | fungi: sure | 20:40 |
| fungi | and making this work consistently between python 2 and 3 is why six.texttype exists | 20:40 |
| *** baoli has quit IRC | 20:41 | |
| *** sarob has quit IRC | 20:41 | |
| *** baoli has joined #openstack-infra | 20:41 | |
| *** jkilpatr has quit IRC | 20:41 | |
| fungi | a pyton mud codebase i work on, before switching to py3k-only, just basically used u'whatever' everywhere to get things working unicode-clean | 20:42 |
| clarkb | I just reproduced it fwiw | 20:42 |
| sdague | clarkb: ok, cool | 20:42 |
| sdague | how? | 20:42 |
| *** EricGonczer_ has quit IRC | 20:42 | |
| *** tkelsey has joined #openstack-infra | 20:42 | |
| clarkb | http://paste.openstack.org/show/577709/ like that | 20:42 |
| clarkb | oh except thats backwards | 20:43 |
| clarkb | encode vs decode | 20:43 |
| clarkb | anyways I think that shows that this may just be a python issue | 20:44 |
| fungi | but i agree it's strange that 370132 is working locally for sdague (unless somehow the test with the unicode instance name is somehow being skipped?) | 20:44 |
| *** askb has joined #openstack-infra | 20:44 | |
| *** Goneri has quit IRC | 20:45 | |
| sdague | clarkb: ok, if it's going through format, then that's a thing | 20:45 |
| sdague | but if I used % it's not | 20:46 |
| sdague | I wonder if it has to do with log defered formating | 20:46 |
| *** tkelsey has quit IRC | 20:47 | |
| sdague | anyway, kind of end of day here, I'm going to experiment with this to smooth it over | 20:47 |
| *** itsuugo has quit IRC | 20:47 | |
| fungi | also if you don't u the snowman definition, it seems to not raise an exception | 20:47 |
| sdague | fungi / clarkb thanks for all the ideas here | 20:47 |
| sdague | fungi: right | 20:47 |
| sdague | In [1]: u = u'☃' | 20:48 |
| sdague | In [2]: a = "%s" % u | 20:48 |
| sdague | In [3]: print a | 20:48 |
| sdague | ☃ | 20:48 |
| fungi | i think because then it's just being treated as a bytestring | 20:48 |
| *** kzaitsev_mb has quit IRC | 20:48 | |
| *** Rockyg has quit IRC | 20:48 | |
| fungi | e.g. '\xe2\x98\x83' in my terminal at least | 20:48 |
| *** trown is now known as trown|outtypewww | 20:48 | |
| clarkb | fungi: yup and I think that because the error is on a decode not an encode the input is a bytestring that its trying to envode into ascii | 20:49 |
| clarkb | er thats not right. Thats its triny to decode as ascii to make an internap python object | 20:49 |
| mgagne | internap python object :O | 20:49 |
| clarkb | and I am guessing that the loggers assume bytestrings are ascii | 20:49 |
| clarkb | mgagne: er internal | 20:50 |
| *** itsuugo has joined #openstack-infra | 20:50 | |
| jeblair | fungi, pabelanger, mordred: i just tried to launch a node. ansible timed out with no debug info. do you have suggestions as to how to proceed? | 20:50 |
| fungi | yep. basically if you have utf8 byte sequences you can interpolate them into a non-unicode format string all day long. if you have a (declared as) unicode string you can't just interpolate it into a bytestring without an explicit encoding | 20:50 |
| fungi | jeblair: mordred tracked it down to something having to do with broken newer ansible again? | 20:51 |
| jeblair | fungi, pabelanger, mordred: the first thing i noticed is that we don't output anything from ansible until the end | 20:51 |
| fungi | when i ran it with an earlier ansible from a virtualenv it worked for me last week | 20:51 |
| jeblair | so i couldn't even tell what task it was hung on until it completely timed out | 20:51 |
| jeblair | fungi: should we pin ansible on puppetmaster? | 20:52 |
| fungi | jeblair: probably. i thought mordred was reporting something upstream | 20:52 |
| fungi | i'm looking for details on what worked for me | 20:52 |
| jeblair | i would like us to start treating this as something that needs to work all the time | 20:52 |
| clarkb | sdague: ya if I do b = b'☃' ; s = "%s" % b ; s.decode() I get that error | 20:53 |
| fungi | jeblair: i agree. looks like it worked for me with 2.1.1.0 | 20:53 |
| *** baoli has quit IRC | 20:53 | |
| clarkb | so that would be my hunch, we have raw utf8 in a bytestring rather than a unicode string and its getting munged on its way through logging | 20:53 |
| *** ijw has joined #openstack-infra | 20:53 | |
| *** raildo has quit IRC | 20:53 | |
| fungi | jeblair: my concern is whether we've grown a dependency on any post-2.1.1.0 ansible features for other things run from the puppetmaster now | 20:53 |
| ianw | jeblair / (future) AJaeger : i'm going to call the sync to old-docs done ... i'm running it again with "newer only" but it seems to be making odd choices about what to download. | 20:54 |
| fungi | but i guess we can try downgrading and find out | 20:54 |
| *** akshai has quit IRC | 20:54 | |
| *** gouthamr has quit IRC | 20:54 | |
| clarkb | fungi: I doubt it, we were running 2.0.1 for a long time just fine | 20:54 |
| fungi | jeblair: oh, wait... | 20:54 |
| fungi | i used _newer_ ansible? | 20:54 |
| fungi | 2.0.2.0 is what is installed system-wide on the puppetmaster right now | 20:54 |
| fungi | so i guess it's a question of whether we can safely upgrade to 2.1.1.0 or need to downgrade to something before 2.0.2.0 | 20:55 |
| *** xarses has quit IRC | 20:55 | |
| *** baoli has joined #openstack-infra | 20:55 | |
| clarkb | mordred was supposed to figure this out a couple weeks ago iirc so that puppetmaster and zuul could use the same ansible version | 20:55 |
| clarkb | but not sure if that happened | 20:55 |
| fungi | thinking back, mordred may have said it looked like 2.0.2.0 was failing on a bug which was fixed upstream, and then when i tested with 2.1.1.0 things worked | 20:56 |
| fungi | (for launch-node.py) | 20:56 |
| *** nherciu has quit IRC | 20:57 | |
| mordred | yes | 20:57 |
| mordred | that is my memory - we are currently pinned back, and there is a fix in newer ansible which fixes the problem we were seeing a few days ago whenever we looked in to this last | 20:58 |
| fungi | so the question is can we upgrade ansible on puppetmaster to 2.1.1.0? that would fix this at least | 20:58 |
| *** ijw has quit IRC | 20:58 | |
| *** _sarob has quit IRC | 20:58 | |
| clarkb | pabelanger's fix for types to make 2.1.1.0 work did merge but not sure if we have tested that it works as a whole | 20:58 |
| *** kzaitsev_mb has joined #openstack-infra | 21:00 | |
| mordred | commit c6c51f90f120345aad01331837b894d00e5bff26 in puppet-ansible | 21:00 |
| mordred | is the one where we pinned it | 21:00 |
| mordred | * Our group hiera files are not being copied over. | 21:00 |
| mordred | * ansible_module_puppet_post_puppetdb.py causes a "MODULE FAILURE". | 21:00 |
| mordred | are the two reasons we pinned | 21:00 |
| *** rfolco has quit IRC | 21:02 | |
| fungi | jeblair: oh, and the other thing which helped was that i was running with ianw's stack of fixes up to 359500 applied. i'm good with them but they could use someone approving (or i could approve them now and call his being a core reviewer good enough not to wait for another reviewer) | 21:02 |
| fungi | jeblair: improvements for debuggability | 21:03 |
| jeblair | fungi: ah. i'm making some major changes to that right now | 21:03 |
| jeblair | fungi: i will build upon ianw's changes | 21:03 |
| fungi | awesome | 21:03 |
| fungi | anyway, i need to break away and do a pass at the yard before it gets too late | 21:03 |
| jeblair | fungi: if you feel like +3ing them that will be fine | 21:04 |
| jeblair | otherwise i can :) | 21:04 |
| fungi | oh, looks like mordred just did | 21:04 |
| fungi | so, er, +6! | 21:04 |
| mordred | ianw: I have a question about a comment in https://review.openstack.org/#/c/359499/1/launch/launch-node.py | 21:04 |
| mordred | ianw: (I started to ask you this a few days ago, then lost the train of thought) | 21:04 |
| *** eharney has quit IRC | 21:05 | |
| *** matrohon has quit IRC | 21:05 | |
| mordred | ianw: Remove cloud and region from the environment to work around a bug in occ ... | 21:05 |
| mordred | ianw: I'd like to understand more about that? | 21:05 |
| *** EricGonczer_ has joined #openstack-infra | 21:06 | |
| fungi | i've removed my approval on 359499 until mordred gets a 'splaination | 21:06 |
| fungi | he can +3 when he's ready on that one | 21:06 |
| mordred | fungi: oh - it's ok ... we can approve that ... I just want to make sure I don't not fix an occ bug | 21:06 |
| *** kzaitsev_mb has quit IRC | 21:06 | |
| mordred | this patch is fine | 21:06 |
| *** psilvad has quit IRC | 21:06 | |
| fungi | okay, approval readded | 21:06 |
| fungi | and now, the lawn | 21:06 |
| fungi | bbiaw | 21:07 |
| *** ddieterly[away] is now known as ddieterly | 21:08 | |
| *** fguillot has quit IRC | 21:09 | |
| *** gouthamr has joined #openstack-infra | 21:09 | |
| *** ijw has joined #openstack-infra | 21:09 | |
| *** fguillot has joined #openstack-infra | 21:10 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: Use popen rather than check_output https://review.openstack.org/371158 | 21:10 |
| kfox1111 | question... http://logs.openstack.org/53/371153/1/check/gate-kolla-kubernetes-python27-ubuntu-xenial/2f72774/console.html | 21:10 |
| jeblair | ianw, fungi, mordred: ^ untested changes to launch node | 21:10 |
| jeblair | i will try now | 21:10 |
| kfox1111 | its failing due to timeout. | 21:10 |
| *** kzaitsev_mb has joined #openstack-infra | 21:10 | |
| kfox1111 | it normally takes 22 seconds on my machine to run. | 21:10 |
| openstackgerrit | Merged openstack-infra/system-config: launch-node.py: set ansible log path https://review.openstack.org/359499 | 21:10 |
| *** akshai has joined #openstack-infra | 21:10 | |
| kfox1111 | are things really backed up? is there some how to make the test run longer? | 21:11 |
| *** salv-orlando has joined #openstack-infra | 21:11 | |
| *** jkilpatr has joined #openstack-infra | 21:11 | |
| jeblair | mordred: so how should i run launch-node (what's the resolution to the ansible issue?) | 21:11 |
| pleia2 | heading out for a bit, bbl | 21:12 |
| *** hashar has quit IRC | 21:12 | |
| jeblair | okay, | 21:13 |
| clarkb | kfox1111: edit the timeout for your unittests in your tests | 21:13 |
| jeblair | i guess the resolution is to use a virtualenv? | 21:13 |
| openstackgerrit | Merged openstack-infra/system-config: launch-node.py: More verbose logging https://review.openstack.org/359500 | 21:13 |
| jeblair | i will add that documentation to launch-node | 21:13 |
| mordred | jeblair: to my knowledge, 2.1.1.0 is the thing that was used last time this was done | 21:13 |
| kfox1111 | clarkb: know off hand how to do that? | 21:14 |
| clarkb | kfox1111: grep for TIMEOUT and see where its set | 21:14 |
| mordred | jeblair: yah - I think until there is more consensus on running 2.1.1.0 generally on puppetmaster | 21:14 |
| mordred | jeblair: virtualenv is the best bet | 21:14 |
| clarkb | kfox1111: its a per project thing so no I dont know how kolla does it | 21:14 |
| kfox1111 | is it in the tox config, or in the project-config? | 21:14 |
| clarkb | kfox1111: but you can see it in the test runner commands | 21:14 |
| clarkb | kfox1111: its not in project co fig its in your project | 21:15 |
| *** hashar has joined #openstack-infra | 21:15 | |
| *** hashar has quit IRC | 21:15 | |
| *** hashar has joined #openstack-infra | 21:15 | |
| clarkb | OS_TEST_TIMEOUT is the var according to that job log | 21:15 |
| mordred | jeblair: your untested change makes sense to me | 21:15 |
| clarkb | so grep for that | 21:15 |
| jeblair | mordred: cool, i will test it now in a virtualenv | 21:15 |
| *** hashar has quit IRC | 21:15 | |
| mordred | jeblair: woot | 21:15 |
| *** burgerk has quit IRC | 21:15 | |
| *** ldnunes has quit IRC | 21:16 | |
| *** hashar has joined #openstack-infra | 21:16 | |
| mordred | jeblair: I eagerly await word | 21:16 |
| * amrith send mordred a scrabble dictionary | 21:16 | |
| kfox1111 | ah. .testr.conf it looks like. | 21:17 |
| *** ccamacho has quit IRC | 21:17 | |
| *** krtaylor has quit IRC | 21:17 | |
| kfox1111 | clarkb: thx. | 21:17 |
| *** kzaitsev_mb has quit IRC | 21:18 | |
| *** salv-orlando has quit IRC | 21:18 | |
| *** rossella_ has quit IRC | 21:18 | |
| *** aeng has joined #openstack-infra | 21:18 | |
| *** asettle has joined #openstack-infra | 21:19 | |
| *** rossella_ has joined #openstack-infra | 21:19 | |
| *** fguillot has quit IRC | 21:21 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: document using a virtualenv for launch-node https://review.openstack.org/371162 | 21:21 |
| *** jascott1 has quit IRC | 21:21 | |
| jeblair | mordred: ^ | 21:21 |
| *** salv-orlando has joined #openstack-infra | 21:22 | |
| EmilienM | we think tripleo multinode job is stable again, please review this revert so our gate is voting again https://review.openstack.org/#/c/371133/ - thanks! | 21:22 |
| EmilienM | slagle: fyi ^ | 21:22 |
| mordred | OH! | 21:22 |
| mordred | I understand from this patch what the occ bug is | 21:22 |
| mordred | although it's not really an occ bug | 21:22 |
| mordred | I mean, it sort of is | 21:23 |
| ianw | mordred: heh, that was there when i got there :) | 21:23 |
| *** hashar has quit IRC | 21:23 | |
| ianw | let's go digging | 21:23 |
| *** ddieterly is now known as ddieterly[away] | 21:24 | |
| *** asettle has quit IRC | 21:24 | |
| *** ijw has quit IRC | 21:25 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: Use popen rather than check_output https://review.openstack.org/371158 | 21:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: document using a virtualenv for launch-node https://review.openstack.org/371162 | 21:25 |
| ianw | mordred: i looks like you added it :) https://review.openstack.org/#/c/296127/ | 21:25 |
| ianw | it | 21:25 |
| *** EricGonczer_ has quit IRC | 21:25 | |
| mordred | ianw: ah - I believe we have solved that occ bug now :) | 21:26 |
| mordred | but there is another bug here | 21:26 |
| *** kzaitsev_mb has joined #openstack-infra | 21:26 | |
| *** gyee has joined #openstack-infra | 21:27 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: Use popen rather than check_output https://review.openstack.org/371158 | 21:27 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: document using a virtualenv for launch-node https://review.openstack.org/371162 | 21:27 |
| *** fguillot has joined #openstack-infra | 21:27 | |
| mordred | ianw: OH HOLY CRAP that bug still exists. wtf | 21:27 |
| * mordred cries | 21:27 | |
| *** esberglu has quit IRC | 21:28 | |
| * jeblair hands mordred a fluffy kitty to dry his eyes | 21:28 | |
| *** ddieterly[away] is now known as ddieterly | 21:28 | |
| *** adriant has joined #openstack-infra | 21:28 | |
| jeblair | mind the claws | 21:28 |
| *** sarob has joined #openstack-infra | 21:30 | |
| *** piet has quit IRC | 21:30 | |
| amrith | :) | 21:31 |
| *** tsg__ has joined #openstack-infra | 21:32 | |
| *** rvasilets___ has joined #openstack-infra | 21:33 | |
| *** tsg_ has quit IRC | 21:34 | |
| *** jascott1 has joined #openstack-infra | 21:34 | |
| pabelanger | just catching up on backscroll | 21:36 |
| *** kzaitsev_mb has quit IRC | 21:37 | |
| pabelanger | guess we don't use PYTHONUNBUFFERED = 1 for launch-node.py | 21:38 |
| *** jascott1 has quit IRC | 21:39 | |
| *** jascott1 has joined #openstack-infra | 21:39 | |
| jeblair | pabelanger: no it's because of subprocess.check_result | 21:42 |
| jeblair | er check_output | 21:42 |
| jeblair | pabelanger: see 371158 | 21:42 |
| pabelanger | Ah | 21:42 |
| *** jascott1 has quit IRC | 21:42 | |
| jeblair | subprocess.CalledProcessError: Command '['ansible-playbook', '-i', '/tmp/tmpJYRagc/inventory', '-l', 'files01.openstack.org', '--private-key=/tmp/tmpJYRagc/id_rsa', "--ssh-common-args='-o StrictHostKeyChecking=no'", '-e', 'target=files01.openstack.org', './../playbooks/remote_puppet_adhoc.yaml']' returned non-zero exit status 1 | 21:43 |
| jeblair | hrm | 21:43 |
| jeblair | it still timed out even running within the virtualenv | 21:43 |
| jeblair | this time i got to see that it was taking a long time | 21:43 |
| jeblair | but of course, i don't have any output from ansible | 21:43 |
| jeblair | so i'm no closer to understanding the failure than i was an hour ago, except now i knew it was running puppet earlier. | 21:44 |
| *** tkelsey has joined #openstack-infra | 21:44 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:44 | |
| openstackgerrit | Monty Taylor proposed openstack/os-client-config: Don't create envvars cloud if cloud or region are set https://review.openstack.org/371173 | 21:44 |
| jeblair | mordred: do you have any further suggestions? | 21:45 |
| *** samyewell has quit IRC | 21:45 | |
| *** TheJulia has quit IRC | 21:45 | |
| *** jraim has quit IRC | 21:45 | |
| *** asaprykin has quit IRC | 21:45 | |
| *** skath has quit IRC | 21:45 | |
| *** mattfarina has quit IRC | 21:45 | |
| *** vaidy has quit IRC | 21:45 | |
| *** isviridov_away has quit IRC | 21:45 | |
| pabelanger | won't be able to have more tonight, but I'd add --keep to then check syslog on the server. maybe something in puppet apply is failing | 21:45 |
| pabelanger | need to run out for some errands | 21:45 |
| jeblair | pabelanger: i already tried logging into the server | 21:45 |
| jeblair | i was unable to | 21:45 |
| pabelanger | Oh, missed that | 21:45 |
| *** TheJulia has joined #openstack-infra | 21:45 | |
| *** scottda has quit IRC | 21:45 | |
| *** sweston has quit IRC | 21:45 | |
| *** ogelbukh has quit IRC | 21:45 | |
| *** agordeev has quit IRC | 21:45 | |
| *** hyakuhei has quit IRC | 21:45 | |
| *** adam_g has quit IRC | 21:45 | |
| *** knikolla has quit IRC | 21:45 | |
| jeblair | pabelanger: oh, you mean with the temp key? | 21:45 |
| jeblair | i didn't try taht | 21:46 |
| pabelanger | jeblair: right | 21:46 |
| *** kuromagi^ has joined #openstack-infra | 21:46 | |
| mordred | jeblair: if that doesn't shed light - also adding a -vvvv to the playbook invocation parameters might get more info too | 21:46 |
| *** kuromagi has quit IRC | 21:46 | |
| *** cargonza has quit IRC | 21:46 | |
| *** rm_work has quit IRC | 21:46 | |
| *** AJaeger has quit IRC | 21:46 | |
| *** bmjen has quit IRC | 21:46 | |
| *** mjb has quit IRC | 21:46 | |
| *** craige has quit IRC | 21:46 | |
| *** madorn has quit IRC | 21:46 | |
| *** cj has quit IRC | 21:46 | |
| *** JayF has quit IRC | 21:46 | |
| *** jamielennox has quit IRC | 21:46 | |
| *** mhayden has quit IRC | 21:46 | |
| *** alexm2 has quit IRC | 21:46 | |
| jeblair | we have to find a way to get the failed output off of the machine | 21:46 |
| mordred | yes. I agree | 21:47 |
| *** amit213 has quit IRC | 21:47 | |
| *** ashtokolov has quit IRC | 21:47 | |
| *** jhesketh has quit IRC | 21:47 | |
| *** mattoliverau has quit IRC | 21:47 | |
| *** dkehn has quit IRC | 21:47 | |
| *** gus has quit IRC | 21:47 | |
| *** d34dh0r53 has quit IRC | 21:47 | |
| *** ryanpetrello has quit IRC | 21:47 | |
| *** mrhillsman has quit IRC | 21:47 | |
| *** vkmc has quit IRC | 21:47 | |
| *** tbarron has quit IRC | 21:47 | |
| mordred | I'm curious if ansible is hanging trying to ssh to the machine | 21:47 |
| *** matt6434 has joined #openstack-infra | 21:47 | |
| mordred | which I think we'd see with -vvvv | 21:47 |
| jeblair | cause this is a 30 minute timeout (for you to learn you need to run --keep), and then another up to 30 minutes when you run it the second time with --keep | 21:47 |
| jeblair | is not cloudy | 21:48 |
| mordred | yes. totally agree. | 21:48 |
| *** pradk has quit IRC | 21:48 | |
| *** tkelsey has quit IRC | 21:48 | |
| *** gus has joined #openstack-infra | 21:48 | |
| *** cj has joined #openstack-infra | 21:48 | |
| jeblair | i just have no idea how to do that with ansible | 21:48 |
| jeblair | maybe we need to have launch-node open a second ssh connection | 21:48 |
| jeblair | and stream syslog | 21:48 |
| jeblair | i will do that | 21:48 |
| *** samyewell has joined #openstack-infra | 21:49 | |
| *** scottda has joined #openstack-infra | 21:49 | |
| *** sweston has joined #openstack-infra | 21:49 | |
| *** jhesketh has joined #openstack-infra | 21:49 | |
| *** jascott1 has joined #openstack-infra | 21:49 | |
| *** jraim has joined #openstack-infra | 21:49 | |
| mordred | jeblair: I kind of feel like what we really want is to run ansible the way we do with zuul-launcher | 21:49 |
| *** skath has joined #openstack-infra | 21:49 | |
| *** matt6434 is now known as mattoliverau | 21:49 | |
| mordred | but that's likely not going to happen in the next 15 minutes | 21:49 |
| mordred | so I think your second ssh connection streaming syslog is a great idea | 21:50 |
| jeblair | mordred: well, that's where all that code i just added came from :) | 21:50 |
| mordred | :) | 21:50 |
| jeblair | mordred: but the issue here is the 'main puppet run' | 21:50 |
| *** agordeev has joined #openstack-infra | 21:50 | |
| jeblair | mordred: where lots of black magic happens inside of one ansible task | 21:50 |
| *** ogelbukh has joined #openstack-infra | 21:50 | |
| mordred | ok - so we are certain it's getting as far as running puppet | 21:50 |
| mordred | yah | 21:50 |
| *** jascott1 has quit IRC | 21:50 | |
| *** ashtokolov has joined #openstack-infra | 21:50 | |
| jeblair | mordred: oh yeah, we're past all the hier, env stuff and on to "TASK [puppet : run puppet] ***************************************************** | 21:50 |
| mordred | kk | 21:51 |
| *** asaprykin has joined #openstack-infra | 21:51 | |
| *** adam_g has joined #openstack-infra | 21:51 | |
| jeblair | mordred: so it's the familiar "ansible command output" problem | 21:51 |
| *** amit213 has joined #openstack-infra | 21:51 | |
| *** bmjen has joined #openstack-infra | 21:51 | |
| *** adam_g has quit IRC | 21:51 | |
| *** adam_g has joined #openstack-infra | 21:51 | |
| jeblair | mordred: which we might be able to solve with an action plugin :) | 21:51 |
| mordred | jeblair: I would offer to shell in and help more directly than just making random suggestions, but I go to airport in about 20 minutes | 21:51 |
| *** kzaitsev_mb has quit IRC | 21:51 | |
| *** rm_work has joined #openstack-infra | 21:51 | |
| *** d34dh0r53 has joined #openstack-infra | 21:51 | |
| *** craige has joined #openstack-infra | 21:52 | |
| *** ryanpetrello has joined #openstack-infra | 21:52 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Revert "Revert "Switch in Fedora 24 devstack job"" https://review.openstack.org/370483 | 21:52 |
| *** mjb has joined #openstack-infra | 21:52 | |
| jeblair | mordred: is it worth giving that a spin now in this context, or does it need a little more hacking first? | 21:52 |
| *** isviridov_away has joined #openstack-infra | 21:52 | |
| mordred | jeblair: but yah - that's sort of what I was thinking ... something tells me what we want when running zuul is _also_ useful in ops environments | 21:52 |
| *** tbarron has joined #openstack-infra | 21:52 | |
| jeblair | mordred: yes | 21:52 |
| *** vaidy has joined #openstack-infra | 21:52 | |
| mordred | jeblair: the action plugin I have now will not help this | 21:52 |
| *** cargonza has joined #openstack-infra | 21:52 | |
| *** ijw has joined #openstack-infra | 21:52 | |
| mordred | it _will_ in the future tense | 21:52 |
| *** knikolla has joined #openstack-infra | 21:52 | |
| mordred | but it is not in shape for you to use at the moment | 21:52 |
| jeblair | mordred: ok. couldn't remember if you'd done the output bits yet | 21:52 |
| mordred | not yet | 21:52 |
| mordred | plane hacking FTW! | 21:52 |
| *** hyakuhei has joined #openstack-infra | 21:53 | |
| jeblair | mordred: gotcha. so i will ssh/syslog so our sysadmins can launch nodes, and we will have nice things later. | 21:53 |
| mordred | I like having nice things | 21:53 |
| *** mattfarina has joined #openstack-infra | 21:54 | |
| cloudnull | if im not seeing our test prefix here http://status.openstack.org/openstack-health/#/tests does it mean we've done something wrong, or missed a step somewhere? | 21:55 |
| * cloudnull looking for openstack-ansible | 21:55 | |
| clarkb | I think you have to have subunit log files | 21:56 |
| *** kzaitsev_mb has joined #openstack-infra | 21:56 | |
| *** jheroux has quit IRC | 21:57 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Use OS_REGION_NAME so that OCC ignore it properly https://review.openstack.org/371176 | 21:57 |
| clarkb | probably in the same location as in the dsvm jobs | 21:57 |
| mtreinish | cloudnull: the only ansible job I see data for is: http://status.openstack.org/openstack-health/#/g/project/openstack~2Fansible-role-cloud-launcher | 21:57 |
| mordred | jeblair: ^^ change to the README to make things friendlier for when the occ change lands | 21:57 |
| *** vkmc has joined #openstack-infra | 21:57 | |
| cloudnull | clarkb: that may be | 21:57 |
| mtreinish | cloudnull: clarkb is right you need to make sure your test runs put a testrepository.subunit file either in the log output either in the base dir or logs/ | 21:58 |
| *** mriedem has quit IRC | 21:58 | |
| mtreinish | other wise the subunit worker won't be able to populate the subunit2sql db with the test results | 21:58 |
| cloudnull | odyssey4me: ^ | 21:58 |
| cloudnull | i think we need to make some adjustments | 21:58 |
| *** csomerville has quit IRC | 21:58 | |
| cloudnull | :) thanks mtreinish clarkb | 21:59 |
| *** csomerville has joined #openstack-infra | 21:59 | |
| *** madorn has joined #openstack-infra | 21:59 | |
| mtreinish | cloudnull: this is where things look for the subunit file: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml#n14 | 21:59 |
| odyssey4me | ah ok, interesting - good to know how the facility works | 21:59 |
| *** alexm2 has joined #openstack-infra | 21:59 | |
| *** 32NABYP9K is now known as sabari | 21:59 | |
| *** dkehn has joined #openstack-infra | 21:59 | |
| *** JayF has joined #openstack-infra | 21:59 | |
| * odyssey4me will leave cloudnull to figure that one out | 21:59 | |
| odyssey4me | :p | 21:59 |
| *** mrhillsman has joined #openstack-infra | 22:00 | |
| mtreinish | odyssey4me, cloudnull: do you have an example log link I can look at? Just curious to see what it's doing now | 22:00 |
| *** AJaeger has joined #openstack-infra | 22:00 | |
| *** mhayden has joined #openstack-infra | 22:00 | |
| cloudnull | http://logs.openstack.org/60/371160/2/check/gate-openstack-ansible-galera_server-ansible-func-ubuntu-trusty/877e3bf/ | 22:01 |
| *** jamielennox has joined #openstack-infra | 22:01 | |
| clarkb | any other project-config root want to help get keystone jobs running on xenial ? https://review.openstack.org/#/c/371060/ | 22:01 |
| *** jascott1 has joined #openstack-infra | 22:01 | |
| openstackgerrit | Jonathan Como proposed openstack-infra/jenkins-job-builder: Implement a publisher for HockeyApp https://review.openstack.org/371178 | 22:02 |
| jeblair | ooh, the syslog tailing is working | 22:02 |
| *** yamamoto has joined #openstack-infra | 22:02 | |
| *** akshai has quit IRC | 22:02 | |
| *** yamamoto has quit IRC | 22:02 | |
| *** kzaitsev_mb has quit IRC | 22:03 | |
| mtreinish | cloudnull: ah ok, thanks. That's what I guessed was going on. You guys just use ansible to do things and not a test runner (which totally makes sense) | 22:03 |
| mtreinish | cloudnull: I don't think ansible has native subunit support (although you could add a module for that I guess) | 22:03 |
| *** rtheis has quit IRC | 22:03 | |
| mtreinish | cloudnull: or you could use generate-subunit like devstack does | 22:03 |
| mtreinish | cloudnull: http://docs.openstack.org/developer/os-testr/generate_subunit.html | 22:03 |
| *** krtaylor has joined #openstack-infra | 22:04 | |
| *** esberglu has joined #openstack-infra | 22:04 | |
| openstackgerrit | Jonathan Como proposed openstack-infra/jenkins-job-builder: Fix reference repo configuration for Git SCM https://review.openstack.org/371181 | 22:04 |
| mordred | jeblair: yay! | 22:04 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: stream syslog on remote host https://review.openstack.org/371182 | 22:04 |
| jeblair | ianw, mordred: ^ | 22:04 |
| mordred | jeblair: that sounds like a wonderful improvement | 22:04 |
| jeblair | Sep 15 22:03:09 files01 puppet-user[21891]: (/Stage[main]/Openafs::Client/Package[kstart]/ensure) ensure changed 'purged' to 'present' | 22:05 |
| jeblair | i'm wondiring if it's a dkms build or something | 22:05 |
| mordred | oh. yeah. that might take a second | 22:05 |
| cloudnull | thanks mtreinish i'll look into generating that | 22:05 |
| jeblair | mordred: or 1800? | 22:05 |
| *** tphummel has quit IRC | 22:06 | |
| jeblair | yeah, cc1 is running. | 22:07 |
| *** xyang1 has quit IRC | 22:07 | |
| mordred | jeblair: files01 is a small-ish vm right? | 22:08 |
| jeblair | mordred: the 'timeout 30' is somewher in the puppet role isn't it? | 22:08 |
| *** tphummel has joined #openstack-infra | 22:08 | |
| mordred | yah | 22:08 |
| mordred | one sec | 22:08 |
| jeblair | mordred: yeah, i'm booting it as 4g | 22:09 |
| jeblair | mordred: i wonder if we could parameterize that | 22:09 |
| jeblair | so i could pass '--timeout 60' to launch node and it could pass that to ansible-playbook | 22:09 |
| *** Apoorva has quit IRC | 22:09 | |
| jeblair | ooh, it has moved on from the dkms stuff | 22:09 |
| mordred | jeblair: actually, I do not see a timeout setting being passed to puppet at all | 22:09 |
| jeblair | fatal: [files01.openstack.org]: FAILED! => {"changed": false, "failed": true, "msg": "/usr/bin/timeout -s 9 30m /usr/bin/puppet apply --detailed-exitcodes --logdest syslog --no-noop /opt/system-config/production/manifests/site.pp failed with return code: 6", "rc": 6, "stderr": "", "stdout": "", "stdout_lines": []} | 22:10 |
| jeblair | mordred: however, it does not look like the timeout is at issue here | 22:11 |
| jeblair | it looks like it did complete in time, it just failed. | 22:11 |
| *** mdrabe has quit IRC | 22:11 | |
| mordred | jeblair: awesome! (and we have the timeout in the puppet ansible module - but it is not exposed in the role ... I can work on that) | 22:11 |
| jeblair | (so that might be a nice thing for the future, but probably not urgent as if this hasn't hit the timeout then i think we can say we haven't seen a legit case of it) | 22:11 |
| jeblair | i think there's an apache error | 22:12 |
| jeblair | and so puppet is failing | 22:12 |
| *** yamamoto has joined #openstack-infra | 22:13 | |
| mordred | jeblair: ++ | 22:13 |
| mtreinish | cloudnull: let me know if you need any help with it | 22:13 |
| jeblair | but yay, i can see that now :) | 22:13 |
| jeblair | mordred: we don't have a way to use a 'local' copy of system-config for the adhoc puppet playbook do we? | 22:13 |
| *** kzaitsev_mb has joined #openstack-infra | 22:14 | |
| *** edmondsw has quit IRC | 22:14 | |
| *** mdrabe has joined #openstack-infra | 22:14 | |
| mordred | jeblair: one sec | 22:15 |
| *** itsuugo has quit IRC | 22:15 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: stream syslog on remote host https://review.openstack.org/371182 | 22:15 |
| *** fguillot has quit IRC | 22:16 | |
| *** itsuugo has joined #openstack-infra | 22:17 | |
| cloudnull | mtreinish: where would I need to store a generated subunit ? | 22:17 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: Use popen rather than check_output https://review.openstack.org/371158 | 22:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: document using a virtualenv for launch-node https://review.openstack.org/371162 | 22:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: stream syslog on remote host https://review.openstack.org/371182 | 22:18 |
| mordred | jeblair: no, we do not have that facility that I can see. we DO support puppet_environment on the underlying puppet role | 22:18 |
| cloudnull | after every test I would need to run "generate-subunit $(date +%s) 1 success 'name of test'" ? | 22:18 |
| *** yamamoto has quit IRC | 22:18 | |
| cloudnull | where 1 is the number of seconds it took ? | 22:18 |
| jeblair | mordred: so we could make a variable for that playbook? | 22:18 |
| mordred | jeblair: but that is not exposed in the playbook. yeah | 22:19 |
| jeblair | mordred: you're not missing your flight are you? :) | 22:19 |
| mordred | jeblair: not yet :) | 22:19 |
| *** jkraj has joined #openstack-infra | 22:19 | |
| *** cardeois has quit IRC | 22:19 | |
| *** ijw has quit IRC | 22:19 | |
| *** vhosakot has quit IRC | 22:20 | |
| mordred | jeblair: actually - I think if you just set puppet_environment on the command line as an extra var, it'll just work | 22:20 |
| jeblair | 'ansible-playbook -e puppet_environment=foo' ? | 22:20 |
| jeblair | mordred: huh, i would have thought that would need to be plumbed through the playbook. | 22:21 |
| mordred | jeblair: it might work. I also think it might need to be plumbed through | 22:21 |
| *** asettle has joined #openstack-infra | 22:21 | |
| *** kzaitsev_mb has quit IRC | 22:21 | |
| jeblair | okay, i will try shortly. :) | 22:21 |
| mordred | (I'm making a plumbing patch right now) | 22:21 |
| jeblair | i'm running launch-node with keep now, and i'll just run adhoc on the resulting node until it works | 22:21 |
| *** ijw has joined #openstack-infra | 22:22 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Plumb puppet_environment through to the adhoc playbook https://review.openstack.org/371193 | 22:22 |
| mordred | jeblair: ^^ | 22:22 |
| mordred | jeblair: obvs untested | 22:22 |
| *** esberglu has quit IRC | 22:22 | |
| *** Apoorva has joined #openstack-infra | 22:22 | |
| *** mdrabe has quit IRC | 22:23 | |
| mtreinish | cloudnull: either in the root dir of the artifacts that gets uploaded to the log server or under /logs | 22:23 |
| cloudnull | ok. | 22:23 |
| mtreinish | cloudnull: the subunit worker will be looking at files here: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml#n14 | 22:23 |
| *** yamamoto has joined #openstack-infra | 22:24 | |
| *** yamamoto has quit IRC | 22:24 | |
| jeblair | mordred: do multiple env vars each get a -e argument like: '-e foo=1 -e bar=2' ? | 22:24 |
| *** yamamoto has joined #openstack-infra | 22:24 | |
| cloudnull | so calling it "logs/testrepository.subunit" should be all thats needed to get it picked up | 22:24 |
| mordred | cloudnull: ^^ do you know the answer to jeblair's question? | 22:25 |
| cloudnull | running ansible on the CLI, yes | 22:25 |
| mtreinish | cloudnull: yep that should work fine | 22:25 |
| clarkb | I think I have done it as -e'foo=bar bar=foo' before | 22:25 |
| cloudnull | mordred: jeblair: we've found it easier to put them all in a file and do "-e @/file/name.yml" | 22:26 |
| *** asettle has quit IRC | 22:26 | |
| mordred | yah | 22:26 |
| mordred | jeblair: so - multiple -e work - as does putting in a file | 22:26 |
| *** tonytan4ever has quit IRC | 22:27 | |
| mordred | jeblair: I just tested with a checkout I have that prints a lot of internal ansible debugging :) | 22:27 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: add puppet environment option https://review.openstack.org/371196 | 22:27 |
| mordred | as well as a bunch of print statements with profanity | 22:27 |
| jeblair | mordred, cloudnull: thanks :) ^ | 22:27 |
| cloudnull | we have so many options that could be overriden we simply find the file to be more managable | 22:27 |
| *** yamamoto has quit IRC | 22:28 | |
| *** gordc has quit IRC | 22:29 | |
| jhesketh | Morning | 22:29 |
| cloudnull | raise SystemExit('$#@$ %@@ ##@ $# @ @####') -- is generally how i add breakpoints :) | 22:29 |
| jeblair | clarkb, mordred, ianw, pabelanger: i'm happy with launch-node's debugability with the stack ending at https://review.openstack.org/371182 applied | 22:29 |
| openstackgerrit | Caleb Boylan proposed openstack-infra/nodepool: [WIP] Fix subnode deletion https://review.openstack.org/370455 | 22:30 |
| jeblair | i think we should land that stack asap to avoid leaving infra-root in a lurch | 22:30 |
| *** salv-orlando has quit IRC | 22:32 | |
| mordred | jeblair: +2 from me on all of them | 22:32 |
| *** sarob has quit IRC | 22:33 | |
| *** ddieterly is now known as ddieterly[away] | 22:34 | |
| *** itsuugo has quit IRC | 22:34 | |
| mtreinish | jeblair: I've been seeing a lot of stack traces like this in my gertty log lately: http://paste.openstack.org/show/577737/ is that something you've seen before? | 22:35 |
| mtreinish | I was assuming it was just gerrit slowness or something, but I wasn't sure | 22:36 |
| jeblair | mtreinish: master? | 22:36 |
| mtreinish | yep | 22:36 |
| *** itsuugo has joined #openstack-infra | 22:37 | |
| clarkb | jeblair: re https://review.openstack.org/#/c/371182/3 do you find that the interleaving of syslog and ansible is a problem? wondering ifwe can do that cleaner like adding a puppet filter to the tail or something | 22:38 |
| mtreinish | jeblair: heh, I maintain the gertty arch package but I don't ever use it | 22:38 |
| clarkb | jeblair: but not sure if in practice it causes any issues | 22:38 |
| prometheanfire | clarkb: pabelanger testing the gentoo thing now | 22:38 |
| jeblair | mtreinish: hrm. that looks like it could be a problem | 22:38 |
| *** tsg__ has quit IRC | 22:39 | |
| jeblair | clarkb: it's easy to mentally filter because syslog has timestamps, also, it tends to be one or the other. (like a bit of ansible, then it stops while interesting things happen in syslog, then syslog stops and more ansible) | 22:39 |
| jeblair | clarkb: looks like http://paste.openstack.org/show/577738/ | 22:40 |
| clarkb | jeblair: it apparently fails linting too | 22:40 |
| jeblair | mtreinish: any chance you're running in debug mode? | 22:40 |
| clarkb | oh ya thats readable so fine as is (once jenkins is happy) | 22:40 |
| *** tphummel has quit IRC | 22:40 | |
| *** rlandy is now known as rlandy|bbl | 22:41 | |
| mtreinish | jeblair: I'm not, but I'll restart it in debug mode | 22:41 |
| openstackgerrit | Merged openstack-infra/system-config: launch: Use popen rather than check_output https://review.openstack.org/371158 | 22:41 |
| *** itsuugo has quit IRC | 22:41 | |
| mtreinish | of course now I didn't hit the issue, I might have to wait a while for it to do a big sync again | 22:42 |
| jeblair | mtreinish: k, thanks. i'm worried there's something wrong with the batching api there. it's possible you may be missing some changes. | 22:42 |
| clarkb | mordred: and your ansible puppet change apparently needs a reabse | 22:42 |
| *** itsuugo has joined #openstack-infra | 22:42 | |
| *** esberglu has joined #openstack-infra | 22:43 | |
| *** mriedem has joined #openstack-infra | 22:44 | |
| openstackgerrit | Merged openstack-infra/system-config: launch: document using a virtualenv for launch-node https://review.openstack.org/371162 | 22:45 |
| prometheanfire | pabelanger: the code isn't writing out a new config :| | 22:45 |
| prometheanfire | KeyError: 'netmask' | 22:46 |
| prometheanfire | neat | 22:46 |
| *** salv-orlando has joined #openstack-infra | 22:46 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: stream syslog on remote host https://review.openstack.org/371182 | 22:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: add puppet environment option https://review.openstack.org/371196 | 22:46 |
| jeblair | clarkb: ^ | 22:46 |
| *** esberglu has quit IRC | 22:47 | |
| *** piet has joined #openstack-infra | 22:47 | |
| *** baoli has quit IRC | 22:48 | |
| *** esberglu has joined #openstack-infra | 22:48 | |
| *** chem` has joined #openstack-infra | 22:49 | |
| *** EricGonczer_ has joined #openstack-infra | 22:49 | |
| *** yamahata has quit IRC | 22:49 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run horizon jobs on xenial https://review.openstack.org/371202 | 22:50 |
| clarkb | now horizon can xenial | 22:50 |
| clarkb | jeblair: I think mordreds still needs sorting which is making your second one unhappy | 22:50 |
| clarkb | but I am just going to review them as is | 22:50 |
| prometheanfire | ah, found it | 22:50 |
| *** ijw has quit IRC | 22:50 | |
| jeblair | clarkb: yeah, that one isn't critical | 22:50 |
| *** chem has quit IRC | 22:51 | |
| clarkb | jeblair: that last one adds ansible_cmd.+= | 22:52 |
| clarkb | I think the . is extra and should be removed? | 22:52 |
| jeblair | probably so | 22:52 |
| *** sdague has quit IRC | 22:52 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: launch: add puppet environment option https://review.openstack.org/371196 | 22:53 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Create more Puppet OpenStack Gerrit groups https://review.openstack.org/371205 | 22:53 |
| mgagne | pabelanger: actively working on the issue in mtl01 | 22:53 |
| mgagne | pabelanger: still not fixed :-/ | 22:54 |
| *** jamesdenton has quit IRC | 22:56 | |
| *** amitgandhinz has quit IRC | 22:56 | |
| *** ddieterly[away] is now known as ddieterly | 22:58 | |
| *** tphummel has joined #openstack-infra | 22:59 | |
| *** ddieterly has quit IRC | 23:00 | |
| openstackgerrit | Matthew Thode proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 23:01 |
| prometheanfire | clarkb: jeblair ^ just did the enable_interfaces bit | 23:02 |
| prometheanfire | bah | 23:02 |
| prometheanfire | pabelanger: ^ | 23:02 |
| *** kzaitsev_mb has joined #openstack-infra | 23:03 | |
| *** piet has quit IRC | 23:03 | |
| *** claudiub has quit IRC | 23:06 | |
| *** kzaitsev_mb has quit IRC | 23:07 | |
| *** itsuugo has quit IRC | 23:08 | |
| *** pahuang has joined #openstack-infra | 23:09 | |
| *** itsuugo has joined #openstack-infra | 23:09 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4 https://review.openstack.org/371209 | 23:09 |
| EmilienM | can someone review https://review.openstack.org/#/c/371133/ please? | 23:10 |
| *** ijw has joined #openstack-infra | 23:11 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: skip constraints update if there is no tox.ini file https://review.openstack.org/371211 | 23:11 |
| *** rbrndt_ has quit IRC | 23:11 | |
| *** jkraj has quit IRC | 23:13 | |
| *** hongbin has quit IRC | 23:13 | |
| *** amitgandhinz has joined #openstack-infra | 23:14 | |
| *** whoops has quit IRC | 23:14 | |
| *** kzaitsev_mb has joined #openstack-infra | 23:14 | |
| *** ijw has quit IRC | 23:16 | |
| *** asettle has joined #openstack-infra | 23:22 | |
| *** itsuugo has quit IRC | 23:23 | |
| *** itsuugo has joined #openstack-infra | 23:24 | |
| *** whoops has joined #openstack-infra | 23:24 | |
| *** Apoorva has quit IRC | 23:25 | |
| *** drawsmcgraw has quit IRC | 23:26 | |
| sdake_ | hey folks, having trouble adding a user to our core review team | 23:26 |
| sdake_ | gerrit pops up 3 names for the individual | 23:26 |
| sdake_ | they are all identical | 23:26 |
| *** asettle has quit IRC | 23:27 | |
| sdake_ | electing any ofthem yields the error "Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla http://goo.gl/VKpPzA)" | 23:27 |
| sdake_ | thats not the error | 23:28 |
| sdake_ | sorry | 23:28 |
| sdake_ | Account Not found: Christian Berendt <berendt@..> | 23:29 |
| sdake_ | (id = berendt | 23:29 |
| *** itsuugo has quit IRC | 23:35 | |
| *** esberglu has quit IRC | 23:35 | |
| *** itsuugo has joined #openstack-infra | 23:37 | |
| *** armax has quit IRC | 23:37 | |
| *** rvasilets___ has quit IRC | 23:37 | |
| *** markvoelker has quit IRC | 23:39 | |
| *** Jeffrey4l__ is now known as Jeffrey4l | 23:40 | |
| *** AnarchyAo has quit IRC | 23:41 | |
| *** tkelsey has joined #openstack-infra | 23:45 | |
| *** camunoz has joined #openstack-infra | 23:45 | |
| *** thcipriani is now known as thcipriani|afk | 23:45 | |
| *** chem` has quit IRC | 23:49 | |
| *** itsuugo has quit IRC | 23:49 | |
| *** tkelsey has quit IRC | 23:49 | |
| *** kzaitsev_mb has quit IRC | 23:50 | |
| *** ijw has joined #openstack-infra | 23:50 | |
| *** kzaitsev_mb has joined #openstack-infra | 23:50 | |
| *** itsuugo has joined #openstack-infra | 23:51 | |
| *** dahoo has quit IRC | 23:52 | |
| *** tqtran has quit IRC | 23:52 | |
| *** fguillot has joined #openstack-infra | 23:54 | |
| *** armax has joined #openstack-infra | 23:54 | |
| *** tqtran has joined #openstack-infra | 23:55 | |
| *** kzaitsev_mb has quit IRC | 23:56 | |
| *** yamamoto_ has joined #openstack-infra | 23:58 | |
| *** piet has joined #openstack-infra | 23:58 | |
| *** ijw has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!