| *** dingyichen has joined #openstack-infra | 00:01 | |
| *** germs has quit IRC | 00:02 | |
| *** germs has joined #openstack-infra | 00:03 | |
| *** germs has quit IRC | 00:03 | |
| *** germs has joined #openstack-infra | 00:03 | |
| *** rh-jelabarre has quit IRC | 00:13 | |
| *** kzaitsev1pi has quit IRC | 00:30 | |
| *** kzaitsev_pi has joined #openstack-infra | 00:37 | |
| *** zhangfei has joined #openstack-infra | 00:39 | |
| *** kzaitsev_pi has quit IRC | 00:42 | |
| *** kzaitsev_pi has joined #openstack-infra | 00:42 | |
| *** zhangfei has quit IRC | 00:53 | |
| *** edmondsw has joined #openstack-infra | 01:02 | |
| *** edmondsw has quit IRC | 01:07 | |
| *** zhangfei has joined #openstack-infra | 01:10 | |
| *** namnh has joined #openstack-infra | 01:17 | |
| *** gyankum has joined #openstack-infra | 01:17 | |
| *** lifeless has quit IRC | 01:22 | |
| *** gagehugo has joined #openstack-infra | 01:22 | |
| *** lifeless has joined #openstack-infra | 01:27 | |
| *** gagehugo has quit IRC | 01:31 | |
| *** ihar has quit IRC | 01:34 | |
| *** gagehugo has joined #openstack-infra | 01:36 | |
| *** dhinesh has joined #openstack-infra | 01:45 | |
| *** lifeless has quit IRC | 01:46 | |
| *** lifeless has joined #openstack-infra | 01:53 | |
| *** hongbin has joined #openstack-infra | 02:02 | |
| *** roman_g has quit IRC | 02:02 | |
| *** yamamoto has quit IRC | 02:04 | |
| *** dhinesh has quit IRC | 02:04 | |
| *** yamamoto has joined #openstack-infra | 02:04 | |
| *** threestrands has quit IRC | 02:05 | |
| *** threestrands_ has joined #openstack-infra | 02:05 | |
| *** yankcrime has quit IRC | 02:07 | |
| *** _nick has joined #openstack-infra | 02:08 | |
| *** e0ne has joined #openstack-infra | 02:10 | |
| *** e0ne_ has joined #openstack-infra | 02:12 | |
| *** e0ne has quit IRC | 02:15 | |
| *** kiennt26 has joined #openstack-infra | 02:20 | |
| *** igormarnat has quit IRC | 02:24 | |
| *** igormarnat has joined #openstack-infra | 02:24 | |
| *** ramishra has joined #openstack-infra | 02:31 | |
| hongbin | hi infra team, we saw this error on the gate: "chmod: cannot access '/home/zuul/workspace/logs/reproduce.sh': No such file or directory" | 02:36 |
|---|---|---|
| hongbin | http://logs.openstack.org/96/567096/3/check/zun-tempest-docker-sql/202455f/job-output.txt.gz#_2018-05-29_02_16_22_248407 | 02:36 |
| hongbin | is it a known issue? | 02:36 |
| *** lbragstad[m] has quit IRC | 02:37 | |
| *** smcginnis[m] has quit IRC | 02:37 | |
| *** jhesketh has quit IRC | 02:37 | |
| *** lbragstad[m] has joined #openstack-infra | 02:37 | |
| *** smcginnis[m] has joined #openstack-infra | 02:37 | |
| *** jhesketh has joined #openstack-infra | 02:37 | |
| *** raginbajin has quit IRC | 02:40 | |
| *** jd_ has quit IRC | 02:40 | |
| *** raginbajin has joined #openstack-infra | 02:40 | |
| *** jd_ has joined #openstack-infra | 02:40 | |
| *** kbaikov[m] has quit IRC | 02:40 | |
| *** onovy has quit IRC | 02:40 | |
| *** lbragstad[m] has quit IRC | 02:41 | |
| openstackgerrit | Sampath Priyankara (samP) proposed openstack-infra/irc-meetings master: Change Masakari Team Meeting time to 0300UTC https://review.openstack.org/570833 | 02:41 |
| *** smcginnis[m] has quit IRC | 02:41 | |
| *** namnh has quit IRC | 02:41 | |
| *** warlord77[m] has quit IRC | 02:41 | |
| *** masayukig1 has quit IRC | 02:41 | |
| *** igormarnat has quit IRC | 02:41 | |
| *** yolanda_ has quit IRC | 02:41 | |
| *** rasca has quit IRC | 02:41 | |
| *** dayou_ has quit IRC | 02:41 | |
| *** xinliang3 has quit IRC | 02:41 | |
| *** lennyb has quit IRC | 02:41 | |
| *** aspiers[m] has quit IRC | 02:41 | |
| *** igormarnat has joined #openstack-infra | 02:42 | |
| *** yolanda_ has joined #openstack-infra | 02:42 | |
| *** rasca has joined #openstack-infra | 02:42 | |
| *** dayou_ has joined #openstack-infra | 02:42 | |
| *** xinliang3 has joined #openstack-infra | 02:42 | |
| *** lennyb has joined #openstack-infra | 02:42 | |
| *** onovy has joined #openstack-infra | 02:42 | |
| *** namnh has joined #openstack-infra | 02:42 | |
| *** germs_ has joined #openstack-infra | 02:44 | |
| *** kiennt26 has quit IRC | 02:44 | |
| *** germs has quit IRC | 02:44 | |
| *** notmyname has quit IRC | 02:44 | |
| *** germs_ has quit IRC | 02:44 | |
| *** apetrich has quit IRC | 02:44 | |
| *** katyafervent_awa has quit IRC | 02:44 | |
| *** mtreinish has quit IRC | 02:44 | |
| *** Adri2000 has quit IRC | 02:44 | |
| *** Tahvok has quit IRC | 02:44 | |
| *** oanson has quit IRC | 02:44 | |
| *** zhongjun_ has quit IRC | 02:44 | |
| *** adreznec has quit IRC | 02:44 | |
| *** rnoriega has quit IRC | 02:44 | |
| *** isviridov_away has quit IRC | 02:44 | |
| *** vaidy has quit IRC | 02:44 | |
| *** lxkong has quit IRC | 02:44 | |
| *** mshalamov has quit IRC | 02:44 | |
| *** spsurya has quit IRC | 02:44 | |
| *** persia has quit IRC | 02:44 | |
| *** zeus has quit IRC | 02:44 | |
| *** mpjetta has quit IRC | 02:44 | |
| *** vipul has quit IRC | 02:44 | |
| *** portdirect has quit IRC | 02:44 | |
| *** _ari_ has quit IRC | 02:44 | |
| *** rfolco has quit IRC | 02:44 | |
| *** myoung has quit IRC | 02:44 | |
| *** shaner has quit IRC | 02:44 | |
| *** isviridov_away has joined #openstack-infra | 02:45 | |
| *** vaidy has joined #openstack-infra | 02:45 | |
| *** lxkong has joined #openstack-infra | 02:45 | |
| *** mshalamov has joined #openstack-infra | 02:45 | |
| *** spsurya has joined #openstack-infra | 02:45 | |
| *** persia has joined #openstack-infra | 02:45 | |
| *** zeus has joined #openstack-infra | 02:45 | |
| *** mpjetta has joined #openstack-infra | 02:45 | |
| *** vipul has joined #openstack-infra | 02:45 | |
| *** portdirect has joined #openstack-infra | 02:45 | |
| *** _ari_ has joined #openstack-infra | 02:45 | |
| *** rfolco has joined #openstack-infra | 02:45 | |
| *** myoung has joined #openstack-infra | 02:45 | |
| *** germs_ has joined #openstack-infra | 02:45 | |
| *** apetrich has joined #openstack-infra | 02:45 | |
| *** katyafervent_awa has joined #openstack-infra | 02:45 | |
| *** mtreinish has joined #openstack-infra | 02:45 | |
| *** Adri2000 has joined #openstack-infra | 02:45 | |
| *** Tahvok has joined #openstack-infra | 02:45 | |
| *** oanson has joined #openstack-infra | 02:45 | |
| *** zhongjun_ has joined #openstack-infra | 02:45 | |
| *** adreznec has joined #openstack-infra | 02:45 | |
| *** rnoriega has joined #openstack-infra | 02:45 | |
| *** bandini has quit IRC | 02:45 | |
| *** bandini has joined #openstack-infra | 02:46 | |
| *** notmyname has joined #openstack-infra | 02:46 | |
| *** gyankum has quit IRC | 02:46 | |
| *** jpena|off has quit IRC | 02:46 | |
| *** hemna has quit IRC | 02:46 | |
| *** Hunner_ has quit IRC | 02:46 | |
| *** pahuang has quit IRC | 02:46 | |
| *** lihi has quit IRC | 02:46 | |
| *** quite has quit IRC | 02:46 | |
| *** auristor has quit IRC | 02:46 | |
| *** calbers has quit IRC | 02:46 | |
| *** antonym has quit IRC | 02:46 | |
| *** evrardjp has quit IRC | 02:46 | |
| *** ssbarnea has quit IRC | 02:46 | |
| *** wendar has quit IRC | 02:46 | |
| *** scas has quit IRC | 02:46 | |
| *** nhandler has quit IRC | 02:46 | |
| *** tonyb has quit IRC | 02:46 | |
| *** andreykurilin has quit IRC | 02:46 | |
| *** panda|pto has quit IRC | 02:46 | |
| *** yamamoto has quit IRC | 02:46 | |
| *** rossella_s has quit IRC | 02:46 | |
| *** rcernin has quit IRC | 02:46 | |
| *** slaweq has quit IRC | 02:46 | |
| *** sambetts_ has quit IRC | 02:46 | |
| *** bdodd has quit IRC | 02:46 | |
| *** openstackgerrit has quit IRC | 02:46 | |
| *** zzzeek has quit IRC | 02:46 | |
| *** gouthamr has quit IRC | 02:46 | |
| *** sai_ has quit IRC | 02:46 | |
| *** vtapia has quit IRC | 02:46 | |
| *** pleia2 has quit IRC | 02:46 | |
| *** mpeterson has quit IRC | 02:46 | |
| *** eglute has quit IRC | 02:46 | |
| *** darvon has quit IRC | 02:46 | |
| *** alex_xu has quit IRC | 02:46 | |
| *** betherly_ has quit IRC | 02:46 | |
| *** bramwelt has quit IRC | 02:46 | |
| *** frickler has quit IRC | 02:46 | |
| *** wznoinsk has quit IRC | 02:46 | |
| *** ddurst has quit IRC | 02:46 | |
| *** kazsh has quit IRC | 02:46 | |
| *** germs_ has quit IRC | 02:47 | |
| *** gyankum has joined #openstack-infra | 02:47 | |
| *** jpena|off has joined #openstack-infra | 02:47 | |
| *** hemna has joined #openstack-infra | 02:47 | |
| *** Hunner_ has joined #openstack-infra | 02:47 | |
| *** pahuang has joined #openstack-infra | 02:47 | |
| *** lihi has joined #openstack-infra | 02:47 | |
| *** quite has joined #openstack-infra | 02:47 | |
| *** auristor has joined #openstack-infra | 02:47 | |
| *** calbers has joined #openstack-infra | 02:47 | |
| *** antonym has joined #openstack-infra | 02:47 | |
| *** evrardjp has joined #openstack-infra | 02:47 | |
| *** ssbarnea has joined #openstack-infra | 02:47 | |
| *** wendar has joined #openstack-infra | 02:47 | |
| *** scas has joined #openstack-infra | 02:47 | |
| *** nhandler has joined #openstack-infra | 02:47 | |
| *** tonyb has joined #openstack-infra | 02:47 | |
| *** andreykurilin has joined #openstack-infra | 02:47 | |
| *** panda|pto has joined #openstack-infra | 02:47 | |
| *** quite has quit IRC | 02:47 | |
| *** germs has joined #openstack-infra | 02:47 | |
| *** shaner has joined #openstack-infra | 02:47 | |
| *** germs has quit IRC | 02:47 | |
| *** germs has joined #openstack-infra | 02:47 | |
| *** dbecker has quit IRC | 02:47 | |
| *** yamamoto has joined #openstack-infra | 02:48 | |
| *** rossella_s has joined #openstack-infra | 02:48 | |
| *** rcernin has joined #openstack-infra | 02:48 | |
| *** slaweq has joined #openstack-infra | 02:48 | |
| *** sambetts_ has joined #openstack-infra | 02:48 | |
| *** bdodd has joined #openstack-infra | 02:48 | |
| *** openstackgerrit has joined #openstack-infra | 02:48 | |
| *** zzzeek has joined #openstack-infra | 02:48 | |
| *** gouthamr has joined #openstack-infra | 02:48 | |
| *** sai_ has joined #openstack-infra | 02:48 | |
| *** vtapia has joined #openstack-infra | 02:48 | |
| *** pleia2 has joined #openstack-infra | 02:48 | |
| *** mpeterson has joined #openstack-infra | 02:48 | |
| *** eglute has joined #openstack-infra | 02:48 | |
| *** darvon has joined #openstack-infra | 02:48 | |
| *** alex_xu has joined #openstack-infra | 02:48 | |
| *** 7GHAARR89 has joined #openstack-infra | 02:48 | |
| *** bramwelt has joined #openstack-infra | 02:48 | |
| *** frickler has joined #openstack-infra | 02:48 | |
| *** wznoinsk has joined #openstack-infra | 02:48 | |
| *** ddurst has joined #openstack-infra | 02:48 | |
| *** kazsh has joined #openstack-infra | 02:48 | |
| *** quite_ has joined #openstack-infra | 02:48 | |
| *** kien-ha has quit IRC | 02:50 | |
| *** freerunner has quit IRC | 02:50 | |
| *** khappone_ has quit IRC | 02:50 | |
| *** rpioso|afk has quit IRC | 02:50 | |
| *** owalsh has quit IRC | 02:50 | |
| *** niska has quit IRC | 02:50 | |
| *** dtroyer has quit IRC | 02:50 | |
| *** mgagne has quit IRC | 02:50 | |
| *** wadadli has quit IRC | 02:50 | |
| *** olivierbourdon38 has quit IRC | 02:50 | |
| *** tobberydberg has quit IRC | 02:50 | |
| *** isssp has quit IRC | 02:50 | |
| *** tinwood has quit IRC | 02:50 | |
| *** Miouge has quit IRC | 02:50 | |
| *** adriant has quit IRC | 02:50 | |
| *** Nil_ has quit IRC | 02:50 | |
| *** jroll has quit IRC | 02:50 | |
| *** haleyb has quit IRC | 02:50 | |
| *** jrist has quit IRC | 02:50 | |
| *** otherwiseguy has quit IRC | 02:50 | |
| *** kashyap has quit IRC | 02:50 | |
| *** michaelxin has quit IRC | 02:50 | |
| *** charz has quit IRC | 02:50 | |
| *** bstinson has quit IRC | 02:50 | |
| *** hongbin has quit IRC | 02:50 | |
| *** lifeless has quit IRC | 02:50 | |
| *** zhangfei has quit IRC | 02:50 | |
| *** dingyichen has quit IRC | 02:50 | |
| *** markvoelker has quit IRC | 02:50 | |
| *** kaiokmo has quit IRC | 02:50 | |
| *** SergeyLukjanov has quit IRC | 02:50 | |
| *** aeng has quit IRC | 02:50 | |
| *** jesusaur has quit IRC | 02:50 | |
| *** rkukura has quit IRC | 02:50 | |
| *** Douhet has quit IRC | 02:50 | |
| *** rwsu has quit IRC | 02:50 | |
| *** shoogz has quit IRC | 02:50 | |
| *** dtruong has quit IRC | 02:50 | |
| *** snapiri has quit IRC | 02:50 | |
| *** ekhugen_alt has quit IRC | 02:50 | |
| *** hrubi has quit IRC | 02:50 | |
| *** jmccrory has quit IRC | 02:50 | |
| *** weshay_pto has quit IRC | 02:50 | |
| *** mpjetta has quit IRC | 02:50 | |
| *** bandini has quit IRC | 02:50 | |
| *** threestrands_ has quit IRC | 02:50 | |
| *** gagehugo has quit IRC | 02:50 | |
| *** ianychoi_ has quit IRC | 02:50 | |
| *** sshnaidm has quit IRC | 02:50 | |
| *** jaosorior has quit IRC | 02:50 | |
| *** electrofelix has quit IRC | 02:50 | |
| *** jogo has quit IRC | 02:50 | |
| *** hamzy has quit IRC | 02:50 | |
| *** kamren has quit IRC | 02:50 | |
| *** rook has quit IRC | 02:50 | |
| *** rvba has quit IRC | 02:50 | |
| *** krtaylor has quit IRC | 02:50 | |
| *** strigazi has quit IRC | 02:50 | |
| *** cloudnull has quit IRC | 02:50 | |
| *** corvus has quit IRC | 02:50 | |
| *** ltomasbo has quit IRC | 02:50 | |
| *** dalvarez has quit IRC | 02:50 | |
| *** aspiers has quit IRC | 02:50 | |
| *** rcarrillocruz has quit IRC | 02:50 | |
| *** sfeole has quit IRC | 02:50 | |
| *** tobasco has quit IRC | 02:50 | |
| *** kien-ha has joined #openstack-infra | 02:50 | |
| *** freerunner has joined #openstack-infra | 02:50 | |
| *** khappone_ has joined #openstack-infra | 02:50 | |
| *** rpioso|afk has joined #openstack-infra | 02:50 | |
| *** owalsh has joined #openstack-infra | 02:50 | |
| *** niska has joined #openstack-infra | 02:50 | |
| *** mgagne has joined #openstack-infra | 02:50 | |
| *** dtroyer has joined #openstack-infra | 02:50 | |
| *** wadadli has joined #openstack-infra | 02:50 | |
| *** olivierbourdon38 has joined #openstack-infra | 02:50 | |
| *** tobberydberg has joined #openstack-infra | 02:50 | |
| *** isssp has joined #openstack-infra | 02:50 | |
| *** tinwood has joined #openstack-infra | 02:50 | |
| *** Miouge has joined #openstack-infra | 02:50 | |
| *** adriant has joined #openstack-infra | 02:50 | |
| *** Nil_ has joined #openstack-infra | 02:50 | |
| *** jroll has joined #openstack-infra | 02:50 | |
| *** haleyb has joined #openstack-infra | 02:50 | |
| *** jrist has joined #openstack-infra | 02:50 | |
| *** otherwiseguy has joined #openstack-infra | 02:50 | |
| *** kashyap has joined #openstack-infra | 02:50 | |
| *** michaelxin has joined #openstack-infra | 02:50 | |
| *** charz has joined #openstack-infra | 02:50 | |
| *** bstinson has joined #openstack-infra | 02:50 | |
| *** hongbin has joined #openstack-infra | 02:50 | |
| *** lifeless has joined #openstack-infra | 02:50 | |
| *** zhangfei has joined #openstack-infra | 02:50 | |
| *** dingyichen has joined #openstack-infra | 02:50 | |
| *** markvoelker has joined #openstack-infra | 02:50 | |
| *** kaiokmo has joined #openstack-infra | 02:50 | |
| *** SergeyLukjanov has joined #openstack-infra | 02:50 | |
| *** aeng has joined #openstack-infra | 02:50 | |
| *** jesusaur has joined #openstack-infra | 02:50 | |
| *** rkukura has joined #openstack-infra | 02:50 | |
| *** Douhet has joined #openstack-infra | 02:50 | |
| *** rwsu has joined #openstack-infra | 02:50 | |
| *** shoogz has joined #openstack-infra | 02:50 | |
| *** dtruong has joined #openstack-infra | 02:50 | |
| *** snapiri has joined #openstack-infra | 02:50 | |
| *** ekhugen_alt has joined #openstack-infra | 02:50 | |
| *** hrubi has joined #openstack-infra | 02:50 | |
| *** jmccrory has joined #openstack-infra | 02:50 | |
| *** weshay_pto has joined #openstack-infra | 02:50 | |
| *** edmondsw has joined #openstack-infra | 02:51 | |
| *** bandini has joined #openstack-infra | 02:51 | |
| *** threestrands_ has joined #openstack-infra | 02:51 | |
| *** gagehugo has joined #openstack-infra | 02:51 | |
| *** ianychoi_ has joined #openstack-infra | 02:51 | |
| *** sshnaidm has joined #openstack-infra | 02:51 | |
| *** jaosorior has joined #openstack-infra | 02:51 | |
| *** electrofelix has joined #openstack-infra | 02:51 | |
| *** jogo has joined #openstack-infra | 02:51 | |
| *** hamzy has joined #openstack-infra | 02:51 | |
| *** kamren has joined #openstack-infra | 02:51 | |
| *** rook has joined #openstack-infra | 02:51 | |
| *** rvba has joined #openstack-infra | 02:51 | |
| *** krtaylor has joined #openstack-infra | 02:51 | |
| *** strigazi has joined #openstack-infra | 02:51 | |
| *** cloudnull has joined #openstack-infra | 02:51 | |
| *** corvus has joined #openstack-infra | 02:51 | |
| *** dalvarez has joined #openstack-infra | 02:51 | |
| *** ltomasbo has joined #openstack-infra | 02:51 | |
| *** tobasco has joined #openstack-infra | 02:51 | |
| *** aspiers has joined #openstack-infra | 02:51 | |
| *** rcarrillocruz has joined #openstack-infra | 02:51 | |
| *** sfeole has joined #openstack-infra | 02:51 | |
| clarkb | haleyb: yes the root cause is an earlier failure. I've pushed a change to devstack-gate to fix it | 02:51 |
| clarkb | er sorry haleyb that was for hongbin | 02:51 |
| hongbin | clarkb: ack, thx | 02:53 |
| *** VW has joined #openstack-infra | 02:53 | |
| clarkb | hongbin: the root cause is cmd2 made a release that is python3 only | 02:53 |
| *** Douhet has quit IRC | 02:53 | |
| clarkb | and so fails when we install ansible under pytbon2 | 02:54 |
| hongbin | i see | 02:54 |
| *** Douhet has joined #openstack-infra | 02:54 | |
| *** jesusaur has quit IRC | 02:55 | |
| *** edmondsw has quit IRC | 02:55 | |
| *** kiennt26 has joined #openstack-infra | 02:56 | |
| *** psachin`` has joined #openstack-infra | 03:01 | |
| *** dbecker has joined #openstack-infra | 03:02 | |
| *** pbourke has joined #openstack-infra | 03:02 | |
| *** germs has quit IRC | 03:11 | |
| *** masayukig1 has joined #openstack-infra | 03:11 | |
| *** mpjetta has joined #openstack-infra | 03:11 | |
| *** kien-ha has quit IRC | 03:11 | |
| *** germs has joined #openstack-infra | 03:12 | |
| *** germs has quit IRC | 03:12 | |
| *** germs has joined #openstack-infra | 03:12 | |
| *** pbourke has quit IRC | 03:14 | |
| *** annp has joined #openstack-infra | 03:14 | |
| *** pcrews has quit IRC | 03:15 | |
| *** kien-ha has joined #openstack-infra | 03:18 | |
| *** jesusaur has joined #openstack-infra | 03:22 | |
| *** lpetrut has joined #openstack-infra | 03:40 | |
| *** pcrews has joined #openstack-infra | 03:42 | |
| *** sree_ has joined #openstack-infra | 03:45 | |
| *** sree_ is now known as Guest35639 | 03:46 | |
| *** ykarel|away has joined #openstack-infra | 03:46 | |
| *** hongbin has quit IRC | 03:50 | |
| *** kzaitsev_pi has quit IRC | 03:52 | |
| *** kzaitsev_pi has joined #openstack-infra | 03:53 | |
| *** kiennt26 has quit IRC | 03:56 | |
| *** kzaitsev_pi has quit IRC | 03:58 | |
| *** kzaitsev1pi has joined #openstack-infra | 03:58 | |
| *** warlord77[m] has joined #openstack-infra | 03:58 | |
| *** aspiers[m] has joined #openstack-infra | 03:58 | |
| *** lbragstad[m] has joined #openstack-infra | 03:58 | |
| *** kbaikov[m] has joined #openstack-infra | 03:58 | |
| *** smcginnis[m] has joined #openstack-infra | 03:58 | |
| *** germs has quit IRC | 04:04 | |
| *** ykarel|away is now known as ykarel | 04:18 | |
| *** markvoelker has quit IRC | 04:19 | |
| *** VW has quit IRC | 04:19 | |
| *** lpetrut has quit IRC | 04:20 | |
| *** markvoelker has joined #openstack-infra | 04:22 | |
| *** aeng has quit IRC | 04:25 | |
| *** udesale has joined #openstack-infra | 04:26 | |
| *** pcichy has joined #openstack-infra | 04:27 | |
| *** aeng has joined #openstack-infra | 04:27 | |
| *** ykarel has quit IRC | 04:31 | |
| *** e0ne_ has quit IRC | 04:38 | |
| *** ykarel has joined #openstack-infra | 04:46 | |
| *** janki has joined #openstack-infra | 04:49 | |
| *** cshastri has joined #openstack-infra | 04:55 | |
| *** kei-ichi has quit IRC | 04:59 | |
| *** dhajare_ has joined #openstack-infra | 05:00 | |
| kota_ | hmm... it looks like clarkb is now working to fix devstack-gate on the gerrit? | 05:03 |
| kota_ | i saw a bunch of patches got failures at the legacy-dsvm-functional jobs for swift but the logs doesn't look to be related to Swift change, like this -> | 05:04 |
| kota_ | this -> http://logs.openstack.org/19/570619/2/check/legacy-swift-dsvm-functional/d8c5f7b/job-output.txt.gz | 05:05 |
| *** jiapei has quit IRC | 05:05 | |
| *** masber has quit IRC | 05:08 | |
| ykarel | kota_, failures are occuring after cmd2 released(supporting only python3) | 05:13 |
| ykarel | see, http://logs.openstack.org/19/570619/2/check/legacy-swift-dsvm-functional/d8c5f7b/job-output.txt.gz#_2018-05-29_04_22_02_034339 | 05:14 |
| kota_ | ykarel: oic. but I didn't get how we can resolve it for py2 runner, yet. | 05:15 |
| ykarel | currently problematic cmd2(> 0.9.0) are deleted on pypi side, but mirrors still have those, for mor info see:- https://github.com/python-cmd2/cmd2/issues/421 | 05:15 |
| ykarel | kota_, ^^ | 05:15 |
| *** felipemonteiro has joined #openstack-infra | 05:16 | |
| kota_ | hmm... let me try to take a look, thx. | 05:17 |
| *** masber has joined #openstack-infra | 05:29 | |
| *** CrayZee has joined #openstack-infra | 05:31 | |
| *** yolanda has joined #openstack-infra | 05:33 | |
| *** yolanda_ has quit IRC | 05:35 | |
| *** pgadiya has joined #openstack-infra | 05:41 | |
| *** pgadiya has quit IRC | 05:41 | |
| *** ramishra has quit IRC | 05:55 | |
| *** iranzo has joined #openstack-infra | 06:01 | |
| *** links has joined #openstack-infra | 06:02 | |
| *** gongysh has joined #openstack-infra | 06:08 | |
| *** ramishra has joined #openstack-infra | 06:08 | |
| *** felipemonteiro has quit IRC | 06:11 | |
| *** zxiiro-away is now known as zxiiro | 06:25 | |
| *** masuberu has joined #openstack-infra | 06:27 | |
| *** masber has quit IRC | 06:29 | |
| *** aojea has joined #openstack-infra | 06:32 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Fix template variables https://review.openstack.org/567111 | 06:34 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Add beaker tests https://review.openstack.org/565046 | 06:34 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Use httpd::vhost $content parameter https://review.openstack.org/564904 | 06:34 |
| *** pcaruana has joined #openstack-infra | 06:37 | |
| *** armaan has joined #openstack-infra | 06:38 | |
| *** ramishra has quit IRC | 06:46 | |
| *** ramishra has joined #openstack-infra | 06:49 | |
| *** lifeless has quit IRC | 06:50 | |
| *** lifeless has joined #openstack-infra | 06:56 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Add beaker tests https://review.openstack.org/565046 | 06:58 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Use httpd::vhost $content parameter https://review.openstack.org/564904 | 06:58 |
| *** vivsoni__ has quit IRC | 07:01 | |
| *** apple01 has joined #openstack-infra | 07:01 | |
| *** sree has joined #openstack-infra | 07:02 | |
| *** lpetrut has joined #openstack-infra | 07:03 | |
| *** Guest35639 has quit IRC | 07:04 | |
| *** vivsoni has joined #openstack-infra | 07:04 | |
| *** ssbarnea_ has joined #openstack-infra | 07:10 | |
| *** kien-ha has quit IRC | 07:11 | |
| *** dmellado has joined #openstack-infra | 07:12 | |
| *** armaan has quit IRC | 07:14 | |
| *** threestrands_ has quit IRC | 07:14 | |
| *** tosky has joined #openstack-infra | 07:14 | |
| *** tesseract has joined #openstack-infra | 07:14 | |
| *** hashar has joined #openstack-infra | 07:16 | |
| *** dpawlik has joined #openstack-infra | 07:17 | |
| *** janki has quit IRC | 07:19 | |
| *** apple01 has quit IRC | 07:20 | |
| *** amoralej|off is now known as amoralej | 07:20 | |
| *** apple01 has joined #openstack-infra | 07:23 | |
| dpawlik | cloudnull, xgerman_: Hi, please let me on priv when you are on IRC | 07:24 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Add beaker tests https://review.openstack.org/565046 | 07:27 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Use httpd::vhost $content parameter https://review.openstack.org/564904 | 07:27 |
| *** quite_ is now known as quite | 07:27 | |
| *** myoung is now known as myoung|zzz | 07:28 | |
| *** apple01 has quit IRC | 07:29 | |
| *** roman_g has joined #openstack-infra | 07:30 | |
| *** armaan has joined #openstack-infra | 07:37 | |
| *** janki has joined #openstack-infra | 07:38 | |
| *** jtomasek has joined #openstack-infra | 07:39 | |
| *** apple01 has joined #openstack-infra | 07:39 | |
| *** ykarel is now known as ykarel|lunch | 07:40 | |
| *** rcernin has quit IRC | 07:42 | |
| *** apple01 has quit IRC | 07:44 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Add beaker tests https://review.openstack.org/565046 | 07:44 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Use httpd::vhost $content parameter https://review.openstack.org/564904 | 07:44 |
| *** apple01 has joined #openstack-infra | 07:44 | |
| *** hwoarang has joined #openstack-infra | 07:44 | |
| *** zoli is now known as zoli|wfh | 07:45 | |
| *** zoli|wfh is now known as zoli | 07:45 | |
| *** jpena|off is now known as jpena | 07:46 | |
| *** hwoarang has quit IRC | 07:47 | |
| *** hwoarang has joined #openstack-infra | 07:48 | |
| *** jaosorior has quit IRC | 07:48 | |
| *** rpittau has joined #openstack-infra | 07:53 | |
| *** numans is now known as numans_afk | 07:53 | |
| *** lifeless has quit IRC | 07:54 | |
| *** mikal_ has joined #openstack-infra | 07:58 | |
| *** alexchadin has joined #openstack-infra | 08:00 | |
| *** ralonsoh has joined #openstack-infra | 08:00 | |
| *** mikal has quit IRC | 08:00 | |
| *** yolanda has quit IRC | 08:01 | |
| *** dtantsur|afk is now known as dtantsur | 08:04 | |
| *** yolanda has joined #openstack-infra | 08:17 | |
| openstackgerrit | Artem Goncharov proposed openstack-infra/nodepool master: Add support for specifying security_group in nodepool https://review.openstack.org/570857 | 08:18 |
| *** xinliang has joined #openstack-infra | 08:19 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Change Masakari Team Meeting time to 0300UTC https://review.openstack.org/570833 | 08:22 |
| *** apple01 has quit IRC | 08:22 | |
| CrayZee | Hi Infra, cmd2 0.9.1 was released about 10 hours ago and broke zuul. Is anyone looking at it? (See http://logs.openstack.org/61/566961/3/gate/neutron-fullstack/11b8515/job-output.txt.gz#_2018-05-28_15_56_36_548759) | 08:24 |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config master: Add requirements jobs to metalsmith https://review.openstack.org/570860 | 08:26 |
| openstackgerrit | Artem Goncharov proposed openstack-infra/nodepool master: https://review.openstack.org/#/c/570857/ https://review.openstack.org/570861 | 08:27 |
| *** apple01 has joined #openstack-infra | 08:29 | |
| *** jaosorior has joined #openstack-infra | 08:32 | |
| *** therve has joined #openstack-infra | 08:32 | |
| *** vivsoni has quit IRC | 08:33 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Use httpd::vhost $content parameter https://review.openstack.org/564904 | 08:35 |
| *** ykarel|lunch is now known as ykarel | 08:35 | |
| *** dingyichen has quit IRC | 08:37 | |
| *** slaweq has quit IRC | 08:37 | |
| *** slaweq has joined #openstack-infra | 08:38 | |
| *** alexchadin has quit IRC | 08:39 | |
| *** priteau has joined #openstack-infra | 08:39 | |
| *** ramishra has quit IRC | 08:40 | |
| *** ianychoi_ is now known as ianychoi | 08:40 | |
| *** alexchadin has joined #openstack-infra | 08:42 | |
| *** d0ugal has joined #openstack-infra | 08:43 | |
| *** d0ugal has quit IRC | 08:43 | |
| *** d0ugal has joined #openstack-infra | 08:43 | |
| *** derekh has joined #openstack-infra | 08:45 | |
| *** ramishra has joined #openstack-infra | 08:47 | |
| *** numans_afk is now known as numans | 08:53 | |
| lennyb | Hi Infra, do you have different zuul gates to different branches? I have the following layout http://paste.openstack.org/show/722245/ (zuul v2), but I see that commits in gates from different branches depend on each other. How can I make gate be independent for different branches of the same project ? | 08:53 |
| *** rcernin has joined #openstack-infra | 08:58 | |
| *** gfidente has joined #openstack-infra | 09:10 | |
| *** ramishra has quit IRC | 09:12 | |
| *** jesusaur has quit IRC | 09:14 | |
| *** markvoelker has quit IRC | 09:15 | |
| *** jesusaur has joined #openstack-infra | 09:18 | |
| *** ramishra has joined #openstack-infra | 09:19 | |
| *** zhangfei has quit IRC | 09:20 | |
| *** sree has quit IRC | 09:20 | |
| sshnaidm | infra cores, can you please check why all jobs fail in tripleo patch? looks like pip mirror failure maybe? http://logs.openstack.org/67/570167/2/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/cf9ccc3/job-output.txt.gz#_2018-05-29_09_13_53_496173 | 09:21 |
| *** sambetts_ is now known as sambetts|afk | 09:22 | |
| gema | ianw: ack, thanks, looking into that | 09:23 |
| *** armaan has quit IRC | 09:23 | |
| *** pcaruana has quit IRC | 09:23 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-meetbot master: Use httpd::vhost $content parameter https://review.openstack.org/564904 | 09:23 |
| *** lifeless has joined #openstack-infra | 09:24 | |
| sshnaidm | cores, please review/merge https://review.openstack.org/#/c/570822/ | 09:24 |
| *** sambetts|afk is now known as sambetts | 09:25 | |
| *** pcaruana has joined #openstack-infra | 09:27 | |
| *** rossella_s has quit IRC | 09:27 | |
| *** rossella_s has joined #openstack-infra | 09:31 | |
| *** zhangfei has joined #openstack-infra | 09:31 | |
| *** panda|pto is now known as panda | 09:32 | |
| *** _nick is now known as yankcrime | 09:35 | |
| *** armaan has joined #openstack-infra | 09:35 | |
| *** alexchadin has quit IRC | 09:42 | |
| *** alexchadin has joined #openstack-infra | 09:42 | |
| *** pblaho has joined #openstack-infra | 09:43 | |
| *** dbecker has quit IRC | 09:46 | |
| *** Tengu has joined #openstack-infra | 09:49 | |
| *** rossella_s has quit IRC | 09:53 | |
| *** pcaruana has quit IRC | 09:54 | |
| *** rossella_s has joined #openstack-infra | 09:55 | |
| *** timothyb89 has quit IRC | 09:56 | |
| *** dbecker has joined #openstack-infra | 09:57 | |
| *** timothyb89 has joined #openstack-infra | 09:57 | |
| ianw | frickler: oh, heh good timing :) | 10:01 |
| frickler | ianw: ^5 ;) | 10:03 |
| *** rossella_s has quit IRC | 10:05 | |
| *** vabada has joined #openstack-infra | 10:07 | |
| *** rossella_s has joined #openstack-infra | 10:08 | |
| *** rcernin has quit IRC | 10:10 | |
| *** yamamoto has quit IRC | 10:10 | |
| *** pcaruana has joined #openstack-infra | 10:10 | |
| *** gyankum has quit IRC | 10:11 | |
| *** sfeole has quit IRC | 10:14 | |
| *** namnh has quit IRC | 10:15 | |
| *** wadadli has quit IRC | 10:15 | |
| *** markvoelker has joined #openstack-infra | 10:16 | |
| *** gongysh has quit IRC | 10:16 | |
| *** wadadli has joined #openstack-infra | 10:19 | |
| *** sfeole has joined #openstack-infra | 10:20 | |
| *** gongysh has joined #openstack-infra | 10:21 | |
| *** gongysh has quit IRC | 10:21 | |
| *** ramishra has quit IRC | 10:22 | |
| *** alexchadin has quit IRC | 10:23 | |
| *** ramishra has joined #openstack-infra | 10:23 | |
| *** sfeole has quit IRC | 10:38 | |
| *** nicolasbock has joined #openstack-infra | 10:38 | |
| *** yolanda has quit IRC | 10:38 | |
| *** yolanda has joined #openstack-infra | 10:42 | |
| *** sfeole has joined #openstack-infra | 10:45 | |
| *** markvoelker has quit IRC | 10:51 | |
| *** rossella_s has quit IRC | 10:51 | |
| *** rossella_s has joined #openstack-infra | 10:54 | |
| *** jpena is now known as jpena|lunch | 11:02 | |
| *** vivsoni has joined #openstack-infra | 11:07 | |
| *** neiloy has joined #openstack-infra | 11:09 | |
| *** yamamoto has joined #openstack-infra | 11:11 | |
| *** lucasagomes is now known as lucas-hungry | 11:11 | |
| *** lucas-hungry is now known as lucasagomes | 11:11 | |
| *** yamamoto has quit IRC | 11:16 | |
| *** gyankum has joined #openstack-infra | 11:24 | |
| *** zhangfei has quit IRC | 11:31 | |
| *** sree_ has joined #openstack-infra | 11:31 | |
| *** rossella_s has quit IRC | 11:31 | |
| *** sree_ is now known as Guest77906 | 11:32 | |
| *** dpawlik has quit IRC | 11:32 | |
| *** udesale_ has joined #openstack-infra | 11:33 | |
| *** myoung|zzz is now known as myoung | 11:33 | |
| *** udesale has quit IRC | 11:34 | |
| *** rossella_s has joined #openstack-infra | 11:34 | |
| *** yamamoto has joined #openstack-infra | 11:36 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Cap cmd2 to < 0.9.0 https://review.openstack.org/570822 | 11:37 |
| *** udesale_ has quit IRC | 11:37 | |
| frickler | sshnaidm: CrayZee: ykarel: kota_: should be o.k. to recheck failing devstack-gate based jobs now ^^ | 11:40 |
| ykarel | frickler, as https://review.openstack.org/#/c/570822/ is merged, i think it's ok | 11:41 |
| CrayZee | frickler: thanks! | 11:42 |
| *** ldnunes has joined #openstack-infra | 11:42 | |
| *** pcaruana has quit IRC | 11:42 | |
| frickler | ykarel: yes, that's what I was saying (or trying to) ;) | 11:42 |
| ykarel | frickler, ahh Ok :) | 11:43 |
| *** tpsilva has joined #openstack-infra | 11:46 | |
| *** yamamoto has quit IRC | 11:47 | |
| *** nicolasbock has quit IRC | 11:48 | |
| *** markvoelker has joined #openstack-infra | 11:48 | |
| *** yamamoto has joined #openstack-infra | 11:48 | |
| *** dpawlik has joined #openstack-infra | 11:49 | |
| *** nicolasbock has joined #openstack-infra | 11:51 | |
| *** amoralej is now known as amoralej|lunch | 11:55 | |
| *** rh-jelabarre has joined #openstack-infra | 11:56 | |
| *** pcaruana has joined #openstack-infra | 12:02 | |
| *** rosmaita has joined #openstack-infra | 12:03 | |
| *** jpena|lunch is now known as jpena | 12:03 | |
| zigo | ianw: Around? | 12:04 |
| zigo | I need to get my hands into a VM running puppet-openstack's CI. | 12:05 |
| zigo | So I can debug and understand why it's getting redis-server from backports ... | 12:05 |
| *** neiloy_ has joined #openstack-infra | 12:05 | |
| *** e0ne has joined #openstack-infra | 12:06 | |
| *** wolverineav has joined #openstack-infra | 12:06 | |
| *** sshnaidm has quit IRC | 12:06 | |
| *** sshnaidm has joined #openstack-infra | 12:10 | |
| *** edmondsw_ has joined #openstack-infra | 12:11 | |
| *** udesale has joined #openstack-infra | 12:11 | |
| *** sshnaidm has quit IRC | 12:15 | |
| *** udesale has quit IRC | 12:17 | |
| *** sshnaidm has joined #openstack-infra | 12:18 | |
| *** markvoelker has quit IRC | 12:21 | |
| *** sshnaidm has quit IRC | 12:24 | |
| *** caphrim007 has quit IRC | 12:26 | |
| *** caphrim007 has joined #openstack-infra | 12:26 | |
| *** rlandy has joined #openstack-infra | 12:28 | |
| *** rlandy is now known as rlandy|rover | 12:29 | |
| *** udesale has joined #openstack-infra | 12:34 | |
| *** jcoufal has joined #openstack-infra | 12:37 | |
| *** dklyle has quit IRC | 12:42 | |
| *** hughsaunders has quit IRC | 12:42 | |
| *** efried has joined #openstack-infra | 12:46 | |
| *** jcoufal has quit IRC | 12:54 | |
| mnaser | https://review.openstack.org/#/q/topic:cmd2-pin | 13:00 |
| mnaser | im going around and tracking things down | 13:01 |
| *** jcoufal has joined #openstack-infra | 13:01 | |
| *** kzaitsev1pi has quit IRC | 13:02 | |
| *** kzaitsev_pi has joined #openstack-infra | 13:02 | |
| *** trown|outtypewww is now known as trown | 13:04 | |
| *** camunoz has joined #openstack-infra | 13:05 | |
| *** rossella_s has quit IRC | 13:05 | |
| *** esberglu has joined #openstack-infra | 13:06 | |
| *** ykarel is now known as ykarel|away | 13:06 | |
| *** caphrim007 has quit IRC | 13:07 | |
| *** sshnaidm has joined #openstack-infra | 13:10 | |
| *** rossella_s has joined #openstack-infra | 13:10 | |
| *** ykarel|away has quit IRC | 13:10 | |
| *** camunoz has quit IRC | 13:12 | |
| *** camunoz has joined #openstack-infra | 13:13 | |
| *** kzaitsev_pi has quit IRC | 13:13 | |
| *** kzaitsev_pi has joined #openstack-infra | 13:13 | |
| *** rossella_s has quit IRC | 13:16 | |
| *** caphrim007 has joined #openstack-infra | 13:16 | |
| scas | semantics question: if i want to import a new repo, but i'm intending to branch from master Soon(tm), should i hold off on branching until the reviews or merged, or push the feature branch to my gh pre-import? | 13:17 |
| *** gongysh has joined #openstack-infra | 13:17 | |
| scas | ENOCAFFEINE | 13:17 |
| *** markvoelker has joined #openstack-infra | 13:17 | |
| scas | excuse the sleepy spelling/grammar | 13:17 |
| *** amoralej|lunch is now known as amoralej | 13:18 | |
| *** rossella_s has joined #openstack-infra | 13:20 | |
| *** links has quit IRC | 13:20 | |
| *** esberglu has quit IRC | 13:20 | |
| *** caphrim007 has quit IRC | 13:21 | |
| jhesketh | scas: assuming you're talking about importing a repo from github into openstack's gerrit, all of the branches that exist will be copied across, but none of the pull requests. Thus you should merge any PR's that you want before you import it into gerrit, or otherwise resubmit them as gerrit changes after the import | 13:21 |
| *** dave-mccowan has joined #openstack-infra | 13:21 | |
| *** markvoelker has quit IRC | 13:22 | |
| *** mriedem has joined #openstack-infra | 13:23 | |
| *** dave-mcc_ has joined #openstack-infra | 13:25 | |
| *** sshnaidm has quit IRC | 13:25 | |
| *** jamesmcarthur has joined #openstack-infra | 13:25 | |
| *** dave-mccowan has quit IRC | 13:26 | |
| *** sshnaidm has joined #openstack-infra | 13:27 | |
| *** esberglu has joined #openstack-infra | 13:30 | |
| *** zoli is now known as zoli|lunch | 13:31 | |
| *** kgiusti has joined #openstack-infra | 13:31 | |
| *** dtantsur is now known as dtantsur|brb | 13:31 | |
| *** lbragstad has joined #openstack-infra | 13:32 | |
| *** markvoelker has joined #openstack-infra | 13:33 | |
| mriedem | is "chmod: cannot access '/home/zuul/workspace/logs/reproduce.sh': No such file or directory" a known issue? | 13:36 |
| scas | that's part of the idea, but more of a 'should i' -- like i mentioned, i'm branching from master soon, but i'm also importing a repo that would naturally inherit the same branching. i suppose it doesn't really make much difference either way | 13:36 |
| mriedem | http://logs.openstack.org/40/482640/31/check/nova-next/220dca7/ara-report/result/6f2923a4-218b-4d01-beb0-3735bbbc78d3/ | 13:36 |
| scas | i can just push the branch before i import. i don't have any automated jobs spitting out artifacts yet, as i am the artifact delivery utility | 13:36 |
| scas | i like to keep my repos in lockstep when branching, so it caused my 06:30 non-caffeinated brain to raise a question probably not totally thought through | 13:38 |
| Shrews | mriedem: looks like that may be related the cmd2 issue | 13:39 |
| mriedem | https://bugs.launchpad.net/openstack-gate/+bug/1773983 | 13:39 |
| openstack | Launchpad bug 1773983 in OpenStack-Gate "legacy jobs failing with "chmod: cannot access '/home/zuul/workspace/logs/reproduce.sh': No such file or directory"" [Undecided,New] | 13:39 |
| *** yolanda_ has joined #openstack-infra | 13:40 | |
| mriedem | Shrews: so https://github.com/openstack-infra/devstack-gate/commit/63e5e1dd9638173a8f959be07842e445bafcc837 | 13:40 |
| mriedem | it is hitting all branches so that's probably right | 13:40 |
| *** eharney has joined #openstack-infra | 13:41 | |
| *** apple01 has quit IRC | 13:41 | |
| *** apple01 has joined #openstack-infra | 13:42 | |
| *** edmondsw_ is now known as edmondsw | 13:42 | |
| *** yolanda has quit IRC | 13:42 | |
| *** VW has joined #openstack-infra | 13:43 | |
| mriedem | oh looks like the failing jobs i'm looking at are fixed by that patch | 13:44 |
| mriedem | so nvm | 13:44 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Add query for cmd2 0.9.1 python bug 1773936 https://review.openstack.org/570939 | 13:48 |
| openstack | bug 1773936 in tripleo "ci failing on cmd2 pip" [Critical,Fix released] https://launchpad.net/bugs/1773936 | 13:48 |
| *** VW has quit IRC | 13:49 | |
| *** psachin`` has quit IRC | 13:50 | |
| *** ykarel|away has joined #openstack-infra | 13:51 | |
| *** r-daneel has joined #openstack-infra | 13:52 | |
| *** dave-mcc_ has quit IRC | 13:54 | |
| zigo | gema: Hi there! Are you around? | 13:55 |
| zigo | gema: I have an issue in puppet-openstack, as there's backports activated by default in the Stretch image. | 13:55 |
| zigo | gema: I wonder if you've set pinning or something, because it's getting redis-server from official backports and fails... | 13:55 |
| *** ykarel|away is now known as ykarel | 13:55 | |
| zigo | gema: I can hardly know without having access to a VM in infra, so I thought you wouldn't mind if I just asked. | 13:56 |
| *** dave-mccowan has joined #openstack-infra | 13:56 | |
| *** VW has joined #openstack-infra | 13:57 | |
| zigo | gema: And I'm asking you, because it looks like the add of /etc/apt/sources.list.d/backport.list was made for the arm64 CI, I heard (from Jeremy). | 13:58 |
| *** jroll has quit IRC | 14:01 | |
| *** jamesmcarthur has quit IRC | 14:02 | |
| *** jroll has joined #openstack-infra | 14:02 | |
| gema | zigo: context? | 14:03 |
| *** mikal has joined #openstack-infra | 14:03 | |
| gema | (otp right now) | 14:03 |
| zigo | gema: I'm trying to get puppet-openstack work with Debian, and the CI fails when installing redis-server because it takes it from backports, when IMO, the Stretch image shouldn't have backport at all. | 14:04 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Add query for cmd2 0.9.1 python bug 1773936 https://review.openstack.org/570939 | 14:04 |
| openstack | bug 1773936 in tripleo "ci failing on cmd2 pip" [Critical,Fix released] https://launchpad.net/bugs/1773936 | 14:04 |
| gema | zigo: talk to hrw | 14:04 |
| gema | zigo: easy to find on #openstack-kolla | 14:04 |
| zigo | gema: Ok, thanks. | 14:04 |
| gema | np | 14:04 |
| *** mikal_ has quit IRC | 14:07 | |
| *** mriedem is now known as mriedem_away | 14:13 | |
| *** dave-mcc_ has joined #openstack-infra | 14:18 | |
| *** apple01 has quit IRC | 14:18 | |
| *** apple01 has joined #openstack-infra | 14:19 | |
| *** bnemec has joined #openstack-infra | 14:20 | |
| *** felipemonteiro has joined #openstack-infra | 14:20 | |
| *** dave-mccowan has quit IRC | 14:21 | |
| *** rossella_s has quit IRC | 14:21 | |
| *** Guest77906 has quit IRC | 14:22 | |
| *** jamesmcarthur has joined #openstack-infra | 14:22 | |
| *** markvoelker has quit IRC | 14:24 | |
| *** rossella_s has joined #openstack-infra | 14:25 | |
| *** markvoelker has joined #openstack-infra | 14:26 | |
| *** eharney has quit IRC | 14:26 | |
| *** felipemonteiro has quit IRC | 14:28 | |
| *** jamesmcarthur has quit IRC | 14:28 | |
| *** rpioso|afk is now known as rpioso | 14:29 | |
| *** tbachman has joined #openstack-infra | 14:29 | |
| *** markvoelker has quit IRC | 14:30 | |
| *** lifeless_ has joined #openstack-infra | 14:31 | |
| *** lifeless has quit IRC | 14:32 | |
| *** rpioso has quit IRC | 14:32 | |
| *** kien-ha has joined #openstack-infra | 14:32 | |
| *** apple01 has quit IRC | 14:32 | |
| *** rpioso has joined #openstack-infra | 14:33 | |
| *** jistr is now known as jistr|mtg | 14:36 | |
| *** rossella_s has quit IRC | 14:37 | |
| *** eharney has joined #openstack-infra | 14:39 | |
| *** felipemonteiro has joined #openstack-infra | 14:40 | |
| *** rossella_s has joined #openstack-infra | 14:40 | |
| *** rajinir has joined #openstack-infra | 14:40 | |
| *** hongbin has joined #openstack-infra | 14:42 | |
| *** tbachman has left #openstack-infra | 14:43 | |
| *** cshastri has quit IRC | 14:49 | |
| *** beagles is now known as beagles_food | 14:50 | |
| *** felipemonteiro has quit IRC | 14:50 | |
| *** felipemonteiro has joined #openstack-infra | 14:51 | |
| *** jistr|mtg is now known as jistr | 14:52 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:54 | |
| *** ykarel is now known as ykarel|away | 14:54 | |
| *** felipemonteiro has quit IRC | 14:58 | |
| *** felipemonteiro_ is now known as felipemonteiro | 14:59 | |
| *** jamesmcarthur has joined #openstack-infra | 15:00 | |
| *** dtantsur|brb is now known as dtantsur | 15:00 | |
| *** CrayZee has quit IRC | 15:02 | |
| *** zoli|lunch is now known as zoli|wfh | 15:04 | |
| *** apple01 has joined #openstack-infra | 15:09 | |
| *** gyee has joined #openstack-infra | 15:10 | |
| *** dave-mcc_ is now known as dave-mccowan | 15:13 | |
| *** dklyle has joined #openstack-infra | 15:15 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Revert "Cap cmd2 to < 0.9.0" https://review.openstack.org/570948 | 15:15 |
| *** lpetrut has quit IRC | 15:15 | |
| clarkb | upstream appears to have sorted out the pypi hosting situation with cmd2 on pypi. This revert will check if it works properly | 15:15 |
| smcginnis | We got a release job failure with an odd (to me at least) error from pypi. Anyone see this before? http://logs.openstack.org/26/26956a27b95550e2162243da79d62bb1b19d50d7/release/release-openstack-python/2bd7f7d/job-output.txt.gz#_2018-05-29_14_28_35_963702 | 15:16 |
| smcginnis | cc dhellmann ^^ | 15:16 |
| clarkb | lennyb: if you put your project configuration on those specific brnaches their configs can differ | 15:16 |
| clarkb | lennyb: the idea there is over time master will be updated as the project moves then when you cut branches off of master you effectively freeze the older stable zuul config | 15:17 |
| *** dpawlik has quit IRC | 15:17 | |
| clarkb | smcginnis: looks like pypi is checking if the project description is valid rst now | 15:17 |
| *** hrw has joined #openstack-infra | 15:17 | |
| smcginnis | clarkb: New stricter enforcement? Oh joy, this should be fun. | 15:18 |
| clarkb | smcginnis: http://git.openstack.org/cgit/openstack/tripleo-validations/tree/README.rst guessing that has a bug in it | 15:18 |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Update neutron rally job in grafana dashboard config https://review.openstack.org/570949 | 15:18 |
| clarkb | since it appears to pull that file in as the desciption | 15:18 |
| smcginnis | Guess we may need to start running doc8 against README files. :/ | 15:19 |
| hrw | hi. just to lurk | 15:19 |
| clarkb | smcginnis: we might be able to have pbr try to render that at build time too | 15:19 |
| clarkb | smcginnis: to catch it as early as possible | 15:19 |
| smcginnis | Yeah, we'll at least need to have some validation added to our release jobs to catch these before it's too late. | 15:20 |
| *** ccamacho has quit IRC | 15:20 | |
| clarkb | ++ | 15:20 |
| *** apple01 has quit IRC | 15:21 | |
| *** apple01 has joined #openstack-infra | 15:21 | |
| smcginnis | EmilienM_PTO: FYI for when you're back ^^ | 15:22 |
| *** kjackal has joined #openstack-infra | 15:22 | |
| fungi | clarkb: we will want to double-check whether we need to manually delete the wheels for cmd2 0.9.0 off the wheel mirrors, since those are purely additive | 15:23 |
| clarkb | fungi: ya, though they had to push new pacakges for cmd2 which should override the older 0.9.0 packages for us | 15:23 |
| fungi | oh, that works too then | 15:23 |
| *** felipemonteiro has quit IRC | 15:23 | |
| clarkb | oh except 0.9.0 will be seen as newer than 0.8.8 | 15:24 |
| clarkb | hrm | 15:24 |
| fungi | yeah, 0.9.0.1 is python3-only | 15:24 |
| clarkb | yup it is still broken | 15:24 |
| *** felipemonteiro has joined #openstack-infra | 15:24 | |
| fungi | so just need to tidy up the wheel mirrors | 15:24 |
| *** lifeless_ has quit IRC | 15:24 | |
| clarkb | ya I think that is the only way around this, that or to stop building site local wheels and mirroring them | 15:25 |
| fungi | eventually maybe we can think about not putting wheels on our wheel mirrors except for packages which don't already upload usable wheels on pypi | 15:25 |
| *** beagles_food is now known as beagles | 15:26 | |
| clarkb | infra-root let me know if you want to poke at ^ it isn't urgent as my weekend workaround is working. I'm still in catch up after summit mode and likely won't have time to look at that today | 15:27 |
| *** caphrim007 has joined #openstack-infra | 15:28 | |
| clarkb | potentially a good opportunity to do afs things :) | 15:31 |
| *** e0ne has quit IRC | 15:33 | |
| *** caphrim007 has quit IRC | 15:33 | |
| *** caphrim007 has joined #openstack-infra | 15:34 | |
| *** jesslampe has joined #openstack-infra | 15:35 | |
| *** lyarwood has joined #openstack-infra | 15:36 | |
| *** apple01 has quit IRC | 15:36 | |
| *** jamesmcarthur has quit IRC | 15:37 | |
| *** caphrim007 has quit IRC | 15:38 | |
| *** caphrim007 has joined #openstack-infra | 15:39 | |
| *** caphrim007 has quit IRC | 15:44 | |
| *** caphrim007 has joined #openstack-infra | 15:45 | |
| *** claudiub has joined #openstack-infra | 15:48 | |
| zigo | fungi: clarkb: Hi there! Could one of you set a VM on hold for puppet-openstack-integration-4-scenario001-tempest-debian-stable so I could login and investigate what's going on? | 15:49 |
| zigo | I need to investigate ... | 15:49 |
| *** caphrim007 has quit IRC | 15:50 | |
| *** caphrim007 has joined #openstack-infra | 15:50 | |
| *** jtomasek has quit IRC | 15:52 | |
| fungi | zigo: the autohold needs to be for a project and job together. what project are you testing a change on for that? | 15:52 |
| *** neiloy has quit IRC | 15:53 | |
| zigo | fungi: I'm testing this one: https://review.openstack.org/#/c/564328 | 15:53 |
| zigo | fungi: I need to ssh in the first debian job... | 15:53 |
| *** iranzo has quit IRC | 15:53 | |
| *** udesale_ has joined #openstack-infra | 15:54 | |
| *** dhajare_ has quit IRC | 15:54 | |
| *** jtomasek has joined #openstack-infra | 15:54 | |
| *** dpawlik has joined #openstack-infra | 15:54 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Don't capture stderr in siblings logic https://review.openstack.org/570956 | 15:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: WIP Support building pdfs of sphinx docs https://review.openstack.org/570957 | 15:55 |
| *** caphrim007 has quit IRC | 15:55 | |
| mordred | clarkb, corvus: https://review.openstack.org/#/c/570956/ should fix a bug I encountered over the weekend in siblings | 15:56 |
| mordred | you can see the issue in http://logs.openstack.org/78/570678/4/check/openstacksdk-ansible-devel-functional-devstack/b396ba5/tox/ansible-siblings.txt | 15:56 |
| *** udesale has quit IRC | 15:57 | |
| mordred | (on line 3- and then in the fact that it doesn't install ansible from source) | 15:57 |
| clarkb | mordred: that patch has grown a , in a weird spot but it is valid python to do so. I have approved teh change | 15:59 |
| *** dpawlik has quit IRC | 15:59 | |
| mordred | clarkb: thanks! and oh - it has indeed | 16:00 |
| *** hashar is now known as hasharAway | 16:01 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Remove errant comma https://review.openstack.org/570962 | 16:02 |
| mordred | clarkb: ^^ if you feel like it :) | 16:02 |
| clarkb | thanks | 16:02 |
| fungi | zigo: okay, the next puppet-openstack-integration-4-scenario001-tempest-debian-stable job which fails for change 564328 to openstack/puppet-nova will have its node(s) held, and then i can log in and grant you ssh access to it | 16:02 |
| mordred | clarkb, fungi, smcginnis, dhellmann: also - 'python setup.py check -r -s' will check that RST long-descriptions are valid rst - it's used in the pep8 env of a few projects | 16:06 |
| *** caphrim007 has joined #openstack-infra | 16:06 | |
| zigo | fungi: Thanks. | 16:06 |
| *** caphrim007 has quit IRC | 16:06 | |
| mordred | it might be worthwhile looking at adding it $somewhere systemically (maybe openstack-tox-pep8?) and also to the PTI | 16:06 |
| *** caphrim007 has joined #openstack-infra | 16:06 | |
| *** udesale__ has joined #openstack-infra | 16:07 | |
| smcginnis | mordred: I agree. I've been spot checking a few repos this morning and this is a larger issue that I'm afraid will pop up randomly unless we have a good way to catch it right away. | 16:09 |
| mordred | smcginnis: ++ | 16:09 |
| mordred | clarkb: sigh. turns out that comma broke pep8 | 16:10 |
| *** udesale_ has quit IRC | 16:10 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Don't capture stderr in siblings logic https://review.openstack.org/570956 | 16:10 |
| clarkb | mordred: good ol' pep8 | 16:10 |
| mordred | yup | 16:11 |
| mordred | corvus: if you have another sec ^^ | 16:11 |
| *** mriedem_away is now known as mriedem | 16:11 | |
| clarkb | mordred: also I didn't realize that was a thing re setup.py check | 16:12 |
| *** gongysh has quit IRC | 16:12 | |
| mordred | clarkb: I learned about it from the openstacksdk repo | 16:12 |
| openstackgerrit | Felipe Monteiro proposed openstack-infra/project-config master: Set up gerritbot for airship projects https://review.openstack.org/569251 | 16:13 |
| *** armaan has quit IRC | 16:14 | |
| *** udesale__ has quit IRC | 16:14 | |
| *** mriedem has quit IRC | 16:15 | |
| *** anteaya has joined #openstack-infra | 16:15 | |
| *** armaan has joined #openstack-infra | 16:16 | |
| *** claudiub has quit IRC | 16:19 | |
| *** mriedem has joined #openstack-infra | 16:20 | |
| *** pcichy has quit IRC | 16:21 | |
| *** panda is now known as panda|off | 16:21 | |
| openstackgerrit | Artem Goncharov proposed openstack-infra/nodepool master: Add support for specifying security_group in nodepool https://review.openstack.org/570857 | 16:27 |
| *** claudiub has joined #openstack-infra | 16:32 | |
| clarkb | zigo: fungi this is debugging the redis problem? | 16:33 |
| zigo | yep | 16:34 |
| zigo | I tried making a package without ::1 in the redis.conf, it didn't help, so I'm out of idea... | 16:34 |
| clarkb | as a heads up I think today's infra meeting will be far less formal than normal. I'm still in the process of mentally organizing last week and the set of todo items that came out of it. Don't think I will be ready to write much of it down in the next couple hours | 16:36 |
| *** kjackal has quit IRC | 16:36 | |
| *** claudiub has quit IRC | 16:37 | |
| *** kjackal has joined #openstack-infra | 16:38 | |
| fungi | clarkb: particularly, working out why the job is dragging in the redis package from stretch-backports rather than stretch proper | 16:38 |
| *** pcaruana has quit IRC | 16:39 | |
| zigo | fungi: Just did a recheck on the job, it should be failing in a few minutes, I'm going home in the mean while. | 16:39 |
| *** kien-ha has quit IRC | 16:42 | |
| *** e0ne has joined #openstack-infra | 16:42 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Don't capture stderr in siblings logic https://review.openstack.org/570956 | 16:42 |
| *** ramishra has quit IRC | 16:43 | |
| fungi | zigo: cool, i'll look for the node... what ssh key should i authorize for you? | 16:46 |
| *** eharney has quit IRC | 16:48 | |
| *** lpetrut has joined #openstack-infra | 16:51 | |
| *** markvoelker has joined #openstack-infra | 16:52 | |
| *** markvoelker_ has joined #openstack-infra | 16:53 | |
| *** eandersson has quit IRC | 16:53 | |
| *** markvoelker has quit IRC | 16:57 | |
| *** r-daneel has quit IRC | 16:59 | |
| *** derekh has quit IRC | 17:00 | |
| *** kjackal has quit IRC | 17:01 | |
| *** ralonsoh has quit IRC | 17:02 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-manual master: Correct old reference to StackForge hosting guide https://review.openstack.org/570974 | 17:02 |
| fungi | clarkb: ^ that could stand to get updated quickly since it's currently a broken link | 17:02 |
| *** eharney has joined #openstack-infra | 17:02 | |
| fungi | oops, i missed one spot | 17:02 |
| clarkb | fungi: probably the one I just commented on | 17:03 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-manual master: Correct old reference to StackForge hosting guide https://review.openstack.org/570974 | 17:03 |
| fungi | there we go | 17:03 |
| clarkb | I've approved it | 17:03 |
| clarkb | the content isn't changing just the links | 17:03 |
| fungi | well, the content changed ever so slightly | 17:03 |
| fungi | but yes, not substantially | 17:04 |
| *** kjackal has joined #openstack-infra | 17:04 | |
| fungi | adjusted it to make it clear stackforge was the old name, not a current name | 17:04 |
| *** neiloy has joined #openstack-infra | 17:05 | |
| openstackgerrit | Artem Goncharov proposed openstack-infra/nodepool master: Add support for specifying security_group in nodepool https://review.openstack.org/570857 | 17:06 |
| *** armaan has quit IRC | 17:06 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Allow to rebuild arbitrary images https://review.openstack.org/568697 | 17:06 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-manual master: Correct old reference to StackForge hosting guide https://review.openstack.org/570974 | 17:08 |
| fungi | clarkb: oops, i just spotted that i should have removed an indefinite article in the rephrasing too ^ | 17:08 |
| openstackgerrit | Artem Goncharov proposed openstack-infra/nodepool master: Add support for specifying security_group in nodepool https://review.openstack.org/570857 | 17:10 |
| *** trown is now known as trown|lunch | 17:11 | |
| *** dklyle has quit IRC | 17:12 | |
| *** yamahata has joined #openstack-infra | 17:14 | |
| *** Guest92760 is now known as gtmanfred | 17:15 | |
| *** armaan has joined #openstack-infra | 17:15 | |
| openstackgerrit | Roman Gorshunov proposed openstack/diskimage-builder master: Added release notes for Change 568697 https://review.openstack.org/570978 | 17:15 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Allow templates to be optional for zuul-migrate https://review.openstack.org/570979 | 17:15 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Allow for projects only names in zuul-migrate https://review.openstack.org/570980 | 17:15 |
| openstackgerrit | Merged openstack-infra/infra-manual master: Correct old reference to StackForge hosting guide https://review.openstack.org/570974 | 17:17 |
| clarkb | fungi: ^ | 17:17 |
| fungi | thanks, as you can imagine i spotted that in composing a followup to the ml thread | 17:17 |
| fungi | however i'm also going through codesearch with a case-insensitive search for "stackforge" to spot any other important places we might have missed | 17:18 |
| *** kjackal has quit IRC | 17:22 | |
| *** kjackal has joined #openstack-infra | 17:22 | |
| *** eharney has quit IRC | 17:25 | |
| corvus | fungi: what thread? | 17:28 |
| clarkb | corvus: [openstack-dev] [TC] Terms of service for hosted projects is my guess | 17:29 |
| *** armaan has quit IRC | 17:29 | |
| fungi | corvus: http://lists.openstack.org/pipermail/openstack-dev/2018-May/130807.html | 17:29 |
| fungi | yes | 17:29 |
| fungi | i'm adding an [Infra} subject tag in my reply | 17:29 |
| corvus | thx | 17:29 |
| *** armaan has joined #openstack-infra | 17:30 | |
| *** sambetts is now known as sambetts|afk | 17:31 | |
| *** eharney has joined #openstack-infra | 17:35 | |
| fungi | and now i've replied | 17:37 |
| fungi | just wanted the project creators guide updated before doing so | 17:38 |
| fungi | which it now is as the post publication job for it completed | 17:38 |
| *** pcichy has joined #openstack-infra | 17:39 | |
| *** pcaruana has joined #openstack-infra | 17:43 | |
| *** gfidente has quit IRC | 17:46 | |
| *** r-daneel has joined #openstack-infra | 17:48 | |
| *** jaosorior has quit IRC | 17:49 | |
| *** kjackal has quit IRC | 17:50 | |
| mnaser | in hindsight, maybe having stackforge wasn't so bad | 17:51 |
| *** jpena is now known as jpena|off | 17:51 | |
| mnaser | in the current state that the osf is going anyways | 17:51 |
| *** kjackal has joined #openstack-infra | 17:52 | |
| *** neiloy has quit IRC | 17:56 | |
| *** dpawlik has joined #openstack-infra | 17:56 | |
| fungi | the idea of having a name for what it is we're doing other than "openstack" and "not openstack" does seem prudent | 17:57 |
| *** camunoz has quit IRC | 17:57 | |
| fungi | however tying that name to github orgs, prefixing it on repository names and so on was not so great | 17:57 |
| *** dhinesh has joined #openstack-infra | 17:58 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Use httpd::vhost $content parameter https://review.openstack.org/570825 | 17:59 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Add beaker check of vhost template https://review.openstack.org/570991 | 17:59 |
| *** dpawlik has quit IRC | 18:00 | |
| fungi | clarkb: what do you think about getting permission to expense that domain name you liked? i mean, sure it's a couple orders of magnitude more than a typical domain registration, but in the grand scheme of things... i've expensed plane tickets which cost more than that | 18:00 |
| clarkb | fungi: I'm in favor of it but unsure if we'll get broader support for it and worry if we don't get general buy in that people might not be too happy | 18:01 |
| fungi | and you only get to use a plane ticket fir a few hours, whereas a domain lasts until someone sues you over it | 18:01 |
| clarkb | not any specific group or individual just in general | 18:01 |
| *** iyamahat has joined #openstack-infra | 18:01 | |
| fungi | right, we'd need to circulate the idea, but if the current owners get wind of it they might see that as a reason to raise the asking price | 18:02 |
| clarkb | indeed | 18:02 |
| *** gyankum has quit IRC | 18:02 | |
| *** priteau has quit IRC | 18:02 | |
| clarkb | maybe we should talk to the people that approve our expense reports and if they are not opposed we can do a priavte email thread to get consensus? | 18:03 |
| fungi | i'm happy to have that conversation, but seeing as you're the ptl it might be better if you started it | 18:03 |
| *** iyamahat has quit IRC | 18:05 | |
| fungi | fwiw, i like it and i'm sure it will resonate well with a lot of others too, so seems worth the price. the sooner we come up with something we can get broader agreement on, and so have a name for what this is we're doing, the better | 18:06 |
| clarkb | ++ | 18:06 |
| * clarkb asks expense approvers | 18:06 | |
| fungi | because we keep deferring decisions on things we need to do in part because we lack something to call it | 18:06 |
| *** kjackal has quit IRC | 18:07 | |
| *** kjackal has joined #openstack-infra | 18:09 | |
| dhellmann | mordred : nice, thanks, I'll see about adding that to our release validation | 18:10 |
| *** aojea has quit IRC | 18:10 | |
| *** camunoz has joined #openstack-infra | 18:12 | |
| *** iyamahat has joined #openstack-infra | 18:12 | |
| corvus | fungi, clarkb: fwiw, thanks for having that discussion in the open this way. i think it's very reasonable :) | 18:15 |
| *** zoli|wfh is now known as zoli|gone | 18:16 | |
| *** zoli|gone is now known as zoli | 18:16 | |
| *** rlandy|rover is now known as rlandy|rover|brb | 18:21 | |
| *** trown|lunch is now known as trown | 18:22 | |
| *** janki has quit IRC | 18:25 | |
| *** dtantsur is now known as dtantsur|afk | 18:28 | |
| *** tesseract has quit IRC | 18:30 | |
| *** markvoelker_ has quit IRC | 18:33 | |
| *** amoralej is now known as amoralej|off | 18:38 | |
| *** pcaruana has quit IRC | 18:39 | |
| *** lbragstad has quit IRC | 18:39 | |
| *** felipemonteiro_ has joined #openstack-infra | 18:40 | |
| *** markvoelker has joined #openstack-infra | 18:42 | |
| *** dtruong_ has joined #openstack-infra | 18:43 | |
| *** rkukura_ has joined #openstack-infra | 18:43 | |
| *** jcoufal_ has joined #openstack-infra | 18:44 | |
| *** caphrim007_ has joined #openstack-infra | 18:44 | |
| *** snapiri- has joined #openstack-infra | 18:44 | |
| *** felipemonteiro has quit IRC | 18:44 | |
| *** pcichy_ has joined #openstack-infra | 18:45 | |
| *** Hunner_ is now known as Hunner | 18:46 | |
| *** kien-ha has joined #openstack-infra | 18:46 | |
| *** timothyb89_ has joined #openstack-infra | 18:47 | |
| *** mikal_ has joined #openstack-infra | 18:48 | |
| *** e0ne has quit IRC | 18:49 | |
| *** lpetrut has quit IRC | 18:49 | |
| *** armaan_ has joined #openstack-infra | 18:50 | |
| *** felipemonteiro_ has quit IRC | 18:51 | |
| *** hrubi_ has joined #openstack-infra | 18:51 | |
| *** felipemonteiro_ has joined #openstack-infra | 18:51 | |
| *** ekhugen has joined #openstack-infra | 18:51 | |
| *** SergeyLukjanov2 has joined #openstack-infra | 18:51 | |
| *** jmccrory_ has joined #openstack-infra | 18:51 | |
| *** sfeole` has joined #openstack-infra | 18:52 | |
| *** pcichy has quit IRC | 18:52 | |
| *** armaan has quit IRC | 18:52 | |
| *** caphrim007 has quit IRC | 18:52 | |
| *** mikal has quit IRC | 18:52 | |
| *** jcoufal has quit IRC | 18:52 | |
| *** sfeole has quit IRC | 18:52 | |
| *** timothyb89 has quit IRC | 18:52 | |
| *** Douhet has quit IRC | 18:52 | |
| *** kaiokmo has quit IRC | 18:52 | |
| *** SergeyLukjanov has quit IRC | 18:52 | |
| *** rkukura has quit IRC | 18:52 | |
| *** rwsu has quit IRC | 18:52 | |
| *** shoogz has quit IRC | 18:53 | |
| *** dtruong has quit IRC | 18:53 | |
| *** snapiri has quit IRC | 18:53 | |
| *** ekhugen_alt has quit IRC | 18:53 | |
| *** hrubi has quit IRC | 18:53 | |
| *** jmccrory has quit IRC | 18:53 | |
| *** weshay_pto has quit IRC | 18:53 | |
| *** rkukura_ is now known as rkukura | 18:53 | |
| *** SergeyLukjanov2 is now known as SergeyLukjanov | 18:53 | |
| *** pcichy_ is now known as pcichy | 18:53 | |
| *** Douhet has joined #openstack-infra | 18:53 | |
| *** shoogz has joined #openstack-infra | 18:53 | |
| *** jmccrory_ is now known as jmccrory | 18:53 | |
| *** weshay has joined #openstack-infra | 18:54 | |
| *** numans_ has joined #openstack-infra | 18:58 | |
| *** rwsu has joined #openstack-infra | 18:59 | |
| *** lbragstad has joined #openstack-infra | 19:00 | |
| clarkb | meeting time | 19:00 |
| *** kaiokmo has joined #openstack-infra | 19:00 | |
| *** numans has quit IRC | 19:00 | |
| *** armaan_ has quit IRC | 19:02 | |
| *** armaan has joined #openstack-infra | 19:02 | |
| *** dhajare_ has joined #openstack-infra | 19:03 | |
| *** rlandy|rover|brb is now known as rlandy|rover | 19:03 | |
| *** Guest32198 is now known as melwitt | 19:06 | |
| *** armaan has quit IRC | 19:08 | |
| *** numans_ has quit IRC | 19:10 | |
| *** rossella_s has quit IRC | 19:10 | |
| *** dave-mccowan has quit IRC | 19:12 | |
| *** rossella_s has joined #openstack-infra | 19:14 | |
| *** numans has joined #openstack-infra | 19:16 | |
| *** markvoelker has quit IRC | 19:18 | |
| *** dpawlik has joined #openstack-infra | 19:19 | |
| *** markvoelker has joined #openstack-infra | 19:19 | |
| *** hasharAway has quit IRC | 19:21 | |
| *** markvoelker has quit IRC | 19:22 | |
| *** Guest888 has joined #openstack-infra | 19:23 | |
| *** dpawlik has quit IRC | 19:24 | |
| openstackgerrit | Brian Rosmaita proposed openstack-infra/zuul-jobs master: WIP - Handle -/_ ambiguity in package names https://review.openstack.org/571005 | 19:24 |
| *** Guest888 has quit IRC | 19:27 | |
| *** lifeless has joined #openstack-infra | 19:33 | |
| *** dhinesh has quit IRC | 19:36 | |
| *** Guest888 has joined #openstack-infra | 19:36 | |
| *** armaan has joined #openstack-infra | 19:39 | |
| *** Guest888 has quit IRC | 19:45 | |
| beisner | hi dhellmann - can you let me know the next steps for this pair of project reviews? https://review.openstack.org/#/c/566958/ https://review.openstack.org/#/c/566956/ iiuc, we need wf+1 on the project-config change, then it's all set. | 19:46 |
| *** beagles is now known as beagles_biab | 19:48 | |
| *** felipemonteiro_ has quit IRC | 19:49 | |
| *** markvoelker has joined #openstack-infra | 19:49 | |
| *** markvoelker_ has joined #openstack-infra | 19:50 | |
| *** felipemonteiro has joined #openstack-infra | 19:51 | |
| *** Guest888 has joined #openstack-infra | 19:52 | |
| *** dhinesh has joined #openstack-infra | 19:53 | |
| *** eharney has quit IRC | 19:53 | |
| *** markvoelker has quit IRC | 19:54 | |
| clarkb | alright I'm going to take a short break then work on writing these emails I have committed to | 19:55 |
| *** Guest888 has quit IRC | 19:55 | |
| *** xarses_ has joined #openstack-infra | 19:56 | |
| dhellmann | beisner : yes, we need the project-config change to land then we can re-workflow the governance change | 19:58 |
| *** xarses has quit IRC | 19:59 | |
| *** harlowja has joined #openstack-infra | 20:00 | |
| wolverineav | hi! i'm observing a change in infra that may be causing zuul gate failure for the neutron plugin networking-bigswitch project. all PRs across all branches are failing with the error "cmd2 requires Python '>=3.4' but the running Python is 2.7.6". locally running tox doesn't fail, only when making a change request upstream. sample of failing PR: https://review.openstack.org/#/c/571009/ | 20:01 |
| *** Guest888 has joined #openstack-infra | 20:02 | |
| dhellmann | wolverineav : see https://review.openstack.org/570811 where the requirements team is trying to mitigate that | 20:02 |
| dhellmann | wolverineav : you can reach them in #openstack-requirements if you have questions about the status of that effort | 20:03 |
| wolverineav | ah, thanks dhellmann! | 20:04 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-openstack_infra_spec_helper master: Use system-config script to install puppet https://review.openstack.org/481943 | 20:07 |
| *** Guest888 has quit IRC | 20:08 | |
| *** jmorgan1 has quit IRC | 20:09 | |
| *** dhinesh has quit IRC | 20:09 | |
| clarkb | wolverineav: dhellmann the reason it is failing in our systems is we build site local wheels for our deps | 20:12 |
| clarkb | we've worked around it by excluding the bad versions in requirements lists but infra should likely also clean up that site local mirror | 20:13 |
| fungi | clarkb: find /afs/.openstack.org/mirror/wheel/ -name "*cmd2*0.9.0*" dosn't turn up any | 20:13 |
| fungi | i just started to dig into cleaning them up | 20:13 |
| clarkb | hrm | 20:13 |
| dhellmann | clarkb : ah, that's good to know, thanks | 20:13 |
| clarkb | it is breaking on 0.9.1 now http://logs.openstack.org/09/571009/1/check/openstack-tox-pep8/3e45738/job-output.txt.gz#_2018-05-29_19_49_02_793492 | 20:14 |
| fungi | oh, it's finding 0.9.1 | 20:14 |
| fungi | yep | 20:14 |
| clarkb | I wonder if that magic to make pip select based on python version only works if you run cheeseshop/warehouse | 20:14 |
| zigo | fungi: My ssh key is there: http://thomas.goirand.fr/ssh-pubkey.txt | 20:14 |
| clarkb | and a straight mirror won't do it, in which case updating our requirements lists/constraints is the way forward | 20:14 |
| *** ykarel|away has quit IRC | 20:14 | |
| zigo | The VM should be ready right now ... | 20:14 |
| wolverineav | clarkb: gotcha! i was gonna ping dhellmann - since this (https://github.com/openstack/cliff/commit/73a5d6529f16c08afbe42bd39f8eb7531d7c8ac8) is the closest change that looked like it would affect. the fix PR makes the problem clear :) | 20:16 |
| fungi | does zuul autohold not set the hold reason in nodepool's node table any longer? or does nodepool list simply not print it? | 20:18 |
| clarkb | nodepools printing is far less verbose by default now | 20:19 |
| clarkb | there should be a long form flag for outoput though | 20:19 |
| fungi | --detail! | 20:20 |
| fungi | thanks clarkb | 20:20 |
| *** Guest888 has joined #openstack-infra | 20:21 | |
| fungi | zigo: ssh root@213.32.75.46 | 20:22 |
| fungi | and let me know once you're done poking around on it so i can delete it | 20:22 |
| zigo | fungi: Cheers ! | 20:22 |
| *** jmorgan1 has joined #openstack-infra | 20:22 | |
| zigo | I'm in. | 20:22 |
| fungi | i don't see anything in /etc/apt overriding the default priority for backports... i wonder if the way we're using reprepro to mirror the backports set is losing the default priority 100 for it? | 20:25 |
| fungi | we may need to set that explicitly in the reprepro config so that it doesn't compete with normal stretch packages | 20:26 |
| *** pcichy has quit IRC | 20:27 | |
| *** pcichy has joined #openstack-infra | 20:28 | |
| dhellmann | wolverineav : that change in cliff should only affect the lower-constraints job, not anything that uses cliff | 20:28 |
| wolverineav | dhellmann: yep. i realized as soon as you pointed out the fix | 20:29 |
| *** beagles_biab is now known as beagles | 20:29 | |
| dhellmann | wolverineav : ack, just making sure :-) | 20:30 |
| *** pcichy has quit IRC | 20:32 | |
| *** camunoz has quit IRC | 20:34 | |
| *** r-daneel has quit IRC | 20:34 | |
| *** r-daneel has joined #openstack-infra | 20:34 | |
| *** dhinesh has joined #openstack-infra | 20:35 | |
| zigo | fungi: Good point, let me see with another thing that's backported. | 20:36 |
| *** dpawlik has joined #openstack-infra | 20:38 | |
| zigo | fungi: I just tried, and indeed, that's the case. :/ | 20:39 |
| *** kgiusti has left #openstack-infra | 20:39 | |
| fungi | zigo: yeah, so probably we can just add a line or two in our bandersnatch config to set a default package priority 100 for backports and then it'll be fixed the next time the index is updated | 20:39 |
| *** Guest888 has quit IRC | 20:39 | |
| * zigo tries something | 20:39 | |
| fungi | er, not bandersnatch. reprepro | 20:40 |
| * fungi is trying to troubleshoot too many mirroring tools at the same time | 20:40 | |
| *** VW_ has joined #openstack-infra | 20:40 | |
| fungi | where "too many" is any number greater than one | 20:40 |
| *** dhinesh has quit IRC | 20:40 | |
| zigo | fungi: If I set the official debian's stretch-backport instead of http://mirror.gra1.ovh.openstack.org/debian, then I get a very different result with apt-cache policy. | 20:40 |
| zigo | fungi: My guess is that the metadata of the mirror is wrong. | 20:41 |
| zigo | fungi: I'm checking for that now. | 20:41 |
| *** dpawlik has quit IRC | 20:43 | |
| zigo | fungi: Look at the differences in the Release files: http://mirror.gra1.ovh.openstack.org/debian/dists/stretch-backports/Release and http://ftp.fr.debian.org/debian/dists/stretch-backports/Release | 20:43 |
| *** VW has quit IRC | 20:43 | |
| zigo | My guess is that the metadata in the mirror are missing, so it fools apt. | 20:43 |
| zigo | Origin: Debian Backports | 20:44 |
| zigo | Label: Debian Backports | 20:44 |
| zigo | Suite: stretch-backports | 20:44 |
| zigo | Codename: stretch-backports | 20:44 |
| zigo | All that must be in the mirrored thing, IMO. | 20:44 |
| zigo | Especially "suite", maybe. | 20:44 |
| zigo | Let me ask in #debian-ftp, maybe someone will know for sure. | 20:45 |
| *** trown is now known as trown|outtypewww | 20:45 | |
| *** VW_ has quit IRC | 20:45 | |
| *** priteau has joined #openstack-infra | 20:45 | |
| *** Guest888 has joined #openstack-infra | 20:46 | |
| fungi | i wouldn't be surprised if reprepro documentation says what to do when mirroring the backports set | 20:46 |
| ianw | fungi / zigo : hmm, we don't mention the suite at all in the config | 20:49 |
| *** dhinesh has joined #openstack-infra | 20:50 | |
| ianw | https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/reprepro/debuntu-updates | 20:50 |
| ianw | for reference | 20:50 |
| zigo | fungi: ianw: https://wiki.debian.org/DebianRepository/Format#NotAutomatic_and_ButAutomaticUpgrades | 20:50 |
| zigo | I think that's our issue. | 20:51 |
| fungi | agreed, i guess that's how the default priority 100 for debian backports gets inferred | 20:52 |
| *** Guest888 has quit IRC | 20:53 | |
| zigo | ianw: I don't see any reference to backports there. | 20:53 |
| *** dhajare_ has quit IRC | 20:55 | |
| ianw | zigo: sorry, i've pulled up the wrong file -> https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/reprepro/distributions.debian.erb | 20:55 |
| *** Guest888 has joined #openstack-infra | 20:55 | |
| ianw | i'd agree we should pass those options through https://manpages.debian.org/stretch/reprepro/reprepro.1.en.html | 20:56 |
| zigo | ianw: Does it work if we just add the flags: | 20:56 |
| zigo | NotAutomatic: yes | 20:56 |
| zigo | ButAutomaticUpgrades: yes | 20:56 |
| zigo | to that template? | 20:56 |
| *** dhinesh_ has joined #openstack-infra | 20:56 | |
| ianw | yes, and probably Suite: as well? | 20:56 |
| ianw | it looks like reprepro passes all through unaltered | 20:57 |
| zigo | Right. | 20:57 |
| zigo | Let me do a patch then. | 20:57 |
| ianw | Label: is there too | 20:58 |
| ianw | zigo: cool. i can run a manual update quickly | 20:58 |
| ianw | with the patch | 20:58 |
| zigo | :) | 20:58 |
| ianw | do we do this already for ubuntu, or we've just never noticed? | 20:59 |
| ianw | yeah, we already set these there -> https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/reprepro/distributions.ubuntu.erb | 20:59 |
| *** dhinesh has quit IRC | 21:00 | |
| *** jesslampe has quit IRC | 21:01 | |
| *** jesslampe has joined #openstack-infra | 21:01 | |
| fungi | so simply overlooked for the debian one | 21:02 |
| fungi | that's reassuring at least | 21:02 |
| rosmaita | fungi clarkb mordred: when you have some time, let me know what you think of https://review.openstack.org/#/c/571005/ -- i think it fixes that issue we were discussing earlier, which I wrote up as https://bugs.launchpad.net/glance-store/+bug/1774030 | 21:02 |
| openstack | Launchpad bug 1774030 in glance_store "metadata/name in setup.cfg inconsistent with release name" [Undecided,New] - Assigned to Brian Rosmaita (brian-rosmaita) | 21:02 |
| fungi | ianw: i wouldn't be surprised if we need to tweak the arm64 miage builds to explicitly install a backport kernel once that's in place | 21:04 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Make puppet 4 puppet-apply jobs voting https://review.openstack.org/571022 | 21:04 |
| fungi | s/miage/image/ | 21:04 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement a Runc driver https://review.openstack.org/535556 | 21:05 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/system-config master: Fix Debian Release file headers https://review.openstack.org/571023 | 21:05 |
| zigo | ianw: There you go. | 21:06 |
| ianw | fungi: hmm, that's a good point, i'll watch that | 21:06 |
| clarkb | summit recap sent | 21:06 |
| *** jesslampe has quit IRC | 21:06 | |
| zigo | ianw: fungi: Probably a -t stretch-backport will be needed indeed. | 21:06 |
| *** eharney has joined #openstack-infra | 21:06 | |
| TheJulia | Are we aware of any issues with storyboard at present? | 21:06 |
| zigo | -t stretch-backports (with s) | 21:06 |
| fungi | TheJulia: plenty... you'll have to be more specific | 21:07 |
| TheJulia | fungi: Pages not loading | 21:07 |
| TheJulia | s/pages/nothing/ | 21:07 |
| TheJulia | s/not// | 21:07 |
| fungi | any particular pages? i'm browsing it fine | 21:07 |
| TheJulia | freaky... okay | 21:07 |
| fungi | though not logged in. let me see if that makes a difference | 21:07 |
| TheJulia | the main page and https://storyboard.openstack.org/#!/story/2002093 | 21:08 |
| fungi | yeah, i'm happily (and fairly quickly) loading all of those even when logged in | 21:08 |
| TheJulia | hmm | 21:08 |
| TheJulia | okay | 21:08 |
| TheJulia | maybe it is just time to reboot | 21:08 |
| TheJulia | or restart or whatever | 21:08 |
| corvus | TheJulia: shift-reload? (maybe some cached js weirdness?) | 21:09 |
| TheJulia | bbingo | 21:09 |
| fungi | yeah, that could be it | 21:09 |
| TheJulia | yup, must have been something cached | 21:09 |
| fungi | we rolled forward a fairly massive webclient commit backlog during the summit | 21:09 |
| *** slaweq has quit IRC | 21:10 | |
| *** slaweq has joined #openstack-infra | 21:11 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/project-config master: Remove beaker test on trusty for infracloud https://review.openstack.org/571024 | 21:11 |
| *** edmondsw has quit IRC | 21:13 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Remove trusty beaker job template https://review.openstack.org/571025 | 21:14 |
| fungi | rosmaita: https://www.python.org/dev/peps/pep-0440/#allowing-underscore-in-normalization has a very brief mention of the phenomenon | 21:14 |
| *** Guest888 has quit IRC | 21:14 | |
| zigo | fungi: Can you approve https://review.openstack.org/571023 so that ianw can run the mirror script? | 21:15 |
| fungi | rosmaita: and https://setuptools.readthedocs.io/en/latest/pkg_resources.html#parsing-utilities entry on the safe_name() method is likely relevant | 21:15 |
| fungi | by way of background | 21:15 |
| rosmaita | fungi: ty | 21:15 |
| *** ssbarnea_ has quit IRC | 21:16 | |
| zigo | Weird, looks like the Redis puppet module creates /etc/systemd/system/redis.service but there's also /lib/systemd/system/redis-server.service which is identical. :/ | 21:17 |
| ianw | zigo: once it merges, give it ~15 minutes to be deployed by puppet and then we can re-run mirror | 21:17 |
| fungi | zigo: i bet that's cruft from dealing with an earlier version of the package which didn't have a unit file | 21:17 |
| zigo | Ah no, it's just a symlink. | 21:19 |
| fungi | surprisingly unnecessary | 21:19 |
| fungi | doesn't systemd already find the one installed at /lib/systemd/system/redis-server.service ? | 21:19 |
| fungi | oh, or is that an attempt to alias it so that a puppet service entry can call it by the name "redis" instead of "redis-server"? | 21:20 |
| *** jcoufal_ has quit IRC | 21:20 | |
| clarkb | but you can only use one because the port is the same on both | 21:21 |
| clarkb | and systemd doesnt know they are the same? | 21:21 |
| zigo | fungi: Yeah, I think so. | 21:21 |
| zigo | clarkb: As it uses a pid file, systemd may find that the service is already started or something. | 21:21 |
| zigo | That's still quite bad, but it should work. | 21:21 |
| zigo | Using PID files with systemd is silly anyway... | 21:22 |
| zigo | :) | 21:22 |
| *** wolverineav has quit IRC | 21:27 | |
| *** r-daneel has quit IRC | 21:28 | |
| *** r-daneel has joined #openstack-infra | 21:28 | |
| *** wolverineav has joined #openstack-infra | 21:28 | |
| fungi | agreed | 21:29 |
| *** wolverineav has quit IRC | 21:32 | |
| openstackgerrit | Merged openstack-infra/system-config master: Fix Debian Release file headers https://review.openstack.org/571023 | 21:40 |
| *** felipemonteiro has quit IRC | 21:41 | |
| *** sree has joined #openstack-infra | 21:49 | |
| *** sree has quit IRC | 21:53 | |
| *** jtomasek has quit IRC | 21:53 | |
| efried | dhellmann, fungi, mordred: Is there any reason for a thing to be in lower-constraints.txt if it's not in requirements.txt or test-requirements.txt? | 21:55 |
| fungi | efried: i suppose if it's a transitive dependency of something which is in requirements.txt, tehre might be some use in tracking the earliest version you can operate with | 21:56 |
| dhellmann | efried : you usually want to constrain something to a version compatible with other things in the constraints list. Otherwise you'd test with really-old A and really-new B | 21:56 |
| dhellmann | esp. if A depends on B without capping that dependency (which is pretty standard) | 21:56 |
| efried | And I can't rely on B having a req on a reasonable version of A? | 21:57 |
| fungi | nope, mainly because it's hard for the author of B to predict the future version of A which will become incompatible | 21:57 |
| efried | okeydokey. Keeping things like snowballstemmer (wtf is that??) | 21:58 |
| fungi | i'm afraid to even look | 21:58 |
| fungi | hopefully it's only including transitive dependencies and direct dependencies, not completely unrelated packages | 21:58 |
| fungi | because that, yes, would be pointless | 21:59 |
| efried | I do know it's caused me hell trying to build venvs. Something's wrong with pip on my setup where installing that guy will freeze unless I use --no-cache-dir. | 21:59 |
| fungi | i would keep incrementing that one until the breakage stops | 21:59 |
| fungi | in that case | 21:59 |
| efried | finally figured out how to do that in a global conf file so I don't need to update tox.ini (and then forget to undo it) | 21:59 |
| efried | well, apparently I'm the only one who has that problem. | 22:00 |
| efried | It freezes on the download. | 22:00 |
| fungi | oh, ick. are you on a work network? could be a proxy or something trying to do content inspection? | 22:00 |
| efried | I happen to be VPN'd, but I don't think that one goes through the vpn (and I wanna say I've had the same issue even when not VPN'd) | 22:01 |
| clarkb | speaking of, ianw thinking about the zk connection in linaro I wonder if switching that to ssl would help it just like it did for http | 22:01 |
| efried | Speaking of ssl, is the cert on git.o.o bad? I get ssl errors trying to run pip under py2 (but not py3??) with -e/-r to git.o.o | 22:02 |
| *** tosky has quit IRC | 22:02 | |
| fungi | efried: i gather some older python 2 interpreters fail to perform sni | 22:03 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Remove trusty beaker job template https://review.openstack.org/571025 | 22:03 |
| clarkb | fungi: have you written a change to change the order of teh vhosts yet to see if that fixes it for git.o.o? | 22:03 |
| clarkb | if not I can do that really quickly because addressing that for existing users would be nice | 22:03 |
| ianw | clarkb: i had actually just assumed it was using some sort of ssl | 22:04 |
| fungi | oh, not yet. need to figure out how to tell it to adjust the run-parts priority on the vhost config | 22:04 |
| clarkb | ianw: I don't think it is :/ | 22:04 |
| fungi | efried: as clarkb points out, we're going to try to change the load order of the vhosts there to make sure git.openstack.org comes first, on a hunch that will make it assumed when non-sni requests come in | 22:05 |
| efried | neat. | 22:05 |
| efried | I don't know what sni is. | 22:05 |
| efried | but neat. | 22:05 |
| fungi | server name indication | 22:05 |
| fungi | something like that | 22:05 |
| fungi | modern solution to ssl/tls multi-hosting to avoid needing a different ip address for each site | 22:06 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-openstack_infra_spec_helper master: Use system-config script to install puppet https://review.openstack.org/481943 | 22:06 |
| *** wolverineav has joined #openstack-infra | 22:06 | |
| *** tosky has joined #openstack-infra | 22:06 | |
| fungi | right now they're alphabetized, and theory is that the reports of problems emerged just after we added git.airshipit.org but not after we added git.zuul-ci.org | 22:07 |
| clarkb | you can fix this by either installing requests[security] | 22:07 |
| clarkb | or not using ssl | 22:07 |
| clarkb | or updating python2 to newer python2 | 22:07 |
| *** lifeless has quit IRC | 22:07 | |
| *** priteau has quit IRC | 22:07 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-cgit master: Reduce vhost priority on default site https://review.openstack.org/571034 | 22:09 |
| clarkb | fungi: ^ I don't actually know if that will leave the old 50- prefixed file in place which may cause problems. I also don't know if that will influence non sni client request vhost ordering | 22:09 |
| *** esberglu has quit IRC | 22:10 | |
| fungi | we might want to carefully apply that on just one server which is disabled in haproxy? | 22:11 |
| clarkb | ya | 22:11 |
| clarkb | maybe do the update my hand on a single server to check the ordering and if it fixes that move forward with the puppet | 22:12 |
| clarkb | can openssl s_client make non sni requests? it must be able to | 22:12 |
| clarkb | appears to not do sni by default | 22:14 |
| clarkb | need to use -servername to set the vhost name in s_client. So this is easily testable | 22:15 |
| *** kjackal has quit IRC | 22:15 | |
| clarkb | infra-root thoughts on just moving the 50- vhost file for git.o.o on git08.o.o to 25- prefix and restarting apache? | 22:16 |
| clarkb | then we can test with s_cleint and see if 571034 is worth deploying | 22:16 |
| fungi | clarkb: yeah, -servername is how i'd test it | 22:17 |
| clarkb | fungi: well in this case lack of -servername but ya | 22:17 |
| fungi | right, you want both to note the change (or not) in behavior | 22:17 |
| ianw | zigo / fungi: hmm, i re-ran reprepro and the releases file wasn't updated | 22:18 |
| ianw | zigo / fungi : ohhh, doh moment ... i think nothing had changed since the last run, so it probably didn't get updated | 22:18 |
| fungi | the main reason i suggested applying that change on a server not receiving traffic though is that if it adds a second vhost config without removing the old one and then restarts apache, that may cause apache to fail to start and completely take down all the git servers | 22:18 |
| *** rcernin has joined #openstack-infra | 22:18 | |
| zigo | ianw: Correct. | 22:18 |
| zigo | ianw: fungi: I very much think it'd be much nicer to use archvsync rather than reprepro. | 22:19 |
| clarkb | fungi: ya I was suggesting ignoring puppet for a moment to check if priority chagne will fix it at all. However next step would be doing puppet the way you describe so maybe we just start there | 22:19 |
| * clarkb checks if apache has docs on this | 22:20 | |
| *** camunoz has joined #openstack-infra | 22:20 | |
| zigo | ianw: fungi: https://packages.debian.org/search?keywords=ftpsync <--- If you didn't know, that's the official Debian tool for FTP mirrors. | 22:21 |
| clarkb | "Since the first (default) vhost will be used for any request where the provided server name doesn't match another vhost, it is important that the first vhost have the most restrictive access control..." | 22:21 |
| clarkb | that does imply the priority order would win here | 22:21 |
| *** rossella_s has quit IRC | 22:21 | |
| zigo | It's been packaged "recently" (as in, more than a year ago). | 22:21 |
| *** wolverineav has quit IRC | 22:22 | |
| clarkb | http://httpd.apache.org/docs/2.4/mod/mod_ssl.html#sslstrictsnivhostcheck is another possible option though that will be a bit more forceful to clients | 22:22 |
| clarkb | "If no matching ServerName or ServerAlias is found in the set of virtual hosts containing the most specific matching IP address and port combination, then the first listed virtual host that matches that will be used." I'm fairly convinced this priority change will fix things based on that | 22:23 |
| *** rossella_s has joined #openstack-infra | 22:24 | |
| ianw | zigo: yeah, i think we're probably at the point with reprepro that it's better to have the problems we know about, than take on a new mirroring method and create new problems :) | 22:24 |
| fungi | zigo: i want to say the last time we looked at it, that didn't allow you to properly avoid pulling incomplete in-progress mirror states unless you were configured as a push mirror, so we'd need a separate tool to validate the archive after each update to make sure the indices we have only refer to files we have. we also need a mechanism to delay removal of delisted packages in case a mirror update is | 22:25 |
| fungi | released between when a client does an apt update and an apt install | 22:25 |
| ianw | also i may have vague memories of us not wanting to do full mirrors or something, and we couldn't? | 22:26 |
| zigo | ianw: The issue is that reprepro is *resigning* the repo, and not generating indices correctly (ie: it doesn't download packages first, then indices in a correct order). Reprepro is full of problem. It's not really a mirroring tool per say. | 22:26 |
| fungi | since we have to avoid removing packages which were listed in any prior index in recent history | 22:26 |
| zigo | fungi: Are you sure we're talking about the same tool? :) | 22:26 |
| fungi | zigo: reprepro generating the indices based on the files retrieved is actually what we want, because that guarantees that indices match the file set | 22:27 |
| clarkb | right, this is the major issue with debian mirroring in general | 22:27 |
| clarkb | the only way you can reliably do it is if you are first tier of mirrors and get update notifications | 22:27 |
| clarkb | otherwise your indexes and files can be out of sync | 22:27 |
| clarkb | or you build them from the groupd up like reprepro does | 22:27 |
| fungi | afs vos release is an atomic operation, so the published index and package files all appear at the exact same moment across our mirror network | 22:27 |
| zigo | fungi: ftpsync is what the FTP masters recommand exactly because it doesn't have the issues you're refering to. | 22:27 |
| zigo | It's also a tool written by the Debian ftpmasters. | 22:28 |
| clarkb | zigo: my understanding is it only doesn't have that problem if you get notifications from debian | 22:28 |
| clarkb | zigo: everyone else has this problem | 22:28 |
| *** Guest888 has joined #openstack-infra | 22:28 | |
| zigo | clarkb: Why wouldn't you get the push notifications? | 22:28 |
| fungi | zigo: last i looked it is written by the debian ftp masters for public mirror operators receiving push notification from the master archive | 22:28 |
| clarkb | zigo: because only first teir of mirrors get that | 22:28 |
| fungi | unless somethnig has changed, you have to register as an official mirror to get included in the notifications | 22:29 |
| *** Guest888 has quit IRC | 22:29 | |
| zigo | clarkb: It'd be very surprising to me if Debian was discriminating like this. | 22:29 |
| zigo | clarkb: Have you ever tried registering for getting the notifs? | 22:29 |
| clarkb | zigo: no beacuse to do so you have to be a public mirror | 22:29 |
| clarkb | and I don't think we want to be that | 22:29 |
| fungi | i actually like that we don't have official index signatures in our ci system mirrors because it actively discourages random people from putting them in their configuration and starting to rely on them | 22:30 |
| zigo | Ok, I'll investigate more than, and will let you know if I see something wrong in what you wrote (and will trust you in the mean time). | 22:30 |
| ianw | yeah, that the mirrors aren't signed has been touted as a feature in the past, as it stopped everyone pointing to them | 22:30 |
| clarkb | I think that calebb wrote a tool that will just resync then check integrity in a loop and then once things are good it will mark it as being done | 22:30 |
| ianw | fungi: jinx :) | 22:31 |
| clarkb | so there are other approaches we can take | 22:31 |
| zigo | fungi: Good point, but the issue is that all the repo keys are then completely wrong, and our images don't even have the infra repo keys. | 22:31 |
| zigo | I've seen that the image even has crypto checks disabled. | 22:32 |
| zigo | That's kind of bad ! | 22:32 |
| calebb | clarkb: yeah basically | 22:32 |
| fungi | https://www.debian.org/mirror/push_mirroring | 22:33 |
| calebb | it's kind of a hack, but it's used by at least one public mirror and seems to work | 22:33 |
| clarkb | fungi: ianw zuul is happy with https://review.openstack.org/#/c/571034/ at least. Maybe I should mark it WIP, but we can get reviews then deploy it when we can restrict it to a single git backend that has been removed from haproxy? | 22:34 |
| fungi | https://www.debian.org/mirror/ftpmirror also states "The mirrors commonly start updating around 3:00, 9:00, 15:00 and 21:00 (all times UTC), but these are never fixed times and you should not fixate your mirror on them. Your mirror should update a few hours after one of the main archive mirror pulses. You should check if the site you're mirroring from leaves a time stamp file in their project/trace/ | 22:34 |
| fungi | subdirectory. The time stamp file will be named like that site, and it will contain the completion time of their last mirror update. Add a couple of hours to that time (to be safe) and mirror then." | 22:34 |
| zigo | fungi: Yeah, it's described that you need to be a Tier-1 to be a *PRIMARY* client. | 22:34 |
| zigo | fungi: But you don't have to receive pushes from Debian, it could be from another site that could be a Tier-1. | 22:35 |
| fungi | pushes seem to be the most effective means of figuring out when to update your mirror to avoid ending up with an incomplete/mismatched mirror | 22:35 |
| fungi | not usually a big deal for the stable indices as they get fairly minimal/infrequent updates, but testing and unstable you're still likely to end up with a number of references to nonexistent files if you mirror at the wrong moment from another mirror which is itself in the process of updating | 22:37 |
| *** lamt has joined #openstack-infra | 22:37 | |
| zigo | fungi: What happens is that you have dak (Debian Archive Kit) that does updates 3 times a day, which is why you get 3 pushes per day. | 22:37 |
| clarkb | I went ahead and WIP'd it but I think it likely is the best way forwadr re sni and git.o.o | 22:37 |
| zigo | But the time to run dak depends on many things, like how many new uploads has been done. | 22:37 |
| zigo | Or how much time it will take to run britney2. | 22:38 |
| zigo | etc. | 22:38 |
| fungi | sure, i get why the primary mirrors don't update in perfect sync or at an entirely predictable cadence. we however need to be able to start our mirror updates at arbitrary times and guarantee that once they're done the index corresponds to packages we have mirrored before we vos release that volume update to the public cache network | 22:39 |
| *** dpawlik has joined #openstack-infra | 22:39 | |
| clarkb | even ignoring afs we wouldn't want to mirror out of sync packages and indexes | 22:39 |
| clarkb | and we would want to keep old package files around for a few hours | 22:39 |
| fungi | we do have the atomicity of afs volume updates to rely on, which allows us to not have to care what order we retrieve files in as long as they all end up with the right contents once we're done | 22:40 |
| fungi | since in-progress state doesn't get published | 22:40 |
| * zigo goes to sleep | 22:40 | |
| ianw | also does ftpsync really have much of an idea of not mirroring everything? you can exclude arch's? | 22:40 |
| zigo | ianw: Yeah, you can ! | 22:40 |
| fungi | "The configuration file for ftpsync has ARCH_EXCLUDE and ARCH_INCLUDE settings for this purpose." | 22:41 |
| zigo | Like selective arch and suites... | 22:41 |
| fungi | https://www.debian.org/mirror/ftpmirror#partial | 22:41 |
| zigo | Anyway, hopefully, tomorror reprepro will pickup updates and will auto-fix itself. :P | 22:41 |
| ianw | sorry, i mean yeah arch's, but suites i'm not seeing? | 22:41 |
| zigo | ianw: I'm quite sure you can also select suites, though if you couldn't, that'd be a good thing, as we'd get sid in ! :) | 22:42 |
| clarkb | infra-root I'm going to go ahead and pull git08 out of haproxy and then test it directly with a manual update of the vhost priority using s_client | 22:42 |
| ianw | yeah, i'm not really seeing how to restrict the suites with https://salsa.debian.org/mirror-team/archvsync/blob/master/doc/ftpsync.conf.5.md | 22:43 |
| fungi | clarkb: sgtm | 22:43 |
| *** dpawlik has quit IRC | 22:44 | |
| fungi | ianw: given package pooling deduplicates the suites anyway, if we end up wanting to host a mirror of sid like we've talked about then there's probably not much point in limiting by suite | 22:44 |
| fungi | at the end of the ftpmirror wiki page, it says "If you want to operate a mirror for your own site only, and you need to carry only a subset of suites (such as stable), debmirror might be a good fit for you also." | 22:45 |
| ianw | sure, if we need sid, i guess i just mean staying with the status quo | 22:46 |
| clarkb | ianw: fungi seems to work `openssl s_client -connect git08.openstack.org:4443` compared to `openssl s_client -connect git07.openstack.org:4443` | 22:48 |
| clarkb | note this doesn't test the puppet concern | 22:48 |
| clarkb | but we can disable puppet on 01-07 next then have puppet apply to just 08 | 22:48 |
| clarkb | I will return 08 to its previous state now | 22:48 |
| clarkb | will give you a minute to test it yourselves if you haven't already | 22:49 |
| clarkb | and back to the way it was now | 22:50 |
| clarkb | fungi: ianw should I go ahead and disable them in puppet and approve the chagne now? | 22:51 |
| fungi | clarkb: yeah, seems fine | 22:51 |
| clarkb | disable 01-07 | 22:51 |
| fungi | blacklist 01-07 and make sure the current puppet pass is done before approving | 22:51 |
| fungi | just to be safe | 22:51 |
| fungi | and keep 08 down in haproxy obviously until we're sure all is well with the update | 22:51 |
| clarkb | yup | 22:52 |
| clarkb | the puppet run appears to have ended ~7 minutes ago and I've added 01-07 to the emergency file and 08 is disabled in haproxy | 22:53 |
| clarkb | I'll approve the puppet change now | 22:53 |
| fungi | thanks! | 22:55 |
| clarkb | unfortunately I think we will have to wait for the puppet run after next to see the updated module | 22:56 |
| clarkb | I will be around to watch it this evening | 22:59 |
| *** hongbin has quit IRC | 23:00 | |
| fungi | i'll mostly be around as well, since i have tc office hour coming up 01:00-02:00z | 23:00 |
| *** mriedem has quit IRC | 23:06 | |
| *** wolverineav has joined #openstack-infra | 23:06 | |
| *** lifeless has joined #openstack-infra | 23:10 | |
| *** rajinir has quit IRC | 23:10 | |
| clarkb | I'm actually not seeing us puppet on any of the git backends | 23:10 |
| openstackgerrit | Merged openstack-infra/puppet-cgit master: Reduce vhost priority on default site https://review.openstack.org/571034 | 23:11 |
| clarkb | oh well this is interesting | 23:12 |
| *** gary_perkins has quit IRC | 23:13 | |
| clarkb | localhost puppetmaster puppeting is failing which I think is causing us to skip all the git0* and review.o.o nodes | 23:13 |
| *** ldnunes has quit IRC | 23:13 | |
| ianw | clarkb: let the yak shaving begin! | 23:14 |
| clarkb | (/Stage[main]/Openstack_project::Puppetmaster/File[/etc/ansible/hosts/openstack]) Could not evaluate: Could not retrieve information from environment production source(s) file:/opt/ansible/contrib/inventory/openstack.py | 23:15 |
| clarkb | I'm guessing that file moved | 23:15 |
| *** VW has joined #openstack-infra | 23:16 | |
| clarkb | openstack_inventory.py the new file maybe | 23:16 |
| clarkb | also why | 23:16 |
| clarkb | mordred: ^ can you confirm that we need to update that path? | 23:16 |
| clarkb | that must've just happened over the weekend too? | 23:17 |
| clarkb | ya the commit that added that file is from the 26th | 23:17 |
| clarkb | I don't want to just switch it out under it as this appears to also come with a switch from shade to openstacksdk | 23:18 |
| *** rpioso is now known as rpioso|afk | 23:18 | |
| *** wolverineav has quit IRC | 23:19 | |
| *** gary_perkins has joined #openstack-infra | 23:19 | |
| *** wolverineav has joined #openstack-infra | 23:20 | |
| clarkb | rather than dig too deep today I'm tempted to just leave git08 disabled and then pick this up in the morning when I can debug the ansible side of things. Otherwise I'm worried I may be here until past bed time :) | 23:20 |
| clarkb | #status log git08 currently disabled in git.o.o haproxy. git01-07 are disabled from having puppet run on them in order to roll out reordering of apache vhosts to accomodate non SNI capable clients. Unfortunately changes to ansible openstack inventory script prevent any puppet from running for now. | 23:22 |
| *** lifeless_ has joined #openstack-infra | 23:23 | |
| *** wolverineav has quit IRC | 23:24 | |
| *** lifeless has quit IRC | 23:25 | |
| *** tosky has quit IRC | 23:25 | |
| *** kien-ha has quit IRC | 23:25 | |
| *** VW has quit IRC | 23:33 | |
| *** dhinesh_ has quit IRC | 23:35 | |
| *** dhinesh has joined #openstack-infra | 23:36 | |
| *** dhinesh has quit IRC | 23:38 | |
| mtreinish | infra-root: it looks like mosquitto crashed on firehose01.o.o | 23:38 |
| mtreinish | or at least I'm not able to connect to it | 23:38 |
| mtreinish | my guess is that there was a log rotation again and it's the same sighup bug | 23:39 |
| ianw | mtreinish: there is no mosquitto process running ... | 23:39 |
| ianw | ok, i restarted it | 23:39 |
| fungi | #status log Bypassed zuul on https://review.openstack.org/570811 due to needing a circular fix for the cmd2 environment markers solution | 23:40 |
| fungi | openstackstatus has left us | 23:40 |
| *** felipemonteiro has joined #openstack-infra | 23:41 | |
| mtreinish | ianw: cool, thanks. While you're logged into the machine can you check germqtt and lpmqtt? They have a habit of crashing when mosquitto goes down (https://review.openstack.org/561952 should address that) | 23:41 |
| fungi | yeah, statusbot was running but status logs indicated that it had seen nothing since early saturday | 23:42 |
| *** openstackstatus has joined #openstack-infra | 23:43 | |
| *** ChanServ sets mode: +v openstackstatus | 23:43 | |
| ianw | mtreinish: yeah, germqtt was dead, started it. lpmqtt seems ok? | 23:43 |
| fungi | #status log Restarted statusbot as it seemed to have gotten lost in the midst of Saturday's netsplits | 23:43 |
| fungi | #status log Bypassed zuul on https://review.openstack.org/570811 due to needing a circular fix for the cmd2 environment markers solution | 23:43 |
| mtreinish | phew, it's not the mosquitto downtime for that. Those statusbot patches havent landed yet | 23:43 |
| fungi | it should register those as soon as it's done churning through joins | 23:43 |
| mtreinish | ianw: ok, yeah it's only a fatal bug if the server is down when either tries to send the message. lpmqtt has a pretty long interval. I'm also not convinced it's still getting the emails | 23:44 |
| *** tpsilva has quit IRC | 23:44 | |
| openstackstatus | fungi: finished logging | 23:45 |
| openstackstatus | fungi: finished logging | 23:45 |
| fungi | there we go. all caught up now | 23:45 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: builder: support setting diskimage env-vars in secure configuration https://review.openstack.org/564687 | 23:48 |
| *** stakeda has joined #openstack-infra | 23:49 | |
| *** gary_perkins has quit IRC | 23:49 | |
| *** VW has joined #openstack-infra | 23:50 | |
| *** felipemonteiro has quit IRC | 23:50 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Pin /opt/ansible as source of openstack inventory https://review.openstack.org/571045 | 23:51 |
| clarkb | ianw: fungi ^ that is my low effort attempt at addressing the puppet ansible thing short term | 23:51 |
| clarkb | I also notice that we have a lot of mqtt warnings | 23:51 |
| *** gary_perkins has joined #openstack-infra | 23:51 | |
| clarkb | oh that is because the firehose server was down. Should be happier now | 23:51 |
| fungi | when troubleshooting sessions collide | 23:52 |
| mtreinish | clarkb: yeah we really should do something about the log rotation on firehose01.o.o. Sending the sighup is crashing it pretty reliably (which is infrequent, but still annoying) | 23:52 |
| clarkb | what sends the sighup? logrotate? | 23:54 |
| clarkb | we can do the copy truncate method if so | 23:54 |
| mtreinish | yeah it's logrotate | 23:55 |
| mtreinish | unless this crash was something different. All the recent crashes have been caused by that | 23:55 |
| fungi | well, we have only circumstantial evidence to go on there, but the timing is always really suspicious | 23:56 |
| fungi | i haven't looked at the mosquitto log this time to see if it's still the case | 23:56 |
| mtreinish | fungi: iirc it was pretty clear from the core dump we looked at last time that's where it was failing | 23:56 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add some rationale for reprepro https://review.openstack.org/571046 | 23:56 |
| ianw | clarkb / fungi : ^ i think that captures some of the prior discussion? | 23:57 |
| fungi | oh! right, i forgot i ran it in such a way as to produce an actual coredump | 23:57 |
| fungi | clarkb: on the ansible inventory change, what specifically is the issue with rolling forward? do we need a new release of openstacksdk or something? | 23:57 |
| mtreinish | fungi: https://github.com/eclipse/mosquitto/issues/278#issuecomment-384111492 | 23:57 |
| fungi | yeah, i remember it now | 23:58 |
| fungi | mind like a steel sieve, i have | 23:58 |
| ianw | fungi: will there be a core for the latest failure? ... (looking) | 23:58 |
| clarkb | fungi: the script name changed to openstack_inventory.py which was coupled with converting from shade to openstacksdk. Mostly I don't want to untangle why this couldn't be done in a backward compatible fashion to make it work for us | 23:59 |
| fungi | ianw: i think i ran it in the foreground or something. don't remember what we had to do to enable generating a coredump | 23:59 |
| ianw | May 29 23:39:44 firehose01 mosquitto[20230]: start-stop-daemon: warning: failed to kill 8816: No such process | 23:59 |
| mtreinish | ianw: there probably should be in /var/crash (if I remember how ubuntu/apport does things) | 23:59 |
| ianw | so i guess i thinks it *was* 8816 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!