| rdogerrit | rdo-trunk created rdoinfo master: Bump rdoinfo queens-uc tags to latest upper-constraints https://review.rdoproject.org/r/10306 | 00:06 |
|---|---|---|
| rdogerrit | rdo-trunk proposed rdoinfo master: Promote CBS tags update for newton-testing https://review.rdoproject.org/r/10262 | 00:06 |
| rdogerrit | rdo-trunk proposed rdoinfo master: Promote CBS tags update for ocata-testing https://review.rdoproject.org/r/10263 | 00:07 |
| rdogerrit | rdo-trunk proposed rdoinfo master: Promote CBS tags update for pike-testing https://review.rdoproject.org/r/10264 | 00:08 |
| *** catintheroof has joined #rdo | 00:11 | |
| *** ushkalim has quit IRC | 00:19 | |
| *** ushkalim has joined #rdo | 00:19 | |
| rdogerrit | rdo-trunk created openstack/designate-distgit pike-rdo: Update to 5.0.1 https://review.rdoproject.org/r/10307 | 00:19 |
| *** Son_Goku has quit IRC | 00:20 | |
| *** rcernin has joined #rdo | 00:21 | |
| *** dtrainor has quit IRC | 00:22 | |
| *** gkadam has joined #rdo | 00:23 | |
| *** vnogin has quit IRC | 00:24 | |
| *** gkadam_ has quit IRC | 00:25 | |
| *** catintheroof has quit IRC | 00:32 | |
| *** owlbot` has quit IRC | 00:33 | |
| *** catintheroof has joined #rdo | 00:38 | |
| *** owlbot has joined #rdo | 00:42 | |
| *** catintheroof has quit IRC | 00:42 | |
| *** catintheroof has joined #rdo | 00:44 | |
| *** vnogin has joined #rdo | 00:50 | |
| *** Son_Goku has joined #rdo | 00:53 | |
| *** catintheroof has quit IRC | 00:55 | |
| *** catintheroof has joined #rdo | 00:56 | |
| *** scorcoran_afk has quit IRC | 01:04 | |
| *** vnogin has quit IRC | 01:06 | |
| *** gkadam has quit IRC | 01:07 | |
| *** Son_Goku has quit IRC | 01:12 | |
| *** liujiong has joined #rdo | 01:15 | |
| *** catintheroof has quit IRC | 01:20 | |
| *** fzdarsky_ has joined #rdo | 01:21 | |
| *** catintheroof has joined #rdo | 01:21 | |
| *** Son_Goku has joined #rdo | 01:21 | |
| *** catintheroof has quit IRC | 01:24 | |
| *** fzdarsky|afk has quit IRC | 01:24 | |
| *** yselkowitz has quit IRC | 01:38 | |
| *** rcernin has quit IRC | 01:43 | |
| *** rcernin has joined #rdo | 01:44 | |
| *** Son_Goku has quit IRC | 01:52 | |
| *** catintheroof has joined #rdo | 01:55 | |
| *** catintheroof has quit IRC | 02:00 | |
| *** Son_Goku has joined #rdo | 02:00 | |
| *** yselkowitz has joined #rdo | 02:04 | |
| *** liujiong has quit IRC | 02:18 | |
| *** liujiong has joined #rdo | 02:18 | |
| *** ushkalim has quit IRC | 02:23 | |
| *** Son_Goku has quit IRC | 02:24 | |
| *** catintheroof has joined #rdo | 02:28 | |
| *** catintheroof has quit IRC | 02:33 | |
| *** fragatina has quit IRC | 02:40 | |
| *** fragatina has joined #rdo | 02:45 | |
| *** trozet has joined #rdo | 02:47 | |
| *** fragatina has quit IRC | 02:50 | |
| *** Son_Goku has joined #rdo | 02:51 | |
| *** Son_Goku has quit IRC | 02:59 | |
| *** shreshtha has joined #rdo | 03:07 | |
| *** gvrangan has joined #rdo | 03:08 | |
| *** trozet has quit IRC | 03:11 | |
| *** ushkalim has joined #rdo | 03:14 | |
| *** ihrachys has quit IRC | 03:17 | |
| *** paragan has joined #rdo | 03:18 | |
| *** Son_Goku has joined #rdo | 03:21 | |
| *** Son_Goku has quit IRC | 03:43 | |
| *** fragatina has joined #rdo | 03:57 | |
| *** fragatina has quit IRC | 03:58 | |
| *** udesale has joined #rdo | 03:58 | |
| *** fragatina has joined #rdo | 03:58 | |
| *** catintheroof has joined #rdo | 04:01 | |
| *** dsneddon has quit IRC | 04:03 | |
| *** catintheroof has quit IRC | 04:05 | |
| *** bstinson has quit IRC | 04:10 | |
| *** ykarel has joined #rdo | 04:10 | |
| *** bstinson has joined #rdo | 04:14 | |
| *** fragatina has quit IRC | 04:16 | |
| *** zoli has quit IRC | 04:19 | |
| *** gkadam has joined #rdo | 04:19 | |
| *** dbecker has quit IRC | 04:20 | |
| *** zoli has joined #rdo | 04:21 | |
| *** gildub has quit IRC | 04:24 | |
| rdogerrit | chkumar246 proposed rdoinfo master: Update tempest to 17.1.0 for pike https://review.rdoproject.org/r/10265 | 04:28 |
| rdogerrit | chkumar246 created openstack/tempest-distgit pike-rdo: Added python-stestr as a explicit BR https://review.rdoproject.org/r/10308 | 04:32 |
| chandankumar | ykarel: https://review.rdoproject.org/r/#/q/topic:tempest_1710 all set for tempest-17.1.0 | 04:34 |
| *** janki has joined #rdo | 04:36 | |
| *** dbecker has joined #rdo | 04:36 | |
| ykarel | chandankumar, ack | 04:37 |
| *** logan- has quit IRC | 04:38 | |
| *** gildub has joined #rdo | 04:40 | |
| *** jatanmalde has joined #rdo | 04:41 | |
| *** logan- has joined #rdo | 04:42 | |
| *** ktdreyer has quit IRC | 04:50 | |
| *** bstinson has quit IRC | 04:51 | |
| *** gvrangan has quit IRC | 04:52 | |
| *** gvrangan has joined #rdo | 04:52 | |
| *** bstinson has joined #rdo | 05:04 | |
| *** jaosorior has joined #rdo | 05:05 | |
| *** Amita has quit IRC | 05:06 | |
| *** ktdreyer has joined #rdo | 05:08 | |
| *** bstinson has quit IRC | 05:19 | |
| *** bstinson has joined #rdo | 05:22 | |
| rdogerrit | chkumar246 created rdoinfo master: Add Zaqar Tempest Plugin https://review.rdoproject.org/r/10309 | 05:23 |
| *** newmember has joined #rdo | 05:31 | |
| *** cshastri has joined #rdo | 05:51 | |
| *** jparrill has joined #rdo | 05:51 | |
| *** jprovazn has joined #rdo | 05:53 | |
| *** iranzo has joined #rdo | 05:56 | |
| *** agurenko has quit IRC | 05:58 | |
| *** mosulica has joined #rdo | 05:59 | |
| *** Son_Goku has joined #rdo | 06:00 | |
| *** aufi has joined #rdo | 06:02 | |
| *** ratailor has joined #rdo | 06:03 | |
| rdogerrit | Merged openstack/networking-cisco-distgit rpm-master: Fix dependency on tempest https://review.rdoproject.org/r/10135 | 06:07 |
| *** Amita has joined #rdo | 06:07 | |
| *** jbadiapa has joined #rdo | 06:10 | |
| *** egonzalez has joined #rdo | 06:12 | |
| *** Son_Goku has quit IRC | 06:14 | |
| *** emalikov has joined #rdo | 06:15 | |
| *** anilvenkata has joined #rdo | 06:15 | |
| *** sbonazzo has joined #rdo | 06:17 | |
| *** gildub has quit IRC | 06:19 | |
| rdogerrit | Sandro Bonazzola proposed config master: Add rubygem-fluent-plugin-elasticsearch to OpsTools https://review.rdoproject.org/r/10272 | 06:21 |
| *** spectr has joined #rdo | 06:22 | |
| *** ratailor has quit IRC | 06:24 | |
| *** gvrangan has quit IRC | 06:26 | |
| *** ushkalim has quit IRC | 06:28 | |
| *** adac has joined #rdo | 06:29 | |
| *** gvrangan has joined #rdo | 06:32 | |
| *** egallen has joined #rdo | 06:36 | |
| *** egallen has left #rdo | 06:36 | |
| *** ratailor has joined #rdo | 06:37 | |
| *** smeyer has joined #rdo | 06:40 | |
| *** hseipp has joined #rdo | 06:42 | |
| *** shreshtha has quit IRC | 06:44 | |
| *** gvrangan has quit IRC | 06:44 | |
| *** Son_Goku has joined #rdo | 06:46 | |
| *** ccamacho has quit IRC | 06:47 | |
| *** pgadiya has joined #rdo | 06:48 | |
| *** adac has quit IRC | 06:53 | |
| *** ratailor has quit IRC | 06:56 | |
| *** ratailor has joined #rdo | 06:57 | |
| *** pblaho has joined #rdo | 07:00 | |
| *** rbowen has joined #rdo | 07:05 | |
| *** ChanServ sets mode: +o rbowen | 07:05 | |
| *** sbulage has joined #rdo | 07:08 | |
| *** florianf has joined #rdo | 07:11 | |
| *** Son_Goku has quit IRC | 07:16 | |
| *** anilvenkata has quit IRC | 07:20 | |
| *** jackNemrod has joined #rdo | 07:20 | |
| *** jatanmalde is now known as jatanmalde|brb | 07:21 | |
| *** anilvenkata has joined #rdo | 07:21 | |
| *** jatanmalde|brb is now known as jatanmalde | 07:22 | |
| *** tesseract has joined #rdo | 07:22 | |
| *** gbraad__ has quit IRC | 07:26 | |
| *** gbraad__ has joined #rdo | 07:27 | |
| *** anshul has joined #rdo | 07:29 | |
| *** jlibosva has joined #rdo | 07:31 | |
| *** gbraad__ has quit IRC | 07:31 | |
| *** cylopez has joined #rdo | 07:33 | |
| *** hewbrocca_afk is now known as hewbrocca | 07:35 | |
| *** rbowen has quit IRC | 07:36 | |
| *** pblaho has quit IRC | 07:37 | |
| *** oidgar has joined #rdo | 07:38 | |
| *** rbowen has joined #rdo | 07:38 | |
| *** ChanServ sets mode: +o rbowen | 07:38 | |
| *** josecastroleon has joined #rdo | 07:41 | |
| *** ratailor has quit IRC | 07:41 | |
| *** pblaho has joined #rdo | 07:42 | |
| *** gbraad__ has joined #rdo | 07:49 | |
| *** toanju has joined #rdo | 07:49 | |
| *** jpena|off is now known as jpena | 07:49 | |
| jpena | good morning | 07:51 |
| *** amoralej|off is now known as amoralej | 07:51 | |
| amoralej | good morning | 07:51 |
| chandankumar | jpena: amoralej number80 \o/ | 07:52 |
| sbonazzo | jpena: amoralej: good morning, can you please have a look at https://review.rdoproject.org/r/#/c/10272/ ? | 07:52 |
| *** rbowen has quit IRC | 07:53 | |
| rdogerrit | Alfredo Moralejo proposed config master: Add rubygem-fluent-plugin-elasticsearch to OpsTools https://review.rdoproject.org/r/10272 | 07:54 |
| *** ratailor has joined #rdo | 07:54 | |
| *** Caterpillar has joined #rdo | 07:55 | |
| jpena | sbonazzo: can you create the repo in github.com/centos-opstools? | 07:56 |
| rdogerrit | chkumar246 created rdoinfo master: Bump rally to 0.10.0 for Pike https://review.rdoproject.org/r/10310 | 07:56 |
| chandankumar | jpena: amoralej https://review.rdoproject.org/r/#/c/10309/ | 07:56 |
| *** vnogin has joined #rdo | 07:56 | |
| *** lebauce has joined #rdo | 07:57 | |
| chandankumar | i need to get this merged https://review.openstack.org/#/c/504899/ for completing zaqar tempest plugin goal | 07:57 |
| chandankumar | so we need zaqar-tempest-plugin package in rdo in order to avoid breakage | 07:57 |
| *** rcernin has quit IRC | 07:58 | |
| sbonazzo | jpena: checking | 07:58 |
| *** flepied has quit IRC | 07:58 | |
| *** rbowen has joined #rdo | 07:58 | |
| *** ChanServ sets mode: +o rbowen | 07:58 | |
| sbonazzo | jpena: looks like it's already there | 07:58 |
| sbonazzo | jpena: https://github.com/centos-opstools/rubygem-fluent-plugin-elasticsearch | 07:58 |
| rdogerrit | Merged config master: Add rubygem-fluent-plugin-elasticsearch to OpsTools https://review.rdoproject.org/r/10272 | 07:59 |
| jpena | mmm how did I search for it then? | 07:59 |
| jpena | anyway | 07:59 |
| sbonazzo | jpena: uh, already merged | 07:59 |
| sbonazzo | jpena: amoralej mrunge thanks | 07:59 |
| mrunge | sbonazzo: you're welcome :) | 08:00 |
| *** rdogerrit has quit IRC | 08:01 | |
| *** MrAbaddon has quit IRC | 08:01 | |
| *** jackNemrod has quit IRC | 08:01 | |
| *** liujiong has quit IRC | 08:02 | |
| *** liujiong has joined #rdo | 08:02 | |
| *** jackNemrod has joined #rdo | 08:03 | |
| *** jackNemrod_ has joined #rdo | 08:07 | |
| *** jackNemrod has quit IRC | 08:07 | |
| *** jackNemrod_ is now known as jackNemrod | 08:07 | |
| *** rdogerrit has joined #rdo | 08:07 | |
| rdogerrit | Merged rdoinfo master: Add Zaqar Tempest Plugin https://review.rdoproject.org/r/10309 | 08:07 |
| chandankumar | amoralej: jpena https://review.rdoproject.org/r/#/q/topic:tempest_1710+status:open another set | 08:07 |
| *** oidgar has quit IRC | 08:08 | |
| chandankumar | this https://review.rdoproject.org/r/10308 will go first | 08:08 |
| rdogerrit | rdo-trunk created config master: Create project for zaqar-tempest-plugin https://review.rdoproject.org/r/10312 | 08:08 |
| *** _lebauce_ has joined #rdo | 08:10 | |
| *** ccamacho has joined #rdo | 08:10 | |
| adarazs|rover | jpena: hi | 08:11 |
| jpena | morning adarazs|rover | 08:11 |
| adarazs|rover | jpena: I checked two ovb periodic job so far that started at 0400UTC and they both failed with could not retrieve env: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-pike/89581a1/console.txt.gz#_2017-10-27_04_16_54_339 | 08:12 |
| adarazs|rover | jpena: can this be a result of increasing our nodepool? | 08:12 |
| jpena | adarazs|rover: mmmm... only if our calculations were wrong, let me check | 08:12 |
| jpena | well, are there more VMs in the nodepool tenant? | 08:13 |
| *** lebauce has quit IRC | 08:13 | |
| rdogerrit | Merged openstack/tempest-distgit pike-rdo: Added python-stestr as a explicit BR https://review.rdoproject.org/r/10308 | 08:15 |
| *** flepied has joined #rdo | 08:15 | |
| adarazs|rover | jpena: I'm not sure it's relevant what we have currently, the problem might have been with the peak. | 08:16 |
| adarazs|rover | jpena: fwiw we have this many nodepool instance: | 08:16 |
| adarazs|rover | $ nova list|grep upstream-centos|wc -l | 08:16 |
| adarazs|rover | 81 | 08:16 |
| rdogerrit | chkumar246 proposed rdoinfo master: Update tempest to 17.1.0 for pike https://review.rdoproject.org/r/10265 | 08:18 |
| *** ktibi has joined #rdo | 08:18 | |
| *** paramite has joined #rdo | 08:18 | |
| jpena | adarazs|rover: it looks like there was an issue with one of the compute nodes, and it is still disabled | 08:18 |
| adarazs|rover | hmmm | 08:19 |
| jpena | since our calculations were quite on the limit, that is probably affecting | 08:19 |
| jpena | let me propose a patch to change it to 100 | 08:19 |
| ktibi | Hi, anyone has packaged the designate dashboard package ??? | 08:19 |
| adarazs|rover | jpena: ack, please do. | 08:19 |
| rdogerrit | Yatin Karel proposed gating_scripts master: List packages which are not installed if rpm -q $LIST fails https://review.rdoproject.org/r/10298 | 08:19 |
| rdogerrit | chkumar246 proposed openstack/tempest-distgit pike-rdo: Use stestr to run tempest unit tests https://review.rdoproject.org/r/10266 | 08:20 |
| rdogerrit | Yatin Karel proposed gating_scripts master: List packages which are not installed if rpm -q $LIST fails https://review.rdoproject.org/r/10298 | 08:21 |
| rdogerrit | Javier Peña created config master: Set max-servers to 100 on the rdo-cloud-tripleo provider https://review.rdoproject.org/r/10313 | 08:22 |
| chandankumar | amoralej: next patch https://review.rdoproject.org/r/#/c/10266/ | 08:22 |
| rdogerrit | Merged rdoinfo master: OVS 2.8 for Queens https://review.rdoproject.org/r/9947 | 08:23 |
| rdogerrit | chkumar246 proposed rdoinfo master: Update tempest to 17.1.0 for pike https://review.rdoproject.org/r/10265 | 08:24 |
| *** martinkopec has joined #rdo | 08:25 | |
| *** lucas-afk is now known as lucasagomes | 08:26 | |
| *** panda|ruck|off is now known as panda|ruck | 08:29 | |
| *** yselkowitz has quit IRC | 08:31 | |
| rdogerrit | Merged openstack/designate-distgit pike-rdo: Update to 5.0.1 https://review.rdoproject.org/r/10307 | 08:32 |
| rdogerrit | Javier Peña proposed rdoinfo master: Bump rdoinfo queens-uc tags to latest upper-constraints https://review.rdoproject.org/r/10306 | 08:33 |
| adarazs|rover | jpena: thanks, submitted it. | 08:33 |
| chandankumar | jpena: amoralej https://review.rdoproject.org/r/10265 and https://review.rdoproject.org/r/10266 | 08:34 |
| rdogerrit | Merged config master: Set max-servers to 100 on the rdo-cloud-tripleo provider https://review.rdoproject.org/r/10313 | 08:34 |
| *** udesale has quit IRC | 08:35 | |
| *** iranzo has quit IRC | 08:36 | |
| *** dmacpher has joined #rdo | 08:37 | |
| *** iranzo has joined #rdo | 08:37 | |
| *** iranzo has quit IRC | 08:37 | |
| *** iranzo has joined #rdo | 08:37 | |
| *** gszasz has joined #rdo | 08:38 | |
| *** vnogin has quit IRC | 08:39 | |
| rdogerrit | Merged openstack/tempest-distgit pike-rdo: Use stestr to run tempest unit tests https://review.rdoproject.org/r/10266 | 08:41 |
| *** colonwq has quit IRC | 08:42 | |
| *** fzdarsky_ is now known as fzdarsky | 08:43 | |
| *** derekh has joined #rdo | 08:45 | |
| rdogerrit | chkumar246 proposed openstack/tempest-distgit pike-rdo: Update tempest-17.1.0 for Pike https://review.rdoproject.org/r/10267 | 08:46 |
| *** ntpttr_ has joined #rdo | 08:50 | |
| *** ykarel is now known as ykarel|lunch | 08:51 | |
| *** gbraad__ has quit IRC | 08:51 | |
| *** pblaho has quit IRC | 08:51 | |
| *** ntpttr has quit IRC | 08:52 | |
| *** udesale has joined #rdo | 08:53 | |
| *** racedo has joined #rdo | 08:54 | |
| *** MrAbaddon has joined #rdo | 08:56 | |
| *** yselkowitz has joined #rdo | 08:57 | |
| *** yselkowitz has quit IRC | 08:58 | |
| *** shreshtha has joined #rdo | 09:00 | |
| *** vnogin has joined #rdo | 09:05 | |
| *** vnogin has quit IRC | 09:10 | |
| *** jparrill has quit IRC | 09:10 | |
| *** jatanmalde is now known as jatanmalde|brb | 09:10 | |
| *** _lebauce_ has quit IRC | 09:10 | |
| *** vnogin has joined #rdo | 09:15 | |
| *** tosky has joined #rdo | 09:17 | |
| *** ykarel|lunch is now known as ykarel | 09:20 | |
| chandankumar | tosky: https://review.rdoproject.org/r/#/q/topic:tempest_1710+status:open | 09:21 |
| chandankumar | 2 remaining | 09:21 |
| tosky | as soon as I can | 09:23 |
| *** lebauce has joined #rdo | 09:24 | |
| *** gfidente has joined #rdo | 09:26 | |
| *** gfidente has quit IRC | 09:26 | |
| *** gfidente has joined #rdo | 09:26 | |
| *** paragan has quit IRC | 09:37 | |
| *** liujiong has quit IRC | 09:39 | |
| *** liujiong has joined #rdo | 09:39 | |
| *** abregman has joined #rdo | 09:42 | |
| *** links has quit IRC | 09:42 | |
| rdogerrit | Merged rdoinfo master: Bump rdoinfo queens-uc tags to latest upper-constraints https://review.rdoproject.org/r/10306 | 09:43 |
| *** ratailor is now known as rtailor | 09:45 | |
| *** liujiong has quit IRC | 09:46 | |
| jpena | I'm going to apply the latest puppet-dlrn changes to the DLRN builder system. That includes setting fallback_to_master=false in the stable/* workers. | 09:48 |
| *** fragatina has joined #rdo | 09:48 | |
| *** apevec has joined #rdo | 09:48 | |
| *** apevec has quit IRC | 09:48 | |
| *** apevec has joined #rdo | 09:48 | |
| jpena | This can cause some issues in the first runs, I'll be watching that and sending fixes to rdoinfo when needed | 09:48 |
| jpena | apevec, number80, amoralej: ^^ | 09:48 |
| amoralej | jpena, ack | 09:49 |
| apevec | I missed, what? | 09:49 |
| tosky | chandankumar: what should be merged first, https://review.rdoproject.org/r/#/c/10265/ or https://review.rdoproject.org/r/#/c/10267/? Also 10265 requires a rebase | 09:49 |
| jpena | <jpena> I'm going to apply the latest puppet-dlrn changes to the DLRN builder system. That includes setting fallback_to_master=false in the stable/* workers. | 09:49 |
| jpena | apevec: ^ | 09:49 |
| amoralej | tosky, https://review.rdoproject.org/r/#/c/10265/ first | 09:49 |
| *** abregman is now known as abregman|afk | 09:49 | |
| tosky | then it requires a rebase | 09:49 |
| rdogerrit | Alfredo Moralejo proposed rdoinfo master: Update tempest to 17.1.0 for pike https://review.rdoproject.org/r/10265 | 09:50 |
| *** dpawlik has joined #rdo | 09:52 | |
| rdogerrit | Yatin Karel proposed gating_scripts master: List packages which are not installed if rpm -q $LIST fails https://review.rdoproject.org/r/10298 | 09:54 |
| *** danpawlik has quit IRC | 09:55 | |
| jpena | apevec: any concern about the change? | 09:55 |
| panda|ruck | jpena: is there a way to understand at what time of day is a trigger attempt less prone to failure ? | 09:56 |
| apevec | jpena, not on builders | 09:56 |
| apevec | jpena, on trunk.rdo there's manual WIP for new deps, which I have yet to push to puppet-dlrn | 09:57 |
| jpena | panda|ruck: I guess that when there's a smaller load | 09:57 |
| apevec | but you will not run it there ? | 09:57 |
| jpena | apevec: no, I was just planning to run it on the builder | 09:57 |
| apevec | +W then | 09:57 |
| panda|ruck | jpena: do you know when there's a smaller load usually diring the day ? | 09:58 |
| *** ktibi has left #rdo | 09:59 | |
| amoralej | apevec, FYI https://bugs.launchpad.net/tripleo/+bug/1727985 is blocking promotions | 10:03 |
| openstack | Launchpad bug 1727985 in tripleo "yum-plugin-priorities is not installed in tripleo image when overcloud packages are installed" [Critical,Triaged] | 10:03 |
| amoralej | moving out of pike-deps will fix that | 10:03 |
| apevec | amoralej, wth | 10:04 |
| adarazs|rover | jpena, panda|ruck: don't we have some statistics (ceilometer?) on rdocloud that could tell us these best times to run stuff? | 10:04 |
| amoralej | apevec, https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-master-upload/72d0be2/undercloud/home/jenkins/overcloud_image_build.log.txt.gz | 10:04 |
| apevec | amoralej, thanks for tracking that down, that's ugly | 10:04 |
| amoralej | it's getting openstack-neutron-lbaas from deps repo instead of delorean one | 10:05 |
| apevec | is that making trouble with OC deploy in the gate? | 10:05 |
| amoralej | in periodic job | 10:05 |
| amoralej | promotion ones | 10:05 |
| amoralej | creating images, yes | 10:05 |
| apevec | ok, but in my oooq change, OC deployment is timing out randomly it seems :( | 10:06 |
| apevec | once in containers-multinode | 10:06 |
| apevec | and latest was in nonha-multinode | 10:06 |
| adarazs|rover | :/ | 10:06 |
| amoralej | yes, i've seen that but i'm unsure what was the issue | 10:06 |
| amoralej | but not related to the one with priorities | 10:06 |
| amoralej | mmm | 10:07 |
| amoralej | it may be | 10:07 |
| amoralej | not, not in multinode | 10:07 |
| jpena | adarazs|rover: not that I'm aware. Last time gnocchi was enabled it killed ceph performance, so it has not been re-enabled since | 10:07 |
| jpena | apevec, amoralej: aha, we have a few packages to fix in rdoinfo -> https://review.rdoproject.org/paste/show/48/ | 10:08 |
| *** Son_Goku has joined #rdo | 10:08 | |
| rdogerrit | rdo-trunk created openstack/ceilometer-distgit rpm-master: openstack-ceilometer: failed to build 2061c16 https://review.rdoproject.org/r/10314 | 10:09 |
| panda|ruck | weird, gnocchi never gave a problem in any of our tests, it always performed wonderfully. Said no tester ever. | 10:09 |
| *** _bsurfer_ has joined #rdo | 10:09 | |
| *** mosulica has quit IRC | 10:10 | |
| apevec | panda|ruck, with ceph backend? | 10:10 |
| adarazs|rover | panda|ruck, jpena: so something that is meant to record performance is impacting performance so much that we can't track performance. isn't that ironic? oh wait, it's not. :) | 10:10 |
| * jpena must refrain from making jokes about "ironic" | 10:11 | |
| panda|ruck | apevec: just kiddin. In general gnocchi has been a CPU killer in many tests, but usually was bug that forced some process to spin frantically | 10:11 |
| *** vnogin has quit IRC | 10:11 | |
| *** daidv has quit IRC | 10:12 | |
| *** bsurfer has quit IRC | 10:12 | |
| rdobot | [sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| Build failure on centos7-master/current: ceilometer: http://trunk.rdoproject.org/centos7-master/report.html | 10:15 |
| *** vnogin has joined #rdo | 10:16 | |
| *** yselkowitz has joined #rdo | 10:18 | |
| *** Goneri has joined #rdo | 10:20 | |
| *** mosulica has joined #rdo | 10:25 | |
| *** Son_Goku has quit IRC | 10:28 | |
| *** vnogin has quit IRC | 10:32 | |
| *** gkadam has quit IRC | 10:34 | |
| rdogerrit | Attila Darazs created config master: Tweak the tripleo periodic pipelines trigger times https://review.rdoproject.org/r/10315 | 10:35 |
| rdogerrit | Attila Darazs proposed config master: Tweak the tripleo periodic pipelines trigger times https://review.rdoproject.org/r/10315 | 10:39 |
| *** vnogin has joined #rdo | 10:41 | |
| rdogerrit | Javier Peña proposed openstack/ceilometer-distgit rpm-master: Remove deprecated storage drivers and binaries https://review.rdoproject.org/r/10314 | 10:42 |
| *** pblaho has joined #rdo | 10:44 | |
| *** vnogin has quit IRC | 10:45 | |
| *** gkadam has joined #rdo | 10:47 | |
| *** rtailor has quit IRC | 10:49 | |
| *** jprovazn has quit IRC | 10:53 | |
| *** Goneri has quit IRC | 10:53 | |
| apevec | amoralej, btw cbs list-tag-history --build openstack-neutron-lbaas-11.0.1-1.el7 | 10:54 |
| apevec | looks weird, it was tagged/untagged back and forth, what happened there? | 10:54 |
| apevec | didn't it go via rdoinfo ? | 10:55 |
| *** DV has quit IRC | 10:55 | |
| *** Goneri has joined #rdo | 10:55 | |
| amoralej | apevec, that's because of graffiti | 10:55 |
| amoralej | that's how graffiti works | 10:56 |
| apevec | ? seems wrong | 10:56 |
| apevec | why is it untagging?? | 10:57 |
| amoralej | apevec, https://github.com/softwarefactory-project/graffiti/blob/master/graffiti/kojiclient.py#L93-L107 | 10:57 |
| amoralej | so | 10:57 |
| amoralej | let's say you ask graffiti to tag buildA to pike-testing | 10:57 |
| amoralej | it will untag it from all pike-* | 10:58 |
| amoralej | and then will tag it to pike-candidate and pike-testing | 10:58 |
| amoralej | that's why i said that we have problems using koji "getlatest" call | 10:58 |
| amoralej | when we tag something in -release | 10:59 |
| apevec | hmm, I missed that impl detail, it's not right | 10:59 |
| amoralej | we untag it from testing and tag it again | 10:59 |
| amoralej | and we may have other newer versions of the same package in -testing at that time | 10:59 |
| *** vnogin has joined #rdo | 11:00 | |
| apevec | I still don't see point why untagging | 11:01 |
| *** egallen has joined #rdo | 11:02 | |
| *** rtailor has joined #rdo | 11:02 | |
| amoralej | i think it's to avoid checking if tag is applied | 11:02 |
| amoralej | would it be a problem if we try to tag a build for a tag already in the build? | 11:02 |
| adarazs|rover | is there a way to reference Launchpad bugs in rdoproject.org changes to get a proper link? | 11:04 |
| adarazs|rover | I mean besides pasting the full URL :) | 11:05 |
| chandankumar | jpena: amoralej https://review.rdoproject.org/r/10265 | 11:06 |
| *** lucasagomes is now known as lucas-hungry | 11:07 | |
| *** pkovar has joined #rdo | 11:10 | |
| *** egallen has quit IRC | 11:10 | |
| *** jparrill has joined #rdo | 11:12 | |
| amoralej | adarazs|rover, not afaik | 11:12 |
| chandankumar | mrunge: apevec jpena https://review.rdoproject.org/r/#/c/10312/ can we get this merged, i need to push zaqar tempest plugin in order to finish it's goal | 11:13 |
| adarazs|rover | amoralej: okay, full url it is then :) | 11:14 |
| *** rtailor has quit IRC | 11:15 | |
| *** Son_Goku has joined #rdo | 11:16 | |
| *** rbowen has quit IRC | 11:17 | |
| *** dyasny has quit IRC | 11:18 | |
| rdogerrit | Attila Darazs proposed config master: Tweak the tripleo periodic pipelines trigger times https://review.rdoproject.org/r/10315 | 11:18 |
| rdogerrit | Merged rdoinfo master: Update tempest to 17.1.0 for pike https://review.rdoproject.org/r/10265 | 11:21 |
| *** emalikov has quit IRC | 11:21 | |
| rdogerrit | rdo-trunk created openstack/tempest-distgit pike-rdo: Update to 17.1.0 https://review.rdoproject.org/r/10316 | 11:22 |
| rdogerrit | Alfredo Moralejo created config master: Create missing stable branches https://review.rdoproject.org/r/10317 | 11:28 |
| *** atoth_ has joined #rdo | 11:30 | |
| *** Goneri has quit IRC | 11:30 | |
| *** Son_Goku has quit IRC | 11:30 | |
| *** hamzy has joined #rdo | 11:30 | |
| *** atoth has quit IRC | 11:33 | |
| *** rtailor has joined #rdo | 11:34 | |
| rdogerrit | Merged config master: Create missing stable branches https://review.rdoproject.org/r/10317 | 11:35 |
| *** Goneri has joined #rdo | 11:36 | |
| *** mburned is now known as mburned_out | 11:36 | |
| *** colonwq has joined #rdo | 11:37 | |
| *** rtailor has quit IRC | 11:37 | |
| *** ratailor has joined #rdo | 11:37 | |
| *** martinkopec has quit IRC | 11:38 | |
| *** vnogin has quit IRC | 11:40 | |
| rdogerrit | chkumar246 proposed rdoinfo master: Bump rally to 0.10.0 for Pike https://review.rdoproject.org/r/10310 | 11:41 |
| *** mburned_out is now known as mburned | 11:42 | |
| chandankumar | tosky: need blessings on this https://review.rdoproject.org/r/#/c/10267/ | 11:42 |
| chandankumar | amoralej: https://review.rdoproject.org/r/#/c/10312/ | 11:43 |
| *** Son_Goku has joined #rdo | 11:45 | |
| *** anilvenkata has quit IRC | 11:51 | |
| *** mosulica has quit IRC | 11:51 | |
| *** vnogin has joined #rdo | 11:51 | |
| *** vnogin has quit IRC | 11:53 | |
| *** rbowen has joined #rdo | 11:53 | |
| *** ChanServ sets mode: +o rbowen | 11:53 | |
| *** vnogin has joined #rdo | 11:54 | |
| *** jayg|g0n3 is now known as jayg | 11:54 | |
| *** flepied has quit IRC | 11:55 | |
| *** lebauce has quit IRC | 11:56 | |
| *** _bsurfer_ has quit IRC | 11:57 | |
| rdogerrit | Merged config master: Create project for zaqar-tempest-plugin https://review.rdoproject.org/r/10312 | 11:57 |
| *** rdogerrit has quit IRC | 11:57 | |
| dmsimard | jpena, amoralej, apevec, number80: I ninja restart jenkins and zuul while they were both very quiet to free up RAM, we have been low for a while | 11:58 |
| jpena | ack | 11:58 |
| *** jpena is now known as jpena|lunch | 11:58 | |
| amoralej | ok | 11:58 |
| *** dtantsur|afk is now known as dtantsur | 11:58 | |
| *** ratailor has quit IRC | 11:58 | |
| *** ratailor has joined #rdo | 11:58 | |
| *** Son_Goku has quit IRC | 11:59 | |
| *** lebauce has joined #rdo | 11:59 | |
| *** athomas has joined #rdo | 12:01 | |
| *** anilvenkata has joined #rdo | 12:04 | |
| *** dprince has joined #rdo | 12:05 | |
| *** flepied has joined #rdo | 12:08 | |
| adarazs|rover | jpena|lunch, amoralej: we're getting "couldn't retrieve env" errors again on the freshly started promotion jobs :( https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-master-upload/203/console | 12:11 |
| adarazs|rover | opening a bug. | 12:11 |
| jpena|lunch | dmanchad: could that have something to do with yesterday's patching? ^^ | 12:11 |
| amoralej | adarazs|rover, ok | 12:12 |
| adarazs|rover | now I see only 50 "upstream-centos" instance up on our tenant. | 12:12 |
| *** Amita has quit IRC | 12:13 | |
| *** lucas-hungry is now known as lucasagomes | 12:14 | |
| amoralej | chandankumar, tosky we have disabled fallback to master in stable dlrn instances and some projects which are not pinned are failing | 12:15 |
| amoralej | https://review.rdoproject.org/paste/show/49/ | 12:15 |
| amoralej | the ones that have not stable/pike and are not pinned in rdoinfo | 12:16 |
| amoralej | i'm not sure what's the best option for tempest plugins | 12:16 |
| adarazs|rover | panda|ruck, jpena|lunch, amoralej: we had something similar previously: https://bugs.launchpad.net/tripleo/+bug/1711913 -- looks like we had some problem with the "te-broker" instance back then. | 12:16 |
| openstack | Launchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Fix released] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 12:16 |
| *** vnogin has quit IRC | 12:16 | |
| adarazs|rover | so I think it's not really a problem with the rdo cloud instance as much as with that broker. | 12:17 |
| adarazs|rover | panda|ruck: do you have access to that machine? | 12:17 |
| panda|ruck | adarazs|rover: yes | 12:17 |
| amoralej | chandankumar, tosky you need to pin those using source-branch | 12:17 |
| amoralej | if you want to keep following master use source-branch: master | 12:17 |
| *** ratailor has quit IRC | 12:17 | |
| chandankumar | amoralej: sure will do that | 12:17 |
| tosky | amoralej: go over there case by case and see which branch should be used | 12:17 |
| panda|ruck | adarazs|rover: but it worked without problem until yesterday | 12:18 |
| panda|ruck | adarazs|rover: I'll check | 12:18 |
| amoralej | or if you want to pin to a commit you can do source-branch: <commit id> | 12:18 |
| *** vnogin has joined #rdo | 12:18 | |
| *** trown|outtypewww is now known as trown | 12:18 | |
| chandankumar | amoralej: https://review.rdoproject.org/r/#/c/10267/ +w missing | 12:18 |
| adarazs|rover | panda|ruck: https://bugs.launchpad.net/tripleo/+bug/1728033 | 12:20 |
| openstack | Launchpad bug 1728033 in tripleo "testenv-client is failing with error "Couldn't retrieve env" on rdo cloud jobs" [Critical,Triaged] | 12:20 |
| *** lebauce has quit IRC | 12:21 | |
| adarazs|rover | trown: can you please take a look at https://review.rdoproject.org/r/10315 ? we again had problems with jobs queuing for too long and missing the 0800UTC runs. | 12:21 |
| adarazs|rover | and extra hour would have helped. | 12:22 |
| amoralej | chandankumar, tosky i'll pin tempest-horizon to the last built commit in newton and ocata, can you check plugins in pike when you have a chance? | 12:22 |
| *** rdogerrit has joined #rdo | 12:23 | |
| rdogerrit | Merged config master: Tweak the tripleo periodic pipelines trigger times https://review.rdoproject.org/r/10315 | 12:23 |
| rdogerrit | chkumar246 created openstack/zaqar-tempest-plugin-distgit rpm-master: Initial import of zaqar tempest plugin https://review.rdoproject.org/r/10318 | 12:24 |
| *** morazi has joined #rdo | 12:24 | |
| *** rhallisey has quit IRC | 12:25 | |
| rdogerrit | Merged openstack/tempest-distgit pike-rdo: Update tempest-17.1.0 for Pike https://review.rdoproject.org/r/10267 | 12:26 |
| tosky | amoralej: I can't guarantee that I will be able to do it before Monday | 12:27 |
| *** pgadiya has quit IRC | 12:28 | |
| amoralej | tosky, ok, just note new commits on those packages will not be built in pike builder | 12:28 |
| adarazs|rover | panda|ruck: yay, the pipeline got recreated so we'll have another shot at things at 1400UTC :) | 12:29 |
| adarazs|rover | panda|ruck: 1.5 hours to figure out what's wrong with the te-broker. | 12:30 |
| *** Amita has joined #rdo | 12:30 | |
| *** jcoufal has joined #rdo | 12:30 | |
| *** Son_Goku has joined #rdo | 12:30 | |
| rdogerrit | chkumar246 proposed openstack/zaqar-tempest-plugin-distgit rpm-master: Initial import of zaqar tempest plugin https://review.rdoproject.org/r/10318 | 12:31 |
| *** rlandy has joined #rdo | 12:32 | |
| dmsimard | adarazs|rover: why not just every 5hrs ? :/ | 12:34 |
| dmsimard | or every 6 rather | 12:34 |
| adarazs|rover | dmsimard: because you can't divide 24 by 5 :] | 12:36 |
| adarazs|rover | dmsimard: and not every 6 because I'm greedy and want to run as often as I can. :) | 12:37 |
| *** gkadam has quit IRC | 12:37 | |
| *** abregman|afk is now known as abregman | 12:38 | |
| *** toure_biab is now known as toure | 12:38 | |
| dmsimard | ¯\_(ツ)_/¯ | 12:40 |
| *** Amita has quit IRC | 12:40 | |
| dmsimard | adarazs|rover: we bumped the amount of nodes to 120 yesterday and reduced nodepool rate limiting, let's see how today goes. | 12:40 |
| adarazs|rover | dmsimard: we had a ton of errors on the 0400UTC and 1200UTC runs with that, sooo it goes bad for now. | 12:41 |
| *** _bsurfer_ has joined #rdo | 12:41 | |
| dmsimard | adarazs|rover: with that ? | 12:42 |
| dmsimard | with what ? | 12:42 |
| adarazs|rover | dmsimard: not sure why we have errors yet from te-broker: https://bugs.launchpad.net/tripleo/+bug/1728033 | 12:42 |
| openstack | Launchpad bug 1728033 in tripleo "testenv-client is failing with error "Couldn't retrieve env" on rdo cloud jobs" [Critical,Triaged] | 12:42 |
| dmsimard | adarazs|rover: a compute node crashed for the tripleo tenant | 12:42 |
| *** Son_Goku has quit IRC | 12:42 | |
| *** abregman is now known as abregman|afk | 12:42 | |
| dmsimard | sent a PM | 12:42 |
| adarazs|rover | dmsimard: some script that sits on our tenant and provides nodes for OVB jobs. and it couldn't provide the nodes. now we reduced the max to to 100 from 120 and it still happened. | 12:43 |
| dmsimard | adarazs|rover: what was the error ? | 12:43 |
| adarazs|rover | panda|ruck: is looking at what's wrong with that "te-broker" -- I have no experience with what's that and have no access. :) | 12:44 |
| rdogerrit | rdo-trunk created openstack/networking-cisco-distgit rpm-master: python-networking-cisco: failed to build 701349c https://review.rdoproject.org/r/10319 | 12:44 |
| adarazs|rover | dmsimard: all I know is in the bug I just linked. ( https://bugs.launchpad.net/tripleo/+bug/1728033 ) | 12:44 |
| openstack | Launchpad bug 1728033 in tripleo "testenv-client is failing with error "Couldn't retrieve env" on rdo cloud jobs" [Critical,Triaged] | 12:44 |
| dmsimard | adarazs|rover: I doubt it was related to quota because there's no quota, and if it was during the night, it couldn't be scheduling failures due to lack of resources because night is calm | 12:44 |
| dmsimard | if it happened around 18:30-21:00 UTC, it's likely due to the compute outage | 12:44 |
| adarazs|rover | dmsimard: yep, I don't think it's quota, but we skipped again the 0800UTC run because the jobs went over 4 hours a bit. | 12:45 |
| dmsimard | I'll look if all VMs are up, I believe jpena|lunch had a look before I was awake | 12:45 |
| dmsimard | "mirror-server" is shutoff, not sure if that should be on | 12:46 |
| dmsimard | rest looks active | 12:46 |
| adarazs|rover | panda|ruck: ^? | 12:46 |
| dmsimard | not sure if I can trust the last_updated field but it says 2017-10-27T11:43:52Z | 12:47 |
| rdogerrit | chkumar246 created openstack/zaqar-distgit rpm-master: Remove zaqar tempest plugin from zaqar project https://review.rdoproject.org/r/10320 | 12:47 |
| dmsimard | so maybe it was shutoff around that time | 12:47 |
| dmsimard | I don't know for sure. | 12:47 |
| chandankumar | EmilienM: amoralej all set for zaqar tempest plugins | 12:49 |
| *** lebauce has joined #rdo | 12:49 | |
| adarazs|rover | dmsimard: jobs failed about ~40 minutes ago with this error, probably the node was on, but it might have some problem. | 12:50 |
| panda|ruck | adarazs|rover: dmsimard I'm getting this from the logs ERROR (ConnectFailure): Unable to establish connection to https://phx2.cloud.rdoproject.org:13000/v2.0/tokens: HTTPSConnectionPool(host='phx2.cloud.rdoproject.org', port=13000): Max retries exceeded with url: /v2.0/tokens (Caused by NewCon | 12:50 |
| panda|ruck | nectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x201f310>: Failed to establish a new connection: [Errno -2] Name or service not known',)) | 12:50 |
| *** jpena|lunch is now known as jpena | 12:50 | |
| *** pchavva has joined #rdo | 12:50 | |
| panda|ruck | unless rdocloud is based on queens, keystone v2 should be there | 12:50 |
| chandankumar | EmilienM: here is the all stuff https://review.rdoproject.org/r/#/q/topic:add-zaqar-tempest-plugin | 12:50 |
| adarazs|rover | hehe :) | 12:50 |
| dmsimard | panda|ruck: that's a DNS resolution error | 12:50 |
| dmsimard | Name or service not known | 12:50 |
| dmsimard | $ curl https://phx2.cloud.rdoproject.org:13000/v2.0 | 12:51 |
| dmsimard | {"version": {"status": "deprecated", "updated": "2016-08-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "https://phx2.cloud.rdoproject.org:13000/v2.0/", "rel": "self"}, {"href": "http://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}} | 12:51 |
| dmsimard | Fix your DNS :) | 12:51 |
| *** jatanmalde|brb has quit IRC | 12:51 | |
| chandankumar | amoralej: i will add the fix the rdoinfo for tempest-plugin in night | 12:51 |
| panda|ruck | ok, who sut down the mirror server yesterday ? | 12:51 |
| amoralej | chandankumar, i think we can wait until monday | 12:52 |
| *** wolverineav has joined #rdo | 12:52 | |
| panda|ruck | what's the latest dns server that is not blocking us ? | 12:52 |
| chandankumar | amoralej: for zaqar? | 12:53 |
| amoralej | chandankumar, no, i meant the pins for tempest plugins in rdoinfo | 12:53 |
| chandankumar | amoralej: ack, no problem | 12:53 |
| dmsimard | panda|ruck: there was a compute node outage, I told adarazs|rover just now | 12:54 |
| dmsimard | panda|ruck: we didn't boot it back up because we didn't know if it was legitimately shut off. | 12:54 |
| dmsimard | We're not familiar with the different servers in that tenant. | 12:54 |
| chandankumar | amoralej: do we need backward compatilibilty for zaqar tempest plugin | 12:55 |
| chandankumar | amoralej: all the related fixes are already up | 12:55 |
| *** amoralej is now known as amoralej|lunch | 12:55 | |
| panda|ruck | ok, we're not realy using the mirror server as a mirror server, but it was nds for the te broker, and the jumphost for the rest of the server | 12:55 |
| *** scorcoran has joined #rdo | 12:56 | |
| rdogerrit | chkumar246 proposed openstack/zaqar-distgit rpm-master: Remove zaqar tempest plugin from zaqar project https://review.rdoproject.org/r/10320 | 12:56 |
| panda|ruck | I'm keeping that shutoff for now, put a floeating ip directly to the te rboker and changing dns | 12:56 |
| panda|ruck | so we can probably get rid of the mirror server in rdocloud | 12:56 |
| dmsimard | panda|ruck: I would probably double check that with sshnaidm|off | 12:56 |
| panda|ruck | then I'll have to change the puppet manifest that configures the te-broker to make changes permanent | 12:57 |
| *** ansiwen has quit IRC | 12:58 | |
| *** pblaho has quit IRC | 13:01 | |
| *** egonzalez has quit IRC | 13:01 | |
| *** pblaho has joined #rdo | 13:02 | |
| *** dmarlin has joined #rdo | 13:03 | |
| *** shreshtha has quit IRC | 13:04 | |
| *** jatanmalde|brb has joined #rdo | 13:04 | |
| *** catintheroof has joined #rdo | 13:04 | |
| panda|ruck | dmsimard: mirror server was meant to copy the functionality for mirror-server in rh1. that mirror server is now copying images from images.r.o, and the promotion is done by the promoter server. Also the puppet configuration doesn't touch resolv conf. I think we should be good to go now. | 13:04 |
| *** dustins has joined #rdo | 13:05 | |
| *** imcleod has joined #rdo | 13:05 | |
| panda|ruck | [root@te-broker log]# ping phx2.cloud.rdoproject.org | 13:05 |
| panda|ruck | PING phx2.cloud.rdoproject.org (38.145.32.1) 56(84) bytes of data. | 13:05 |
| dmsimard | panda|ruck: copying the functionality of the mirror server in rh1 would be pretty useful | 13:06 |
| dmsimard | panda|ruck: if it's like an openstack-infra mirror, we need one | 13:06 |
| dmsimard | we were discussing that yesterday actually | 13:06 |
| dmsimard | we're leeching off of RAX's openstack-infra DFW mirror right now | 13:06 |
| *** shardy has quit IRC | 13:07 | |
| panda|ruck | dmsimard: so images.r.o is not in rdocloud itself ? | 13:08 |
| *** jackNemrod has quit IRC | 13:08 | |
| *** udesale has quit IRC | 13:08 | |
| dmsimard | panda|ruck: it is | 13:09 |
| dmsimard | panda|ruck: but an openstack-infra mirror is something else | 13:09 |
| dmsimard | http://mirror.dfw.rax.openstack.org/ | 13:09 |
| panda|ruck | dmsimard: if we not and we really need that, I'd like to mirror images with something more resilient than a curl on the images link, like we're doing now | 13:09 |
| panda|ruck | dmsimard: I don't thing that is mirroring overclooud images | 13:09 |
| panda|ruck | and the mirror-server was actually offering only those | 13:10 |
| dmsimard | panda|ruck: it's not, but it mirrors CentOS and Ceph packages, etc. | 13:10 |
| panda|ruck | yeah the mirror server was offering only images | 13:10 |
| dmsimard | ok, but there *is* a real mirror in rh1 | 13:10 |
| panda|ruck | no space for anything else actually | 13:10 |
| panda|ruck | if there is , it's not that one. I don't remember seeing a package mirro rin rh1 | 13:11 |
| panda|ruck | I'll check | 13:11 |
| *** Son_Goku has joined #rdo | 13:11 | |
| rdobot | [sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| Build failure on centos7-master/current: ceilometer, networking-cisco: http://trunk.rdoproject.org/centos7-master/report.html | 13:12 |
| *** kgiusti has joined #rdo | 13:13 | |
| dmsimard | panda|ruck: http://mirror.regionone.tripleo-test-cloud-rh1.openstack.org/ | 13:18 |
| *** anilvenkata_ has joined #rdo | 13:18 | |
| *** paragan has joined #rdo | 13:20 | |
| *** ansiwen has joined #rdo | 13:21 | |
| *** anilvenkata has quit IRC | 13:22 | |
| *** scorcoran is now known as scorcoran_mtg | 13:24 | |
| *** jackNemrod has joined #rdo | 13:24 | |
| panda|ruck | dmsimard: ya ok, that is managed by infra, it's not the mirror-server for the images anyway. Not even sure I have access to that. I think pabelanger could help creating something similar for rdocloud | 13:27 |
| *** jmelvin has joined #rdo | 13:28 | |
| *** artom has quit IRC | 13:28 | |
| *** artom has joined #rdo | 13:28 | |
| honza | are there any known issues with dlrn at the moment? getting failures when deploying to rdo cloud | 13:29 |
| *** rbowen has quit IRC | 13:30 | |
| sfbender | Javier Peña created DLRN master: Split rsync in two actions to avoid race condition https://softwarefactory-project.io/r/10040 | 13:31 |
| jpena | honza: the repos are available, what type of failure are you getting? | 13:31 |
| honza | jpena: dlrn hash parsing? | 13:32 |
| jpena | honza: ?? | 13:32 |
| jpena | do you have a link? | 13:32 |
| honza | jpena: that's the last error message, i think it might related to the new nodepool proxy? | 13:33 |
| honza | one sec | 13:33 |
| *** catintheroof has quit IRC | 13:34 | |
| *** Goneri has quit IRC | 13:35 | |
| *** janki has quit IRC | 13:37 | |
| jpena | apevec. number80: https://softwarefactory-project.io/r/10040 should fix a race condition that has affected a few tripleo jobs lately | 13:41 |
| *** Goneri has joined #rdo | 13:41 | |
| jpena | it's not too common, but it's good to fix it | 13:41 |
| honza | jpena: current-triple and current don't have the same baseurl hash | 13:41 |
| jpena | honza: that is expected. "current" is the latest built repo, and "current-tripleo" is the last one that passed CI | 13:42 |
| *** dyasny has joined #rdo | 13:42 | |
| *** catintheroof has joined #rdo | 13:42 | |
| *** flepied has quit IRC | 13:43 | |
| *** Son_Goku has quit IRC | 13:44 | |
| Ng | hey folks - I'm looking at https://ci.centos.org/view/rdo/view/promotion-pipeline/ and wondering what triggers the promotion jobs | 13:44 |
| honza | jpena: this is the error i get https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L37 | 13:44 |
| Ng | (I'm specifically interested in the docker images for the passed-ci tag) | 13:44 |
| jpena | honza: did you get it once or multiple times? I've just sent a patch for review that could fix a race condition we have seen 4 times during the last week | 13:45 |
| honza | jpena: It has happened several times today. In fact, it happens every time for me. | 13:45 |
| jpena | either that, or there's something wrong with $NODEPOOL_RDO_PROXY | 13:45 |
| jpena | then I'm inclined to think it's an error with the proxy | 13:46 |
| *** jatanmalde|brb has quit IRC | 13:46 | |
| honza | jpena: I'm happy to provide additional debug info. But I'm not sure what's helpful. | 13:46 |
| jpena | honza: if we could find out what is the value of $NODEPOOL_RDO_PROXY in your case, that should help | 13:47 |
| jpena | it should be in /etc/ci/mirror_info.sh in the node | 13:47 |
| honza | jpena: https://trunk.rdoproject.org | 13:48 |
| *** spectr has quit IRC | 13:49 | |
| dmsimard | Ng: the container build and promotion process is no longer on ci.centos.org | 13:49 |
| Ng | dmsimard: aha, do you happen to know where it lives? | 13:50 |
| dmsimard | Ng: what's your question? :p | 13:50 |
| jpena | honza: that is strange, it works fine for me (https://review.rdoproject.org/paste/show/50/) | 13:50 |
| jpena | actually, if that failed we'd have everything failing | 13:50 |
| Ng | dmsimard: I'm trying to understand the chain of events that trigger container build/upload | 13:50 |
| *** morazi has quit IRC | 13:52 | |
| *** owalsh has quit IRC | 13:56 | |
| *** amoralej|lunch is now known as amoralej | 13:56 | |
| *** arxcruz is now known as arxcruz|pto | 13:56 | |
| *** flepied has joined #rdo | 13:56 | |
| rdogerrit | Jakub Libosvar created openstack/neutron-distgit rpm-master: Keep code change from upstream as minimal as possible https://review.rdoproject.org/r/10321 | 13:58 |
| *** owalsh has joined #rdo | 13:59 | |
| *** _bsurfer has joined #rdo | 13:59 | |
| *** _bsurfer_ has quit IRC | 14:02 | |
| *** jatanmalde|brb has joined #rdo | 14:03 | |
| dmsimard | Ng: it's a periodic job that builds containers, tests them and if they work, pushes/tags them | 14:03 |
| *** d0ugal_ has joined #rdo | 14:04 | |
| dmsimard | Ng: it's part of the promotion pipeline, a set of jobs that tests the latest trunk repository several times a day | 14:05 |
| *** d0ugal has quit IRC | 14:05 | |
| *** Amita has joined #rdo | 14:05 | |
| amoralej | chandankumar, zaqar changes will break current deployment tools, right? | 14:06 |
| *** tosky has quit IRC | 14:06 | |
| chandankumar | amoralej: https://review.openstack.org/#/q/topic:add-zaqar-tempest-plugin+(status:open+OR+status:merged) | 14:07 |
| chandankumar | amoralej: i have setted all stuff for that | 14:07 |
| chandankumar | amoralej: once package will land, just do a recheck | 14:07 |
| chandankumar | we are all good | 14:07 |
| *** cylopez has quit IRC | 14:07 | |
| *** tosky has joined #rdo | 14:08 | |
| *** spectr has joined #rdo | 14:09 | |
| EmilienM | could we have an alias https://zuul.rdoproject.org/ ? :D | 14:10 |
| EmilienM | adarazs|rover: we already have 5 failing jobs :/ | 14:11 |
| adarazs|rover | EmilienM: yeah, I just wrote on #tripleo :/ | 14:11 |
| adarazs|rover | looks like that te-broker is still not working completely | 14:11 |
| amoralej | chandankumar, we are having problems with promotions and would like to avoid breaking changes | 14:11 |
| adarazs|rover | panda|ruck: maybe we relied on that mirror-server for something else too... | 14:11 |
| amoralej | and changes in tripleo repos upstream can take long to land | 14:12 |
| chandankumar | amoralej: let's wait tille monday then | 14:12 |
| amoralej | chandankumar, why don't add a provides : python-zaqar-tests-tempest in current python-zaqar-tests | 14:12 |
| sfbender | Jakub Ružička proposed rdopkg master: pkgenv: show patches base information https://softwarefactory-project.io/r/10029 | 14:12 |
| amoralej | chandankumar, that way we would be fully backwards compatible and could merge already changes in oooq | 14:12 |
| amoralej | btw, do we need to update puppet-tempest also? | 14:13 |
| chandankumar | amoralej: puppet tempest for poi | 14:13 |
| amoralej | yeah, i just saw it | 14:13 |
| honza | jpena: It looks like my oooq env was stale. I just updated everything, reinstalled all the dependencies, and now it's royally broken. Thanks for looking but at the moment, it doesn't look like an RDO problem. | 14:14 |
| rdogerrit | chkumar246 proposed openstack/zaqar-distgit rpm-master: Remove zaqar tempest plugin from zaqar project https://review.rdoproject.org/r/10320 | 14:14 |
| rdogerrit | chkumar246 proposed openstack/zaqar-distgit rpm-master: Remove zaqar tempest plugin from zaqar project https://review.rdoproject.org/r/10320 | 14:15 |
| chandankumar | amoralej: https://review.rdoproject.org/r/#/c/10320/4/openstack-zaqar.spec@102 it will be provides or requires? | 14:16 |
| *** gfidente has quit IRC | 14:16 | |
| *** ratailor has joined #rdo | 14:17 | |
| amoralej | chandankumar, so the order would be | 14:17 |
| amoralej | 1. just add "Provvides: python-zaqr-tests-tempest" in python-zaqar-tests but not to remove entrypoint | 14:17 |
| amoralej | 2. Merge changes in puppet-tempest and oooq | 14:18 |
| amoralej | 3. add new package python-zaqar-tests-tempest to rdo-trunk for queens and queens-uc | 14:18 |
| amoralej | 4. remove provides from python-zaqar-tests | 14:18 |
| amoralej | and entrypoint | 14:19 |
| amoralej | i think that should work | 14:19 |
| *** itamarjp has joined #rdo | 14:20 | |
| *** gfidente has joined #rdo | 14:20 | |
| chandankumar | amoralej: https://review.openstack.org/#/c/504899/ | 14:20 |
| chandankumar | amoralej: for new pluign entrypoint would be different | 14:21 |
| rdogerrit | rdo-trunk created openstack/ceilometer-distgit rpm-master: openstack-ceilometer: failed to build 995abb6 https://review.rdoproject.org/r/10322 | 14:23 |
| amoralej | chandankumar, ok let's go for it | 14:25 |
| amoralej | but this is going to block promotions | 14:25 |
| amoralej | how urgent is this for zaqar? | 14:26 |
| amoralej | chandankumar, ^ | 14:26 |
| amoralej | mmm | 14:26 |
| Ng | dmsimard: thanks, and that doesn't run on ci.centos.org anymore? I had a look at upstream infra CI config and didn't see an obviously relevant periodic job, which is why I started looking at RDO CI :) | 14:27 |
| amoralej | chandankumar, i still think it's better to merge the "provides" change only first | 14:27 |
| amoralej | let me think | 14:27 |
| amoralej | no, that will fail in the gate | 14:27 |
| *** vnogin has quit IRC | 14:30 | |
| amoralej | chandankumar, oooq gate jobs run using promoted repos | 14:31 |
| amoralej | so, recheck after merging that will not work | 14:32 |
| chandankumar | amoralej: so do i need send provides patch? | 14:32 |
| rdogerrit | Gabriele Cerami proposed rdo-infra/ci-config master: promoter setup: add logrotate policy and install it https://review.rdoproject.org/r/10240 | 14:32 |
| amoralej | no, because we'd need to promote also | 14:32 |
| amoralej | chandankumar, the best way would be to temporarily disable zaqar tests | 14:32 |
| amoralej | so, i think that | 14:33 |
| chandankumar | amoralej: it is disabled in tripleo | 14:33 |
| amoralej | if we remove the entrypoint both in the -tests and in python-zaqar | 14:33 |
| *** vnogin has joined #rdo | 14:33 | |
| amoralej | it will just don't discover the tests and will pass, right? | 14:33 |
| amoralej | chandankumar, ^ is this correct? | 14:34 |
| *** dbecker has quit IRC | 14:35 | |
| *** dbecker has joined #rdo | 14:35 | |
| panda|ruck | is it possible in horizon to search for an instance by IP ? There's a proxy down but I don't remember its name | 14:37 |
| panda|ruck | nevermind, found. | 14:38 |
| *** spectr has quit IRC | 14:39 | |
| *** dbecker has quit IRC | 14:40 | |
| *** dbecker has joined #rdo | 14:40 | |
| amoralej | chandankumar, i think the best option is to ask zaqar team to merge https://review.openstack.org/#/c/504899/ asap | 14:41 |
| chandankumar | EmilienM: ^6 | 14:41 |
| amoralej | and then merge https://review.rdoproject.org/r/#/c/10320/ but without any depends-on | 14:41 |
| amoralej | well, it's not importat | 14:41 |
| amoralej | chandankumar, but patchset 2 | 14:42 |
| amoralej | without the provides | 14:42 |
| amoralej | at that point jobs should pass although zaqar tests will not be executed | 14:42 |
| amoralej | chandankumar, ^ makes it sense? | 14:42 |
| *** sasha2 has quit IRC | 14:43 | |
| *** sasha2 has joined #rdo | 14:43 | |
| chandankumar | amoralej: so i revert to patchset2? | 14:44 |
| amoralej | then we add python-zaqar-tests-tempest, get a new promotion and merge changes in tripleo and puppet-tempest | 14:44 |
| amoralej | chandankumar, yes | 14:44 |
| chandankumar | amoralej: ack | 14:44 |
| amoralej | but remove the depends-on | 14:45 |
| chandankumar | yup | 14:45 |
| amoralej | right | 14:45 |
| amoralej | ps2 didn't have it :) | 14:45 |
| *** toanju has quit IRC | 14:46 | |
| *** josecastroleon has quit IRC | 14:46 | |
| *** adarazs|rover is now known as adarazs|rover|af | 14:46 | |
| *** adarazs|rover|af is now known as adarazs_afk | 14:47 | |
| *** sasha2 has quit IRC | 14:49 | |
| *** sasha2 has joined #rdo | 14:49 | |
| *** abregman_ has joined #rdo | 14:50 | |
| *** abregman|afk has quit IRC | 14:54 | |
| *** toure is now known as toure_biab | 14:57 | |
| *** pblaho has quit IRC | 14:58 | |
| *** toure_biab is now known as toure | 15:00 | |
| *** ihrachys has joined #rdo | 15:00 | |
| *** anilvenkata_ has quit IRC | 15:00 | |
| *** sasha2 has quit IRC | 15:01 | |
| rdogerrit | chkumar246 proposed openstack/zaqar-distgit rpm-master: Remove zaqar tempest plugin from zaqar project https://review.rdoproject.org/r/10320 | 15:02 |
| chandankumar | amoralej: ^^ | 15:02 |
| chandankumar | amoralej: got stuck in a different call | 15:02 |
| chandankumar | amoralej: now good | 15:02 |
| chandankumar | ? | 15:02 |
| *** abregman_ has quit IRC | 15:02 | |
| amoralej | chandankumar, i think so | 15:02 |
| amoralej | but let's wait until zaqar change is to be merged | 15:03 |
| *** smeyer has quit IRC | 15:03 | |
| chandankumar | amoralej: it will fix the setup.cfg issue coming with https://review.openstack.org/#/c/504899/ | 15:03 |
| amoralej | or we may have problems with the entrypoint in the main package | 15:03 |
| amoralej | tripleo job is non-voting | 15:04 |
| amoralej | so zaqar review can be merged | 15:04 |
| chandankumar | amoralej: let see | 15:04 |
| *** iranzo has quit IRC | 15:06 | |
| *** chlong has quit IRC | 15:06 | |
| *** thrash is now known as thrash|biab | 15:06 | |
| chandankumar | EmilienM: amoralej: i would suggest merge both https://review.openstack.org/#/c/504899/ and https://review.rdoproject.org/r/#/c/10320/ together | 15:07 |
| chandankumar | to avoid tempest plugin entrypoint issue | 15:07 |
| amoralej | chandankumar, yeah, that's the right way | 15:07 |
| *** cylopez has joined #rdo | 15:08 | |
| chandankumar | EmilienM: amoralej i have sent my less availabity during november, | 15:08 |
| amoralej | chandankumar, yes i saw it | 15:08 |
| chandankumar | (longggggg vacation) | 15:08 |
| amoralej | chandankumar, lucky man :) | 15:10 |
| * chandankumar is going home after 3 months. | 15:10 | |
| *** tosky has quit IRC | 15:12 | |
| *** dustins has quit IRC | 15:13 | |
| *** jackNemrod has quit IRC | 15:13 | |
| *** rbowen has joined #rdo | 15:13 | |
| *** ChanServ sets mode: +o rbowen | 15:13 | |
| *** jmlowe_ has joined #rdo | 15:14 | |
| *** newmember has quit IRC | 15:15 | |
| chandankumar | Good night guys, see ya on next weekend :-) | 15:15 |
| *** jmlowe has quit IRC | 15:16 | |
| *** jatanmalde|brb is now known as jatanmalde | 15:16 | |
| rdogerrit | Jakub Libosvar created openstack/neutron-distgit pike-rdo: Keep code change from upstream as minimal as possible https://review.rdoproject.org/r/10323 | 15:17 |
| *** scorcoran_mtg is now known as scorcoran | 15:18 | |
| rdogerrit | Alfredo Moralejo proposed rdoinfo master: Promote CBS tags update for pike-testing https://review.rdoproject.org/r/10264 | 15:19 |
| *** links has joined #rdo | 15:19 | |
| *** jbrooks has quit IRC | 15:24 | |
| *** sasha2 has joined #rdo | 15:25 | |
| *** cshastri has quit IRC | 15:25 | |
| *** sbonazzo has quit IRC | 15:25 | |
| *** jbrooks has joined #rdo | 15:26 | |
| pabelanger | panda|ruck: EmilienM: apevec: dmsimard just talking in #rdo that we need somebody to setup a local AFS mirror for tripleo ovb jobs that are running in RDOCloud, we cannot be depending on external mirror (rackspace) and expect jobs in RDO cloud to be working 100% | 15:27 |
| pabelanger | A path forward is to stand up mirror from openstack-infra/system-config, which is ubuntu. Then have somebody work on porting all changes to centos, and push that up into puppet-openstackci. Then we can migrate openstack-infra to that and share a code base | 15:28 |
| pabelanger | was actually #tripleo | 15:30 |
| rdogerrit | Merged rdoinfo master: Bump rally to 0.10.0 for Pike https://review.rdoproject.org/r/10310 | 15:30 |
| panda|ruck | the price if we don't do that is failing job for the time it takes to translate mirror manifest to centos | 15:30 |
| panda|ruck | but we also have to understand whos; going to translate and maintain the manifest | 15:31 |
| pabelanger | right, but depending on rackspace, you are losing your local cache. Which means everything once again depends on the network | 15:31 |
| panda|ruck | look more infra to me, but I'm ok if it improves the success rate of the jobs | 15:31 |
| rdogerrit | rdo-trunk created openstack/rally-distgit pike-rdo: Update to 0.10.0 https://review.rdoproject.org/r/10324 | 15:31 |
| panda|ruck | which is CI team resposibility | 15:31 |
| pabelanger | yes, it will dramatically improve jobs passing rate. This bascially all the work we did in pike upstream, we'd need to do the same in RDOcloud | 15:33 |
| *** gfidente is now known as gfidente|warhw | 15:34 | |
| *** ykarel has quit IRC | 15:34 | |
| pabelanger | another option, allow upstream openstack-infra to run jobs on RDOCloud (donate resources) and we'd need to stand up a mirror for the project, then you'd get it for free. | 15:34 |
| *** hewbrocca is now known as hewbrocca_afk | 15:34 | |
| pabelanger | This would also work well with the idea of bring your own cloud to zuulv3 multi tenant we are discussing. | 15:36 |
| rdogerrit | Merged openstack/neutron-distgit rpm-master: Keep code change from upstream as minimal as possible https://review.rdoproject.org/r/10321 | 15:36 |
| rdogerrit | rdo-trunk created openstack/swift-distgit rpm-master: openstack-swift: failed to build ff2acfe https://review.rdoproject.org/r/10325 | 15:36 |
| rdogerrit | Merged openstack/neutron-distgit pike-rdo: Create destroy-patch-ports systemd service file https://review.rdoproject.org/r/10192 | 15:37 |
| rdogerrit | Merged openstack/neutron-distgit pike-rdo: Keep code change from upstream as minimal as possible https://review.rdoproject.org/r/10323 | 15:37 |
| *** Goneri has quit IRC | 15:39 | |
| *** anshul has quit IRC | 15:41 | |
| *** thrash|biab is now known as thrash | 15:44 | |
| *** adarazs_afk is now known as adarazs | 15:46 | |
| *** adarazs is now known as adarazs|rover | 15:46 | |
| *** jaosorior has quit IRC | 15:48 | |
| *** scorcoran is now known as scorcoran_biab | 15:49 | |
| rdogerrit | Javier Peña proposed openstack/swift-distgit rpm-master: Add man page for container-reconciler.conf https://review.rdoproject.org/r/10325 | 15:50 |
| *** wolverineav has quit IRC | 15:50 | |
| *** wolverineav has joined #rdo | 15:51 | |
| *** rhallisey has joined #rdo | 15:52 | |
| *** derekh has quit IRC | 15:52 | |
| *** vnogin has quit IRC | 15:52 | |
| *** rbowen has quit IRC | 15:52 | |
| *** anshul has joined #rdo | 15:54 | |
| openstackgerrit | Javier Peña proposed openstack/packstack master: Remove --skip-metering-database when calling ceilometer-upgrade https://review.openstack.org/515753 | 15:54 |
| *** Goneri has joined #rdo | 15:55 | |
| *** vnogin has joined #rdo | 15:55 | |
| *** jlibosva has quit IRC | 15:57 | |
| *** artom has quit IRC | 15:58 | |
| *** anshul has quit IRC | 15:58 | |
| *** jatanmalde has quit IRC | 16:04 | |
| *** ratailor has quit IRC | 16:06 | |
| *** itamarjp has quit IRC | 16:07 | |
| amoralej | mwhahaha, wrt puppet-pacemaker for pike, can we pin to the last commit or should we follow master trunk? | 16:09 |
| amoralej | we normally don't follow master in stable repos | 16:10 |
| amoralej | if we want to do it we need to explicit it in rdoinfo | 16:10 |
| rdobot | [sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| Build failure on centos7-master/current: swift, ceilometer, networking-cisco: http://trunk.rdoproject.org/centos7-master/report.html | 16:12 |
| *** lucasagomes is now known as lucas-afk | 16:13 | |
| *** _bsurfer has quit IRC | 16:14 | |
| mnaser | is there somewhere we can see promotion status foor puppet | 16:15 |
| *** anshul has joined #rdo | 16:15 | |
| mnaser | https://review.openstack.org/#/c/515599/ - i assume that is failing because there is no promotion | 16:15 |
| *** vnogin has quit IRC | 16:17 | |
| rdogerrit | rdo-trunk created openstack/vitrage-distgit pike-rdo: Update to 1.8.2 https://review.rdoproject.org/r/10326 | 16:19 |
| *** scorcoran_biab has quit IRC | 16:19 | |
| rdogerrit | rdo-trunk created openstack/vitrageclient-distgit pike-rdo: Update to 1.4.0 https://review.rdoproject.org/r/10327 | 16:19 |
| *** tosky has joined #rdo | 16:19 | |
| *** artom has joined #rdo | 16:21 | |
| *** jbrooks has quit IRC | 16:21 | |
| *** hseipp has quit IRC | 16:21 | |
| *** catintheroof has quit IRC | 16:23 | |
| *** Caterpillar2 has joined #rdo | 16:23 | |
| *** jmlowe_ has quit IRC | 16:23 | |
| *** jbrooks has joined #rdo | 16:24 | |
| *** scorcoran has joined #rdo | 16:24 | |
| *** paragan has quit IRC | 16:25 | |
| *** cylopez has quit IRC | 16:26 | |
| apevec | mnaser, puppet promotion pipeline is https://ci.centos.org/view/rdo/view/weirdo-pipelines/view/weirdo-promote-puppet/ | 16:27 |
| *** catintheroof has joined #rdo | 16:27 | |
| * mnaser bookmarks that | 16:27 | |
| mnaser | thanks apevec | 16:27 |
| *** rhallisey has quit IRC | 16:27 | |
| apevec | https://trunk.rdoproject.org/centos7-master/puppet-passed-ci/ is rather recent | 16:27 |
| *** vnogin has joined #rdo | 16:28 | |
| *** Caterpillar2 has quit IRC | 16:28 | |
| apevec | Puppet (err): Failed to apply catalog: Can't retrieve net-list because Neutron or Keystone API is not available. | 16:29 |
| amoralej | mnaser, no, we are managing that problem | 16:29 |
| *** ccamacho has quit IRC | 16:29 | |
| apevec | which issue is that? | 16:29 |
| amoralej | 2017-10-27 05:59:07 +0000 Puppet (err): Execution of '/bin/yum -d 0 -e 0 -y install python-zaqar-tests-tempest' returned 1: Error: Nothing to do | 16:30 |
| mnaser | dang you're good | 16:30 |
| amoralej | apevec, moving zaqar to external repo | 16:30 |
| mnaser | knew it before i even said | 16:30 |
| mnaser | :P | 16:30 |
| mnaser | ooh | 16:30 |
| mnaser | i did mentiono that issue | 16:30 |
| mnaser | its friday | 16:30 |
| amoralej | :) | 16:30 |
| amoralej | apevec, https://review.rdoproject.org/r/#/c/10320/ we need to wait for upstream change and merge that | 16:31 |
| amoralej | then we can move puppet-tempest and oooq to the new package | 16:31 |
| apevec | but why was python-zaqar-tests-tempest change pushed ? | 16:32 |
| amoralej | it was WIP from chandankumar | 16:32 |
| *** gvrangan has joined #rdo | 16:32 | |
| jpena | apevec: just the project creation has been pushed. The spec is still under review | 16:32 |
| apevec | WIP which merged? | 16:32 |
| amoralej | apevec, which one was merged? | 16:32 |
| *** gvrangan has quit IRC | 16:33 | |
| jpena | apevec: https://review.rdoproject.org/r/#/q/topic:add-zaqar-tempest-plugin | 16:33 |
| amoralej | apevec, https://review.openstack.org/#/c/515599/ | 16:33 |
| apevec | yum install python-zaqar-tests-tempest | 16:33 |
| amoralej | it's not mreged | 16:33 |
| amoralej | failure is in the gate for that review | 16:33 |
| *** gvrangan has joined #rdo | 16:33 | |
| *** Goneri has quit IRC | 16:34 | |
| *** dustins has joined #rdo | 16:34 | |
| *** catintheroof has quit IRC | 16:35 | |
| apevec | aah that's the review mnaser has linked | 16:35 |
| amoralej | yeah | 16:35 |
| *** ccamacho has joined #rdo | 16:35 | |
| *** vnogin has quit IRC | 16:36 | |
| *** dtantsur is now known as dtantsur|afk | 16:36 | |
| *** DV has joined #rdo | 16:36 | |
| *** catintheroof has joined #rdo | 16:36 | |
| *** links has quit IRC | 16:38 | |
| *** catintheroof has quit IRC | 16:39 | |
| chandankumar | apevec: i have completed all the works related to zaqar tempest plugin once package is available we need to just recheck it | 16:39 |
| *** catintheroof has joined #rdo | 16:39 | |
| *** gvrangan has quit IRC | 16:39 | |
| apevec | chandankumar, yep all good, I just did realize that review is part of it | 16:39 |
| chandankumar | EmilienM: tempest-17.1.0 just landed for pike, if you see any failure in CI let me know | 16:41 |
| *** ccamacho has quit IRC | 16:41 | |
| *** gvrangan has joined #rdo | 16:42 | |
| *** gvrangan has quit IRC | 16:43 | |
| EmilienM | ok | 16:44 |
| *** gvrangan has joined #rdo | 16:46 | |
| *** gvrangan has quit IRC | 16:51 | |
| amoralej | pradk, about https://review.rdoproject.org/r/#/c/10314/ | 16:51 |
| amoralej | now --skip-metering-database doesn't exist | 16:52 |
| *** lebauce has quit IRC | 16:52 | |
| amoralej | should we totally skip the ceilometer-upgrade command in packstack? | 16:52 |
| amoralej | https://review.openstack.org/#/c/515753 | 16:52 |
| amoralej | pradk, ^ | 16:52 |
| *** sshnaidm|off has quit IRC | 16:54 | |
| *** trown is now known as trown|lunch | 16:54 | |
| *** florianf has quit IRC | 16:54 | |
| rdogerrit | Alfredo Moralejo created rdoinfo master: Pin branchless projects for stable releases https://review.rdoproject.org/r/10328 | 17:01 |
| *** dmacpher has quit IRC | 17:01 | |
| rdogerrit | Alfredo Moralejo proposed rdoinfo master: Pin branchless projects for stable releases https://review.rdoproject.org/r/10328 | 17:01 |
| *** fzdarsky is now known as fzdarsky|afk | 17:03 | |
| *** MrAbaddon has quit IRC | 17:03 | |
| *** fragatina has quit IRC | 17:03 | |
| EmilienM | pabelanger: nice discussions there, but I don't see much follow-up. Might be great to formalize and take some actions eventually. | 17:03 |
| EmilienM | I agree on the donation, if we can, I think it would be very valuable to run OpenStack jobs on this cloud | 17:04 |
| *** ykarel has joined #rdo | 17:06 | |
| *** ykarel is now known as ykarel|away | 17:06 | |
| apevec | EmilienM, where is the discussion? | 17:07 |
| EmilienM | apevec: here, scroll up | 17:07 |
| EmilienM | apevec: 1h30 ago | 17:07 |
| apevec | re. mirror? | 17:08 |
| *** dyasny has quit IRC | 17:14 | |
| rdogerrit | rdo-trunk created openstack/swift-distgit rpm-master: openstack-swift: failed to build ff2acfe https://review.rdoproject.org/r/10329 | 17:14 |
| openstackgerrit | Alfredo Moralejo proposed openstack/packstack master: Remove ceilometer-upgrade command in ceilometer deployment https://review.openstack.org/515753 | 17:15 |
| *** racedo_ has joined #rdo | 17:15 | |
| *** Goneri has joined #rdo | 17:17 | |
| *** racedo has quit IRC | 17:17 | |
| *** rpioso is now known as rpioso|eat | 17:17 | |
| jpena | have a nice weekend everyone | 17:18 |
| rdogerrit | rdo-trunk created openstack/networking-cisco-distgit rpm-master: python-networking-cisco: failed to build 7b373bf https://review.rdoproject.org/r/10330 | 17:19 |
| *** jpena is now known as jpena|off | 17:19 | |
| pabelanger | apevec: EmilienM: ya, mirror. We'll need to have somebody work on that, to keep ovb jobs to good standing. Right now depending on rackspace isn't cutting it | 17:20 |
| apevec | yes, we're just getting lucky when it passes | 17:20 |
| *** fragatina has joined #rdo | 17:21 | |
| *** thrash is now known as thrash|bbl | 17:21 | |
| apevec | pabelanger, how much disk is needed? | 17:21 |
| pabelanger | Ideally, 100GB, 200GB would be future proofing | 17:22 |
| apevec | and currently we'd need to run one ubuntu instance right? | 17:23 |
| apevec | do you build special infra ubuntu image for that? | 17:23 |
| *** sshnaidm has joined #rdo | 17:24 | |
| apevec | or infra puppet runs on a plain ubunut cloud image for such pet instances? | 17:24 |
| pabelanger | no, right now we use ubuntu-trusty cloud image from ubuntu site | 17:24 |
| pabelanger | https://cloud-images.ubuntu.com/trusty/current/ should be fine | 17:24 |
| pabelanger | we are planning on rolling our own DIB images after zuulv3 rollout is finished | 17:25 |
| apevec | ok, as much as I don't like it, we could ask ops team if we could have a private ubuntu image | 17:25 |
| apevec | to get this rolling | 17:25 |
| *** anshul has quit IRC | 17:26 | |
| pabelanger | yah, migrating to centos is going to be work, and if we want to do it right, will need to do that in puppet-openstackci | 17:26 |
| pabelanger | otherwise, see if software factory has a way of managing it | 17:26 |
| *** gszasz has quit IRC | 17:27 | |
| pradk | amoralej, hmm no, we still need to run the upgrade to initialize the resource types in gnocchi | 17:28 |
| pradk | i'll comment in the review | 17:29 |
| *** spr has quit IRC | 17:29 | |
| *** sbulage has quit IRC | 17:29 | |
| amoralej | pradk, that's not done with gnocchi-upgrade? | 17:29 |
| pradk | amoralej, no | 17:29 |
| amoralej | ok, then it may be a problem with ordering? | 17:29 |
| *** vnogin has joined #rdo | 17:29 | |
| *** sshnaidm has quit IRC | 17:30 | |
| *** jmlowe has joined #rdo | 17:30 | |
| pradk | amoralej, ceilo upgrade needs to creates the resource types in gnocchi that are defined in gnocchi resource yaml .. so we still need the upgrade.. we can remove the --skip-metering-database | 17:30 |
| pradk | amoralej, that flag is probably gone noe | 17:30 |
| pradk | mow* | 17:30 |
| amoralej | pradk, mmmm | 17:30 |
| amoralej | so we need to just remove the option | 17:30 |
| amoralej | right? | 17:31 |
| EmilienM | panda|ruck: are you confident about the next periodic job run? have we found the reason it failed? | 17:31 |
| amoralej | but we need to wait until a new package with https://review.openstack.org/512700 is shipped, right? | 17:31 |
| EmilienM | panda|ruck: or we just wait and hope it was transient | 17:32 |
| *** spr has joined #rdo | 17:32 | |
| amoralej | pradk, will that cause a chicken-and-egg issue? | 17:32 |
| amoralej | i mean | 17:32 |
| *** ykarel|away has quit IRC | 17:32 | |
| amoralej | we need to remove the option or ceilometer-upgrade command fails | 17:32 |
| pradk | amoralej, well thats already initializing gnocchi | 17:33 |
| pradk | the purpose of skip metering db was to skip mongodb | 17:33 |
| pradk | now that its removed | 17:33 |
| pradk | it will just default to gnocchi | 17:33 |
| amoralej | but we can't remove it from packstack, p-o-i and tripleo because | 17:33 |
| pradk | so i dont think it will fail | 17:33 |
| panda|ruck | EmilienM: the job failed with a 503 error, while downloading a package from the mirror, using the proxy. The local proxy is up, running and works, I tested it requesting a page, so I assume the 503 error came from the rax mirror server | 17:33 |
| EmilienM | ok | 17:33 |
| amoralej | current package in promoted repo fails if we try to run ceilometer-upgrade withouth --skip-metering-database | 17:34 |
| *** vnogin has quit IRC | 17:35 | |
| pradk | amoralej, fails with what error? | 17:35 |
| apevec | panda|ruck, where is local proxy? | 17:35 |
| amoralej | pradk, http://logs.openstack.org/53/515753/1/check/packstack-integration-scenario003-tempest/b3eee20/logs/ceilometer/ceilometer-upgrade.log.txt.gz | 17:35 |
| apevec | and who set it up | 17:35 |
| pradk | amoralej, oh did we drop a requires from packaging? | 17:36 |
| amoralej | not afaik | 17:36 |
| panda|ruck | apevec: in nodepool tenant, proxy-server | 17:37 |
| panda|ruck | apevec: the mirror instead is rax | 17:37 |
| pradk | amoralej, guess we need to update the packaging first to drop the storage and make sure thats promoted and then drop the option | 17:37 |
| amoralej | yeah | 17:37 |
| panda|ruck | EmilienM: all the jobs failed more or less for the same reason at the same time | 17:37 |
| apevec | panda|ruck, ah, so it's just caching proxy? | 17:37 |
| amoralej | we'll have to pin ceilometer to last commit before droping storage drvier | 17:38 |
| panda|ruck | but I'm seeing a container build failed to push to rdoregistry now | 17:38 |
| panda|ruck | apevec: yes, but I can't access it, my keys are not working :( | 17:38 |
| panda|ruck | apevec: I tried to get the same link from the proxy at a different time, and it worked | 17:39 |
| *** dsneddon has joined #rdo | 17:39 | |
| panda|ruck | mmmhh, now I cant reach the other servers I could before | 17:40 |
| apevec | yeah, but if there's issue on the path to rax, proxy caching doesn't help | 17:40 |
| apevec | we need local mirror | 17:40 |
| panda|ruck | ssh -v -i ~/keys/tripleo-infra -A centos@38.145.33.91 returns "no route to host" | 17:40 |
| pradk | amoralej, yea :/ | 17:40 |
| amoralej | pradk, it seems we don't have bson dep ready :( | 17:41 |
| panda|ruck | the proxy was created to mimick what rh1 was doing, I'm not sure it's still relevant in rdocloud | 17:41 |
| apevec | new dep!? | 17:41 |
| amoralej | i'm going to send the pin for ceilometer | 17:41 |
| amoralej | apevec, bson | 17:42 |
| amoralej | http://logs.openstack.org/53/515753/1/check/packstack-integration-scenario003-tempest/b3eee20/logs/ceilometer/ceilometer-upgrade.log.txt.gz | 17:42 |
| *** vnogin has joined #rdo | 17:42 | |
| amoralej | it's a bit crazy | 17:42 |
| pradk | amoralej, yea looks like thats been broken already and since we never use that, we dint catch it. mongodb has been dead for us for a while :/ | 17:42 |
| amoralej | we need to add bson in order to move on and remove storage driver | 17:42 |
| pradk | amoralej, i dont think we need that dep with new storage removal | 17:42 |
| amoralej | yeah | 17:42 |
| apevec | amoralej, dang mongodb again... didn't we drop it everywhere :) | 17:43 |
| amoralej | so we need to add it to be able to remove it | 17:43 |
| *** sreichar_ has joined #rdo | 17:43 | |
| apevec | heh I don't follow, it's late here :) | 17:43 |
| pradk | amoralej, if we update the spec and drop all the storage code and promote package, we dont need it? no? | 17:43 |
| amoralej | apevec, i'm not explaining well :) | 17:44 |
| apevec | pradk, except, promotions are not happening for >40days.. | 17:44 |
| *** chlong has joined #rdo | 17:44 | |
| amoralej | pradk, first thing is to pin ceilometer, i think | 17:45 |
| pradk | yea chicken-egg .. we need https://review.rdoproject.org/r/#/c/10314/ but without bson we cant remove the option | 17:45 |
| amoralej | let me send the patch | 17:45 |
| pradk | damn | 17:45 |
| *** itamarjp has joined #rdo | 17:45 | |
| *** itamarjp has joined #rdo | 17:45 | |
| *** rhallisey has joined #rdo | 17:45 | |
| amoralej | pradk, could we temporarily add a patch in the distgit to re-introduce --skip-metering-database option (although doing nothing) for backwards compatibility? | 17:48 |
| *** MrAbaddon has joined #rdo | 17:48 | |
| amoralej | until we remove it from tripleo / poi / packstack / kolla / etc... | 17:48 |
| pradk | amoralej, you mean upstream? | 17:48 |
| amoralej | well, i think it will not be accepted upstream, righ | 17:49 |
| amoralej | packaging | 17:49 |
| apevec | amoralej, pradk please summarize the plan in ceilo ftbfs review, b/c I really don't understand it now :) | 17:49 |
| apevec | https://review.rdoproject.org/r/10314 | 17:49 |
| amoralej | well, if we can justify it upstream as backwards-compatibility | 17:49 |
| amoralej | apevec, i think right now the best option is to just pin ceilometer | 17:49 |
| pradk | amoralej, yea its too late i think for upstream .. | 17:49 |
| pradk | amoralej, if we can pin it, can we add bson dep and the gate should pass | 17:50 |
| pradk | we just need to get the package promoted | 17:50 |
| amoralej | pradk, yes, but we need to introduce python-bson in deps repo | 17:50 |
| amoralej | which i was trying to avoid | 17:50 |
| apevec | hold on, introduce dep just to drop it? | 17:50 |
| amoralej | yeah | 17:51 |
| apevec | I like adding dummy --skip-metering-database | 17:51 |
| amoralej | me too | 17:51 |
| apevec | would that avoid the need for bson? | 17:51 |
| amoralej | yes | 17:51 |
| apevec | sold | 17:52 |
| amoralej | :D | 17:52 |
| amoralej | pradk, ^ am i right? | 17:52 |
| pradk | amoralej, add it where though? | 17:52 |
| apevec | let's just add it a temp rpm patch in ftbfs review | 17:52 |
| apevec | pradk, ^ | 17:52 |
| EmilienM | do we have jobs for queens for automatic release? | 17:53 |
| EmilienM | I guess yes | 17:53 |
| apevec | amoralej, pradk - just restoring lines 33-35 https://review.openstack.org/#/c/512700/17/ceilometer/cmd/storage.py@33 should do? | 17:53 |
| pradk | hmm yea .. i'm not clear where that would be, but if that can avoid adding new dep then sure | 17:53 |
| EmilienM | (tripleo queens1 was released today and I don't see the patches in the distgit yet) | 17:53 |
| pradk | wrt repo | 17:53 |
| apevec | EmilienM, what do you mean? | 17:53 |
| apevec | EmilienM, we are not release milestones | 17:54 |
| pradk | apevec, correct, just add the oslo config option and dont do anything | 17:54 |
| apevec | that starts with RC | 17:54 |
| EmilienM | apevec: the jobs like https://review.rdoproject.org/r/#/c/10116/ | 17:54 |
| EmilienM | the patchs, sorry | 17:54 |
| amoralej | pradk, apevec i'll add the patch | 17:54 |
| EmilienM | "Update to..." | 17:54 |
| apevec | EmilienM, yes, that's not happening on master | 17:54 |
| EmilienM | ah ok | 17:55 |
| EmilienM | wow TIL | 17:55 |
| apevec | only when we branch queens-rdo | 17:55 |
| apevec | what would you do with those releases? | 17:55 |
| pradk | amoralej, cool, yea just add the option back without doing anything.. basically a noop, where ever this ftbft review is | 17:55 |
| amoralej | yes | 17:55 |
| apevec | pradk, it's https://review.rdoproject.org/r/10314 | 17:55 |
| pradk | right | 17:56 |
| *** bitchecker has quit IRC | 17:58 | |
| *** newmember has joined #rdo | 17:58 | |
| EmilienM | apevec: for OSP imports? | 17:58 |
| EmilienM | how do they import now? on commits? | 17:58 |
| rdogerrit | Alfredo Moralejo proposed openstack/ceilometer-distgit rpm-master: Remove deprecated storage drivers and binaries https://review.rdoproject.org/r/10314 | 18:01 |
| *** jbadiapa has quit IRC | 18:02 | |
| *** rpioso|eat is now known as rpioso | 18:02 | |
| *** pkovar has quit IRC | 18:03 | |
| *** bitchecker has joined #rdo | 18:03 | |
| *** aufi has quit IRC | 18:08 | |
| *** vnogin has quit IRC | 18:13 | |
| panda|ruck | we are failing to get nodes from rdocloud again ... | 18:13 |
| *** yselkowitz has quit IRC | 18:14 | |
| panda|ruck | apevec: I'm not sure if there's anyone around at this hour on friday to check ... ^ | 18:19 |
| *** yselkowitz has joined #rdo | 18:20 | |
| dmsimard | panda|ruck: what's the issue ? | 18:20 |
| *** fultonj has quit IRC | 18:21 | |
| panda|ruck | dmsimard: testenv-client is timing out while trying to get nodes | 18:21 |
| dmsimard | panda|ruck: can you translate that for me ? is that heat stacks failing to get created or something ? | 18:22 |
| *** dyasny has joined #rdo | 18:22 | |
| panda|ruck | dmsimard: I don't see any error, I think we're just waiting fomr available node and timing out after 20 minutes. | 18:24 |
| dmsimard | panda|ruck: after 20 minutes ? that's not reasonable... our nodepool doesn't seem to struggle creating and deleting nodes all the time | 18:26 |
| dmsimard | panda|ruck: just from recent logs http://paste.openstack.org/raw/624846/ | 18:26 |
| dmsimard | panda|ruck: could there be an issue with how the nodes are requested ? do you know how it works ? | 18:26 |
| panda|ruck | dmsimard: yes, and I don't see any errors in the log | 18:28 |
| dmsimard | panda|ruck: let's take a step back.. the fact that there aren't any errors in the log doesn't mean there's no problem, it could just mean you're not writing to the log that there's a problem in the first place :) | 18:30 |
| dmsimard | panda|ruck: what is the script that is used to spawn those instances ? | 18:31 |
| dmsimard | btw, from looking at the tenant quickly, it looks like there might be some orphaned instances or heat stacks | 18:32 |
| *** jackNemrod has joined #rdo | 18:33 | |
| panda|ruck | dmsimard: it's complicated but I can try to explain breifly. the job contats a geard server that takes requests. The gerd server then dispathes the server to a runner that runs ovb, when the env is ready the server returns the informations of the nodes crated. This happens async, to the client launches a request and wait for the reply | 18:35 |
| panda|ruck | if the geard server is unable to reply in 20 minutes with the info of the env created the job fails | 18:35 |
| dmsimard | panda|ruck: ok, and the geard server is healthy ? | 18:36 |
| dmsimard | panda|ruck: also I pasted you something on #rdo-ci | 18:36 |
| *** jackNemrod has quit IRC | 18:38 | |
| *** _bsurfer has joined #rdo | 18:38 | |
| panda|ruck | dmsimard: it is, the logs of the provisioner indicates that is working correclty | 18:40 |
| panda|ruck | but maybe I have to cleanup nodes from yesterday. | 18:41 |
| *** trown|lunch is now known as trown | 18:44 | |
| panda|ruck | sigh I'll open another bug to track this issue | 18:44 |
| *** fragatina has quit IRC | 18:48 | |
| *** itamarjp has quit IRC | 18:48 | |
| *** dprince has quit IRC | 18:48 | |
| *** amoralej is now known as amoralej|off | 18:48 | |
| rdogerrit | Merged openstack/swift-distgit rpm-master: Add man page for container-reconciler.conf https://review.rdoproject.org/r/10325 | 18:53 |
| dmsimard | panda|ruck: if you think there's an issue with rdo cloud, open a ticket with rhos ops | 18:54 |
| panda|ruck | dmsimard: yeah, 295 npodes from yesterday that were not deleted properly | 18:54 |
| panda|ruck | dmsimard: no it's a ticker I have to solve | 18:54 |
| panda|ruck | ticket | 18:54 |
| panda|ruck | 295 orphaned nodes | 18:55 |
| dmsimard | 295 orphaned nodes ? how do you konw ? | 18:55 |
| dmsimard | know* | 18:55 |
| panda|ruck | I have to clicking to do this night | 18:55 |
| dmsimard | that sounds like way too much | 18:55 |
| *** vnogin has joined #rdo | 18:55 | |
| panda|ruck | dmsimard: there's a jump, 295 nodes older than 22 hours, then some from 8 hours | 18:56 |
| panda|ruck | no job runs for 22 hours | 18:56 |
| dmsimard | interesting... | 18:56 |
| dmsimard | we should set up some process to clean up orphaned nodes -- like I said, nodepool will delete orphaned nodes it knows about, but if there are orphaned OVB nodes or heat stacks, it doesn't know about those | 18:57 |
| panda|ruck | yes, what happened is probably that when ysterday te-broker lost the dns, it lost the ability to contact rdocloud and delete the nodes | 18:57 |
| panda|ruck | they're sitting there, and nobody will remove them | 18:57 |
| dmsimard | I have to go to an appointment now, but that seems like a good suspect for this issue | 18:58 |
| panda|ruck | this is a job for superruck and its magic mouse | 18:58 |
| panda|ruck | dmsimard: thanks for you help | 18:58 |
| rdogerrit | David Moreau Simard proposed rdo-infra/rdo-container-registry master: WIP: Upgrade registry to OpenShift 3.7 https://review.rdoproject.org/r/10259 | 19:12 |
| rdobot | [sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| Build failure on centos7-master/current: ceilometer, networking-cisco: http://trunk.rdoproject.org/centos7-master/report.html | 19:12 |
| *** dneary has quit IRC | 19:12 | |
| *** dprince has joined #rdo | 19:13 | |
| *** athomas has quit IRC | 19:14 | |
| *** Goneri has quit IRC | 19:25 | |
| *** DV has quit IRC | 19:27 | |
| *** DV has joined #rdo | 19:28 | |
| *** _bsurfer has quit IRC | 19:29 | |
| *** catintheroof has quit IRC | 19:29 | |
| *** vnogin has quit IRC | 19:32 | |
| *** tesseract has quit IRC | 19:33 | |
| *** vnogin has joined #rdo | 19:37 | |
| *** hrw has quit IRC | 19:40 | |
| *** catintheroof has joined #rdo | 19:41 | |
| *** hrw has joined #rdo | 19:41 | |
| *** yselkowitz has quit IRC | 19:45 | |
| *** catintheroof has quit IRC | 19:45 | |
| *** pchavva has quit IRC | 19:51 | |
| *** itamarjp has joined #rdo | 19:55 | |
| *** itamarjp has joined #rdo | 19:55 | |
| *** flepied has quit IRC | 19:56 | |
| *** rcernin has joined #rdo | 19:57 | |
| *** scorcoran is now known as scorcoran_afk | 20:05 | |
| *** flepied has joined #rdo | 20:08 | |
| *** yselkowitz has joined #rdo | 20:08 | |
| rdogerrit | rdo-trunk created openstack/ironic-python-agent-distgit pike-rdo: Update to 2.2.2 https://review.rdoproject.org/r/10331 | 20:09 |
| *** jmlowe has quit IRC | 20:14 | |
| *** wolverineav has quit IRC | 20:18 | |
| *** wolverineav has joined #rdo | 20:18 | |
| rdogerrit | Alfredo Moralejo created openstack/heat-distgit ocata-rdo: Update to 8.0.5 https://review.rdoproject.org/r/10332 | 20:24 |
| *** dprince has quit IRC | 20:27 | |
| rdogerrit | Merged openstack/ceilometer-distgit rpm-master: Remove deprecated storage drivers and binaries https://review.rdoproject.org/r/10314 | 20:29 |
| apevec | EmilienM, import is from trunk srpms which passed ci | 20:29 |
| *** sasha2 has quit IRC | 20:30 | |
| apevec | pabelanger, dmsimard - rdocloud tenants can upload private images, so we could start with that in the ci tenant. | 20:31 |
| apevec | dmsimard, which does have enough disk quota to run the mirror (100-200GB) | 20:32 |
| apevec | ? | 20:32 |
| apevec | pabelanger, which one in https://cloud-images.ubuntu.com/trusty/current/ is RAW image? | 20:33 |
| dmsimard | apevec: we have the capacity to run a mirror. What kind of priority do we want to make that happen ? | 20:33 |
| apevec | I don't have stats, but looks like using rax is making ci jobs in rdo cloud unreliable | 20:34 |
| apevec | prio would follow from that statistics | 20:34 |
| *** dustins has quit IRC | 20:35 | |
| dmsimard | We've been using rax ever since the beginning, although we have ramped up usage a mirror could be beneficial. | 20:35 |
| *** rhallisey has quit IRC | 20:35 | |
| *** kgiusti has left #rdo | 20:35 | |
| dmsimard | I can put it on my todo for next week. There's some things to do under the hood to make that happen first | 20:36 |
| *** sreichar_ has quit IRC | 20:37 | |
| dmsimard | Like we don't expose the cloud region in nodepool and mirror format is like mirror.region.cloud.domain.tld | 20:37 |
| *** ansiwen has quit IRC | 20:37 | |
| apevec | pabelanger, ^ once we have ubuntu image, what playbook/script do we run to install mirror on it? | 20:37 |
| dmsimard | And there are hacks to undo | 20:37 |
| apevec | right | 20:37 |
| dmsimard | I know how to set it up, everything we need is in system-config | 20:37 |
| dmsimard | I used it recently to set up a test logs.o.o server | 20:38 |
| dmsimard | Need to afk appointment | 20:39 |
| dmsimard | apevec: btw triple had like 250 orphan OVB nodes in their tenant | 20:40 |
| dmsimard | See backlog.. | 20:40 |
| dmsimard | brb | 20:40 |
| apevec | I saw, why is that leaking... | 20:40 |
| apevec | if we could just integrate OVB into nodepool ... | 20:41 |
| *** ansiwen has joined #rdo | 20:43 | |
| apevec | trusty-server-cloudimg-amd64-disk1.img is actualy qcow2 | 20:43 |
| amoralej|off | apevec, what can we do with https://review.rdoproject.org/r/#/c/10319/ | 20:45 |
| amoralej|off | it's a weird thing | 20:45 |
| *** pchavva has joined #rdo | 20:45 | |
| amoralej|off | they run py27 and docs builds in gate with newton from mitaka-eol | 20:45 |
| amoralej|off | it doesn't work with master | 20:46 |
| *** sasha2 has joined #rdo | 20:47 | |
| *** apevec has quit IRC | 20:48 | |
| EmilienM | can someone tl;dr the status of rdocloud now? | 20:51 |
| EmilienM | panda|ruck: ^ | 20:51 |
| *** apevec has joined #rdo | 20:51 | |
| *** pchavva has quit IRC | 20:52 | |
| panda|ruck | EmilienM: I cleaned up 300 orphaned instances, the proxy server was using the mirror server as DNS, and the mirror-server wws shut down again. Now the proxy server has its own nds | 20:54 |
| *** rlandy has quit IRC | 20:54 | |
| EmilienM | panda|ruck: it sounds like we're on the good track | 20:54 |
| panda|ruck | EmilienM: yeah we are at the same point of yesterday hopefully | 20:55 |
| panda|ruck | next periodic trigger is at midnight UTC | 20:55 |
| EmilienM | panda|ruck: in 3h | 20:57 |
| panda|ruck | yeah, before daylight savings | 20:57 |
| panda|ruck | because it had to happen THIS night | 20:58 |
| *** pchavva has joined #rdo | 21:04 | |
| *** fragatina has joined #rdo | 21:04 | |
| *** trown is now known as trown|outtypewww | 21:06 | |
| *** pchavva has quit IRC | 21:09 | |
| *** scorcoran_afk has quit IRC | 21:09 | |
| apevec | panda|ruck, next night not this night | 21:10 |
| EmilienM | apevec: wait you have DST? | 21:13 |
| EmilienM | when | 21:13 |
| EmilienM | in US/Canada it's in 1 week | 21:13 |
| rdogerrit | Alfredo Moralejo proposed openstack/networking-cisco-distgit rpm-master: Remove doc building until project is compatible with neutron from master https://review.rdoproject.org/r/10319 | 21:14 |
| EmilienM | ok it's Sunday in Europe | 21:15 |
| panda|ruck | ah yeah | 21:15 |
| panda|ruck | tomorrow | 21:15 |
| EmilienM | next week meetings are going to be interesting | 21:15 |
| EmilienM | you in DST, us in normal hours :D | 21:15 |
| panda|ruck | as usual | 21:15 |
| apevec | yeah, DST is just pain for no gain | 21:16 |
| EmilienM | well, I'll be able to finish my night rating at 5pm :) | 21:18 |
| *** gfidente|warhw has quit IRC | 21:23 | |
| *** rcernin has quit IRC | 21:28 | |
| *** newmember has quit IRC | 21:33 | |
| *** apevec has left #rdo | 21:37 | |
| *** vnogin has quit IRC | 21:42 | |
| rdogerrit | Merged openstack/vitrage-distgit pike-rdo: Update to 1.8.2 https://review.rdoproject.org/r/10326 | 21:43 |
| rdogerrit | Merged openstack/ironic-python-agent-distgit pike-rdo: Update to 2.2.2 https://review.rdoproject.org/r/10331 | 21:43 |
| rdogerrit | Merged openstack/vitrageclient-distgit pike-rdo: Update to 1.4.0 https://review.rdoproject.org/r/10327 | 21:43 |
| rdogerrit | Merged openstack/heat-distgit ocata-rdo: Update to 8.0.5 https://review.rdoproject.org/r/10332 | 21:43 |
| rdogerrit | Merged openstack/networking-cisco-distgit rpm-master: Remove doc building until project is compatible with neutron from master https://review.rdoproject.org/r/10319 | 21:47 |
| *** wolverineav has quit IRC | 21:50 | |
| *** wolverineav has joined #rdo | 21:50 | |
| *** wolverineav has quit IRC | 21:54 | |
| *** pradk has quit IRC | 21:55 | |
| *** dciabrin has quit IRC | 21:55 | |
| *** dciabrin has joined #rdo | 21:56 | |
| *** yselkowitz has quit IRC | 22:02 | |
| *** vnogin has joined #rdo | 22:04 | |
| rdobot | [sensu] RESOLVED: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| No build failures detected: http://trunk.rdoproject.org/centos7-master/report.html | 22:09 |
| *** jtomasek has quit IRC | 22:14 | |
| *** vnogin has quit IRC | 22:16 | |
| *** artom has quit IRC | 22:19 | |
| *** panda|ruck is now known as panda|ruck|off | 22:24 | |
| *** Caterpillar has quit IRC | 22:25 | |
| *** vnogin has joined #rdo | 22:35 | |
| *** sshnaidm has joined #rdo | 22:38 | |
| *** jcoufal has quit IRC | 22:44 | |
| *** wolverineav has joined #rdo | 22:46 | |
| *** tosky has quit IRC | 23:00 | |
| sfbender | Merged DLRN master: Split rsync in two actions to avoid race condition https://softwarefactory-project.io/r/10040 | 23:06 |
| *** jmelvin has quit IRC | 23:09 | |
| *** ansiwen[q] has quit IRC | 23:10 | |
| *** ansiwen[q] has joined #rdo | 23:15 | |
| *** ansiwen[q] has quit IRC | 23:22 | |
| *** scorcoran_afk has joined #rdo | 23:24 | |
| *** owalsh is now known as owalsh_pto | 23:29 | |
| *** oanson has quit IRC | 23:54 | |
| *** oanson has joined #rdo | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!