| *** ohochman has quit IRC | 00:00 | |
| *** pilasguru has quit IRC | 00:05 | |
| *** imcleod has quit IRC | 00:08 | |
| *** mbound has joined #rdo | 00:11 | |
| *** paragan has quit IRC | 00:11 | |
| *** mbound has quit IRC | 00:16 | |
| *** dtrainor has joined #rdo | 00:16 | |
| *** morazi has quit IRC | 00:18 | |
| *** cpg|away is now known as cpg | 00:18 | |
| *** dtrainor has quit IRC | 00:19 | |
| *** p01nt3r75 has joined #rdo | 00:21 | |
| *** Son_Goku has quit IRC | 00:26 | |
| *** flepied has joined #rdo | 00:27 | |
| *** sdake_ has quit IRC | 00:28 | |
| *** morazi has joined #rdo | 00:30 | |
| *** cpg is now known as cpg|away | 00:30 | |
| *** pilasguru has joined #rdo | 00:45 | |
| *** limao has joined #rdo | 01:02 | |
| *** pilasguru has quit IRC | 01:04 | |
| *** limao_ has joined #rdo | 01:16 | |
| *** limao has quit IRC | 01:20 | |
| *** limao_ has quit IRC | 01:22 | |
| *** limao has joined #rdo | 01:22 | |
| *** Liuqing has joined #rdo | 01:34 | |
| *** rwsu has quit IRC | 01:34 | |
| rdobot | [sensu] NEW: master.monitoring.rdoproject.org - check-delorean-newton-current @ http://uchiwa.monitoring.rdoproject.org/#/client/rdo-monitoring/master.monitoring.rdoproject.org?check=check-delorean-newton-current |#| Build failure on centos7-master/current: ceilometer: http://trunk.rdoproject.org/centos7-master/report.html | 01:50 |
|---|---|---|
| *** pilasguru has joined #rdo | 02:01 | |
| *** ohochman has joined #rdo | 02:19 | |
| *** pilasguru has quit IRC | 02:27 | |
| *** crossbuilder has quit IRC | 02:34 | |
| *** crossbuilder_ has joined #rdo | 02:34 | |
| *** saneax is now known as saneax_AFK | 02:36 | |
| *** nyechiel has joined #rdo | 02:39 | |
| *** jhershbe has joined #rdo | 02:40 | |
| rdobot | [sensu] RESOLVED: master.monitoring.rdoproject.org - check-delorean-newton-current @ http://uchiwa.monitoring.rdoproject.org/#/client/rdo-monitoring/master.monitoring.rdoproject.org?check=check-delorean-newton-current |#| No build failures detected: http://trunk.rdoproject.org/centos7-master/report.html | 02:53 |
| *** Liuqing has quit IRC | 02:59 | |
| *** Liuqing has joined #rdo | 03:00 | |
| *** dustins has quit IRC | 03:03 | |
| *** jdob has quit IRC | 03:05 | |
| *** danielbruno has quit IRC | 03:06 | |
| *** melwitt has quit IRC | 03:06 | |
| *** Guest98668 has joined #rdo | 03:11 | |
| *** vkmc has quit IRC | 03:15 | |
| *** richm has quit IRC | 03:19 | |
| *** danielbruno has joined #rdo | 03:19 | |
| *** paragan has joined #rdo | 03:20 | |
| *** vkmc has joined #rdo | 03:21 | |
| *** jaosorior has joined #rdo | 03:29 | |
| *** julim has quit IRC | 03:32 | |
| *** shivrao has quit IRC | 03:39 | |
| *** danielbruno has quit IRC | 03:39 | |
| *** abregman has quit IRC | 03:44 | |
| *** vimal has joined #rdo | 03:48 | |
| *** shaunm has quit IRC | 03:49 | |
| *** tshefi has quit IRC | 03:56 | |
| *** shivrao has joined #rdo | 04:03 | |
| *** ashw has quit IRC | 04:08 | |
| *** hynekm has joined #rdo | 04:11 | |
| *** zaneb has quit IRC | 04:12 | |
| *** vimal has quit IRC | 04:13 | |
| *** chandankumar has joined #rdo | 04:18 | |
| *** chandankumar has quit IRC | 04:24 | |
| *** zaneb has joined #rdo | 04:29 | |
| *** akshai has joined #rdo | 04:31 | |
| *** cpg|away is now known as cpg | 04:32 | |
| *** nehar has joined #rdo | 04:32 | |
| *** akshai has quit IRC | 04:34 | |
| *** vimal has joined #rdo | 04:35 | |
| *** anilvenkata has joined #rdo | 04:44 | |
| *** d0ugal has quit IRC | 04:46 | |
| *** d0ugal has joined #rdo | 04:47 | |
| *** zaneb has quit IRC | 04:51 | |
| *** zaneb has joined #rdo | 04:51 | |
| *** chandankumar has joined #rdo | 04:53 | |
| *** ohochman has quit IRC | 05:03 | |
| *** abregman has joined #rdo | 05:04 | |
| *** Alex_Stef has joined #rdo | 05:11 | |
| *** yfried has joined #rdo | 05:16 | |
| *** apetrich has quit IRC | 05:20 | |
| *** apetrich has joined #rdo | 05:20 | |
| *** satya4ever has joined #rdo | 05:21 | |
| *** lkuchlan has joined #rdo | 05:22 | |
| *** alexismonville has joined #rdo | 05:25 | |
| *** rdas has joined #rdo | 05:28 | |
| *** jprovazn has joined #rdo | 05:30 | |
| *** jprovazn has quit IRC | 05:31 | |
| *** jprovazn has joined #rdo | 05:31 | |
| *** hynekm has quit IRC | 05:34 | |
| *** shivrao_ has joined #rdo | 05:36 | |
| *** shivrao has quit IRC | 05:39 | |
| *** shivrao_ is now known as shivrao | 05:39 | |
| *** pilasguru has joined #rdo | 05:41 | |
| *** rcernin has quit IRC | 05:44 | |
| *** pilasguru has quit IRC | 05:45 | |
| *** lkuchlan has quit IRC | 05:52 | |
| *** gkadam has joined #rdo | 05:52 | |
| *** dgurtner has joined #rdo | 05:56 | |
| *** dgurtner has joined #rdo | 05:56 | |
| *** saneax_AFK is now known as saneax | 05:58 | |
| *** d0ugal has quit IRC | 05:58 | |
| *** aufi has joined #rdo | 05:59 | |
| *** anshul has joined #rdo | 06:06 | |
| *** rcernin has joined #rdo | 06:07 | |
| *** leanderthal|afk is now known as leanderthal | 06:08 | |
| *** p01nt3r75 has quit IRC | 06:08 | |
| *** anshul has quit IRC | 06:09 | |
| *** anshul has joined #rdo | 06:10 | |
| *** oshvartz has joined #rdo | 06:13 | |
| *** Son_Goku has joined #rdo | 06:18 | |
| *** hynekm has joined #rdo | 06:19 | |
| *** jubapa has joined #rdo | 06:19 | |
| *** jhershbe has quit IRC | 06:21 | |
| *** jprovazn has quit IRC | 06:22 | |
| *** pgadiya has joined #rdo | 06:24 | |
| *** jubapa_ has joined #rdo | 06:24 | |
| *** edannon has joined #rdo | 06:26 | |
| *** anshul has quit IRC | 06:27 | |
| *** Son_Goku has quit IRC | 06:27 | |
| *** afazekas is now known as afazekas|dentist | 06:27 | |
| *** jerrygb has quit IRC | 06:29 | |
| *** anshul has joined #rdo | 06:29 | |
| *** Alex_Stef has quit IRC | 06:31 | |
| *** jhershbe has joined #rdo | 06:38 | |
| *** smeyer has joined #rdo | 06:39 | |
| *** eliska has joined #rdo | 06:40 | |
| *** d0ugal has joined #rdo | 06:42 | |
| *** anshul has quit IRC | 06:47 | |
| *** mcornea has joined #rdo | 06:49 | |
| *** mcornea has quit IRC | 06:49 | |
| *** tesseract- has joined #rdo | 06:50 | |
| *** mcornea has joined #rdo | 06:50 | |
| *** nmagnezi_ has joined #rdo | 06:51 | |
| *** d0ugal has quit IRC | 06:51 | |
| *** jprovazn has joined #rdo | 06:52 | |
| *** dhoppe has quit IRC | 06:54 | |
| *** dhoppe has joined #rdo | 06:54 | |
| *** Son_Goku has joined #rdo | 06:57 | |
| *** danofsatx has quit IRC | 06:58 | |
| *** anshul has joined #rdo | 06:59 | |
| *** oshvartz has quit IRC | 07:00 | |
| *** oshvartz has joined #rdo | 07:00 | |
| *** toanju has joined #rdo | 07:01 | |
| *** belmoreira has joined #rdo | 07:01 | |
| *** rdo has quit IRC | 07:05 | |
| *** d0ugal has joined #rdo | 07:08 | |
| *** florianf has joined #rdo | 07:08 | |
| *** iranzo has joined #rdo | 07:08 | |
| *** tshefi has joined #rdo | 07:09 | |
| *** anshul has quit IRC | 07:11 | |
| *** anshul has joined #rdo | 07:11 | |
| *** tshefi has quit IRC | 07:13 | |
| *** rdo has joined #rdo | 07:13 | |
| *** toanju has quit IRC | 07:14 | |
| *** athomas has joined #rdo | 07:16 | |
| *** gchamoul has quit IRC | 07:16 | |
| *** adarazs_pto has quit IRC | 07:17 | |
| *** jjoyce has quit IRC | 07:17 | |
| *** jschlueter has quit IRC | 07:17 | |
| *** jjoyce has joined #rdo | 07:19 | |
| *** jschlueter has joined #rdo | 07:20 | |
| *** adarazs has joined #rdo | 07:22 | |
| *** gchamoul has joined #rdo | 07:22 | |
| *** garrett has joined #rdo | 07:26 | |
| *** ifarkas_afk is now known as ifarkas | 07:27 | |
| *** shardy has joined #rdo | 07:27 | |
| *** abregman has quit IRC | 07:28 | |
| *** jpich has joined #rdo | 07:28 | |
| *** KarlchenK has joined #rdo | 07:29 | |
| *** puzzled has joined #rdo | 07:30 | |
| *** jerrygb has joined #rdo | 07:30 | |
| *** abregman has joined #rdo | 07:32 | |
| *** jerrygb has quit IRC | 07:35 | |
| *** anshul has quit IRC | 07:35 | |
| *** anshul has joined #rdo | 07:36 | |
| *** zoli_gone-proxy is now known as zoliXXL | 07:40 | |
| *** kaminohana has quit IRC | 07:41 | |
| *** ushkalim has joined #rdo | 07:42 | |
| *** zoliXXL is now known as zoli|WFH | 07:42 | |
| *** zoli|WFH is now known as zoli|wfh | 07:42 | |
| *** d0ugal has quit IRC | 07:46 | |
| *** devvesa has joined #rdo | 07:49 | |
| *** abregman has quit IRC | 07:49 | |
| *** derekh has joined #rdo | 07:50 | |
| *** tshefi has joined #rdo | 07:56 | |
| flaper87 | number80: what would be required to pull https://admin.fedoraproject.org/pkgdb/package/rpms/docker-compose/ into the rdo repos? (or just to have it in centos:7) | 07:56 |
| flaper87 | it's in f23 and f24 | 07:56 |
| *** lkuchlan has joined #rdo | 07:57 | |
| *** anshul has quit IRC | 08:01 | |
| *** abregman has joined #rdo | 08:03 | |
| *** shivrao has quit IRC | 08:05 | |
| *** d0ugal has joined #rdo | 08:05 | |
| *** pppingme has quit IRC | 08:05 | |
| *** pppingme has joined #rdo | 08:12 | |
| *** anshul has joined #rdo | 08:14 | |
| *** Alex_Stef has joined #rdo | 08:15 | |
| *** pnavarro has joined #rdo | 08:16 | |
| *** paramite has joined #rdo | 08:16 | |
| *** puzzled has quit IRC | 08:17 | |
| *** zoli|wfh is now known as zoli|brb | 08:20 | |
| *** anshul has quit IRC | 08:21 | |
| *** limao has quit IRC | 08:25 | |
| *** gfidente has joined #rdo | 08:28 | |
| *** limao has joined #rdo | 08:29 | |
| *** jerrygb has joined #rdo | 08:31 | |
| *** devvesa has quit IRC | 08:33 | |
| *** anshul has joined #rdo | 08:33 | |
| *** jerrygb has quit IRC | 08:35 | |
| *** zoli|brb is now known as zoli|wfh | 08:41 | |
| *** hynekm has quit IRC | 08:42 | |
| *** ihrachys has joined #rdo | 08:43 | |
| number80 | flaper87: I'll work this out with the virt SIG, but I can temporarily add them in Cloud SIG repo | 08:44 |
| *** priteau has joined #rdo | 08:45 | |
| *** hynekm has joined #rdo | 08:46 | |
| number80 | anything already in fedora or centos, doesn't need specific process | 08:47 |
| *** devvesa has joined #rdo | 08:48 | |
| *** anshul has quit IRC | 08:48 | |
| flaper87 | number80: gotcha, thanks! | 08:49 |
| *** anshul has joined #rdo | 08:49 | |
| *** nehar_ has joined #rdo | 08:52 | |
| *** nehar has quit IRC | 08:52 | |
| *** Son_Goku has quit IRC | 08:52 | |
| *** ohamada has joined #rdo | 08:56 | |
| *** jlibosva has joined #rdo | 08:56 | |
| *** jaosorior has quit IRC | 08:58 | |
| *** jaosorior has joined #rdo | 08:58 | |
| *** jaosorior is now known as jaosorior_lunch | 09:00 | |
| *** nehar has joined #rdo | 09:00 | |
| *** egallen has joined #rdo | 09:01 | |
| *** chandankumar has quit IRC | 09:01 | |
| *** dtantsur|afk is now known as dtantsur | 09:01 | |
| *** nehar_ has quit IRC | 09:02 | |
| *** vimal has quit IRC | 09:04 | |
| *** rdobot has quit IRC | 09:04 | |
| *** fzdarsky has joined #rdo | 09:04 | |
| openstackgerrit | Ivan Chavero proposed openstack/packstack: Fix user creation for nova network https://review.openstack.org/344664 | 09:05 |
| *** jubapa has quit IRC | 09:08 | |
| *** vimal has joined #rdo | 09:08 | |
| *** devvesa has quit IRC | 09:10 | |
| sshnaidm | does anybody know what is "reponame=delorean" in project.ini of openstack-packages/DLRN? (and where to find projects.ini explanations) | 09:14 |
| *** chandankumar has joined #rdo | 09:14 | |
| *** anshul has quit IRC | 09:15 | |
| *** anshul has joined #rdo | 09:17 | |
| *** sdake has joined #rdo | 09:21 | |
| *** sdake has quit IRC | 09:23 | |
| *** iberezovskiy|off is now known as iberezovskiy | 09:23 | |
| *** akrivoka has joined #rdo | 09:25 | |
| *** mvk has quit IRC | 09:27 | |
| *** ifarkas has quit IRC | 09:30 | |
| hewbrocca | number80: hey, I just went and added [fixed] to the end of the three crossed-out items on the RDO promotion CI issues eitherpad | 09:30 |
| hewbrocca | so that they no longer show up in the count on Fred's dashboard | 09:31 |
| hewbrocca | I guess that means we're now down to pecan and gnocchi... | 09:31 |
| *** yolanda has quit IRC | 09:31 | |
| *** jerrygb has joined #rdo | 09:32 | |
| *** hanchao has quit IRC | 09:34 | |
| *** paragan has quit IRC | 09:36 | |
| *** jerrygb has quit IRC | 09:36 | |
| *** alexismonville has quit IRC | 09:36 | |
| *** devvesa has joined #rdo | 09:37 | |
| *** athomas has quit IRC | 09:39 | |
| *** abehl has joined #rdo | 09:39 | |
| flaper87 | number80: so, turns out this is real and I don't think it's correct (but of course, I could be wrong) http://pkgs.fedoraproject.org/cgit/rpms/numpy.git/tree/numpy.spec#n66 | 09:40 |
| flaper87 | That's a problem because it forces us to keep python-devel installed (unless you force the removal) | 09:40 |
| *** anshul has quit IRC | 09:41 | |
| flaper87 | removing python-devel would end up removing a good portion of openstack's stack | 09:41 |
| flaper87 | and it's annoying to use a -devel as a runtime dependency | 09:41 |
| flaper87 | number80: is there anything you can help with on that front ? | 09:41 |
| * flaper87 trusts on number80's cow powers | 09:42 | |
| *** puzzled has joined #rdo | 09:42 | |
| number80 | hewbrocca: thanks, btw pecan and gnocchi are fixed | 09:42 |
| number80 | (gnocchi is waiting confirmation though) | 09:42 |
| *** Poornima has joined #rdo | 09:42 | |
| *** ifarkas has joined #rdo | 09:42 | |
| flaper87 | number80: we depend on that package because taskflow depends on python-networkx-core | 09:42 |
| flaper87 | well, it depends on python-networkx, which depends on python-networkx-core | 09:43 |
| flaper87 | BOM! | 09:43 |
| hewbrocca | number80: that is fantastic. does that mean we have a working promote job? | 09:43 |
| hewbrocca | and, if so, should we update the etherpad? | 09:43 |
| number80 | though, pixelbeat did reduce networkx dependency chain ... I'll give it a look again | 09:43 |
| flaper87 | number80: danke, sir! | 09:44 |
| number80 | hewbrocca: dmsimard was working on this, last night, I haven't checked results | 09:44 |
| *** _degorenko|afk is now known as degorenko | 09:46 | |
| number80 | hewbrocca: looks better than the other day => https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/ | 09:46 |
| number80 | it's slowly turning green | 09:47 |
| hewbrocca | LMK when you have a chance. I'd love to be able to report in the program meeting (two hours from now) that we have up-to-date promote jobs | 09:47 |
| hewbrocca | or, better yet, I'd love for apevec to be able to do that :) | 09:47 |
| hewbrocca | coool | 09:47 |
| *** Poornima has quit IRC | 09:48 | |
| hewbrocca | number80: oh, what about the mitaka job? There's one error there but it looks like a fix might have been merged? | 09:48 |
| number80 | hewbrocca: if I get the news before that, I'll notify you | 09:48 |
| hewbrocca | https://etherpad.openstack.org/p/delorean_mitaka_current_issues | 09:48 |
| hewbrocca | number80: thank you sir | 09:48 |
| *** chandankumar has quit IRC | 09:49 | |
| number80 | Yeah, tricky one => Neutron backported a patch that requires a *Newton* version of neutron-lib | 09:49 |
| hewbrocca | thanks, Neutron! | 09:49 |
| number80 | Well, I'll give it a shot | 09:49 |
| hewbrocca | It looks like chem (Sofer) merged a fix for it? | 09:50 |
| *** przem has joined #rdo | 09:50 | |
| *** devvesa has quit IRC | 09:52 | |
| number80 | Yes, I'm trying to figure out why the promotion job failed, only one sub-job has failed | 09:53 |
| apetrich | rdo slave on ci.centos is unresponsive. I've talked to centos people and they will reboot the rdo slave | 09:53 |
| number80 | could be the selinux issue that also affected master | 09:53 |
| number80 | apetrich: ack | 09:54 |
| number80 | again => "error: failed to get vol 'undercloud.qcow2'\nerror: Storage volume not found: no storage vol with matching path 'undercloud.qcow2'"" | 09:54 |
| number80 | ok, since we have two promotions jobs running (master, liberty) and one node down, well, I'll leave mitaka alone until we get more ressources. | 09:55 |
| number80 | .whoowns python-networkx | 09:56 |
| zodbot | number80: jjames | 09:56 |
| *** Son_Goku has joined #rdo | 10:00 | |
| *** tosky has joined #rdo | 10:01 | |
| *** cpg is now known as cpg|away | 10:02 | |
| *** Liuqing has quit IRC | 10:03 | |
| *** karimb has joined #rdo | 10:06 | |
| *** sdake has joined #rdo | 10:14 | |
| *** devvesa has joined #rdo | 10:14 | |
| *** limao has quit IRC | 10:16 | |
| *** sdake_ has joined #rdo | 10:17 | |
| *** jaosorior_lunch is now known as jaosorior | 10:19 | |
| *** sdake has quit IRC | 10:19 | |
| *** jcoufal has joined #rdo | 10:20 | |
| *** anshul has joined #rdo | 10:20 | |
| *** sdake_ has quit IRC | 10:22 | |
| *** abehl has quit IRC | 10:22 | |
| *** chandankumar has joined #rdo | 10:22 | |
| *** dpeacock has joined #rdo | 10:24 | |
| *** sdake has joined #rdo | 10:25 | |
| *** jcoufal has quit IRC | 10:26 | |
| *** mbound has joined #rdo | 10:30 | |
| *** d0ugal has quit IRC | 10:31 | |
| *** jerrygb has joined #rdo | 10:33 | |
| *** vimal has quit IRC | 10:35 | |
| *** dgurtner has quit IRC | 10:36 | |
| *** egallen has quit IRC | 10:36 | |
| apetrich | so rdo slave on ci-centos is back but probably missing a mount to /home/centos or /home/centos/workspace | 10:38 |
| *** sdake has quit IRC | 10:38 | |
| apetrich | does anyone know anything about it? the centos sysadm says that the slave is annotated with "rdo self managed" | 10:38 |
| *** jerrygb has quit IRC | 10:39 | |
| panda | number80: why there are 2 versions of os-*-config in http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-liberty/ ? should the 5.0.0 be in liberty ? | 10:39 |
| *** dhill_ has quit IRC | 10:40 | |
| number80 | panda: we don't remove old builds, but only latest is installed | 10:40 |
| number80 | and it allows yum doangrade | 10:40 |
| number80 | as for os-cloud-config, it's branchless project, so DLRN builds whatever is in master in all branches | 10:41 |
| *** sdake has joined #rdo | 10:42 | |
| panda | number80: thanks, that explains a lot. | 10:42 |
| *** mvk has joined #rdo | 10:44 | |
| number80 | I'm planning to change that but we have other stuff to fix first | 10:46 |
| *** vimal has joined #rdo | 10:47 | |
| *** pkovar has joined #rdo | 10:49 | |
| *** gszasz has joined #rdo | 10:50 | |
| *** Son_Goku has quit IRC | 10:51 | |
| *** rgogunskiy has joined #rdo | 10:53 | |
| *** pkovar has quit IRC | 10:59 | |
| *** jcoufal has joined #rdo | 11:00 | |
| *** jcoufal has quit IRC | 11:01 | |
| *** dgurtner has joined #rdo | 11:03 | |
| *** dgurtner has joined #rdo | 11:03 | |
| *** ccamacho is now known as ccamacho|lunch | 11:04 | |
| *** pppingme has quit IRC | 11:04 | |
| number80 | hewbrocca: it failed but as apetrich said, there's an issue with CI infra | 11:07 |
| number80 | https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/503/console | 11:07 |
| apetrich | hewbrocca, number80 working with centos people to figure that out. | 11:07 |
| number80 | apetrich: yup, just to be sure that he gets the info before his meeting :) | 11:09 |
| number80 | well, we had a lot of CI failures, so I prefer letting infra folks fixing it | 11:10 |
| *** jcoufal has joined #rdo | 11:11 | |
| *** sdake has quit IRC | 11:12 | |
| *** jcoufal has quit IRC | 11:12 | |
| *** dgurtner has quit IRC | 11:13 | |
| *** rgogunskiy has quit IRC | 11:14 | |
| *** dgurtner has joined #rdo | 11:14 | |
| *** pkovar has joined #rdo | 11:16 | |
| *** shardy has quit IRC | 11:18 | |
| *** dpeacock has quit IRC | 11:18 | |
| *** dpeacock has joined #rdo | 11:19 | |
| *** lucasagomes is now known as lucas-hungry | 11:20 | |
| *** aortega has joined #rdo | 11:21 | |
| *** karimb has quit IRC | 11:22 | |
| *** rodrigods has quit IRC | 11:26 | |
| *** gfidente is now known as gfidente|lunch | 11:27 | |
| *** pstack has joined #rdo | 11:29 | |
| hewbrocca | number80: thanks for keeping me informed | 11:31 |
| hewbrocca | apetrich: any idea how long it'll be before it's fixed? | 11:31 |
| *** karimb has joined #rdo | 11:35 | |
| *** jerrygb has joined #rdo | 11:35 | |
| *** Son_Goku has joined #rdo | 11:36 | |
| *** King_InuYasha has joined #rdo | 11:37 | |
| *** milan has joined #rdo | 11:39 | |
| *** jerrygb has quit IRC | 11:39 | |
| *** Son_Goku has quit IRC | 11:41 | |
| apetrich | hewbrocca, nope :( I have no experience with that server and the annotation there says "rdo self managed" so the sysadms there do now know how if anything is needed after a reboot | 11:41 |
| *** abregman has quit IRC | 11:41 | |
| apetrich | hewbrocca, I'm hoping that when wes appears that he has any idea | 11:41 |
| hewbrocca | apetrich: OK, yeah | 11:42 |
| apetrich | hewbrocca, but on the other hand it seems that we have reduced that to be a permission problem at this time so not the end of the world | 11:44 |
| hewbrocca | reduced what, exactly? | 11:44 |
| *** degorenko is now known as _degorenko|afk | 11:45 | |
| *** weshay has joined #rdo | 11:46 | |
| apetrich | hewbrocca, it is fixed | 11:46 |
| apetrich | s/reduced/reduced the problems/ | 11:47 |
| hewbrocca | Oh, meaning the slave machine now works? | 11:47 |
| apetrich | hewbrocca, aye | 11:48 |
| hewbrocca | well that is excellent -- so no reboot needed after all | 11:48 |
| apetrich | hewbrocca, it was rebooted early on. it was stuck not even answering ssh | 11:48 |
| number80 | apetrich: nothing specific is needed, weirdo takes care of setting up nodes | 11:48 |
| hewbrocca | well, cool | 11:49 |
| weshay | cico does that | 11:49 |
| weshay | morning all | 11:49 |
| hewbrocca | I'm sorry for being so dense, guys, but does this mean we are good to try the promote job again? | 11:49 |
| hewbrocca | weshay: morning! | 11:49 |
| weshay | hewbrocca, did the introspection package issue resolve? | 11:49 |
| apetrich | number80, it needed to be run with rhos-ci user they are used to rdo-ci user then it was labeled rdo-ci-slave01 not cloudslave. they didn't know that | 11:50 |
| apetrich | but we are adding notes for that not to happen again | 11:50 |
| weshay | hewbrocca, kicked it | 11:50 |
| number80 | ack | 11:50 |
| apetrich | and there he is! | 11:50 |
| apetrich | hey weshay | 11:50 |
| weshay | ellooo | 11:50 |
| apetrich | weshay, we had to reboot the ci.centos slave early on and it just came back. | 11:51 |
| *** pkovar has quit IRC | 11:51 | |
| weshay | hewbrocca, I guess this goes in delorean-deps http://cbs.centos.org/koji/buildinfo?buildID=11604 | 11:51 |
| * weshay looks | 11:52 | |
| weshay | must be a new dep, don't see it in either delorean or delorean-deps | 11:53 |
| weshay | hewbrocca, we fail until that is avail afaict | 11:53 |
| number80 | weshay: update to existing dep | 11:54 |
| *** nehar has quit IRC | 11:55 | |
| weshay | number80, I guess that is a base os library? | 11:55 |
| weshay | if it's built in cbs that would make sense | 11:55 |
| number80 | weshay: nope, dependency maintained by RDO | 11:55 |
| *** gchamoul is now known as gchamoul|afk | 11:55 | |
| weshay | number80, which repo? | 11:56 |
| *** gchamoul|afk is now known as gchamoul | 11:56 | |
| *** gchamoul is now known as gchamoul|afk | 11:56 | |
| *** gchamoul|afk is now known as gchamoul | 11:56 | |
| *** abregman has joined #rdo | 11:56 | |
| hewbrocca | pecan, yeah | 11:57 |
| hewbrocca | So Pevec updated it yesterday, is it nowt available? | 11:57 |
| *** pkovar has joined #rdo | 11:58 | |
| number80 | weshay: newton-testing => http://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-newton/ | 11:58 |
| *** karimb has quit IRC | 11:59 | |
| weshay | number80, only issue w/ that is I don't believe CI uses that repo | 12:00 |
| *** amuller has joined #rdo | 12:00 | |
| number80 | weshay: well, it is in delorean-deps.repo => https://trunk.rdoproject.org/centos7-master/delorean-deps.repo | 12:01 |
| *** athomas has joined #rdo | 12:03 | |
| weshay | ah.. now I see it.. was searching for python-pecan not python2-pecan | 12:03 |
| weshay | heh | 12:03 |
| weshay | my bad | 12:03 |
| number80 | yeah, python-pecan is a virtual provides for compat | 12:03 |
| *** abregman has quit IRC | 12:04 | |
| weshay | number80, so who updates delorean-deps /me sees 1.0.2-2 | 12:04 |
| weshay | vs.. 1.1.2-1 | 12:04 |
| *** d0ugal has joined #rdo | 12:04 | |
| *** chandankumar has quit IRC | 12:04 | |
| number80 | weshay: Alan and I | 12:04 |
| weshay | cool | 12:04 |
| *** jayg|g0n3 is now known as jayg | 12:05 | |
| number80 | Until we have better automation, I'm human automation | 12:05 |
| weshay | :) | 12:05 |
| weshay | ya.. automating all things is not easy | 12:06 |
| *** dprince has joined #rdo | 12:07 | |
| weshay | number80, thanks for taking care of it | 12:07 |
| number80 | np | 12:07 |
| *** zoli|wfh is now known as zoli|lunch | 12:07 | |
| *** egallen has joined #rdo | 12:08 | |
| *** pkovar has quit IRC | 12:08 | |
| hewbrocca | weshay: so... does this mean we have a working promote? | 12:08 |
| weshay | hewbrocca, no.. number80 is updating the repo | 12:09 |
| *** Liuqing has joined #rdo | 12:10 | |
| number80 | repo is up-to-date since monday, maybe you're hitting an unrefreshed CDN node | 12:10 |
| * number80 reviewing CI logs | 12:10 | |
| honza | mrunge: i'm online now if you're free --- what timezone are you in? | 12:10 |
| hewbrocca | honza: mrunge is auf deutschland | 12:11 |
| honza | hewbrocca: roger that :) | 12:11 |
| weshay | ha.. weird.. python2-pecan-1.1.2-1.el7.noarch.rpm2016-07-19 14:07267K | 12:11 |
| weshay | number80, ya.. see it now | 12:12 |
| *** rodrigods has joined #rdo | 12:12 | |
| number80 | ack | 12:12 |
| number80 | restarting the liberty promote job as it was jenkins failure | 12:12 |
| hewbrocca | Any chance we can get the Mitaka one going too? | 12:13 |
| *** sshnaidm is now known as sshnaidm|lnch | 12:13 | |
| weshay | hewbrocca, ok.. bad news.. Jul 20 00:49:08 Installed: python2-pecan-1.1.2-1.el7.noarch | 12:14 |
| weshay | does not resolve the introspection issue | 12:14 |
| * weshay looking into it | 12:14 | |
| weshay | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal-376/undercloud/var/log/yum.log.gz | 12:14 |
| *** nehar has joined #rdo | 12:14 | |
| weshay | last run got.. | 12:14 |
| weshay | Introspection for UUID fc421898-c26f-41a1-9db0-766713c7e066 finished with error: Introspection timeout | 12:14 |
| weshay | which is better | 12:14 |
| weshay | so it did fix the ise | 12:14 |
| hewbrocca | It did fix the issue, but we have a different issue? | 12:15 |
| weshay | introspection is still not working, but the python-pecan update resolved the ise | 12:16 |
| *** hynekm has quit IRC | 12:16 | |
| *** abregman has joined #rdo | 12:16 | |
| hewbrocca | what is the ise? | 12:16 |
| hewbrocca | and, dtantsur do you have any insight here? | 12:16 |
| weshay | the ise was resolved.. the error *was* Exception registering nodes: Internal Server Error | 12:17 |
| weshay | now we're just timing out | 12:17 |
| mrunge | honza, pong | 12:17 |
| hewbrocca | Oh, ISE means "Internal Server ERror" | 12:17 |
| hewbrocca | that's what I was missing | 12:17 |
| dtantsur | well, we need ramdisk logs I guess | 12:17 |
| * weshay brings up a local env | 12:17 | |
| weshay | hewbrocca, ya.. weird right.. blast from the past | 12:17 |
| dtantsur | unless it's https://bugs.launchpad.net/tripleo/+bug/1604770 | 12:18 |
| openstack | Launchpad bug 1604770 in tripleo "introspection hangs due to broken ipxe config" [Undecided,New] | 12:18 |
| dtantsur | so check the ipxe config first ^^^ | 12:18 |
| dtantsur | weshay, ^^^ | 12:18 |
| weshay | k | 12:18 |
| hewbrocca | I thought we landed the fix for that :( | 12:18 |
| honza | mrunge: i had some fruther discussions with the folks in #openstack-infra and i think i like the "bundle all node_modules inside the source tarball" idea | 12:18 |
| honza | mrunge: how do you like xstatic? is it worth publishing hundreds of pypi packages for our app? | 12:19 |
| mrunge | honza, well. what's the alternative? | 12:19 |
| *** chandankumar has joined #rdo | 12:19 | |
| mrunge | honza, bundling all node modules in one source tarball is a nightmare on the distro side | 12:19 |
| mrunge | if you're doing the packaging as well: good luck with it | 12:20 |
| *** pkovar has joined #rdo | 12:20 | |
| dtantsur | hewbrocca, awesome, I've screwed up https://review.openstack.org/#/c/342147/2/elements/puppet-stack-config/puppet-stack-config.yaml.template and thanks to the disabled gate nobody noticed that >_< | 12:20 |
| hewbrocca | GAAAARHRRRRR | 12:20 |
| honza | mrunge: when the rpm is built, it can't have access to the internet, right? so when building we'll have access to the bundled modules and then throw them away once it's all built | 12:21 |
| mrunge | right | 12:21 |
| *** brault has joined #rdo | 12:21 | |
| honza | mrunge: why is it a nightmare? package size? | 12:21 |
| mrunge | nope. bundling is forbidden by policy | 12:21 |
| *** flepied has quit IRC | 12:21 | |
| mrunge | and npm install at build time is disabled for good reason | 12:21 |
| *** satya4ever has quit IRC | 12:22 | |
| honza | mrunge: i thought it was bundling of artifacts only, and not sources? | 12:22 |
| hewbrocca | mrunge: I believe we have relaxed the bundling policy somewhat, have we not? | 12:22 |
| hewbrocca | number80: ^^^ | 12:22 |
| mrunge | hewbrocca, it's still a *should* unbundle | 12:23 |
| mrunge | where possible | 12:23 |
| mrunge | honza, so your question is: how to get your static files like js libs into your package, no? | 12:24 |
| mrunge | honza, you don't rely on python for your application at all, don't you? | 12:25 |
| *** pradk has joined #rdo | 12:25 | |
| number80 | honza: temporarily, we can accept bundling artifacts but that'd be an exception | 12:25 |
| honza | mrunge: i want to run "npm run build" in my rpm spec file and need the files that "npm install" brings in --- my choices appear to be a) bundle b) xstatic | 12:26 |
| mrunge | both is not your solution then | 12:26 |
| mrunge | look at node packaging guides | 12:26 |
| *** gfidente|lunch is now known as gfidente | 12:26 | |
| dtantsur | weshay, FYI: https://review.openstack.org/#/c/344792/ | 12:27 |
| *** rbrady has joined #rdo | 12:27 | |
| *** unclemarc has joined #rdo | 12:27 | |
| mrunge | there are more node packages being built in koji without accessing the net | 12:27 |
| mrunge | xstatic helps you to map those node packages into python namespace | 12:27 |
| weshay | dtantsur, thanks | 12:27 |
| number80 | xstatic is more for web assets, if I'm correct? | 12:27 |
| *** lucas-hungry is now known as lucasagomes | 12:28 | |
| mrunge | xstatic is something to make static files accessible/installable via pip | 12:28 |
| *** limao has joined #rdo | 12:29 | |
| mrunge | benefit is, that you can re-use system packages with xstatic packages | 12:29 |
| mrunge | like in xstatic-fonts-fontawesome, we're re-using fontawesome-fonts, xstatic only provides a thin wrapper | 12:30 |
| honza | but what if you have hundreds of dependencies? | 12:30 |
| mrunge | then you have hundreds of packages | 12:30 |
| mrunge | horizon has 60 dependencies currently | 12:31 |
| number80 | honza: if it's in fedora, then we'll rebuild them in CBS | 12:31 |
| number80 | for the others, well, we'll help you | 12:31 |
| *** julim has joined #rdo | 12:31 | |
| *** limao_ has joined #rdo | 12:31 | |
| mrunge | grafana has around 120(?) deps? | 12:31 |
| mrunge | golang and node deps | 12:32 |
| number80 | if it's 800 deps before GA, I have few weeks of remaining PTO :) | 12:32 |
| mrunge | same here | 12:32 |
| mrunge | and an insane pile of other stuff to do | 12:32 |
| number80 | yeah, optools is a lot of work | 12:32 |
| *** _degorenko|afk is now known as degorenko | 12:33 | |
| mrunge | honza, seriously, check what's already available in fedora | 12:33 |
| mrunge | it can't be that bad any more | 12:33 |
| honza | Where do I check that? I can't help but think that we're talking about different things here. | 12:34 |
| *** limao has quit IRC | 12:34 | |
| mrunge | dnf search foo, where foo is your package name? | 12:35 |
| *** paragan has joined #rdo | 12:35 | |
| mrunge | or https://apps.fedoraproject.org/packages/ if you prefer a web interface | 12:35 |
| *** jerrygb has joined #rdo | 12:36 | |
| honza | that's what i thought you meant | 12:36 |
| honza | so, we're publishing npm packages in fedora? | 12:36 |
| *** chandankumar has quit IRC | 12:36 | |
| hewbrocca | Not yet | 12:37 |
| mrunge | we're packaging nodejs- related packages in fedora, yes | 12:37 |
| *** eliska has quit IRC | 12:38 | |
| *** anshul has quit IRC | 12:39 | |
| honza | just did a cursory check and most of what we need isn't in fedora | 12:39 |
| *** shaunm has joined #rdo | 12:39 | |
| *** fultonj has joined #rdo | 12:40 | |
| *** jerrygb has quit IRC | 12:41 | |
| mrunge | honza, then I suppose you should check, how those deps are being packaged | 12:42 |
| *** ccamacho|lunch is now known as ccamacho | 12:42 | |
| honza | mrunge: my js deps? they're on npm and that's it | 12:42 |
| mrunge | honza, don't try to bundle everything and promise to unbundle later. let's be honest, that won't happen | 12:43 |
| honza | mrunge: what does unbundle mean? | 12:43 |
| mrunge | honza, package every dependency as a single package | 12:43 |
| mrunge | bundling means: copying all together, no? | 12:43 |
| *** eliska-mtg has joined #rdo | 12:44 | |
| honza | hmmmm | 12:44 |
| mrunge | for golang deps, there is a script to *nearly* automatically package golang dependencies | 12:44 |
| honza | I want to tar up node_modules to e.g. node_modules.tar.gz and then run "npm pack" in that same repo to produce a source tarball | 12:44 |
| *** rlandy has joined #rdo | 12:45 | |
| mrunge | honza, I don't envy you. | 12:45 |
| honza | then, the in the spec I'll untar the node_modules.tar.gz and run "npm run build" to produce the dist files | 12:45 |
| mrunge | honza, discuss that with product security | 12:45 |
| mrunge | that's comparable to static linking, no? | 12:46 |
| *** ashw has joined #rdo | 12:46 | |
| *** pstack has quit IRC | 12:46 | |
| honza | so, are you saying that publishing hundreds of dependencies to pypi via xstatic or to fedora is the way to go? | 12:47 |
| mrunge | nope | 12:47 |
| mrunge | you don't rely on python at all, no? | 12:47 |
| honza | no | 12:47 |
| honza | so no xstatic for me then | 12:47 |
| honza | what's left? | 12:47 |
| mrunge | then xstatic gives you nothing | 12:47 |
| mrunge | prober building packages? | 12:48 |
| *** hynekm has joined #rdo | 12:48 | |
| *** _elmiko is now known as elmiko | 12:48 | |
| hewbrocca | jtomasek: had you not given this whole packaging question some thought at one point? | 12:48 |
| honza | I don't follow | 12:48 |
| *** sasha2 has quit IRC | 12:49 | |
| honza | hewbrocca: jtomasek and i discussed this last week | 12:49 |
| mrunge | honza, build a package for each dependency would be my recommendation | 12:49 |
| * jtomasek reads back | 12:49 | |
| mrunge | a nodejs-foo-bar package for each dependency | 12:49 |
| number80 | good, we're progressing in requirements management upstream :) | 12:49 |
| hewbrocca | honza: I thought you might have | 12:49 |
| honza | mrunge: package here means rpm? | 12:49 |
| mrunge | correct | 12:49 |
| honza | hewbrocca: we were hoping to not have to publish hundreds of rpms :( | 12:50 |
| hewbrocca | indeed | 12:50 |
| mrunge | that's *my* recommendation and pov | 12:50 |
| number80 | honza: I suggest that you start progressively | 12:50 |
| mrunge | number80, might see it differently | 12:50 |
| number80 | bundle everything, and start unbundling | 12:50 |
| number80 | as said, we'll provide support | 12:51 |
| mrunge | number80, that won't happen, let's be honest, no? | 12:51 |
| mrunge | I mean, unbundling won't happen | 12:51 |
| mrunge | providing support will surely happen | 12:51 |
| honza | unbundling meaning that little by little you start removing libs from the tar file and publish it as an rpm? | 12:51 |
| jtomasek | mrunge: having each dependency explicitly packaged is the optimal way, yes, but since it is not possible at the moment, I believe it is possible to relax the rules a bit and let the app provide compiled source | 12:51 |
| jtomasek | we should be able to provide all dependencies sources | 12:51 |
| number80 | mrunge: possibly, but the red line is that minification/whatever toolchain must be unbundled | 12:51 |
| mrunge | jtomasek, then you'll end up in the same situation as static linking | 12:52 |
| number80 | that derives from a stronger requirements which is "I don't want to bang my head against a wall, bickering with lawyers" | 12:52 |
| jtomasek | number80: unbundled means having rpm package? | 12:52 |
| number80 | jtomasek: yes | 12:52 |
| *** karimb has joined #rdo | 12:53 | |
| number80 | source rpm must contains only sources, not generated files | 12:53 |
| honza | I don't think this is realistic at all. The speed at which npm packages are publish is staggering. How can we ever expect to keep up? | 12:53 |
| *** jhershbe has quit IRC | 12:53 | |
| honza | published* | 12:54 |
| mrunge | honza, other question: would you do a daily rebuild on your package source and package then? | 12:54 |
| dmsimard | tristanC: upstream openstack-infra centos images do not install firewalld and networkmanager (these tend to conflict with OpenStack things). firewalld and networkmanager are part of the centos-minimal image we use as a base image. upstream doesn't have it because they start from a bare image. Do you see a problem with removing them from our images ? | 12:54 |
| *** sasha2 has joined #rdo | 12:54 | |
| jtomasek | number80: let's take it from the other side a bit. What is the recommended way to create nodejs appllications in rdo/fedora ecosystem? | 12:54 |
| number80 | honza: well, legal constraints, we can't publish package which has files with dubious licensing or generated by unknown tool | 12:54 |
| jtomasek | number80: in general, there are no packages available | 12:54 |
| mrunge | jtomasek, honza stated, some are available | 12:55 |
| number80 | jtomasek: that's the current way, I agree it is painful but until we fix our build system, it's not changing in the near-future | 12:55 |
| jtomasek | mrunge: it is like 5% | 12:55 |
| *** jcoufal has joined #rdo | 12:55 | |
| number80 | some people like threebean are working on such topics | 12:55 |
| mrunge | jtomasek, better than nothing, no? | 12:55 |
| honza | react isn't even there | 12:55 |
| jtomasek | mrunge: we'll sure, but it does not currently solve the problem | 12:55 |
| number80 | at some point, we'll have internal npm registry and it'll be simpler | 12:55 |
| *** flepied has joined #rdo | 12:56 | |
| jtomasek | mrunge: waiting 5 years seems not a solution. So I'd expect that we have some strategy that relaxes the rules a bit | 12:56 |
| *** rhallisey has joined #rdo | 12:56 | |
| mrunge | jtomasek, waiting is one strategy, but maybe not the optimal one, no? | 12:56 |
| *** yfried has quit IRC | 12:56 | |
| *** pilasguru has joined #rdo | 12:56 | |
| jtomasek | mrunge: that is what I am saying | 12:57 |
| *** pstack has joined #rdo | 12:57 | |
| mrunge | jtomasek, then I'd suggest to start packaging | 12:57 |
| *** jhershbe has joined #rdo | 12:59 | |
| hewbrocca | Look, it wouldn't matter when we started, we're not going to individually package 800 node deps | 12:59 |
| number80 | jtomasek: we're actually relaxing rules by allowing reasonable bundling | 12:59 |
| hewbrocca | it's just not going to happen, so we should abandon that line of inquiry | 12:59 |
| mrunge | 800 dependencies? | 12:59 |
| mrunge | wow | 13:00 |
| number80 | hewbrocca: some of them may be packaged, and we only require the packages that are part of the minification/generation toolchain | 13:00 |
| hewbrocca | Right | 13:00 |
| hewbrocca | So, let's proceed that way | 13:00 |
| hewbrocca | we need to get the toolchain packaged in individual RPMs | 13:00 |
| *** egallen has quit IRC | 13:00 | |
| hewbrocca | do we know which ones those are? | 13:00 |
| number80 | *nods* | 13:00 |
| *** pilasguru has quit IRC | 13:01 | |
| number80 | well, tripleo-ui experts can tell us which ones are they | 13:01 |
| *** ohochman has joined #rdo | 13:01 | |
| *** pilasguru has joined #rdo | 13:02 | |
| *** ohochman has left #rdo | 13:02 | |
| *** trown|outtypewww is now known as trown | 13:03 | |
| jtomasek | number80: https://github.com/openstack/tripleo-ui/blob/master/package.json | 13:03 |
| *** tumble has joined #rdo | 13:03 | |
| *** egallen has joined #rdo | 13:03 | |
| *** mlammon1 has quit IRC | 13:03 | |
| *** mlammon has joined #rdo | 13:03 | |
| number80 | jtomasek: I can tell that less and webpack are good candidates | 13:04 |
| *** richm has joined #rdo | 13:04 | |
| number80 | I was told that gulp was in process to be removed, right? | 13:04 |
| jtomasek | number80: yes, nodejs, npm, webpack, less | 13:04 |
| jtomasek | number80: correct | 13:04 |
| number80 | nodejs/npm are available in CBS, we can work out versions shipped | 13:04 |
| hewbrocca | that's a good start | 13:05 |
| jtomasek | number80: webpack uses loaders - babel-loader | 13:05 |
| jtomasek | + babel presets. | 13:05 |
| number80 | jtomasek: so we need babel-core, babel-loader too | 13:05 |
| jtomasek | as we remove gulp, we'll have a few more loaders, but loaders are tiny without dependencies mostly | 13:05 |
| jtomasek | number80: we (with honza) can try to put together a list | 13:06 |
| *** limao_ has quit IRC | 13:07 | |
| number80 | excellent | 13:07 |
| dmsimard | trown: seeing more green but we still have work to do .. https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/501/ | 13:07 |
| jtomasek | number80: problem might be, that the tooling are usually most robust and have a lot of dependencies | 13:07 |
| jtomasek | number80: https://github.com/webpack/webpack/blob/master/package.json | 13:07 |
| hewbrocca | dmsimard: we're going to push a fix for the issue blocking the tripleo jobs as soon as it passes upstream CI | 13:07 |
| jtomasek | number80: also, is there a way to have multiple versions of the same npm modules? | 13:07 |
| jtomasek | number80: I believe so, right? | 13:08 |
| *** limao has joined #rdo | 13:08 | |
| dmsimard | hewbrocca: ok | 13:08 |
| hewbrocca | That *might* be the last thing blocking the trunk promote job | 13:08 |
| hewbrocca | Really need the Mitaka job fixed too, I don't know what the issue is there | 13:08 |
| jtomasek | number80: the problem is, that npm install builds a dependency tree where each dependency can depend on same node module but different version | 13:09 |
| *** laron has joined #rdo | 13:09 | |
| *** limao_ has joined #rdo | 13:10 | |
| jtomasek | number80: in general, wouldn't it be better to create a verified npm registry which could be used for building? instead of having to package every npm package independently | 13:10 |
| weshay | hewbrocca, mitaka just failed one job.. /me looks | 13:10 |
| *** dustins has joined #rdo | 13:10 | |
| hewbrocca | BRB folks | 13:11 |
| *** hewbrocca is now known as hewbrocca-afk | 13:11 | |
| trown | weshay: have been seeing httpd fail to start on mitaka minimal | 13:11 |
| weshay | yup.. https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-mitaka-delorean-minimal-627/undercloud/home/stack/failed_deployment_74c0728b-298c-4abe-950a-6dbb50dbb177.log.gz | 13:12 |
| trown | weshay: running a local run of it now to see if it is a CI only issue | 13:12 |
| number80 | jtomasek: yes, but we can't touch the build system | 13:12 |
| jtomasek | number80: how about something like this? https://fedoraproject.org/wiki/KojiMavenSupport | 13:12 |
| *** limao has quit IRC | 13:13 | |
| number80 | and if we were able to do that, you'd do the work anyway for the product as we have the same constraints | 13:13 |
| number80 | jtomasek: that'll happen in the future but it's work in progress | 13:13 |
| *** pgadiya has quit IRC | 13:13 | |
| *** dgurtner has quit IRC | 13:14 | |
| *** d0ugal has quit IRC | 13:14 | |
| *** hewbrocca-afk is now known as hewbrocca | 13:15 | |
| *** rdas has quit IRC | 13:16 | |
| *** limao has joined #rdo | 13:16 | |
| *** jdob has joined #rdo | 13:16 | |
| weshay | have introspection running now on master | 13:17 |
| jtomasek | number80: do you have some link to that work? I'd really like to take a look | 13:17 |
| *** limao_ has quit IRC | 13:18 | |
| *** vimal has quit IRC | 13:18 | |
| *** bfournie has joined #rdo | 13:19 | |
| dmsimard | trown: fyi I noticed something I will investigate today.. the upstream openstack-infra CentOS image does not have either firewalld or networkmanager .. which both come installed by default on the centos-minimal base we use in both ci.centos and review.rdo | 13:19 |
| jtomasek | number80: I am kind of worried that creating so many rpm packages is a waste of time, considering that it will eventually get replaced by an approved npm registry | 13:19 |
| *** abregman is now known as abregman|mtg | 13:19 | |
| honza | also, we're not necessarily involved with those projects --- would it make sense for us to do the packaging? | 13:20 |
| *** nmagnezi_ is now known as nmagnezi | 13:21 | |
| *** sdake has joined #rdo | 13:21 | |
| *** akshai has joined #rdo | 13:22 | |
| *** limao_ has joined #rdo | 13:22 | |
| rdogerrit | Michael Chapman created openstack/nova-distgit: Change nova shell from nologin to bash http://review.rdoproject.org/r/1693 | 13:23 |
| honza | number80: any sense of timeline on the npm registry thing? | 13:23 |
| *** michchap has joined #rdo | 13:24 | |
| *** jmelvin has joined #rdo | 13:24 | |
| *** chandankumar has joined #rdo | 13:25 | |
| *** limao has quit IRC | 13:25 | |
| *** imcleod has joined #rdo | 13:28 | |
| hewbrocca | There is a Node SCL | 13:28 |
| hewbrocca | this might solve some problems for us | 13:28 |
| weshay | afaict.. introspection is hanging on my local env | 13:29 |
| hewbrocca | weshay: that's expected if you don't yet have dtantsur patch | 13:29 |
| *** athomas has quit IRC | 13:29 | |
| rdogerrit | Jakub Ruzicka created rdopkg: patches: drop legacy patches branch rule for clients http://review.rdoproject.org/r/1694 | 13:29 |
| weshay | k.. I'll add his patch and retry | 13:29 |
| number80 | honza: I'm only sure that it won't happen before FY2018 | 13:29 |
| hewbrocca | number80: so there is an SCL for node-js | 13:30 |
| hewbrocca | available for RHEL 7 and I assume centos 7 | 13:30 |
| hewbrocca | honza, jtomasek ^^^ this might be a solution | 13:31 |
| jtomasek | hewbrocca: I think thrcka mentioned that to me some time ago. I'll get in touch with him about it again | 13:32 |
| hewbrocca | zsvetlik is the guy you want | 13:32 |
| hewbrocca | I was just talking to him | 13:32 |
| jtomasek | hewbrocca: ack | 13:33 |
| *** hynekm has quit IRC | 13:33 | |
| *** hmlnarik has joined #rdo | 13:34 | |
| number80 | fcami++ | 13:34 |
| zodbot | number80: Karma for fcami changed to 1 (for the f24 release cycle): https://badges.fedoraproject.org/tags/cookie/any | 13:34 |
| number80 | hewbrocca: well, SCL is a divise topic for us | 13:34 |
| *** zoli|lunch is now known as zoli|wfh | 13:35 | |
| *** nehar_ has joined #rdo | 13:35 | |
| *** nehar has quit IRC | 13:35 | |
| *** jerrygb has joined #rdo | 13:37 | |
| rdogerrit | Michael Chapman proposed openstack/nova-distgit: Change nova shell from nologin to bash http://review.rdoproject.org/r/1693 | 13:37 |
| *** gszasz has quit IRC | 13:38 | |
| hewbrocca | number80: how so | 13:39 |
| *** hmlnarik has quit IRC | 13:39 | |
| *** aortega has quit IRC | 13:39 | |
| *** gszasz has joined #rdo | 13:39 | |
| *** hmlnarik has joined #rdo | 13:39 | |
| *** hmlnarik has quit IRC | 13:39 | |
| *** hmlnarik has joined #rdo | 13:39 | |
| *** hynekm has joined #rdo | 13:40 | |
| hewbrocca | dmsimard: et al, can you guys update the various promote etherpads | 13:40 |
| hewbrocca | with current status of all the issues, including *who* owns each issue? | 13:40 |
| *** jerrygb has quit IRC | 13:41 | |
| hewbrocca | weshay: ^^^ | 13:41 |
| *** egafford has joined #rdo | 13:41 | |
| EmilienM | hewbrocca: updating | 13:42 |
| hewbrocca | EmilienM: many thanks | 13:43 |
| *** dgurtner has joined #rdo | 13:43 | |
| EmilienM | all is green for puppet CI atm | 13:43 |
| *** d0ugal has joined #rdo | 13:43 | |
| hewbrocca | EmilienM: excellent | 13:43 |
| hewbrocca | we haven't had an RDO trunk promote in 15 days now | 13:44 |
| hewbrocca | I'm trying to get that solved | 13:44 |
| hewbrocca | or a Mitaka promote in... 5 days I think? | 13:44 |
| weshay | 5 days is not unusual | 13:45 |
| hewbrocca | it's going to bite us pretty soon because we're trying to kick OSP9 out the door | 13:46 |
| weshay | hewbrocca, the issue w/ mitaka was httpd did not start on one test job for tripleo | 13:46 |
| weshay | it did start on the HA job.. I believe trown is looking at that issue right now | 13:46 |
| *** priteau has quit IRC | 13:46 | |
| *** priteau has joined #rdo | 13:47 | |
| *** nehar_ has quit IRC | 13:47 | |
| hewbrocca | cool | 13:47 |
| *** akrivoka has quit IRC | 13:47 | |
| *** rdo has quit IRC | 13:48 | |
| *** rdo has joined #rdo | 13:50 | |
| *** pstack has quit IRC | 13:50 | |
| *** akrivoka has joined #rdo | 13:51 | |
| *** abregman|mtg has quit IRC | 13:52 | |
| trown | just failed to reproduce it locally | 13:52 |
| trown | pinche CI | 13:52 |
| hewbrocca | number80: what's the problem with SCL, just so I understand? | 13:52 |
| *** jerrygb has joined #rdo | 13:53 | |
| number80 | hewbrocca: it's non-intrusive to the system but it's kinda packaging-intrusive | 13:53 |
| hewbrocca | If it means we get node more or less for free though, that would be pretty cool, right? | 13:54 |
| number80 | I'm not mentioning also the dependency galore, you have to rebuild dependencies on top of SCL if it doesn't exist | 13:54 |
| *** eliska-mtg has quit IRC | 13:54 | |
| hewbrocca | hmm | 13:54 |
| number80 | hewbrocca: node ain't a problem, but SCL doesn't come with all the dependencies we may need | 13:54 |
| hewbrocca | even the toolchain ones? | 13:54 |
| number80 | yes | 13:54 |
| hewbrocca | ahh | 13:54 |
| hewbrocca | I can see how that would be an issue | 13:54 |
| hewbrocca | We might be able to get them added? | 13:55 |
| number80 | what's interesting for us is to provide alternative stacks like python3 on EL7 for instance | 13:55 |
| number80 | hewbrocca: probably, at least in our repositories | 13:55 |
| *** mgarciam has joined #rdo | 13:56 | |
| hewbrocca | OK. We'll have a closer look and see if it helps | 13:56 |
| number80 | CentOS SCLs try to remain consistent with RHEL's so not sure that we can push additional packages there | 13:56 |
| number80 | ack | 13:56 |
| hewbrocca | I get the impression from talking to the SCL guys here that they are hungry for RFEs | 13:56 |
| hewbrocca | I don't know what schedule they ship on though | 13:56 |
| *** limao_ has quit IRC | 13:57 | |
| *** _milan_ has joined #rdo | 13:57 | |
| weshay | hewbrocca, trown https://review.openstack.org/#/c/344792/ fixes the issue | 13:57 |
| *** athomas has joined #rdo | 13:58 | |
| *** limao has joined #rdo | 13:58 | |
| hewbrocca | weshay: which one is that, mitaka? | 13:59 |
| weshay | master | 13:59 |
| weshay | introspection | 13:59 |
| hewbrocca | Oh, right | 13:59 |
| hewbrocca | soon as it passes upstream CI we'll get it in | 14:00 |
| *** eliska has joined #rdo | 14:00 | |
| weshay | it failed upstream | 14:00 |
| * weshay looking at that now | 14:00 | |
| weshay | w/ sshnaidm|lnch | 14:00 |
| weshay | pinche CI | 14:00 |
| hewbrocca | ipv6? | 14:00 |
| *** dgurtner has quit IRC | 14:00 | |
| *** dtantsur is now known as dtantsur|mtg | 14:00 | |
| weshay | gate-tripleo-ci-centos-7-ovb-ha | 14:00 |
| *** sshnaidm|lnch is now known as sshnaidm | 14:00 | |
| *** eliska is now known as eliska-mtg | 14:00 | |
| *** milan has quit IRC | 14:01 | |
| trown | dmsimard: any idea on https://ci.centos.org/view/rdo/view/promotion-pipeline/job/weirdo-master-promote-puppet-openstack-scenario001/ | 14:02 |
| trown | looks pretty fail :) | 14:02 |
| *** sdake_ has joined #rdo | 14:02 | |
| trown | and nothing in https://etherpad.openstack.org/p/delorean_master_current_issues | 14:02 |
| *** Alex_Stef has quit IRC | 14:02 | |
| dmsimard | trown: got my caffeine now, checking. | 14:02 |
| *** dgurtner has joined #rdo | 14:02 | |
| *** dgurtner has joined #rdo | 14:02 | |
| *** shardy has joined #rdo | 14:03 | |
| dmsimard | trown: looks like the ceph issue again, that should be resolved as of yesterday PM | 14:03 |
| dmsimard | looking if the fix was effective in that job .. | 14:03 |
| *** sdake has quit IRC | 14:03 | |
| dmsimard | trown: no, my fix wasn't effective for that job | 14:04 |
| dmsimard | trown: it installed the ceph hammer repo instead of the ceph jewel repo | 14:04 |
| dmsimard | trown: looks like gerrit replication for weirdo repo doesn't work.. looking | 14:04 |
| *** sdake has joined #rdo | 14:04 | |
| *** fultonj has quit IRC | 14:06 | |
| *** fultonj has joined #rdo | 14:07 | |
| *** rhallisey has quit IRC | 14:07 | |
| dmsimard | number80: oh no :( | 14:07 |
| *** trozet has quit IRC | 14:07 | |
| *** sdake_ has quit IRC | 14:07 | |
| dmsimard | I really need to pay more attention in reviews | 14:08 |
| *** zoli|wfh is now known as zoli|brb | 14:08 | |
| dmsimard | https://review.rdoproject.org/r/gitweb?p=config.git;a=blob;f=gerrit/replication.config;h=6ea85bb374c005a61c6d77eb7d8135915bfa0182;hb=refs/heads/master#l23 | 14:08 |
| *** rhallisey has joined #rdo | 14:08 | |
| dmsimard | weirdo is prefixed by rdo-infra/ not openstack/ | 14:08 |
| *** trozet has joined #rdo | 14:08 | |
| rdogerrit | David Moreau Simard created config: WeIRDO repositories are in the rdo-infra namespace http://review.rdoproject.org/r/1695 | 14:08 |
| rdogerrit | Merged config: WeIRDO repositories are in the rdo-infra namespace http://review.rdoproject.org/r/1695 | 14:09 |
| number80 | dmsimard: btw, any idea why => https://review.rdoproject.org/r/#/c/1686/ | 14:09 |
| number80 | no +V | 14:10 |
| *** ohochman has joined #rdo | 14:10 | |
| number80 | the gate does not run at all | 14:10 |
| dmsimard | trown: replication is fixed and was sent to github now .. next time the job runs it'll pull the role with the fix now | 14:10 |
| *** przem has quit IRC | 14:10 | |
| trown | dmsimard++ thanks | 14:11 |
| *** dgurtner has quit IRC | 14:12 | |
| *** yfried has joined #rdo | 14:12 | |
| dmsimard | number80: is it rebased on top of https://review.rdoproject.org/r/#/c/1635/ ? | 14:12 |
| *** dgurtner has joined #rdo | 14:12 | |
| dmsimard | number80: hard to tell from gerrit UI without cloning the review and checking the dependant commit | 14:12 |
| dmsimard | if it's rebased on top of a review that hasn't merged, the gate jobs will not run | 14:13 |
| dmsimard | number80: yeah, it says the parent is that review | 14:13 |
| dmsimard | and TIL I learned how to check the parent/child relationship in the gerrit UI | 14:14 |
| *** alexismonville has joined #rdo | 14:16 | |
| *** King_InuYasha is now known as Son_Goku | 14:17 | |
| rdogerrit | Jakub Ruzicka created rdopkg: guess: only consider open patch reviews http://review.rdoproject.org/r/1696 | 14:17 |
| *** dhill_ has joined #rdo | 14:18 | |
| *** dhill_ has quit IRC | 14:19 | |
| *** p01nt3r75 has joined #rdo | 14:19 | |
| *** dhill_ has joined #rdo | 14:19 | |
| *** rdobot has joined #rdo | 14:21 | |
| *** ChanServ sets mode: +v rdobot | 14:21 | |
| *** saneax is now known as saneax_AFK | 14:22 | |
| *** tosky has quit IRC | 14:24 | |
| *** dgurtner has quit IRC | 14:25 | |
| number80 | dmsimard: damn | 14:28 |
| rdogerrit | Jakub Ruzicka created rdopkg: Remove unused gerrit module http://review.rdoproject.org/r/1697 | 14:29 |
| number80 | well, I need to block an afternoon | 14:29 |
| *** rdobot has quit IRC | 14:29 | |
| *** gszasz has quit IRC | 14:29 | |
| *** dtrainor has joined #rdo | 14:31 | |
| *** julim has quit IRC | 14:32 | |
| jrist | number80: can you point me to agenda for #rdo meetings? | 14:32 |
| jrist | please :) | 14:32 |
| *** gszasz has joined #rdo | 14:32 | |
| dmsimard | jrist: https://etherpad.openstack.org/p/RDO-Meeting | 14:32 |
| jrist | brilliant thanks | 14:33 |
| rbowen | Also, a useful resource: https://etherpad.openstack.org/p/RDO | 14:33 |
| jrist | number80: ignore :) | 14:33 |
| jrist | rbowen: boom, thanks | 14:33 |
| jrist | those would be good in the topic but the topic is already huge :) | 14:33 |
| *** d0ugal has quit IRC | 14:33 | |
| rdogerrit | Jakub Ruzicka proposed rdopkg: Remove unused gerrit module http://review.rdoproject.org/r/1697 | 14:33 |
| jrist | rbowen: oh wow that is quite useful | 14:33 |
| jrist | etherpad of etherpads | 14:34 |
| jrist | etherpads all the way down | 14:34 |
| *** eliska-mtg has quit IRC | 14:34 | |
| rbowen | :) | 14:34 |
| number80 | jrist: well, we can trim it | 14:34 |
| jrist | the royal we? :) | 14:34 |
| *** shardy is now known as shardy_mtg | 14:35 | |
| number80 | nah, I'm hardcore republican :) | 14:35 |
| *** mengxd has joined #rdo | 14:35 | |
| jrist | ROFL | 14:35 |
| *** dgurtner has joined #rdo | 14:37 | |
| *** dgurtner has joined #rdo | 14:37 | |
| *** nmagnezi has quit IRC | 14:38 | |
| dmsimard | trown, weshay: FYI I'm testing new virtualized ci.centos.org slaves right now. | 14:39 |
| *** zoli|brb is now known as zoli|wfh | 14:39 | |
| dmsimard | please report if you see any funkiness, sorry in advance but this is for the best | 14:39 |
| *** jistr is now known as jistr|mtg | 14:39 | |
| weshay | dmsimard, thanks | 14:39 |
| *** dhill_ has quit IRC | 14:40 | |
| *** d0ugal has joined #rdo | 14:41 | |
| rdogerrit | Merged rdopkg: guess: only consider open patch reviews http://review.rdoproject.org/r/1696 | 14:41 |
| number80 | jruzicka++ | 14:41 |
| zodbot | number80: Karma for jruzicka changed to 1 (for the f24 release cycle): https://badges.fedoraproject.org/tags/cookie/any | 14:41 |
| *** hynekm has quit IRC | 14:41 | |
| *** hynekm has joined #rdo | 14:42 | |
| rdogerrit | Jakub Ruzicka proposed rdopkg: Remove unused gerrit module http://review.rdoproject.org/r/1697 | 14:42 |
| *** apevec has joined #rdo | 14:42 | |
| rdogerrit | Jakub Ruzicka proposed rdopkg: patches: drop legacy patches branch rule for clients http://review.rdoproject.org/r/1694 | 14:42 |
| rdogerrit | Merged rdopkg: Remove unused gerrit module http://review.rdoproject.org/r/1697 | 14:45 |
| imcsk8 | jschlueter: https://review.openstack.org/#/c/344664/ | 14:45 |
| *** dhill_ has joined #rdo | 14:46 | |
| rdogerrit | Jakub Ruzicka proposed rdopkg: patches: drop legacy patches branch rule for clients http://review.rdoproject.org/r/1694 | 14:46 |
| imcsk8 | jschlueter: can you check that one out and see if you still have the nova network problem? | 14:46 |
| apevec | imcsk8, does that patch fixes it? | 14:46 |
| dmsimard | trown: we already have jobs running on the new slaves \o/ | 14:46 |
| imcsk8 | apevec: from my end it does, but i would like other opinion | 14:46 |
| apevec | ack | 14:46 |
| trown | dmsimard: magic | 14:47 |
| dmsimard | will monitor these to see if they work | 14:47 |
| *** jcoufal has quit IRC | 14:47 | |
| imcsk8 | apevec: it was a pretty sneaky fix | 14:47 |
| dmsimard | https://ci.centos.org/job/tripleo-quickstart-gate-mitaka-delorean-full-minimal/112/ | 14:47 |
| dmsimard | https://ci.centos.org/job/tripleo-quickstart-gate-liberty-delorean-full-minimal/111/ | 14:47 |
| dmsimard | https://ci.centos.org/job/tripleo-quickstart-gate-liberty-delorean-roles-minimal/44/ | 14:47 |
| apevec | imcsk8, whatever it takes :) | 14:47 |
| dmsimard | https://ci.centos.org/job/tripleo-quickstart-gate-mitaka-delorean-roles-minimal/46/ | 14:47 |
| *** jcoufal has joined #rdo | 14:47 | |
| apevec | dmsimard, where are the new slaves? | 14:47 |
| dmsimard | apevec: ci.centos openstack cloud | 14:47 |
| apevec | no way, we got networking !? | 14:48 |
| jjoyce | imcsk8: jschlueter is not around today. | 14:48 |
| dmsimard | apevec: they tweaked MTU settings and it works now | 14:48 |
| apevec | and afazekas|dentist | 14:48 |
| imcsk8 | apevec: sorry it took me a while find the proper solution, it was confusing | 14:48 |
| dmsimard | apevec: MTU problems are the worse problems. | 14:48 |
| dmsimard | trown: it's failing, checking why | 14:48 |
| apevec | dmsimard, oh yeah, esp when you don't have access to all the devices in the path | 14:49 |
| dmsimard | trown: oh, I guess I need to setup a ssh key for connecting to the duffy nodes, forgot that. | 14:49 |
| trown | dmsimard: hmm k, if that doesnt work, maybe we can put a label on those new ones and run some test jobs before doing the whole switch :) | 14:49 |
| rdogerrit | Merged rdopkg: patches: drop legacy patches branch rule for clients http://review.rdoproject.org/r/1694 | 14:49 |
| *** tosky has joined #rdo | 14:50 | |
| trown | dmsimard: dont want promote jobs getting scheduled there right now | 14:50 |
| *** egafford has quit IRC | 14:50 | |
| apevec | last pipeline run (still running ha) https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/504/ - we have puppet scenario001 failing | 14:50 |
| apevec | but packstack scenario001 passed | 14:50 |
| trown | apevec: ya, should be fixed in next run according to dmsimard | 14:50 |
| *** rook has joined #rdo | 14:50 | |
| imcsk8 | meeting in 10 minutes guys... | 14:50 |
| apevec | ah cool | 14:50 |
| *** aortega has joined #rdo | 14:52 | |
| *** aortega has quit IRC | 14:52 | |
| *** aortega has joined #rdo | 14:52 | |
| trown | dmsimard: I just went ahead and made a label for those new slaves for now rdo-dev | 14:52 |
| trown | they just screwed up the mitaka pipeline | 14:53 |
| trown | dmsimard: so lets use a poc that targets rdo-dev and confirm it works before putting them back to rdo label | 14:53 |
| apevec | trown, 3o minimal also failed | 14:53 |
| weshay | dam | 14:54 |
| trown | apevec: ya that one is issue 18 https://etherpad.openstack.org/p/delorean_master_current_issues | 14:54 |
| apevec | ah new one | 14:54 |
| trown | fyi I will be cutting out pretty early from the meeting for a dr appt | 14:56 |
| dmsimard | trown: ok sure | 14:57 |
| dmsimard | trown: I just copied the ssh config over to the new slaves | 14:57 |
| *** jaosorior has quit IRC | 14:57 | |
| *** hynekm has quit IRC | 14:58 | |
| trown | dmsimard: cool kicked https://ci.centos.org/view/rdo/view/promotion-pipeline/job/poc-new-slaves-tripleo-quickstart-periodic-liberty-delorean-full-deploy-minimal/ to test | 14:59 |
| dmsimard | I'm gonna kick a lot more than that :p | 14:59 |
| jruzicka | meeting time | 14:59 |
| imcsk8 | meeting time guys | 15:00 |
| apevec | yes | 15:00 |
| apevec | start it up | 15:00 |
| imcsk8 | #startmeeting RDO meeting - 2016-07-20 | 15:00 |
| zodbot | Meeting started Wed Jul 20 15:00:30 2016 UTC. The chair is imcsk8. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| zodbot | Useful Commands: #action #agreed #halp #info #idea #link #topic. | 15:00 |
| zodbot | The meeting name has been set to 'rdo_meeting_-_2016-07-20' | 15:00 |
| *** sshnaidm is now known as sshnaidm|mtg | 15:00 | |
| openstack | Meeting started Wed Jul 20 15:00:30 2016 UTC and is due to finish in 60 minutes. The chair is imcsk8. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| openstack | The meeting name has been set to 'rdo_meeting___2016_07_20' | 15:00 |
| imcsk8 | #topic roll call | 15:00 |
| *** rbowen sets mode: -v openstack | 15:00 | |
| coolsvap | o/ | 15:00 |
| rbowen | ¯\_(ツ)_/¯ | 15:01 |
| mengxd | o/ | 15:01 |
| apevec | o/ | 15:01 |
| imcsk8 | #chair apevec coolsvap jruzicka rbowen mengxd | 15:01 |
| openstack | Current chairs: apevec coolsvap imcsk8 jruzicka mengxd rbowen | 15:01 |
| zodbot | Current chairs: apevec coolsvap imcsk8 jruzicka mengxd rbowen | 15:01 |
| jjoyce | o/ | 15:01 |
| trown | ☃ | 15:01 |
| imcsk8 | #chair jjoyce trown | 15:01 |
| zodbot | Current chairs: apevec coolsvap imcsk8 jjoyce jruzicka mengxd rbowen trown | 15:01 |
| openstack | Current chairs: apevec coolsvap imcsk8 jjoyce jruzicka mengxd rbowen trown | 15:01 |
| imcsk8 | ok, let's start | 15:02 |
| eggmaster | \m/ -_- \m/ | 15:02 |
| *** pstack has joined #rdo | 15:02 | |
| imcsk8 | #chair eggmaster | 15:02 |
| openstack | Current chairs: apevec coolsvap eggmaster imcsk8 jjoyce jruzicka mengxd rbowen trown | 15:02 |
| zodbot | Current chairs: apevec coolsvap eggmaster imcsk8 jjoyce jruzicka mengxd rbowen trown | 15:02 |
| *** yfried has quit IRC | 15:02 | |
| apevec | trown, it's too hot for snowman | 15:02 |
| imcsk8 | #topic newton2 testday readiness | 15:02 |
| trown | wishful thinking | 15:02 |
| apevec | is that testday readiness summary? :) | 15:03 |
| weshay | heh | 15:03 |
| trown | lol, it does work there too | 15:03 |
| apevec | so we're down to 1 issue | 15:03 |
| *** zeroshft has joined #rdo | 15:03 | |
| trown | though I think there is a better chance of promotion than building a snowman outside right now | 15:03 |
| trown | so we have that going for us | 15:03 |
| weshay | there is a weirdo failure on scen001 | 15:04 |
| apevec | dmsimard, ^ has it fixed for the next run iiuc ? | 15:04 |
| weshay | and a introspection issue that we've confirmed https://review.openstack.org/#/c/344792/ fixes | 15:04 |
| apevec | it's only puppet scn1 | 15:04 |
| trown | overcloud deploy just failed on HA as well, which would not be introspection | 15:04 |
| weshay | doh | 15:04 |
| number80 | o/ | 15:04 |
| trown | waiting on logs | 15:05 |
| chandankumar | \o/ | 15:05 |
| imcsk8 | #chair chandankumar | 15:05 |
| zodbot | Current chairs: apevec chandankumar coolsvap eggmaster imcsk8 jjoyce jruzicka mengxd rbowen trown | 15:05 |
| openstack | Current chairs: apevec chandankumar coolsvap eggmaster imcsk8 jjoyce jruzicka mengxd rbowen trown | 15:05 |
| dmsimard | apevec: yeah, the gerrit replication wasn't working since the gerrit replication revamp for weirdo repositories | 15:05 |
| dmsimard | so the fix landed in the gerrit repo but wasn't replicated to github | 15:05 |
| dmsimard | fixed it this morning | 15:05 |
| trown | ha still has a high transient failure rate, so might not be a new issue | 15:05 |
| dmsimard | trown: see my comment re: firewalld and networkmanager | 15:05 |
| dmsimard | ? | 15:05 |
| dmsimard | trown: it might explain the flapping to a certain extent | 15:05 |
| trown | dmsimard: hmm, maybe you could uninstall those at the beginning of weirdo? | 15:06 |
| jtomasek | o/ | 15:06 |
| imcsk8 | #chair jtomasek | 15:06 |
| zodbot | Current chairs: apevec chandankumar coolsvap eggmaster imcsk8 jjoyce jruzicka jtomasek mengxd rbowen trown | 15:06 |
| openstack | Current chairs: apevec chandankumar coolsvap eggmaster imcsk8 jjoyce jruzicka jtomasek mengxd rbowen trown | 15:06 |
| florianf | o/ | 15:06 |
| imcsk8 | #chair florianf | 15:06 |
| zodbot | Current chairs: apevec chandankumar coolsvap eggmaster florianf imcsk8 jjoyce jruzicka jtomasek mengxd rbowen trown | 15:06 |
| openstack | Current chairs: apevec chandankumar coolsvap eggmaster florianf imcsk8 jjoyce jruzicka jtomasek mengxd rbowen trown | 15:07 |
| dmsimard | trown: would ideally not manage that in weirdo (i.e, bake it in the image for review.rdo and do it some other way for ci.centos) | 15:07 |
| *** Liuqing has quit IRC | 15:07 | |
| dmsimard | but yeah, we should definitely try it | 15:07 |
| trown | k | 15:07 |
| jrist | #chair jrist | 15:07 |
| dmsimard | see if that fixes some flapping | 15:07 |
| number80 | jrist: only chairs can chair | 15:07 |
| jrist | oh :) | 15:07 |
| jrist | o/ | 15:07 |
| imcsk8 | #chair jrist | 15:08 |
| openstack | Current chairs: apevec chandankumar coolsvap eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd rbowen trown | 15:08 |
| zodbot | Current chairs: apevec chandankumar coolsvap eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd rbowen trown | 15:08 |
| apevec | so summary for the meeting minutes is: not ready but have a good chance? | 15:08 |
| *** jprovazn has quit IRC | 15:08 | |
| *** rcernin has quit IRC | 15:09 | |
| dmsimard | yeah and | 15:09 |
| apevec | we can retrigger after introspection fix is merged and built in dlrn | 15:09 |
| dmsimard | #action dmsimard to investigate if removing firewalld and networkmanager from the default centos installations can help alleviate flapping results | 15:09 |
| apevec | (18. in current issues) | 15:09 |
| apevec | dmsimard, ^ is there more info on that? where have you seen it in logs? | 15:10 |
| apevec | NM was supposed to work fine w/ Packstack | 15:10 |
| apevec | imcsk8, ^ ? | 15:10 |
| dmsimard | apevec: it's part intuition, part it's documented to remove those anyway, part these are not installed upstream | 15:10 |
| imcsk8 | apevec: i've been testing packstack without disabling NM for a while now with no problems | 15:11 |
| apevec | imcsk8, what about firewalld ? | 15:11 |
| apevec | it could be disabled w/o removing? | 15:11 |
| *** pstack has quit IRC | 15:11 | |
| imcsk8 | firewalld has to be disabled at least | 15:11 |
| *** oshvartz has quit IRC | 15:12 | |
| *** rcernin has joined #rdo | 15:12 | |
| *** pstack has joined #rdo | 15:12 | |
| apevec | ok, who will watch over 18. and retrigger promotion pipeline when it gets build in RDO Trunk ? | 15:13 |
| imcsk8 | apevec, dmsimard https://github.com/puppetlabs/puppetlabs-firewall/blob/master/manifests/linux/redhat.pp#L29 | 15:14 |
| apevec | oh it is not +W yet? https://review.openstack.org/#/c/344792/ | 15:14 |
| imcsk8 | the firewall puppet module disables firewalld | 15:15 |
| trown | #action trown babysit instack-undercloud patch | 15:15 |
| trown | apevec: no it is not passing upstream CI, because upstream CI issues | 15:15 |
| number80 | seriously? | 15:15 |
| number80 | (the firewalld thing) | 15:16 |
| weshay | ya.. downloading packages | 15:16 |
| weshay | weee | 15:16 |
| trown | anything else on this topic? | 15:16 |
| imcsk8 | ok, let's continue | 15:16 |
| imcsk8 | #topic RDO CI: POWER nodes sizing (w/ mengxd) | 15:17 |
| mengxd | yes, i want to discuss with team to understand the h/w requirements for RDO CI | 15:18 |
| mengxd | https://ci.centos.org/view/rdo/view/all/ | 15:18 |
| weshay | k | 15:18 |
| *** mgarciam has quit IRC | 15:18 | |
| *** belmoreira has quit IRC | 15:18 | |
| mengxd | from the above link, i can see there are about 5 nodes used for RDO ci. Is this number correct? | 15:19 |
| *** trown is now known as trown|dr | 15:19 | |
| weshay | nodes? | 15:20 |
| mengxd | physical server | 15:20 |
| mengxd | that is the physical servers in the node pool in the CI system, right? | 15:20 |
| weshay | we have the slave governed to start 15 max at any time | 15:20 |
| *** eharney has joined #rdo | 15:20 | |
| weshay | mengxd, atm I see all 15 running | 15:21 |
| weshay | so there will be at least 15 servers/nodes reserved by rdo-ci atm.. plus any that have "leaked" | 15:21 |
| mengxd | weshay: i think that 15 is the CI pipelines, not the nodes | 15:21 |
| weshay | 15 physical servers | 15:22 |
| *** rcernin has quit IRC | 15:22 | |
| dmsimard | mengxd, weshay: We're in the process of adding more slave capacity | 15:22 |
| mengxd | i saw 15 pipelines under rdo-ci-slave01 | 15:22 |
| dmsimard | mostly to distribute the load and have redundancy | 15:22 |
| weshay | dmsimard, ya.. we should then limit each to 5 jobs | 15:23 |
| weshay | if we end up w/ 3 | 15:23 |
| weshay | 3 slaves | 15:23 |
| dmsimard | We will lower the amount of threads on the current slave and use 3 more slaves (2 are under testing right now) | 15:23 |
| weshay | mengxd, not sure what you mean re: pipelines | 15:23 |
| weshay | dmsimard++ | 15:23 |
| zodbot | weshay: Karma for dmsimard changed to 3 (for the f24 release cycle): https://badges.fedoraproject.org/tags/cookie/any | 15:23 |
| weshay | mengxd, each job when running uses 1 physical server | 15:24 |
| mengxd | weshay: do we really need one physical for a job? i thought they are running on top of VMs | 15:24 |
| *** gszasz has quit IRC | 15:24 | |
| weshay | mengxd, yes we need that | 15:24 |
| dmsimard | mengxd: there will be an openstack cloud available for virtual workloads | 15:25 |
| dmsimard | soon | 15:25 |
| weshay | these jobs are deploying openstack on vms on top of the physical server | 15:25 |
| *** tesseract- has quit IRC | 15:25 | |
| dmsimard | mengxd: we try not to run jobs directly on the slaves as they are static, we run the jobs on ephemeral nodes | 15:25 |
| *** aufi has quit IRC | 15:25 | |
| *** edannon has quit IRC | 15:25 | |
| weshay | hopefully we have no jobs running on the slaves | 15:25 |
| mengxd | ok, then if i need to enable RDO on ppc64le, what is the minimal h/w requirements? which will trigger the ci job? | 15:25 |
| dmsimard | weshay: we might have some things.. like lint jobs or things like that | 15:26 |
| *** lkuchlan has quit IRC | 15:26 | |
| *** sdake has quit IRC | 15:26 | |
| dmsimard | mengxd: we don't have ppc64le available on the ci.centos environment, I don't think | 15:26 |
| dmsimard | mengxd: would need to check. | 15:26 |
| mengxd | you are right, but i have an interest to enable that | 15:26 |
| mengxd | so i want to get some idea about the h/w requirements if we do so. | 15:27 |
| dmsimard | mengxd: okay, right | 15:27 |
| weshay | http://docs.openstack.org/developer/tripleo-docs/environments/virtual.html | 15:27 |
| *** dtantsur|mtg is now known as dtantsur | 15:27 | |
| *** pstack has quit IRC | 15:27 | |
| weshay | for CI, we need to test w/ HA.. which requires 64gb of memory on the host | 15:27 |
| weshay | same w/ upgrades | 15:27 |
| imcsk8 | #chair weshay | 15:27 |
| zodbot | Current chairs: apevec chandankumar coolsvap eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd rbowen trown weshay | 15:27 |
| number80 | please provide multiple scenarios | 15:27 |
| openstack | Current chairs: apevec chandankumar coolsvap eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd rbowen trown weshay | 15:27 |
| dmsimard | mengxd: This is the documentation for the hardware currently on ci.centos.org: https://wiki.centos.org/QaWiki/PubHardware | 15:27 |
| imcsk8 | #chair number80 | 15:28 |
| zodbot | Current chairs: apevec chandankumar coolsvap eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd number80 rbowen trown weshay | 15:28 |
| openstack | Current chairs: apevec chandankumar coolsvap eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd number80 rbowen trown weshay | 15:28 |
| *** pstack has joined #rdo | 15:28 | |
| imcsk8 | #chair dmsimard | 15:28 |
| zodbot | Current chairs: apevec chandankumar coolsvap dmsimard eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd number80 rbowen trown weshay | 15:28 |
| openstack | Current chairs: apevec chandankumar coolsvap dmsimard eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd number80 rbowen trown weshay | 15:28 |
| dmsimard | mengxd: Jobs are currently running on nodes with 32GB ram, 8 cores and disk space varies between 200GB to 500GB I believe | 15:28 |
| mengxd | so from the 1st link, it seems one big power server is enough for triple-o test | 15:28 |
| dmsimard | mengxd: some jobs are designed to fit within 8GB of ram, others really require 32GB at the very least. | 15:29 |
| *** sdake has joined #rdo | 15:29 | |
| weshay | dmsimard, mengxd really 32gb is min, 64 is ideal | 15:29 |
| *** pstack has quit IRC | 15:29 | |
| dmsimard | weshay: there's no 64GB anywhere on ci.centos, where's that number from ? | 15:29 |
| weshay | w/o 64 we can't test a sudo supported deployment | 15:29 |
| weshay | dmsimard, aye I know | 15:29 |
| jrist | in fact he's probably the most familiar, ha | 15:30 |
| number80 | mengxd: we'll need also enough capacity for gating DLRN changes (I mean packaging changes) | 15:30 |
| dmsimard | number80: that's from review.rdo though | 15:30 |
| number80 | dmsimard: well, we can plug external CI | 15:30 |
| mengxd | so what will trigger a RDO CI job now? | 15:30 |
| dmsimard | number80: though it could be third party | 15:30 |
| *** pstack has joined #rdo | 15:30 | |
| imcsk8 | isn't 65Gb too much?? | 15:30 |
| imcsk8 | (64) | 15:31 |
| dmsimard | imcsk8: tripleo. | 15:31 |
| number80 | for 3o? nope | 15:31 |
| weshay | mengxd, an update to a yum repo | 15:31 |
| weshay | mengxd, and we also have periodic triggers | 15:31 |
| number80 | actually 32Go is barely enough | 15:31 |
| mengxd | btw, i can run full Tempest with 16GB memory on a CentOS VM, not sure why we need 64GB here | 15:31 |
| dmsimard | mengxd: we periodically check if new RDO packages have been built and if so, we trigger a series of jobs to check if those packages work well. | 15:31 |
| *** pstack has quit IRC | 15:31 | |
| dmsimard | mengxd: tripleo has particular requirements | 15:31 |
| mengxd | are you running full Tempest? | 15:31 |
| dmsimard | mengxd: packstack and puppet-openstack don't require more than 8GB of RAM | 15:32 |
| weshay | mengxd, for HA 3 controller, 2 compute 1 ceph is the min official support arch | 15:32 |
| weshay | we don't attempt that today | 15:32 |
| weshay | but that is the CI requirement | 15:32 |
| weshay | we work w/ in the current hardware atm | 15:32 |
| weshay | and test the rest else where | 15:32 |
| *** pstack has joined #rdo | 15:32 | |
| mengxd | ok, so even for triple-O, we can test RDO with VMs (nested virtualization), right? | 15:33 |
| weshay | we're very happy w/ what we have.. but those our the requirements we've been given | 15:33 |
| dmsimard | mengxd: yes, we test with nested virtualization in the review.rdoproject.org and the review.openstack.org environment. | 15:33 |
| *** pstack has quit IRC | 15:33 | |
| dmsimard | mengxd: well, wait, I read that wrong | 15:33 |
| dmsimard | mengxd: tripleo does nested virt itself (through tripleo-quickstart), the job is not designed to run on a VM (since then you'll end up with ultimately 3 layers of nested virt) | 15:34 |
| *** pstack has joined #rdo | 15:34 | |
| weshay | dmsimard, that does work though | 15:34 |
| dmsimard | weshay: quickstart on VMs ? must be slow, no ? | 15:34 |
| weshay | ya.. not saying it's ideal.. but it works | 15:35 |
| dmsimard | ok | 15:35 |
| number80 | that explains why jobs are so long | 15:35 |
| mengxd | ok, usually how long will each CI job take? | 15:35 |
| dmsimard | number80: which jobs ? | 15:35 |
| number80 | dmsimard: tripleo | 15:35 |
| number80 | mengxd: 3 to 5 hours | 15:35 |
| dmsimard | mengxd: packstack and puppet openstack finish within 45 minutes, tripleo takes several hours | 15:36 |
| weshay | mengxd, w/ quickstart a min job is 1:15 and upgrade or scale can run as much as 3.5 hrs | 15:36 |
| dmsimard | weshay: are you including the image build in that time ? | 15:36 |
| *** laron has quit IRC | 15:36 | |
| weshay | dmsimard, image build is only done in the promotion pipeline | 15:36 |
| dmsimard | fair | 15:36 |
| *** laron has joined #rdo | 15:36 | |
| *** iranzo has quit IRC | 15:36 | |
| *** ushkalim has quit IRC | 15:36 | |
| number80 | we manage to get average below 3hours? | 15:36 |
| mengxd | ok, and how frequently will CI job be triggered? | 15:36 |
| number80 | woot | 15:36 |
| *** anilvenkata has quit IRC | 15:37 | |
| weshay | we are working on a downloading an already deployed stack. and restarting it.. | 15:37 |
| dmsimard | mengxd: well, that's up to you I guess ? I'm not sure where you want this job and what you want it to test | 15:37 |
| weshay | so that upgrades, scale etc. don't have to deploy the initial cloud each time | 15:37 |
| *** imcleod_ has joined #rdo | 15:37 | |
| weshay | which will bring run times down to 1.5 hrs for upgrades which is our longest job | 15:37 |
| *** gszasz has joined #rdo | 15:37 | |
| weshay | it's only WIP atm | 15:38 |
| *** leanderthal is now known as leanderthal|afk | 15:38 | |
| mengxd | weshay: that is really nice to have. since it can save a lot of time. | 15:38 |
| *** gkadam has quit IRC | 15:38 | |
| weshay | agree.. upgrades are terrible | 15:38 |
| dmsimard | I have to step out for an appointment, I'll be afk for a bit | 15:39 |
| *** dmsimard is now known as dmsimard|afk | 15:39 | |
| *** imcleod has quit IRC | 15:39 | |
| mengxd | dmsimard: how about the current RDO CI? Is it reporting to every community patch-set? | 15:39 |
| weshay | mengxd, no | 15:39 |
| weshay | mengxd, we poll the git repo every 4hrs or so.. check if there is a change.. if true; then execute | 15:40 |
| weshay | other jobs are configured to run once a day | 15:40 |
| weshay | for instance | 15:40 |
| weshay | https://ci.centos.org/view/rdo/view/promotion-pipeline/ | 15:40 |
| weshay | are triggered off the yum repo | 15:40 |
| *** mvk has quit IRC | 15:40 | |
| weshay | https://ci.centos.org/view/rdo/view/tripleo-gate/ are triggered off of changes to CI src.. | 15:40 |
| weshay | so every patch | 15:40 |
| weshay | https://ci.centos.org/view/rdo/view/tripleo-periodic/ | 15:41 |
| weshay | are triggered once a day | 15:41 |
| imcsk8 | guys, i think we're getting a little off topic and we have other stuff to address | 15:41 |
| weshay | sure | 15:41 |
| mengxd | weshay: so i just want to get an estimate about the CI h/w reqs | 15:41 |
| mengxd | maybe we can talk in mailing list | 15:41 |
| jruzicka | or here after the meeting ;) | 15:42 |
| mengxd | sure | 15:42 |
| weshay | mengxd, sure np.. we're very grateful for what we have in ci.centos but the requirements of tripleo are what they are :( | 15:42 |
| *** linuxgeek has quit IRC | 15:43 | |
| imcsk8 | is there anything else? do you want an action for continue this topic on the ML? | 15:44 |
| mengxd | yes, i will send out a note to mailing list for further discussion | 15:44 |
| imcsk8 | #action mengxd to send a message to the Mailing List about CI requirements | 15:45 |
| mengxd | so we can move on with other topics | 15:45 |
| *** jlibosva has quit IRC | 15:45 | |
| imcsk8 | next topic | 15:45 |
| *** livelace has joined #rdo | 15:45 | |
| imcsk8 | #topic tripleo-ui packaging | 15:45 |
| *** Son_Goku has quit IRC | 15:46 | |
| *** mbound has quit IRC | 15:46 | |
| imcsk8 | jrist: ^^ | 15:46 |
| jrist | honza, jtomasek, florianf | 15:47 |
| jrist | so yeah | 15:47 |
| *** dprince has quit IRC | 15:47 | |
| jrist | thanks imcsk8 | 15:47 |
| jrist | we've got to get tripleo-ui packaged | 15:47 |
| jrist | and we've got some first steps with upstream openstack | 15:47 |
| imcsk8 | #chair jrist | 15:47 |
| zodbot | Current chairs: apevec chandankumar coolsvap dmsimard eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd number80 rbowen trown weshay | 15:47 |
| openstack | Current chairs: apevec chandankumar coolsvap dmsimard eggmaster florianf imcsk8 jjoyce jrist jruzicka jtomasek mengxd number80 rbowen trown weshay | 15:47 |
| jrist | but there is a concern for what we need to do for compilation | 15:47 |
| *** karimb has quit IRC | 15:47 | |
| *** sshnaidm|mtg is now known as sshnaidm | 15:47 | |
| jrist | i.e. all of the possible dependencies | 15:47 |
| jrist | note, tripleo-ui is npm/react based | 15:48 |
| jruzicka | which dependencies are problematic in particular? | 15:48 |
| jrist | well, it is npm based, so there are many npm packages | 15:48 |
| jrist | jruzicka: we would like to understand what might be already packaged | 15:48 |
| *** smeyer has quit IRC | 15:48 | |
| jrist | or if there is an npm repo that we can work from, instead of packaging | 15:48 |
| jrist | if that is not possible | 15:48 |
| jrist | we will have to package the dependencies that are not already in RPM f | 15:48 |
| *** jistr|mtg is now known as jistr | 15:48 | |
| jrist | does anyone have any insight? is this something we can or need to set up another | 15:49 |
| jrist | to not derail the #rdo meeting | 15:49 |
| jtomasek | in general, we're talking hundreds of dependencies, since the nature of how npm packages work | 15:50 |
| *** linuxgeek has joined #rdo | 15:50 | |
| jrist | last count was 856, but it will reduce a little | 15:50 |
| jtomasek | whole ecosystem is very similar to this https://fedoraproject.org/wiki/KojiMavenSupport | 15:50 |
| *** iranzo has joined #rdo | 15:50 | |
| *** mlammon has quit IRC | 15:50 | |
| florianf | to give a bit of background: this discussion has been going on for some days now on various channels. Initially we were hoping to find a way to deliver the compiled/minified JS packages with the UI package. | 15:50 |
| jrist | honza mentioned that there might that there might be a fedora NPM registry | 15:50 |
| jrist | but that it won't be ready until next year | 15:50 |
| jtomasek | an approved npm registry where the dependencies could be sourced would be a nice solution | 15:51 |
| *** tshefi has quit IRC | 15:51 | |
| *** v1k0d3n has joined #rdo | 15:51 | |
| *** mlammon has joined #rdo | 15:51 | |
| honza | i think it was number80 who suggested we might be able to get away with only packaging the build toolchain to start and work on the rest later | 15:51 |
| *** dprince has joined #rdo | 15:51 | |
| number80 | yes | 15:52 |
| apevec | honza, yes, how big is the toolchain? | 15:52 |
| jtomasek | problem is that the build toolchain is most of the deps | 15:53 |
| jtomasek | say 500 | 15:53 |
| honza | apevec: i'll let jtomasek answer that one | 15:53 |
| jtomasek | maybe less if we don't need to include testing tools | 15:53 |
| apevec | do you have a dep tree? this sounds insane :) | 15:53 |
| sshnaidm | apevec, hi there | 15:54 |
| jruzicka | yeah, sounds pretty instane if no npm rpms are available ATM | 15:54 |
| sshnaidm | apevec, do you have a time for delorean issue talk? | 15:54 |
| number80 | jtomasek: we can ignore testing tools, and not request strict unbundling for toolchain | 15:54 |
| *** mbound has joined #rdo | 15:54 | |
| *** fzdarsky is now known as fzdarsky|afk | 15:54 | |
| apevec | sshnaidm, we're in the meeting | 15:54 |
| *** karimb has joined #rdo | 15:54 | |
| jtomasek | number80: that means that we would not need to package dependencies of the toolchain dependencies? | 15:55 |
| *** amuller is now known as amuller_afk | 15:55 | |
| jtomasek | this is the list of the direct app dependencies https://github.com/openstack/tripleo-ui/blob/master/package.json | 15:55 |
| number80 | jtomasek: top priority is to build from sources and have the toolchain available | 15:56 |
| *** rpioso has joined #rdo | 15:56 | |
| *** Son_Goku has joined #rdo | 15:56 | |
| number80 | unbundling will be ongoing work but not a blocker for this package | 15:56 |
| number80 | (and if this lands in RHOSP, you'd have to do it anyway) | 15:56 |
| *** pstack has quit IRC | 15:57 | |
| jtomasek | this is the full dependency tree http://paste.openstack.org/show/538860/ | 15:57 |
| * jrist winces | 15:57 | |
| jtomasek | we're in process of cutting down some of them but not a lot | 15:57 |
| florianf | number80: this is supposed to land in RHOSP10 | 15:57 |
| jruzicka | what a magnificient tree! | 15:57 |
| jrist | jruzicka: :) | 15:57 |
| imcsk8 | !! | 15:57 |
| openstack | imcsk8: Error: "!" is not a valid command. | 15:57 |
| *** pstack has joined #rdo | 15:58 | |
| imcsk8 | guys, we're almost at the top of the our. can we proceed with the next topic? | 15:58 |
| jtomasek | ok | 15:58 |
| * chandankumar thinks https://github.com/ralphbean/npm2spec it might be useful for creating npm specs for packages | 15:58 | |
| jrist | thanks chandankumar | 15:58 |
| honza | chandankumar: nice | 15:58 |
| jrist | imcsk8: sounds like we need to have another separate meeting. thanks | 15:58 |
| imcsk8 | #topic rdopkg 0.38 released | 15:58 |
| jruzicka | yeah, that's just a quick info | 15:59 |
| jruzicka | new version contains bugfixes, cbsbuild command by number80 and 1000 less sloc of obsolete code | 15:59 |
| jruzicka | number80++ | 15:59 |
| imcsk8 | nice! | 15:59 |
| *** egafford has joined #rdo | 15:59 | |
| jruzicka | 18.5 % of code is gone ;) | 15:59 |
| *** laron has quit IRC | 16:00 | |
| imcsk8 | cool!! | 16:00 |
| chandankumar | sweet! | 16:00 |
| jruzicka | so let me know if something broke as always and that's all :) | 16:00 |
| *** laron has joined #rdo | 16:00 | |
| imcsk8 | ok, next | 16:00 |
| imcsk8 | #topic Chair for next meetup | 16:00 |
| number80 | jruzicka: awesome | 16:00 |
| *** zoli|wfh is now known as zoli|brb | 16:01 | |
| chandankumar | i am up for chairing. | 16:01 |
| rdogerrit | hguemar proposed DLRN: Add rdopkg reqcheck output in CI runs http://review.rdoproject.org/r/1275 | 16:01 |
| imcsk8 | #action chandankumar to chair next meeting | 16:01 |
| imcsk8 | #topic open floor | 16:01 |
| imcsk8 | is there anything else? or should we finish? | 16:02 |
| imcsk8 | ok, closing meeting | 16:03 |
| imcsk8 | 1 | 16:03 |
| imcsk8 | 2 | 16:03 |
| imcsk8 | 3 | 16:03 |
| jruzicka | C-C-COMBO BREAKER | 16:03 |
| chandankumar | 4 | 16:03 |
| imcsk8 | #endmeeting | 16:03 |
| zodbot | Meeting ended Wed Jul 20 16:03:20 2016 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . | 16:03 |
| zodbot | Minutes: https://meetbot.fedoraproject.org/rdo/2016-07-20/rdo_meeting_-_2016-07-20.2016-07-20-15.00.html | 16:03 |
| zodbot | Minutes (text): https://meetbot.fedoraproject.org/rdo/2016-07-20/rdo_meeting_-_2016-07-20.2016-07-20-15.00.txt | 16:03 |
| zodbot | Log: https://meetbot.fedoraproject.org/rdo/2016-07-20/rdo_meeting_-_2016-07-20.2016-07-20-15.00.log.html | 16:03 |
| openstack | Meeting ended Wed Jul 20 16:03:20 2016 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:03 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/rdo_meeting___2016_07_20/2016/rdo_meeting___2016_07_20.2016-07-20-15.00.html | 16:03 |
| *** rbowen sets mode: +v openstack | 16:03 | |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/rdo_meeting___2016_07_20/2016/rdo_meeting___2016_07_20.2016-07-20-15.00.txt | 16:03 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/rdo_meeting___2016_07_20/2016/rdo_meeting___2016_07_20.2016-07-20-15.00.log.html | 16:03 |
| jrist | lol jruzicka | 16:03 |
| imcsk8 | XD | 16:03 |
| rbowen | Thanks, imcsk8 | 16:03 |
| jrist | thanks imcsk8 | 16:03 |
| imcsk8 | np :) this was a long one | 16:04 |
| jtomasek | thanks | 16:04 |
| *** shivrao has joined #rdo | 16:04 | |
| imcsk8 | it's very weird how everything that has to be with tripleo is massive | 16:05 |
| *** pstack has quit IRC | 16:07 | |
| *** d0ugal has quit IRC | 16:07 | |
| jrist | lol | 16:07 |
| jrist | it's openstack on openstack | 16:08 |
| jrist | so... TWICE AS MUCH? :) | 16:08 |
| jrist | shouldn't be | 16:08 |
| jrist | but it seems like it | 16:08 |
| *** garrett has quit IRC | 16:08 | |
| *** mengxd has quit IRC | 16:08 | |
| *** jubapa_ has quit IRC | 16:09 | |
| rdogerrit | Michael Chapman proposed openstack/nova-distgit: Change nova shell from nologin to bash http://review.rdoproject.org/r/1693 | 16:10 |
| *** mlammon1 has joined #rdo | 16:10 | |
| *** zoli|brb is now known as zoli|wfh | 16:10 | |
| rdogerrit | Michael Chapman proposed openstack/nova-distgit: Change nova shell from nologin to bash http://review.rdoproject.org/r/1693 | 16:11 |
| jruzicka | jrist, FOUR TIMES (two power two?) AS MUCH (16 vs 64 GB) ;) | 16:12 |
| *** beagles is now known as beagles_brb | 16:12 | |
| jrist | jruzicka: haha, yes, fair. noted | 16:12 |
| *** rwsu has joined #rdo | 16:13 | |
| jruzicka | jruzicka, anyway, I'll try to not forget about the friday UI packaging discussion. I'm quite curious actually... | 16:13 |
| jruzicka | it's more like dependency forset :-p | 16:13 |
| *** mlammon has quit IRC | 16:14 | |
| *** shivrao has quit IRC | 16:14 | |
| *** jprovazn has joined #rdo | 16:15 | |
| *** tumble has quit IRC | 16:15 | |
| jruzicka | eeeh, that was for you jrist. | 16:18 |
| jrist | jruzicka: haha | 16:18 |
| * jruzicka wasn't talking to myslef this time | 16:18 | |
| jrist | jruzicka: thanks | 16:18 |
| jrist | jruzicka: I thought maybe it would be good to have you on it. | 16:18 |
| jrist | jruzicka: but you are optional if you have pressing matters | 16:18 |
| *** hrw has quit IRC | 16:21 | |
| jruzicka | jrist, yeah, I'll try to add my 0.02 CZK ;) | 16:22 |
| *** hrw has joined #rdo | 16:22 | |
| jrist | :) | 16:22 |
| jrist | chandankumar: btw, thanks for the npm2spec, very useful - this is why the wider visibility is good | 16:23 |
| chandankumar | jrist, np :-) | 16:23 |
| chandankumar | jrist, you can find the npm2spec developers on #fedora-apps :-) | 16:24 |
| *** dgurtner has quit IRC | 16:24 | |
| jrist | also useful :) | 16:24 |
| jruzicka | that's a way to go, I'd definitely start with generating the packages directly from npm | 16:24 |
| *** dprince has quit IRC | 16:27 | |
| *** shardy_mtg has quit IRC | 16:27 | |
| *** flepied has quit IRC | 16:27 | |
| number80 | well threebean for you | 16:28 |
| *** _milan_ has quit IRC | 16:31 | |
| *** athomas has quit IRC | 16:33 | |
| *** egallen has quit IRC | 16:34 | |
| *** jpich has quit IRC | 16:35 | |
| *** dtantsur is now known as dtantsur|afk | 16:35 | |
| *** mcornea has quit IRC | 16:35 | |
| *** karimb has quit IRC | 16:36 | |
| *** jtomasek has quit IRC | 16:38 | |
| *** ayoung has joined #rdo | 16:38 | |
| *** puzzled has quit IRC | 16:40 | |
| *** anilvenkata has joined #rdo | 16:41 | |
| *** zoli|wfh is now known as zoli|gone | 16:42 | |
| *** jhershbe_ has joined #rdo | 16:45 | |
| *** p01nt3r75 has quit IRC | 16:45 | |
| *** zoli|gone is now known as zoli_gone-proxy | 16:45 | |
| *** apevec has quit IRC | 16:47 | |
| *** trown|dr is now known as trown | 16:47 | |
| *** d0ugal has joined #rdo | 16:48 | |
| *** jhershbe has quit IRC | 16:48 | |
| *** paragan has quit IRC | 16:50 | |
| *** lucasagomes is now known as lucas-afk | 16:51 | |
| *** hynekm has joined #rdo | 16:52 | |
| *** pstack has joined #rdo | 16:53 | |
| *** derekh has quit IRC | 16:54 | |
| *** laron has quit IRC | 16:54 | |
| *** READ10 has joined #rdo | 16:55 | |
| *** limao has quit IRC | 16:55 | |
| *** Amita has joined #rdo | 16:56 | |
| *** laron has joined #rdo | 16:56 | |
| *** limao has joined #rdo | 16:56 | |
| *** pstack has quit IRC | 16:57 | |
| *** shivrao has joined #rdo | 16:58 | |
| *** limao has quit IRC | 17:00 | |
| *** hynekm has quit IRC | 17:00 | |
| *** laron has quit IRC | 17:02 | |
| *** jeckersb_gone is now known as jeckersb | 17:03 | |
| *** pkovar has quit IRC | 17:04 | |
| *** gfidente has quit IRC | 17:04 | |
| *** paramite is now known as paramite|afk | 17:04 | |
| *** Son_Goku has quit IRC | 17:04 | |
| *** ihrachys has quit IRC | 17:05 | |
| *** sdake has quit IRC | 17:07 | |
| *** sdake has joined #rdo | 17:11 | |
| *** florianf has quit IRC | 17:12 | |
| *** hynekm has joined #rdo | 17:13 | |
| *** sdake has quit IRC | 17:16 | |
| *** hynekm has quit IRC | 17:18 | |
| *** iberezovskiy is now known as iberezovskiy|off | 17:21 | |
| *** beagles_brb is now known as beagles | 17:21 | |
| *** aortega has quit IRC | 17:22 | |
| *** Tenhi has joined #rdo | 17:25 | |
| *** jeckersb is now known as jeckersb_gone | 17:25 | |
| *** florianf has joined #rdo | 17:26 | |
| *** pcaruana has quit IRC | 17:27 | |
| *** jeckersb_gone is now known as jeckersb | 17:28 | |
| *** chandankumar has quit IRC | 17:29 | |
| *** jtomasek has joined #rdo | 17:31 | |
| *** Tenhi has quit IRC | 17:32 | |
| *** jhershbe__ has joined #rdo | 17:33 | |
| *** akrivoka has quit IRC | 17:34 | |
| *** imcsk8 is now known as imcsk8|doctor | 17:36 | |
| *** jhershbe_ has quit IRC | 17:36 | |
| *** pppingme has joined #rdo | 17:42 | |
| *** laron has joined #rdo | 17:45 | |
| *** mlammon1 has quit IRC | 17:45 | |
| *** ohamada has quit IRC | 17:45 | |
| *** mlammon has joined #rdo | 17:45 | |
| *** ohamada has joined #rdo | 17:47 | |
| *** ifarkas is now known as ifarkas_adk | 17:48 | |
| *** ifarkas_adk is now known as ifarkas_afk | 17:48 | |
| *** degorenko is now known as _degorenko|afk | 17:50 | |
| trown | I am pretty confused by the mitaka minimal job | 17:50 |
| *** pstack has joined #rdo | 17:50 | |
| trown | no clue why httpd is failing to start there, but not in a local run | 17:50 |
| trown | and not in the ha run | 17:50 |
| *** amuller_afk is now known as amuller | 17:51 | |
| *** tosky has quit IRC | 17:51 | |
| *** devvesa has quit IRC | 17:51 | |
| *** ohamada has quit IRC | 17:58 | |
| *** laron has quit IRC | 17:58 | |
| *** dprince has joined #rdo | 18:02 | |
| *** akshai has quit IRC | 18:03 | |
| *** mbound has quit IRC | 18:04 | |
| *** zodbot has quit IRC | 18:05 | |
| *** READ10 has quit IRC | 18:05 | |
| *** yfried has joined #rdo | 18:06 | |
| *** akshai has joined #rdo | 18:08 | |
| *** cpg|away is now known as cpg | 18:09 | |
| *** zodbot has joined #rdo | 18:10 | |
| *** visbits has joined #rdo | 18:10 | |
| *** pstack has quit IRC | 18:12 | |
| *** laron has joined #rdo | 18:13 | |
| trown | while true; do sleep 30; curl -s https://trunk.rdoproject.org/centos7-master/report.html | grep -A4 '<tr class="success">' | head -n4 | grep ironic || echo 'not yet'; done | 18:18 |
| trown | not yet | 18:19 |
| *** pstack has joined #rdo | 18:20 | |
| *** paramite|afk is now known as paramite | 18:23 | |
| *** dmsimard|afk is now known as dmsimard | 18:26 | |
| *** jhershbe__ has quit IRC | 18:26 | |
| dmsimard | trown: I don't get the ssh connection problem from the slaves to the duffy nodes .. | 18:27 |
| dmsimard | trown: I'm feeling like a noob here.. | 18:27 |
| dmsimard | trown: I even went as far as generating a new keypair (and adding the public key to an already provisioned node) and still getting permission denied | 18:28 |
| dmsimard | no errors on either side, file permissions are ok.. | 18:28 |
| trown | hmm | 18:28 |
| dmsimard | it might be some more network weirdness | 18:28 |
| dmsimard | because if I do a icmp tcpdump, I see the pings from one side to the other | 18:28 |
| dmsimard | but if I tcpdump on port 22 from dst being the slave node, I don't see any traffic .. | 18:29 |
| *** pstack has quit IRC | 18:30 | |
| *** ihrachys has joined #rdo | 18:30 | |
| dmsimard | http://paste.openstack.org/show/iHBGtJIS4hoItZbZYDug/ | 18:30 |
| dmsimard | They found an issue that is MTU related (and was causing different network issues with the cloud) and supposedly fixed that | 18:33 |
| trown | dmsimard: ya looks like rsa handshake fails: | 18:33 |
| trown | debug2: we sent a publickey packet, wait for reply | 18:33 |
| trown | debug1: Authentications that can continue: publickey,gssapi-keyex,gssapi-with-mic | 18:33 |
| dmsimard | trown: but why doesn't that show up in the tcpdump ? | 18:33 |
| dmsimard | I can give you access to both machines if you can prove I'm not crazy :P | 18:34 |
| trown | sure | 18:34 |
| *** hynekm has joined #rdo | 18:38 | |
| *** akshai has quit IRC | 18:42 | |
| *** ihrachys has quit IRC | 18:43 | |
| *** livelace has quit IRC | 18:48 | |
| *** pcaruana has joined #rdo | 18:48 | |
| *** akshai has joined #rdo | 18:52 | |
| trown | weshay: looks like dlrn is a couple hours behind... | 18:54 |
| weshay | dang it | 18:55 |
| weshay | what are the odds we have a bug hiding after the introspection error | 18:55 |
| weshay | probably fairly high | 18:55 |
| trown | not really given ha passed | 18:55 |
| trown | oh except ha didnt pass :P | 18:56 |
| weshay | w/ no host found | 18:57 |
| weshay | ha hasn't passed since the 7th | 18:59 |
| *** pstack has joined #rdo | 19:00 | |
| *** dpeacock has quit IRC | 19:02 | |
| *** laron has quit IRC | 19:02 | |
| number80 | we have new scipy in common-testing, it removes dependency on f2py/python-devel | 19:02 |
| number80 | flaper87 ^ | 19:02 |
| number80 | let me know if you experience issues with it | 19:02 |
| *** laron has joined #rdo | 19:02 | |
| number80 | I think that openstack does not have dependency on fortran stuff so should be harmless | 19:03 |
| *** mbound has joined #rdo | 19:04 | |
| *** pstack has quit IRC | 19:06 | |
| *** yfried has quit IRC | 19:07 | |
| *** pnavarro has quit IRC | 19:07 | |
| *** jcoufal_ has joined #rdo | 19:09 | |
| *** mbound has quit IRC | 19:10 | |
| *** hynekm has quit IRC | 19:10 | |
| *** jcoufal has quit IRC | 19:13 | |
| *** akshai has quit IRC | 19:14 | |
| *** weshay has quit IRC | 19:18 | |
| *** imcsk8|doctor is now known as imcsk8 | 19:21 | |
| *** pstack has joined #rdo | 19:23 | |
| *** fzdarsky|afk has quit IRC | 19:30 | |
| *** akshai has joined #rdo | 19:31 | |
| *** jprovazn has quit IRC | 19:36 | |
| *** trown is now known as trown|relocating | 19:36 | |
| *** ihrachys has joined #rdo | 19:36 | |
| *** gszasz has quit IRC | 19:37 | |
| *** pstack has quit IRC | 19:38 | |
| *** sdake has joined #rdo | 19:38 | |
| *** imcleod_ has quit IRC | 19:42 | |
| *** akshai has quit IRC | 19:42 | |
| *** akshai has joined #rdo | 19:43 | |
| *** imcleod_ has joined #rdo | 19:45 | |
| *** fzdarsky|afk has joined #rdo | 19:46 | |
| *** akshai has quit IRC | 19:46 | |
| *** sdake has quit IRC | 19:47 | |
| mlammon | i have a failed overcloud deployment with RDO. I was wondering if you could take a look at these errors. Not sure if its a config issue or bz http://pastebin.test.redhat.com/394348 | 19:49 |
| ohochman | mlammon: thanks for raising this . | 19:54 |
| ohochman | trown|relocating: ^ | 19:54 |
| *** weshay has joined #rdo | 19:58 | |
| *** Liuqing has joined #rdo | 19:58 | |
| *** fzdarsky|afk has quit IRC | 20:01 | |
| *** julim has joined #rdo | 20:02 | |
| *** jcoufal_ has quit IRC | 20:05 | |
| *** laron has quit IRC | 20:05 | |
| *** laron has joined #rdo | 20:09 | |
| *** ihrachys has quit IRC | 20:10 | |
| *** ohochman has quit IRC | 20:12 | |
| *** dprince has quit IRC | 20:13 | |
| *** beagles is now known as beagles_l8r | 20:15 | |
| *** rasca_ has quit IRC | 20:19 | |
| jjoyce | number80: https://review.openstack.org/#/c/338879/3 wondering if we can get this guy moving. | 20:22 |
| *** rasca_ has joined #rdo | 20:25 | |
| *** egafford has quit IRC | 20:27 | |
| *** trown|relocating is now known as trown | 20:29 | |
| rdogerrit | zaitcev created openstack/swift-distgit: Remove is_admin from keystoneauth clause http://review.rdoproject.org/r/1698 | 20:29 |
| number80 | ping EmilienM, trown, see jjoyce request ^ | 20:30 |
| number80 | jjoyce: I'm no tripleo core, so let's have them do some work | 20:30 |
| EmilienM | jjoyce: is it passing CI? | 20:30 |
| jjoyce | number80: Thanks | 20:30 |
| EmilienM | I see red | 20:30 |
| jjoyce | EmilienM: I am not sure. | 20:30 |
| EmilienM | ah | 20:30 |
| number80 | EmilienM: there's a weird failure "2016-07-19 08:03:09.261927 | fatal: A branch named 'master' already exists." | 20:31 |
| *** milan has joined #rdo | 20:31 | |
| number80 | unrelated to the content of the changeset though | 20:31 |
| trown | ya that is the bug that blocks all stable/mitaka CI in tripleo | 20:31 |
| jjoyce | EmilienM: Are you looking at http://logs.openstack.org/79/338879/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/5318f59/ | 20:32 |
| * jjoyce wonders what I walked into | 20:32 | |
| trown | https://bugs.launchpad.net/tripleo/+bug/1604039 | 20:33 |
| openstack | Launchpad bug 1604039 in tripleo "CI: delorean build of tripleo-heat-templates fails" [Critical,Triaged] | 20:33 |
| trown | it is because there is some broken hacks in tripleo.sh | 20:33 |
| trown | thats what happens to hacks | 20:34 |
| jjoyce | got to love hacks | 20:35 |
| *** egafford has joined #rdo | 20:35 | |
| trown | mlammon: that looks like configuration issue to me... line 38: 10.0.0.1 is not pingable. | 20:36 |
| *** laron has quit IRC | 20:38 | |
| *** florianf has quit IRC | 20:38 | |
| number80 | hell yeah | 20:38 |
| *** anilvenkata has quit IRC | 20:39 | |
| mlammon | trown: thanks for checking… I am attempting again now with a correct network-environment.yaml I got from Sasha. thanks | 20:43 |
| *** mlammon has quit IRC | 20:43 | |
| *** mlammon has joined #rdo | 20:43 | |
| *** mlammon has quit IRC | 20:44 | |
| *** ashw has quit IRC | 20:48 | |
| *** KarlchenK has quit IRC | 20:50 | |
| *** mlammon has joined #rdo | 20:50 | |
| *** mbound has joined #rdo | 20:51 | |
| *** jayg is now known as jayg|g0n3 | 20:51 | |
| *** pcaruana has quit IRC | 20:53 | |
| *** jerrygb has quit IRC | 20:56 | |
| *** ohochman has joined #rdo | 20:58 | |
| *** dgurtner has joined #rdo | 21:01 | |
| *** jerrygb has joined #rdo | 21:02 | |
| *** jdennis has joined #rdo | 21:05 | |
| *** unclemarc has quit IRC | 21:05 | |
| *** jdennis1 has quit IRC | 21:08 | |
| *** Liuqing has quit IRC | 21:12 | |
| *** ebalduf has joined #rdo | 21:16 | |
| *** egafford has quit IRC | 21:17 | |
| *** trown is now known as trown|outtypewww | 21:18 | |
| *** laron has joined #rdo | 21:18 | |
| *** ohochman has left #rdo | 21:20 | |
| *** iranzo has quit IRC | 21:24 | |
| *** pradk has quit IRC | 21:25 | |
| *** paramite has quit IRC | 21:26 | |
| *** fcoelho has quit IRC | 21:29 | |
| *** rhallisey has quit IRC | 21:32 | |
| *** jerrygb has quit IRC | 21:32 | |
| *** TSCHAK has quit IRC | 21:34 | |
| *** fultonj has quit IRC | 21:36 | |
| *** fcoelho has joined #rdo | 21:38 | |
| *** pilasguru has quit IRC | 21:40 | |
| *** lucas-afk has quit IRC | 21:42 | |
| *** laron has quit IRC | 21:44 | |
| *** lucasagomes has joined #rdo | 21:50 | |
| *** jmelvin has quit IRC | 21:52 | |
| *** milan has quit IRC | 21:57 | |
| *** nyechiel has quit IRC | 21:59 | |
| *** alexismonville has quit IRC | 22:00 | |
| *** alexismonville has joined #rdo | 22:02 | |
| *** ccamacho has quit IRC | 22:02 | |
| *** dustins has quit IRC | 22:08 | |
| *** mvk has joined #rdo | 22:09 | |
| *** rhallisey has joined #rdo | 22:11 | |
| *** dgurtner has quit IRC | 22:14 | |
| *** priteau has quit IRC | 22:15 | |
| *** dneary has quit IRC | 22:17 | |
| *** steveg_afk has quit IRC | 22:23 | |
| *** elmiko is now known as _elmiko | 22:27 | |
| *** ebalduf has quit IRC | 22:30 | |
| *** amuller has quit IRC | 22:31 | |
| *** jerrygb has joined #rdo | 22:33 | |
| *** pilasguru has joined #rdo | 22:36 | |
| *** eharney has quit IRC | 22:38 | |
| *** ohochman has joined #rdo | 22:39 | |
| *** ohochman has left #rdo | 22:39 | |
| *** jerrygb has quit IRC | 22:39 | |
| *** zeroshft has quit IRC | 22:41 | |
| *** rhallisey has quit IRC | 22:45 | |
| *** choirboy has quit IRC | 22:52 | |
| *** pilasguru has quit IRC | 22:54 | |
| *** rhallisey has joined #rdo | 22:57 | |
| *** bfournie has quit IRC | 22:59 | |
| *** steveg_afk has joined #rdo | 23:02 | |
| *** sshnaidm is now known as sshnaidm|afk | 23:08 | |
| *** saneax_AFK is now known as saneax | 23:10 | |
| *** egafford has joined #rdo | 23:17 | |
| *** rlandy has quit IRC | 23:19 | |
| *** mengxd has joined #rdo | 23:20 | |
| *** panda is now known as panda|zZ | 23:34 | |
| *** jerrygb has joined #rdo | 23:35 | |
| *** mbound has quit IRC | 23:37 | |
| *** ayoung has quit IRC | 23:39 | |
| *** jerrygb has quit IRC | 23:41 | |
| *** rpioso has quit IRC | 23:42 | |
| *** mengxd has quit IRC | 23:43 | |
| *** mengxd has joined #rdo | 23:45 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!