rdogerrit | rdo-trunk proposed rdoinfo master: Bump rdoinfo stein-uc tags to latest upper-constraints https://review.rdoproject.org/r/18435 | 00:01 |
---|---|---|
rdogerrit | rdo-trunk created rdoinfo master: Promote CBS tags update for queens-release https://review.rdoproject.org/r/18498 | 00:03 |
*** wolverineav has quit IRC | 00:22 | |
*** wolverineav has joined #rdo | 00:23 | |
*** wolverineav has quit IRC | 00:28 | |
*** wolverineav has joined #rdo | 00:30 | |
*** ade_lee has quit IRC | 00:33 | |
*** wolverineav has quit IRC | 00:35 | |
*** wolverineav has joined #rdo | 00:35 | |
*** ade_lee has joined #rdo | 00:36 | |
*** mjturek has quit IRC | 00:36 | |
*** ade_lee has quit IRC | 00:42 | |
*** ade_lee has joined #rdo | 00:42 | |
*** ade_lee has quit IRC | 00:45 | |
*** ade_lee has joined #rdo | 00:46 | |
*** ade_lee has quit IRC | 00:49 | |
*** ade_lee has joined #rdo | 00:49 | |
*** imcleod has quit IRC | 00:52 | |
*** ekultails has quit IRC | 00:52 | |
*** dsneddon has quit IRC | 01:00 | |
*** _fragatina has quit IRC | 01:10 | |
*** _fragatina has joined #rdo | 01:11 | |
*** _fragatina has quit IRC | 01:15 | |
*** wolverineav has quit IRC | 01:18 | |
*** wolverineav has joined #rdo | 01:19 | |
*** wolverineav has quit IRC | 01:24 | |
*** dsneddon has joined #rdo | 01:25 | |
*** dsneddon has quit IRC | 01:32 | |
*** wolverineav has joined #rdo | 01:50 | |
*** wolverineav has quit IRC | 01:55 | |
*** dsneddon has joined #rdo | 02:00 | |
*** dsneddon has quit IRC | 02:04 | |
rdogerrit | rdo-trunk created rdoinfo master: CBS tags sync with uc for stein-candidate https://review.rdoproject.org/r/18499 | 02:11 |
*** imcleod has joined #rdo | 02:20 | |
*** wolverineav has joined #rdo | 02:24 | |
*** rh-jelabarre has quit IRC | 02:28 | |
*** rh-jelabarre has joined #rdo | 02:32 | |
*** dsneddon has joined #rdo | 02:35 | |
*** ykarel|away has joined #rdo | 02:35 | |
*** dsneddon has quit IRC | 02:40 | |
rdogerrit | Merged rdoinfo master: Promote CBS tags update for queens-release https://review.rdoproject.org/r/18498 | 02:51 |
*** Son_Goku has joined #rdo | 02:53 | |
rdogerrit | Merged openstack/oslo-config-distgit rpm-master: Add python3-sphinx as BR when building with python 3 https://review.rdoproject.org/r/18491 | 03:01 |
*** numans has quit IRC | 03:01 | |
*** wolverineav has quit IRC | 03:10 | |
*** dsneddon has joined #rdo | 03:13 | |
*** apetrich has quit IRC | 03:15 | |
*** dsneddon has quit IRC | 03:18 | |
*** wolverineav has joined #rdo | 03:29 | |
*** udesale has joined #rdo | 03:49 | |
*** owalsh_ has joined #rdo | 03:51 | |
*** rlandy|bbl is now known as rlandy | 03:53 | |
*** dsneddon has joined #rdo | 03:54 | |
*** owalsh has quit IRC | 03:55 | |
*** dsneddon has quit IRC | 03:58 | |
*** _fragatina has joined #rdo | 03:59 | |
*** _fragatina has quit IRC | 03:59 | |
*** _fragatina has joined #rdo | 03:59 | |
rdogerrit | Yatin Karel proposed openstack/kuryr-kubernetes-distgit queens-rdo: openstack-kuryr-kubernetes-0.4.6-1 https://review.rdoproject.org/r/18497 | 04:05 |
rdogerrit | Yatin Karel proposed openstack/kuryr-kubernetes-distgit rocky-rdo: openstack-kuryr-kubernetes-0.5.3-1 https://review.rdoproject.org/r/18496 | 04:06 |
*** rh-jelabarre has quit IRC | 04:06 | |
*** ramishra has joined #rdo | 04:10 | |
rdogerrit | Yatin Karel proposed rdoinfo master: Bump rdoinfo stein-uc tags to latest upper-constraints https://review.rdoproject.org/r/18435 | 04:18 |
*** snowgoggles has quit IRC | 04:20 | |
*** dsneddon has joined #rdo | 04:32 | |
rdogerrit | Merged openstack/mistral-distgit queens-rdo: openstack-mistral-6.0.6-1 https://review.rdoproject.org/r/17286 | 04:34 |
rdogerrit | Merged openstack/oslo-db-distgit queens-rdo: python-oslo-db-4.33.2-1 https://review.rdoproject.org/r/18470 | 04:34 |
rdogerrit | Merged openstack/kuryr-kubernetes-distgit rocky-rdo: openstack-kuryr-kubernetes-0.5.3-1 https://review.rdoproject.org/r/18496 | 04:35 |
rdogerrit | Merged openstack/kuryr-kubernetes-distgit queens-rdo: openstack-kuryr-kubernetes-0.4.6-1 https://review.rdoproject.org/r/18497 | 04:35 |
rdogerrit | Merged openstack/ironic-distgit rpm-master: Optimize systemd dependency for containers https://review.rdoproject.org/r/17617 | 04:36 |
rdogerrit | Merged openstack/oslo-messaging-distgit queens-rdo: python-oslo-messaging-5.35.4-1 https://review.rdoproject.org/r/18468 | 04:36 |
*** dsneddon has quit IRC | 04:37 | |
*** wolverineav has quit IRC | 04:39 | |
*** wolverineav has joined #rdo | 04:41 | |
*** ramishra has quit IRC | 04:50 | |
*** dsneddon has joined #rdo | 05:12 | |
*** dsneddon has quit IRC | 05:17 | |
*** imcleod has quit IRC | 05:20 | |
*** wolverineav has quit IRC | 05:22 | |
*** wolverineav has joined #rdo | 05:23 | |
*** richm has quit IRC | 05:23 | |
*** udesale has quit IRC | 05:27 | |
*** udesale has joined #rdo | 05:27 | |
*** udesale has quit IRC | 05:29 | |
*** udesale has joined #rdo | 05:29 | |
*** udesale has quit IRC | 05:30 | |
*** Son_Goku has quit IRC | 05:31 | |
*** _fragatina has quit IRC | 05:33 | |
*** ramishra has joined #rdo | 05:41 | |
*** dsneddon has joined #rdo | 05:47 | |
*** dsneddon has quit IRC | 05:52 | |
*** imacdonn has joined #rdo | 05:54 | |
*** quiquell|off is now known as quiquell | 06:01 | |
*** udesale has joined #rdo | 06:09 | |
*** jbadiapa has joined #rdo | 06:13 | |
*** wolverineav has quit IRC | 06:17 | |
*** ykarel has joined #rdo | 06:20 | |
*** dsneddon has joined #rdo | 06:21 | |
*** ykarel|away has quit IRC | 06:22 | |
*** wolverineav has joined #rdo | 06:23 | |
*** ccamacho has quit IRC | 06:26 | |
*** jfrancoa has joined #rdo | 06:34 | |
*** dsneddon has quit IRC | 06:36 | |
*** ksambor has joined #rdo | 06:51 | |
*** aufi_ has joined #rdo | 07:05 | |
*** agurenko has joined #rdo | 07:05 | |
*** dsneddon has joined #rdo | 07:06 | |
*** agurenko has quit IRC | 07:09 | |
*** ccamacho has joined #rdo | 07:12 | |
*** apetrich has joined #rdo | 07:12 | |
*** ykarel_ has joined #rdo | 07:12 | |
*** ykarel has quit IRC | 07:15 | |
*** dpawlik has joined #rdo | 07:16 | |
*** kopecmartin|off is now known as kopecmartin | 07:19 | |
*** dsneddon has quit IRC | 07:19 | |
*** wolverineav has quit IRC | 07:20 | |
*** wolverineav has joined #rdo | 07:21 | |
*** udesale has quit IRC | 07:22 | |
*** wolverineav has quit IRC | 07:26 | |
*** quiquell is now known as quiquell|brb | 07:42 | |
*** udesale has joined #rdo | 07:46 | |
*** dsneddon has joined #rdo | 07:47 | |
rdogerrit | Félix Enrique Llorente Pastora created rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 07:50 |
*** dsneddon has quit IRC | 07:51 | |
*** Pigi_102 has joined #rdo | 07:53 | |
Pigi_102 | Hi all | 07:54 |
*** ykarel_ is now known as ykarel | 07:55 | |
*** gfidente has joined #rdo | 07:56 | |
Pigi_102 | I'm trying to install tripleo (latest ) on Centos but is stuck on convert-image. The process started more than 14h ago. | 07:56 |
Pigi_102 | Any hint on what to check ? | 07:56 |
ykarel | Pigi_102, how are u deploying? | 07:59 |
ykarel | manual or tripleo-quickstart | 08:00 |
Pigi_102 | Well, I'm following instruction on "tripleo quickstart" on rdo. It's not manual | 08:02 |
ykarel | u following https://www.rdoproject.org/tripleo/? | 08:03 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 08:03 |
Pigi_102 | +Yes, that's it | 08:03 |
Pigi_102 | the command I issued is quickstart.sh -R master --tags all undercloudvm | 08:04 |
ykarel | and exactly which task is stuck? | 08:04 |
Pigi_102 | and it's stuck at TASK [convert-image : convert image] | 08:05 |
Pigi_102 | task path: /root/.quickstart/tripleo-quickstart/roles/convert-image/tasks/main.yml:36 | 08:05 |
Pigi_102 | Wednesday 23 January 2019 17:10:01 +0100 (0:00:03.333) 0:10:30.10 | 08:05 |
Pigi_102 | It's the second time he hangs there. | 08:05 |
ykarel | it should not stuck that long | 08:06 |
*** rpittau has joined #rdo | 08:06 | |
ykarel | can u check what's going on undercloud vm | 08:07 |
ykarel | sorry this task is running on virthost itself | 08:08 |
Pigi_102 | I would like, but I'm not really sure how to connect to her | 08:08 |
Pigi_102 | There is a qemu process running. | 08:08 |
ykarel | can u check, ps -eaf |grep virt-customize on undercloudvm | 08:08 |
Pigi_102 | stack 17987 17986 0 Jan23 ? 00:00:00 virt-customize -v --smp 2 -m 2048 -a /home/stack/undercloud.qcow2 --run convert_image.sh stack 17991 17987 0 Jan23 ? 00:00:00 virt-customize -v --smp 2 -m 2048 -a /home/stack/undercloud.qcow2 --run convert_image.sh | 08:09 |
Pigi_102 | A couple process running. Both descend from the qemu process, btw | 08:09 |
Pigi_102 | stack 17990 17987 99 Jan23 ? 1-06:35:19 /usr/libexec/qemu-kvm | 08:10 |
*** cylopez has joined #rdo | 08:10 | |
ykarel | Pigi_102, 17987 process is stuck somehow | 08:10 |
ykarel | do you have enough resources on undercloudvm | 08:10 |
Pigi_102 | I think I hav. Load is around 1.5 | 08:11 |
Pigi_102 | swap is free | 08:11 |
Pigi_102 | cpu's are running 33% | 08:12 |
Pigi_102 | The most eating process is qemu | 08:12 |
Pigi_102 | eating resource, indeed | 08:12 |
Pigi_102 | but there is still some ( few ) memory available. | 08:12 |
*** ttsiouts has joined #rdo | 08:14 | |
*** ttsiouts has quit IRC | 08:14 | |
ykarel | Pigi_102, can u try running that command manually | 08:16 |
ykarel | Pigi_102, LIBGUESTFS_BACKEND=direct virt-customize -v --smp 2 -m 2048 -a /home/stack/undercloud.qcow2 --run convert_image.sh | 08:17 |
ykarel | u can stop the quickstart execution as that will not complete | 08:17 |
*** quiquell|brb is now known as quiquell | 08:18 | |
*** jfrancoa has quit IRC | 08:23 | |
Pigi_102 | ykarel Sure | 08:25 |
Pigi_102 | Started. But, before we go any further, Could it be an issue due to the fat I'm running those stuffs on a VM ? | 08:27 |
*** dsneddon has joined #rdo | 08:27 | |
*** ttsiouts has joined #rdo | 08:28 | |
*** rcernin has quit IRC | 08:29 | |
ykarel | Pigi_102, maybe | 08:30 |
ykarel | Pigi_102, but i have run in vm successfully in past | 08:30 |
ykarel | so by running that command manually we can see the issue | 08:30 |
*** amoralej|off is now known as amoralej | 08:31 | |
*** dsneddon has quit IRC | 08:32 | |
Pigi_102 | ykarel It seems the process is stuck again. | 08:32 |
ykarel | Pigi_102, manual? | 08:33 |
Pigi_102 | yes. | 08:33 |
ykarel | Pigi_102, run same command with -x | 08:33 |
Pigi_102 | https://pastebin.com/kVR1Bqjj | 08:34 |
ykarel | amoralej, can u review https://review.rdoproject.org/r/#/c/18435/ | 08:35 |
ykarel | amoralej, i have added os-vif in this ^^ | 08:35 |
Pigi_102 | this is from the previous run. Now I'm trying with -x | 08:35 |
ykarel | ack | 08:36 |
ykarel | Pigi_102, can u check if nested virtualization is enabled in ur vm | 08:37 |
*** udesale has quit IRC | 08:37 | |
ykarel | cat /sys/module/kvm_intel/parameters/nested | 08:38 |
Pigi_102 | For what I can tell it should. Any hint on verify this ? Some flag to check in /proc/cpu ? | 08:38 |
Pigi_102 | thx | 08:38 |
Pigi_102 | [root@undercloudvm ~]# cat /sys/module/kvm_intel/parameters/nested | 08:38 |
Pigi_102 | Y | 08:38 |
Pigi_102 | [root@undercloudvm ~]# | 08:38 |
ykarel | ack | 08:38 |
Pigi_102 | It seems it is. | 08:39 |
ykarel | yes | 08:39 |
Pigi_102 | It seems stuck again, according with iostat -xctz | 08:39 |
Pigi_102 | No I/O activity | 08:39 |
*** avivgt has joined #rdo | 08:40 | |
ykarel | and ur kernel version? uname -r | 08:40 |
ykarel | share output of -x command | 08:40 |
Pigi_102 | [root@undercloudvm ~]# uname -r | 08:40 |
Pigi_102 | 3.10.0-957.1.3.el7.x86_64 | 08:40 |
*** jlibosva has joined #rdo | 08:40 | |
ykarel | ack it's latest | 08:40 |
Pigi_102 | https://pastebin.com/3y6zCZ7R | 08:41 |
Pigi_102 | brb | 08:41 |
*** udesale has joined #rdo | 08:42 | |
*** udesale has quit IRC | 08:42 | |
*** jpena|off is now known as jpena | 08:42 | |
ykarel | Pigi_102, is it complete output? | 08:42 |
*** numans_ has joined #rdo | 08:44 | |
*** ttsiouts has quit IRC | 08:46 | |
*** ttsiouts has joined #rdo | 08:47 | |
*** tosky has joined #rdo | 08:48 | |
*** ykarel is now known as ykarel|lunch | 08:48 | |
Pigi_102 | ykarel unfortunally yes | 08:49 |
*** holser_ has joined #rdo | 08:51 | |
ykarel|lunch | Pigi_102, from that output it didn't even try booting | 08:51 |
*** paramite has joined #rdo | 08:51 | |
*** ttsiouts has quit IRC | 08:51 | |
ykarel|lunch | Pigi_102, can u try without kvm:- LIBGUESTFS_BACKEND=direct virt-customize -v --smp 2 -m 2048 -a /home/stack/undercloud.qcow2 --run convert_image.sh | 08:53 |
ykarel|lunch | sorry not this | 08:54 |
*** jpich has joined #rdo | 08:54 | |
ykarel|lunch | Pigi_102, this:- LIBGUESTFS_BACKEND_SETTINGS=force_tcg LIBGUESTFS_BACKEND=direct virt-customize -vx --smp 2 -m 2048 -a /home/stack/undercloud.qcow2 --run convert_image.sh | 08:54 |
Pigi_102 | This seems to boot, at least. | 08:55 |
Pigi_102 | but after booting I get: | 08:56 |
Pigi_102 | virt-customize: error: convert_image.sh: No such file or directory | 08:56 |
rdogerrit | Javier Peña proposed openstack/nova-distgit rpm-master: Move doc-related dependencies to the -doc subpackage https://review.rdoproject.org/r/18478 | 08:56 |
ykarel|lunch | Pigi_102, it should exist at, /home/stack | 08:57 |
*** jfrancoa has joined #rdo | 08:57 | |
ykarel|lunch | this task: generate convert script | 08:57 |
ykarel|lunch | creates it | 08:57 |
Pigi_102 | https://pastebin.com/y0fGHXDc | 08:57 |
Pigi_102 | [root@undercloudvm ~]# ls -l /home/stack/convert_image.sh | 08:58 |
Pigi_102 | -rw-rw-r-- 1 stack stack 1359 Jan 23 17:09 /home/stack/convert_image.sh | 08:58 |
ykarel|lunch | can u run with stack user | 08:58 |
ykarel|lunch | or with full path | 08:58 |
Pigi_102 | sure ! | 09:00 |
Pigi_102 | With full path seems better. | 09:00 |
*** dsneddon has joined #rdo | 09:00 | |
rdogerrit | Merged openstack/os-brick-distgit rpm-master: Add sysfsutils dependency https://review.rdoproject.org/r/18485 | 09:02 |
*** ykarel|lunch is now known as ykarel| | 09:04 | |
*** ykarel| is now known as ykarel | 09:05 | |
ykarel | ack | 09:05 |
Pigi_102 | https://pastebin.com/dt3kWKBQ | 09:05 |
*** ccamposr has joined #rdo | 09:05 | |
*** zaneb has quit IRC | 09:05 | |
Pigi_102 | Now the laster process from the fork seems to be asking for a kill of the parent.... | 09:06 |
Pigi_102 | latest | 09:06 |
*** dsneddon has quit IRC | 09:07 | |
Pigi_102 | and it's stuck on : sed -i 's/SELINUX=enforcing/SELINUX=permissive/' /etc/selinux/config | 09:07 |
Pigi_102 | or after it btw | 09:07 |
Pigi_102 | https://pastebin.com/DsN0jN4r | 09:08 |
Pigi_102 | But now I see some iostat activity... | 09:09 |
rdogerrit | Javier Peña proposed rdoinfo master: Add python-confluent-kafka to the dependency list https://review.rdoproject.org/r/18420 | 09:09 |
ykarel | looks like it's running | 09:10 |
Pigi_102 | yep ! | 09:11 |
ykarel | tail -f /tmp/builder.log | 09:11 |
rdogerrit | Javier Peña proposed rdoinfo master: Add python-confluent-kafka to the dependency list https://review.rdoproject.org/r/18420 | 09:12 |
Pigi_102 | tail: cannot open "/tmp/builder.log" for reading: No such file or directory | 09:13 |
ykarel | ack | 09:14 |
ykarel | may be it's in the vm that virt-customize creates | 09:14 |
*** hseipp has joined #rdo | 09:14 | |
*** ykarel is now known as ykarel|lunch | 09:16 | |
*** ykarel_ has joined #rdo | 09:18 | |
*** udesale has joined #rdo | 09:20 | |
*** ykarel|lunch has quit IRC | 09:21 | |
*** ttsiouts has joined #rdo | 09:21 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 09:24 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 09:26 |
*** shardy has joined #rdo | 09:27 | |
*** jpich has quit IRC | 09:27 | |
Pigi_102 | Without kvm the procedure ended up well. | 09:27 |
*** jpich has joined #rdo | 09:27 | |
*** derekh has joined #rdo | 09:29 | |
*** ttsiouts has quit IRC | 09:32 | |
*** ttsiouts has joined #rdo | 09:32 | |
Pigi_102 | ykarel_ any hint on how to proceed ? I' ve reissue the quickstart but it ended up removing the undercloud.qcow | 09:34 |
rdogerrit | Javier Peña created openstack/pycadf-distgit rpm-master: Enable Python 3 build for RHEL > 7 https://review.rdoproject.org/r/18501 | 09:35 |
*** ttsiouts has quit IRC | 09:36 | |
openstackgerrit | Daniel Alvarez proposed openstack/packstack master: Switch the default Neutron ML2 driver to OVN https://review.openstack.org/632700 | 09:40 |
tristanC | jpena: ykarel_: is it ok if we restart (and re-enqueue current changes) zuul now to apply a security fix? | 09:42 |
*** dsneddon has joined #rdo | 09:43 | |
jpena | tristanC: if it's security, we have to do it | 09:43 |
rdogerrit | Merged rdoinfo master: Bump rdoinfo stein-uc tags to latest upper-constraints https://review.rdoproject.org/r/18435 | 09:43 |
*** ttsiouts has joined #rdo | 09:43 | |
tristanC | jpena: actually we are not affected, but we would like to update zuul&nodepool to last version. now would be convenient for us, but we could wait too | 09:44 |
rdogerrit | Merged rdoinfo master: Add python-confluent-kafka to the dependency list https://review.rdoproject.org/r/18420 | 09:45 |
jpena | tristanC: would it be possible to pause zuul-executors and upgrade once the current jobs are done? | 09:45 |
tristanC | jpena: yes, but we need to restart the scheduler anyway | 09:46 |
jpena | tristanC: right. Ok, I'm +1 to doing it | 09:47 |
ykarel_ | tristanC, ack can be done | 09:47 |
ykarel_ | tristanC, are u aware of disk_full error | 09:47 |
ykarel_ | i am seeing in one job in periodic-24 currently running | 09:47 |
*** fbo has joined #rdo | 09:47 | |
ykarel_ | and no logs | 09:48 |
ykarel_ | Pigi_102, yes re running quickstart will redo that step | 09:48 |
tristanC | ykarel_: what logs are missing? | 09:49 |
ykarel_ | tristanC, when i click on job, it redirects to finger://ze07.softwarefactory-project.io:7979/5a3047109c7540168718f078a197f254 | 09:49 |
tristanC | oh, disk_full, never seen that before, let me check | 09:50 |
Pigi_102 | So, if you don't mind, what's the correct way to keep on ? Should I modify some playbook ? | 09:50 |
*** erlon_ has joined #rdo | 09:52 | |
Pigi_102 | Or it could be enough to export the LIBGUESTFS_BACKEND_SETTINGS=force_tcg env var ? | 09:52 |
tristanC | ykarel_: that's odd, ze07 has lots of free space | 09:52 |
tristanC | ykarel_: e.g. https://softwarefactory-project.io/grafana/?panelId=52240&fullscreen&orgId=1&var-datasource=default&var-server=ze07.softwarefactory-project.io&var-inter=$__auto_interval_inter&from=now-3h&to=now | 09:53 |
*** sshnaidm|afk is now known as sshnaidm | 09:53 | |
ykarel_ | tristanC, i have seen it earlier also | 09:53 |
tristanC | anyway, restarting zuul now, let see after | 09:54 |
ykarel_ | ack | 09:54 |
ykarel_ | some detail https://review.rdoproject.org/etherpad/p/ruckrover-sprint24 | 09:54 |
*** factor has quit IRC | 09:54 | |
ykarel_ | ruck/rover may have more idea ^^ | 09:54 |
ykarel_ | Pigi_102, i think easiest would be to modify playbook | 09:55 |
ykarel_ | exporting LIBGUESTFS_BACKEND_SETTINGS might not help | 09:55 |
ykarel_ | can u try setting that var /etc/environment | 09:56 |
*** dsneddon has quit IRC | 09:56 | |
ykarel_ | Pigi_102, like:- sudo tee -a /etc/environment <<EOF | 09:57 |
ykarel_ | export LIBGUESTFS_BACKEND_SETTINGS=force_tcg | 09:57 |
ykarel_ | EOF | 09:57 |
ykarel_ | if that works u can move without modifying playbooks | 09:58 |
ykarel_ | i think it will work | 09:58 |
*** ykarel_ is now known as ykarel | 09:58 | |
Pigi_102 | Let's try. At the moment I've modified the playbook, but I don't like as it would be overwritten on update, isn't it ? | 09:59 |
ykarel | what will be overwritten? | 10:00 |
*** moguimar has joined #rdo | 10:02 | |
*** ssbarnea|rover has joined #rdo | 10:02 | |
Pigi_102 | the playbook for the quickstart if I understand correctly. | 10:02 |
ykarel | at what location u modified | 10:03 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 10:04 |
*** ssbarnea|bkp2 has quit IRC | 10:04 | |
Pigi_102 | In the /root/.quickstart, so it shouldn't .... | 10:04 |
ykarel | okk with default i think it will be clone again | 10:05 |
ykarel | so changes overridden | 10:05 |
Pigi_102 | But I've removed my mods and trying the /etc/environment tip | 10:05 |
rdogerrit | Gabriele Cerami created rdo-infra/ansible-role-tripleo-ci-reproducer master: base post playbook: add a task to force post failure https://review.rdoproject.org/r/18502 | 10:05 |
*** ssbarnea|bkp2 has joined #rdo | 10:07 | |
ykarel | ack | 10:07 |
rdogerrit | Yatin Karel created rdo-infra/ci-config master: Run regular scenarios in puppet-promotion pipeline https://review.rdoproject.org/r/18503 | 10:07 |
ykarel | amoralej, running regular scenarios ^^ | 10:08 |
*** dpawlik has quit IRC | 10:09 | |
*** ssbarnea|rover has quit IRC | 10:10 | |
tristanC | ykarel: jpena: zuul restart completed, Zuul version: 3.5.0-1.el7 | 10:12 |
ykarel | tristanC, ack | 10:12 |
*** udesale has quit IRC | 10:12 | |
*** udesale has joined #rdo | 10:13 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 10:17 |
openstackgerrit | Luigi Toscano proposed openstack/packstack master: Deploy Sahara with unversioned endpoints https://review.openstack.org/583884 | 10:19 |
rdogerrit | Merged openstack/nova-distgit rpm-master: Move doc-related dependencies to the -doc subpackage https://review.rdoproject.org/r/18478 | 10:23 |
rdogerrit | Javier Peña proposed openstack/pycadf-distgit rpm-master: Enable Python 3 build for RHEL > 7 https://review.rdoproject.org/r/18501 | 10:28 |
tristanC | ykarel: jpena: jobs seem to be working fine, please let me (or fbo) know if there are odd behavior | 10:28 |
ykarel | tristanC, ack | 10:29 |
jpena | ack | 10:29 |
ykarel | jpena, can u review https://review.rdoproject.org/r/#/c/18151/ | 10:29 |
*** dpawlik has joined #rdo | 10:30 | |
*** dsneddon has joined #rdo | 10:32 | |
rdogerrit | Merged rdo-jobs master: Add standalone job for testing distgit changes https://review.rdoproject.org/r/18151 | 10:35 |
ykarel | amoralej, u said u added networkx yesterday in Fedora, we need > 2.0, looks like u build 1.11 | 10:38 |
amoralej | ykarel, i'm trying to rebuild it for centos7 first | 10:39 |
amoralej | it's a mess :) | 10:39 |
amoralej | https://cbs.centos.org/kojifiles/work/tasks/7996/687996/root.log | 10:39 |
amoralej | last try | 10:39 |
amoralej | i'm thinking what to do | 10:39 |
ykarel | amoralej, ack | 10:40 |
ykarel | new deps | 10:41 |
rdogerrit | Gabriele Cerami proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: base post playbook: add a task to force post failure https://review.rdoproject.org/r/18502 | 10:42 |
*** dpawlik has quit IRC | 10:42 | |
*** dsneddon has quit IRC | 10:45 | |
rdogerrit | Yatin Karel proposed rdo-jobs master: Add standalone alternative for fs016, 030 multinode jobs https://review.rdoproject.org/r/18329 | 10:49 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 10:53 |
*** dpawlik has joined #rdo | 10:54 | |
openstackgerrit | Luigi Toscano proposed openstack/packstack master: Deploy Sahara with unversioned endpoints https://review.openstack.org/583884 | 11:02 |
rdogerrit | Alfredo Moralejo created openstack/networking-ovn-distgit rpm-master: Convert unversioned python- subpackages to versioned ones https://review.rdoproject.org/r/18504 | 11:03 |
amoralej | dalvarez, ykarel ^ to fix issue in py3 job in https://review.openstack.org/#/c/632700/ | 11:03 |
ykarel | ack looking | 11:04 |
dalvarez | amoralej++ thanks! | 11:04 |
ykarel | ack makes sense | 11:05 |
rdogerrit | Alfredo Moralejo proposed openstack/networking-ovn-distgit rpm-master: Convert unversioned python- subpackages to versioned ones https://review.rdoproject.org/r/18504 | 11:07 |
*** dciabrin has quit IRC | 11:10 | |
ykarel | tristanC, can u enque aborted openstack-periodic ? | 11:10 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 11:11 |
*** Son_Goku has joined #rdo | 11:14 | |
ykarel | amoralej, u need to adjust migration tool as well | 11:15 |
ykarel | subpackage | 11:15 |
*** ttsiouts has quit IRC | 11:15 | |
amoralej | i fixed it in ps2 | 11:15 |
ykarel | okk looking | 11:15 |
*** ttsiouts has joined #rdo | 11:16 | |
*** dsneddon has joined #rdo | 11:17 | |
*** morazi has quit IRC | 11:17 | |
rdogerrit | Gabriele Cerami proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: base post playbook: add a task to force post failure https://review.rdoproject.org/r/18502 | 11:17 |
*** ttsiouts has quit IRC | 11:20 | |
rdogerrit | Sorin Sbarnea created rdo-infra/ansible-role-tripleo-ci-reproducer master: Simplify pre-commit run https://review.rdoproject.org/r/18505 | 11:21 |
*** Son_Goku has quit IRC | 11:21 | |
*** ssbarnea|rover has joined #rdo | 11:23 | |
*** ssbarnea|bkp2 has quit IRC | 11:24 | |
rdogerrit | Javier Peña created rdoinfo master: Promote librdkafka and confluent-kafka to stein-testing https://review.rdoproject.org/r/18506 | 11:24 |
*** udesale has quit IRC | 11:25 | |
*** dsneddon has quit IRC | 11:28 | |
tristanC | ykarel: done, fwiw, here is the command i used: zuul enqueue-ref --tenant rdoproject.org --trigger timer --pipeline openstack-periodic --project openstack-infra/tripleo-ci --ref master | 11:29 |
rdogerrit | Sorin Sbarnea created rdo-infra/ansible-role-tripleo-ci-reproducer master: Bump linting and syncronize config with tq repo https://review.rdoproject.org/r/18507 | 11:29 |
ykarel | tristanC, Thanks | 11:29 |
ssbarnea|rover | tristanC: do you happen to know when rdo will get gerrit updated? the 2.11 is ancient and full of stupid bugs like "case-insensitive lookup for users" | 11:31 |
ssbarnea|rover | I mean if user is named Foo, i will not me found when typing "foo" | 11:32 |
ykarel | also search like, committer: is not in rdo gerrit | 11:32 |
tristanC | ssbarnea|rover: we almost finished the poc, we'll propose an upgrade soon, perhaps for next week or the week after | 11:33 |
ssbarnea|rover | tristanC++ happy to hear that, the sooner the better. | 11:33 |
tristanC | ssbarnea|rover: ftr: https://tree.taiga.io/project/morucci-software-factory/us/2146 | 11:33 |
ssbarnea|rover | tristanC: apparently I am not allowed to comment :( but at least I was able to upvote and watch. | 11:35 |
rdogerrit | Merged openstack/pycadf-distgit rpm-master: Enable Python 3 build for RHEL > 7 https://review.rdoproject.org/r/18501 | 11:37 |
rdogerrit | Merged rdo-infra/ansible-role-tripleo-ci-reproducer master: Connect 'host' mode to host instead of container https://review.rdoproject.org/r/18500 | 11:39 |
*** dmacpher_ has joined #rdo | 11:45 | |
*** dmacpher has quit IRC | 11:45 | |
rdogerrit | Sorin Sbarnea proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Simplify pre-commit run https://review.rdoproject.org/r/18505 | 11:47 |
rdogerrit | Sorin Sbarnea proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Bump linting and syncronize config with tq repo https://review.rdoproject.org/r/18507 | 11:47 |
Pigi_102 | ykarel, the procedure eventually ended but due to an error in the statup phase ( not enough memory ) she interrupted. | 11:51 |
ykarel | Pigi_102, how much memory undercloudvm have? | 11:52 |
Pigi_102 | Now I have grown the memory to the vm, and restarted the quickstart.sh but again started the create-image phase | 11:52 |
*** ssbarnea|bkp2 has joined #rdo | 11:52 | |
Pigi_102 | She used to have 4G now it's 8 | 11:52 |
ykarel | 8 is also not enough | 11:52 |
Pigi_102 | my question is, why do the playbook plays again the create-image ? | 11:52 |
*** ssbarnea|rover has quit IRC | 11:54 | |
ykarel | it redos everything | 11:55 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Use playbooks and roles from config repo https://review.rdoproject.org/r/18422 | 11:55 |
ykarel | there are different options available, u can see with quickstart.sh --help | 11:55 |
*** ttsiouts has joined #rdo | 11:56 | |
*** wolverineav has joined #rdo | 11:57 | |
Pigi_102 | Thx ykarel, I'll check for it ( at the end of this run :) ) | 11:57 |
ykarel | but 8 gb is not enough | 11:58 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add fingergw zuul service https://review.rdoproject.org/r/18475 | 11:58 |
rdogerrit | Merged openstack/networking-ovn-distgit rpm-master: Convert unversioned python- subpackages to versioned ones https://review.rdoproject.org/r/18504 | 11:58 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 11:59 |
*** rpittau has quit IRC | 12:00 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: WIP: Launch zuul jobs https://review.rdoproject.org/r/18279 | 12:01 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 12:01 |
*** dsneddon has joined #rdo | 12:02 | |
rdogerrit | Merged rdo-infra/ansible-role-tripleo-ci-reproducer master: Simplify pre-commit run https://review.rdoproject.org/r/18505 | 12:04 |
*** amoralej is now known as amoralej|lunch | 12:05 | |
*** rpittau has joined #rdo | 12:06 | |
*** eharney has quit IRC | 12:08 | |
*** Caterpillar2 has joined #rdo | 12:14 | |
rdogerrit | Merged rdo-infra/ansible-role-tripleo-ci-reproducer master: Use playbooks and roles from config repo https://review.rdoproject.org/r/18422 | 12:14 |
rdogerrit | Merged rdo-infra/ci-config master: Run regular scenarios in puppet-promotion pipeline https://review.rdoproject.org/r/18503 | 12:14 |
*** imcleod has joined #rdo | 12:14 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Added os_tempest and it's deps roles as required projects https://review.rdoproject.org/r/18480 | 12:15 |
*** dsneddon has quit IRC | 12:15 | |
*** rpittau has quit IRC | 12:15 | |
*** rpittau has joined #rdo | 12:16 | |
*** masonjoyers has quit IRC | 12:17 | |
*** Son_Goku has joined #rdo | 12:17 | |
*** panda is now known as panda|lunch | 12:17 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add fingergw zuul service https://review.rdoproject.org/r/18475 | 12:24 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 12:25 |
rdogerrit | Sorin Sbarnea proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Bump linting and syncronize config with tq repo https://review.rdoproject.org/r/18507 | 12:25 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: WIP: Launch zuul jobs https://review.rdoproject.org/r/18279 | 12:25 |
rdogerrit | Sorin Sbarnea proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Bump linting and syncronize config with tq repo https://review.rdoproject.org/r/18507 | 12:25 |
rdogerrit | Merged rdo-infra/ansible-role-tripleo-ci-reproducer master: Added os_tempest and it's deps roles as required projects https://review.rdoproject.org/r/18480 | 12:28 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: WIP: Launch zuul jobs https://review.rdoproject.org/r/18279 | 12:29 |
*** wolverineav has quit IRC | 12:30 | |
*** rpittau has quit IRC | 12:30 | |
*** rpittau has joined #rdo | 12:31 | |
*** dsneddon has joined #rdo | 12:32 | |
*** takamatsu has joined #rdo | 12:32 | |
*** morazi has joined #rdo | 12:35 | |
*** quiquell is now known as quiquell|lunch | 12:36 | |
*** ssbarnea|rover has joined #rdo | 12:37 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 12:38 |
*** ssbarnea|bkp2 has quit IRC | 12:39 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Launch zuul jobs from the role https://review.rdoproject.org/r/18279 | 12:40 |
*** jpena is now known as jpena|lunch | 12:40 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 12:40 |
*** pcaruana has quit IRC | 12:40 | |
rdogerrit | Félix Enrique Llorente Pastora proposed config master: Run tripleo zuul reproducer at tq/tqe changes https://review.rdoproject.org/r/18297 | 12:41 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add a project-template for repro jobs https://review.rdoproject.org/r/18296 | 12:41 |
jschlueter | <mandre> jschlueter: http://paste.openstack.org/show/743218/ | 12:43 |
jschlueter | mandre: yea looks like keystone is failing tripleo-build-containers-centos-7 job | 12:44 |
*** dsneddon has quit IRC | 12:45 | |
*** rpittau has quit IRC | 12:45 | |
*** rpittau has joined #rdo | 12:46 | |
jschlueter | mandre: I don't see a keystone folder in tripleo_common/keystone | 12:46 |
rdogerrit | Merged rdo-infra/ansible-role-tripleo-ci-reproducer master: Bump linting and syncronize config with tq repo https://review.rdoproject.org/r/18507 | 12:47 |
mandre | jschlueter: it should be a keystone file in the healthcheck directory of tripleo-common | 12:47 |
*** dprince has joined #rdo | 12:47 | |
mandre | but the patch at https://review.openstack.org/#/c/631310/ creates it... so I wonder why it's missing | 12:48 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 12:49 |
*** mcornea has joined #rdo | 12:49 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 12:50 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Launch zuul jobs from the role https://review.rdoproject.org/r/18279 | 12:50 |
jschlueter | mandre: when did that get merged? | 12:50 |
jschlueter | mandre: 2 days ago | 12:51 |
jschlueter | mandre: I wonder if it has made it into a promoted hash that the job is using to check against | 12:52 |
jschlueter | that was a lockstep change in tripleo-common ... that kolla has to also get updated at same time ... if I'm reading it correctly | 12:54 |
jschlueter | along with puppet-keystone change | 12:54 |
* jschlueter sighs | 12:54 | |
*** quiquell|lunch is now known as quiquell | 12:54 | |
*** panda|lunch is now known as panda | 12:55 | |
mandre | jschlueter: hmm but it looks like it's using an up-to-date tripleo-common since it tries to link from keystone and not keyston-public, no? | 12:56 |
*** Caterpillar2 has quit IRC | 12:56 | |
*** Caterpillar2 has joined #rdo | 12:57 | |
*** quiquell is now known as quiquell|brb | 12:59 | |
jschlueter | mandre: mis-match in which tripleo-common ... version used by kolla and version installed in container image | 12:59 |
jschlueter | one is being used for the templates, the other for the file to pull from | 13:00 |
*** udesale has joined #rdo | 13:01 | |
*** hseipp has quit IRC | 13:02 | |
jschlueter | mandre: confirmed ... kolla job is installing from source | 13:05 |
jschlueter | INFO:kolla.common.utils.base:---> Package openstack-tripleo-common-container-base.noarch 0:10.3.1-0.20190121222828.93113e7.el7 will be installed is in container image ... | 13:05 |
jschlueter | 2019-01-24 08:42:45.677446 | primary | e7ccc164f0e99e01c9581525dbc9a9f3ec84b49d Merge "Check for physical_resource_id before getting deployments" | 13:05 |
jschlueter | hmm the rpm in the container image is 9 patches older | 13:05 |
jschlueter | mandre: but not sure why the rpm is that much older | 13:05 |
jschlueter | built on 20190121 ... | 13:06 |
jschlueter | maybe it was last promoted when job ran? | 13:06 |
mandre | I'd have to look at what tripleo-build-containers-centos-7 job does to understand why https://review.openstack.org/#/c/631310/ broke it, perhaps mwhahaha can help when he's around | 13:08 |
*** trown|outtypewww is now known as trown | 13:13 | |
*** quiquell|brb is now known as quiquell | 13:15 | |
*** rpittau has quit IRC | 13:15 | |
*** rpittau has joined #rdo | 13:16 | |
*** pcaruana has joined #rdo | 13:20 | |
*** dsneddon has joined #rdo | 13:20 | |
*** agurenko has joined #rdo | 13:22 | |
*** agurenko has quit IRC | 13:23 | |
rdogerrit | Yatin Karel created rdo-jobs master: Create a project-template for distgit tripleo jobs https://review.rdoproject.org/r/18508 | 13:24 |
*** owalsh_ is now known as owalsh | 13:25 | |
*** derekh has quit IRC | 13:26 | |
*** wolverineav has joined #rdo | 13:27 | |
ykarel | mandre, where it's failing | 13:27 |
ykarel | so last promotion of master was on 23st | 13:28 |
ykarel | 23rd | 13:28 |
mandre | ykarel: tripleo-build-containers-centos-7 fails since https://review.openstack.org/#/c/631310/ and I'm a bit confused of why | 13:29 |
*** eharney has joined #rdo | 13:29 | |
ykarel | mandre, looking, possibly tripleo-current is not used, when the puppet-keystone patch merged | 13:30 |
*** rpittau has quit IRC | 13:31 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 13:31 |
*** rpittau has joined #rdo | 13:31 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Launch zuul jobs from the role https://review.rdoproject.org/r/18279 | 13:32 |
*** ade_lee has quit IRC | 13:32 | |
*** ttsiouts has quit IRC | 13:35 | |
ykarel | mandre, from commit message: puppet-keystone has been changed. what has changed and when | 13:35 |
*** ttsiouts has joined #rdo | 13:35 | |
ykarel | okk i think i got it | 13:36 |
mandre | ykarel: I believe the puppet-keystone change is unrelated to why it's failing, I think it's just the reason why healthcheck/keystone needed to be updated | 13:37 |
ykarel | mandre, tripleo-common is installed from pip from latest master | 13:37 |
*** rlandy has joined #rdo | 13:37 | |
ykarel | mandre, and it's looking for file in /usr/share/ that comes from package | 13:37 |
ykarel | mandre, http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/playbooks/tripleo-buildcontainers/run.yaml#n35 | 13:37 |
mandre | ykarel: hmm ok, we should update setup.cfg to install healthchecks in the expected location? | 13:38 |
*** ttsiouts has quit IRC | 13:39 | |
*** ttsiouts has joined #rdo | 13:39 | |
*** dsneddon has quit IRC | 13:39 | |
ykarel | mandre, looks like delorean-current is setup:- http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/roles/tripleo-repos/tasks/main.yml#n43 | 13:41 |
ykarel | so that job will fail until promotion of that tripleo-common patch | 13:42 |
ykarel | s/is setup/is not setup/ | 13:42 |
mandre | ykarel: yeah, either we stop installing from source or we fix the source install to put files in /usr/share/openstack-tripleo-common instead of /usr/share/tripleo-common | 13:43 |
*** jpena|lunch is now known as jpena | 13:43 | |
ykarel | mandre, yes | 13:44 |
*** amoralej|lunch is now known as amoralej | 13:45 | |
ykarel | ok mwhahaha already responded on #tripleo | 13:45 |
ykarel | mandre, ^^ | 13:45 |
*** rpittau has quit IRC | 13:46 | |
*** Caterpillar2 has quit IRC | 13:46 | |
*** mburned is now known as mburned_out | 13:47 | |
*** mburned_out is now known as mburned | 13:48 | |
*** rpittau has joined #rdo | 13:48 | |
*** Caterpillar2 has joined #rdo | 13:49 | |
*** Caterpillar2 has quit IRC | 13:50 | |
rdogerrit | Gabriele Cerami proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: base post playbook: add a task to force post failure https://review.rdoproject.org/r/18502 | 13:58 |
*** derekh has joined #rdo | 13:58 | |
*** jcoufal has joined #rdo | 13:59 | |
rdogerrit | Alan Bishop created openstack/os-brick-distgit rocky-rdo: Add sysfsutils dependency https://review.rdoproject.org/r/18509 | 14:00 |
*** wolverineav has quit IRC | 14:00 | |
*** ttsiouts has quit IRC | 14:01 | |
*** ttsiouts has joined #rdo | 14:01 | |
*** kgiusti has joined #rdo | 14:05 | |
*** ttsiouts has quit IRC | 14:05 | |
*** ttsiouts has joined #rdo | 14:09 | |
*** tahini has quit IRC | 14:12 | |
*** dsneddon has joined #rdo | 14:14 | |
*** mgariepy has joined #rdo | 14:15 | |
*** ssbarnea|rover has quit IRC | 14:19 | |
*** ade_lee has joined #rdo | 14:21 | |
*** ssbarnea|rover has joined #rdo | 14:22 | |
*** ekultails has joined #rdo | 14:22 | |
*** mjturek has joined #rdo | 14:27 | |
*** dsneddon has quit IRC | 14:27 | |
ykarel | amoralej, jpena EmilienM can u review https://review.rdoproject.org/r/#/c/18508/ | 14:31 |
rdogerrit | Merged openstack/os-brick-distgit rocky-rdo: Add sysfsutils dependency https://review.rdoproject.org/r/18509 | 14:31 |
rdogerrit | Javier Peña created openstack/sahara-distgit rpm-master: Fix ambiguous shebangs for Python 3 builds https://review.rdoproject.org/r/18510 | 14:31 |
ykarel | EmilienM, this template can be used to run tripleo standalone against distgit changes | 14:31 |
amoralej | ykarel, the plan is to add that to the existing one? | 14:31 |
amoralej | for the legacy-DLRN-rpmbuild-fedora, etc... | 14:32 |
amoralej | rpmlint and so on | 14:32 |
ykarel | jpena, sahara shebangs will be cleared once unpinned in rdoinfo | 14:32 |
*** ccamacho has quit IRC | 14:32 | |
jpena | ykarel: I know, it's a comment in the spec, but I need it fixed before if possible | 14:32 |
jpena | I'll take care of reverting the patch | 14:33 |
ykarel | jpena, ack | 14:33 |
ykarel | amoralej, existing one? | 14:34 |
amoralej | i mean, we currently are running jobs in tripleo distgits | 14:34 |
jpena | ykarel: about the new package-distgit-tripleo-check-jobs template, is it meant to replace package-distgit-check-jobs, or will they be used together? | 14:34 |
ykarel | jpena together | 14:34 |
amoralej | yes, that's my question | 14:34 |
ykarel | wherever needed | 14:34 |
amoralej | they, aren't we duplicating a job? | 14:34 |
jpena | I wonder what will happen with the multiple legacy-DLRN-rpmbuild jobs | 14:35 |
*** dpawlik has quit IRC | 14:35 | |
amoralej | yeah | 14:35 |
*** ccamacho has joined #rdo | 14:35 | |
amoralej | i think it's better to have it just once | 14:35 |
ykarel | i think it will run once, but not sure | 14:36 |
ykarel | i have seen this when running jobs | 14:36 |
ykarel | amoralej, so should i remove legacy-DLRN-rpmbuild from template | 14:36 |
ykarel | just the job, not dependency | 14:36 |
rdogerrit | Ronelle Landy created rdo-infra/ansible-role-tripleo-ci-reproducer master: WIP: Clone tq if it does not exist when running libvirt https://review.rdoproject.org/r/18511 | 14:37 |
amoralej | ykarel, yes, that's what i was thinking | 14:37 |
ykarel | okk will do, anyways DLRN build always runs with package-distgit-check template | 14:38 |
ykarel | okk updating | 14:38 |
rdogerrit | Merged rdo-infra/ansible-role-tripleo-ci-reproducer master: Add libvirt nodepool_provider type https://review.rdoproject.org/r/18446 | 14:39 |
rdogerrit | Yatin Karel proposed rdo-jobs master: Create a project-template for distgit tripleo jobs https://review.rdoproject.org/r/18508 | 14:39 |
ykarel | amoralej, jpena upDATED ^^ | 14:39 |
rdogerrit | Ronelle Landy proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: WIP: Clone tq if it does not exist when running libvirt https://review.rdoproject.org/r/18511 | 14:41 |
*** mjturek has quit IRC | 14:42 | |
rdogerrit | Javier Peña created openstack/manila-distgit rpm-master: Move man page creation to the with_doc condition https://review.rdoproject.org/r/18512 | 14:44 |
*** rh-jelabarre has joined #rdo | 14:47 | |
*** mgariepy has quit IRC | 14:50 | |
ykarel | amoralej, all new job failed in puppet-promotion pipeline | 14:51 |
ykarel | with: SSH Error: data could not be sent to remote host \ | 14:51 |
ykarel | need to disable nested_virtualization | 14:52 |
ykarel | nested_virtualization=false | 14:52 |
*** avivgt has quit IRC | 14:54 | |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add fingergw zuul service https://review.rdoproject.org/r/18475 | 14:54 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add a project-template for repro jobs https://review.rdoproject.org/r/18296 | 14:54 |
amoralej | ykarel, yeah, that looks like the old bug with nested enable with fedora on top of centos7? | 14:55 |
*** masonjoyers has joined #rdo | 14:55 | |
ykarel | amoralej, yes | 14:55 |
ykarel | on scenario-py3 i have disabled | 14:55 |
amoralej | at what level? | 14:56 |
amoralej | in weirdo? or job config? | 14:56 |
ykarel | amoralej, yes weirdo https://review.rdoproject.org/r/#/c/16990/ | 14:56 |
rdogerrit | Félix Enrique Llorente Pastora proposed rdo-infra/ansible-role-tripleo-ci-reproducer master: Add a project-template for repro jobs https://review.rdoproject.org/r/18296 | 14:56 |
amoralej | ok | 14:57 |
*** dsneddon has joined #rdo | 14:57 | |
*** wolverineav has joined #rdo | 14:58 | |
*** takamatsu has quit IRC | 15:00 | |
*** mjturek has joined #rdo | 15:02 | |
rdogerrit | Alan Bishop created openstack/os-brick-distgit queens-rdo: Add sysfsutils dependency https://review.rdoproject.org/r/18513 | 15:03 |
*** mjturek has quit IRC | 15:04 | |
*** kgiusti has quit IRC | 15:06 | |
Pigi_102 | Now the name of the game is "FAILED - RETRYING: Get undercloud vm ip address (20 retries left)." | 15:07 |
Pigi_102 | and it ends after 20 retries failing | 15:07 |
Pigi_102 | Al the check has been done ( ssh to machine etc ) and passed | 15:07 |
*** mjturek has joined #rdo | 15:08 | |
*** kgiusti has joined #rdo | 15:09 | |
*** dsneddon has quit IRC | 15:10 | |
rdogerrit | Yatin Karel created rdo-infra/weirdo master: Do not enable nested virtualization when running on Fedora https://review.rdoproject.org/r/18514 | 15:16 |
ykarel | amoralej, ^^ | 15:16 |
rdogerrit | Merged config master: Add pure f28 promotion jobs (bm/containers) to periodic pipeline https://review.rdoproject.org/r/17740 | 15:20 |
*** baha has joined #rdo | 15:21 | |
*** ykarel is now known as ykarel|away | 15:22 | |
*** rdogerrit has quit IRC | 15:24 | |
*** ykarel|away is now known as ykarel | 15:26 | |
*** wolverineav has quit IRC | 15:30 | |
ykarel | dalvarez, fs030 ovn job passed with os-vif 1.14:- https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset030-master/cef25dc/logs/tempest.html | 15:31 |
dalvarez | ykarel: \o/ | 15:31 |
dalvarez | coooooool | 15:31 |
*** moguimar has quit IRC | 15:34 | |
*** pcaruana has quit IRC | 15:35 | |
*** dsneddon has joined #rdo | 15:38 | |
*** ykarel is now known as ykarel|away | 15:38 | |
*** mjturek has quit IRC | 15:41 | |
*** dsneddon has quit IRC | 15:43 | |
*** mjturek has joined #rdo | 15:46 | |
*** quiquell is now known as quiquell|off | 15:51 | |
*** mjturek has quit IRC | 15:51 | |
*** udesale has quit IRC | 15:53 | |
*** udesale has joined #rdo | 15:54 | |
*** pcaruana has joined #rdo | 15:55 | |
*** jmlowe has joined #rdo | 15:57 | |
ykarel|away | amoralej, panda can u review:- https://review.rdoproject.org/r/#/c/18329/ | 15:58 |
*** Son_Goku has quit IRC | 15:59 | |
*** dsneddon has joined #rdo | 16:00 | |
panda | ykarel|away: who can I ask if I can get core on that and config repos ? | 16:01 |
*** Vorrtex has joined #rdo | 16:01 | |
*** mjturek has joined #rdo | 16:02 | |
ykarel|away | panda, iirc weshay proposed tripleo ci people some time back | 16:02 |
ykarel|away | and then post discussion with Alan those were added | 16:03 |
Pigi_102 | ykarel, could you spend a second on my message ? TASK [setup/undercloud : Get undercloud vm ip address] always fail | 16:03 |
panda | ykarel|away: ok thanks. | 16:03 |
ykarel|away | Pigi_102, is the vm up | 16:04 |
ykarel|away | might be a resource issue | 16:04 |
Pigi_102 | Yes, the vm looks up ( I can see her in the ps -ef ) and resources seems not to be very high. I'm on 16G now | 16:07 |
Pigi_102 | load is around 3 | 16:07 |
Pigi_102 | and hee the mem ( from top ): KiB Mem : 16266144 total, 312800 free, 996792 used, 14956552 buff/cache | 16:07 |
Pigi_102 | Btw the vm is almost hungry: 31676 stack 20 0 12.7g 684120 13020 R 316.9 4.2 83:04.01 qemu-kvm | 16:08 |
Pigi_102 | 316% .... | 16:08 |
panda | ykarel|away: reviewed https://review.rdoproject.org/r/#/c/18329/ | 16:09 |
*** Son_Goku has joined #rdo | 16:09 | |
ykarel|away | panda, Thanks, updating, for scenario007 i added in commit message | 16:11 |
ykarel|away | that it needs support in tht | 16:11 |
*** ramishra has quit IRC | 16:11 | |
*** ttsiouts has quit IRC | 16:11 | |
*** takamatsu has joined #rdo | 16:12 | |
ykarel|away | panda, Done | 16:14 |
*** wolverineav has joined #rdo | 16:15 | |
panda | ykarel|away: safe to merge, but do you want to add s7 anyway even if you can't use it ? | 16:16 |
ykarel|away | panda, last time i talked with marios so he said it's in plan of ci team | 16:16 |
ykarel|away | in next sprint | 16:17 |
ykarel|away | so i added job just to save some commits | 16:17 |
panda | ykarel|away: well it doesn't completely depend on us, the change for scenario007 to use OVN is still out there. I've +1 it, just remember to not us it anywhere yet :) | 16:17 |
ykarel|away | panda, ack | 16:18 |
ykarel|away | and Thanks | 16:18 |
*** wolverineav has quit IRC | 16:19 | |
*** wolverineav has joined #rdo | 16:20 | |
*** _fragatina has joined #rdo | 16:20 | |
*** _fragatina has quit IRC | 16:20 | |
*** _fragatina has joined #rdo | 16:21 | |
*** wolverin_ has joined #rdo | 16:22 | |
*** ccamacho has quit IRC | 16:23 | |
*** wolverineav has quit IRC | 16:26 | |
*** factor has joined #rdo | 16:27 | |
*** mhu has joined #rdo | 16:37 | |
*** panda is now known as panda|off | 16:40 | |
*** cylopez has quit IRC | 16:42 | |
*** Son_Goku has quit IRC | 16:43 | |
*** jfrancoa has quit IRC | 16:44 | |
amoralej | ykarel|away, https://review.rdoproject.org/r/#/c/18516/ you can use it to test the containers-build job | 16:46 |
amoralej | jpena, lon ^ you'll probably need to update in el8 too | 16:47 |
*** wolverin_ has quit IRC | 16:47 | |
ykarel|away | amoralej, sure | 16:47 |
amoralej | ykarel|away, ammend it as needed and use DNM if you use it | 16:47 |
*** pcaruana has quit IRC | 16:48 | |
ykarel|away | amoralej, will test in other review that i already have | 16:48 |
amoralej | ok | 16:48 |
amoralej | which one btw? | 16:48 |
ykarel|away | amoralej, https://review.rdoproject.org/r/#/c/18375/ | 16:49 |
amoralej | ykarel|away, you mean adding networkx to that one? | 16:49 |
ykarel|away | yes | 16:49 |
amoralej | but note that if someone merges the other one, you will not able to test it | 16:50 |
amoralej | so set -W or -2 or something to block it | 16:51 |
amoralej | but yeah, it's good to use a different review | 16:51 |
ykarel|away | ack | 16:51 |
*** takamatsu has quit IRC | 16:54 | |
ykarel|away | jpena, there are too many jobs in https://review.rdoproject.org/zuul/status queue:openstack/nova neutron etc | 16:58 |
jpena | damn | 16:59 |
jpena | ykarel|away: we have seen this a few times. When there's a very long chain of patches, Zuul just struggles to process them | 17:00 |
jpena | we can only wait until they are digested | 17:00 |
ykarel|away | jpena, ack, but this looks like for long, | 17:00 |
jpena | ykarel|away: yep, it will make us crawl for a long while | 17:00 |
ykarel|away | i have seen them in past but just disappears in some time, few minutes | 17:00 |
*** ccamposr has quit IRC | 17:01 | |
*** agopi is now known as agopi|lunch | 17:02 | |
*** aufi_ has quit IRC | 17:07 | |
*** holser_ is now known as holser|eod | 17:13 | |
*** kopecmartin is now known as kopecmartin|off | 17:18 | |
Pigi_102 | I've raised mem to 24G and cpu to 8 but still "Failed Get undercloud vm ip address". I'm really lost, now. | 17:25 |
*** mhu has quit IRC | 17:25 | |
*** gfidente has quit IRC | 17:26 | |
*** ccamacho has joined #rdo | 17:28 | |
Pigi_102 | I'll try to get more info's tomorrow. Thanks for everything all ( and in particular to ykarel|away ) | 17:30 |
Pigi_102 | ykarel|away coul it be that the qemu is not running under the same environment ( and thus it don't start ) ? | 17:32 |
Pigi_102 | I've seen that the variable we used in the previous fix is not present in environ for the proc of qemu-kvm | 17:33 |
*** imacdonn has quit IRC | 17:34 | |
*** rpittau has quit IRC | 17:34 | |
Pigi_102 | later all. It's that time. | 17:35 |
*** Pigi_102 has left #rdo | 17:36 | |
*** jpich has quit IRC | 17:39 | |
*** _fragatina has quit IRC | 17:43 | |
*** snowgoggles has joined #rdo | 17:48 | |
*** trown is now known as trown|lunch | 17:59 | |
*** udesale has quit IRC | 18:01 | |
*** snowgoggles has quit IRC | 18:02 | |
*** dprince has quit IRC | 18:07 | |
*** agopi|lunch has joined #rdo | 18:08 | |
*** agopi|lunch is now known as agopi | 18:08 | |
*** derekh has quit IRC | 18:09 | |
*** takamatsu has joined #rdo | 18:15 | |
*** dmacpher__ has joined #rdo | 18:15 | |
*** dmacpher__ has quit IRC | 18:15 | |
*** jlibosva has quit IRC | 18:16 | |
*** dmacpher__ has joined #rdo | 18:16 | |
*** imcleod has quit IRC | 18:16 | |
*** dmacpher_ has quit IRC | 18:17 | |
*** jlibosva has joined #rdo | 18:21 | |
*** jlibosva has quit IRC | 18:26 | |
*** jpena is now known as jpena|off | 18:28 | |
*** _fragatina has joined #rdo | 18:30 | |
amoralej | it seems that gerritbot is not working? | 18:35 |
amoralej | jpena|off, ^ | 18:35 |
amoralej | dmsimard, ^ | 18:35 |
dmsimard | amoralej: looking | 18:36 |
*** jlibosva has joined #rdo | 18:36 | |
dmsimard | amoralej: which gerritbot, the one for RDO ? | 18:37 |
amoralej | yes | 18:37 |
amoralej | the one reporting in #rdo | 18:37 |
amoralej | i don't see any notification here | 18:37 |
*** ccamacho has quit IRC | 18:38 | |
amoralej | last one is at 16:20 | 18:38 |
amoralej | yeah * rdogerrit has quit (Disconnected by services) | 18:38 |
amoralej | at 16:24 | 18:38 |
*** jlibosva has quit IRC | 18:40 | |
dmsimard | amoralej: it's online but isn't in #rdo | 18:42 |
dmsimard | amoralej: I have a feeling it attempts to join the channel before authenticating with nickserv | 18:42 |
dmsimard | let me try something | 18:42 |
amoralej | oh | 18:42 |
amoralej | ok | 18:42 |
amoralej | no rush, i'm about to leave :) | 18:42 |
dmsimard | oh I think it only joins when there's something | 18:43 |
*** shardy has quit IRC | 18:43 | |
amoralej | i've created several reviews and it didn't notify, that's how i realized | 18:43 |
*** rdogerrit has joined #rdo | 18:43 | |
rdogerrit | David Moreau Simard created rdo-infra/ci-config master: Test gerritbot notification https://review.rdoproject.org/r/18521 | 18:43 |
dmsimard | there you go | 18:43 |
dmsimard | I didn't do anything in specific, just restarted | 18:44 |
amoralej | cool | 18:44 |
amoralej | thanks dmsimard++ | 18:44 |
*** amoralej is now known as amoralej|off | 18:44 | |
*** jlibosva has joined #rdo | 18:49 | |
*** ykarel|away has quit IRC | 18:52 | |
*** jlibosva has quit IRC | 19:02 | |
*** baha has quit IRC | 19:07 | |
*** agopi_ has joined #rdo | 19:08 | |
*** takamatsu has quit IRC | 19:09 | |
*** agopi has quit IRC | 19:11 | |
*** jmlowe has quit IRC | 19:12 | |
*** jlibosva has joined #rdo | 19:14 | |
*** baha has joined #rdo | 19:15 | |
*** jlibosva has quit IRC | 19:18 | |
*** agopi__ has joined #rdo | 19:23 | |
*** agopi_ has quit IRC | 19:25 | |
*** agopi__ is now known as agopi | 19:26 | |
*** imcleod has joined #rdo | 19:27 | |
*** jlibosva has joined #rdo | 19:27 | |
*** mjturek has quit IRC | 19:30 | |
*** mjturek has joined #rdo | 19:31 | |
rdogerrit | Sagi Shnaidman created config master: Additional way to get undercloud UUID in OVB https://review.rdoproject.org/r/18522 | 19:31 |
*** sshnaidm is now known as sshnaidm|off | 19:36 | |
*** jlibosva has quit IRC | 19:40 | |
rdogerrit | rdo-trunk created rdoinfo master: CBS tags sync with uc for stein-candidate https://review.rdoproject.org/r/18523 | 19:42 |
*** tosky has quit IRC | 19:44 | |
*** baha has quit IRC | 19:47 | |
*** baha has joined #rdo | 19:49 | |
*** jlibosva has joined #rdo | 19:51 | |
*** jlibosva has quit IRC | 19:56 | |
*** erlon_ has quit IRC | 20:02 | |
*** imcleod has quit IRC | 20:07 | |
*** jlibosva has joined #rdo | 20:07 | |
*** zaneb has joined #rdo | 20:09 | |
*** jlibosva has quit IRC | 20:12 | |
*** ksambor has quit IRC | 20:12 | |
*** morazi has quit IRC | 20:20 | |
*** jlibosva has joined #rdo | 20:23 | |
*** paramite has quit IRC | 20:26 | |
*** jlibosva has quit IRC | 20:28 | |
*** wolverineav has joined #rdo | 20:29 | |
*** wolverineav has quit IRC | 20:36 | |
*** imcleod has joined #rdo | 20:37 | |
*** jlibosva has joined #rdo | 20:39 | |
*** jlibosva has quit IRC | 20:43 | |
*** dprince has joined #rdo | 20:47 | |
*** jlibosva has joined #rdo | 20:51 | |
*** jlibosva has quit IRC | 20:55 | |
*** jmlowe has joined #rdo | 21:01 | |
*** rcernin has joined #rdo | 21:02 | |
*** wolverineav has joined #rdo | 21:06 | |
*** jlibosva has joined #rdo | 21:06 | |
*** morazi has joined #rdo | 21:09 | |
*** jlibosva has quit IRC | 21:11 | |
*** wolverineav has quit IRC | 21:11 | |
*** wolverineav has joined #rdo | 21:13 | |
rdogerrit | wes hayutin created rdo-infra/ansible-role-tripleo-ci-reproducer master: <wes> Launch zuul jobs from the role https://review.rdoproject.org/r/18524 | 21:16 |
*** wolverineav has quit IRC | 21:18 | |
*** jlibosva has joined #rdo | 21:22 | |
*** jlibosva has quit IRC | 21:26 | |
*** ssbarnea|bkp2 has joined #rdo | 21:32 | |
*** kgiusti has left #rdo | 21:32 | |
rdogerrit | Sorin Sbarnea proposed rdo-infra/ci-config master: Refactor ovb-tenant-cleanup.sh https://review.rdoproject.org/r/18517 | 21:32 |
*** eharney has quit IRC | 21:33 | |
*** ssbarnea|rover has quit IRC | 21:33 | |
*** snowgoggles has joined #rdo | 21:37 | |
*** jlibosva has joined #rdo | 21:38 | |
*** wolverineav has joined #rdo | 21:40 | |
*** jlibosva has quit IRC | 21:42 | |
*** trown|lunch is now known as trown|outtypewww | 21:48 | |
*** jlibosva has joined #rdo | 21:54 | |
*** dprince has quit IRC | 21:55 | |
*** jlibosva has quit IRC | 21:59 | |
*** jlibosva has joined #rdo | 22:00 | |
*** Vorrtex has quit IRC | 22:01 | |
*** mjturek has quit IRC | 22:03 | |
*** agopi has quit IRC | 22:05 | |
*** imcleod has quit IRC | 22:10 | |
*** slaweq has quit IRC | 22:10 | |
*** rcernin has quit IRC | 22:11 | |
*** wolverineav has quit IRC | 22:11 | |
*** wolverineav has joined #rdo | 22:12 | |
*** rcernin has joined #rdo | 22:12 | |
*** jlibosva has quit IRC | 22:13 | |
*** ssbarnea|rover has joined #rdo | 22:14 | |
*** ssbarnea|bkp2 has quit IRC | 22:16 | |
*** slaweq has joined #rdo | 22:17 | |
*** jmlowe has quit IRC | 22:20 | |
*** rh-jelabarre has quit IRC | 22:21 | |
*** jlibosva has joined #rdo | 22:25 | |
*** jlibosva has quit IRC | 22:29 | |
*** ade_lee has quit IRC | 22:31 | |
*** baha has quit IRC | 22:35 | |
*** jcoufal has quit IRC | 22:36 | |
*** jlibosva has joined #rdo | 22:41 | |
*** jmlowe has joined #rdo | 22:41 | |
*** ekultails has quit IRC | 22:44 | |
*** jlibosva has quit IRC | 22:45 | |
*** dneary__ has quit IRC | 22:46 | |
*** jmlowe has quit IRC | 22:51 | |
*** jmlowe has joined #rdo | 22:52 | |
*** jlibosva has joined #rdo | 22:57 | |
*** wolverineav has quit IRC | 22:58 | |
*** Pharaoh_Atem has quit IRC | 22:59 | |
*** wolverineav has joined #rdo | 23:00 | |
*** mcornea has quit IRC | 23:00 | |
*** Pharaoh_Atem has joined #rdo | 23:00 | |
*** jlibosva has quit IRC | 23:01 | |
*** slaweq has quit IRC | 23:04 | |
*** wolverineav has quit IRC | 23:05 | |
*** slaweq has joined #rdo | 23:11 | |
*** jlibosva has joined #rdo | 23:12 | |
*** slaweq has quit IRC | 23:15 | |
*** jlibosva has quit IRC | 23:17 | |
*** wolverineav has joined #rdo | 23:19 | |
*** jlibosva has joined #rdo | 23:20 | |
*** ade_lee has joined #rdo | 23:22 | |
*** jlibosva has quit IRC | 23:24 | |
*** jlibosva has joined #rdo | 23:35 | |
*** jmlowe has quit IRC | 23:36 | |
*** jlibosva has quit IRC | 23:40 | |
*** jlibosva has joined #rdo | 23:51 | |
*** jlibosva has quit IRC | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!