| *** keper7 has quit IRC | 00:55 | |
| *** k_mouza has joined #openstack-kolla | 01:33 | |
| *** spsurya has joined #openstack-kolla | 02:11 | |
| *** dpawlik has joined #openstack-kolla | 02:12 | |
| *** zaitcev has joined #openstack-kolla | 02:14 | |
| *** k_mouza has quit IRC | 02:16 | |
| *** dpawlik has quit IRC | 02:16 | |
| zaitcev | I don't know a thing about Docker and I am working on a bug | 02:20 |
|---|---|---|
| zaitcev | We have a dockerized rsyncd, apparently coming from this: docker/swift/swift-rsyncd/Dockerfile.j2 | 02:21 |
| zaitcev | the problem is, the container cannot restart because it leaves behind a file that it itself cannot overwrite when it restarts: | 02:22 |
| zaitcev | /var/lib/docker/overlay2/fdfbd45c034ecf9cf3f91722862386c805ecec3126d92dc7631a0437d62a6db1/diff/run/rsyncd.pid | 02:22 |
| zaitcev | I started question just how it manages to leave it, because /run is supposed to be tmpfs mounted and /var/run symlinks to it. | 02:23 |
| zaitcev | Ergo, we forgot to mount a fresh /run in this container | 02:23 |
| zaitcev | But looking at Kolla's source for the container, I don't know where to begin... Like, how the mounts (or bind mounts) are regulated inside a docket container. | 02:24 |
| *** keper7 has joined #openstack-kolla | 02:29 | |
| *** itlinux has joined #openstack-kolla | 02:44 | |
| *** itlinux has quit IRC | 02:45 | |
| *** keper7 has quit IRC | 02:51 | |
| *** gkadam has joined #openstack-kolla | 03:36 | |
| *** gkadam has quit IRC | 03:36 | |
| *** zaitcev has quit IRC | 04:06 | |
| *** dpawlik has joined #openstack-kolla | 04:13 | |
| *** k_mouza has joined #openstack-kolla | 04:16 | |
| *** dpawlik has quit IRC | 04:17 | |
| *** zaitcev has joined #openstack-kolla | 04:20 | |
| *** k_mouza has quit IRC | 04:20 | |
| *** itlinux has joined #openstack-kolla | 04:39 | |
| *** dave-mccowan has quit IRC | 04:40 | |
| *** itlinux has quit IRC | 04:52 | |
| *** dr_feelgood has joined #openstack-kolla | 05:05 | |
| *** dr_feelgood has quit IRC | 05:09 | |
| *** itlinux has joined #openstack-kolla | 05:10 | |
| *** itlinux has quit IRC | 05:19 | |
| *** dr_feelgood has joined #openstack-kolla | 05:38 | |
| *** shyamb has joined #openstack-kolla | 05:39 | |
| *** dr_feelgood has quit IRC | 05:43 | |
| *** shyamb has quit IRC | 05:44 | |
| *** Luzi has joined #openstack-kolla | 05:46 | |
| *** skramaja has joined #openstack-kolla | 06:13 | |
| yoctozepto | zaitcev: hi, what's the exact error message you get | 06:14 |
| *** dpawlik has joined #openstack-kolla | 06:15 | |
| *** hamdyk has joined #openstack-kolla | 06:17 | |
| yoctozepto | and also when exactly it happens, and what is the used release of kolla / kolla-ansible | 06:20 |
| *** shyamb has joined #openstack-kolla | 06:20 | |
| yoctozepto | morning channel | 06:32 |
| *** skramaja has quit IRC | 06:50 | |
| *** skramaja has joined #openstack-kolla | 06:54 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 07:09 |
| mnasiadka | morning | 07:09 |
| yoctozepto | mnasiadka: https://review.opendev.org/678276 ;-) | 07:15 |
| mnasiadka | done | 07:25 |
| mnasiadka | yoctozepto: https://review.opendev.org/#/c/675614/ :) | 07:25 |
| yoctozepto | mnasiadka: just did, you late | 07:26 |
| mnasiadka | good | 07:26 |
| yoctozepto | final touches | 07:26 |
| yoctozepto | let's make fluentd great again | 07:26 |
| yoctozepto | ;D | 07:26 |
| yoctozepto | also, why did we include td.repo if we were not using td on rhel? did you check that? | 07:27 |
| *** ivve has joined #openstack-kolla | 07:28 | |
| mnasiadka | yoctozepto: somebody removing td-agent on rhel-derivatives in the past did not remove td.repo file | 07:32 |
| mnasiadka | bloody sudoers, I'll rename them to td-agent-sudoers and fluentd-sudoers :D | 07:33 |
| mnasiadka | because now the naming sucks | 07:33 |
| yoctozepto | indeed, then adapt template | 07:33 |
| yoctozepto | great job anyways | 07:34 |
| mnasiadka | well, I'll merge it into one sudoers file, it's mixed up already... | 07:35 |
| mnasiadka | and I don't get why somebody did this in one line: | 07:35 |
| mnasiadka | %kolla ALL=(root) NOPASSWD: /bin/chown fluentd\:kolla /var/log/kolla, /usr/bin/chown fluentd\:kolla /var/log/kolla | 07:36 |
| mnasiadka | two times the same command? | 07:36 |
| mnasiadka | ah, different paths | 07:36 |
| * mnasiadka blind in the morning | 07:36 | |
| yoctozepto | no problem, mornings are worst :-) | 07:41 |
| yoctozepto | we could certainly merge it into one file | 07:42 |
| yoctozepto | td-agent and fluentd being in one place could not hurt | 07:42 |
| yoctozepto | then it's a matter of line removal when fluentd is completely gone | 07:42 |
| *** shyamb has quit IRC | 07:42 | |
| yoctozepto | well, two lines to be precise | 07:42 |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla master: Restore TripleO CI as voting and gated https://review.opendev.org/677228 | 07:43 |
| mnasiadka | yoctozepto: well, we use fluentd on Debian, I think hrw did some changes recently | 07:44 |
| mnasiadka | yoctozepto: around running this line https://opendev.org/openstack/kolla/src/branch/master/docker/fluentd/Dockerfile.j2#L70 only on Debian - I tend to disagree - seems Ubuntu !x86_64 also runs this | 07:45 |
| *** egon^ has left #openstack-kolla | 07:47 | |
| yoctozepto | mnasiadka: yeah, sorry, this is my morning blinddness for you :-) | 07:48 |
| mnasiadka | haha :) | 07:48 |
| mnasiadka | good that I'm not the only one retarded in the morning :) | 07:48 |
| openstackgerrit | Merged openstack/kolla-ansible master: Add support for using custom Logstash patterns https://review.opendev.org/674884 | 07:48 |
| openstackgerrit | Merged openstack/kolla-ansible master: Support configuration of trusted CA certificate file https://review.opendev.org/676709 | 07:48 |
| openstackgerrit | Merged openstack/kolla-ansible master: Fixes Monasca log transformer UTC offset exception https://review.opendev.org/675660 | 07:48 |
| *** zaitcev has quit IRC | 07:50 | |
| yoctozepto | mnasiadka: I get 'retarded' again in the evening though, brain muscles are getting tired then | 07:50 |
| yoctozepto | cola drinks help a little bit, tons of sugar dissolved in black water :D | 07:52 |
| *** zaitcev has joined #openstack-kolla | 08:02 | |
| mnasiadka | yoctozepto: well, I'm starting to be lost in fluentd :D | 08:04 |
| mgoddard | morning koalas | 08:05 |
| yoctozepto | morning mgoddard | 08:05 |
| *** zaitcev_ has joined #openstack-kolla | 08:06 | |
| mnasiadka | yoctozepto: centos x86_64 and ubuntu x86_64 use td-agent and 0.14, debian (all archs?) and ubuntu non x86_64 uses fluentd and 0.14, and centos non x86_64 uses fluentd and 0.12 - how can I not loose sanity in all this? | 08:06 |
| yoctozepto | mnasiadka: by using proper variables in proper conditional branches | 08:06 |
| yoctozepto | you already did a great service to readability | 08:06 |
| hrw | morning | 08:08 |
| *** dougsz has joined #openstack-kolla | 08:08 | |
| mnasiadka | yoctozepto: I know what should be the end goal, I'm rather complaining about the process of getting there :) | 08:09 |
| *** zaitcev has quit IRC | 08:09 | |
| hrw | mnasiadka: sep/oct td-agent 4 will be released. should cover everything we care and then ppc64le will suxx | 08:10 |
| mnasiadka | hrw: so it's an endless game with fluentd :) | 08:10 |
| openstackgerrit | Merged openstack/kolla-ansible master: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/674775 | 08:13 |
| openstackgerrit | Mark Goddard proposed x/kayobe stable/stein: Add support for Arista switches https://review.opendev.org/679009 | 08:23 |
| Blinkiz | Does Kolla-ansible work with Python 3.7.4 on stein (8.0.0)? | 08:24 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 08:24 |
| yoctozepto | Blinkiz: yup, it should | 08:25 |
| Blinkiz | I try it then | 08:25 |
| *** zaitcev_ has quit IRC | 08:30 | |
| yoctozepto | mnasiadka: I have no idea how you manage to decrease complexity in one place, just to increase it in another :-) | 08:32 |
| mnasiadka | yoctozepto: Sometimes you need to increase complexity first, and then decrease it :) | 08:33 |
| *** shyamb has joined #openstack-kolla | 08:33 | |
| yoctozepto | mnasiadka: you just want me to constantly review :D | 08:36 |
| mnasiadka | yoctozepto: naah, now I wanted Zuul to tell me what breaks :) | 08:37 |
| yoctozepto | mnasiadka: k, take your time, break it and stick it back | 08:37 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 08:40 |
| yoctozepto | weird error in ubuntu k-a | 08:41 |
| yoctozepto | https://80761cae90bb201ddf2a-de5ae15935168409da4576fce7897429.ssl.cf2.rackcdn.com/677228/3/check/kolla-ansible-ubuntu-source/309239f/primary/logs/ansible/deploy | 08:41 |
| yoctozepto | "oslo_db.exception.DBError: (pymysql.err.InternalError) (1832, \"Cannot change column 'network_id': used in a foreign key constraint 'subnets_ibfk_1'\")", | 08:41 |
| yoctozepto | "[SQL: ALTER TABLE subnets MODIFY network_id VARCHAR(36) NOT NULL]", | 08:41 |
| yoctozepto | Running Neutron bootstrap container | 08:41 |
| mnasiadka | saw that once, but never again | 08:42 |
| *** zaitcev_ has joined #openstack-kolla | 08:43 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/queens: Constrain the size of Docker logs https://review.opendev.org/678869 | 08:43 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/679012 | 08:48 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/rocky: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/679013 | 08:48 |
| yoctozepto | mnasiadka, mgoddard, hrw: kolla(-ansible) on-cloud ipv6 officially broken on centos 7, ovs affected the same :< | 08:54 |
| mgoddard | yoctozepto: :( | 08:55 |
| mgoddard | is tripleo adding ipv6 support? | 08:56 |
| yoctozepto | https://bugzilla.redhat.com/show_bug.cgi?id=1746123 | 08:56 |
| openstack | bugzilla.redhat.com bug 1746123 in libvirt "Isolated IPv6 bridge network does not work with br_netfilter being on" [Unspecified,New] - Assigned to libvirt-maint | 08:56 |
| yoctozepto | mgoddard: no idea | 08:56 |
| yoctozepto | cloudnull: ^ ? | 08:56 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 08:57 |
| yoctozepto | well, it could be the latest 7.6 | 08:58 |
| yoctozepto | no 7.7 ready and I have no older servers around | 08:58 |
| yoctozepto | argh | 08:58 |
| mgoddard | yoctozepto: does this affect control plane, data plane or both? | 08:59 |
| yoctozepto | mgoddard: I meant on-cloud = data plane | 08:59 |
| mgoddard | ok | 08:59 |
| yoctozepto | I discovered it by wiring up virtualized control plane for our ipv6 support | 09:00 |
| yoctozepto | baremetal should work fine still | 09:00 |
| yoctozepto | this applies to libvirt bridges | 09:00 |
| yoctozepto | or more precisely to ip6tables being lame ;p | 09:00 |
| yoctozepto | mgoddard: I posted on #tripleo, it might be more clear if you read there and the bug report I made | 09:02 |
| yoctozepto | all right, let's continue the ipv6 control plane battle after this nasty disturbance ;( | 09:03 |
| mgoddard | yoctozepto: have you tried looking at net.bridge.bridge-nf-call-ip6tables? | 09:04 |
| yoctozepto | mgoddard: yeah, one can disable it and then it all works but then ip6tables is never consulted for this traffic kind | 09:05 |
| yoctozepto | so no per-vm filtering | 09:05 |
| mgoddard | right. might be worth adding to the bug | 09:06 |
| yoctozepto | mgoddard: yeah, I could have been more precise | 09:07 |
| yoctozepto | ;p | 09:07 |
| yoctozepto | http://codesearch.openstack.org/?q=call-ip6tables&i=nope&files=&repos= | 09:07 |
| yoctozepto | this is interesting | 09:07 |
| yoctozepto | esp. | 09:07 |
| yoctozepto | https://opendev.org/openstack/neutron/src/branch/master/doc/source/install/compute-install-option2-rdo.rst | 09:07 |
| mgoddard | can you maually enable ipv6 on the bridge via a sysctl? | 09:07 |
| yoctozepto | so neutron recommends it | 09:08 |
| yoctozepto | mgoddard: yeah but it does not solve all cases | 09:08 |
| yoctozepto | it only allows link-local then | 09:08 |
| mgoddard | hmm | 09:10 |
| *** cz2 has joined #openstack-kolla | 09:10 | |
| mgoddard | yoctozepto: what do you have for net.ipv6.conf.{default,all}.disable_ipv6? | 09:12 |
| *** k_mouza has joined #openstack-kolla | 09:12 | |
| *** k_mouza has quit IRC | 09:12 | |
| mgoddard | yoctozepto: https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/deployment/kernel/kernel-baremetal-puppet.yaml | 09:13 |
| *** k_mouza has joined #openstack-kolla | 09:14 | |
| yoctozepto | mgoddard: 0s | 09:14 |
| mgoddard | seems like libvirt has some broken logic somewhere | 09:15 |
| yoctozepto | and this is not only about link-local so getting 0 on the bridge does not fix routable | 09:15 |
| yoctozepto | mgoddard: seems like kernel ;-) | 09:15 |
| yoctozepto | bridge should only bridge | 09:16 |
| yoctozepto | iptables does it right | 09:16 |
| yoctozepto | ip6tables does not | 09:16 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 09:18 |
| *** shyamb has quit IRC | 09:22 | |
| *** dougsz has quit IRC | 09:35 | |
| *** hjensas has joined #openstack-kolla | 09:37 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 09:50 |
| *** dougsz has joined #openstack-kolla | 09:51 | |
| hrw | mnasiadka: commented | 09:53 |
| openstackgerrit | Merged openstack/kolla-ansible master: docs: ceph-ansible usage, add note around ceph keys https://review.opendev.org/677939 | 09:54 |
| *** k_mouza has quit IRC | 09:54 | |
| *** zaitcev_ has quit IRC | 09:55 | |
| *** zaitcev_ has joined #openstack-kolla | 10:07 | |
| *** heikkine has joined #openstack-kolla | 10:07 | |
| mnasiadka | hrw: thanks, all comments welcome :) | 10:07 |
| *** shyamb has joined #openstack-kolla | 10:10 | |
| yoctozepto | mgoddard: on controller+network node I have | 10:23 |
| yoctozepto | # sysctl net.bridge | 10:23 |
| yoctozepto | net.bridge.bridge-nf-call-arptables = 0 | 10:23 |
| yoctozepto | net.bridge.bridge-nf-call-ip6tables = 0 | 10:23 |
| yoctozepto | net.bridge.bridge-nf-call-iptables = 0 | 10:23 |
| yoctozepto | so something turned it off explicitly | 10:23 |
| yoctozepto | (or something did not turn it on explicitly?) | 10:24 |
| yoctozepto | just installing docker seems to turn these on | 10:24 |
| yoctozepto | well, installing and starting | 10:24 |
| yoctozepto | so probably something did turn them off there | 10:24 |
| yoctozepto | though that's no solution on compute nodes either way | 10:24 |
| yoctozepto | wonder what's the background anyway | 10:25 |
| yoctozepto | this seems to conflict with aio approach | 10:25 |
| yoctozepto | as you have a host which has to have them both on and off :D | 10:25 |
| yoctozepto | Schroedinger's bridging | 10:25 |
| yoctozepto | hrw: have you any ubuntu/debian deployment and could you verify whether those are affected too? that would be interesting to know | 10:26 |
| yoctozepto | announcement: k-a ubuntu permanently broken | 10:34 |
| yoctozepto | all jobs end in neutron bootstrap failure | 10:35 |
| yoctozepto | let's call it a bad day :p | 10:35 |
| hrw | yoctozepto: can you rebase https://review.opendev.org/#/c/672700 one? | 10:35 |
| yoctozepto | hrw: sure, can do later | 10:36 |
| yoctozepto | now onto meeting | 10:36 |
| hrw | yoctozepto: thanks | 10:36 |
| yoctozepto | (local one) | 10:36 |
| *** shyamb has quit IRC | 10:41 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Add CentOS/source aarch64 experimental job https://review.opendev.org/662456 | 10:44 |
| hrw | rebase only | 10:45 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Add CentOS/source aarch64 experimental job https://review.opendev.org/662456 | 10:49 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Add Debian/source aarch64 experimental job https://review.opendev.org/557659 | 10:49 |
| *** k_mouza has joined #openstack-kolla | 10:54 | |
| *** shyamb has joined #openstack-kolla | 11:00 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 11:05 |
| mgoddard | yoctozepto: nova role should set those sysctls on computes | 11:10 |
| mgoddard | yoctozepto: yeah, noticing those ubuntu neutron failures. Ubuntu images were uploaded to dockerhub before centos, so perhaps we'll see failures everywhere soon? | 11:11 |
| *** tonythomas has joined #openstack-kolla | 11:12 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 11:18 |
| mnasiadka | god, this fluentd is killing me :D | 11:19 |
| *** zaitcev_ has quit IRC | 11:20 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 11:22 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 11:25 |
| *** kplant has joined #openstack-kolla | 11:29 | |
| *** zaitcev_ has joined #openstack-kolla | 11:32 | |
| hrw | mnasiadka: +1 and let's see what zuul say | 11:35 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 11:36 |
| *** shyamb has quit IRC | 11:41 | |
| *** shyam89 has joined #openstack-kolla | 11:41 | |
| *** k_mouza has quit IRC | 11:41 | |
| *** k_mouza has joined #openstack-kolla | 11:42 | |
| *** shyam89 has quit IRC | 11:45 | |
| *** k_mouza has quit IRC | 11:47 | |
| *** k_mouza has joined #openstack-kolla | 11:47 | |
| *** k_mouza has quit IRC | 11:52 | |
| *** dpawlik has quit IRC | 12:02 | |
| *** shyamb has joined #openstack-kolla | 12:03 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/rocky: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/679013 | 12:04 |
| shyamb | Hi | 12:07 |
| shyamb | In ocata release, Is kolla ansible deployment containerized or not? | 12:08 |
| hrw | shyamb: kolla is container solution... | 12:09 |
| shyamb | okay | 12:09 |
| shyamb | What was the first openstack release that kolla-ansible supported? | 12:09 |
| shyamb | hrw: ^^ | 12:10 |
| hrw | shyamb: ocata was first when kolla-ansible was part of releases.openstack.org | 12:11 |
| hrw | I joined during pike/queens | 12:11 |
| hrw | shyamb: and I would not deploy <stein | 12:11 |
| shyamb | hrw: great, thank you | 12:13 |
| shyamb | Ocata kolla not so stable? | 12:13 |
| mgoddard | shyamb: the project started around liberty | 12:14 |
| shyamb | mgoddard: thanks for the info | 12:14 |
| mgoddard | shyamb: hrw is wrong to say do not deploy <stein - we have run pike, queens, rocky in production. If you are starting a new project though, stein or rocky is the best choice | 12:15 |
| hrw | right, meant new projects | 12:16 |
| mgoddard | we currently maintain queens and later as stable branches | 12:16 |
| mgoddard | hrw: k | 12:16 |
| yoctozepto | <mgoddard> yoctozepto: yeah, noticing those ubuntu neutron failures. Ubuntu images were uploaded to dockerhub before centos, so perhaps we'll see failures everywhere soon? | 12:17 |
| shyamb | mgoddard: Okay | 12:17 |
| yoctozepto | mgoddard: those seems to be from rebuilds | 12:17 |
| yoctozepto | so centos should have the same source | 12:17 |
| yoctozepto | but who knows :D | 12:17 |
| shyamb | mgoddard: hrw: If someone wants to upgrade from ocata to queens, is it supported in kolla-ansible? | 12:18 |
| mgoddard | shyamb: yes, but no fast-forward. You need to upgrade to each major release | 12:18 |
| mgoddard | so ocata, pike, queens | 12:19 |
| shyamb | mgoddard: Great | 12:24 |
| shyamb | mgoddard: One of our client is using Ocata, so we need to support it | 12:25 |
| shyamb | I am just checking how much it is possible | 12:25 |
| shyamb | Client is running Ocata Kolla in production | 12:25 |
| shyamb | I believe there are no major issues with it from installation and working perspective for our testing | 12:26 |
| shyamb | if we need anything, we will always take first help from this channel | 12:26 |
| openstackgerrit | Merged openstack/kolla-ansible stable/stein: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/679012 | 12:26 |
| *** dpawlik has joined #openstack-kolla | 12:30 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 12:33 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 12:40 |
| *** shyamb has quit IRC | 12:42 | |
| *** shyamb has joined #openstack-kolla | 12:47 | |
| *** shyamb has quit IRC | 12:52 | |
| *** watersj has joined #openstack-kolla | 12:52 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: Refactor service, endpoint and user registration https://review.opendev.org/587590 | 12:52 |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Change fluentd to td-agent on CentOS https://review.opendev.org/675614 | 13:01 |
| hrw | mnasiadka: tell when it will be ready for review | 13:04 |
| mnasiadka | hrw: Zuul will say +1 then :D | 13:04 |
| *** k_mouza has joined #openstack-kolla | 13:06 | |
| watersj | yoctozepto, thanks for response yesterday. I do have a chicken and egg issue. My master node is down and won't start due to now container present. Yes I am to blame for pruning my container, is there way to get it started? | 13:10 |
| *** dave-mccowan has joined #openstack-kolla | 13:10 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 13:12 |
| *** k_mouza has quit IRC | 13:17 | |
| *** k_mouza has joined #openstack-kolla | 13:20 | |
| mnasiadka | mgoddard: regarding https://review.opendev.org/#/c/673949/3 - maybe let's abandon my change and move communication to yours? :) | 13:25 |
| *** keper7 has joined #openstack-kolla | 13:27 | |
| mgoddard | mnasiadka: can do. I wasn't planning to complete it though :) | 13:30 |
| mnasiadka | mgoddard: well, there's no rush in this I guess - but it's a nice to have :) | 13:30 |
| mgoddard | mnasiadka: did you see my comment about the endpoint interface? I think it's a blocker for os_keystone_endpoint | 13:30 |
| mnasiadka | mgoddard: might be, the only idea I have to deliver interface to auth dictionary so os_client_config can use it | 13:31 |
| mgoddard | I don't think it takes it | 13:31 |
| mgoddard | I don't actually see where our module differentiates these two interfaces though | 13:33 |
| *** itlinux has joined #openstack-kolla | 13:37 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 13:38 |
| *** itlinux has quit IRC | 13:49 | |
| *** chason has joined #openstack-kolla | 13:50 | |
| *** priteau has joined #openstack-kolla | 13:55 | |
| openstackgerrit | Ondrej Duchon proposed openstack/kolla-ansible master: Corrected notificaions for auditing. https://review.opendev.org/678544 | 14:00 |
| *** k_mouza_ has joined #openstack-kolla | 14:02 | |
| *** k_mouza has quit IRC | 14:02 | |
| openstackgerrit | Scott Solkhon proposed openstack/kolla-ansible master: Enable Swift Recon https://review.opendev.org/677720 | 14:07 |
| *** k_mouza_ has quit IRC | 14:08 | |
| openstackgerrit | Scott Solkhon proposed openstack/kolla-ansible master: Enable Swift Recon https://review.opendev.org/677720 | 14:12 |
| *** openstackgerrit has quit IRC | 14:22 | |
| *** k_mouza has joined #openstack-kolla | 14:24 | |
| *** openstackgerrit has joined #openstack-kolla | 14:26 | |
| openstackgerrit | Scott Solkhon proposed openstack/kolla master: Add effective and permitted capability to blackbox exporter https://review.opendev.org/677156 | 14:26 |
| *** dpawlik has quit IRC | 14:29 | |
| *** hamdyk has quit IRC | 14:36 | |
| *** Luzi has quit IRC | 14:40 | |
| *** hjensas has quit IRC | 14:44 | |
| openstackgerrit | Merged x/kayobe stable/stein: Add support for Arista switches https://review.opendev.org/679009 | 14:46 |
| *** skramaja has quit IRC | 14:50 | |
| mgoddard | meeting in 10 minutes | 14:51 |
| *** hjensas has joined #openstack-kolla | 14:51 | |
| mgoddard | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne ^ | 14:51 |
| hrw | sorry but can not attend today | 14:51 |
| hrw | have to go and pick up some papers | 14:51 |
| *** k_mouza has quit IRC | 14:53 | |
| mgoddard | hrw: ok, np | 14:53 |
| *** scottsol has joined #openstack-kolla | 14:55 | |
| *** igordc has joined #openstack-kolla | 14:57 | |
| *** scottsol has quit IRC | 14:58 | |
| *** scottsol has joined #openstack-kolla | 14:59 | |
| mgoddard | #startmeeting kolla | 15:00 |
| openstack | Meeting started Wed Aug 28 15:00:43 2019 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: kolla)" | 15:00 | |
| mgoddard | #topic rollcall | 15:00 |
| openstack | The meeting name has been set to 'kolla' | 15:00 |
| *** openstack changes topic to "rollcall (Meeting topic: kolla)" | 15:00 | |
| mgoddard | \o | 15:00 |
| yoctozepto | o/ | 15:01 |
| scottsol | o/ | 15:01 |
| priteau | \o | 15:01 |
| dougsz | Lo | 15:02 |
| *** dpawlik has joined #openstack-kolla | 15:02 | |
| yoctozepto | dougsz: rectangular arms? | 15:03 |
| chason | o/ | 15:03 |
| dougsz | good posture | 15:03 |
| *** zaitcev_ has quit IRC | 15:04 | |
| mgoddard | bod | 15:04 |
| mgoddard | biceps? | 15:04 |
| mgoddard | #topic agenda | 15:04 |
| yoctozepto | https://www.urbandictionary.com/define.php?term=bod | 15:04 |
| *** openstack changes topic to "agenda (Meeting topic: kolla)" | 15:04 | |
| yoctozepto | definition 2? | 15:04 |
| yoctozepto | ;o | 15:04 |
| mgoddard | * Roll-call | 15:05 |
| mgoddard | * Announcements | 15:05 |
| mgoddard | ** PTL and TC nominations open for U cycle http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008832.html | 15:05 |
| mgoddard | * Review action items from last meeting | 15:05 |
| mgoddard | * Kolla whiteboard https://etherpad.openstack.org/p/KollaWhiteBoard | 15:05 |
| mgoddard | * Kayobe Stein release status | 15:05 |
| mgoddard | * Train release planning | 15:05 |
| mgoddard | * Testing TLS | 15:05 |
| mgoddard | #topic announcements | 15:05 |
| *** openstack changes topic to "announcements (Meeting topic: kolla)" | 15:05 | |
| mgoddard | #info PTL and TC nominations open for U cycle | 15:05 |
| mgoddard | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008832.html | 15:05 |
| mgoddard | I will be running for kolla PTL again, but it is an election so please do feel free to run | 15:06 |
| mgoddard | Any other announcements? | 15:06 |
| *** dpawlik has quit IRC | 15:07 | |
| mgoddard | #topic Review action items from last meeting | 15:07 |
| *** openstack changes topic to "Review action items from last meeting (Meeting topic: kolla)" | 15:07 | |
| mgoddard | There was one item last time | 15:07 |
| mgoddard | mgoddard to release stable branches | 15:07 |
| mgoddard | I did not | 15:07 |
| mgoddard | #action mgoddard to release stable branches | 15:08 |
| mgoddard | #topic Kolla whiteboard https://etherpad.openstack.org/p/KollaWhiteBoard | 15:08 |
| *** openstack changes topic to "Kolla whiteboard https://etherpad.openstack.org/p/KollaWhiteBoard (Meeting topic: kolla)" | 15:08 | |
| mgoddard | How is CI looking? We had an issue with ubuntu earlier | 15:08 |
| yoctozepto | is it gone now? | 15:09 |
| *** k_mouza has joined #openstack-kolla | 15:10 | |
| mgoddard | zuul is being slwo | 15:11 |
| mgoddard | I'm not sure from looking at builds page, but there are quite a few failures recently | 15:11 |
| mgoddard | hard to tell if they are just broken patches though | 15:12 |
| mgoddard | I think we just need to keep an eye out for those jobs | 15:12 |
| mgoddard | all kolla-ansible-ubuntu-source jobs since 2019-08-28T07:39:52 have failed | 15:13 |
| mgoddard | #topic Kayobe Stein release status | 15:14 |
| *** openstack changes topic to "Kayobe Stein release status (Meeting topic: kolla)" | 15:14 | |
| mgoddard | I think there is just one more patch left that I'd like to land: https://review.opendev.org/676907 | 15:15 |
| openstackgerrit | Mark Goddard proposed x/kayobe master: Set provisioning and cleaning networks as non-shared https://review.opendev.org/676907 | 15:15 |
| *** zaitcev_ has joined #openstack-kolla | 15:16 | |
| mgoddard | ^ just fixed up a comment, hopefully it can now land | 15:16 |
| mgoddard | then backport and we're god | 15:16 |
| mgoddard | *good | 15:16 |
| mgoddard | any other patches we're missing? | 15:16 |
| mgoddard | #topic Train release planning | 15:17 |
| *** openstack changes topic to "Train release planning (Meeting topic: kolla)" | 15:17 | |
| mgoddard | #info About 1 month until kolla feature freeze | 15:17 |
| mgoddard | so let's try to focus on those priorities that have been started | 15:18 |
| mgoddard | In priority order: | 15:19 |
| mgoddard | * Nova cells v2 | 15:19 |
| mgoddard | * support matrix (actually this is above cells) | 15:19 |
| mgoddard | * support new ansible versions | 15:19 |
| mnasiadka | For support matrix is anybody volunteering to help me fill out the content for kolla? | 15:21 |
| mgoddard | good question | 15:21 |
| mgoddard | can it be automated? | 15:21 |
| mgoddard | * TLS everywhere | 15:22 |
| mgoddard | I guess we can easily generate the list of images | 15:23 |
| mgoddard | and maybe using the skip list we can generate lists of N/A? | 15:23 |
| mgoddard | others might be harder | 15:23 |
| yoctozepto | mgoddard: good idea | 15:23 |
| yoctozepto | then all not unbuildabe are at least C | 15:23 |
| mgoddard | yeah | 15:23 |
| yoctozepto | and we promote others | 15:23 |
| yoctozepto | as we see fit | 15:23 |
| mgoddard | +1 | 15:24 |
| *** ivve has quit IRC | 15:24 | |
| mnasiadka | I’ll start populating from skip lists | 15:24 |
| mnasiadka | And the rest is easy | 15:24 |
| mnasiadka | yoctozepto: working on k-a part?:) | 15:24 |
| mgoddard | this seems to work | 15:25 |
| mgoddard | tools/build.py --list-images -t source -b ubuntu | 15:25 |
| mgoddard | at least I get different answers for ubuntu & centos | 15:26 |
| mgoddard | hopefully due to skip list | 15:26 |
| yoctozepto | mnasiadka: nope, sorry | 15:26 |
| mgoddard | anyway, I'll take an action to mark priority patches with RP+1 | 15:27 |
| mgoddard | #action mgoddard to mark Train priority patches ready for review with RP+1 | 15:27 |
| mgoddard | Anything else for Train? | 15:27 |
| mgoddard | #topic Testing TLS | 15:28 |
| *** openstack changes topic to "Testing TLS (Meeting topic: kolla)" | 15:28 | |
| mgoddard | In https://review.opendev.org/#/c/664517 there is a new CI test being added with TLS enabled | 15:29 |
| mgoddard | #link https://review.opendev.org/#/c/664517/8 | 15:29 |
| mgoddard | ping generalfuzz | 15:29 |
| mgoddard | I was thinking maybe it would be better to enable TLS in one of our existing tests | 15:30 |
| mgoddard | e.g. kolla-ansible-*-* or kolla-ansible-*-*-ceph | 15:30 |
| mgoddard | maybe single node would make sense | 15:31 |
| mgoddard | so TLS for single node jobs, no TLS for multinode | 15:31 |
| mgoddard | what do people think? | 15:31 |
| mgoddard | don't care? | 15:33 |
| *** dpawlik has joined #openstack-kolla | 15:35 | |
| dougsz | just wondering - why not TLS on multi-node? | 15:35 |
| dougsz | Isn't that where it would be most useful? | 15:36 |
| mgoddard | could do. Just thinking it's a longer job already, and TLS might make it even longer* | 15:36 |
| mgoddard | *untested | 15:36 |
| dougsz | fair point | 15:37 |
| mgoddard | I could be convinced either way | 15:38 |
| mgoddard | ok, let's move on | 15:38 |
| mgoddard | #topic open discussion | 15:38 |
| *** openstack changes topic to "open discussion (Meeting topic: kolla)" | 15:38 | |
| *** dpawlik has quit IRC | 15:39 | |
| mgoddard | Does anyone have anything to discuss today? | 15:39 |
| *** niceplace_ has joined #openstack-kolla | 15:39 | |
| dougsz | Quick one on the upgrade process: | 15:39 |
| dougsz | We have rolling upgrade, nova_safety_upgrade, legacy upgrade, and possibly fast forward upgrade | 15:40 |
| dougsz | Should we simplify it and just support one? | 15:40 |
| dougsz | (this is for Nova) | 15:41 |
| mgoddard | default is rolling upgrade | 15:41 |
| dougsz | yeah - that is the one that makes most sense to me, and should quite possibly have nova_safety_upgrade turned on as part of that | 15:41 |
| mgoddard | I'm not sure what legacy upgrade would be used for now | 15:42 |
| mgoddard | safety upgrade is a tradeoff | 15:42 |
| dougsz | as you say, it could be transformed into the fast upgrade method, but then, do we want so many upgrade paths which we don't test? | 15:42 |
| mgoddard | it gives you control plane downtime in exchange for no failed requests | 15:43 |
| mgoddard | I'm not sure about legacy upgrade. It was never quite clear to me why it was kept | 15:44 |
| mgoddard | fast forward upgrades aren't supported yet, but I do wonder whether we'd use the legacy upgrade code for that | 15:45 |
| openstackgerrit | Ondrej Duchon proposed openstack/kolla-ansible master: Corrected notificaions for auditing. https://review.opendev.org/678544 | 15:45 |
| mgoddard | however, given we don't support FFU now and have no one working on it it's not much of an argument | 15:45 |
| mgoddard | I'd like to keep the safety upgrade default, it's more in the spirit of a rolling upgrade | 15:46 |
| dougsz | yeah, was wondering if we actually *want* to support FFU. I like the idea of one upgrade path for Nova, which is the one we test. | 15:46 |
| mgoddard | FFU is useful if you're stuck on an old release | 15:47 |
| dougsz | as in safety upgrade off? | 15:47 |
| mgoddard | yes | 15:47 |
| mgoddard | it's not really unsafe without it, you just might get some API request failures if they use new features | 15:48 |
| mgoddard | but if you turn your API off then you can't service any requests, which is kind of like a failure | 15:48 |
| mgoddard | I guess I'm up for removing the legacy upgrade path in kolla-ansible | 15:49 |
| dougsz | ok, thanks, that would be one path gone at least | 15:49 |
| mgoddard | any other topics? | 15:50 |
| generalfuzz | sorry - just joined | 15:51 |
| mgoddard | hi generalfuzz | 15:51 |
| mgoddard | we 'discussed' the TLS job but didn't really get any comments | 15:51 |
| generalfuzz | regarding TLS - We can re-org the test suite whatever way makes most sense | 15:51 |
| mgoddard | sure. I think just getting something to pass would be a good first step | 15:52 |
| generalfuzz | yes, and we are a bit off from that still | 15:52 |
| mgoddard | my comment about using upstream ansible modules, I don't think we'll get to that this cycle so I'd suggest fixing the ones we have. They're bundled in the kolla_toolbox image in the kolla repo | 15:53 |
| mgoddard | anything else on TLS? | 15:55 |
| generalfuzz | I am running into issues enabling TLS internally, and believe that the "validate_certs: "{{ kolla_verify_tls | bool}}" isn't fully propegated to openstack python libraries | 15:55 |
| mgoddard | yes, I think that's the issue | 15:55 |
| mgoddard | you could compare the modules in kolla_toolbox with those in upstream ansible. I think they now use openstacksdk directly rather than shade | 15:56 |
| mgoddard | ok, let's leave it there | 15:57 |
| mgoddard | #endmeeting | 15:57 |
| *** openstack changes topic to "Topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ https://docs.openstack.org/kolla/latest/ | | Kolla IRC meetngs on Wednesdays @ 15:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 15:57 | |
| openstack | Meeting ended Wed Aug 28 15:57:28 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:57 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2019/kolla.2019-08-28-15.00.html | 15:57 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2019/kolla.2019-08-28-15.00.txt | 15:57 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2019/kolla.2019-08-28-15.00.log.html | 15:57 |
| yoctozepto | mgoddard: re: https://bugzilla.redhat.com/show_bug.cgi?id=1746123 | 15:57 |
| openstack | bugzilla.redhat.com bug 1746123 in libvirt "Isolated IPv6 bridge network does not work with br_netfilter being on" [Unspecified,New] - Assigned to libvirt-maint | 15:57 |
| yoctozepto | Daniel helped me locate the problem for the bare case | 15:57 |
| yoctozepto | turns out firewalld was the culprit | 15:58 |
| yoctozepto | forgot to check the raw tables | 15:58 |
| yoctozepto | ipv6 rp_filter applied in there matched exactly the behavior I saw | 15:58 |
| yoctozepto | now onto why kolla's data plane ipv6 is broken even without firewalld... | 15:59 |
| *** zaitcev_ has quit IRC | 16:01 | |
| *** k_mouza has quit IRC | 16:03 | |
| *** scottsol has quit IRC | 16:04 | |
| yoctozepto | watersj: best apply this patch onto your kolla-ansible | 16:05 |
| yoctozepto | then run mariadb_recovery | 16:05 |
| *** zaitcev_ has joined #openstack-kolla | 16:13 | |
| watersj | yoctozepto, I already took sledgehammer approach. I have small test cluster and redeploying now should be up within 30minutes. After my ha tests again, I won't prune the comntainers. | 16:16 |
| *** itlinux has joined #openstack-kolla | 16:17 | |
| *** itlinux is now known as itlinux-away | 16:20 | |
| *** watersj has quit IRC | 16:25 | |
| *** itlinux-away has quit IRC | 16:25 | |
| *** iclon has quit IRC | 16:32 | |
| *** keper7 has quit IRC | 16:38 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI https://review.opendev.org/676376 | 16:39 |
| *** jonaspaulo has joined #openstack-kolla | 16:39 | |
| *** keper7 has joined #openstack-kolla | 16:40 | |
| mnasiadka | yoctozepto: got the neutron error once again :) | 16:41 |
| mnasiadka | I guess it's officially a CI blocker in kolla-ansible... | 16:41 |
| *** k_mouza has joined #openstack-kolla | 16:45 | |
| *** k_mouza has quit IRC | 16:49 | |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: Minimal support for deploying multiple instances of MariaDB https://review.opendev.org/619756 | 16:52 |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: Copy Nova role as a basis for the Nova cell role https://review.opendev.org/675658 | 16:52 |
| openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: [WIP] Factor out nova-cell role https://review.opendev.org/675659 | 16:52 |
| *** dougsz has quit IRC | 17:01 | |
| *** itlinux has joined #openstack-kolla | 17:02 | |
| *** itlinux has quit IRC | 17:07 | |
| *** zaitcev_ has quit IRC | 17:12 | |
| *** k_mouza has joined #openstack-kolla | 17:12 | |
| *** k_mouza has quit IRC | 17:17 | |
| *** zaitcev_ has joined #openstack-kolla | 17:24 | |
| *** Chaserjim has joined #openstack-kolla | 17:46 | |
| *** zaitcev__ has joined #openstack-kolla | 17:55 | |
| *** chason has quit IRC | 17:56 | |
| *** zaitcev_ has quit IRC | 17:58 | |
| *** priteau has quit IRC | 18:12 | |
| *** igordc has quit IRC | 18:23 | |
| *** k_mouza has joined #openstack-kolla | 18:40 | |
| *** itlinux has joined #openstack-kolla | 18:44 | |
| *** k_mouza has quit IRC | 18:45 | |
| *** dciabrin has quit IRC | 18:47 | |
| *** itlinux has quit IRC | 18:48 | |
| *** zaitcev_ has joined #openstack-kolla | 18:51 | |
| yoctozepto | <mnasiadka> I guess it's officially a CI blocker in kolla-ansible... | 18:54 |
| yoctozepto | :<<< | 18:54 |
| *** zaitcev__ has quit IRC | 18:55 | |
| mnasiadka | yoctozepto: but it’s showing up sometimes :) | 18:55 |
| mnasiadka | Don’t be sad, drink a beer ;) | 18:55 |
| yoctozepto | mnasiadka: I'm a water drinker ;-) | 19:05 |
| yoctozepto | (I know, too bad) | 19:05 |
| mnasiadka | yoctozepto: naah, drink a lot of water :) | 19:17 |
| *** zaitcev_ has quit IRC | 19:18 | |
| *** ivve has joined #openstack-kolla | 19:20 | |
| *** itlinux has joined #openstack-kolla | 19:22 | |
| openstackgerrit | Merged x/kayobe master: Set provisioning and cleaning networks as non-shared https://review.opendev.org/676907 | 19:24 |
| keper7 | Hey all, this blueprint talks about setting up bridge ports to allow an aio deploy with a single nic. https://blueprints.launchpad.net/kolla-ansible/+spec/kolla-ansible-aio-single-interface-prep - Can anyone point me in the right direction as to how I can manually make them? I'm trying to use Kolla-Ansible to deploy Openstack on an Intel Nuc with just one port | 19:26 |
| *** itlinux_ has joined #openstack-kolla | 19:28 | |
| *** zaitcev_ has joined #openstack-kolla | 19:30 | |
| *** itlinux has quit IRC | 19:31 | |
| openstackgerrit | Mark Goddard proposed x/kayobe stable/stein: Set provisioning and cleaning networks as non-shared https://review.opendev.org/679129 | 19:34 |
| *** dpawlik has joined #openstack-kolla | 19:36 | |
| *** dpawlik has quit IRC | 19:41 | |
| openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible master: Modernize a way of configuring Docker daemon https://review.opendev.org/672700 | 19:43 |
| *** kplant has quit IRC | 19:46 | |
| *** itlinux has joined #openstack-kolla | 20:06 | |
| *** dciabrin has joined #openstack-kolla | 20:06 | |
| *** atmark has quit IRC | 20:07 | |
| *** mloza has joined #openstack-kolla | 20:08 | |
| *** itlinux_ has quit IRC | 20:09 | |
| *** zaitcev_ has quit IRC | 20:17 | |
| *** itlinux has quit IRC | 20:18 | |
| *** itlinux has joined #openstack-kolla | 20:20 | |
| *** zaitcev_ has joined #openstack-kolla | 20:29 | |
| *** itlinux has quit IRC | 20:33 | |
| *** itlinux has joined #openstack-kolla | 20:33 | |
| *** itlinux has quit IRC | 21:00 | |
| *** itlinux has joined #openstack-kolla | 21:04 | |
| *** k_mouza has joined #openstack-kolla | 21:11 | |
| *** itlinux has quit IRC | 21:12 | |
| *** itlinux has joined #openstack-kolla | 21:12 | |
| *** zaitcev_ has quit IRC | 21:16 | |
| *** k_mouza has quit IRC | 21:16 | |
| *** itlinux has quit IRC | 21:22 | |
| *** k_mouza has joined #openstack-kolla | 21:34 | |
| *** dpawlik has joined #openstack-kolla | 21:37 | |
| *** k_mouza has quit IRC | 21:38 | |
| *** dpawlik has quit IRC | 21:41 | |
| *** jbadiapa has quit IRC | 21:52 | |
| *** ivve has quit IRC | 22:03 | |
| *** jonaspaulo has quit IRC | 22:24 | |
| *** k_mouza has joined #openstack-kolla | 23:03 | |
| *** k_mouza has quit IRC | 23:08 | |
| *** k_mouza has joined #openstack-kolla | 23:26 | |
| *** k_mouza has quit IRC | 23:30 | |
| *** keper7 has quit IRC | 23:36 | |
| *** keper7 has joined #openstack-kolla | 23:37 | |
| *** k_mouza has joined #openstack-kolla | 23:53 | |
| *** k_mouza has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!