Wednesday, 2017-11-22

*** salv-orlando has quit IRC00:03
*** hongbin has quit IRC00:10
*** itlinux has joined #openstack-kolla00:24
*** ntpttr_laptop has joined #openstack-kolla00:27
*** classicsnail has left #openstack-kolla00:29
*** jamesbenson has joined #openstack-kolla00:42
*** jamesbenson has quit IRC00:46
*** itlinux has quit IRC00:50
*** tovin07_ has joined #openstack-kolla00:50
openstackgerritZeyu Zhu proposed openstack/kolla master: Modify the version of skydive to v0.14.0  https://review.openstack.org/52085100:51
*** ntpttr_laptop has quit IRC01:01
*** lxdong has quit IRC01:03
*** daidv has joined #openstack-kolla01:15
mikalrwellum: you around?01:17
*** heigao has joined #openstack-kolla01:17
mikalrwellum: continuing on from yesterday, starting mariadb with helm results in the init-element being in a crash loop. Thoughts?01:17
mikalrwellum: the pod logs are unhelpful01:17
jascott1mikal nothing in describe?01:19
mikaljascott1: not that I could see, but I am a k8s n00b so I'm not really sure what I am looking at01:20
mikalI'm going to delete the chart and recreate it to see if that helps01:20
jascott1ususally a describe will have some reason with the status01:20
jascott1like cant mount a volume01:20
*** duonghq has joined #openstack-kolla01:21
jascott1if you have persistent db on and dont have dynamic storage it might do that. cant remember for sure01:21
duonghqmorning guys01:22
mikaljascott1: so now I have a new problem... I deleted the helm release, but now can't create it again because helm still thinks its there01:22
mikalOh, I can purge it01:23
jascott1yeah01:23
mikalSorry for being a n00b01:23
jascott1np we all noobs all the time at something right01:23
mikalI do have persistent storage turned on...01:24
mikalI don't see an error in the describe output though01:26
mikalWould it help if I pasted it somewhere?01:26
mikalhttp://paste.openstack.org/show/627020/01:28
mikaljascott1: yes, I think I need to learn how to setup persistent volumes on my k8s before this will work01:32
jascott1iirc you can disable it in cloud.yaml01:33
mikalBut then if the pod dies I lose all of the state of my openstack, yes?01:33
*** caowei has joined #openstack-kolla01:35
jascott1mikal you have configmaps for secrets?01:37
jascott1map imean01:37
mikalI don't know? What's a config map?01:37
mikalI'm just following the deployment guide, which hasn't mentioned that01:38
mikalhttps://docs.openstack.org/kolla-kubernetes/latest/deployment-guide.html01:38
*** reddreamster has joined #openstack-kolla01:38
jascott1config maps are created in k8s as collections of data like config files01:38
jascott1you can create a configmap from a directory of config files, and each file will be a key in the configmap with the file contents01:39
jascott1do a `kubectl get cm`01:39
*** zhangfei has joined #openstack-kolla01:40
jascott1in those instructions kollakube creates the configmap01:40
jascott1configmpas01:40
jascott1the contexts of each key from the configmap can be mounted as local file in the container01:41
jascott1that way, config is centralized and reusable01:41
jascott1mikal what does logs on 'mariadb-init-element-pgwqq' get you?01:42
*** itlinux has joined #openstack-kolla01:45
jascott1ive got to bounce for a couple hours. will check back in01:45
reddreamsterhi, I cannot enable ironic, when I enable ironic and copy initramfs, kernel into the config folder, then make a deploy.  My controller nodes get stuck. Any suggestion? I'm using centos + source.01:50
*** kiennt26 has joined #openstack-kolla01:52
*** itlinux has quit IRC01:53
reddreamsteriscsid container keeps restarting, with the error message: 'iscsid: Can not bind IPC socket'01:53
mikaljascott1: so, a "kubectl get cm -n kolla" shows a bunch of stuff01:54
*** jtriley has joined #openstack-kolla01:54
mikaljascott1: the last two lines of the logs for that container are:01:54
mikal171122 12:48:24 mysqld_safe Logging to syslog.01:54
mikal171122 12:48:24 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql01:54
*** jascott1 has quit IRC01:56
*** jascott1 has joined #openstack-kolla01:56
Jeffrey4lreddreamster, guess the iscsd is running on the host too. stop it.01:58
reddreamsterhi Jeffrey41, yes, I've also googled this hint and I'm stoping those services01:59
*** salv-orlando has joined #openstack-kolla02:01
*** jascott1 has quit IRC02:01
*** salv-orlando has quit IRC02:05
*** zhurong has joined #openstack-kolla02:16
reddreamsterJeffrey41, the ironic_dnsmasq container is restarting, dnsmasq: bad dhcp-range at line 4 of /etc/dnsmasq.conf, should I make a config for it?02:32
mikaljascott1: I got it working. I needed to use centos in cloud.yaml, ubuntu does not seem to work02:38
openstackgerritjinke proposed openstack/kolla-ansible master: Add dvr_no_external l3 dvr agent mode  https://review.openstack.org/51032702:39
openstackgerritjinke proposed openstack/kolla-ansible master: Add dvr_no_external l3 dvr agent mode  https://review.openstack.org/51032702:41
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145002:45
*** itlinux has joined #openstack-kolla02:47
Jeffrey4lreddreamster, https://github.com/openstack/kolla-ansible/blob/941f498107a2f5c96f58a675f7fd137458fca880/ansible/roles/ironic/defaults/main.yml#L65 this two value should be configuration02:50
Jeffrey4land run reconfigure again.02:50
reddreamsterJeffrey41, ok I will have a try02:51
*** lxdong has joined #openstack-kolla02:52
lxdongHow to delete pool in luminous? The mon_allow_pool_delete flag has been set to true in the Monitor’s configuration.02:53
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145002:55
*** manheim has joined #openstack-kolla02:56
*** manheim has quit IRC03:01
*** salv-orlando has joined #openstack-kolla03:02
*** jtriley has quit IRC03:02
*** salv-orlando has quit IRC03:06
lxdongHealth status turn to WARN with creating pools.03:22
*** itlinux has quit IRC03:27
openstackgerritjinke proposed openstack/kolla-ansible master: Add dvr_no_external l3 dvr agent mode  https://review.openstack.org/51032703:27
lxdongonce remove pools health recover03:28
*** jtriley has joined #openstack-kolla03:29
openstackgerritWei Cao proposed openstack/kolla master: Add designate-producer container  https://review.openstack.org/52029903:30
*** sanjayu_ has joined #openstack-kolla03:33
*** jtriley has quit IRC03:33
*** jamesbenson has joined #openstack-kolla03:37
*** jamesbenson has quit IRC03:42
*** jtriley has joined #openstack-kolla03:42
*** sanjayu_ has quit IRC03:43
*** jascott1 has joined #openstack-kolla03:47
openstackgerritMerged openstack/kolla stable/pike: Install libvirt-clients for nova-libvirt image  https://review.openstack.org/52181903:57
*** absubram has quit IRC03:59
*** itlinux has joined #openstack-kolla04:00
*** korean101 has joined #openstack-kolla04:01
korean101hi guys04:01
korean101i finished to deploy ocata release04:01
korean101and also i finished to deploy pike release04:01
korean101and finished to upgrade ocata to pike04:01
korean101now i try to downgrade pike to ocata04:01
korean101how can i do?04:01
korean101any suggestion for me?04:02
*** salv-orlando has joined #openstack-kolla04:02
*** ArminderSingh has quit IRC04:06
*** salv-orlando has quit IRC04:07
*** jascott1 has quit IRC04:08
mikalDo I need to start the keystone-internal-svc pod separately somehow?04:09
*** jascott1 has joined #openstack-kolla04:09
*** ArminderSingh has joined #openstack-kolla04:10
*** mdnadeem has joined #openstack-kolla04:12
*** reddreamster has quit IRC04:12
*** jascott1 has quit IRC04:13
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145004:20
*** janki has joined #openstack-kolla04:32
korean101downgrade is not implemented? (https://github.com/openstack/kolla/blob/stable/pike/specs/containerize-openstack.rst)04:36
korean101now just specs?04:36
*** jascott1 has joined #openstack-kolla04:37
openstackgerritMerged openstack/kolla stable/pike: Fix the Ubuntu Fluentd image  https://review.openstack.org/52104504:45
*** skramaja has joined #openstack-kolla04:45
*** zhurong has quit IRC04:48
openstackgerritMerged openstack/kolla master: Modify the version of skydive to v0.14.0  https://review.openstack.org/52085104:53
*** kiennt26 has quit IRC04:58
*** salv-orlando has joined #openstack-kolla05:03
*** caowei has quit IRC05:04
*** salv-orlando has quit IRC05:07
*** zhurong has joined #openstack-kolla05:12
*** manheim has joined #openstack-kolla05:12
*** manheim has quit IRC05:17
*** janki has quit IRC05:17
lxdongI remeber there are pools named .rgw.root and rbd created by containerized ceph, is it necessary to create these pools first?05:28
*** caowei has joined #openstack-kolla05:29
SamYaplelxdong: radosgw creates those pools05:29
SamYapleautomatically05:29
*** pratapagoutham has joined #openstack-kolla05:30
lxdongI have no these pools.05:31
*** jtriley_ has joined #openstack-kolla05:31
*** jtriley has quit IRC05:32
SamYapleyou will if you run radosgw. it will create them05:32
lxdongI thought it should be the way you said but can't find reference . Yes ,I ran radosgw ,no pools created.05:33
*** janki has joined #openstack-kolla05:35
lxdongSamYaple , is this the reason that once created pools manually , ceph will turn to WARN status and pgs are inactive.05:36
lxdongI ran radosgw literally, no options.05:38
*** oanson_ has joined #openstack-kolla05:52
*** oanson has quit IRC05:52
*** oanson_ is now known as oanson05:52
lxdongceph-deploy --overwrite-conf  rgw create compute01 compute02  created .rgw.root with default pgs number of 8 and all 8 pgs are inactive.05:54
lxdong 100.000% pgs not active05:55
*** zhangfei has quit IRC05:58
*** caowei has quit IRC06:03
*** salv-orlando has joined #openstack-kolla06:04
*** caowei has joined #openstack-kolla06:04
*** salv-orlando has quit IRC06:05
*** salv-orlando has joined #openstack-kolla06:05
*** Ashu has joined #openstack-kolla06:05
AshuI am trying to enable tacker in kolla-ansible.. As per my knowledge for that we just need to set enable_tacker to yes... After dependent I am able to see tacker in horizon however no docker container service is spawned tacker06:07
AshuPlease help06:07
*** zhangfei has joined #openstack-kolla06:11
*** lpetrut has joined #openstack-kolla06:24
*** sanjayu_ has joined #openstack-kolla06:28
*** openstackgerrit has quit IRC06:33
Jeffrey4lduonghq, inc0 could you review https://review.openstack.org/52133406:40
*** jtriley_ has quit IRC06:50
kolla-slack<egonzalez> ashu, tacker requires barbican, mistral and redis to be enabled. There is a doc in kolla site06:55
*** egonzalez has joined #openstack-kolla06:58
*** xinliang has quit IRC06:58
egonzalezAshu, https://docs.openstack.org/kolla-ansible/latest/reference/tacker-guide.html06:59
egonzalezAshu, tacker exists in kolla since ocata, older releases has no tacker supported07:01
*** absubram has joined #openstack-kolla07:01
*** jamesbenson has joined #openstack-kolla07:02
*** absubram has quit IRC07:05
korean101egonzalez: HI07:06
*** jamesbenson has quit IRC07:06
korean101egonzalez: can i downgrade pike to ocata?07:07
korean101egonzalez: i can't see downgrade command07:07
egonzalezkorean101, nope07:07
korean101egonzalez: huh07:07
egonzalezthere is no openstack way to downgrade07:07
*** itlinux has quit IRC07:07
egonzalezyou have to recover your database to a backup before upgrade, deploy older containers and probably restart all instances to pick new xml07:08
egonzalezand likely some inconsistency will be raised somewhere07:08
korean101egonzalez: 7 page (http://s.itho.me/openstack/2016/102/102-2.pdf)07:09
*** absubram has joined #openstack-kolla07:09
egonzalezkorean101, re phrase my statement07:09
egonzalezyou can downgrade in same release (pike 2 to pike 1) but not downgrade releases (pike to ocata)07:10
korean101egonzalez: OK07:10
AshuHi can reconfigure also help when we enable new service in globals. Yml07:10
korean101egonzalez: When upgrading or downgrading OpenStack (https://github.com/openstack/kolla-ansible/blob/stable/pike/specs/containerize-openstack.rst)07:11
korean101egonzalez: this downgrading means minor version?07:11
egonzalezkorean101, yes, mayor versions requires a lot more work than just came to a prior working state07:12
*** openstackgerrit has joined #openstack-kolla07:12
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Apply neutron database migration  https://review.openstack.org/40792207:12
korean101egonzalez: really really helpful07:12
korean101egonzalez: many thanks!07:13
egonzalezAshu, yep or deploy07:13
*** xinliang has joined #openstack-kolla07:14
*** jtriley has joined #openstack-kolla07:17
AshuHi enable mistral barbican and redis for tacker however deploy ment fails in task copying mistral. Conf dict object has no attitude redis07:18
*** jtriley has quit IRC07:22
*** coolsvap has joined #openstack-kolla07:22
*** ipsecguy_ has joined #openstack-kolla07:22
*** ipsecguy has quit IRC07:22
*** lxdong has quit IRC07:23
*** manheim has joined #openstack-kolla07:29
*** jtriley has joined #openstack-kolla07:31
egonzalezAshu, what release?07:43
egonzalezthat services are required for pike, ocata only need tacker07:43
openstackgerritMerged openstack/kolla stable/ocata: Dockerhub publisher job  https://review.openstack.org/52133407:46
AshuPike07:46
*** threestrands has quit IRC07:47
*** pcaruana has joined #openstack-kolla07:49
*** lpetrut has quit IRC07:50
*** mgoddard has joined #openstack-kolla07:53
*** jtriley has quit IRC07:55
*** lpetrut has joined #openstack-kolla07:55
*** shardy has joined #openstack-kolla07:59
egonzalezAshu, mind sharing globals.yml and exact log error?08:01
*** goldyfruit has joined #openstack-kolla08:01
*** manheim has quit IRC08:04
*** manheim has joined #openstack-kolla08:04
duonghqegonzalez, ping08:05
*** sanjayu_ has quit IRC08:08
*** manheim has quit IRC08:09
*** goldyfruit has quit IRC08:13
*** goldyfruit has joined #openstack-kolla08:14
egonzalezduonghq, sup08:14
*** reddreamster has joined #openstack-kolla08:14
duonghqegonzalez, can you help me on this log: http://logs.openstack.org/22/407922/22/check/kolla-ansible-ubuntu-source/6aa10a8/primary/docker_logs/fluentd.txt.gz08:15
reddreamsterHi, can I ask a question about ironic? One of my node is always in 'inspecting' state, how can I delete it?08:15
duonghqI cannot figure why fluent config is wrong, I do not touch the file08:16
duonghqhttps://review.openstack.org/#/c/407922/08:16
egonzalezduonghq, is being fixed, not sure if already done08:16
duonghqah, thanks08:16
*** manheim has joined #openstack-kolla08:17
*** manheim_ has joined #openstack-kolla08:19
*** manheim has quit IRC08:19
*** gkadam has joined #openstack-kolla08:20
*** manheim_ has quit IRC08:20
*** manheim has joined #openstack-kolla08:21
*** jtriley has joined #openstack-kolla08:21
openstackgerritWei Cao proposed openstack/kolla-ansible master: Add CephFS backend in Manila  https://review.openstack.org/51619608:22
*** jmccarthy has joined #openstack-kolla08:24
*** salv-orlando has quit IRC08:25
*** salv-orlando has joined #openstack-kolla08:26
*** jtriley has quit IRC08:26
*** lpetrut has quit IRC08:27
*** salv-orlando has quit IRC08:30
*** jtriley has joined #openstack-kolla08:31
*** amoralej|off is now known as amoralej08:36
*** magicboiz has joined #openstack-kolla08:40
*** rumors has joined #openstack-kolla08:42
*** salv-orlando has joined #openstack-kolla08:42
openstackgerritMerged openstack/kolla master: Use 3 hours timeout for gate jobs and install yum-axelget  https://review.openstack.org/52171608:44
*** heigao has quit IRC08:48
*** heigao has joined #openstack-kolla08:48
*** Ashu has quit IRC08:49
*** ktibi has joined #openstack-kolla08:51
*** goldyfruit has quit IRC08:51
*** heigao has quit IRC08:54
*** gfidente has joined #openstack-kolla08:55
*** gfidente has quit IRC08:55
*** gfidente has joined #openstack-kolla08:55
*** rmart04 has joined #openstack-kolla09:01
*** jascott1 has quit IRC09:05
*** jascott1 has joined #openstack-kolla09:05
*** zhurong has quit IRC09:09
*** jascott1 has quit IRC09:09
*** goldyfruit has joined #openstack-kolla09:11
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Horizon multidomain flag  https://review.openstack.org/52195009:19
ktibiegonzalez Hi, If I want my review to be cherry-pick in stable/pike, what is the good way ?09:21
egonzalezktibi, from my POV is a feature and shouldnt be backported09:22
*** jascott1 has joined #openstack-kolla09:28
ktibino for this PR, but for https://review.openstack.org/#/c/519302/09:28
*** jtriley has quit IRC09:32
*** jamesbenson has joined #openstack-kolla09:43
*** jamesbenson has quit IRC09:47
openstackgerritWei Cao proposed openstack/kolla-ansible master: Update URL in documents of zun and kuryr  https://review.openstack.org/52219509:48
egonzalezktibi, not really sure, as may be a change that can break existing deployments09:55
ktibiegonzalez, ok so I'll continue to work with my own local repo for kolla09:58
*** jtriley has joined #openstack-kolla09:58
*** duonghq has quit IRC10:00
jmccarthyAnyone hit this before with swift ? http://paste.openstack.org/show/627054/ I can't see why my 'operator' node is involved in this task at all, I have checked the inventory ..10:01
*** lpetrut has joined #openstack-kolla10:01
*** ashu has joined #openstack-kolla10:02
ashuHello10:02
ashuI am facing issue with tacker I have enabled mistral redis barbican and tacker... Deploy ment fails in mistral showing dint obj has no attribute redis10:04
ashuI have asked question in https://ask.openstack.org/en/question/11126210:06
*** tovin07_ has quit IRC10:08
*** jtriley has quit IRC10:10
openstackgerritWei Cao proposed openstack/kolla-ansible master: Update URL in documents of zun and kuryr  https://review.openstack.org/52219510:12
*** jtriley has joined #openstack-kolla10:17
jmccarthyHmm ok I thought 2.2 would be ok, anyway updated to ansible 2.4.1 and the issue went away10:22
*** jtriley has quit IRC10:24
*** caowei has quit IRC10:29
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add a precheck to ensure Cinder backend enabled  https://review.openstack.org/52105110:30
*** jtriley has joined #openstack-kolla10:34
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: kubernetes: get it working on AArch64 as well  https://review.openstack.org/46404510:35
hrwmorning10:36
hrwcan someone look at that kube change ^^?10:36
*** jtriley has quit IRC10:39
*** magicboiz has quit IRC10:45
*** jtriley has joined #openstack-kolla10:46
*** k_mouza has joined #openstack-kolla10:50
egonzalezashu, is redis group in inventory?10:53
egonzalezi'd say answer is no due the error message10:54
*** jtriley has quit IRC10:55
*** goldyfruit has quit IRC10:56
*** jtriley has joined #openstack-kolla10:58
ashuYes Egonzalez found out the issue was in invetory thanks11:01
*** reddreamster has quit IRC11:01
*** jtriley has quit IRC11:06
*** ashu has quit IRC11:06
*** jtriley has joined #openstack-kolla11:08
pratapagouthamegonzalez: Compute log shows no error at all11:11
pratapagouthamI have sent a mail regarding the nova compute service doesnt come up11:12
*** magicboiz has joined #openstack-kolla11:12
*** zhangfei has quit IRC11:13
*** jtriley has quit IRC11:28
*** goldyfruit has joined #openstack-kolla11:35
*** jtriley has joined #openstack-kolla11:35
*** jtriley has quit IRC11:44
*** goldyfruit has quit IRC11:44
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145011:47
*** skramaja has quit IRC11:48
*** jascott1 has quit IRC11:48
*** jascott1 has joined #openstack-kolla11:49
openstackgerritRavi Shekhar Jethani proposed openstack/kolla-ansible master: Remove checking m1.tiny flavor  https://review.openstack.org/52222111:51
*** jtriley has joined #openstack-kolla11:53
*** jascott1 has quit IRC11:53
*** jtriley has quit IRC11:58
*** shardy has quit IRC12:04
*** shardy has joined #openstack-kolla12:06
*** jtriley has joined #openstack-kolla12:07
*** janki has quit IRC12:08
*** jtriley has quit IRC12:14
*** shardy has quit IRC12:15
*** jtriley has joined #openstack-kolla12:16
*** shardy has joined #openstack-kolla12:16
*** jtriley has quit IRC12:20
*** heigao has joined #openstack-kolla12:22
*** shardy has quit IRC12:23
*** jtriley has joined #openstack-kolla12:25
*** shardy has joined #openstack-kolla12:28
*** jtriley has quit IRC12:33
*** abishop has joined #openstack-kolla12:34
*** lucker has joined #openstack-kolla12:40
*** lucker has left #openstack-kolla12:40
*** pratapagoutham has quit IRC12:41
*** jtriley has joined #openstack-kolla12:43
*** lxdong has joined #openstack-kolla12:44
lxdong Build of instance f26fe02d-ba77-4ec8-8482-d62dc06eb959 aborted: Volume e56d5a7a-66d9-4b30-9183-c18bf121469f did not finish being created even after we waited 0 seconds or 1 attempts. And its status is error.]12:44
*** heigao has quit IRC12:44
lxdongexternal ceph can upload image while unable to create instance .12:45
*** yangyapeng has joined #openstack-kolla12:45
*** mdnadeem has quit IRC12:46
*** jtriley has quit IRC12:49
*** jtriley has joined #openstack-kolla12:55
*** rhallisey has joined #openstack-kolla12:58
lxdongnova_compute logs http://paste.openstack.org/show/627075/13:00
*** jtriley has quit IRC13:03
*** amoralej is now known as amoralej|brb13:04
*** jtriley has joined #openstack-kolla13:08
*** jtriley has quit IRC13:16
*** jtriley has joined #openstack-kolla13:20
*** goldyfruit has joined #openstack-kolla13:23
*** janki has joined #openstack-kolla13:26
*** k_mouza_ has joined #openstack-kolla13:27
*** k_mouza has quit IRC13:27
*** jtriley has quit IRC13:28
*** jtriley has joined #openstack-kolla13:33
*** magicboiz has quit IRC13:40
*** jtriley has quit IRC13:41
*** mgoddard has quit IRC13:42
lxdongcinder_volume logs http://paste.openstack.org/show/627083/13:43
*** dave-mcc_ has joined #openstack-kolla13:44
*** daidv_ has joined #openstack-kolla13:48
*** daidv_ has quit IRC13:49
*** jtriley has joined #openstack-kolla13:49
*** daidv_ has joined #openstack-kolla13:49
*** amoralej|brb is now known as amoralej13:55
*** glycerine has quit IRC13:55
*** glycerine has joined #openstack-kolla13:56
*** zhangfei has joined #openstack-kolla13:57
*** jtriley has quit IRC14:09
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145014:21
*** mgoddard has joined #openstack-kolla14:22
*** yangyapeng has quit IRC14:24
pbourkesbezverk: ping14:24
*** benjamin_ has joined #openstack-kolla14:28
*** benjamin_ has quit IRC14:29
*** benjamin_diaz has joined #openstack-kolla14:29
*** zhangfei has quit IRC14:29
*** benjamin_diaz has quit IRC14:29
*** benjamin_diaz has joined #openstack-kolla14:30
*** tvignaud has quit IRC14:34
*** jtriley has joined #openstack-kolla14:42
*** zhangfei has joined #openstack-kolla14:46
*** pbourke has quit IRC14:49
*** pbourke has joined #openstack-kolla14:50
*** jascott1 has joined #openstack-kolla14:51
*** tvignaud has joined #openstack-kolla14:52
*** zhangfei has quit IRC14:54
*** jascott1 has quit IRC14:56
*** duonghq has joined #openstack-kolla15:01
ktibianyone works on manila and ceph ??15:02
sbezverkpbourke: pong15:12
pbourkesbezverk: hi :) just wrt to https://review.openstack.org/#/c/309102/15:13
pbourkei know it was a while ago15:13
pbourkebut did this work ok for you?15:13
sbezverkpbourke yep15:13
pbourkeI ask as we're seeing https://bugs.launchpad.net/kolla/+bug/157313715:14
openstackLaunchpad bug 1573137 in kolla mitaka "need swift-rsync to run using port above 1024" [High,Fix released] - Assigned to Serguei Bezverkhi (sbezverk)15:14
pbourkewait sorry, wrong link15:14
pbourkehttps://bugs.launchpad.net/kolla/+bug/173385115:15
openstackLaunchpad bug 1733851 in kolla "swift rsync operations fail, no daemon on port 873" [High,Confirmed]15:15
pbourkeessentially swift is trying to rsync on the default privelaged port15:15
pbourkebut our container is listening on the new port15:15
jmccarthysbezverk: Oh your looking into that bug ? I am also, might have a temp fix - can you reproduce it ?15:18
sbezverkjmccarthy I am not looking into that bug, sorry15:19
*** yangyapeng has joined #openstack-kolla15:19
jmccarthyOh ok - it'd be great if someone else also confirmed ;)15:21
*** hongbin has joined #openstack-kolla15:24
openstackgerritRavi Shekhar Jethani proposed openstack/kolla-ansible master: Don't change directory while running init-runonce  https://review.openstack.org/52119015:25
jmccarthyI think the 'sync_module' in the conf doesn't actually do anything ..15:26
openstackgerritRavi Shekhar Jethani proposed openstack/kolla-ansible master: Remove checking m1.tiny flavor  https://review.openstack.org/52222115:29
*** lrensing has joined #openstack-kolla15:34
*** lrensing has quit IRC15:40
*** daidv_ has quit IRC15:40
*** jamesbenson has joined #openstack-kolla15:44
*** jamesbenson has quit IRC15:44
*** jtriley has quit IRC15:44
*** jtriley has joined #openstack-kolla15:45
*** vhosakot has joined #openstack-kolla15:45
sdakeinc0 u about15:52
inc0now I am15:55
inc0good morning15:55
sdakesup15:56
sdaketh ereview you wanted reviews on15:56
sdakedid you get that?15:56
inc0https://review.openstack.org/#/c/518797/15:57
inc0meeting in 215:57
*** magicboiz has joined #openstack-kolla15:58
*** egonzalez90 has joined #openstack-kolla16:00
*** rmart04 has quit IRC16:00
openstackgerritJeffrey Zhang proposed openstack/kolla stable/pike: Dockerhub publisher job  https://review.openstack.org/51879716:00
*** egonzalez has quit IRC16:01
*** salv-orlando has quit IRC16:02
*** salv-orlando has joined #openstack-kolla16:03
*** manheim has quit IRC16:07
*** salv-orlando has quit IRC16:07
*** magicboiz has quit IRC16:08
*** manheim has joined #openstack-kolla16:11
*** egonzalez90 has quit IRC16:12
*** manheim has quit IRC16:13
*** manheim has joined #openstack-kolla16:13
*** janki has quit IRC16:13
*** jamesbenson has joined #openstack-kolla16:16
*** manheim has quit IRC16:17
*** jamesbenson has quit IRC16:18
*** egonzalez has joined #openstack-kolla16:19
*** jamesbenson has joined #openstack-kolla16:21
kfox1111morning.16:21
*** magicboiz has joined #openstack-kolla16:21
openstackgerritMerged openstack/kolla-ansible master: HyperV should not disable tunneling  https://review.openstack.org/51566016:24
*** magicboiz has quit IRC16:26
*** itlinux has joined #openstack-kolla16:26
*** magicboiz has joined #openstack-kolla16:26
*** jtriley has quit IRC16:26
openstackgerritJeffrey Zhang proposed openstack/kolla master: Improve gate post jobs  https://review.openstack.org/51996916:27
*** ener938 has joined #openstack-kolla16:31
ener938When is the meeting starting16:32
*** manheim has joined #openstack-kolla16:32
egonzalezener938 now, #openstack-meeting-416:33
*** ener938 has left #openstack-kolla16:34
openstackgerritMerged openstack/kolla-ansible master: Associate text to link  https://review.openstack.org/51298316:35
*** jtriley has joined #openstack-kolla16:36
*** manheim has quit IRC16:37
*** egonzalez has quit IRC16:38
*** manheim has joined #openstack-kolla16:42
*** rhallisey has quit IRC16:44
*** itlinux has quit IRC16:47
*** jascott1 has joined #openstack-kolla16:52
kfox1111inc0: ping16:52
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145016:53
*** jascott1 has quit IRC16:57
*** duonghq has quit IRC17:00
*** itlinux has joined #openstack-kolla17:02
*** salv-orlando has joined #openstack-kolla17:04
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145017:07
*** salv-orlando has quit IRC17:08
*** itlinux has quit IRC17:15
*** ntpttr_laptop has joined #openstack-kolla17:15
*** pcaruana has quit IRC17:18
*** jtriley has quit IRC17:19
*** dciabrin_ has joined #openstack-kolla17:20
inc0kfox1111: now I'm up17:20
*** dciabrin has quit IRC17:22
*** ntpttr_laptop has quit IRC17:24
*** gkadam has quit IRC17:25
*** ntpttr_laptop has joined #openstack-kolla17:27
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145017:28
*** gfidente^2nd has joined #openstack-kolla17:28
*** gfidente has quit IRC17:30
*** salv-orlando has joined #openstack-kolla17:31
*** salv-orlando has quit IRC17:31
*** salv-orlando has joined #openstack-kolla17:31
*** manheim has quit IRC17:34
*** jamesbenson has quit IRC17:38
*** absubram has quit IRC17:39
*** jamesbenson has joined #openstack-kolla17:40
dmsimardinc0: fyi it looks like the kolla jobs don't use the reverse proxy for trunk.rdoproject.org, seeing a lot of DNS lookup failures17:42
dmsimardinc0: logstash.openstack.org: (message:"Could not resolve host" OR message:"Name or service not known") AND message:"trunk.rdoproject.org"17:42
inc0Jeffrey4l: ^17:43
dmsimardJeffrey4l: I discussed squid (or something like that) a while back with inc0, is that what I think it is ?17:43
inc0we had some issues with delorean few days back, I dont know much about it:(17:43
inc0squid is not merged yet17:43
dmsimardinc0: there's DNS failures on a semi regular basis, it's not a one time thing17:43
inc0we'll look into it, thanks dmsimard17:44
dmsimardI count 15 occurrences but it might be more, we've been having some issues with logstash17:44
dmsimardinc0: ack17:44
*** manheim has joined #openstack-kolla17:45
*** jtriley has joined #openstack-kolla17:48
*** itlinux has joined #openstack-kolla17:49
*** k_mouza_ has quit IRC17:49
*** goldyfruit has quit IRC17:51
*** goldyfruit has joined #openstack-kolla17:51
*** dmsimard is now known as dmsimard|afk17:53
*** lpetrut has quit IRC17:59
*** jascott1 has joined #openstack-kolla18:00
*** jtriley has quit IRC18:03
*** mgoddard has quit IRC18:04
*** goldyfruit has quit IRC18:08
openstackgerritJeffrey Zhang proposed openstack/kolla master: Change more repo url to infra mirror  https://review.openstack.org/52231818:09
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145018:10
*** coolsvap has quit IRC18:12
*** ntpttr_laptop has quit IRC18:13
*** ntpttr_laptop has joined #openstack-kolla18:13
ntpttrinc0: hey, if I need to tear down and redeploy my openstack how do i reconfigure ceph? I didn't, I just did the kolla-ansible destroy command, and now trying to deploy again is giving me failures with ceph18:21
inc0what kind of failures?18:22
inc0(don't forget you'll need to mark disks with BOOTSTRAP thingy again)18:23
*** TxGirlGeek has joined #openstack-kolla18:23
jamesbensonntpttr: Is it external ceph?18:26
ntpttrjamesbenson: no, just trying to deploy ceph with kolla ala https://docs.openstack.org/kolla-ansible/ocata/ceph-guide.html18:27
jamesbensonntpttr: did you do what inc0 mentioned, relabeling the disks?18:40
ntpttryes, running the deploy now to see what happens18:41
jamesbensonif you didn't do that before, it'll produce errors,  hoepfully that will fix it18:41
*** jtriley has joined #openstack-kolla18:41
jamesbensoninc0: you'll be proud, I'm digging deeper into k8s now... ;-)18:41
inc0nice18:42
inc0I'm digging deeper into pxe;)18:42
inc0you're going forward, I'm going backwards18:42
jamesbensonlol, but your solution could solve a lot of fundamental problems ;-)18:48
inc0right now it's mostly kfox1111's solution18:48
jamesbenson*your plural? ... silly english language.18:49
inc0he might very well be if you look at amount of work he cracks up, but it's his solution not mine18:50
jamesbensonPersonally it completely baffles me ubuntu's solution for maas isn't more elegant.18:51
*** shardy has quit IRC18:51
inc0I don't like giant monolyths, that's why maas is meh for me18:52
inc0solution we work on will be microservice based18:52
jamesbensondefinitely18:55
*** giulivo^3rd has joined #openstack-kolla19:08
openstackgerritAndy Smith proposed openstack/kolla-ansible master: Add support for hybrid messaging backends  https://review.openstack.org/46896619:10
*** gfidente^2nd has quit IRC19:10
*** lpetrut has joined #openstack-kolla19:19
*** mgoddard has joined #openstack-kolla19:21
*** salv-orlando has quit IRC19:24
*** salv-orlando has joined #openstack-kolla19:24
*** niedbalski is now known as ikslabdein19:26
*** ikslabdein is now known as gyosaboy19:26
*** gyosaboy is now known as niedbalski19:27
*** salv-orlando has quit IRC19:28
jascott1inc0 cobbler not good enough?19:42
inc0ever tried to use it?19:42
inc0jascott1: since I have your attention19:44
jascott1I have19:44
inc0what's best way to simulate python's dict update in golang?19:45
jascott1does it overwrite keys?19:45
inc0a = {'foo': 'bar', 'doos': 'foos'}; a.update({'foo': 'bas'}); a == {'foo': 'bas', 'doos': 'foos'}19:45
*** amoralej is now known as amoralej|off19:46
inc0basically waht I want to do is to have yaml file inheritance19:46
inc0where you can specify parent struct and it will produce struct combined of these parents19:47
jascott1well an update would be a loop like for k, v := range mymapNEW{ mymapORIG[k] = v }19:47
kfox1111jascott1: cobbler's getting long in the tooth and they keep breaking it on us.19:48
kfox1111and its very monolythic.19:48
kfox1111been working on replacing it with microservices on k8s. :)19:48
inc0also writing kickstart/preseed files is old19:48
jascott1MAAS looked like overkill for some situations tho19:48
jascott1from what little I know about it19:49
kfox1111can then easily replace parts of it with your own parts if your site needs a particular tweak, without reworking the whole stack.19:49
inc0that's exactly why me and kfox work on simple solutioon;)19:49
* kfox1111 nods.19:49
jascott1nice19:49
kfox1111 Ireally like cobblers simplicity. the architecture is just old/stinky.19:49
*** mgoddard has quit IRC19:49
kfox1111with k8s and cloud native being a thing, we can do better with a rewrite now I think.19:49
jascott1inc0 struct? its usually  a map19:49
inc0jascott1: if you want in19:49
inc0I could use help with this golangy thing19:50
jascott1sure im still troubleshooting exce/logs prob on cluster19:50
inc0so consider this: we want to have yamls: one for basic OS configuration(will say ubuntu.yaml and centos.yaml)19:50
jascott1thinking its node dns reslution19:50
inc0another file with raid configuration19:51
inc0and you'll have one struct at the bottom saying parent: - ubuntu.yaml - raid.yaml19:51
kfox1111ping on slack19:52
kfox1111lets take it there.19:52
*** rwsu has quit IRC19:52
jmccarthyDoes kolla have a slack channel ?19:54
*** zshi has quit IRC19:57
jascott1jmccarthy there is a slack bride to kubernetes slack20:08
kolla-slack<james.m.mccarthy> Sweet20:13
*** zshi has joined #openstack-kolla20:13
rwellumkfox1111: inc0 So kevinz see's the same libvirt issue that I do and we have the following bug written up: https://bugs.launchpad.net/kolla/+bug/173380620:23
openstackLaunchpad bug 1733806 in kolla "Deploy Nova libvirt with Kolla kubernetes get error for libvirt" [Undecided,New]20:23
rwellumkfox1111: I think when we spoke about this before you were going to bring up a cluster and see if you saw it too?20:24
*** ktibi has quit IRC20:24
*** salv-orlando has joined #openstack-kolla20:25
rwellumjascott1: any luck getting k8 sup?20:25
jascott1still have exec/logs problem :(20:25
*** itlinux has quit IRC20:25
jascott1rwellum do you have node name resolution (DNS) working for nodes?20:25
jascott1i dont have that and found some related threads suggesting thats required20:26
jascott1(not just /etc/hosts entries)20:26
kfox1111rwellum: yeah. sorry. just haven't had time to dig into that. :(20:27
rwellumjascott1: yes no problem there.20:27
kfox1111I'm not running anything so new as 5.x20:27
kfox1111we're just now talking about getting to ocata. :(20:28
rwellumkfox1111: np - just checking20:28
kfox1111yeah. sorry.20:29
kfox1111wish I had more time to help. :(20:29
rwellumjascott1: these are three issues I've had to deal with lately. https://www.irccloud.com/pastebin/5OSQUIwC/20:30
rwellumLiterally had to use all three fixes to make things work20:30
rwellumkfox1111: working on a Cinder/storage project that needs pike unfortunately.20:30
*** jtriley has quit IRC20:30
*** salv-orlando has quit IRC20:31
rwellumThey are telling me: ''it works with devstack".20:31
kfox1111heh. did you see my rant on the devel mailing list?20:31
kfox1111"why do ops never keep up to date with openstack"20:31
rwellumNot yet - will go check :)20:31
kfox1111it was a while back.20:32
kfox1111"because upgrades suck becuase the devs never bother.they just spit out fresh devstacks"20:32
kfox1111if devs bother to try and use their own system, then they might feel the same pain, and be inclined to fix it.20:33
rwellumYeah that's why the dev mode inc0 is pushing is so freaking awesome to me.20:33
kfox1111+120:33
kfox1111if it hurts, do it often until it stops hurting.20:34
kfox1111openstack devs need to start doing upgrades themselves.20:34
kfox1111then they will make it hurt less because they will be helping themselves.20:34
rwellumYes exactly.20:34
kfox1111right now, they don't even realize there is a hurt.20:34
kfox1111and blame ops for complaining. :(20:34
kfox1111and us ops are going away because of it.20:34
*** giulivo^3rd has quit IRC20:35
kfox1111which means their employoers will stop paying them to work on it.20:35
kfox1111which doesn't benifit them.20:35
inc0I don't push devmode that much, I'd love it to happen but I don't have energy to push it :(20:35
kfox1111but they seem blindsided by it, which they shouldn't. I'v ebeen warning them for years. :(20:35
rwellumit's like a growing pain; I worked for a company that starts with a 'C' and we went through the same thing. Eventually you have to listen to your customers.20:35
kfox1111yup.20:35
kfox1111you either listen, or die.20:35
inc0communities doesn't have customers20:36
inc0that's the issue20:36
kfox1111I suspect openstack will largely die off. their listeners are still not on.20:36
rwellumwell customers=operators no?20:36
kfox1111yup. they absolutely have customers.20:36
kfox1111its just a bit more round about.20:36
kfox1111the pay structure is very different.20:36
inc0well, they *should* have customers20:36
kfox1111with open source,20:36
inc0and ops should be customers20:36
inc0but with community it doesn't work this way20:37
kfox1111the more users you have the better. as a small portion of users become developers.20:37
kfox1111the more users you have, the more developers you can mobilize.20:37
kfox1111its done directly, by non paying customers use your stuff and put up devs,20:37
inc0what I think is problem in OpenStack is that there is dev community and there is ops community20:37
kfox1111or indirectly through resellers like redhat,20:37
inc0and they don't touch nearly as much as they should20:37
kfox1111who have paying customers, and some of the income is directed to devs to make the system better.20:37
*** rwsu has joined #openstack-kolla20:38
inc0ops rarely go to ptg, devs rarely go to ops midcycle20:38
inc0and neither goes to forum20:38
rwellumOne thing confuses me - I thought this was the strength of being a devops. I mean I'd consider most of you guys devops - especially people like kfox1111.20:38
kfox1111iether way, end users = life in open source.20:38
inc0well rwellum deployment tools are a bit different culture20:38
kfox1111yeah. openstack devs really are out of touch with ops. and even other openstack devs. :(20:38
inc0you have most of devops here20:38
inc0but it's not standard in non-deployment projects20:39
kfox1111rwellum: yeah, I'm kind of devops. but I'm also something different.20:39
kfox1111devops is kind of about using devel like tools for deployment.20:39
kfox1111I do that, but also do something entirely different.20:39
kfox1111I try and keep about 50% of my time doing dev work, and about 50% of my time doing ops work. pure.20:39
kfox1111the idea being, if I'm a dev, I can bring in ops knowlege and share with devs what ops need.20:40
inc0that's the premise of devops20:40
inc0you run what you make20:40
kfox1111and as an op, I know what devs can and cant do and can find the stuff that wil really bight us and mitigate it, while not worrying so much about new things.20:40
inc0if you make crap, it's you that'll get hurt by it20:40
kfox1111inc0: yeah, but thats my point. I don't run what I make.20:40
kfox1111I try and interface with devs a lot of times too in getting them to understand what ops needs and how they think.20:41
kfox1111which is why I advocate so much to openstack-dev.20:41
rwellumThat's actually much harder imo kfox111120:41
rwellumYou straddle both worlds.20:41
kfox1111right.20:41
kfox1111dev, ops and devops are actually 3 different worlds.20:41
kfox1111I use devops myself for my own deployments, but I also play in the other 2 spaces.20:42
kfox1111and I think I'm a better dev for knowing ops, and a better op for knowing dev.20:42
kfox1111(I may be delusional. ;)20:42
inc0we are all a bit psychotic20:43
rwellumlol inc020:43
rwellumI'm def. dev - with maybe 10% ops. But you can see my lack of real-world experience in ops. One thing I need more training in; help -whatever... I simply can't figure out why the pike issue I am seeing is not occurring in our kolla-k8s gates. I wish the code and outputs were more readable - but maybe this is just me. But I feel like if I am seeing a problem, but our CI/CD is not - something is broken in the20:45
rwellumprocess.20:45
kfox1111rwellum: I don't think we have workign pike gates?20:48
kfox1111if its not tested, its borken. :(20:48
kfox1111I don't think it woudl take someone long to add them?20:48
rwellumkfox1111: I think sbezverk added (with the docker registry) but I also think it's truly master - so not stable/pike - could be wrong.20:50
kfox1111yeah. I think thats trunk.20:51
kfox1111but I think thats still experimental too?20:51
kfox1111not sure anyone checks it.20:51
rwellumAh that might be true.20:52
kfox1111might be a good test case though. submit a dummy change and do a 'check experimental' on it.20:52
kfox1111and check the results.20:52
*** jamesbenson has quit IRC20:52
rwellumyeah good point.20:52
rwellumkfox1111: wouldn't kolla-ansible technically see the same issue?20:54
kfox1111maybe, maybe not. depends on the reason for the breakage.20:55
kfox1111if its a needed config file change or some other docker runtime option change, maybe not.20:56
*** TxGirlGeek has quit IRC20:56
rwellumBut just to check; pike is being tested in the gates for kolla-ansible afayk?20:58
kfox1111don't know.20:59
kfox1111I don't think the released containers get tested much.20:59
kfox1111and self built ones are always a crapshoot. :(20:59
*** salv-orlando has joined #openstack-kolla21:00
*** salv-orlando has quit IRC21:00
*** salv-orlando has joined #openstack-kolla21:01
rwellumContainers are supposed to fix these issues :)21:01
*** benjamin_diaz has quit IRC21:01
*** mgoddard has joined #openstack-kolla21:06
kfox1111rwellum: tested containers can. :)21:06
kfox1111kolla isn't buidl that way currently htough. :(21:07
kfox1111kolla's docker hub needs fresh, stable released containers that are tested.21:07
kfox1111(its a work in progress)21:07
*** abishop has quit IRC21:11
rwellumYeah following that effort very closely.21:20
*** jmccarthy has left #openstack-kolla21:28
sbezverkpike used to work for a long time until something broke the gate21:31
*** pomac has quit IRC21:32
sdakemy guess is a qemu upstream chagne21:39
*** dave-mcc_ has quit IRC21:39
rwellumsbezverk: you know what issue it's failing on?21:42
rwellumsdake: we can restrict qemu to a known working version I guess.21:42
sdakeyou assume that version is in the rdo repo :)21:42
sdakeor the UCA repo21:43
sdakegenerally old versions are removed21:43
kfox1111yeah. thats why we keep cobbler mirrors of it all. :(21:44
kfox1111its a pain, but prevents random updates from breaking you at inoppertune times.21:44
*** mgoddard has quit IRC21:44
kfox1111the current kolla build it yourself infra doesn't take that kind of issue into account.21:44
*** threestrands has joined #openstack-kolla21:45
*** threestrands has quit IRC21:45
*** threestrands has joined #openstack-kolla21:45
*** mchlumsky has quit IRC21:46
rwellumgah - nasty21:48
kfox1111yeah. thats one of the reasons I want fresh tested hub images so much.21:49
kfox1111so users don't have to worry about that ugly.21:49
kfox1111unless they want to. :)21:49
kfox1111the testing kolla does currently is "it worked at one point in time".21:51
kfox1111not, it currently builds/works now if you were to build your own.21:51
*** mchlumsky has joined #openstack-kolla21:51
kfox1111and often the time difference between it was tested, and you building is enough different that lots of things change.21:51
*** lpetrut has quit IRC21:57
*** pomac has joined #openstack-kolla22:01
*** mrunge has quit IRC22:01
*** mrunge has joined #openstack-kolla22:04
rwellumIt truly is yeah.22:04
kfox1111the biggest benifit of containers I can see is the, deploy what you tested feature.22:09
kfox1111which kolla doesn't currently take great advantage of yet.22:09
kfox1111the exact container that was tested has to be shipped.22:09
*** ntpttr_laptop has quit IRC22:24
sdakekfox1111 this was being done prior to the TC motion to keep kolla from publishing docker images22:42
sdakekfox1111 (hence 4.0 images and prior are all good to go)22:42
sdakeand on that note, its nap time :)22:42
kfox1111agreed, once implemented.22:42
kfox1111still not there yet.22:42
sdakeit was there :)22:42
kfox1111hoping it will be weeks, but fearing it will be many months.22:42
kfox1111the current implementation only pushes trunk.22:43
kfox1111not a viable solution for non devs.22:43
sdakei can't speak to the current situation - the tc does not want kolla to push stable releases22:43
kfox1111the non trunk solution is not trivally the same as the trunk solution so will tkae time to develop.22:44
sdakethat is my understanding of the situation but I could be mistaken22:44
kfox1111I know the tc doesn't want it. but that doesn't mean they are right on what is best for openstack. :(22:44
sdakenap time - i'll bbl :)22:44
kfox1111l8r.22:44
*** rwsu has quit IRC22:55
*** abishop has joined #openstack-kolla23:21
*** abishop has quit IRC23:23
*** jascott1 has quit IRC23:29
*** jascott1 has joined #openstack-kolla23:29
*** vhosakot has quit IRC23:30
*** jascott1 has quit IRC23:34
*** ipsecguy_ has quit IRC23:46
*** ipsecguy has joined #openstack-kolla23:55
*** manheim has quit IRC23:55
*** salv-orlando has quit IRC23:57
*** salv-orlando has joined #openstack-kolla23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!