Tuesday, 2019-09-10

*** goldyfruit_ has joined #openstack-ansible00:20
*** admin0 has joined #openstack-ansible00:22
*** macz has quit IRC00:39
*** prometheanfire has quit IRC00:42
*** gyee has quit IRC00:42
*** prometheanfire has joined #openstack-ansible00:43
*** markvoelker has joined #openstack-ansible00:46
*** markvoelker has quit IRC00:48
*** markvoelker has joined #openstack-ansible00:49
*** spatel has joined #openstack-ansible00:49
*** spatel has quit IRC00:53
*** markvoelker has quit IRC00:59
*** markvoelker has joined #openstack-ansible00:59
*** markvoelker has quit IRC01:04
*** nicolasbock has quit IRC01:04
*** nicolasbock has joined #openstack-ansible01:04
*** NewJorg has quit IRC01:06
*** markvoelker has joined #openstack-ansible01:07
openstackgerritMerged openstack/openstack-ansible stable/rocky: Fix systemd-journal-remote socket dependency  https://review.opendev.org/67639701:10
*** markvoelker has quit IRC01:17
*** markvoelker has joined #openstack-ansible01:18
*** markvoelker has quit IRC01:23
*** markvoelker has joined #openstack-ansible01:48
*** nicolasbock has quit IRC02:01
*** spsurya has joined #openstack-ansible02:18
*** markvoelker has quit IRC02:20
*** markvoelker has joined #openstack-ansible02:22
*** gillesMo has quit IRC02:33
*** macz has joined #openstack-ansible02:36
*** macz has quit IRC02:41
guilhermesphuum jrosser yeah I got a bit confused because the -w comment I saw is mentioning a depends-on test job, that for me now in this case is https://review.opendev.org/#/c/681003/02:53
guilhermespjrosser: btw, I think this can be merged? https://review.opendev.org/#/c/670394/402:58
guilhermespabout the galera one, I think I may return to it tomorrow to keep debugging locally02:58
*** BjoernT has joined #openstack-ansible03:01
*** hamzy_ has quit IRC03:06
*** BjoernT has quit IRC03:24
*** dave-mccowan has quit IRC03:35
openstackgerritMerged openstack/ansible-role-thales-hsm master: Fix condition for setting seboolean  https://review.opendev.org/68060803:40
*** gkadam has joined #openstack-ansible03:59
*** udesale has joined #openstack-ansible04:07
*** cshen has joined #openstack-ansible04:12
*** macz has joined #openstack-ansible04:37
openstackgerritMerged openstack/openstack-ansible-os_swift master: Allow venv python interpreter to be overridden  https://review.opendev.org/68094404:38
*** macz has quit IRC04:41
openstackgerritMerged openstack/ansible-role-uwsgi master: Use a different venv per python executable  https://review.opendev.org/68101804:43
*** markvoelker has quit IRC04:48
openstackgerritMerged openstack/openstack-ansible-os_glance master: Allow venv python interpreter to be overridden  https://review.opendev.org/68046005:03
openstackgerritMerged openstack/openstack-ansible-os_nova master: Allow venv python interpreter to be overridden  https://review.opendev.org/68046705:08
openstackgerritMerged openstack/openstack-ansible-os_nova master: Restore nova-key tag  https://review.opendev.org/68056405:08
openstackgerritMerged openstack/openstack-ansible-os_placement master: Allow venv python interpreter to be overridden  https://review.opendev.org/68046905:10
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Allow venv python interpreter to be overridden  https://review.opendev.org/68039005:18
*** macz has joined #openstack-ansible05:21
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Add extra barbican services  https://review.opendev.org/67983205:23
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Remove duplicated templates from zuul jobs  https://review.opendev.org/67995905:23
*** markvoelker has joined #openstack-ansible05:26
*** markvoelker has quit IRC05:30
*** raukadah is now known as chandankumar05:34
*** macz has quit IRC05:38
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_horizon master: Add python3 compatibility to horizon role  https://review.opendev.org/68109606:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_horizon master: Add python3 compatibility to horizon role  https://review.opendev.org/68109606:07
*** miloa has joined #openstack-ansible06:09
*** dr_feelgood has joined #openstack-ansible06:25
*** kopecmartin|off is now known as kopecmartin06:26
*** jawad_axd has joined #openstack-ansible06:29
ChosSimbaOneMorning. Any input on where to look when my infrastructure node dies 100 sec after reboot, with no error to log er tty. Crashes hard, I cannot change tty or anything afterwards? Looked in the common logs, syslog/dmesg with out luck.06:43
openstackgerritMerged openstack/openstack-ansible master: Add uwsgi role to zuul required-projects  https://review.opendev.org/68075806:45
*** dr_feelgood has quit IRC06:46
*** southquist has joined #openstack-ansible06:46
*** dr_feelgood has joined #openstack-ansible06:46
*** luksky has joined #openstack-ansible06:52
*** threestrands has quit IRC07:20
*** rpittau|afk is now known as rpittau07:28
miloaMorning07:31
*** gkadam has quit IRC07:34
*** macz has joined #openstack-ansible07:39
*** macz has quit IRC07:43
*** trident has quit IRC07:50
*** mathlin has joined #openstack-ansible07:58
*** mathlin has left #openstack-ansible07:58
*** mathlin has joined #openstack-ansible07:59
*** trident has joined #openstack-ansible08:01
evrardjpmorning everyone08:10
evrardjpjrosser: hey, received your ping08:11
jrosserhi there08:11
evrardjptwo ways:08:11
evrardjpeither openstack-hosts08:11
evrardjpif it's EVERYWHERE08:11
evrardjpwhich I would say yes08:12
evrardjpelse, in each of those services.08:12
evrardjppython3-systemd you say?08:12
jrosseri *think* so08:12
jrosserinterestinly someone turned up here yesterday with a very similar problem happening for stein/heat on centos08:12
evrardjpoh08:14
jrossersame thing - "raise RuntimeError(\"Systemd bindings do not exist\")"08:14
evrardjpshouldn't this be part of the dependency list of a package though?08:14
evrardjpI will ask on our side08:14
evrardjpcould you propose a patch in the meantime in openstack-hosts?08:15
evrardjpI think it makes sense to have it everywhere08:15
jrosserright - and where this most obviously fails is the suse distro job, so yes i'd agree that it's a missing dependancy08:15
jrosseri am guessing at python3-systemd so i will make a patch to test that08:15
evrardjpyup08:15
evrardjpsounds good08:15
ppetitmorning!08:21
evrardjpmorning ppetit :)08:21
ppetitmorning evradjp :)08:22
ppetitso yesterday I came up with a dependency problem w.r.t to installing Stein release on centos 708:22
ppetitIt appeared thx to jrosser that the definition of repos was broken.08:23
ppetitI changed it to get something like.08:23
jrosserppetit: did you see my followup message?08:24
ppetithmmm... not sure08:24
ppetitargh paste bin is down08:25
ppetitLet's to it here if you don't mind08:25
ppetit_package_repos:08:25
ppetit  - name: rdo-qemu-ev08:26
ppetit    file: rdo08:26
ppetit    description: "RDO CentOS-$releasever - QEMU EV"08:26
ppetit    baseurl: "http://mirror.centos.org/centos/7/virt/$basearch/kvm-common/"08:26
ppetit    gpgcheck: yes08:26
ppetit    gpgkey: "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-Virtualization-RDO"08:26
ppetit  - name: openstack-stein08:26
ppetit    file: rdo08:26
ppetit    description: "OpenStack Stein Repository"08:26
ppetit    baseurl: "http://mirror.centos.org/centos/7/cloud/$basearch/openstack-stein/"08:26
ppetit    priority: 9908:26
ppetit    gpgcheck: yes08:26
ppetit    mirrorlist: "http://mirrorlist.centos.org/?release=7&arch=$basearch&repo=cloud-openstack-stein"08:26
ppetit    gpgkey: "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-Cloud"08:26
ppetit    exclude: "sip,PyQt4"08:26
ppetitSolved the initial problem dependency resolution pb. But know I get another one08:26
jrosserppetit: so i found this https://opendev.org/openstack/openstack-ansible-openstack_hosts/src/branch/stable/stein/defaults/main.yml#L147-L15308:27
ppetitisn't the bogus one you highlighted yesterday?08:27
jrosserthats where the var openstack_hosts_rdo_repo_url is defined08:28
ppetitWhat I get now is Package: python2-pyOpenSSL-19.0.0-1.el7.noarch (openstack-stein)\n           Requires: python2-cryptography >= 2.2.1\n           Available: python2-cryptography-1.7.2-2.el7.x86_64 (core-0)\n08:28
ppetitpython2-cryptography >= 2.2.1 is not available in centos7 core repo08:29
ppetitWhere am I supposed to get it from?08:30
ppetitin deps/latest perhaps?08:32
jrosserhave you followed all of the instrcutions for preparing your hosts?08:34
jrosserhere for the deployment host https://docs.openstack.org/project-deploy-guide/openstack-ansible/stein/deploymenthost.html08:34
ppetitI did yum upgrade the deployment host but not the target hosts because it would break the setup-host phase... Perhaps because of the openstack_hosts_package_repos config pb...08:37
*** sshnaidm|afk is now known as sshnaidm|ruck08:37
ppetitCan someone just tell me what's the correct openstack_hosts_package_repos config ? I will restart the installation from here.08:39
*** dr_feelgood has quit IRC08:42
jrosseras far as i know the repos are correct08:42
jrosseras they are currently08:42
*** dr_feelgood has joined #openstack-ansible08:42
ppetitokay, then perhaps I goofed somewhere... I'll restart the install and see were it takes me.08:43
ppetitjrosser: thanks08:43
jrossersure - if you can wipe stuff and try again that would be helpful08:43
ppetitjrosser: Yes I'll do that and let you know how it goes...08:44
jrosserthis is normal btw for the first few attempts in a lab, it usually takes a few iterations08:44
jrosserif you get massively stuck it is our weekly meeting here later today and there will be some centos users there who can answer authoritatively on the repos, which i can't08:45
ppetitok got it08:45
jrosserfor reference here are the CI jobs we run for stein https://review.opendev.org/#/q/branch:stable/stein+project:openstack/openstack-ansible08:46
jrosserand you can navigate to the logs there to see a centos job and see what happened08:47
jrosserhere for example is a recent one https://zuul.opendev.org/t/openstack/build/20e8ebc8ace149eaa272df7adc24e673/logs08:47
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Ensure python3-systemd is present on all hosts for suse systems  https://review.opendev.org/68118308:49
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata  https://review.opendev.org/68118408:51
openstackgerritMerged openstack/openstack-ansible master: Drop Cython requirements override  https://review.opendev.org/68098808:52
*** dr_feelgood has quit IRC09:00
*** dr_feelgood has joined #openstack-ansible09:03
evrardjpjrosser: so... I think we uncovered the problem because:09:15
evrardjp1) we move to py309:15
evrardjp2) we are now relying on journal logging09:15
jrosseryes09:15
evrardjpso I am investigating with Dirk if we should change our oslo-log packaging09:15
evrardjpjrosser: should I edit your patch?09:24
*** kaiokmo has joined #openstack-ansible09:24
jrossersure09:24
evrardjpI am assuming you're dealing with jobs and dependencies, so you might not want me to edit that patch because it will break other jobs... only for a commit message09:24
jrossernot for that one, standing alone i hope it will fix the suse distro job09:24
* jrosser maybe optimistic :)09:25
*** dr_feelgood has quit IRC09:25
*** dr_feelgood has joined #openstack-ansible09:29
openstackgerritMerged openstack/openstack-ansible master: Use python3 for the ansible-runtime venv  https://review.opendev.org/68102609:47
*** dr_feelgood has quit IRC09:56
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Use version filter instead of version_compare  https://review.opendev.org/68106210:05
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Use version filter instead of version_compare  https://review.opendev.org/68106210:06
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Use version test instead of version_compare  https://review.opendev.org/68106210:07
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use version test instead of version_compare  https://review.opendev.org/68104310:07
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Use version test instead of version_compare  https://review.opendev.org/68106410:09
*** udesale has quit IRC10:09
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-ops master: Use version test instead of version_compare  https://review.opendev.org/68106810:09
*** udesale has joined #openstack-ansible10:10
jrossernoonedeadpunk: turns out we were using 'version' like a filter in a few places, it's actually a test10:10
*** markvoelker has joined #openstack-ansible10:16
jrosserevrardjp: it's failed later on now, so python3-systemd was indeed not enough https://4caaf2db96fe8aa51e0e-693d804df18b904a897859c5865b9b7f.ssl.cf2.rackcdn.com/681183/1/check/openstack-ansible-deploy-aio_distro_metal-opensuse-15/2a3e597/job-output.txt10:20
*** markvoelker has quit IRC10:21
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Ensure python3-systemd is present on all hosts for suse systems  https://review.opendev.org/68118310:21
*** macz has joined #openstack-ansible10:25
openstackgerritMikael Loaec proposed openstack/openstack-ansible-ceph_client master: Importing keyrings from files rather than from mons  https://review.opendev.org/67176210:29
*** macz has quit IRC10:30
noonedeadpunkjrosser: have you placed version_compare replacement patch for python_venv_build? https://opendev.org/openstack/ansible-role-python_venv_build/src/branch/master/tasks/python_venv_preflight.yml#L41-L4710:33
jrosseri've not, would you like me to?10:34
noonedeadpunkI can place it - doesn't matter. I guess we need it anyway10:35
jrossernp10:36
noonedeadpunkJust to double check that it won't be a dublicate10:36
noonedeadpunkbtw,  even after https://review.opendev.org/#/c/681026/2 centos is still using pyhton2 venv10:36
noonedeadpunkSo we'll need some extra work for it10:36
*** jawad_axd has quit IRC10:40
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/ansible-role-python_venv_build master: Use version test instead of version_compare  https://review.opendev.org/68121210:43
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-lxc_hosts master: Use version test instead of version_compare  https://review.opendev.org/68121410:45
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-lxc_container_create master: Use version test instead of version_compare  https://review.opendev.org/68121610:47
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-nspawn_hosts master: Use version test instead of version_compare  https://review.opendev.org/68121710:48
openstackgerritMerged openstack/ansible-config_template master: Sync Sphinx requirement  https://review.opendev.org/67377410:50
*** cshen has quit IRC10:51
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [DNM] test ansible 2.9  https://review.opendev.org/68100310:51
*** markvoelker has joined #openstack-ansible10:55
*** cshen has joined #openstack-ansible10:57
noonedeadpunkI'm wondering if we can do smth regarding https://zuul.opendev.org/t/openstack/build/31c19d49b0744ab98c7aa5d1258012cd failed due to "qemu-system-x86_64: cannot set up guest memory 'pc.ram': Cannot allocate memory"10:59
*** markvoelker has quit IRC11:00
jrossernoonedeadpunk: we already did a few things to keep memory usage down for octavia11:01
jrosserinteresting it always breaks on the suse job11:01
noonedeadpunknot only for suse, but for suse always11:02
noonedeadpunkothers can be lucky and pass11:02
noonedeadpunkMaybe we should decrease this a bit? https://opendev.org/openstack/openstack-ansible-os_octavia/src/branch/master/defaults/main.yml#L41711:03
jrosseri wonder where the dstat report went11:03
jrossernoonedeadpunk: there should be a ton of stuff in the AIO bootstrap which reduces all of those vars11:04
jrosserhttps://github.com/openstack/openstack-ansible/blob/64f15b4f018266e3f28e7dbf97f95ebdd0ec0a6d/tests/roles/bootstrap-host/templates/user_variables.aio.yml.j2#L104-L11111:05
*** nicolasbock has joined #openstack-ansible11:06
*** udesale has quit IRC11:14
*** dave-mccowan has joined #openstack-ansible11:17
jrossernoonedeadpunk: last time a looked at the memory usage for octavia the best way was to use a local AIO and see where all the ram had gone11:18
*** jawad_axd has joined #openstack-ansible11:20
evrardjpjrosser: oooh11:27
evrardjpsad to hear that11:27
evrardjpbut it went further11:27
evrardjpwe are discussing about oslo.log internally11:28
evrardjpjrosser: https://review.opendev.org/#/c/681218/111:29
jrosserevrardjp: we seem to have quite good velocity on "fixing stuff" right now - can anyone look at the suse distro job becasuse thats one of the few remaining broken things?11:31
evrardjpjrosser: you think there is a wrong systemd unit packaged somewhere?11:31
jrosserfeels that way i think11:31
evrardjpI wasn't even aware we made distro voting11:32
evrardjpI mean distro package install11:32
jrosseroh it's not11:32
evrardjpoh but we have it just at arms' length, that's what you mean11:32
jrosserthey job is defined but it really doesnt get far, make OSA bugs maybe packaging11:33
evrardjpcould you point me to the PR where those logs are issued from?11:33
jrosser*maybe11:33
evrardjpyeah, I had that in my todo list if you remember :)11:34
evrardjphttps://docs.google.com/spreadsheets/d/1coiPHGqaIKNgCGYsNhEgzswqwp4wedm2XoBCN9WMosY/edit#gid=75207069511:34
jrosserhttps://review.opendev.org/#/c/681183/11:34
evrardjpI am just not sure I can dedicate time for that today11:34
evrardjpif it's not blocking you it's fine11:34
jrosserno, not blocking11:34
evrardjpbut yeah, I want to eventually fix this11:35
*** prometheanfire has quit IRC11:41
*** prometheanfire has joined #openstack-ansible11:41
*** ansmith has quit IRC11:43
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Make modern flake8 happy about our code  https://review.opendev.org/68123011:59
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add unified linters check  https://review.opendev.org/67910112:03
*** markvoelker has joined #openstack-ansible12:04
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-rsyslog_client master: Do not use 'skipped' test as a filter  https://review.opendev.org/68123212:05
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration  https://review.opendev.org/66486712:13
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110512:13
*** Namrata has joined #openstack-ansible12:16
*** goldyfruit_ has quit IRC12:18
*** macz has joined #openstack-ansible12:26
NamrataHi folks I saw the following issue http://paste.openstack.org/show/752890/ while running upgrade script from rocky to stein and it was pointed that it was much of a infra problem. I upgraded to bionic and xenial and I still see this issue. Is there any way to solve this?12:26
*** macz has quit IRC12:30
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Collect logs from auditd in CI jobs  https://review.opendev.org/68124112:33
jrosserNamrata: you can try deleting/renaming the role in /etc/ansible/roles and re-run bootstrap-ansible to re-clone it, i'm not sure if that will help?12:34
*** ansmith has joined #openstack-ansible12:36
NamrataIf i use master as the trackbranch it works but that is not the ideal way to do it12:37
*** ansmith_ has joined #openstack-ansible12:38
Namratajrosser is there any other way this can be resolved without manual intervention/any editing as I have to provide an environment where upgrade runs in one go12:40
*** ansmith has quit IRC12:41
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration  https://review.opendev.org/66486712:50
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110512:53
openstackgerritMerged openstack/openstack-ansible master: Imported Translations from Zanata  https://review.opendev.org/68118412:54
*** udesale has joined #openstack-ansible12:57
*** hamzy_ has joined #openstack-ansible12:59
*** kaiokmo has quit IRC13:02
*** BjoernT has joined #openstack-ansible13:02
*** macz has joined #openstack-ansible13:03
openstackgerritDirk Mueller proposed openstack/openstack-ansible-tests master: Switch to opensuse-15 nodeset  https://review.opendev.org/68124913:05
*** kaiokmo has joined #openstack-ansible13:05
*** macz has quit IRC13:07
*** goldyfruit_ has joined #openstack-ansible13:23
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_nova stable/stein: Restore nova-key tag  https://review.opendev.org/68125313:24
guilhermespnoonedeadpunk and any other core around https://review.opendev.org/#/c/670394/13:26
*** BjoernT_ has joined #openstack-ansible13:27
*** BjoernT has quit IRC13:29
noonedeadpunkCan you kindly explain me (or point) to what erlang bind address is? Is it supposed to be different from management bind address?13:30
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [DNM] test ansible 2.9  https://review.opendev.org/68100313:32
noonedeadpunkmaybe we should at least set it as "{{ rabbitmq_management_bind_address }}" by default?13:32
guilhermespnoonedeadpunk: https://review.opendev.org/#/c/670394/4/templates/rabbitmq-env.j2 we've been observing that the only address that was not being overriden was the erlang one. After a bunch of debugging locally we noticed that we would need to add this statement to bind it to the mgmt address13:33
noonedeadpunkguilhermesp:  but the question is should rabbitmq_erlang_bind_address and rabbitmq_management_bind_address be different at any point?13:36
noonedeadpunkIf not - why do we add 2 variables?13:36
noonedeadpunkbtw, I hove this rly works and https://stackoverflow.com/questions/20316035/rabbitmq-listens-on-all-interfaces is not the case anymore13:37
*** cshen has quit IRC13:38
guilhermespthat's a good question tho... maybe jrosser has something to say about it. I can see that this variable is only used by our recent change and in rabbitmq.config13:42
noonedeadpunkyep13:42
guilhermespif we have a good reason to keep both... if not, would be better to reduce the number of variables13:43
*** jawad_axd has quit IRC13:43
noonedeadpunkI've placed a comment for the patch anyway13:44
jrosserwell i just don't know really13:44
*** jawad_axd has joined #openstack-ansible13:45
*** jawad_axd has quit IRC13:45
noonedeadpunkmaybe we'll reduce number of variables as for now and in case someone will require it - we can change that easily anytime. I just can't name any reason why this might be done...13:46
noonedeadpunkbut I'm not big rabbit expert though13:46
guilhermespI'd vote to reduce the variables... as I'm observing locally, it is going to get the same mgmt ip so... jrosser I can edit the patches tho13:47
jrossersure, go for it13:48
jrosseri think the truth will only come out on a multinode metal deploy13:48
jrosserwhich we won't see in CI right now13:48
*** jawad_axd has joined #openstack-ansible13:49
jrosserhopefully some of this can get tested on real vexxhost deploys becasue i know you were needing a ton of overrides otherwise13:49
guilhermespyeah jrosser indeed13:50
*** jawad_axd has quit IRC13:53
jrosserdirk: if you want to test that opensuse-15 nodeset i don't think we have many jobs left using that - a depends-on test patch to openstack-ansible-plugins might do it13:54
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-rabbitmq_server master: Add defaults for rabbitmq managment and erlang bind addresses  https://review.opendev.org/67039413:56
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible master: [WIP] Bind services to mgmt network addresses  https://review.opendev.org/67005113:57
*** BjoernT has joined #openstack-ansible14:00
*** BjoernT_ has quit IRC14:01
*** toabctl has joined #openstack-ansible14:22
*** ianychoi_ is now known as ianychoi14:37
cjloaderhi all14:38
*** spatel has joined #openstack-ansible14:44
spatelnoonedeadpunk: morning!14:45
mgariepyhttps://docs.openstack.org/releasenotes/openstack-ansible/rocky.html any idea why the releases notes are not updated anymore ?14:51
*** miloa has quit IRC14:58
noonedeadpunkmgariepy: there were some during last two tags?14:58
mgariepyrocky and queens are not up to date.14:59
*** udesale has quit IRC15:00
noonedeadpunkI'd say that from 18.1.8 to the current 18.1.10 there were no changes in https://opendev.org/openstack/openstack-ansible/src/tag/18.1.10/releasenotes/notes15:00
*** udesale has joined #openstack-ansible15:00
noonedeadpunkand for 18.1.8 reno is here15:00
noonedeadpunkso the questions should be like - why we don't write renos:)15:00
noonedeadpunkbut I'd suggest the answer would be - because there were almost no updates for rocky and queens15:01
noonedeadpunkhi spatel15:02
mgariepyok fair enough15:02
*** southquist has quit IRC15:04
*** spsurya has quit IRC15:05
*** jawad_axd has joined #openstack-ansible15:06
spatelnoonedeadpunk: I need your help :) i want to build more ceph-mon node but on metal using OSA15:11
*** gillesMo has joined #openstack-ansible15:21
noonedeadpunktbh I used to deploy ceph separately, so I'm not the best advisor regarding this topic:(15:27
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration  https://review.opendev.org/66486715:28
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110515:28
*** theintern has joined #openstack-ansible15:34
*** macz has joined #openstack-ansible15:35
*** gyee has joined #openstack-ansible15:35
spatelnoonedeadpunk: thanks :)15:36
*** cshen has joined #openstack-ansible15:40
*** Namrata has quit IRC15:43
*** cshen has quit IRC15:45
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Use version test instead of version_compare  https://review.opendev.org/68106415:53
*** chalupaul has joined #openstack-ansible15:57
tiffanie#startmeeting openstack_ansible_meeting16:00
openstackMeeting started Tue Sep 10 16:00:04 2019 UTC and is due to finish in 60 minutes.  The chair is tiffanie. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:00
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:00
tiffanie#topic office hours16:00
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)"16:00
jrossero/16:00
guilhermespo/16:00
cjloadero/16:00
BjoernTHey16:01
mnaserđź‘‹16:01
weshay0/16:02
weshayarxcruz ^16:02
chandankumar\o/16:02
evrardjpo/16:03
mnaserthanks for your work on the py3 stuff jrosser16:06
mnaserhere's to hoping centos 7.7 shapes up soon16:06
jrosserno worries :)16:06
*** rpittau is now known as rpittau|afk16:06
jrosserthe ansible-runtime venv is now py3, thats merged16:07
mnaserwhat about for centos?16:07
jrosserbootstrap-ansible.sh detects what to do16:07
arxcruzweshay: hey boss16:07
mnaserok16:07
mnaserso hopefully we can kill it soon. :<16:08
mnaseri do think tha tplacement extraction is becoming more of a priority16:08
chandankumarjrosser: Does python3-libselinux available in centos 7.7?16:08
jrosserthere is a topic here for py3 https://review.opendev.org/#/q/topic:osa-py3+(status:open+OR+status:merged)16:08
evrardjpthanks jrosser16:08
jrosserchandankumar: afaik there are no centos 7.7 test nodes16:08
jrosserthe only thing so far which broke and i've not fixed is swift16:09
noonedeadpunko/16:09
mnasercentos 7.7 is not out yet apparently..16:09
mnaserits been a month or so16:09
jrosseri will continue to make role patches to cover everything else for opt in/out of py316:09
noonedeadpunkso I'm working on the placement extract and upgrade jobs right now16:10
noonedeadpunkAnd I think I have good enough results16:10
mnaserthats awesome, upgrade jobs should forever solve us and "force" us to fix things because we cant land stuff :P16:10
noonedeadpunkhttps://review.opendev.org/#/c/664867/16:11
chandankumarjrosser: in RDO swift rpm for py3 is available now tested here https://review.rdoproject.org/r/#/c/21331/16:11
evrardjpmnaser: +1 that's awesome16:12
noonedeadpunkYep, I guess we may try to move centos to python3 as well16:13
evrardjphow long would those jobs take though?16:13
mnaseri didn't do anything, that's all noonedeadpunk's work :)16:13
mnaseri mean 2 hours tops maybe?16:13
mnaserif our jobs are stable, it doesn't really matter how long they take to run in ci16:13
evrardjpthat's fair too16:13
chandankumarmnaser: for centos 7.7, we can use cr repo http://mirror.centos.org/centos-7/7/cr/x86_64/Packages/ in experimental job16:14
noonedeadpunkso right now upgrade jobs are not really deploying aio - they prepare env and then try to run upgrade.16:14
mnaseroh there you go i see python3 in there chandankumar16:14
evrardjpchandankumar: how stable is that?16:14
mnaserCR is pretty stable.  it's like RC pretty much16:14
noonedeadpunkPRobably this should be changed to real deployment without running tempest after first deployment16:14
jawad_axdHi all, I am putting this here again.I am having issue with heat after stein/centos7  install. Heat-engine service is not getting started properly and showing in logs as http://paste.openstack.org/show/774843/ , http://paste.openstack.org/show/774844/ ,  http://paste.openstack.org/show/774847/ .  Any help with this ?16:14
mnaserCR is a clean rebuild of rhel packages without testing afaik16:14
mnaserso this is what rhel ships16:15
evrardjpso I am confused16:15
mnaserrhel ships 7.7 packages => centos consumes sources and builds packages and puts inside CR repo => <qa/testing/whatever> => centos 7.7 is out16:15
mnaserits the middle ground between rhel and centos release16:15
evrardjpI thought py3 was shipped in RHEL8 and therefore centos8. Then it is to be brough for compatibility in rhel7.7 . I thought CR was for 7.6 to have a preview of 7.7/8 py316:15
openstackgerritMerged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.opendev.org/68006116:16
evrardjpmnaser: I see16:16
*** kopecmartin is now known as kopecmartin|off16:16
evrardjpso centos7.7 is out ?16:16
mugsienope16:17
chandankumarevrardjp: mnaser but it will a test ground to prepare the stuff early16:17
chandankumarmnaser: ah, that part I was not knowing that16:17
chandankumar*will provide16:18
evrardjpok so 7.6's CR will give us the python3-devel (3.6) that we need. Cool, now I return to my previous understanding. That linked confused me :)16:19
evrardjpchandankumar: so you're testing this for OSA?16:20
chandankumarevrardjp: nope, I am was relying on this job https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset021-master/84b1a81/job-output.txt.gz in rdo side16:21
chandankumarwhere we enable cr repo and install it from that16:21
mnaserCR repo will give us what centos 7.7 will be when they "tag" it16:21
evrardjpyeah that was my understanding. Cool16:21
evrardjpgreat.16:21
jrossermnaser: so we can make a depends-on patch for this https://review.opendev.org/#/c/680470/ that enables the repo?16:22
mnaseryah and that should enable us to test py3 under centos16:22
jrosserwe'd need to do that early as part of bootstrap-ansible i think16:22
mnaseryeah in the same python detection code i guess16:22
evrardjpjrosser: it might be in two places16:22
evrardjpit might require to be in two places16:23
evrardjpsorry for the bad sed there :)16:23
evrardjptoday I also wanted to discuss releases and cjloader wanted to discuss ironic16:23
cjloaderhey all -- i'd like to get my ironic-inspector/os-ironic combined patch in before we freeze the roles. BjoernT noonedeadpunk jrosser mnaser evrardjp et al.16:24
mnaserwe're not freezing anything for quite sometime :)16:24
noonedeadpunkActually I've placed freeze https://review.opendev.org/#/c/681002/16:24
noonedeadpunk(i Hope it's freeze)16:24
evrardjpso let's clarify what freeze is first16:24
noonedeadpunk++16:25
evrardjptechnically openstack-ansible is an official project whose release model is cycle-trailing16:25
evrardjpby being cycle-trailing we are allowed some kind of latitude in the project in terms of what we have to do.16:25
evrardjpwhat it used to be is:16:25
evrardjpwe have 3 milestones, at last 2 weeks later than official milestones, and the first rc will branch. We then had two weeks to release final after others16:26
evrardjpAfter discussions, we relaxed the two weeks after milestones, because some milestones basically overlapped between trailing and normal, leading to instabilities.16:27
evrardjpWe then relaxed the trailing the release for more than 2 weeks.16:27
evrardjpSo nowadays we're quite relaxed :D16:27
evrardjpwhat it means, is that we _should_ (not must) have milestones, and must have at least one rc (for branching), and then at least a final release in the x (I think 2) months after final16:28
evrardjptechnically there was a rule that you could only propose a release if you had proposed milestones, but trailing wording allows us more flexibility16:28
evrardjpHaving milestones has two positive aspects: We know where we are in the cycle, and it allows testers to try a "frozen" version of what will be next release16:29
evrardjptherefore it's a good to have a "frozen" milestone containing the features we want to show.16:29
evrardjpThat's what I would call feature freeze.16:29
evrardjpAssuming we align on openstack, we should do that around m3, which is close to nowadays.16:30
noonedeadpunkargh - got disconnected, just see what's used to be and conlusion...16:30
* noonedeadpunk went reading archive16:30
BjoernTso why do milestones before branching, if the master is still open ?16:30
evrardjpa milestone is required for branching, because we need a tagged point to decide where to branch. That opens up master and train branch in this case16:31
evrardjpsorry16:31
evrardjpwrong wording16:31
evrardjpa tag is required for branching16:31
evrardjpin our case16:32
BjoernTWell for thats equivalent of just a SHA ie point in time checkout but its fine, if the freeze is just a mile stone. But there is no additional testing done on that mile stone right ?16:32
evrardjpno additional testing, just that all the shas are frozen, instead of being moving16:32
evrardjprc1 is generally the branching time16:33
evrardjpm1/2/3 are just for "testing out"16:33
evrardjpby m3 we should have an idea of what's included in the release16:33
jrosserevrardjp: can you be precise about "all the SHA" ?16:33
jrosserthe roles? the openstack git repos?16:33
openstackgerritMerged openstack/openstack-ansible-ops master: Use version test instead of version_compare  https://review.opendev.org/68106816:33
evrardjpthe git repos are already kind of frozen16:33
evrardjpgit repos of openstack services and friends*16:34
evrardjpthe roles aren't16:34
cjloaderso basically no new features can go in the milestone? potential release?16:34
evrardjpon a milestone we freeze the roles, we ensure it's stable and working, and then we unfreeze the roles16:34
BjoernTno its just a snapshot16:34
noonedeadpunkevrardjp: so I did kinde right thing with https://review.opendev.org/#/c/681002/ ?:)16:34
evrardjpnoonedeadpunk: that's exactly required for a milestone indeed16:34
BjoernTis a user visible tag which is equivalent of checking out. OSA with a SHA16:35
evrardjpcorrect16:35
evrardjphaving a milestone tagged has extra niceness for the generated documentation etc.16:35
BjoernTyeah lipstick on a pig, lol16:35
evrardjpit's good for us to have milestones16:35
evrardjpoh yeah it's not like it's gonna change the world either16:35
evrardjpbut master is a moving target, milestone gives a way to test a "frozen" way16:36
noonedeadpunkyep, agree that it's goodf to have that16:36
evrardjpso if we are freezing the roles, changes need to be in before that, to be part of the milestone16:36
noonedeadpunksicne otherwise you can't check and test "master" in the middle of the development16:36
cjloaderso i'd like to get my patch in the milestone then16:36
BjoernTno you can wait for the next onw16:37
BjoernTone16:37
BjoernTwe just keep fixing things16:37
evrardjpor you can wait for the next one too :)16:37
cjloaderhow long until next one??16:37
evrardjpIt's both fine. I think I want to encourage you to do it :)16:37
evrardjphow do you still have to do your patch?16:37
evrardjpIf you say that your patch can land this week, then it's probably fine for us to wait for this before proposing a milestone16:38
BjoernTwe estimate 1-2 weeks left16:38
evrardjpmmm16:38
jrosseras far as i see the patch looks sorta reasonable but it can't go anywhere until tests pass16:38
BjoernTyepp16:38
evrardjpagreed16:38
jrosserif it were me i would be spending all the time in an AIO getting it to "work"16:38
evrardjpso let's say that we won't block the milestone for that, and we'll just deal with that when it comes16:38
cjloaderi'd say let me get it passing gates16:38
evrardjpmnaser: is there something you want in for the milestone by any chance?16:39
evrardjpplacement?16:39
noonedeadpunkprobably python3 as well16:40
mnaserin an ideal world :)16:40
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Use version test instead of version_compare  https://review.opendev.org/68121616:41
*** jawad_axd has quit IRC16:41
evrardjpok let's wait for py3/placement extract to be in, and propose the milestone then16:41
guilhermespdo we want also the mgmt-bind ?16:41
*** spatel has quit IRC16:41
jrosser^ that would be super nice16:41
jrossergalera needs someone who understands to fix it16:41
guilhermesphttps://review.opendev.org/#/q/topic:bind-to-mgmt+(status:open+OR+status:merged) right now we still have to fix galera16:41
jrosserwell, or to know what actually needs doing16:42
guilhermespyeah I'm still trying to find a best solution16:42
mnaseri dont think anyone actually understands galera16:42
guilhermespI have a local deployment to test things out16:42
mnaserits just magic that works and you pray to the gods it doesnt break16:42
guilhermespnot fully understanding the issue16:42
guilhermespit is something involving listening to locahost16:42
guilhermespmnaser: exactly16:42
jrosserok so the other thing that i have is ansible 2.9 support16:43
jrosserhttps://review.opendev.org/#/q/topic:osa-ansible-2.9+(status:open+OR+status:merged)16:43
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Use version test instead of version_compare  https://review.opendev.org/68121416:43
noonedeadpunkI can take a look if it still be relevant right after resolving placement and upgrades16:43
jrosserand i don't know if there is appetite for moving to 2.9 for T is. the release aligns favourably16:43
guilhermespnoonedeadpunk: let me know if you need help with placement stuff16:43
noonedeadpunkI'm ok right now - just takes a lot of time for testing since I re-create environment to get clean results16:44
noonedeadpunknot every time, but still16:44
evrardjpok so we have a list16:45
evrardjplet's not wait too much too :)16:46
jrosserwe have really good progress on these things right now - it's good work going on from everyone16:47
jrossermnaser: oh the other thing - os-vif for stein, what are we going to do about that?16:51
mnaserjrosser: unfortunately unless we start creating a list of our own overrides which we then override with the lower constraints .. not much. :(16:52
mnaserit seems like openstack/requirements will not bump up those versions because "those are for testing"16:52
mnaserim not sure if we can use the in-repo local-constraints16:52
mnasererr lower16:53
mnaserim at a loss because i dont want us to start becoming a distro that maintains a second version of all those dependencies16:53
mnaserthat's a lot of work16:54
jrosserit's been backported https://github.com/openstack/os-vif/commits/stable/stein16:54
mnaseryeah but16:54
mnaserhttps://github.com/openstack/requirements/blob/stable/stein/upper-constraints.txt16:54
mnaseri dont know if that will be bumped16:54
mnaseror can be bumped16:54
mnasermaybe prometheanfire can explain but afaik it cannot be changed16:54
mnaseror maybe it can be and we just need a tag of os-vif ?16:55
jrosseralso did folks see jawad_axd issue earlier? another case of python-systemd apparrently missing for logging16:58
jrosserhttp://paste.openstack.org/show/774844/ i tried to advise a bit on this earlier but i don't have a centos deploy to poke around and compare16:59
noonedeadpunkI'd say that python-systemd should be everywhere in master after migration to journald...16:59
noonedeadpunkBut it wasn't backported16:59
jrosserthats why i'm a bit surprised about whats happening there - a journal logging error on stein17:00
noonedeadpunkuwsgi on some roles has been switched already btw before landing patches...17:01
* jrosser travels, bbl17:03
noonedeadpunkbut for heat no journald defined https://opendev.org/openstack/openstack-ansible-os_heat/src/branch/stable/stein/templates/heat.conf.j2#L917:04
noonedeadpunkprobably it's just me who advised jawad_axd to replace logfile with journal17:05
noonedeadpunkyesterday17:06
tiffanie#endmeeting17:10
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC"17:10
openstackMeeting ended Tue Sep 10 17:10:13 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:10
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-09-10-16.00.html17:10
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-09-10-16.00.txt17:10
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-09-10-16.00.log.html17:10
*** udesale has quit IRC17:12
jrossermnaser: can you throw together a patch to add this CR repo during bootstrap? I can chase down brokenness given an initial direction17:25
cjloaderjrosser: evrardjp noonedeadpunk BjoernT thx for discussing my patch today. i'll get it passing gates ASAP17:31
*** nicolasbock has quit IRC17:35
*** nicolasbock has joined #openstack-ansible17:40
prometheanfiremnaser: sup?17:44
prometheanfireos-vif is something you want bumped in stein?17:44
*** trident has quit IRC17:46
openstackgerritMerged openstack/ansible-role-python_venv_build master: Use version test instead of version_compare  https://review.opendev.org/68121217:46
jrosserprometheanfire: there is a CVE17:46
jrosserAddressed by the commit currently at the tip of the stein branch of os-vif17:47
jrosserAnd we wondered how we address that in OSA17:47
prometheanfirejrosser: ah, that'd be a reason, updating the requ in requirements should be consumed by osa unless something has changed17:52
*** gshippey_ has quit IRC17:53
jrosserprometheanfire: we didn’t know what the possibility of getting a requirements update for this was17:54
logan-it doesn't look like os-vif has tagged a release yet17:56
logan-with the fix17:56
prometheanfirejrosser: security is a good reason, though we generally rely on distros to do it, but as an openstack lib we should be good17:57
prometheanfireand ya, need a tag17:57
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Do not use 'skipped' test as a filter  https://review.opendev.org/68123217:58
*** trident has joined #openstack-ansible17:59
jrosserprometheanfire: who would do that tag/release?18:01
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Use version test instead of version_compare  https://review.opendev.org/68106218:03
prometheanfirejrosser: whoever owns the project, though anyone can request the release, the ptl needs to approve18:11
*** gillesMo has quit IRC18:23
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_murano master: Initial commit to os_murano role  https://review.opendev.org/67783018:37
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [DNM] Enable centos CR respository during bootstrap  https://review.opendev.org/68133118:43
*** cshen has joined #openstack-ansible18:46
*** goldyfruit___ has joined #openstack-ansible18:49
*** gyee has quit IRC18:49
*** gyee has joined #openstack-ansible18:50
*** goldyfruit_ has quit IRC18:52
jrossermnaser: ^ CR repo18:55
*** theintern has quit IRC18:57
*** cshen has quit IRC18:57
mnaserjrosser: hey, thanks, sorry i didn't get around that19:01
* jrosser fiddles with selinux now19:02
mnaserjrosser: what sort of coffee are ya on?!19:02
mnaseror i guess tea..19:02
*** cshen has joined #openstack-ansible19:02
jrosseryep, tea all the way19:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [DNM] Enable centos CR respository during bootstrap  https://review.opendev.org/68133119:05
*** cshen has quit IRC19:07
*** chalupaul has quit IRC19:10
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Use version test instead of version_compare  https://review.opendev.org/68121719:11
noonedeadpunkHope that selinux exists for python3 inside CR.... Despite bugs.centos.org/view.php?id=1638919:16
noonedeadpunkit's regarding https://review.opendev.org/#/c/681331/2/scripts/scripts-library.sh19:16
redkriegI have a question about the backups described in the admin guide.  The linked article about galera maintenance doesn't seem to explicitly list any backups, only describes procedures for restoring a degraded cluster.  Where are these backup files?  https://docs.openstack.org/openstack-ansible/stein/admin/backup-restore.html#database-backups-and-recovery19:18
*** pcaruana has quit IRC19:20
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [DNM] Enable centos CR respository during bootstrap  https://review.opendev.org/68133119:36
jrossernoonedeadpunk: i think i just hacked it to blunder on even if that package is missing :)19:37
noonedeadpunkyeah, that's right. I mean I hope that we can pass even if they are not there19:39
noonedeadpunkIn terms that they might be required afterwards19:39
* noonedeadpunk crossed fingers19:40
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [WIP] Test python3  https://review.opendev.org/68047019:54
jrosserthe CR repo is getting far enough i've depends-on it onto that ^19:55
*** ansmith_ has quit IRC20:04
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Add defaults for rabbitmq managment and erlang bind addresses  https://review.opendev.org/67039420:28
*** spatel has joined #openstack-ansible20:31
*** spatel has quit IRC20:35
*** luksky has quit IRC21:00
openstackgerritCam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: [WIP] Adds configuration and enables the Ironic Inspector  https://review.opendev.org/68028421:04
openstackgerritCam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: [WIP] Adds configuration and enables the Ironic Inspector  https://review.opendev.org/68028421:13
*** BjoernT has quit IRC21:20
*** sshnaidm|ruck is now known as sshnaidm|afk21:33
*** ansmith_ has joined #openstack-ansible22:27
*** prometheanfire has quit IRC22:33
*** prometheanfire has joined #openstack-ansible22:33
openstackgerritCam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: [WIP] Adds configuration and enables the Ironic Inspector  https://review.opendev.org/68028422:33
*** andymccr has quit IRC22:51
*** asettle has quit IRC22:51
*** macz has quit IRC23:05
*** goldyfruit___ has quit IRC23:17
*** spatel has joined #openstack-ansible23:29
*** spatel has quit IRC23:34

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!