Thursday, 2018-05-10

*** gyee has quit IRC00:08
*** cjloader has joined #openstack-ansible00:13
*** cjloader has quit IRC00:17
*** jwitko has joined #openstack-ansible00:22
cloudnullYes, I'd remove that variable once you cherry pick the commit.00:25
*** jwitko_ has joined #openstack-ansible00:26
*** jwitko_ has quit IRC00:27
*** jwitko_ has joined #openstack-ansible00:27
cloudnullTo pull the change in you can cd to the role and run git fetch https://git.openstack.org/openstack/openstack-ansible-lxc_hosts refs/changes/33/565933/2 && git cherry-pick FETCH_HEAD00:28
*** jwitko has quit IRC00:29
*** weezS has joined #openstack-ansible00:36
*** weezS has quit IRC00:37
*** devx has quit IRC00:37
*** jwitko_ has quit IRC00:40
*** sawblade6 has quit IRC00:44
*** sawblade6 has joined #openstack-ansible00:45
*** cmart has joined #openstack-ansible01:07
*** cjloader has joined #openstack-ansible01:15
*** dxiri has joined #openstack-ansible01:17
*** cjloader has quit IRC01:20
*** dxiri has quit IRC01:22
*** prometheanfire has joined #openstack-ansible01:23
*** prometheanfire has quit IRC01:30
*** prometheanfire has joined #openstack-ansible01:34
*** prometheanfire has quit IRC01:40
*** mmercer has quit IRC01:40
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733201:43
openstackgerritMerged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735401:44
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733001:44
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56732901:44
openstackgerritMerged openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734601:44
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735301:45
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736201:45
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733401:45
openstackgerritMerged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56732601:45
openstackgerritMerged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734301:45
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733101:45
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734801:45
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56732401:46
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56732801:46
openstackgerritMerged openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736801:46
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736301:46
openstackgerritMerged openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737801:46
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737201:46
openstackgerritMerged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737001:46
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735801:46
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737101:46
openstackgerritMerged openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735201:46
openstackgerritMerged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736601:46
openstackgerritMerged openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733601:46
openstackgerritMerged openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736401:47
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735101:47
openstackgerritMerged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736001:47
openstackgerritMerged openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737501:47
openstackgerritMerged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735701:47
openstackgerritMerged openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737701:47
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734001:47
*** prometheanfire has joined #openstack-ansible01:47
openstackgerritMerged openstack/ansible-config_template master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737301:47
openstackgerritMerged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734401:47
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736701:47
openstackgerritMerged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56732701:47
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56732501:48
openstackgerritMerged openstack/openstack-ansible-os_searchlight master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735901:48
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735001:48
openstackgerritMerged openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736501:48
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734101:48
openstackgerritMerged openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737601:49
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733801:49
openstackgerritMerged openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735601:49
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733701:49
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734901:49
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56736101:49
openstackgerritMerged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56737401:50
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734501:50
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733901:50
openstackgerritMerged openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734201:50
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56734701:50
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56735501:50
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733501:51
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56733301:52
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add information about restoring inventory from backup  https://review.openstack.org/56609901:55
*** dangtrinhnt has joined #openstack-ansible01:58
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use ARA instead of profile_tasks callback  https://review.openstack.org/54627101:58
*** nicolasbock has quit IRC02:01
*** kstev1 has joined #openstack-ansible02:02
*** kstev has quit IRC02:04
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Update the outdated links  https://review.openstack.org/56677202:04
openstackgerritMerged openstack/openstack-ansible-os_monasca master: Trivial: Fix the pep8 warning  https://review.openstack.org/56648902:07
*** tinwood has quit IRC02:10
*** cmart has quit IRC02:12
*** tinwood has joined #openstack-ansible02:12
*** cjloader has joined #openstack-ansible02:18
*** cjloader has quit IRC02:23
*** cmart has joined #openstack-ansible02:25
*** dxiri has joined #openstack-ansible02:30
*** wat89 has quit IRC02:30
*** sawblade6 has quit IRC02:39
*** KeithMnemonic has joined #openstack-ansible03:08
*** cjloader has joined #openstack-ansible03:13
*** cjloader has quit IRC03:18
*** kstev1 is now known as kstev03:26
*** dave-mccowan has quit IRC03:27
*** dxiri has quit IRC03:34
*** dxiri has joined #openstack-ansible03:34
*** prometheanfire has quit IRC03:35
*** jwitko_ has joined #openstack-ansible03:35
*** prometheanfire has joined #openstack-ansible03:35
openstackgerritMerged openstack/openstack-ansible master: [Docs] Fix links to figures  https://review.openstack.org/56725103:37
*** jwitko__ has joined #openstack-ansible03:37
openstackgerritMerged openstack/openstack-ansible master: Fix the appropriate kernel modules path  https://review.openstack.org/56506103:37
openstackgerritMerged openstack/openstack-ansible master: [Docs] Clarify the testing page  https://review.openstack.org/56622703:37
*** dxiri has quit IRC03:39
*** jwitko_ has quit IRC03:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Convert role to use a common systemd mount role  https://review.openstack.org/55218503:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd service role  https://review.openstack.org/46617903:41
*** jwitko__ has quit IRC03:42
*** prometheanfire has quit IRC03:43
*** prometheanfire has joined #openstack-ansible03:52
*** weezS has joined #openstack-ansible03:59
*** tasker has quit IRC04:00
*** weezS has quit IRC04:03
*** prometheanfire has quit IRC04:12
*** prometheanfire has joined #openstack-ansible04:13
*** kstev has quit IRC04:16
*** mmercer has joined #openstack-ansible04:18
*** udesale has joined #openstack-ansible04:27
*** mmercer has quit IRC04:33
*** hamzy has joined #openstack-ansible04:38
*** mmercer has joined #openstack-ansible04:44
*** vnogin has joined #openstack-ansible04:45
*** vnogin has quit IRC04:49
*** mhayden has quit IRC05:04
*** mhayden has joined #openstack-ansible05:09
*** KeithMnemonic has quit IRC05:09
*** mmercer has quit IRC05:15
*** cjloader has joined #openstack-ansible05:17
*** cjloader has quit IRC05:22
*** jmccrory has quit IRC05:28
*** jmccrory has joined #openstack-ansible05:28
*** rschulman has quit IRC05:58
*** jhesketh has quit IRC05:58
*** mhayden has quit IRC06:01
jrosserodyssey4me: i'm still missing something with the repo_build / pip, gimme a shout when you are around06:09
*** mhayden has joined #openstack-ansible06:16
*** armaan has quit IRC06:20
*** armaan has joined #openstack-ansible06:21
*** radeks_ has joined #openstack-ansible06:27
*** DanyC has joined #openstack-ansible06:33
*** DanyC has quit IRC06:37
*** pcaruana has joined #openstack-ansible06:51
*** threestrands_ has quit IRC06:58
*** arbrandes has quit IRC07:00
*** arbrandes has joined #openstack-ansible07:01
*** MrWatson has quit IRC07:10
*** NostawRm has joined #openstack-ansible07:10
*** mbuil has joined #openstack-ansible07:11
odyssey4meo/07:11
odyssey4mejrosser pre-coffee presence :)07:12
jrosserthink i need a coffee too :)07:20
jrossershort story i wiped everything and started again07:20
jrosserrepo install now fails to install pip, so was after a sanity check07:21
*** armaan has quit IRC07:22
*** armaan has joined #openstack-ansible07:22
*** nsingh has quit IRC07:32
odyssey4mejrosser ok, so you did a fresh build and it failed07:36
odyssey4meI know there's a failure because of the try/fail block here, but that shouldn't cause the playbook to fail: https://github.com/openstack/openstack-ansible-repo_server/commit/c75720f9208821855aac8d1a88d94c96114ed51b07:36
odyssey4meI intend to revise that to ensure it doesn't fail on a fresh deployment, but haven't really had much time to work out a better option.07:37
*** tosky has joined #openstack-ansible07:37
*** armaan has quit IRC07:44
*** armaan has joined #openstack-ansible07:44
jrosserodyssey4me: let me just put some notes on an etherpad07:46
odyssey4mejrosser good idea, thanks07:46
jrosserhttps://etherpad.openstack.org/p/repo-pip07:47
jrosserodyssey4me: yesterday i was seeing install pip take ages, so i put your 3 patches in place that we discussed and that was then fixed07:51
jrosserhowver at that point the repo install had already run, so the repo was available07:51
jrosserhaving started from fresh it fails to install the repo07:52
*** mma has joined #openstack-ansible07:53
jrosserodyssey4me: looks like this is down to me not having wired my local pip mirror into the repo server nginx config08:05
*** rmart04 has joined #openstack-ansible08:05
*** erolg has joined #openstack-ansible08:06
*** DanyC has joined #openstack-ansible08:12
*** DanyC has quit IRC08:17
*** vnogin has joined #openstack-ansible08:23
*** DanyC has joined #openstack-ansible08:27
*** vnogin has quit IRC08:27
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: [Docs] Fix links to figures  https://review.openstack.org/56751108:28
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: [Docs] Clarify the testing page  https://review.openstack.org/56751208:28
*** rschulman has joined #openstack-ansible08:29
*** jhesketh has joined #openstack-ansible08:29
evrardjpgood morning jhesketh :)08:32
evrardjpOk I am off for today, it's a day off in Belgium!08:32
evrardjphave a good day everyone08:33
*** rschulman has quit IRC08:36
*** lbragstad[m] has quit IRC08:36
*** keithmnemonic[m] has quit IRC08:36
*** evrardjp[m] has quit IRC08:36
*** jothibasu[m] has quit IRC08:36
openstackgerritRobin Naundorf proposed openstack/openstack-ansible master: Fix spelling error and hypen  https://review.openstack.org/56751508:36
*** csmart has quit IRC08:41
odyssey4mejrosser sorry - was doing something else - looking at the etherpad now08:45
jrosserodyssey4me: no worries08:46
osnaya@evrardjp @cloudnull To cherry pick -> from /opt/openstack_ansible/playbooks folder -> when I run  git fetch https://git.openstack.org/openstack/openstack-ansible-lxc_hosts refs/changes/33/565933/2 && git cherry-pick FETCH_HEAD ----> it errors out  wtih error: could not apply e77c3a9... Fix lxc cache prep resolvers.  resolve conflict08:46
odyssey4mehmm, I see your pypi mirror has a prefix... I'm not sure that will work right without adjusting something else08:46
odyssey4meosnaya you shouldn't have to cherry-pick anything if you're using the head of the stable branch08:47
*** chhagarw has joined #openstack-ansible08:47
osnaya@cloudnull @odyssey4m2 @evrardjp how do I resolve the configt08:47
*** jhesketh has quit IRC08:47
odyssey4meosnaya which branch/tag are you trying to deploy?08:47
*** udesale has quit IRC08:47
*** udesale has joined #openstack-ansible08:47
*** niraj_singh has joined #openstack-ansible08:48
jrosserodyssey4me: yes i was just looking at the nginx setup and was thinking the same08:48
odyssey4meyeah, I'm leaning more and more to reverting this whole reverse proxy thing - it's causing too many headaches08:48
osnayaI have 16.0.12.... and hitting an issue.  the fix has gone in 16.0.13...., so I need to do workaround or fetch that commit08:49
odyssey4meosnaya cd /opt/openstack-ansible; git fetch --all; git checkout origin/stable/pike; rm -rf /etc/ansible/roles/lxc_hosts; ./scripts/bootstrap-ansible.sh08:50
odyssey4methat should get you to 16.0.13 as it stands now, and just work08:50
odyssey4mejrosser alright, so the issue with the pypi mirror you have is the /root prefix - if it's possible to ditch that, then you'll likely be fine08:51
osnaya@odyssey4me thanks, let me do that08:51
jrosserodyssey4me: yes i think i should concentrate on fixing that - we knew it wasnt ideal08:51
odyssey4mejrosser is that mirror an actual mirror, or some sort of caching service?08:52
jrosserit's devpi08:52
jrosserwe had a caching proxy for ages but that all blew up when they re-organised the upstream pypi repos recently08:53
odyssey4meah yes, I looked at that - it seemed nice, but a little more complex than pypiserver08:53
jrosserthe underlying cdn is redirect-tastic and what we had couldnt deal with that, was simpler to drop devpi in08:53
*** vnogin has joined #openstack-ansible08:57
*** vnogin has quit IRC09:01
*** jhesketh has joined #openstack-ansible09:06
*** vnogin has joined #openstack-ansible09:07
openstackgerritFerenc Cserepkei proposed openstack/openstack-ansible-os_monasca master: Non-ascii characters in files  https://review.openstack.org/56752709:10
*** gkadam has joined #openstack-ansible09:14
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: defaults: Allow uwsgi to autoload required plugins.  https://review.openstack.org/56752909:17
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56753009:17
odyssey4mejrosser hmm, on the one hand I think devpi looks really good as a complete solution, but on the other it's also a fairly complex system09:27
odyssey4meI opted for pypiserver because it's super-simple - it does only one thing to replace the one function in the repo - provides a pypi-compatible index to install packages from. The replication we handle for other things using rsync/lsync, so we have to keep that so that function wasn't required from our pypiserver.09:28
jrosserodyssey4me: yeah, it seems it doesnt have an obvious way of acting just as a proxy without introducing a wierd url09:28
odyssey4mejrosser if you're using a web server in front of it, though, you could do URL rewrites09:29
*** keithmnemonic[m] has joined #openstack-ansible09:29
*** vnogin has quit IRC09:29
*** udesale has quit IRC09:31
*** vnogin has joined #openstack-ansible09:32
*** niraj_singh has quit IRC09:33
*** niraj_singh has joined #openstack-ansible09:35
*** radeks has joined #openstack-ansible09:38
odyssey4mejrosser hmm, I wonder if we should make https://github.com/openstack/openstack-ansible/blob/master/playbooks/common-tasks/set-pip-vars.yml#L111 set the value to  repo_build_pip_default_index if it is set, but default to pypi... that might just resolve the issue09:40
odyssey4mewell, one of the issues09:40
jrosserrepo_build_pip_default_index doesnt really seem to do what the name implies currently09:43
odyssey4meit should be the index that's used for building the wheels - is that not so?09:48
odyssey4meit's distinguished from the index set to be used by pip for general operations09:48
jrosser"# Optionally set this to change the default index from pypi to an alternative"09:48
odyssey4meperhaps that comment needs clarification09:50
jrosserto be fair, theres just lots of this09:50
jrosserand it is in repo_build rather than repo_server09:50
odyssey4meyep09:50
odyssey4meI've added notes for things that could be fixed/improved to get this working better - I think both the options laid out are going to have to be done.09:51
odyssey4meWhile trying to implement caching was perhaps a nice idea, the implementation didn't work out to be as stable as I'd hoped - and it's creating more headaches for offline installs, which it was meant to help - not hinder.09:51
*** vnogin has quit IRC09:52
odyssey4meIf you'd like to take a crack at those, I'd be happy to review - otherwise I've set aside time this weekend to work on this stuff. I'm tied up today/tomorrow unfortunately, so I'm not going to be able to do much before the w/end.09:52
odyssey4mefeel free to add more notes of things like bad code comments or documentation, that way I have a nice hit list to work through09:53
jrosserwhat i'll do first is get this devpi url sorted out, then roll the deploy again09:55
odyssey4melet me understand this completely - where is it failing now?09:57
odyssey4meah, it's in the pip install in the repo container09:58
jrosserthats right yes09:58
odyssey4meok, and it's hitting nginx right?09:58
odyssey4mein the nginx log, can you see it trying to access your pypi mirror?09:58
jrosseryes and thats when i realised it wasnt wired into our mirror properly09:58
jrosseri think it's been happy accident that it worked for is before09:59
*** vnogin has joined #openstack-ansible09:59
odyssey4meand you have the repo_nginx_pypi_upstream set as per the entry I added to the etherpad?09:59
jrosseri have now, but now nginx fails to start10:00
odyssey4meoh really? that's odd10:01
jrosserbut i've not yet sanitised the url10:01
jrosserlet me work on that then get back to you10:01
odyssey4meit must be host:port - no sub-url or anything else10:01
odyssey4methe use of the sub-url is something pip needs to handle, not nginx10:01
jrosserand it's implicitly /simple on the end?10:02
odyssey4menginx is simply reverse proxying - it receives a packet via HTTP and forwards it on... it doesn't understand the contents10:02
odyssey4meso it's only host:port10:02
odyssey4meno scheme either10:03
odyssey4methe scheme and the rest of the URL is something pip cares about, and the pypi server cares about - nginx does not10:03
odyssey4menginx will listen on :80 and reverse proxy to whatever host and port you tell it to in repo_nginx_pypi_upstream10:04
odyssey4mewell, I think nginx is actually listening on :8080 - but that's kinda immaterial10:04
odyssey4medoes that make sense?10:06
jrosseryes it does10:06
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56753010:14
*** lbragstad[m] has joined #openstack-ansible10:23
*** jothibasu[m] has joined #openstack-ansible10:23
*** evrardjp[m] has joined #openstack-ansible10:23
*** csmart has joined #openstack-ansible10:23
*** rschulman has joined #openstack-ansible10:23
*** udesale has joined #openstack-ansible10:27
*** udesale has quit IRC10:28
*** udesale has joined #openstack-ansible10:28
hwoarangoh centos is failing again on the lxc cache prep10:28
hwoaranghttp://logs.openstack.org/29/567529/1/check/openstack-ansible-functional-centos-7/40c6365/logs/host/lxc-cache-prep-commands.log.txt.gz10:29
hwoarangneed to decipher that10:29
odyssey4meerror: Failed to initialize NSS library10:29
*** armaan has quit IRC10:29
odyssey4mehttps://bugzilla.redhat.com/show_bug.cgi?id=147603110:32
openstackbugzilla.redhat.com bug 1476031 in nss-softokn "Failed to initialize NSS library" [Unspecified,Closed: duplicate] - Assigned to nss-nspr-maint10:32
*** armaan has joined #openstack-ansible10:32
hwoarang:/10:32
odyssey4melooks like it might be exactly the same issue, but with different package versions10:32
odyssey4mehwoarang any chance you could take a peek at https://review.openstack.org/564841 and https://review.openstack.org/567285 - I'd like to port those back to reduce some of the confusion created by the data output from the py_pkgs lookup10:41
hwoarangwell look good to me10:42
odyssey4meOne more fix I'd like to get in later is to remove the ingestion of the doc/requirements.txt files, but I haven't had time to work that out yet.10:44
*** evin has quit IRC10:48
*** nicolasbock has joined #openstack-ansible11:12
odyssey4methanks hwoarang - I see that failed on centos too :/11:13
hwoarangyeah :(11:14
*** udesale_ has joined #openstack-ansible11:18
*** udesale_ has quit IRC11:18
*** udesale_ has joined #openstack-ansible11:18
*** udesale_ has quit IRC11:18
odyssey4mehwoarang it looks to me like this is an upstream centos issue - the package indexes I'm looking at all have the version mismatch for the different nss packages11:18
odyssey4meI guess we have a choice - wait, or mark all centos non-voting until the issue is fixed11:19
*** udesale_ has joined #openstack-ansible11:19
hwoarangi looked on the bugzilla but I couldn't find any references11:19
hwoarangi mean centos bugzilla11:19
hwoarangstrange that noone noticed yet11:19
odyssey4memaybe register a bug?11:19
hwoarangi dont have an account and i want to postpone the need to create one :)11:21
odyssey4mehaha, same here :p11:21
*** udesale has quit IRC11:21
hwoarangi am wondering if this is fixed but the openstack mirrors are just outdated11:21
odyssey4memaybe when mnaser wakes up or perhaps if mhayden is lurking they'd like to :p11:21
odyssey4meit doesn't appear so - this is showing the same package version that's behind the other nss packages: https://pkgs.org/download/nss-util11:22
odyssey4menss-softokn, nss-softokn-freebl and nss-util are 0-2, but nss-tools, nss-sysinit and nss are 0-411:23
odyssey4mehmm, looking at https://bugzilla.redhat.com/show_bug.cgi?id=1476031 perhaps that's not an issue... perhaps it's the major/minor versions that count11:25
openstackbugzilla.redhat.com bug 1476031 in nss-softokn "Failed to initialize NSS library" [Unspecified,Closed: duplicate] - Assigned to nss-nspr-maint11:25
odyssey4methese are all 3.34.0, which differs from that bug11:25
*** radeks has quit IRC11:35
*** niraj_singh has quit IRC11:39
hwoarangodyssey4me:  a fresh centos image looks good though. At least the 'yum install ca-certificates cronie epel-release gcc iproute iputils libffi-devel openssh-server openssl openssl-devel policycoreutils python2 python-devel rsync setup sudo systemd systemd-sysv systemd-networkd tar wget which yum-plugin-priorities yum-plugin-rpm-warm-cache yum-utils' does not trigger the problem11:44
hwoarangstrange11:44
odyssey4meis that in a vagrant image or host?11:44
*** armaan has quit IRC11:44
odyssey4meperhaps the issue relates only to the OCI container image we download?11:44
odyssey4meand perhaps it's therefore just a missing package of some sort11:45
*** armaan has joined #openstack-ansible11:45
hwoarangcould be11:46
mnaserHi there11:48
hwoarangi wonder if the all the dance we do in lxc_hosts for centos could cause hat11:48
hwoarang*that11:48
mnaserAbout to get into the office. I’ll dig I11:48
mnaserIn when I do11:49
hwoarangbecause we record the transaction  and we execute it later on11:49
hwoarangi blame major for that :D11:50
*** bhujay has joined #openstack-ansible11:52
*** radeks has joined #openstack-ansible11:58
*** radeks has quit IRC12:03
*** bradm has quit IRC12:04
odyssey4meyeah, apparently doing it with transactions is faster... at least that was the justification12:11
*** kaiokmo has quit IRC12:20
*** radeks has joined #openstack-ansible12:21
mnaserok12:23
mnasertime to dig in12:23
mnaserany job failure to look at?12:23
mnaser(re centos712:24
mnaserok, caught uup, http://logs.openstack.org/29/567529/1/check/openstack-ansible-functional-centos-7/40c6365/logs/host/lxc-cache-prep-commands.log.txt.gz12:26
mnaserstrange, i dont see any changes inside the centos repos12:32
mnaserhttp://mirror.centos.org/centos/7/os/x86_64/Packages/?C=M;O=D12:32
mnaserlooking by newly sorted we see not much change12:32
mnasercentos7 image shipped on 20180508_02:1612:34
mnaserhttps://jenkins.linuxcontainers.org/job/lxc-template-centos/12:37
mnaserlast image was aborted mid build for some reason12:37
mnasermaybe we can wait and see when the new image builds12:38
*** evin has joined #openstack-ansible12:38
*** sawblade6 has joined #openstack-ansible12:41
*** throwsb1 has joined #openstack-ansible12:43
cloudnullMornings12:52
mnasermorning cloudnull12:56
cloudnullhows it mnaser?12:57
mnasercloudnull: going good, trying to understand cache prep and why it's broken on centos :p12:57
mnaserso i guess this thing is pretty much about being able to update all packages AND install the ones we need12:57
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use ARA instead of profile_tasks callback  https://review.openstack.org/54627112:58
hwoarangmnaser: i dont think centos is using images from linux containers12:59
mnaserhwoarang: oh?  where is it pulling them from in that case? i thought it did :X12:59
hwoarangmnaser: https://github.com/CentOS/sig-cloud-instance-images/raw/CentOS-7/docker/centos-7-docker.tar.xz12:59
hwoarangsee vars/redhat-7.yml12:59
mnaserstoring files on github13:00
cloudnullthe lxc cache prep ?13:00
hwoarangcloudnull: since you are here...13:00
cloudnull:D13:00
* cloudnull feels like he needs to run away 13:00
hwoarangcould you remind me why we've moved away from the linuxcontainers.org images as the default option?13:00
mgariepymnaser, https://bugzilla.redhat.com/show_bug.cgi?id=147730813:01
openstackbugzilla.redhat.com bug 1477308 in nss-softokn "Installing new nss-softokn-freebl without updating nspr on a RHEL 7.3.0 system results in rpm and yum being non-functional" [Urgent,Closed: errata] - Assigned to dueno13:01
mgariepymissing pkg ?13:01
cloudnullhwoarang we moved to using smaller images.13:01
cloudnullthe lxc images were not being maintained very well and were growing in size13:01
hwoarangoh i didn't know they were not maintained13:02
*** bhujay has quit IRC13:02
mnasermgariepy: thats interesting, that's a different issue from the one reported13:02
cloudnullits not that they dont have a CI system in place it just that theres not a lot of effort going on there.13:02
hwoarangunfortunately for suse we will have to switch back to linuxcontainers soon because the current rootfs is going away13:03
cloudnullwith the new images we've made it so we should be able to pull any rootfs tarball and run with it13:03
hwoarangi have an open bug with teh team to come up with an alternative rootfs13:03
mnaserman this file just overall seems terrifying to look at :p13:03
mnaserhttps://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/prep-scripts/centos_7_prep.sh.j213:03
*** pcaruana|afk| has joined #openstack-ansible13:03
*** NotPcaruana has joined #openstack-ansible13:04
cloudnullhwoarang the legacy capability should still all be there.13:04
hwoarangyep13:04
hwoarangthank god ;p13:04
cloudnullif you have a new location for a rootfs to use we can change to that ?13:04
hwoarangyep not sure if there will be a new one before the old one goes away13:05
cloudnulldoes suse have something like ubuntu with a base rootfs ?13:05
hwoarangno13:05
hwoarang:(13:05
cloudnullok.13:05
cloudnullI couldn't find one for cent either.13:05
mnaseryeah looks like they don't either13:05
mnaseris there a reason those packages are being installed in a shell script rather than ansible?13:06
cloudnullmnaser: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/stable/queens/vars/redhat-7.yml#L48-L86 - a lot of that was ported over from here13:06
mnaserso does that mean that shell file is unused?13:07
cloudnullthe packages are installed within a chroot13:07
hwoarangno the shell script is on master13:07
hwoarangbranch13:07
mnaseroh okay13:07
mnaseryeah i just saw the release note13:07
mnaserwell13:08
mnaseri know in yum you can run an install inside a chroot13:08
cloudnullit used to create a shell script with that config block of old, not its just housed in a shell script13:08
mnaserhttp://docs.ansible.com/ansible/latest/modules/yum_module.html 'installroot'13:08
cloudnullif we could install those packages using ansible within the chroot it'd be better.13:08
openstackgerritMerged openstack/openstack-ansible-os_monasca master: Non-ascii characters in files  https://review.openstack.org/56752713:09
cloudnullit'd be a bit divergent from the rest of the OS installs/setup but a lot better IMHO.13:09
mnaseri'm looking for ways to do it in apt13:09
mnaserthe yum module can do it but trying to see how the apt one13:10
cloudnullzypper has a similar functionality, is that exposed in the ansible module ?13:10
* cloudnull looking13:10
mgariepywith yum you can create a chroot directly, which is not quite possible with apt AFAIK13:10
hwoarangyou can use the extra dpkg opts i think13:10
hwoarangsame for zypper13:10
mnaser"apt-get -o RootDir=/tmp/test_apt sets (almost) all paths to be in the different root. btw on a running system, if you copy /etc/apt, /usr/lib/apt, and mkdir -p usr/lib etc var/cache var/lib/dpkg var/lib/apt/lists/partial var/cache/apt/archives/partial and finally touch var/lib/dpkg/status, then apt is going to work in that root. It can even work as a non-root user if you add the option -o Debug::NoLocking=1. The13:11
mnasernolock option is necessary because I couldn't find a way to set the lock file inside the different root directory. – akostadinov"13:11
cloudnullthe zypper module has extra_args so we could make that go, i suspect13:11
hwoarangwe should yes13:11
mnaserit doesnt look like apt has any options or something :\13:11
hwoarangmnaser: not even in dpkg_options ?13:12
hwoarangyou can pass whatever you want there13:12
mnaseri didnt look into the dpkg level13:12
hwoarangthat's an option in the apt module13:12
mnaserhttps://linux.die.net/man/1/dpkg --root13:13
mnaserdoes anyone wanna hack on the apt one, i can take care of the yum one13:13
hwoarangi think it's best to switch all 3 of them at once13:13
hwoarangbut i think right now we need to fix the centos7 failure first :/13:14
hwoarangotherwise we are not able to merge any new patches13:14
mnaserhwoarang: ill push up a change for yum, lets watch CI13:15
mnaserif it works, we can do the other two and move forward13:15
mnaser(in the same patch)13:15
mnaseronce we know it works for a fact..13:15
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible  https://review.openstack.org/56758513:18
mnaserif that doesn't break terribly ill do apt/zypper13:18
odyssey4mehwoarang cloudnull mnaser FYI I have a working set of things to use diskimage-builder to replace our root cache prep for ubuntu so we don't need to download from anywhere, so I'm hoping to get a patch up soon to allow either download, or use dib... and make the dib usage the default.13:27
odyssey4meand obviously I'll make it work for centos and opensuse too13:27
mnaserodyssey4me: that's pretty exciting.. will hopefully get rid of the flakiness13:28
odyssey4meyeah, I'm tired of the upstream changes affecting our stable builds... time we took control13:28
odyssey4meour operators can then build the image in CI, and use the download option for deployments if they want to13:29
hwoarangtrue but that adds about +10m to the deployment13:29
hwoarangin the CI...13:29
odyssey4mein my test, it was much less time - only 2-3 mins13:29
hwoarangoh that's pretty good then13:29
odyssey4mebear in mind that this is a very small container-only image13:29
odyssey4meno kernel packages13:30
hwoarangindeed13:30
mnaseryay13:30
mnaserso it updated the packages inside13:30
odyssey4methe base I had it to without even optimising it more was around 50MB... and it might be possible to make it smaller... although the dump of extra packages we install into it takes it up to around 160M13:30
mnasersomething else was broken but yeah13:31
mnaserhttp://logs.openstack.org/85/567585/1/check/openstack-ansible-functional-centos-7/3c2370b/logs/ara-report/13:31
mnaserhmm13:31
mnaserhttp://logs.openstack.org/85/567585/1/check/openstack-ansible-functional-centos-7/3c2370b/logs/host/lxc-cache-prep-commands.log.txt.gz13:31
mnaserits failing in 'yum clean all'13:31
mnaserinterestingly enough, it works ok when using installroot13:31
mnaserso even if we work around this with installroot, it will probably break later.13:32
mnaser(and at least we know it's not yum-complete-transaction)13:32
cloudnullodyssey4me ++ that's very cool!13:33
*** NotPcaruana has quit IRC13:34
*** pcaruana|afk| has quit IRC13:34
openstackgerritMerged openstack/openstack-ansible-galera_client master: Use UNIX socket instead of TCP socket  https://review.openstack.org/55940813:34
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Trivial: Fix the pep8 warning  https://review.openstack.org/56683013:35
mnaserwait13:35
mnasercentos 7.5 is out?13:35
cloudnullyup13:35
cloudnulli just saw that fly by my twitter feed13:35
mnaserso that might the source of our issues13:36
mnaserhttp://logs.openstack.org/85/567585/1/check/openstack-ansible-functional-centos-7/3c2370b/logs/ara-report/result/33618303-0067-4368-bf30-fedebfe4aacf/13:36
mnaser"Public key for acl-2.2.51-14.el7.x86_64.rpm is not installed"13:36
mnaserummm13:37
mnaseris it possible because13:37
mnaserwe're doing the whole13:37
mnasercopying mirrors into container thing13:37
mnaserso we're running a 7.4 host with a 7.5 container13:37
mnaserwith 7.4 repos in it13:37
*** cjloader has joined #openstack-ansible13:38
*** jwitko has joined #openstack-ansible13:43
d34dh0r53mornings13:44
mnasero/13:49
odyssey4memnaser oh dear, that would be a problem - is our container source not 7.4-specific?13:50
mnaserodyssey4me: i think it is not 'pinned' to 7.4, it's just "7"13:50
mnaserodyssey4me: so we get 7.4 and we're upgrading to 7.5 in lxc cache prep13:50
odyssey4me*sigh*13:50
mnaseri mean13:51
mnaserwe could yum update the host itself13:51
odyssey4meI guess, then, that this is going to cause all the stable implementations to break too - because I think we're just doing '7' everywhere?13:51
mnaserbefore we start anything heh13:51
mnaserodyssey4me: not really, this is only broken because host version != container version i guess13:51
mnaserso maybe we can add a check for that13:52
odyssey4meok, how about we confirm that - then look at options for our container source.. perhaps we need to switch back to using linuxcontainers for now13:52
mnaserodyssey4me: i think the problem would still exist13:53
mnaserwe're still using a centos 7.4 container13:53
mnaserbut as part of cache prep, we upgrade containers to 7.513:53
odyssey4meoh, why're we upgrading?13:53
odyssey4mewe should stop doing that13:53
mnaseridk, cache prep does yum update13:53
odyssey4meah ok, that makes more sense as the cause13:54
odyssey4meok, so a quick fix to workaround the issue is to remove that - that'll unblock gates and give us time to figure out what we actually want to happen and to implement that13:54
hwoarangbut update != upgrade right?13:55
hwoarangyum update is meant to remove installed packages no?13:55
odyssey4mewhat we want to happen is kinda up to you mnaser, as the core who cares about the state of centos for OSA ;)13:55
hwoarang*s/remove/update13:55
mnaseri think it has to do a little bit with the whole repos being copied from the host13:55
mnaserso some stuff is being updated while others aren't13:56
hwoarangcouldn't we detect the host centos version and use it to get an appropraite container image?13:56
hwoarangassuming upstream provides images for 7.4 and 7.5?13:56
odyssey4mewell, we kinda had something like that before - and the script previously wiped all repo config from the container and put known config down13:56
mnaseryeah but so the thing is13:57
mnasercentos is now this rolling release thing13:57
mnaserso your 7.4 image will become 7.5 when inevitebly something yum update's13:57
hwoarangif it's rolling release what defines 7.4 and 7.5?13:57
* mnaser shrugs13:57
mnaser7.4 and 7.5 isn't like ubuntu's 16.04 and 16.10 or so13:57
mnaserits just a new set of packages13:58
hwoarangso maybe that's automatically fixed tomorrow13:58
hwoarangwhen infra builds new images based on 7.513:58
mnaserbut also maybe that breaks everything for our users too that might deploy on a centos 7.4 machine13:58
*** jwitko_ has joined #openstack-ansible13:58
mnaserso in order not to block productivity13:58
mnaseri will set the c7 jobs to nv13:58
mnaserand will work on this13:58
mnaserwhats the best place to switch them to nv?14:00
hwoarangopenstack-ansible-tests14:00
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests master: Switch OSA functional tests to non-voting for CentOS 7  https://review.openstack.org/56759414:01
mnaserlike this? ^14:01
*** armaan has quit IRC14:01
hwoarangyep14:01
mgariepymnaser, -nv please :D14:02
*** armaan has joined #openstack-ansible14:02
mnasermgariepy: wouldnt that mean i have to change all projects to use -nv?14:02
hwoarangmgariepy: that will change the name of the job14:02
*** jwitko has quit IRC14:02
mgariepyhmm14:02
hwoarangwe need to keep the same name but make it non-voting14:03
mgariepyok14:03
mgariepysorry14:03
odyssey4meyeah, don't bother doing -nv14:04
odyssey4methanks mnaser14:05
odyssey4melet's see what tomorrow brings14:05
hwoarangyeah it's an interesting situation14:05
odyssey4mecould we have some core votes for https://review.openstack.org/567159 please14:06
*** esberglu has joined #openstack-ansible14:09
*** cjloader has quit IRC14:13
mnaserok so please forgive me but does OSA copy the repos from the host into the containers?14:13
mnaseri thought it did that but i cant find it14:13
*** cjloader has joined #openstack-ansible14:13
odyssey4memnaser it does: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/vars/redhat-7.yml#L22-L3014:13
mnaserodyssey4me: ok, so that means that the repos outside the vm and inside the vm are matching.  now i wonder if i do a yum update in a nodepool vm, if it will also break yum14:14
odyssey4meit might do - I guess a patch could be pushed up to give that a go and see what happens14:15
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible  https://review.openstack.org/56758514:15
mnaserif that breaks it then either 7.5 is broken, 7.4 => 7.5 upgrades are broken or nodepool images have something weird in them14:16
*** dxiri has joined #openstack-ansible14:26
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible  https://review.openstack.org/56758514:36
openstackgerritFerenc Cserepkei proposed openstack/openstack-ansible-os_monasca stable/pike: Non-ascii characters in files  https://review.openstack.org/56760714:41
openstackgerritFerenc Cserepkei proposed openstack/openstack-ansible-os_monasca stable/queens: Non-ascii characters in files  https://review.openstack.org/56760914:42
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible  https://review.openstack.org/56758514:49
*** mma has quit IRC14:53
mnaserso doing a yum update inside the host says nothing to be updated, yet the container does update some stuff14:54
*** mma has joined #openstack-ansible14:54
mnasertoday on things that don't make sense14:54
odyssey4meperhaps the container image has some extra repo config or something in it which makes that happen?14:55
mgariepyor the base image isn't up to date ?14:56
*** mma_ has joined #openstack-ansible14:57
mnasermgariepy: right but running yum update should make us land in the final state?14:57
mnaserfinal same state so to speak14:57
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Clean up docs and bootstrap script  https://review.openstack.org/56761414:58
*** chhagarw has quit IRC14:59
*** mma has quit IRC15:00
mgariepydepending on what is installed i would assume that pkg should be updated.15:01
*** mma_ has quit IRC15:01
*** weezS has joined #openstack-ansible15:02
*** mma has joined #openstack-ansible15:02
*** openstacking_123 has joined #openstack-ansible15:03
*** mma has quit IRC15:06
mnasersurprise15:10
mnaserthe host is running c7.515:10
* mnaser sighs15:10
odyssey4meand the guest image is 7.4?15:10
mnaserbut being upgraded to 7.515:13
mnaserthen breaking15:13
*** kaiokmo has joined #openstack-ansible15:13
mnasercould it be something in upgrading 7.4 to 7.5 that is broken15:13
*** DanyC has quit IRC15:14
*** mma has joined #openstack-ansible15:16
*** armaan has quit IRC15:20
*** armaan has joined #openstack-ansible15:20
mnaserso it looks like we're using the same iamges that are used in teh docker contaienrs15:23
mnaserso im gonna try deploying a docker container, updating it, and seeing if it breaks.15:23
hwoarangany brave soul around to give another +2 on https://review.openstack.org/#/c/562606/ ?15:24
*** NostawRm has quit IRC15:28
openstackgerritMerged openstack/openstack-ansible-tests master: Switch OSA functional tests to non-voting for CentOS 7  https://review.openstack.org/56759415:28
*** NostawRm has joined #openstack-ansible15:28
mnaserhwoarang: lets hope it doesn't break everything but it seems ok15:29
mnaseri'm wondering if the lxc 2.0 repos are breaking things15:29
hwoarangthanks mnaser!15:29
*** spine55 has quit IRC15:33
*** spine55 has joined #openstack-ansible15:33
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible  https://review.openstack.org/56758515:39
cloudnullmnaser I wonder if it'd be of use if we moved cent to using nspawn by default? That way we'd remove the COPR dep all together.15:41
mnasercloudnull: thats very tempting, but what about the migration path, is there one?15:41
mnaseri support that15:41
cloudnullthe lxc and nspawn image formats are the same15:42
cloudnullthe containers would have to "restart"15:42
cloudnullbut it'd be doable15:42
cloudnullmaybe something to talk about at the summit?15:43
odyssey4mecloudnull currently the nspawn integrated build is failing, and has been for weeks last I checked... perhaps it's best to get it working before jumping the gun15:44
odyssey4meit'd be good to get that working, and get it voting - then get field testing for at least half a cycle before we think about changing the default15:45
cloudnullits in the gate https://review.openstack.org/#/c/565961/15:45
odyssey4methere's still a lot of work to be done to get nspawn to be a first class option - tests across the repositories, etc15:45
cloudnulland it looks like its working15:46
odyssey4meah, something recent must have fixed it - we should get that voting15:46
cloudnullhowever i agree it still needs work.15:46
cloudnullI just need more hours in the day to get at that15:47
cloudnull:)15:47
odyssey4meit also needs time for people to get familiar with it - right now you're the only guy, which is not a good thing... we need more people to get familiar with it15:47
*** vnogin has quit IRC15:48
cloudnullthat's kinda of a chicken and egg problem :)15:48
cloudnullfolks can use it now. i'd LOVE the feedback15:49
*** openstacking_123 has quit IRC15:50
cloudnullmaybe if we gave folks a reason, like forcing cent to use it, they'd get familiar with it :P15:51
odyssey4meheh, yeah15:51
cloudnullhahaha15:51
odyssey4meit'd be nice if we got more tests using it before the next milestone so that we can release it for Rocky with some confidence15:52
odyssey4meif we can do that, I'd like to flip the default next cycle15:52
cloudnull++15:52
*** pcaruana has quit IRC15:52
cloudnullI need help in that arena. I sadly don't have a lot of time.15:53
cloudnullI'm doing my best to try and keep up w/ reviews and push inflight things forward but I know im falling behind15:54
cloudnull...15:54
odyssey4meunderstood, I'm also under a time crunch at the moment - hopefully another core can partner with you to get it to the finisih line15:54
cloudnull++ if folks are interested I'm happy to help them spin up15:55
jrosseris there a nspawn zfs backend yet?15:56
*** openstacking_123 has joined #openstack-ansible15:58
cloudnulljrosser there is not .15:58
*** KeithMnemonic has joined #openstack-ansible15:58
cloudnullat least not one that im aware of15:58
cloudnulljrosser https://github.com/systemd/systemd/issues/427215:59
jrosseri guess nothing stops me making a bit of btrfs on top of zfs.... but yuk :)15:59
cloudnulllooks like the work has been done.15:59
cloudnullits just a matter of getting it in15:59
cloudnullnevermind that's just a feature request.16:00
*** rmart04 has quit IRC16:02
mnasercloudnull: i am a bit short on time these days too unfortunately16:04
mnaseri'd love to see nspawn but i don't want to promise to commit time where i don't have either16:04
* mnaser is still curious at how centos is breaking16:04
mnaseri've literally replaced all repos in a docker container with the same ones in that container and updated16:04
mnaserand it didnt break16:04
mnaseroh hmm16:07
mnaseri wonder if our package pinning is messing things up16:07
*** gyee has joined #openstack-ansible16:13
openstackgerritMerged openstack/openstack-ansible-plugins master: Remove distro package indexing from py_pkgs lookup  https://review.openstack.org/56484116:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/queens: Remove distro package indexing from py_pkgs lookup  https://review.openstack.org/56762916:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/pike: Remove distro package indexing from py_pkgs lookup  https://review.openstack.org/56763116:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/ocata: Remove distro package indexing from py_pkgs lookup  https://review.openstack.org/56763216:18
openstackgerritMerged openstack/openstack-ansible-plugins master: Remove test-requirements files from py_pkgs lookup  https://review.openstack.org/56728516:18
openstackgerritMerged openstack/openstack-ansible-plugins master: Trivial: Fix the pep8 warning  https://review.openstack.org/56683416:18
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible  https://review.openstack.org/56758516:19
*** ansmith has joined #openstack-ansible16:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/queens: Remove test-requirements files from py_pkgs lookup  https://review.openstack.org/56763316:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/pike: Remove test-requirements files from py_pkgs lookup  https://review.openstack.org/56763416:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/ocata: Remove test-requirements files from py_pkgs lookup  https://review.openstack.org/56763516:20
odyssey4methanks cloudnull for supporting my war against confusion and unnecessary code :)16:21
odyssey4meperhaps the cycle after next we can do the same with lxc ;)16:21
cloudnullhttps://www.youtube.com/watch?v=amFRTRMBk1A16:21
odyssey4melol16:22
*** nicolasbock has quit IRC16:22
*** nicolasbock has joined #openstack-ansible16:24
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_nova master: (WIP) Update to use oslo.messaging services for RPC and Notify  https://review.openstack.org/55862016:24
*** erolg has quit IRC16:26
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_heat master: (WIP) Update to use oslo.messaging service for RPC and Notify  https://review.openstack.org/56403016:33
jrosserodyssey4me: seem to have devpi hooked up and working behind the repo server16:34
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Prefer distribution packages for Tempest dependencies  https://review.openstack.org/56260616:34
odyssey4mejrosser woot!16:35
*** pcaruana has joined #openstack-ansible16:36
odyssey4melooks like devpi uses a slightly different URL format then16:37
*** DanyC has joined #openstack-ansible16:38
*** DanyC has quit IRC16:38
*** DanyC has joined #openstack-ansible16:39
jrosseryes it does, so i had to fiddle the reverse proxy to make things appear just at /simple16:39
jrosserand then adjust the nginx config to play nice with the content of what it returns16:40
odyssey4meok, so there needs to be that extra location, and perhaps also some sort of url rewrite to support devpi out of the box?16:41
jrosserfor osa stuff just the extra location16:41
*** openstacking_123 has quit IRC16:42
jrosserwell hmm yeah i guess you could do it either way16:43
*** pcaruana has quit IRC16:44
*** stuartgr has quit IRC16:45
*** stuartgr has joined #openstack-ansible16:46
*** openstacking_123 has joined #openstack-ansible16:48
openstackgerritMerged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.openstack.org/56513316:48
openstackgerritMerged openstack/openstack-ansible-os_trove master: Convert role to use a common systemd service role  https://review.openstack.org/55802816:48
Taseerevrardjp: Do I need to add the zuul.d to https://review.openstack.org/#/c/567112/ to trigger the testing pipelines ?16:48
mnaserok so it looks like all of nss is broken16:50
mnaserrpm --import /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-Debug-7 /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-Testing-7 /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-7 => "error: Failed to initialize NSS library"16:50
mnaserstrace shows this16:51
mnaseropen("/proc/sys/crypto/fips_enabled", O_RDONLY) = -1 ENOENT (No such file or directory)16:51
mnaserthen error right after16:51
mnasermaybe its expecting that to be there?16:51
odyssey4meperhaps it's an selinux thing?16:52
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible  https://review.openstack.org/56758516:52
odyssey4meTaseer you shouldn't need it - no, perhaps the system jobs haven't been added/merged yet16:52
mnaserodyssey4me: don't we do setenforce 0?16:53
jrosserodyssey4me: i've stuck some examples of what devpi returns on that etherpad16:53
mnaserin the gate anyawys16:53
mnaserOR maybe because this thing is running in chroot16:53
mnaserand the chroot is not properly setup.16:53
mnaserthings that are supposed to be there are missing16:53
Taseerodyssey4me: can you please elaborate the system jobs ? which system jobs ?16:54
odyssey4memnaser yeah, a chroot is not a running system so it will miss some things - nor do we want it running16:54
mnaserso maybe with the newer versions of yum or nss it expects certain things to be there that are not there16:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins master: Remove docs/requirements.txt from py_pkgs lookup output  https://review.openstack.org/56764616:56
mnaserwhich would be nice meaning that it's a smaller fix16:56
odyssey4meperhaps16:56
mnaseropen("/dev/urandom", O_RDONLY)          = -1 ENOENT (No such file or directory)16:56
mnaseri wonder if the fact that it cant get any randomness16:56
odyssey4mecloudnull some MOAR cleanup :) https://review.openstack.org/56764616:57
*** prometheanfire has quit IRC16:57
*** prometheanfire has joined #openstack-ansible16:58
odyssey4meTaseer this needs to merge before the repo will have any tests: https://review.openstack.org/56654217:00
Taseerodyssey4me: ok thanks17:00
*** gkadam has quit IRC17:00
cloudnullanyone around want to go smash the ones that pass through https://review.openstack.org/#/q/topic:add_bionic_support+(status:open+OR+status:merged)17:01
odyssey4mejrosser it looks like the first one came from pypiserver, and the second from devpi17:03
jrosseryeah although i've just got antoher error17:03
mnaserHA17:03
mnaserI THINK I FOUND IT17:03
mnaserhttps://bugzilla.mozilla.org/show_bug.cgi?id=889116#c2017:03
openstackMozilla bug 889116 in Libraries "RNG_SystemRNG and RNG_FileUpdate should not fall back on rng_systemFromNoise on platforms with /dev/urandom" [Normal,Resolved: fixed] - Assigned to wtc17:03
mnaserso it looks like newer releases of nss absolutely require a source of entropy17:04
mnaserin running chroot, we have no /dev/urandom17:04
mnaserso nss blows up17:04
cloudnull:(17:04
odyssey4mehmm, perhaps we could add a package?17:04
mnaseri propose a bind mount of /dev/urandom in the cache prep stage17:04
mnaser..but i'm also open to other alternatives17:04
cloudnull++17:04
mnaserim not sure if that would work in a chroot'd environment though17:05
* mnaser thinks17:05
odyssey4mehttps://bugs.launchpad.net/ubuntu/+source/network-manager-openvpn/+bug/1618363/comments/217:05
openstackLaunchpad bug 1618363 in network-manager-openvpn (Ubuntu) "/dev/urandom not included in chroot, leads to crashes with static key" [High,Confirmed]17:05
mnaseraha17:05
mnasergood catch17:05
mnaserok let me try that17:05
jrosserodyssey4me: what makes the repo sync work?17:05
cloudnullmnaser you could add http://paste.openstack.org/show/720781/ to the setup script17:06
odyssey4mejrosser the primary node should have both rsync and lsyncd - it pushes changes out using rsync to the other nodes17:06
cloudnulloh odyssey4me beat me to it17:06
*** vakuznet has joined #openstack-ansible17:06
mnaserwe'll have to clean up that after too17:06
cloudnulladding that here https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/prep-scripts/_container_sys_setup.sh.j2 would make sure things like that are solved generally17:06
mnaserjust to make sure that it doesn't break something else later17:06
mnaseror is it okay to leave them?17:07
cloudnullthey get mounted over17:07
mnaserah yes17:07
cloudnullthough maybe not a bad idea to clean up post cache prep?17:07
cloudnullwe could do something similar with a general include script17:08
cloudnullat the end of the various distro setups17:08
odyssey4mewell, clean up is easy enough I guess - it hsould be possible to do within the prep script17:08
*** cjloader has quit IRC17:09
cloudnullit doesn't really matter... its not like those devices take space or would impact the runtime, so meh ...17:09
odyssey4meja17:09
mnaserlets see if it works first17:10
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible  https://review.openstack.org/56758517:10
*** udesale_ has quit IRC17:12
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Trivial: Fix the pep8 warning  https://review.openstack.org/56683317:17
odyssey4mecloudnull looks like https://review.openstack.org/547158 needs to be updated and got to a working state asap17:17
odyssey4medoesn't look like there are tests on https://review.openstack.org/#/projects/openstack/openstack-ansible-nspawn_hosts,dashboards/default either17:18
osnaya@odyssey4me @cloudnull @evrardjp continued from earlier ...Ubuntu16.04 local is OSA 16.0.12.... git fetch --all (success). Upon running "git checkout origin/stable/pike" errors out with "error: you need to resolve your current index first"... Please advise17:20
odyssey4meosnaya git reset --hard origin/stable/pike17:21
osnayaok17:21
odyssey4meosnaya google can help you with git issues too ;)17:21
*** ianychoi_ has joined #openstack-ansible17:32
openstackgerritMerged openstack/ansible-role-python_venv_build master: Revise the role to properly cater to use-cases  https://review.openstack.org/56477817:33
*** niraj_singh has joined #openstack-ansible17:33
*** ianychoi has quit IRC17:35
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56758517:36
mnaserodyssey4me, cloudnull ^ that is the fix, it worked, cleaned it up and removed the strace stuff17:36
d34dh0r53odyssey4me: ping17:36
mnaserappreciate if you can have eyes on it so we can merge it and bring back c7 coverage17:36
odyssey4memnaser awesome - I'm wondering whether we should release note something about that... if you use centos, everything is broken unless you add these pre-steps and these post steps to the repo build (similar to the recent resolvconf issue release note17:37
odyssey4med34dh0r53 o/17:37
mnaserodyssey4me: i'm thinking we can backport this change all the way back and it shouldn't affect users too much?17:38
mnaserlet me see how backportable it is17:38
d34dh0r53odyssey4me: so on my MNAIO I'm seeing the repo server 404 problem and I think it's because of this https://github.com/openstack/openstack-ansible-repo_server/blame/9bee3a1b3485ea6ffa6e8118c69341deb617ae61/defaults/main.yml#L82 and https://github.com/openstack/openstack-ansible-repo_server/blame/9bee3a1b3485ea6ffa6e8118c69341deb617ae61/defaults/main.yml#L8217:38
odyssey4memnaser that won't port exactly back, 'cos the structure and placement of the script has changed17:38
d34dh0r53odyssey4me: lsync can't sync the pools directory because it's root:root and lsync is running rsync as the nginix user17:38
odyssey4memnaser but this affects any new build, and given the code merges now - people may try to use centos from previous releases, so a reno really helps them understand what to do17:39
d34dh0r53I'm wondering what it will screw up if I remove https://github.com/openstack/openstack-ansible-repo_server/blob/master/tasks/repo_pre_install.yml#L11017:39
vakuznethave anyone seen "Failed to build libvirt-python" in ocata? i suspect because libvirt bumped to 3.9.0 in centos updates.17:39
SamYaplevakuznet: ya, its pinned to libvirt-python 2.5.0 in upper constraints in ocata17:40
mnaserodyssey4me: i can add a note, but i think it would also be beneficial to backport as well (even if the backport is specific)17:41
SamYapleyou need 3.x libvirt-python with 3.x libvirt (preferably matching versions)17:41
mnasercause of the structure changes17:41
odyssey4med34dh0r53 the pypiserver startup will create the dir I think... but another option would be to change that to set the user:group correctly17:41
odyssey4memnaser yes, of course - backport is a must17:41
jrosserd34dh0r53: are you seeing repo sync failures? i just tan into something like that too17:42
d34dh0r53odyssey4me: it's set correctly earlier, so just removing that line works, I just want to make sure that is not needed for proper pypi server workings, I don't think it is17:42
odyssey4memnaser I'm just thinking the backport could also have a reno with it - at least to note the problem, and which release it's fixed in.17:42
vakuznetlibvirt-python==3.5.0 while ago17:42
odyssey4med34dh0r53 ah I see https://github.com/openstack/openstack-ansible-repo_server/blob/master/tasks/repo_pre_install.yml#L6117:43
d34dh0r53jrosser: yes, one of the repo containers will have the files under /var/www/repo/pools, the others will have /var/www/repo/pools but it will be empty and owned root:root17:43
odyssey4med34dh0r53 the reason it's further down is because the folder was different once - so go for it, remove the root one17:43
d34dh0r53odyssey4me: sounds good, I'll file a bug and get a review up17:43
jrosserd34dh0r53: cheers i'll check that17:43
odyssey4med34dh0r53 thanks for tracking it down!17:44
d34dh0r53jrosser: the fix for now is to just chown -R nginx:www-data /var/www/repo/pools on the two slave containers17:44
odyssey4meand we now have an lsyncd expert in the house ;)17:44
d34dh0r53ROFL17:44
odyssey4med34dh0r53 no need for a bug, unless you insist - just push a review up :)17:44
d34dh0r53odyssey4me: will do17:45
odyssey4me(with a good explanation in the commit, of course)17:47
openstackgerritDavid Wilde proposed openstack/openstack-ansible-repo_server master: Fix permissions for lsync  https://review.openstack.org/56765717:49
odyssey4metyvm d34dh0r5317:50
d34dh0r53np17:51
odyssey4mejrosser ^ that should fix the repo sync17:51
odyssey4meafk for a bit17:51
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add Bionic testing  https://review.openstack.org/56703417:57
*** radeks__ has joined #openstack-ansible17:57
*** radeks_ has quit IRC17:58
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56758517:59
mnasercloudnull, odyssey4me: added a release note17:59
mnaserwill appreciate the +2s back!17:59
odyssey4meLGTM, thanks for that!18:00
*** radeks has quit IRC18:00
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add Bionic testing  https://review.openstack.org/56703418:00
odyssey4mehmm, that may fail the reno build mnaser due to the :18:00
mnaseroh um18:01
d34dh0r53cloudnull: mind looking at https://review.openstack.org/#/c/567657/18:01
mnaserlet me try locally18:01
odyssey4memind if I edit it real quick?18:01
mnaserodyssey4me: go for it18:01
mnaser(but im running it locally too)18:01
cloudnulld34dh0r53 done.18:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56758518:02
cloudnullwe might need that back in queens, pike, etc18:02
cloudnullidk though. nice catch d34dh0r5318:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56758518:02
d34dh0r53at least in queens18:02
odyssey4mecloudnull d34dh0r53 just queens after master is merged18:02
odyssey4memnaser done - that should work18:03
*** armaan has quit IRC18:04
*** electrofelix has quit IRC18:04
odyssey4mealright, afk for a bit - going for a walk to get a little sun18:04
*** armaan has joined #openstack-ansible18:04
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_monasca stable/pike: Fix extras/repo_packages poiting to master  https://review.openstack.org/56766418:07
*** masuberu has joined #openstack-ansible18:16
*** masber has quit IRC18:19
*** toddnni has quit IRC18:19
*** gokhan has quit IRC18:19
*** gokhan has joined #openstack-ansible18:20
*** toddnni has joined #openstack-ansible18:22
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add Bionic testing  https://review.openstack.org/56703418:24
openstackgerritMerged openstack/openstack-ansible-repo_server master: Fix permissions for lsync  https://review.openstack.org/56765718:35
*** KeithMnemonic has quit IRC18:36
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/pike: Do not log passwords  https://review.openstack.org/56298118:38
*** mbuil has quit IRC18:40
openstackgerritDavid Wilde proposed openstack/openstack-ansible-repo_server stable/queens: Fix permissions for lsync  https://review.openstack.org/56766818:43
d34dh0r53reviews much appreciated18:44
openstackgerritKevin Carter (cloudnull) proposed openstack/ansible-role-systemd_networkd master: Add resolved to the networkd setup  https://review.openstack.org/56767018:47
d34dh0r53ty odyssey4me and cloudnull18:52
odyssey4mecloudnull looks like this one is good to go :) https://review.openstack.org/56764618:55
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56758518:55
odyssey4med34dh0r53 please review if you can18:55
cloudnullodyssey4me done18:56
odyssey4memnaser backport https://review.openstack.org/567585 when you're ready!18:56
d34dh0r53odyssey4me: on it's way18:56
mnaseroh cool18:56
mnaserlook at all those grenes18:56
mnasergreens18:56
d34dh0r53much green such passing18:56
odyssey4meI'm guessing you'll want to revert https://review.openstack.org/#/c/567594/ too now :)18:57
odyssey4med34dh0r53 cloudnull tyvm18:57
*** radeks__ has quit IRC18:58
*** dkehn_ has joined #openstack-ansible18:58
hwoarangodyssey4me: could you give your blessing on https://review.openstack.org/#/c/566093/ ? :)18:59
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts stable/queens: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56767118:59
mnaserodyssey4me, cloudnull: wanna tell me if that's an ok way of backporting so i keep going backwards?19:00
odyssey4memnaser yep, perfectly good19:00
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests master: Revert "Switch OSA functional tests to non-voting for CentOS 7"  https://review.openstack.org/56767319:00
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts stable/pike: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56767419:01
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts stable/ocata: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56767519:01
odyssey4memnaser see point 1 in https://docs.openstack.org/openstack-ansible/latest/contributor/contribute.html#backporting :)19:01
mnaserhttps://review.openstack.org/#/q/Iaf6b9cb1435591f28289493f480a7fe46789c551 + https://review.openstack.org/#/c/567673/ and we are back in action for centos 719:01
mgariepythanks a lot mnaser19:01
mnaserodyssey4me: okay cool!19:02
mnasermgariepy: de rien!19:02
*** dkehn has quit IRC19:02
mgariepyi unfortunately don't have much time for that those days.19:02
odyssey4methanks for working that out mnaser - it's great to have more hands available to spread the load :)19:02
mnaser:>19:03
mnaserit would be nice to hack up a patch to do cache prep within ansible but that's a whole another thing :)19:03
mnaseri was losing hope till i got the idea of using an strace19:03
cloudnullmnaser ++ nicely done!19:05
odyssey4mehwoarang now that the pattern is sorted, it's pretty plain sailing  - great work!19:06
prometheanfireevrardjp[m]: orly19:06
*** tosky has quit IRC19:07
*** tosky has joined #openstack-ansible19:11
odyssey4mehwoarang mbuil it looks like the opendaylight role has non-production entries in its requirements.txt, rather than test-requirements.txt - any chance that could be changed so that the repo build doesn't need to build them?19:11
openstackgerritKevin Carter (cloudnull) proposed openstack/ansible-role-systemd_networkd master: Add resolved to the networkd setup  https://review.openstack.org/56767019:13
openstackgerritRobin Naundorf proposed openstack/openstack-ansible master: Fix spelling error and hypen  https://review.openstack.org/56751519:14
hwoarangodyssey4me: thanks. nova and neutron and somewhat complex the rest is easy19:14
hwoarangodyssey4me: no clue about opendaylight that would need mbuil or epalper19:15
hwoarangwill ping them tomorrow19:15
odyssey4med34dh0r53 FYI once https://review.openstack.org/567671 merges, the centos builds for queens will work again19:16
hwoarangmight worth adding that ^ fix to all distros19:17
hwoarangso we could be proactive...19:17
hwoarangbut aaaaaaaaaaaaaaaanyway19:17
odyssey4mehwoarang you reckon that may become a requirement at some point?19:18
hwoarangi guess that since the packages are the same across distros, the requirement for /dev/* is probably the same19:18
odyssey4meFair point. mnaser could you do a follow up patch for other distributions?19:19
odyssey4meSame patch, different reason - this time it's proactive, not reactive. :)19:19
mnaserodyssey4me: i think the issue is more with yum rather than anything19:20
mnaserbut i can push up a change for other distros too for the backport19:20
mnasercause master is fixed for all all distros19:20
odyssey4meIs it? Do all distributions have /dev now?19:20
odyssey4meIn the chroot I mean.19:20
mnaseryes, in master, because i updated the "master" prep file19:20
mnaserwhich is inserted for all distros19:21
mnaserin the backports, not to potentially break other things, i limited it to centos only19:21
odyssey4meoh, heh - didn't realise there was such a thing19:21
mnaserneither did i, but thanks to cloudnull :)19:21
odyssey4mefo' shizzle19:21
openstackgerritMerged openstack/openstack-ansible-plugins master: Remove docs/requirements.txt from py_pkgs lookup output  https://review.openstack.org/56764619:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/queens: Remove docs/requirements.txt from py_pkgs lookup output  https://review.openstack.org/56767919:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/pike: Remove docs/requirements.txt from py_pkgs lookup output  https://review.openstack.org/56768019:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/ocata: Remove docs/requirements.txt from py_pkgs lookup output  https://review.openstack.org/56768119:24
cloudnullanyone want to give https://review.openstack.org/#/c/566099/ a nudge19:26
cloudnulland https://review.openstack.org/#/c/566120/19:26
cloudnullalso https://review.openstack.org/#/c/566360/19:26
cloudnull:P19:26
cloudnullmaybe https://review.openstack.org/#/c/557969/ & https://review.openstack.org/#/c/557970/19:27
cloudnullok im done :)19:27
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/ocata: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56767519:31
openstackgerritMerged openstack/openstack-ansible master: Fix spelling error and hypen  https://review.openstack.org/56751519:31
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/pike: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56767419:33
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/queens: Setup /dev/random and /dev/urandom device in cache prep  https://review.openstack.org/56767119:33
*** openstacking_123 has quit IRC19:36
*** openstacking_123 has joined #openstack-ansible19:37
openstackgerritMerged openstack/openstack-ansible master: Add information about restoring inventory from backup  https://review.openstack.org/56609919:42
openstackgerritMerged openstack/openstack-ansible master: Provide an example for switch port configurations  https://review.openstack.org/56612019:42
openstackgerritMerged openstack/openstack-ansible-os_glance master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56609319:49
*** prometheanfire has quit IRC19:52
*** prometheanfire has joined #openstack-ansible19:53
*** radeks__ has joined #openstack-ansible19:56
openstackgerritMerged openstack/openstack-ansible-os_monasca stable/pike: Fix extras/repo_packages poiting to master  https://review.openstack.org/56766420:02
*** radeks_ has joined #openstack-ansible20:03
*** prometheanfire has quit IRC20:04
*** radeks__ has quit IRC20:06
*** prometheanfire has joined #openstack-ansible20:06
odyssey4memnaser wanna give https://review.openstack.org/#/q/I0d133804a91feae03e44047eede589c75806b2da a once-over too?20:10
openstackgerritMerged openstack/openstack-ansible-plugins stable/queens: Remove docs/requirements.txt from py_pkgs lookup output  https://review.openstack.org/56767920:11
openstackgerritMerged openstack/openstack-ansible-plugins stable/ocata: Remove docs/requirements.txt from py_pkgs lookup output  https://review.openstack.org/56768120:11
openstackgerritMerged openstack/openstack-ansible-plugins stable/pike: Remove docs/requirements.txt from py_pkgs lookup output  https://review.openstack.org/56768020:11
openstackgerritMerged openstack/openstack-ansible-plugins stable/ocata: Remove test-requirements files from py_pkgs lookup  https://review.openstack.org/56763520:11
openstackgerritMerged openstack/openstack-ansible-plugins stable/queens: Remove test-requirements files from py_pkgs lookup  https://review.openstack.org/56763320:18
openstackgerritMerged openstack/openstack-ansible-plugins stable/pike: Remove test-requirements files from py_pkgs lookup  https://review.openstack.org/56763420:18
*** armaan has quit IRC20:21
*** armaan has joined #openstack-ansible20:22
*** armaan has quit IRC20:27
*** ansmith has quit IRC20:30
*** radeks_ has quit IRC20:33
*** mma has quit IRC20:38
*** mma has joined #openstack-ansible20:39
openstackgerritMerged openstack/openstack-ansible-repo_server stable/queens: Fix permissions for lsync  https://review.openstack.org/56766820:43
*** mma has quit IRC20:43
*** sc68cal_ is now known as sc68cal20:44
openstackgerritMerged openstack/openstack-ansible-plugins stable/queens: Remove distro package indexing from py_pkgs lookup  https://review.openstack.org/56762920:46
openstackgerritMerged openstack/openstack-ansible-plugins stable/pike: Remove distro package indexing from py_pkgs lookup  https://review.openstack.org/56763120:46
openstackgerritMerged openstack/openstack-ansible-plugins stable/ocata: Remove distro package indexing from py_pkgs lookup  https://review.openstack.org/56763220:46
*** vnogin has joined #openstack-ansible20:49
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Do not pip install keystoneclient on the host  https://review.openstack.org/56260720:49
*** mma has joined #openstack-ansible20:50
*** vnogin has quit IRC20:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Use a common python build/install role for source-base deployment  https://review.openstack.org/56769221:04
*** jwitko has joined #openstack-ansible21:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Use a common python build/install role for source-base deployment  https://review.openstack.org/56769221:19
*** vakuznet has quit IRC21:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Use a common python build/install role for source-base deployment  https://review.openstack.org/56769221:20
*** jwitko_ has quit IRC21:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: tasks: Ensure /etc/keystone/credential-keys is created on time  https://review.openstack.org/56366721:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56030821:22
*** jwitko has quit IRC21:22
*** ansmith has joined #openstack-ansible21:25
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Tune down the collection intervals and default retention policy  https://review.openstack.org/56769321:30
*** openstacking_123 has quit IRC21:31
mnasercloudnull: seeing you push things so i can borrow you for this? https://review.openstack.org/#/c/567673/ :D21:35
*** openstacking_123 has joined #openstack-ansible21:35
*** openstacking_123 has quit IRC21:36
cloudnullmnaserlooking21:38
cloudnull** looking21:38
cloudnulldone.21:38
*** dave-mccowan has joined #openstack-ansible21:39
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56631521:42
*** openstacking_123 has joined #openstack-ansible21:47
*** jwitko has joined #openstack-ansible21:47
*** openstacking_123 has quit IRC21:59
*** DanyC has quit IRC21:59
*** ivve has quit IRC22:09
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Tune down the collection intervals and default retention policy  https://review.openstack.org/56769322:11
*** esberglu has quit IRC22:19
*** mma has quit IRC22:20
*** mma has joined #openstack-ansible22:21
*** mma has quit IRC22:25
openstackgerritMerged openstack/openstack-ansible-tests master: Revert "Switch OSA functional tests to non-voting for CentOS 7"  https://review.openstack.org/56767322:26
*** KeithMnemonic has joined #openstack-ansible22:31
*** esberglu has joined #openstack-ansible22:33
*** esberglu has quit IRC22:33
*** throwsb1 has quit IRC22:35
*** kaiokmo has quit IRC22:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Tune down the collection intervals and default retention policy  https://review.openstack.org/56769322:40
*** nsingh has joined #openstack-ansible22:42
*** KeithMnemonic has quit IRC22:42
*** portante has quit IRC22:42
*** KeithMnemonic has joined #openstack-ansible22:43
*** jwitko has quit IRC22:44
*** niraj_singh has quit IRC22:45
*** nsingh has quit IRC22:46
*** portante has joined #openstack-ansible22:46
*** nsingh has joined #openstack-ansible22:48
*** dhellmann has quit IRC22:49
*** bradm has joined #openstack-ansible22:50
*** nicolasbock has quit IRC22:50
*** dhellmann has joined #openstack-ansible22:50
*** nicolasbock has joined #openstack-ansible22:50
openstackgerritMerged openstack/openstack-ansible-os_keystone master: tasks: Ensure /etc/keystone/credential-keys is created on time  https://review.openstack.org/56366722:52
*** KeithMnemonic has quit IRC23:11
*** KeithMnemonic has joined #openstack-ansible23:18
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Clean up docs and bootstrap script  https://review.openstack.org/56761423:30
*** KeithMnemonic has quit IRC23:34
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Tune down the collection intervals and default retention policy  https://review.openstack.org/56769323:38
*** kaiokmo has joined #openstack-ansible23:42
*** weezS has quit IRC23:51
*** vnogin has joined #openstack-ansible23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!