Wednesday, 2019-10-09

*** goldyfruit_ has joined #openstack-ansible00:03
*** markvoelker has quit IRC00:05
*** macz has quit IRC00:06
*** gokhani has quit IRC00:06
*** markvoelker has joined #openstack-ansible00:07
*** markvoelker has quit IRC00:14
*** markvoelker has joined #openstack-ansible00:19
*** ansmith_ has quit IRC00:23
*** hwoarang has quit IRC00:34
*** hwoarang has joined #openstack-ansible00:44
*** goldyfruit_ has quit IRC00:56
*** macz has joined #openstack-ansible02:02
*** goldyfruit_ has joined #openstack-ansible02:05
*** macz has quit IRC02:07
*** goldyfruit_ has quit IRC02:35
*** markvoelker has quit IRC03:09
*** macz has joined #openstack-ansible03:09
*** markvoelker has joined #openstack-ansible03:10
*** macz has quit IRC03:14
*** markvoelker has quit IRC03:23
*** markvoelker has joined #openstack-ansible03:24
*** udesale has joined #openstack-ansible03:55
*** raukadah is now known as chandankumar03:58
*** markvoelker has quit IRC04:35
*** markvoelker has joined #openstack-ansible04:35
*** dave-mccowan has quit IRC05:12
*** kopecmartin|off is now known as kopecmartin06:07
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-galera_server master: Bump galera version to 10.3.18  https://review.opendev.org/68745406:10
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-galera_client master: Bump galera version to 10.3.18  https://review.opendev.org/68745506:11
*** jbadiapa has joined #openstack-ansible06:29
*** lkoranda has joined #openstack-ansible06:46
*** cshen has joined #openstack-ansible07:04
*** pcaruana has joined #openstack-ansible07:10
*** tosky has joined #openstack-ansible07:14
*** shyamb has joined #openstack-ansible07:33
*** rpittau|afk is now known as rpittau07:35
*** ivve has joined #openstack-ansible07:41
*** r81 has joined #openstack-ansible07:45
*** shyamb has quit IRC07:48
cshenmorning07:54
evrardjpmorning07:55
*** tosky has quit IRC07:58
*** tosky has joined #openstack-ansible07:59
openstackgerritpengyuesheng proposed openstack/ansible-role-python_venv_build master: Blacklist sphinx 2.1.0 (autodoc bug)  https://review.opendev.org/68747108:04
evrardjpjrosser: sorry it's been a long day yesterday, so I couldn't join our meeting.08:10
jrosserhello08:11
evrardjpAll the things I did can be re-done. I just gave examples08:11
evrardjpI just think branching needs to happen fast before we continue to bump in what would be the train branch, stuff from ussuri (as others have branched already)08:11
jrosseryes08:11
jrosseralready the gate is broken again :(08:11
jrossererlang repo has sum mismatch08:12
evrardjpoh god :(08:12
jrosser*hash08:12
jrosserthey do this so often08:12
evrardjpweirdly my brain extrapolated to hash sum naturally08:12
evrardjpdarn08:12
*** shyamb has joined #openstack-ansible08:19
noonedeadpunkhi everyone08:58
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: PDF Documentation Build tox target  https://review.opendev.org/68727809:16
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: PDF Documentation Build tox target  https://review.opendev.org/68727809:21
*** shyamb has quit IRC09:21
*** shyamb has joined #openstack-ansible09:22
*** shyamb has quit IRC09:59
*** shyamb has joined #openstack-ansible10:21
*** cshen has quit IRC10:22
*** cshen has joined #openstack-ansible10:35
*** prometheanfire has quit IRC10:38
*** prometheanfire has joined #openstack-ansible10:39
*** kaiokmo has joined #openstack-ansible11:21
*** udesale has quit IRC11:22
*** nicolasbock has joined #openstack-ansible11:28
*** gshippey has joined #openstack-ansible11:29
*** shyamb has quit IRC11:35
*** nicolasbock has quit IRC11:39
*** nicolasbock has joined #openstack-ansible11:39
*** dave-mccowan has joined #openstack-ansible11:49
openstackgerritMerged openstack/openstack-ansible master: Allow horizon to be tested on metal  https://review.opendev.org/68172211:50
jamesdentongood day11:51
*** ansmith_ has joined #openstack-ansible11:51
kaiokmojamesdenton: good day sir11:52
jamesdentonhello kaiokmo11:53
jrosserhello11:59
jamesdentonhey jrosser12:00
*** goldyfruit_ has joined #openstack-ansible12:12
*** goldyfruit___ has joined #openstack-ansible12:14
*** goldyfruit_ has quit IRC12:17
*** goldyfruit___ has quit IRC12:19
*** csmart has quit IRC12:33
mnaseri have one thing on my plate that i need to get done with12:35
mnaserand i can kinda focus on helping clear out everything left12:35
*** cshen has quit IRC12:36
*** csmart has joined #openstack-ansible12:36
*** cshen has joined #openstack-ansible12:52
guilhermespo/13:04
jamesdentonmornin13:07
guilhermespmornings jamesdenton \m/13:10
*** markvoelker has quit IRC13:10
*** markvoelker has joined #openstack-ansible13:11
*** markvoelker has quit IRC13:11
*** markvoelker has joined #openstack-ansible13:11
jamesdenton:)13:14
*** spatel has joined #openstack-ansible13:15
openstackgerritGeorgina Shippey proposed openstack/openstack-ansible-ops master: Improvements to ILM  https://review.opendev.org/68643713:17
*** spatel has quit IRC13:19
*** lkoranda has quit IRC13:24
*** jawad_axd has joined #openstack-ansible13:28
*** goldyfruit___ has joined #openstack-ansible13:28
*** goldyfruit___ has quit IRC13:29
*** pcaruana has quit IRC13:31
*** goldyfruit has joined #openstack-ansible13:32
*** pcaruana has joined #openstack-ansible13:33
*** ianychoi has quit IRC13:41
*** udesale has joined #openstack-ansible13:45
*** spatel has joined #openstack-ansible13:45
*** spatel has quit IRC13:50
*** jawad_axd has quit IRC13:51
*** miouge3625 has joined #openstack-ansible13:52
*** jawad_axd has joined #openstack-ansible13:52
*** jenglisch has quit IRC13:56
*** johanssone has quit IRC13:56
*** ivve has quit IRC13:56
*** mrda has quit IRC13:56
*** jmccrory has quit IRC13:56
*** alanmeadows has quit IRC13:56
*** ondrejburian has quit IRC13:56
*** miouge362 has quit IRC13:56
*** django has quit IRC13:56
*** ioni has quit IRC13:56
*** _ioni has joined #openstack-ansible13:56
*** alanmeadows has joined #openstack-ansible13:56
*** ivve has joined #openstack-ansible13:56
*** django has joined #openstack-ansible13:56
guilhermesper, as far as you can see, is the gate still broken jrosser ?13:56
*** ondrejburian has joined #openstack-ansible13:56
*** jawad_axd has quit IRC13:57
jrosserguilhermesp: i've been a bit tied up in other things today, let me take a look13:57
guilhermespno worries, I can take a look to though13:57
*** openstackstatus has quit IRC13:58
*** johanssone has joined #openstack-ansible13:58
jrosserthere have been some timeouts13:58
jrosserwhich don't look like our job actually failing13:58
jrosserprobably uploading logs took too long13:58
*** admin0 has quit IRC13:58
guilhermespjust wondering if I could +w some stuff13:59
guilhermespi will and keep an eye13:59
*** robeik has joined #openstack-ansible13:59
*** _ioni is now known as ioni13:59
jrosseri've just found that the buster lxc image gets the distro mariadb pulled into the base image14:00
*** ioni has left #openstack-ansible14:00
*** ioni has joined #openstack-ansible14:00
jrosserwhich then breaks the actual setup we want in the galera contaienr14:01
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Ensure mariadb packages are not in the lxc base image for debian  https://review.opendev.org/68757414:06
robeiksome time ago I had a apt proxy in my local network ( /etc/apt/apt.conf.d/90curtin-aptproxy ). But now the proxy is gone, but every newly created container has the old config file (/etc/apt/apt.conf.d/90curtin-aptproxy ) and the apt commands afterwards fail . Where is the configuration for new containers are taken from and how can I update them?14:07
jrosserthere is a base image built for the containers, and each new one is a copy of the base image14:10
jrosserso i guess there is two things, finding out how the apt setup got into the container - that may just be copied off the host14:11
jrosserthen you can rebuild the base image with this flag https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/defaults/main.yml#L21714:11
robeikok, should I set the flag in user_variables.yml or could it be done ad-hoc with openstack-ansible command?14:17
jrosseryou can run the setup-hosts.yml playbook with -e lxc_image_cache_refresh=true14:18
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Use xz instead of pxz  https://review.opendev.org/68728014:18
robeikperfect, thanks!14:19
jrosserbut it might need a little checking/digging to see if that apt setup has been properly removed14:19
jrosseryou can check in /var/lib/machines/...14:19
robeikyes, I have already found the apt config in /var/lib/machines and I corrected it there, but this did not retrigger image cache creation14:20
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Ensure mariadb packages are not in the lxc base image for debian  https://review.opendev.org/68757414:20
*** zul has quit IRC14:27
*** udesale has quit IRC14:41
logan-jrosser: wow they ship sql packages in the base image? thats weird14:46
jrosserit gets pulled in courtesy of mailutils i think14:47
jrosserand that from exim14:47
jrosseractually i'll update the commit message becasue thats not clear14:48
logan-https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_674/687574/2/check/openstack-ansible-functional-debian-stable/6745587/logs/host/lxc-cache-prep-commands.log.txt.gz14:50
logan-doesn't look like it removed anything14:51
*** jawad_axd has joined #openstack-ansible14:53
*** udesale has joined #openstack-ansible14:54
jrosserlogan-: heres what i need to fix https://zuul.opendev.org/t/openstack/build/1ab18aaa8f514b9ea3d53c3d6b35bfff/log/job-output.txt#965314:55
*** macz has joined #openstack-ansible15:02
*** ivve has quit IRC15:03
cjloadermorning15:03
*** cshen has quit IRC15:08
*** lkoranda has joined #openstack-ansible15:09
logan-jrosser: https://zuul.opendev.org/t/openstack/build/1ab18aaa8f514b9ea3d53c3d6b35bfff/log/job-output.txt#9314 is where its being installed15:09
logan-based on the timestamp in https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_1ab/687455/1/check/openstack-ansible-deploy-aio_metal-debian-stable/1ab18aa/logs/host/apt/term.log.txt.gz15:10
jrosserok so to make this more complicated i'm testing locally on debian buster here15:10
jrosserand it's there in the lxc base container once the container prep is done15:10
*** robeik has quit IRC15:11
cjloaderhas anyone seen an error when running galera playbook -- when dropping mariadb configs, theres an error saying 'ansible_host' is not defined but my inventory has it defined15:12
jrosserlogan-: but what i don't actually understand is this failure here https://zuul.opendev.org/t/openstack/build/1ab18aaa8f514b9ea3d53c3d6b35bfff/log/job-output.txt#965315:13
*** lkoranda has quit IRC15:13
logan-im wondering if its something we're inheriting from the base image we download and then customize, OR if its something lxc_hosts is accidentally pulling in somehow (you'd see that in /var/log/lxc-cache-prep-commands.log.txt.gz after lxc_hosts runs)15:13
jrosserwell same one - why does it start to do that when i slightly bump the galera version15:13
jrosserit may be that the same thing is happening on stretch as  i see here on buster15:14
*** udesale has quit IRC15:14
logan-so we install mariadb in _client, then in _server we "Remove old repos" which deletes a line from the MariaDB.repo file https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_1ab/687455/1/check/openstack-ansible-deploy-aio_metal-debian-stable/1ab18aa/logs/ara-report/result/023c696b-2c33-4056-9cc7-e252ddd9ef53/15:17
jrosserthe dependacy chain i'm seeing here is exim->mailutils->libmailutils5->libmariadb315:17
jrosserand certainly for buster thats how we get it being in the container base image15:18
logan-gotcha15:18
logan-so thats happening in the cache build?15:18
jrosseryes15:18
*** ryn_eq has joined #openstack-ansible15:19
jrosseri was really puzzled how there were conflicts during the galera role15:19
logan-yeah it doesn't make sense15:19
jrosseri put in a fail: just before it installed the apt packages and whaddya know there were some already there15:19
logan-the repo is deleted and the same one is added back it looks like15:19
jrosseroh well these are upstream backaged from debian15:19
jrosser*packages15:19
logan-ah15:20
*** lkoranda has joined #openstack-ansible15:20
jrosserhttps://mariadb.org/debian-10-mariadb-10-3/15:20
logan-thats unfortunate heh15:20
logan-seems like a different problem in stretch though15:20
jrosseryes, so i think there is something similar but different wrong with https://review.opendev.org/#/c/687455/15:21
jrosserand i'm a bit concerned that we have a circular dependancy between the galera_client and galera_server roles15:22
logan-can you try bumping that in _server first and then depends on it in _client15:22
*** lkoranda has quit IRC15:22
logan-right now _client runs first, then it runs _server trying to install the older version and dies15:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-galera_client master: Bump galera version to 10.3.18  https://review.opendev.org/68745515:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server master: Bump rabbitmq & erlang versions  https://review.opendev.org/68161415:29
openstackgerritMerged openstack/openstack-ansible master: Add nova placement to placement migration  https://review.opendev.org/66486715:31
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server master: Bump rabbitmq & erlang versions  https://review.opendev.org/68161415:33
*** rpittau is now known as rpittau|afk15:45
openstackgerritMerged openstack/openstack-ansible-os_glance master: Turn the filesystem directory to be configurable  https://review.opendev.org/61392415:46
*** openstackgerrit has quit IRC15:52
*** openstackgerrit has joined #openstack-ansible15:52
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Fix host kernel modules when using linux-hwe on ubuntu  https://review.opendev.org/68726515:52
*** toabctl has quit IRC15:53
*** lkoranda has joined #openstack-ansible15:55
*** BjoernT has joined #openstack-ansible15:56
openstackgerritMerged openstack/openstack-ansible-galera_server master: Improve compatibility with connection delegation  https://review.opendev.org/68694515:58
*** lkoranda has quit IRC16:02
*** r81 has quit IRC16:05
*** spatel has joined #openstack-ansible16:07
*** lkoranda has joined #openstack-ansible16:08
*** lkoranda has quit IRC16:09
*** spatel has quit IRC16:12
jrosserlogan-: would you know whats going on here http://paste.openstack.org/show/782456/16:30
*** lkoranda has joined #openstack-ansible16:44
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Update memcached_servers regex to match one or more items  https://review.opendev.org/68762016:46
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Update memcached_servers regex to match one or more chars  https://review.opendev.org/68762016:46
*** lkoranda has quit IRC16:47
*** markvoelker has quit IRC16:53
*** markvoelker has joined #openstack-ansible16:54
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Move debian jobs to buster  https://review.opendev.org/68177716:54
*** lkoranda has joined #openstack-ansible16:55
*** gyee has joined #openstack-ansible16:58
jamesdentonjrosser i get this, locally:     "memcached_servers_foo": "172.29.239.76:11211"17:00
jamesdentonnot a debian host, tho17:02
*** jawad_ax_ has joined #openstack-ansible17:02
*** jawad_axd has quit IRC17:02
jamesdentonand FWIW, two hosts:     "memcached_servers_foo": "172.29.239.76:11211,172.29.238.131:11211"17:05
*** lkoranda has quit IRC17:10
*** lkoranda has joined #openstack-ansible17:11
jrosserjamesdenton: this seems to fix it on buster https://review.opendev.org/68762017:14
jamesdentoni just looked at that :D misunderstood the issue17:15
jrosserit's python3.7, i wonder if theres a sublety there in the templating17:15
*** shananigans has joined #openstack-ansible17:23
*** nicolasbock has quit IRC18:15
*** nicolasbock has joined #openstack-ansible18:17
openstackgerritMerged openstack/openstack-ansible master: Remove use of nested curly braces  https://review.opendev.org/68412518:32
*** hwoarang has quit IRC18:37
*** hwoarang has joined #openstack-ansible18:40
mnasersigh18:43
mnaseranyone ever seen a high run queue but tons of idle cpu  (and no i/o happening)18:44
*** gshippey has quit IRC18:48
*** pcaruana has quit IRC19:07
*** hwoarang has quit IRC19:11
*** mgagne has quit IRC19:11
*** hwoarang has joined #openstack-ansible19:12
*** lkoranda has quit IRC19:26
*** kopecmartin is now known as kopecmartin|off19:35
spotzmnaser: nything showing on top?19:40
*** admin0 has joined #openstack-ansible19:41
*** pcaruana has joined #openstack-ansible20:33
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Bump rabbitmq & erlang versions  https://review.opendev.org/68161420:35
*** pcaruana has quit IRC20:40
*** radeks_ has quit IRC21:31
*** goldyfruit has quit IRC21:32
*** goldyfruit has joined #openstack-ansible21:38
*** cloudnull is now known as cloudnull-afk21:42
*** BjoernT has quit IRC22:02
*** shananigans has quit IRC22:08
openstackgerritCam J. Loader (cjloader) proposed openstack/openstack-ansible master: Update inventory group/user_secrets for inspector change in Ironic  https://review.opendev.org/68055322:23
*** markvoelker has quit IRC22:28
*** spatel has joined #openstack-ansible22:54
*** spatel has quit IRC22:58
*** macz has quit IRC23:02
*** openstackstatus has joined #openstack-ansible23:18
*** ChanServ sets mode: +v openstackstatus23:18
*** andrea15 has quit IRC23:25
*** andrea15 has joined #openstack-ansible23:26
*** gyee has quit IRC23:27
*** tosky has quit IRC23:30
*** andrea10 has joined #openstack-ansible23:35
*** andrea15 has quit IRC23:36
*** goldyfruit has quit IRC23:42
*** andrea10 has quit IRC23:45
*** markvoelker has joined #openstack-ansible23:48
*** andrea10 has joined #openstack-ansible23:55
*** gillesMo has quit IRC23:58
*** markvoelker has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!