Friday, 2019-08-02

« Thursday, 2019-08-01 Index Saturday, 2019-08-03 »
*** goldyfruit has joined #openstack-kolla00:40
*** happyhemant has quit IRC00:59
*** kevinz has joined #openstack-kolla01:05
*** Wasaac has joined #openstack-kolla01:39
*** Wasaac has quit IRC01:44
*** nafiux has quit IRC01:48
openstackgerritChason Chan proposed openstack/kolla-ansible master: Remove unnecessary option from group_vars/all.yml  https://review.opendev.org/67415002:07
*** dpawlik has quit IRC03:04
*** Wasaac has joined #openstack-kolla03:40
*** Wasaac has quit IRC03:45
*** gkadam has joined #openstack-kolla03:49
*** NOXOiD has joined #openstack-kolla04:17
*** kevinz has quit IRC04:24
*** whoami-rajat has joined #openstack-kolla04:34
*** kevinz has joined #openstack-kolla04:37
*** Luzi has joined #openstack-kolla05:05
*** kevinz has quit IRC05:23
*** Wasaac has joined #openstack-kolla05:41
*** Wasaac has quit IRC05:45
*** shyamb has joined #openstack-kolla05:51
mnasiadkamorning05:58
mnasiadkayoctozepto: looking at zuul output I think we have more issues :D05:59
*** janki has joined #openstack-kolla06:04
*** kevinz has joined #openstack-kolla06:06
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241606:19
yoctozeptomorning06:20
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241606:20
yoctozeptomnasiadka: yeah, as if I broke something again06:21
mnasiadkayoctozepto: that's not hard :)06:21
*** shyam89 has joined #openstack-kolla06:26
*** shyamb has quit IRC06:27
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: ceph: fixes to deployment and upgrade  https://review.opendev.org/67316506:28
yoctozeptomnasiadka: yeah, I make this one mistake quite often, this is what you get from language-jumping06:29
*** shyam89 has quit IRC06:33
*** shyam89 has joined #openstack-kolla06:34
*** janki has quit IRC06:34
*** janki has joined #openstack-kolla06:35
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241606:35
mnasiadkayoctozepto: well, I'm in poorly written python department now, and a change that has a circular dependency, so first I need to write a workaround :D06:36
mnasiadkayoctozepto: not even mentioning ages old Ansible version, where changes between 2.2 (or whatever is in toolbox now) and 2.8 are gigantic, even in AnsibleModule...06:37
*** shyam89 has quit IRC06:37
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241606:38
*** shyam89 has joined #openstack-kolla06:38
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Do not require EPEL repo on RHEL-based target hosts  https://review.opendev.org/67411406:38
*** shyam89 has quit IRC06:40
yoctozeptomnasiadka: yeah, it sucks :/06:41
*** shyam89 has joined #openstack-kolla06:41
yoctozeptoas for circular stuff, there is some haproxy change that needs circular dep atm because tests will fail either in k or k-a06:41
yoctozeptowill need to take a look at how to amend this situation06:42
*** shyam89 has quit IRC06:42
*** shyam89 has joined #openstack-kolla06:43
mnasiadkayoctozepto: disable CI :D06:44
*** shyam89 has quit IRC06:44
*** shyam89 has joined #openstack-kolla06:44
*** shyam89 has quit IRC06:45
*** shyam89 has joined #openstack-kolla06:45
yoctozeptomnasiadka: and then re-enable in a subsequent change? shame on you ;p06:52
*** kdean has quit IRC06:56
openstackgerritRadosław Piliszek proposed openstack/kolla master: DNM: test dropping epel repo  https://review.opendev.org/67412306:56
mnasiadkayoctozepto: sometimes there is no other option :)06:57
yoctozeptomnasiadka: in the meantime though:07:02
yoctozeptohttps://review.opendev.org/67332007:02
yoctozeptohttps://review.opendev.org/67408807:02
yoctozepto(the 2nd will be proposed back to stein too to be consistent)07:02
mnasiadkarolling\07:03
mnasiadkathanks for cherry picking my own change ;)07:03
yoctozeptomnasiadka: yw, it's a good change ;-)07:05
yoctozeptoone-char change that repairs world07:05
openstackgerritYang Youseok proposed openstack/kolla-ansible master: Use explicit import for python3 in horizon local_settings  https://review.opendev.org/67420907:08
mnasiadkahaha07:11
*** shyam89 has quit IRC07:13
*** redrobot has quit IRC07:17
*** Wasaac has joined #openstack-kolla07:30
*** shyamb has joined #openstack-kolla07:34
*** janki has quit IRC07:43
*** gfidente has joined #openstack-kolla07:45
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241607:53
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241607:53
*** shyamb has quit IRC07:59
stingrayzamorning folks08:03
openstackgerritMerged openstack/kolla-ansible stable/stein: Add 'allow *' to getting ceph mds keyring  https://review.opendev.org/67332008:10
openstackgerritMerged openstack/kolla master: ceph mds cap 'allow *' in extend_start  https://review.opendev.org/67408808:12
hrwmorning08:13
*** k_mouza has joined #openstack-kolla08:18
*** lemko has joined #openstack-kolla08:24
openstackgerritRadosław Piliszek proposed openstack/kolla stable/stein: ceph mds cap 'allow *' in extend_start  https://review.opendev.org/67422208:28
yoctozepto^ let's merge08:29
*** Wasaac has quit IRC08:34
mnasiadkaso... what do we plan to do with TRANSFORM_INVALID_GROUP_CHARS?08:40
*** shyamb has joined #openstack-kolla08:41
mnasiadka(in ansible 2.10 they will kick us in the groin, and we will need to override it in ansible.cfg or environment...)08:42
hrwhm. which order does ansible runs rules?08:42
hrwbaremetal/post-install has 'configure docker service' and then 'restart docker'. first one creates /etc/docker/daemon.json file and registers 'docker_configured' variable. then 'restart docker' runs when that var change.08:44
hrwthat's theory. in practise it complains that var was not registered08:44
hrwand after check I see that configure part was not run08:45
hrwnvm08:49
shyambHi08:50
shyambI am facing this issue: https://bugs.launchpad.net/bugs/179781408:51
openstackLaunchpad bug 1797814 in kolla-ansible rocky "Keystone register.yml task errors during deploy on existing environment" [Medium,In progress] - Assigned to Mark Goddard (mgoddard)08:51
hrwfound why.08:51
shyambon rocky deployment using kolla ansible08:51
shyambAny way, I can apply the patch?08:51
shyambI see it's fixed in 'Train' release08:52
shyambI need same fix in rocky08:52
hrwshyamb: you can request backport08:54
hrwshyamb: just give either commitID or link to gerrit08:54
*** chrizl has quit IRC08:54
shyambhrw: Fix to rocky release is already in progress state08:55
shyambI need to apply patch on my lab08:56
shyambI installed kolla-ansible 6.0.0 using pip08:56
shyambnow, is it possible to apply the patch over it?08:56
hrwyoctozepto: https://review.opendev.org/#/q/I82d30f3fcf325a3fdff3c59f19a1f88055b566cc08:57
hrwshyamb: fetch git tree from gerrit and then 'pip install .' will update kolla-ansible for you08:58
yoctozeptomnasiadka: re: invalid group chars - with mgoddard we came to conclusion  it would be best to set up upper limit on ansible if they do make the change09:01
mnasiadkayoctozepto: we don't need to make upper limit, we can define the option in ansible.cfg/environment now, and forget about it09:02
yoctozeptomnasiadka: then let's do09:02
shyambhrw: thanks09:03
shyambI will try09:03
mnasiadkaI hate the slowness of CentOS...09:04
mnasiadkacan we just dump it? :)09:04
yoctozeptomnasiadka: no, I like its stability, but it makes me mad it is sooo slow too ;/09:09
mnasiadkayoctozepto: maybe it will get better with 8...09:09
yoctozeptomnasiadka: I seriously hope so09:11
yoctozeptoI also read about rhel8 docker images available for free09:11
yoctozeptowe could try building on that09:11
yoctozeptoof course ton of packages will not match09:11
hrwyoctozepto: I prefer to wait for centos:8 image09:14
hrwyoctozepto: we have lot of other things to worry in meantime09:14
*** chrizl has joined #openstack-kolla09:16
mnasiadkalet's wait for centos, leave rhel for redhat ;)09:16
mnasiadkain the meantime, it seems the Ansible bump up change in kolla-toolbox is nearly ready for reviews09:16
yoctozeptohrw: yeah, it was a loose proposal ;-)09:17
yoctozeptomnasiadka: yay, congrats09:17
openstackgerritMatthias Runge proposed openstack/kolla master: Add collectd-sensubility to the image  https://review.opendev.org/67254709:18
mnasiadkayoctozepto: it's just beginning of a series of changes, I would really love to get rid of kolla_keystone_* modules and use os_keystone_*09:18
yoctozeptomnasiadka, hrw: what do you think about supporting debian for x86_64? as hrw already tries supporting it for arm6409:18
hrwyoctozepto: adding CI would be good move09:19
mnasiadkayoctozepto: I'm all in - as long as somebody cares after it :)09:20
hrwmnasiadka: have you thought about dropping versions for everything != ansible in kolla-toolbox and just use upper-constraints to take care of versions used?09:20
hrwyoctozepto: but debian/source only09:21
yoctozeptomnasiadka: hopefully "all in" means you would like to participate in support09:21
yoctozepto;-)09:21
mnasiadkahrw: I thought, but yoctozepto has some other feelings about it :)09:21
yoctozeptohrw: yeah, I don't like binary ones, source makes us have more control09:21
hrwok09:21
hrwyoctozepto: debian/binary is not supported09:21
yoctozeptomnasiadka: do I now?09:21
mnasiadkahttps://review.opendev.org/#/c/642416/09:21
yoctozepto:D09:21
mnasiadkayoctozepto: so, do we constrain versions of shade, python-openstackclient and os-client-config, or not?09:22
mnasiadka(shade should be gone this dev cycle, so it's irrelevant)09:22
mnasiadkaand  they are pinned to newest versions already09:22
yoctozeptoI wanted to constrain09:22
yoctozeptoand hrw wants to constrain too09:22
yoctozeptobut using upper-reqs09:23
yoctozeptowhich makes total sense to me09:23
yoctozeptoand I agree :D09:23
hrwso we will not have to update versions each release09:23
mnasiadkaso let's use uppper-reqs, let me rework the Dockerfile09:23
yoctozeptoexactly09:23
yoctozeptocool09:23
mnasiadkanow that it works, it's a cosmetic change ;)09:23
yoctozeptomnasiadka: yeah and then it fails :D09:24
mnasiadkayoctozepto: if it doesn't, then I'll be cursed and damned :)09:24
yoctozeptomnasiadka: or blessed; depends on who asks09:24
mgoddard\o09:25
hrwhttps://paste.fedoraproject.org/paste/Ldl63ivorsk9iVplXePONQ - kolla-build-debian-source CI job09:25
*** ksdean has joined #openstack-kolla09:25
mnasiadkahi mgoddard09:26
hrwmgoddard: elo09:26
mnasiadkayoctozepto: yeah, I'll wait for the upgrade job, and then change :D09:26
hrwmgoddard: how's kid?09:26
mgoddardsleeping :)09:26
mnasiadkamgoddard: so you should be sleeping too :D09:26
mgoddardwe had an 'early' hearing test at the hospital09:26
mgoddardfirst time trying to get out of the house at a reasonable time09:26
yoctozeptohi mgoddard09:26
hrwmgoddard: hearing tests are important09:27
mgoddardI'll be doing a few hours each day until Wednesday09:27
yoctozeptogreat to hear :D09:27
hrwmgoddard: thanks09:27
mgoddardhrw: yeah, he passed. Had some mucus on the first test which made it fail but now all good09:27
yoctozepto(pun intended)09:27
mgoddardnice09:28
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241609:28
mnasiadkaok, constraints=true and let's see09:28
hrwmnasiadka: wrong install_pip call ;D09:29
mnasiadkaoh hell09:29
hrwmnasiadka: virtualenv iirc is not in constraints09:29
yoctozeptohaha09:29
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241609:30
mnasiadkanow I found the correct bastard09:30
yoctozepto<hrw> https://paste.fedoraproject.org/paste/Ldl63ivorsk9iVplXePONQ - kolla-build-debian-source CI job09:30
yoctozeptopropose it09:30
hrwyoctozepto: will do in a moment09:30
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Add Debian/source CI job  https://review.opendev.org/67424009:31
hrwlet's see how it go09:31
*** k_mouza has quit IRC09:32
yoctozeptowill require ansible job for sure09:32
yoctozeptohmm and nodeset is missing09:33
hrwnoted09:33
yoctozeptodoes infra keep it?09:33
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Add Debian/source CI job  https://review.opendev.org/67424009:33
hrwone %s too less09:33
openstackgerritChason Chan proposed openstack/kolla-ansible master: ubuntu: update configuration Stein UCA  https://review.opendev.org/67424109:34
yoctozeptohrw: da fsck is debian bionic09:34
hrwyoctozepto: one :%s too less09:34
hrw:%s/ubuntu/debian :%s/bionic/buster09:35
*** Wasaac has joined #openstack-kolla09:35
yoctozeptobut you just changed buster to bionic now09:35
yoctozeptoah, no09:35
yoctozeptodang gerrit09:35
yoctozeptoreversed diff09:35
hrwkolla-build-debian-source (non-voting) QUEUED09:36
yoctozeptoit showed me backwards diff, cool it can09:36
yoctozeptoyay09:36
yoctozeptolet it build, let it build09:36
yoctozepto(you know the music)09:36
yoctozepto;D09:36
yoctozeptomnasiadka: should not you unpin the versions now though?09:38
hrwjust wrote a comment about it09:38
mnasiadkayoctozepto: yeah, will do that in a minute09:38
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241609:39
hrwone day I may understood that whole mess called multinode09:39
hrwkolla_internal_vip_address: "10.101.26.12"09:40
hrw"ERROR 2003 (HY000): Can't connect to MySQL server on '10.101.26.12' (111 \"Connection refused\")"09:40
mnasiadkakeepalived doesn't like you? :)09:41
hrwok, turned out that haproxy was disabled. redeploying09:41
mnasiadkayeah, so keepalived as well09:41
yoctozeptomnasiadka: slapped only cosmetic comments09:42
yoctozeptomnasiadka: refused means the address was taken but nothing was listening09:42
yoctozeptoso more likely keepalived w/o haproxy09:42
yoctozepto;D09:42
yoctozeptono keepalived more likely with timeout stuff09:43
hrwfun.09:44
*** k_mouza has joined #openstack-kolla09:44
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241609:45
mnasiadkayoctozepto: happy now? :)09:45
*** ksdean has quit IRC09:46
hrwmnasiadka: I am not09:46
mnasiadkahrw: so edit the commit message by yourself :D09:47
hrwmnasiadka: we are not GNU project to write 'I set a to 5' commit messages ;D09:47
yoctozeptomnasiadka: you are my hero09:47
hrwwill docommment09:47
yoctozeptohrw: no, we are not09:47
yoctozeptobut reasoning is important09:48
yoctozeptoit is far from gnu comment ;p09:48
yoctozepto"Add endpoint_type as a param in kolla_keystone_service - now AnsibleModule requires all options to be defined, otherwise it throws an UnsupportedParameter error" <- this is valuable09:48
yoctozeptoslap that w+1 and let us be done with it09:49
hrwmnasiadka: commented09:51
mnasiadkahrw: good, now let's allow Zuul to check if upper-constraints work properly, and then we can masturbate on the commit message :)09:52
hrw;D09:52
yoctozeptomnasiadka: https://review.opendev.org/673165 - gonna be one red again due to mariadb, let's not postpone this devil further09:53
hrwmnasiadka: 'setting no_log=true' is quite close to 'umba umba um' if you are not aware of ansible update changes09:53
openstackgerritMerged openstack/kolla-ansible stable/queens: During deploy, always sync DB  https://review.opendev.org/67054909:55
yoctozepto^ and rocky fails because of nova09:55
mnasiadkaERROR: Could not open requirements file: [Errno 2] No such file or directory: '/requirements/upper-constraints.txt'10:08
mnasiadkagah10:08
*** gfidente has quit IRC10:09
yoctozeptoyeah, requirements are addded in openstack-base10:12
hrwops10:13
*** priteau has joined #openstack-kolla10:13
yoctozeptoalways more fun10:13
yoctozepto;D10:13
hrwfun?10:17
hrwDHCPOFFER of 10.101.16.1 from 10.101.1.110:17
hrwDHCPREQUEST for 10.101.16.1 on eth0 to 255.255.255.255 port 6710:17
hrwDHCPNAK from 10.101.1.110:17
hrwthis is fun10:17
hrwminutes of it is fun10:17
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Add Debian/source CI job  https://review.opendev.org/67424010:18
yoctozeptoyeah, looks like DHCP server is a joker10:19
yoctozepto;D10:19
hrwhave to learn a habit of running tox before git review10:19
yoctozeptohrw: yeah, git review should have a hook for pep8 tox10:24
openstackgerritMark Goddard proposed x/kayobe master: Generate openrc files during control host bootstrap  https://review.opendev.org/66745110:25
*** kevinz has quit IRC10:27
*** shyamb has quit IRC10:32
yoctozeptohrw:10:40
yoctozeptoE: Failed to fetch http://mirror.ord.rax.opendev.org/debian/dists/buster-backports/main/source/Sources  404  Not Found [IP: 2001:4801:7824:103:be76:4eff:fe10:9c2 80]10:40
yoctozeptoE: Failed to fetch http://mirror.ord.rax.opendev.org/debian/dists/buster-updates/main/source/Sources  404  Not Found [IP: 2001:4801:7824:103:be76:4eff:fe10:9c2 80]10:40
hrwyoctozepto: aware10:41
hrwbuster is too fresh for infra still10:41
hrwhave workaround for it10:48
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Add Debian/source CI job  https://review.opendev.org/67424010:49
*** ksdean has joined #openstack-kolla10:50
openstackgerritMark Goddard proposed x/kayobe stable/rocky: Ignore --limit for localhost plays  https://review.opendev.org/67426210:52
*** gfidente has joined #openstack-kolla10:54
*** shyamb has joined #openstack-kolla11:01
openstackgerritMark Goddard proposed openstack/kolla stable/stein: Update build profiles for Placement split  https://review.opendev.org/67426411:01
*** kevinz has joined #openstack-kolla11:02
openstackgerritMerged openstack/kolla stable/stein: ceph mds cap 'allow *' in extend_start  https://review.opendev.org/67422211:04
openstackgerritRadosław Piliszek proposed openstack/kolla stable/rocky: Update build profiles for Placement split  https://review.opendev.org/67426511:05
openstackgerritRadosław Piliszek proposed openstack/kolla stable/queens: Update build profiles for Placement split  https://review.opendev.org/67426611:05
hrwyoctozepto: read my comment in 'debian ci' patch about tools/*11:06
yoctozeptohrw: missed that11:07
hrwnp11:07
hrwis haproxy/keepalived required for multinode?11:08
hrwnvm. disabled11:09
yoctozeptohrw: nope, we test it without11:09
yoctozeptobut it makes no practical sense11:09
hrwtired of fighting with lab networking11:10
*** ksdean has quit IRC11:10
yoctozeptohuh, it should work fine on labbed virtual network11:10
openstackgerritMark Goddard proposed x/kayobe master: Use new kolla-ansible upgrade-bifrost command  https://review.opendev.org/66763211:10
openstackgerritMark Goddard proposed x/kayobe master: Revert "Workaround: stop bifrost services before seed upgrade"  https://review.opendev.org/66888811:10
hrwyoctozepto: when I said that our lab is sane?11:11
*** ksdean has joined #openstack-kolla11:11
yoctozeptonever11:11
yoctozeptohrw is working in an insane lab, checked11:11
*** kplant has joined #openstack-kolla11:12
hrwyoctozepto: when aarch64 servers get below 500$ I will consider buying in-home lab11:12
hrwbut it means 'never'11:12
yoctozeptomnasiadka, mgoddard: https://review.opendev.org/673165 < w+1 - tired of red centos ceph on master11:12
yoctozeptohrw: we were interested in some arm64 stuff for experiments11:13
yoctozeptodo you have a link to some arm64 server vendors?11:13
mnasiadkayoctozepto: fire in the hole11:14
hrwyoctozepto: this week I am against that part of market11:14
yoctozeptohrw: why is that?11:14
yoctozeptomnasiadka: thanks :D11:14
hrwyoctozepto: pissed off a bit too much at some stuff11:15
yoctozeptoyeah, probably did not like their floating point rounding when they calculated your payroll :-(11:16
*** Wasaac has quit IRC11:16
*** Wasaac_ has joined #openstack-kolla11:16
hrwyoctozepto: eons pass before my payroll will be calculated on aarch6411:17
*** kevinz has quit IRC11:19
*** kevinz has joined #openstack-kolla11:21
*** zbr has quit IRC11:25
openstackgerritWill Szumski proposed x/kayobe master: Build placement images by default  https://review.opendev.org/67147811:26
mgoddardsorry yoctozepto, added some comments to your patch re bootstrap-servers11:28
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/rocky: Fix ironic inspector iPXE boot with UEFI  https://review.opendev.org/67142111:31
yoctozeptomgoddard: np, those are valid comments11:34
yoctozeptook, reality is that11:35
yoctozeptoceph-nfs did not work11:35
yoctozeptonobody installed it and got it working11:35
yoctozeptothe ganesha issue will probably be gone at some point, especially if we move to ceph-ansible and care not about ceph here11:36
yoctozeptoi'm ok with removing the stuff from docs at all11:36
yoctozeptothe rpcbind can be backported to stein to fix ceph-nfs and the upgrade does not need to install it11:37
yoctozeptomgoddard, mnasiadka: ^ your thoughts11:37
*** hamzaachi has joined #openstack-kolla11:40
*** hamzaachi has quit IRC11:44
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241611:46
mnasiadkayoctozepto: upgrade installs that, because we added that to the ceph CI, it's not that it will happen on all operators systems :)11:47
mnasiadkamgoddard, yoctozepto: second thing is, why would re-bootstrapping restart docker? only in cases where we changed kolla.conf (or however it's called now), right?11:48
hrwmnasiadka: yes11:49
hrwmnasiadka: if we reconfigure docker then we restart11:49
yoctozeptothen ppl should not reconfigure docker if they do not wish that to happen to them11:51
hrwyoctozepto: https://review.opendev.org/#/c/672700 got reply to your comment11:51
openstackgerritMerged x/kayobe master: Bump version of stackhpc.dell-powerconnect-switch  https://review.opendev.org/67292011:51
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/stein: ceph-nfs: Add rpcbind to Ubuntu host bootstrap  https://review.opendev.org/67427911:52
yoctozepto^ this a valid fix anyway11:52
yoctozeptohrw: replied back11:56
*** rpittau|afk is now known as rpittau11:56
mnasiadkayoctozepto: well, question is do we really need MountFlags=shared still11:56
mnasiadkayoctozepto: I remember Docker CE 19.x doesn't have that setting anymore or something11:56
*** Wasaac_ has quit IRC11:57
yoctozeptomnasiadka: I have no idea, this was something obscure around neutron if you google it11:57
*** Wasaac has joined #openstack-kolla11:57
yoctozeptoI doubt it is relevant either11:57
yoctozeptothe issue in there is that CI does some json tweaking atm so it collides with the k-a doing things11:57
yoctozeptothe sharedflags probably can be gone11:57
hrwmnasiadka: https://review.opendev.org/672701 moves us to 18.09 from distros11:58
mnasiadkayoctozepto: I see, neutron-dhcp-agent11:58
mnasiadkahrw: in debian/ubuntu world probably it makes sense, but in CentOS it's either problematic 1.13.1 or using docker-ce11:59
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: On Debian/Ubuntu systems install Docker from distribution  https://review.opendev.org/67270111:59
hrwmnasiadka: on CentOS it has to be docker-ce then12:00
yoctozeptomnasiadka: depends on how problematic 1.13.1 is too12:00
yoctozeptomaybe it works fine12:00
hrwmnasiadka: <18.xx I think we should not support even12:00
mnasiadkayoctozepto: I had some problems with 1.13.1 at some point in time12:00
yoctozeptoand we are erratic12:00
mnasiadkayoctozepto: problem is RedHat's versioning of docker 1.13.x is complicated :D12:00
yoctozeptoyeah, but they even moved to overlay212:00
yoctozeptoexactly12:00
yoctozeptothey backport a lot12:00
mnasiadkayoctozepto: either way - in CentOS 8 there will be no docker12:01
mnasiadkayoctozepto: so either we install docker-ce, or go podman12:01
hrwdocker-ce during train12:02
yoctozeptomnasiadka: good point, docker-ce for T then12:05
yoctozeptohappy with that12:05
*** redrobot has joined #openstack-kolla12:07
openstackgerritPierre Riteau proposed x/kayobe master: Stop allocating network and broadcast addresses  https://review.opendev.org/67231712:07
openstackgerritPierre Riteau proposed x/kayobe master: Stop allocating network and broadcast addresses  https://review.opendev.org/67231712:08
openstackgerritPierre Riteau proposed x/kayobe master: Remove storage management network from controllers  https://review.opendev.org/67248212:17
openstackgerritMerged x/kayobe master: Fix parsing of etc/kayobe/ceph.yml with no variables defined  https://review.opendev.org/67131612:19
*** Luzi has quit IRC12:21
*** dpawlik has joined #openstack-kolla12:25
*** gkadam has quit IRC12:26
*** priteau has quit IRC12:28
*** shyamb has quit IRC12:32
*** zbr has joined #openstack-kolla12:36
*** kevinz has quit IRC12:36
*** shyamb has joined #openstack-kolla12:37
*** kevinz has joined #openstack-kolla12:39
hrwhate RETRY_LIMIT stuff on ci12:41
openstackgerritPierre Riteau proposed x/kayobe master: Fix typo in upgrade documentation  https://review.opendev.org/67429612:43
*** shyamb has quit IRC12:43
*** shyamb has joined #openstack-kolla12:44
shyambHi12:49
shyambkolla-ansible prechecks12:49
shyambfailing12:49
shyamb"kolla ansible Could not resolve hostname neutron: Name or service not known"12:49
shyambMy deployment is done12:50
shyambI changed some configuration12:50
shyamband trying redployment12:50
*** k_mouza has quit IRC12:50
shyambnow I am getting this error12:51
shyambsomething wrong with inventory or hosts file12:51
hrwI use fqdn in inventory12:52
*** kevinz has quit IRC12:54
openstackgerritMichal Nasiadka proposed openstack/kolla master: Bump up pkg versions in kolla-toolbox  https://review.opendev.org/64241613:01
kplanti'm getting some build errors, before i dig in further is my approach correct? kolla-build -b centos -t source --registry 127.0.0.1:4000 --push --tag stein13:05
kplantjust trying to build all containers from source for centos and push to my local registry13:05
hrwkplant: https://github.com/hrw/docker-utils/blob/master/kolla-build-images.sh is a script I use (with local checkout of kolla git)13:06
hrwkplant: "kolla-build-images.sh centos source '--push --registry 127.0.0.1:4000' namespacename"13:06
hrwkplant: but if you plan to deploy from this registry then use external IP rather than localhost13:07
kplanti do but only to localhost, i'm just playing with an aio13:08
hrwah. k13:08
kplantappreciate it!13:08
hrwwith 5 machines I build on fastest, keep registry on 1, do multinode on 2,3,413:09
*** priteau has joined #openstack-kolla13:10
kplantshould i be using a different tag than stein?13:10
hrwkplant: for local build it does not matter13:12
hrwkplant: as long as you remember which of tags you use13:12
hrwI once used mmddx where x was bumped on each rebuild due to some patching13:13
hrwremoving 1500 images took a while then13:13
kplantoh i should building without tags and then pulling from the registry with the tag?13:17
*** k_mouza has joined #openstack-kolla13:18
hrwkplant: tag is always added13:19
hrwkplant: if you do not give own then numberic one is used13:20
hrwINFO:kolla.common.utils.nova-compute:Successfully tagged 10.101.16.1:5000/haerwu/ubuntu-source-nova-compute:8.1.013:20
hrwregistry/namespace/imagename:tag13:21
*** happyhemant has joined #openstack-kolla13:21
*** BjoernT has joined #openstack-kolla13:22
*** k_mouza has quit IRC13:24
kplantso i don't want to build from master13:24
kplanti want to build from stable/stein13:25
*** goldyfruit has quit IRC13:25
*** goldyfruit has joined #openstack-kolla13:25
*** BjoernT_ has joined #openstack-kolla13:25
*** k_mouza has joined #openstack-kolla13:26
*** BjoernT has quit IRC13:27
hrwkplant: whatever branch, building is same ;d13:27
kplantooooooooo13:28
kplanti was over complicating it13:28
kplantty13:29
openstackgerritMerged openstack/kolla-ansible stable/rocky: During deploy, always sync DB  https://review.opendev.org/67054813:29
kplantstill getting checksum errors when building >_<13:29
kplantlet me paste13:29
kplanthttp://paste.openstack.org/show/755331/13:30
kplantyeah i guess that url isn't valid13:31
kplantThe requested URL /sites/ftp.apache.org/storm/apache-storm-1.2.2/apache-storm-1.2.2.tar.gz was not found on this server.13:31
*** dciabrin__ is now known as dciabrin13:31
priteaukplant: this is an issue that has been fixed recently13:31
priteauhttps://review.opendev.org/#/q/c73815347e2e6a456c29dc1f6d93d7ed5c8f7c5913:32
priteauMake sure to pull the latest stable/stein13:32
*** hamzaachi has joined #openstack-kolla13:32
hrwshyamb: fix for you got merged.13:33
shyambgreat13:33
shyambI applied on my local lab using patch13:33
shyambit worked fine13:33
shyambhrw: thanks for the update13:33
kplantpriteau: thank you, i'm using pypi... i'll switch over to git13:33
hrwshyamb: thx for reminding13:34
hrwsomeone remembers policy for minor releases? 8.0.1 etc13:34
priteauhrw: A general OpenStack policy, or something specific to Kolla?13:38
hrwrocky was ~every 3 months13:38
hrwwhich is enough info for me ;D13:38
priteauIf there's a build issue, rather than minor bugfix, I think this would warrant an 8.0.1 release13:39
shyambHi13:39
shyambI see keystone endpoints not getting updated one re-deployment13:39
shyambOn initial deployment, I had not enabled tls on endpoints13:40
shyambon redeployment, I enabled tls on external interface using globals.yaml13:40
shyambit has enabled ssl on public for all services except keystone13:41
shyambKind of bug?13:41
shyambShould I clean the keystone endpoints and retry deployment?13:43
*** ivve has joined #openstack-kolla13:43
priteaushyamb: it's a known issue. You can update your endpoint manually.13:43
shyambIf I delete endpoints and redeploy, they should get created correctly13:44
shyambpriteau:13:45
shyambIt might be a ansible issue13:46
priteaushyamb: I assume you're using rocky or earlier?13:48
shyambit's rocky13:48
priteauThis should fix it, but is only in stein: https://review.opendev.org/#/c/557639/13:49
hrwWARNING: It seems /dev/sda is marked to be wiped and partitioned for Ceph data and13:50
hrw         a co-located journal, but appears to contain other existing partitions (>1).13:50
hrwceph can not be deployed on single partition? :(13:50
shyambpriteu: ok13:51
yoctozeptohrw: it's not recommended by ceph13:53
yoctozeptohence probably noy13:53
hrwmeh.13:53
shyambpriteau: I will patch my kolla13:53
hrwthose are one disk machines which can not have more13:53
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible stable/rocky: Ensure keystone endpoint is updatable  https://review.opendev.org/67431613:54
yoctozeptohrw: re: RETRY_LIMIT - this is badly named 'PRE_FAILURE'13:54
hrwyoctozepto: yep13:54
yoctozeptoconfused me in the beginning13:54
* hrw -> looking where to buy some working phone :(13:55
priteauhrw: use LVM volumes?13:55
yoctozeptohrw: my nokia 5 does well, despite mnasiadka's black PR ;p13:55
hrwpriteau: that's an option ;D13:55
hrwyoctozepto: I want snapdragon 855.13:56
yoctozeptoah13:56
hrwtmux-xpanes++13:59
hrwdisabled ceph. easier14:06
*** k_mouza has quit IRC14:08
yoctozeptohrw: hahaha, though watch out for glance, make sure it uses the deployed one, I fixed that in CI14:08
*** k_mouza has joined #openstack-kolla14:13
*** shyamb has quit IRC14:13
*** shyamb has joined #openstack-kolla14:14
mgoddardmnasiadka: yoctozepto: docker upgrade also restarts docker14:30
yoctozeptomgoddard: we ain't no doing one14:30
yoctozeptoafaik14:30
mgoddardyoctozepto: well we switched from docker to docker CE14:31
yoctozeptowe only ensure docker package is installed14:31
mgoddardplus we don't control the version of the docker package14:31
yoctozeptoyeah but not stein->master14:31
yoctozeptofor me the best would be to drop ceph-nfs ;p14:32
yoctozeptoseriously, requiring rpcbind on host is passe14:32
*** gkadam has joined #openstack-kolla14:32
*** shyamb has quit IRC14:35
*** gkadam has quit IRC14:38
*** dpawlik has quit IRC14:38
hrwmgoddard: https://review.opendev.org/#/c/672701/ moves us to distro Docker14:45
hrwmgoddard: kind of 'let us go with LTS Docker'14:45
*** hamzaachi has quit IRC14:47
*** hamzaachi has joined #openstack-kolla14:48
*** goldyfruit has quit IRC14:50
hrwjust no idea why it failed on ceph14:52
yoctozeptohrw: because we have ceph all around failure for centos until we merge my pack of fixes14:54
openstackgerritMerged x/kayobe master: Build placement images by default  https://review.opendev.org/67147814:59
mnasiadkamgoddard: maybe live-restore is a solution? :)15:09
mnasiadkayoctozepto: nokia mobile phones are not nokia, hmd global is a separate entity and hires only a couple of people in Finland :)15:10
hrwDebian mirrors should be fixed later today ;D15:12
hrwinfra ones I mean15:12
*** gfidente has quit IRC15:17
stingrayzamnasiadka: out of interest, do you have anything to do with cloudband?15:20
mnasiadkastingrayza: I had, up to two days ago.15:20
stingrayzaah, right. our internal product guys are looking to interface with it - I'm telling them it's just openstack with a few tweaks...15:22
stingrayzawhere'd you move to?15:22
mnasiadkastingrayza: well, I could tell more about that ,,product'' :)15:22
mnasiadkastingrayza: now I work at StackHPC - well, barely started :)15:23
stingrayzamnasiadka: grats on the move - and it looks to be a good place to be, considering it's many of the actives around here ;)15:24
*** goldyfruit has joined #openstack-kolla15:31
*** factor has joined #openstack-kolla15:33
openstackgerritjacky06 proposed openstack/kolla-cli master: Move sphinx-build into tox  https://review.opendev.org/67387115:42
openstackgerritjacky06 proposed openstack/kolla-cli master: Move sphinx-build into tox  https://review.opendev.org/67387115:44
*** goldyfruit has quit IRC15:48
*** k_mouza_ has joined #openstack-kolla15:48
yoctozeptomnasiadka: https://review.opendev.org/67427915:49
mnasiadkayoctozepto: done15:50
yoctozeptothx15:50
*** k_mouza has quit IRC15:52
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/stein: Add ceph-mds/rgw/nfs to gate  https://review.opendev.org/67330215:52
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: ceph: fixes to deployment and upgrade  https://review.opendev.org/67316515:55
openstackgerritjacky06 proposed openstack/kolla-cli master: Add tox docs check into zuul  https://review.opendev.org/67433515:56
*** pcaruana has quit IRC16:14
openstackgerritMerged openstack/kolla-cli master: Move sphinx-build into tox  https://review.opendev.org/67387116:23
*** jbadiapa has quit IRC16:24
*** altlogbot_3 has quit IRC16:29
*** irclogbot_2 has quit IRC16:33
*** altlogbot_3 has joined #openstack-kolla16:36
*** irclogbot_2 has joined #openstack-kolla16:42
*** rpittau is now known as rpittau|afk16:46
*** k_mouza_ has quit IRC16:52
ksdeanDont know if anyone is still around16:56
ksdeanto remove a service can i just run reconfigure ?16:56
openstackgerritMerged openstack/kolla-ansible stable/stein: ceph-nfs: Add rpcbind to Ubuntu host bootstrap  https://review.opendev.org/67427917:03
openstackgerritMerged openstack/kolla-ansible stable/rocky: Ensure keystone endpoint is updatable  https://review.opendev.org/67431617:03
*** igordc has joined #openstack-kolla17:03
priteauksdean: I don't think that will remove the service. You may have to run `docker rm -f <service_container>` on hosts instead.17:03
ksdeanok cool17:03
ksdeanit will delete the endpoint however and remove the service from horizon ?17:03
priteauIt won't remove the endpoint either. But if you do it manually, Horizon should detect it and remove the panel.17:07
ksdeansweet thanks17:08
*** dougsz has joined #openstack-kolla17:12
*** dpawlik has joined #openstack-kolla17:19
*** openstackgerrit has quit IRC17:22
*** kplant has quit IRC17:28
*** priteau has quit IRC17:31
*** dougsz has quit IRC17:32
*** hamzaachi has quit IRC17:33
*** dpawlik has quit IRC17:34
*** ksdean has quit IRC17:35
*** kplant has joined #openstack-kolla17:42
*** rfolco|ruck has quit IRC17:42
*** goldyfruit has joined #openstack-kolla17:47
*** goldyfruit has quit IRC18:10
*** Wasaac has quit IRC18:10
*** goldyfruit has joined #openstack-kolla18:20
*** lemko has quit IRC18:23
*** goldyfruit has quit IRC18:26
*** hamzaachi has joined #openstack-kolla18:31
*** portdirect has quit IRC19:13
*** portdirect has joined #openstack-kolla19:13
*** dciabrin_ has joined #openstack-kolla19:32
*** dciabrin has quit IRC19:34
*** mgoddard has quit IRC19:37
*** dpawlik has joined #openstack-kolla19:37
*** mgoddard has joined #openstack-kolla19:38
*** Wasaac has joined #openstack-kolla19:39
*** irclogbot_2 has quit IRC19:39
*** irclogbot_0 has joined #openstack-kolla19:43
*** Wasaac has quit IRC19:44
*** goldyfruit has joined #openstack-kolla19:50
*** kplant has quit IRC20:00
*** whoami-rajat has quit IRC20:04
*** dpawlik has quit IRC20:19
*** dciabrin_ has quit IRC20:26
*** dciabrin_ has joined #openstack-kolla20:34
*** k_mouza has joined #openstack-kolla20:35
*** k_mouza has quit IRC20:40
*** ivve has quit IRC20:43
*** BjoernT_ has quit IRC21:09
*** dciabrin_ has quit IRC21:15
*** EmilienM is now known as EmilienM|afk21:28
*** EmilienM|afk is now known as EmilienM21:28
*** hamzaachi_ has joined #openstack-kolla21:54
*** hamzaachi has quit IRC21:57
*** jistr has quit IRC22:02
*** jistr has joined #openstack-kolla22:09
*** hamzaachi_ has quit IRC22:12
*** hamzaachi_ has joined #openstack-kolla22:13
*** jistr has quit IRC22:17
*** jistr has joined #openstack-kolla22:19
*** goldyfruit has quit IRC22:25
*** hamzaachi_ has quit IRC22:54
*** hamzaachi_ has joined #openstack-kolla22:54
*** hamzaachi_ has quit IRC23:09
*** Wasaac has joined #openstack-kolla23:40
*** Wasaac has quit IRC23:45
« Thursday, 2019-08-01 Index Saturday, 2019-08-03 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!