Wednesday, 2019-06-26

*** spatel has joined #openstack-ansible00:08
*** ianychoi has quit IRC00:12
*** ianychoi has joined #openstack-ansible00:14
*** ansmith has quit IRC00:19
*** ianychoi has quit IRC00:20
*** ianychoi has joined #openstack-ansible00:21
*** ansmith has joined #openstack-ansible00:23
*** hamzy has joined #openstack-ansible00:27
*** ianychoi has quit IRC00:30
*** ianychoi has joined #openstack-ansible00:31
*** spatel has quit IRC00:34
*** ianychoi has quit IRC01:03
*** tureba has quit IRC01:04
*** ianychoi has joined #openstack-ansible01:04
*** ansmith has quit IRC01:07
logan-cyberpear: i don't think anyone implemented the ubuntu stig for ansible-hardening yet.01:10
*** spatel has joined #openstack-ansible01:30
*** spatel has quit IRC01:30
*** kplant has quit IRC01:52
*** ianychoi has quit IRC02:14
*** ianychoi has joined #openstack-ansible02:16
*** ianychoi has quit IRC02:38
*** ianychoi has joined #openstack-ansible02:40
*** udesale has joined #openstack-ansible03:51
*** rgogunskiy has joined #openstack-ansible03:52
*** raukadah is now known as chandankumar03:52
*** rgogunskiy has quit IRC03:56
*** joshualyle has joined #openstack-ansible04:09
*** viks___ has joined #openstack-ansible04:17
*** jhesketh has quit IRC04:19
*** jhesketh has joined #openstack-ansible04:19
*** dave-mccowan has quit IRC04:23
*** gshippey has quit IRC04:26
*** ivve has joined #openstack-ansible05:36
*** Adri2000 has quit IRC06:17
*** pcaruana has joined #openstack-ansible06:27
jrosserMorning06:29
*** ianychoi has quit IRC06:34
*** cshen has joined #openstack-ansible06:35
*** ianychoi has joined #openstack-ansible06:41
*** kopecmartin has joined #openstack-ansible06:43
*** luksky has joined #openstack-ansible06:45
*** rgogunskiy has joined #openstack-ansible07:12
*** rgogunskiy has quit IRC07:12
*** rgogunskiy has joined #openstack-ansible07:12
*** rgogunskiy has joined #openstack-ansible07:13
*** tosky has joined #openstack-ansible07:16
evrardjpmorning07:23
*** jsquare has quit IRC07:26
*** jsquare has joined #openstack-ansible07:28
*** ianychoi has quit IRC07:59
*** ianychoi has joined #openstack-ansible08:01
noonedeadpunkhi folks:)08:02
*** key-networks has joined #openstack-ansible08:09
*** rpittau|afk is now known as rpittau|mtg08:41
gillesMoHello ! Is there any plan to correct this bug https://bugs.launchpad.net/openstack-ansible/+bug/1807346 ? Ansible upgrade or not using os_* modules ?08:42
openstackLaunchpad bug 1807346 in openstack-ansible "[heat] Installations fails during Update Q->R" [Undecided,New] - Assigned to Guilherme Steinmuller Pimentel (guilhermesp)08:42
*** fnpanic has joined #openstack-ansible08:59
*** j^2 has joined #openstack-ansible09:04
*** ianychoi has quit IRC09:07
*** ianychoi has joined #openstack-ansible09:10
*** openstackgerrit has joined #openstack-ansible09:28
openstackgerritJJ Asghar proposed openstack/ansible-hardening master: Updated the Vagrantfile with more support  https://review.opendev.org/66756309:28
*** hamzaachi has joined #openstack-ansible09:35
*** fnpanic has quit IRC09:43
chandankumarlogan-: noonedeadpunk jrosser https://review.opendev.org/#/c/661994/11 it works fine on rhel-809:48
chandankumarit is good to go09:48
jrossergillesMo: i'm not sure what you mean by "correct this bug", we fix the ansible version to whatever is current during the development cycle of a particular release of OSA09:54
jrosserit is very difficult to retrospectively upgrade the version as it has large implications for deployers who integrate with other systems09:54
jrosserit is really an ansible bug and the relevant fixes need to be backported to the required version of ansible09:55
*** vnogin has joined #openstack-ansible09:55
jrossergillesMo: are you able to propose a backport to ansible 2.6 as described here? https://github.com/ansible/ansible/pull/42899#issuecomment-44578722610:00
gillesMojrosser: I understand, so it'sd perhaps easier to revert the changes in os_heat to not use ansible modules until openstack-ansible use a corrected version of Ansible10:06
jrossergillesMo: that would also be possible, yes10:07
jrosserif you are able to test such a change that would be very helpful10:07
gillesMobackport to Ansible 2.6 ? My current Rocky deployment use Ansible 2.5.1410:08
jrosseroh right of course :/10:08
jrosserhmm10:08
*** ansmith has joined #openstack-ansible10:13
*** ansmith has quit IRC10:27
*** luksky has quit IRC10:28
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Install user supplied CA certificates into system trust store  https://review.opendev.org/64144510:35
*** vnogin has quit IRC10:42
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Install user supplied CA certificates into system trust store  https://review.opendev.org/64144510:42
CeeMacgood day10:55
*** luksky has joined #openstack-ansible10:58
*** cshen has quit IRC11:05
*** tosky has quit IRC11:15
*** tosky has joined #openstack-ansible11:16
*** kplant has joined #openstack-ansible11:16
*** cshen has joined #openstack-ansible11:21
*** fnpanic has joined #openstack-ansible11:22
*** ianychoi has quit IRC11:40
*** ianychoi has joined #openstack-ansible11:45
*** ivve has quit IRC11:51
*** udesale has quit IRC11:51
*** udesale has joined #openstack-ansible11:52
guilhermespmornings!11:53
*** tuxjohnson has joined #openstack-ansible11:58
*** vnogin has joined #openstack-ansible11:58
*** luksky has quit IRC12:02
*** luksky has joined #openstack-ansible12:03
*** vnogin has quit IRC12:03
*** tuxjohnson has quit IRC12:10
*** ianychoi has quit IRC12:14
*** ianychoi has joined #openstack-ansible12:22
*** martinkennelly has joined #openstack-ansible12:23
kaiokmomorning guilhermesp12:31
jrosseranyone around who understands nested virt / kvm vs. qemu better than i do? mnaser? there is something wierd like that breaking our octavia tests12:35
mnaserjrosser: linksies?12:35
jrossersure, one moment12:35
*** tuxjohnson has joined #openstack-ansible12:36
*** tuxjohnson has left #openstack-ansible12:36
jrossermnaser: http://logs.openstack.org/51/664551/1/check/openstack-ansible-deploy-aio_metal_octavia-ubuntu-bionic/e374421/logs/openstack/aio1-nova/nova-compute.log.txt.gz#_2019-06-11_22_28_21_36112:36
*** vnogin has joined #openstack-ansible12:37
*** ansmith has joined #openstack-ansible12:38
*** fnpanic has quit IRC12:39
jrosserwe've been running AIO+octavia here on bionic bare metal this week, thats all working fine12:40
jrosseralso any reviews on this - https://review.opendev.org/#/c/667150/ horizon is br0k on master right now, but passing tests :/12:42
*** vnogin has quit IRC12:42
*** gkadam has joined #openstack-ansible12:43
kplantjrosser: not a resources issue? 2019-06-11T22:28:20.871535Z qemu-system-x86_64: cannot set up guest memory 'pc.ram': Cannot allocate memory12:48
jrosserkplant: ooooh!12:48
jrosserkplant: i may have paid too much attention to qemu-system-x86_64: warning: TCG doesn't support requested feature: CPUID.01H:ECX.vmx [bit 5]12:49
kplantyeah that is a lot scarier looking for sure12:50
kplantbut usually that can be safely ignored, especially on nested virt12:50
*** dave-mccowan has joined #openstack-ansible12:51
kplanthad to look it up but it means you don't support LZCNT opcode12:52
johnsomjrosser: that vmx warning is normal, it is the “cannot allocate memory” error that is the fatal error.13:14
jrosserjohnsom: i was just looking at reducing the amount of ram we use13:15
jrosserjohnsom: is there a smaller value we can pick here? https://github.com/openstack/openstack-ansible-os_octavia/blob/master/defaults/main.yml#L26413:15
johnsomqemu does some probes to see if certain cpu features are present. That is the vmx message.13:15
johnsomTechnically yes, if you aren’t loading the lb or adding a lot of listeners, you can cut that in half. But for practical use, you really should have at least 1gb13:16
johnsomI.e. if you cut that, only do it for your gate job, not that default.13:17
jrosserjohnsom: sure - i can override that just for the AIO / gate jobs13:19
johnsomAlso, we are switching ubuntu kernels real soon now that should save some ram. It saves ~200MB in the qcow2 alone.13:19
johnsomIt removes a ton of kernel modules we don’t need.13:20
johnsomFYI, https://review.opendev.org/#/c/66586113:27
*** key-networks has quit IRC13:27
johnsomand https://review.opendev.org/66606313:28
*** spatel has joined #openstack-ansible13:31
*** spatel has quit IRC13:36
CeeMacquick question, the os_<project> roles, they're kept in their own repos outside of openstack-ansible?  So I needed to change the content of a file in one of the roles in line with a patch im writing for osa how does one acheive this?13:43
CeeMactl;dr - halp!13:43
guilhermespCeeMac: I think you can just go to /etc/ansible/roles/os_<project> and checkout your patch13:44
CeeMacguilhermesp: I'm not sure I follow.  If you look at etherpad I shared with you, the first step requires modifying the os_glance default/main.yml13:47
CeeMacbut atm i'm checked out branch in openstack-ansible, which is where the rest of the changes need to be made.  Do I need to submit seperate patches? One for the role and one for osa?13:48
CeeMacI'm still trying to get to grips with the development side of things....13:48
*** af_tim has joined #openstack-ansible13:48
guilhermespwell CeeMac if you need to make changes in roles, just submit patches for these roles. the main osa repo, which we call integrated repo, is only repsonsible to evoke the roles and do all the deployment. So if you made a patch for os_glance and want to test it in an aio locally, you can just checkout your patch in the role and you're ready to go13:51
guilhermespnot sure if is clear for you now, let me know13:51
CeeMacguilhermesp: i think that makes sense.  So, If I checkout the os_glance role, make the necessary changes and submit that, linked to the bug. then I can checkout osa, make the required modifications to complete the fix and submit that, linked to the same bug? does that make sense?13:54
guilhermespoh wait... are you willing to go in the glance role and develop things there, submit a patch and etc? If that's the case, you can do it anywhere, just clone the role anywhere, configure your git review and submit the patch so we can review it :)13:57
*** vnogin has joined #openstack-ansible14:00
CeeMacguilhermesp: tbh I'm not sure what i'm doing at all, haha.  I'm trying to convert that etherpad into "make it work in master"14:04
guilhermespso CeeMac you want to submit patches fixing the things for the involved roles right? like os_glance14:05
CeeMacbtw this for the glance cinder store issue we were working on.  olso.rootwrap needs deploying as part of the glance role deployment so I need to tweak a couple of files in there, then everything else is deployment changes14:06
CeeMacguilhermesp: correct14:06
guilhermespso basically just clone the os_<project> anywhere. Configure your git to be able to submit the patch ( I think spotz has a pdf showing how to do it )14:07
* jrosser fixes his magnum deploy, *again* https://media.giphy.com/media/jqOiGF0SHLI9G/giphy.gif14:07
guilhermesphahahah jrosser what is the issue now?14:08
jrossersome new brokennes this time in magnum for S14:08
jrosserusual internal vs. external keystone endpoint confusion14:08
guilhermespoh boy.... I think we have magnum deployed with S, do we mnaser ?14:09
spotzguilhermesp: I have a whole pdf slide deck:)14:10
CeeMacguilhermesp: presumably I only need to configure git once for gerrit?  I did that from https://docs.openstack.org/infra/manual/developers.html14:10
CeeMacspotz: Hi!  Would appreciate any help/info/brain uploads anyone can provide :D14:11
guilhermespbasically CeeMac but I think spotz 's pdfs are more comprehensive14:11
CeeMaci like comprehensive14:11
CeeMaccomprehensive is good14:11
guilhermesp:P14:12
CeeMacdont want to break anything :S14:12
guilhermespi think this is a nice opportunity for you to start contributing14:12
jrosserguilhermesp: all this stuff is very confusing  https://review.opendev.org/#/c/583745/14:12
guilhermespit is nice, you'll see14:12
jrossertheres an internal<>external endpoint swap in there14:13
spotzCeeMac: this was the last version of it https://github.com/spotz/berlin18/blob/master/gitandgerrit.pdf. The session wasn't held in Denver14:13
guilhermesphuum jrosser I think mnaser can explain better then me the reason for that swap14:14
CeeMacthanks spotz :D14:14
spotzCeeMac: NP it was a fun session to present, I miss it14:15
guilhermespis magnum having trouble to access the internal endpoint jrosser ?14:15
jrosserit appears to be using the external one, when it shouldnt14:15
jrosser*trying to use14:15
jrossertime to dig in the code and see whats going on14:16
jrosserthis feels very similar to our troubles with heat14:16
guilhermespyeah smells like14:16
CeeMacspotz: seems file is corrupt?14:18
spotzCeeMac: might be too big, the vancouver one works https://github.com/spotz/vancouver18/blob/master/gitandgerrit.pdf14:19
CeeMacspotz: thats better, thanks14:21
spotzCeeMac: no worries:)14:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Reduce the RAM allocation for the octavia amphora flavor in AIO/CI  https://review.opendev.org/66763314:26
*** Original_ElGuapo has quit IRC14:33
guilhermespjrosser: is this related to the latest failures with ocatavia role? ^14:33
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Remove deprecated and incorrect config from magnum.conf  https://review.opendev.org/66763614:36
jrosserguilhermesp: yes I think that is why octavia fails on bionic CI14:37
jrosserand also there seems to be wierdness in our magnum.conf too https://review.opendev.org/66763614:37
*** ansmith_ has joined #openstack-ansible14:38
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_octavia master: db_setup: refactor database setup to a common file  https://review.opendev.org/66488814:40
*** ansmith has quit IRC14:40
*** luksky has quit IRC14:43
guilhermespI think I might add as depends-on of one of my octavia patches14:44
guilhermespyeah I was just looking at your magnum pr14:44
jrosserguilhermesp: bad news :( undoing this https://review.opendev.org/#/c/583745/ makes it all work again14:46
guilhermespuoww... should it be bad or good news? :P14:47
jrosserwell good news in that it works again!14:47
jrosserbad news in that it's down the wormhole again with how all this keystone stuff is handled14:48
guilhermespheheheh I'm not sure if mnaser 's patch was something that worked for us then we submitted the patch...14:48
jrosseri am just totally not liking how www_authenticate_uri works across all of this stuff14:50
jrosserthe documentation for that from keystone middleware is ambiguous, because it talks about "client" without specifying the context of the client, i.e internal vs. external14:52
jrosserthen the same boilerplate text is in all of the service config files "Complete "public" Identity API endpoint. This endpoint should not be an "admin" endpoint, as it should be accessible by all end users."14:53
jrosserand yet it just doesnt seem to work that way14:53
*** cshen has quit IRC14:54
johnsomjrosser FYI, if you have a minute, I have this open: https://review.opendev.org/#/c/648744/ but I don't have the cycles to track down how it needs to be adjusted. If you are motivated, I would be happy to have your help in getting that cleaned up.15:00
* jrosser looks15:00
*** asettle is now known as asettle-PTO15:03
johnsomIt's a straight forward fix, but the context switching to how OSA needs it is a bit rough for me sometimes. I'm sure Jesse is right in his comment, it's just the amount of time it would take me to figure it out and the bugs I have in flight in Octavia itself keep dropping it's priority on my list.15:03
jrosserjohnsom: no worries i will try to look, we're in the middle of doing an octaiva deployment on the lab which is why i'm fiddling with all this now15:05
johnsomOk, thanks for the help.15:05
*** hamzaachi_ has joined #openstack-ansible15:14
*** hamzaachi has quit IRC15:16
*** ansmith has joined #openstack-ansible15:17
*** ansmith_ has quit IRC15:19
*** jamesdenton has joined #openstack-ansible15:29
*** rgogunskiy has quit IRC15:31
*** tosky has quit IRC15:37
*** hamzaachi_ has quit IRC15:37
*** vnogin has quit IRC15:52
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Ensure that admin endpoint is used to configure octavia quota  https://review.opendev.org/66455116:42
*** jsquare has quit IRC16:53
dirkmnaser: is it okay to drop ubuntu-xenial in OSA?16:53
*** jsquare has joined #openstack-ansible16:53
dirkhttps://review.opendev.org/#/c/666272/2 is failing for many weeks already due to xenial-ssl, which doesn't seem that anyone is still fixing16:54
openstackgerritDirk Mueller proposed openstack/openstack-ansible-galera_server master: Fix galera_server installation for openSUSE Leap 15.1  https://review.opendev.org/66627217:00
openstackgerritDirk Mueller proposed openstack/openstack-ansible-galera_server master: Remove xenial-ssl  https://review.opendev.org/66768217:00
openstackgerritDirk Mueller proposed openstack/openstack-ansible-galera_server master: Replace opensuse 42.3 functional testing with opensuse-15  https://review.opendev.org/66768317:00
*** martinkennelly has quit IRC17:07
jrosserdirk: anything xenial on OSA master should be switched to bionic17:08
dirkthere are already passing + voting bionic jobs17:09
dirkits just that the xenial job is broken and prevents anything from merging17:09
dirkI suggested https://review.opendev.org/#/c/667682 above to get rid of it17:09
*** zbr|ruck is now known as zbr17:18
*** weifan has joined #openstack-ansible17:19
*** spatel has joined #openstack-ansible17:21
*** hamzaachi has joined #openstack-ansible17:22
*** kopecmartin is now known as kopecmartin|off17:24
*** luksky has joined #openstack-ansible17:29
*** udesale has quit IRC17:29
*** gkadam has quit IRC17:30
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Only install py3 version of libapache2-mod-wsgi for ubuntu distro installs  https://review.opendev.org/66715017:33
*** gkadam has joined #openstack-ansible17:35
spatelI have Stupid question, I have two openstack cloud isolated, and both pointing to same ceph storage with same account and key password. in this case if i upload image to A cloud does that will be visible in cloud B?17:35
mgariepysounds like a really bad plan IMO.17:41
mgariepythe answer would be no since glance won't scan the backend for images, the image needs to be pushed by glance.17:42
mgariepyspatel, why not creating pools for each deployment instead of sharing the sames ?17:43
spatelmgariepy: got you point.. i was just trying to understand how does that work, why do we need to create two pool, why not share?17:44
mgariepybecause you are not sure the uuids won't be the same.17:45
mgariepyand just to save you some trouble donw the line.17:46
spatelhmm got it.. i will create second pool now17:46
mgariepywould you install 2 pc on the same rootfs ?17:46
spatelmgariepy: never.. just trying to understand what could go wrong17:46
*** jamesdenton has quit IRC17:49
*** miouge36 has joined #openstack-ansible17:49
*** zerick_ has joined #openstack-ansible17:50
CeeMacquick question. technically is 'master' still equating with stein from a release perspective?17:53
*** miouge3 has quit IRC17:53
*** zerick has quit IRC17:53
jrosserCeeMac: master will become Train at the point that branch is created17:53
CeeMacbut from a 'current' release perspective, specifically in the os_* roles, which version is master 'now'?  I'm trying to pull the correct oslo.rootwrap for glance and I'm not sure whether to use the stein or train one....17:53
*** altlogbot_0 has quit IRC17:55
jrosserCeeMac: there is no train version, just master and the stable/<blah> branches17:56
*** altlogbot_0 has joined #openstack-ansible17:56
*** jamesdenton has joined #openstack-ansible17:56
CeeMacjrosser: thats what I'm struggling with.17:56
jrosserexplain a bit more?17:57
*** altlogbot_0 has quit IRC17:57
CeeMacI'm trying to write a patch for glance.  It was easy for rocky when I was doing in my env.  But to submit a patch i need to do it against master. However, if master isn't Stein, and it isnt Train, which olso.rootwrap version do I code into the requirements.txt?17:57
CeeMacthere is a specific version difference between the 217:58
*** altlogbot_2 has joined #openstack-ansible17:58
logan-CeeMac: the version of requirements we use in master will determine that17:58
logan-https://github.com/openstack/openstack-ansible/blob/82e853ce73973db6b7b1eb8df94107950105da8a/playbooks/defaults/repo_packages/openstack_services.yml#L3417:58
CeeMaclogan-: you mean based on the SHA of the role?17:59
logan-no, i mean if you install master right now, you will get the version of oslo.policy that is determined by the upper-constraints in the requirements repo18:00
logan-and requirements is pinned to that sha18:00
logan-so the version of oslo.policy you get is https://opendev.org/openstack/requirements/src/commit/47979b8d9080b529152a985820d3615e754e9c4a/upper-constraints.txt#L54918:00
CeeMacits oslo.rootwrap i'm after though18:00
logan-ok, then https://opendev.org/openstack/requirements/src/commit/47979b8d9080b529152a985820d3615e754e9c4a/upper-constraints.txt#L49418:01
logan-same thing18:01
CeeMacgot it18:01
logan-you're still pulling your constraints from requirements18:01
*** weifan has quit IRC18:01
CeeMacgreat18:01
CeeMaci couldn't find it in there for rocky18:01
*** weifan has joined #openstack-ansible18:01
*** altlogbot_2 has quit IRC18:01
CeeMacor i was looking in the wrong place, so i wrote it into doc/requirements.tx of os_glance18:01
*** weifan has quit IRC18:01
*** weifan has joined #openstack-ansible18:02
CeeMacif its in the upper-constraints then I don't need to do that bit, just add it to the pip packages18:02
CeeMacthanks :)18:02
*** altlogbot_3 has joined #openstack-ansible18:02
logan-no prob18:02
CeeMacas a random aside, how do i stop opendev.org displaying in chinese by default? :S18:02
CeeMacpoint of clarity on convention, after I've modified some files should i manually 'git add' them, or just git commit -a at the end? the developer guide seems to indicate the latter, but just wanted to double check.  logan- jrosser ?18:09
jrosserIt’s a stylistic thing to a degree18:11
jrosserIf you’re confident you are not adding a ton of other crap on top of your actual change then -a18:11
CeeMacwell, confident seems like quite a strong word at this point18:11
* CeeMac stoked beard thoughtfully18:12
CeeMaci'll go with 'add' and see how i get on18:12
jrosserBut I pretty much always git add <blah>, or even git add -p <blah> for partially adding changed things18:12
jrosser-p is very cool18:12
CeeMactell me more about this -p18:12
jrosserYou can add changes to the index chunk by chunk in an interactive way18:13
jrosserPer file18:13
jrosserSo if you’ve done a big edit it’s easy to make a few commits out of it18:13
CeeMacooohhhh kaaaaaay so maybe I'll ask you about that a bit more in the future18:14
* CeeMac backs away slowly18:14
jrossergit diff —cached is your friend too to look at the current state of the index18:14
CeeMaci don't think I'll be needing that for a while, lol18:14
*** weifan has quit IRC18:15
*** weifan has joined #openstack-ansible18:16
*** weifan has quit IRC18:20
CeeMacjrosser: running unit-testing is a pre-req to submitting a review?18:30
jrosserCeeMac: no18:31
CeeMacoh, good, because i don't have that setup on my laptop where I've writing the patch18:32
openstackgerritDirk Mueller proposed openstack/openstack-ansible master: Add aio_metal and aio_distro_metal openSUSE 15 jobs  https://review.opendev.org/66605818:36
openstackgerritCraig McIntyre proposed openstack/openstack-ansible-os_glance master: Add oslo.rootwrap to glance_pip_packages  https://review.opendev.org/66770418:40
CeeMacis there a(n easy) way to make it so that you don't have to put your SSH key in multiple times after git review?18:40
jrosserssh-agent18:42
CeeMacack18:44
*** ivve has joined #openstack-ansible18:45
CeeMaci missed something, i can just add the other files and git -amend?  then 'git review' again?18:47
*** hwoarang has quit IRC19:03
jrosserSure, git add / git commit —amend / git review will do the trick19:03
*** hwoarang has joined #openstack-ansible19:04
openstackgerritCraig McIntyre proposed openstack/openstack-ansible-os_glance master: Add missing pre-reqs for glance cinder store  https://review.opendev.org/66770419:12
CeeMacok, think I'm done19:12
CeeMac^that should match with my notes here https://etherpad.openstack.org/p/LEnPABy7Um19:13
CeeMacguilhermesp: fyi19:13
*** hamzaachi has quit IRC19:20
mgariepyanyone here is using keystone endpoint group filter ?19:21
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Reduce the RAM allocation for the octavia amphora flavor in AIO/CI  https://review.opendev.org/66763319:22
jrossermgariepy: no - but i would like to know how to19:23
spatelHow do i disable SSL option here? http://paste.openstack.org/show/753464/19:24
chandankumarnoonedeadpunk: jrosser here is the logs from rhel-8 run https://logs.rdoproject.org/17/171117/24/check/tripleo-ci-rhel-8-standalone-rhos-15/c8690fb/job-output.txt.gz19:24
spatelmgariepy: do you know how i can turn off SSL during image upload https://github.com/openstack/openstack-ansible-os_octavia/blame/dcdeb98468161402a3585990704749b40cac8ed2/tasks/octavia_amp_image.yml#L7119:28
mgariepyspatel,  https://github.com/openstack/openstack-ansible-openstack_openrc/blob/master/templates/clouds.yaml.j2#L19 set openrc_insecure: true19:31
spatelI do have that setting already..19:32
jrosserchandankumar: that is excellent19:33
mgariepyspatel, is the correct setting in the cloud.yaml ?19:33
spatelmgariepy: this is what it looks like on my machine http://paste.openstack.org/show/753465/19:34
mgariepyspatel, in /root/ what's the content of the actual file and not the ansible template19:34
*** weifan has joined #openstack-ansible19:35
*** weifan has quit IRC19:35
*** weifan has joined #openstack-ansible19:35
spatelmgariepy: this is what it looks in /root/openrc http://paste.openstack.org/show/753466/19:36
spatelits pointing to http://  not SSL19:37
*** kplant has quit IRC19:37
mgariepyspatel, openstack endpoint list ?19:37
mgariepyif your catalog refer to ssl endpoint that's what it's going to contact19:37
*** hamzaachi has joined #openstack-ansible19:38
spatelmgariepy: http://paste.openstack.org/show/753467/19:39
*** martinkennelly has joined #openstack-ansible19:39
mgariepyyou have a bunch of https:10.30.xx in there.19:39
martinkennellyjrosser, you were right my bug was coming ansible_default_ipv4.interface. thank you.19:40
spateloctavia uploading image to glance which is https://19:40
jrossermartinkennelly: oh great - i'm sure someone else had the same19:40
spatel10.30.x.x is my public facing VIP19:40
mgariepyyour public interface are all https.19:40
jrossermartinkennelly: do you know why it happened?19:40
spatelmgariepy: is there any temporary way i can say ignore SSL handshake validation or upload image?19:41
martinkennellyjrosser: Just going about findout out why. Will update bug report if I find something.19:41
mgariepyfrom the openrc you pasted the  openrc_insecure: true  is not set.19:41
spatelcurrently i am stuck at that point :(19:41
mgariepyor was set after the file has been generated19:41
jrossermartinkennelly: great thanks, we may be able to fix it, or insert an asset that fails early if something is wrong. i was wondering if there is a situation where the ansible facts have not been gathered19:42
spatelyou are saying if i set openrc_insecure: true in /root/openrc that will fix this issue right?19:42
spatelmgariepy: ^19:42
martinkennellyjrosser: It maybe a bug in how I setup my system, and maybe not something on OS ansible's end, but good to know anyway.19:43
martinkennellyjrosser: it was a clean ubuntu 18.04 both times fyi.19:43
jrossermartinkennelly: sure - i'm quite sure you are not the first with this issue though19:43
jrosseri'm always suspicious of netplan in these situations too :)19:44
mgariepyspatel, i think the client uses cloud.yaml instead.19:45
*** altlogbot_3 has quit IRC19:45
mgariepybut you will need to set the correct args in the file so it's not validating the cert.19:46
*** altlogbot_3 has joined #openstack-ansible19:46
spatelmgariepy: what option i have to hack it and move forward ?19:46
martinkennellyjrosser: I executed ansible all -i localhost, -m setup -c local, and I can see ansible_default_ipv4 is populated and has an interface19:46
mgariepyedit the file i guess19:46
spatelon deployment node right?19:47
mgariepyi think it's in this container: ostack-infra-2-3_octavia_server_container-e804ce0b19:47
spatelin that container there is no openrc file in /root director19:48
mgariepyis there a clouds.yaml file ?19:48
spatelin that container /root is empty19:49
spatelI believe that TASK is running on deployment node to load Octavia image..19:49
jrossermartinkennelly: and before you did that is was not populated?19:50
martinkennellyjrosser: I did it after bootstrapping-aio.sh was run ONLY19:51
jrosserbootstrap-ansible.sh before that?19:51
martinkennellyjrosser: however if i rerun bootstrapping-aio.sh it fails with same error19:51
martinkennellyjrosser: yes19:51
martinkennellyjrosser: remember it works if i revert back a previous openstack version.19:52
jrossermartinkennelly: right - but that will change the major release of ansible which may be a factor19:53
martinkennellyjrosser: so maybe the difference how they get the interface between the two releases will help guide me.19:53
spatelmgariepy: hmm its good question where that playbook is running?19:55
jrossermartinkennelly: so here is where we gather facts after all the networking is set up on an AIO https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/tasks/prepare_networking.yml#L19719:55
jrossernot sure i can see anywhere that is explicitly done up front though19:56
chandankumarcloudnull: https://review.opendev.org/#/c/661994/ please have a look when free logs attached in comments19:56
martinkennellyjrosser: I do not follow. How is this related? Thank you.19:57
jrosserwell, the place that you get the error is here https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/tasks/prepare_networking.yml#L17319:58
jrosserwhich is just before that fact gathering19:58
chandankumarcloudnull: thanks!19:59
jrosserso it is possible that in your configuration we should be also doing the same facts gathering before the place your error occurs, to ensure that ansible_default_ipv4 is always populated before it is used19:59
martinkennellyjrosser: Want me to try?20:00
jrossersure,  you could copy those lines earlier in that file, and give it a whirl20:00
martinkennellyjrosser: no luck20:04
jrossermartinkennelly: do you have a default route?20:05
martinkennellyjrosser: yes, ip r confirms this for me.20:06
guilhermespnice patach CeeMac ! Can you please fix our comments?20:06
martinkennellyjrosser: I will ask the ansible people and see if they know anything. thank you again20:08
jrossermartinkennelly: i did find this https://github.com/ansible/ansible/issues/2005120:08
jrosserbut if you have a default route then it can't be that20:08
jrossermartinkennelly: omg https://github.com/ansible/ansible/blob/devel/lib/ansible/module_utils/facts/network/linux.py#L71-L7220:10
martinkennellyjrosser: :)20:11
*** af_tim has quit IRC20:13
martinkennellyjrosser: can you run that comment ip -4 route get 8.8.8.8  on your machine and show me your output20:13
*** altlogbot_3 has quit IRC20:15
jrossermartinkennelly: http://paste.openstack.org/show/753468/20:17
*** altlogbot_0 has joined #openstack-ansible20:18
spatelexport LC_ALL=C.UTF-8  its throwing error like "sh: warning: setlocale: LC_ALL: cannot change locale (C.UTF-8)"20:21
spatelDo i need that option in openrc file?20:22
martinkennellyjrosser: Nothing to take from this. All normal.20:22
spatelany idea what is going on here http://paste.openstack.org/show/753469/20:28
jrossermartinkennelly: how very odd indeed20:29
martinkennellyjrosser: As I said earlier when I run "ansible all -i localhost, -m setup -c local" I can see the correct default ipv4 interface. How can I run this command with openstack-ansible20:32
*** hamzaachi has quit IRC20:36
jrossermartinkennelly: that is exactly what is happening here https://github.com/openstack/openstack-ansible/blob/82e853ce73973db6b7b1eb8df94107950105da8a/tests/roles/bootstrap-host/tasks/prepare_networking.yml#L19720:36
CeeMacguilhermesp: thanks, sure I'll take a look at doing that tomorrow20:37
jrosser-m setup is the 'ah-hoc' way of running the setup module directly from the command line20:37
jrosserwhen you tried it you did redo boostrap-aio.sh ?20:37
martinkennellyno, i did not redo bootstrap-aio.sh.20:38
*** kplant has joined #openstack-ansible20:38
martinkennellysorry, I did redo bootstrap-aio.sh, nothing changed, i still got the error.20:40
jrosseri'm quite stumped here really, we do actually gather facts here right at the start of bootstrap-aio https://github.com/openstack/openstack-ansible/blob/master/tests/bootstrap-aio.yml#L1820:42
*** hamzaachi has joined #openstack-ansible20:42
jrosserlogan-: do you have any idea about this ^^ undefined ansible_default_ipv4?20:43
*** altlogbot_0 has quit IRC20:43
*** altlogbot_2 has joined #openstack-ansible20:44
logan-maybe delete cached facts or pastebin the cached fact file for that host20:45
logan-in case that hasn't been suggested yet, haven't read much backscroll20:45
logan-martinkennelly: does your ad-hoc setup command work without '-c local'?20:46
logan-martinkennelly: actually, if you go into the osa playbooks directory and run ansible, it will use the osa inventory, so could you cd to that dir and run "ansible localhost -m setup"20:47
*** spatel has quit IRC20:52
*** ansmith has quit IRC20:57
*** altlogbot_2 has quit IRC21:00
*** tosky has joined #openstack-ansible21:02
*** altlogbot_2 has joined #openstack-ansible21:04
CeeMacguilhermesp: just a quick question, to fix your comments I  would update the files / git add / git commit --amend / git review again?21:05
CeeMacjrosser: same question :)21:05
*** pcaruana has quit IRC21:05
guilhermespbasically you just go where you were editing the files and do it the workflow as you mentioned. If you don't have the repo anymore, you just clone it again, go to the top corner of you patch and download your changes21:07
*** ivve has quit IRC21:07
*** hamzaachi has quit IRC21:08
*** martinkennelly has quit IRC21:09
CeeMacOk thanks, will do in workflow, repo clone and local branch is still on my laptop21:18
CeeMacShould I be concerned about those zuul failures?21:18
*** ianychoi has quit IRC21:23
*** ianychoi has joined #openstack-ansible21:28
*** hamzaachi has joined #openstack-ansible21:40
CeeMacErm. What do I need to do to submit my replies to comments on the review? /noobquestions21:44
CeeMacguilhermesp: ^21:51
CeeMacnvm, found the 'reply' button....22:04
mnaserjrosser: i think we are running out of memory in the octavia gate22:09
mnaserjrosser: http://logs.openstack.org/51/664551/1/check/openstack-ansible-deploy-aio_metal_octavia-ubuntu-bionic/e374421/logs/openstack/instance-info/free_22-28-08.log.txt.gz22:09
mnaser260mb free.. that will do it22:09
mnaserguilhermesp, jrosser: yeah we do run stein magnum.. idk.22:10
johnsommnaser He posted a patch to drop the per-amp memory for the gates as your tests don't really stress the amp (not a lot of listeners, etc.).  https://review.opendev.org/66763322:11
mnaserdirk: yes, no xenial jobs should exist at this point in master22:11
johnsomAh, you found it.22:12
mnaserCeeMac: awesome first contribution!!! let me know if you need help cleaning it up too :)22:13
mnaser:)22:14
mnaseri was going through queue22:14
mnaserlol22:14
*** weifan has quit IRC22:15
*** luksky has quit IRC22:16
CeeMacthanks mnaser , will do.22:17
CeeMaconce i get this one through, I think I have a couple more to submit soon :)22:18
kplantmnaser: you run a pretty large os deployment with a ceph backend right?22:19
*** ansmith has joined #openstack-ansible22:20
*** weifan has joined #openstack-ansible22:29
*** hamzaachi has quit IRC22:38
mnaserkplant: yessir22:38
mnasera few22:38
kplantmind me asking how you manage qos with cinder? front-end qos seems very lack luster to me22:43
kplantonce you drop front-end qos on a volume there's no more online retyping, per-gb-qos doesn't react to extending volumes until you detach/reattach22:43
*** schwicht has joined #openstack-ansible22:48
openstackgerritMerged openstack/openstack-ansible-openstack_hosts stable/stein: Use stein RDO release repo  https://review.opendev.org/66518922:48
*** schwicht has quit IRC22:50
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_horizon stable/stein: Fix distro installs on Ubuntu  https://review.opendev.org/66469623:04
*** tosky has quit IRC23:12
openstackgerritMerged openstack/openstack-ansible-galera_server master: Remove xenial-ssl  https://review.opendev.org/66768223:42
openstackgerritMerged openstack/openstack-ansible-galera_server master: Fix galera_server installation for openSUSE Leap 15.1  https://review.opendev.org/66627223:42
*** weifan has quit IRC23:57
*** hwoarang has quit IRC23:57
*** hwoarang has joined #openstack-ansible23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!