Wednesday, 2018-10-03

*** vnogin has joined #openstack-ansible00:01
*** vnogin has quit IRC00:06
*** markvoelker has quit IRC00:17
*** markvoelker has joined #openstack-ansible00:17
*** markvoelker has quit IRC00:21
*** gyee has quit IRC00:29
*** vnogin has joined #openstack-ansible00:31
*** vnogin has quit IRC00:35
*** vnogin has joined #openstack-ansible00:41
*** vnogin has quit IRC00:41
*** vnogin has joined #openstack-ansible00:51
*** vnogin has quit IRC00:56
*** macza has joined #openstack-ansible00:59
*** macza has quit IRC01:03
*** hamzy has joined #openstack-ansible01:12
*** ianychoi has quit IRC01:17
*** cshen has joined #openstack-ansible01:19
*** spatel has joined #openstack-ansible01:20
*** mmercer has quit IRC01:23
*** cshen has quit IRC01:23
*** ianychoi has joined #openstack-ansible01:28
cloudnullevenings01:41
*** ianychoi has quit IRC01:42
guilhermesphello cloudnull 🤘🏼01:42
cloudnullhey there !01:42
cloudnullhows it ?01:42
guilhermespallll good01:43
jamesdentonhey cloudnull - do we have netplan networking docs somewhere?01:47
cloudnullnot that i'm aware of01:47
cloudnullwe're not using any netplan01:47
cloudnullits all systemd-networkd across the board01:47
jamesdentonahh, ok01:48
cloudnullyou needing netplan or just playing with 1804?01:48
jamesdentonworking on an 1804 deploy, knew netplan replaced ifupdown, just couldn't remember if that was the way to go or not. evidently not! but, i have a working config.01:49
cloudnullif needed you can still install ifup/down01:49
cloudnullhowever the recommendation at this time is networkd which works across all of the distros we support01:50
jamesdentoni don't think i need it, honestly. ok, cool. i'll work with that01:51
cloudnullfor networkd i have lots of example config im happy to share if needed. we also have the systemd_networkd role which is useful to just composing the network you want and automating the deployment of it01:53
jamesdentoni'll take what you've got01:54
cloudnullhttps://github.com/openstack/ansible-role-systemd_networkd01:54
jamesdentongracias01:55
*** dave-mccowan has joined #openstack-ansible01:56
*** jbadiapa has quit IRC01:56
*** jbadiapa has joined #openstack-ansible01:58
openstackgerritMerged openstack/openstack-ansible stable/queens: Bump repo_server for latest P2Q upgrade fixes  https://review.openstack.org/60705701:58
*** vnogin has joined #openstack-ansible02:00
cloudnulljamesdenton https://gist.github.com/cloudnull/5e97eca762f210721cedd99adab46a2f02:01
cloudnullthats the running configs from one of my compute hosts with bonding02:02
jamesdentoneven better! thank you02:02
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Fixes too low security group rules quota  https://review.openstack.org/60082602:02
*** vnogin has quit IRC02:04
*** fatdragon has quit IRC02:10
*** tinwood has quit IRC02:10
cloudnulljamesdenton here's another one from my infra node which is bonded with DHCP https://gist.github.com/cloudnull/f38516639a31ef42b91fa3acbf7e28a002:10
jamesdentonnoted02:11
*** tinwood has joined #openstack-ansible02:11
jamesdentonwhere do these files sit? /etc/systemd/network?02:11
cloudnullyes02:12
jamesdentonk02:12
cloudnullif you feel like digging into it - https://www.freedesktop.org/software/systemd/man/systemd.network.html02:13
cloudnulllots of possibilities there02:13
cloudnullhttps://www.freedesktop.org/software/systemd/man/systemd.netdev.html02:13
jamesdentonoye02:13
cloudnullhttps://www.freedesktop.org/software/systemd/man/systemd.link.html02:13
jamesdentoni guess i should plan to get ahead of this, huh02:14
cloudnullthe role does most of what someone might want.02:17
openstackgerritAndriy Shevchenko proposed openstack/openstack-ansible-nspawn_hosts master: fix tox python3 overrides  https://review.openstack.org/60745002:17
cloudnullhowever there's a lot going on there.02:17
jamesdentonfair enough. suitable for bootstrapping networking of an environment in preparation of a deploy?02:18
*** markvoelker has joined #openstack-ansible02:18
*** ianychoi has joined #openstack-ansible02:19
cloudnullyes.02:19
cloudnullhttps://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/tasks/prepare_networking.yml#L16-L13702:20
cloudnullthats a pretty good example02:21
jamesdentonindeed. that's for an AIO, though?02:21
cloudnullif each host had a var for the different IPs you could probably just change the ip addresses to "{{ VAR_WHATEVER }}" and just use that.02:21
jamesdentonk02:21
cloudnullyes you'd want to convert the dummy addresses to the real eth device names02:22
openstackgerritMerged openstack/openstack-ansible stable/queens: Fix for proper package name depending on base OS distribution  https://review.openstack.org/60703502:23
cloudnullhere's a user config where i did just that https://gist.github.com/cloudnull/69bde16011d1ea94edf926252ea93933#file-openstack_user_config-yml02:23
jamesdentonoh man, you misspelled bridge. :P02:24
cloudnulland the playbook i used to deploy it https://gist.github.com/cloudnull/69bde16011d1ea94edf926252ea93933#file-playbook-networkd-host-interfaces-yml02:24
cloudnullmeh02:24
jamesdentonbookmarked. thanks for the tips.02:25
cloudnull++ have fun :)02:25
jamesdentonoh yeah :|02:25
cloudnulllet me know if you have questions, happy to help02:25
jamesdentonthanks :)02:25
cloudnullmy 2 lab environments are both using it, so far so good02:26
jamesdentonnice. i'm in the middle of this deploy with netplan and it's fine so far, but i will ultimately move to networkd. i'm trying to deploy a 1+3 setup with an lxb/sriov node, ovs node, and ovs+dpdk node. had it all working once, but needed to wipe and redeploy02:27
jamesdentonsome days i miss writing ACLs and iRules.02:28
jamesdenton'twas a simpler time02:29
cloudnullhahaha02:34
cloudnullany/any for the win!02:34
jamesdenton"It's temporary. Only for testing"02:34
cloudnullhahaha!02:35
*** shyamb has joined #openstack-ansible02:36
spateljamesdenton:  no luck so far02:38
jamesdentonyeah, i saw that. once i get mine in working order i'll take a look. right now i don't have any suggestions02:38
spateljamesdenton: i am curious how does that work in your environment02:38
jamesdentonwell, for one, i wasn't pinning, and two, i wasn't spinning up large instances02:39
spatelif it doesn't work then i am going to lose my 50% capacity :(02:39
jamesdentonnever tested beyond one numa node02:39
spatelI am not pinning also02:39
jamesdentonk02:39
spatelit feel like its a bug or some strange config issue...02:40
spatelI think i need to pick DPDK path if its not work out02:41
spatelnot sure how DPDK solve my issue but worth try02:41
jamesdentonnot sure that it will, honestly. these things sometimes take time to work through02:41
spatelhmm02:43
*** markvoelker has quit IRC02:51
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible master: Integrate Blazar with OpenStack Ansible  https://review.openstack.org/54995602:54
*** shyam89 has joined #openstack-ansible02:55
*** ram5391_ has joined #openstack-ansible02:58
*** shyamb has quit IRC02:59
jamesdentonspatel can you share your flavor/image details and method of creating the ports/instances? via pastebin02:59
spatelok02:59
ram5391_maybe stupid question, but doing a fresh .bootstrap-ansible.sh is yielding 404 errors on git clone using these urls: https://git.openstack.org/openstack/ansible-hardening03:00
ram5391_is there a known issue there?03:00
spateljamesdenton: http://paste.openstack.org/show/731314/03:04
ram5391_for clarification, that was on the stable/rocky branch03:04
jamesdentonthanks spatel. And the second instance you spin up: done the same way but with its own ports? same flavor/image?03:06
spatelyes just change name to sriov-vm-203:06
jamesdentonram5391_ not sure. Did one a few hours ago that was OK. Will have to defer03:06
spateleverytime it create new ports when i launch instance03:07
jamesdentonk03:07
spatelram5391_: I would say change URL to https://github.com/openstack/ansible-hardening03:07
spatelgithub.com is very reliable03:07
ram5391_spatel: seems like theres a config mismatch from the stable/rocky branch. Master is okay though03:08
jamesdentonspatel it will likely be tomorrow before i'm in a position to spin up instances. but I will try your method and let you know how i compare.03:08
*** dave-mccowan has quit IRC03:08
*** vnogin has joined #openstack-ansible03:09
spateljamesdenton: thanks! i am very curious03:09
spateljamesdenton: thanks for helping me with this :)03:09
jamesdentoni think i'm more surprised that your existing VM is being shutdown when the second comes up. I would just expect some kind of scheduling failure03:10
spatelvery few people here using these kind of technologies so hard to get help from community03:10
jamesdentonno problem. this issue is important to me. need to understand how it works and why it's happening03:10
jamesdentonwe're learning together!03:10
spateljamesdenton: sometime VM got shutdown and sometime it go to paused mode03:10
jamesdentonweirf03:11
jamesdenton*weird03:11
ram5391_jamesdenton: I'm coming up on this error trying to do a fresh install. Have you seen it before? http://paste.openstack.org/show/731316/03:11
spatelbut if i spin two vm with 8 vCPU and 8GB memory they works great03:11
spatelBecause in that case they stay in same numa node 003:12
jamesdentonram5391_ actually, yes, sort of. I had given the same IP to multiple hosts defined in openstack_user_config.yml03:12
cloudnullram5391_ i've only seen something like that when ... ^ jamesdenton beat me to it :)03:12
spatelas soon as they cross numa it start acting up...03:12
cloudnullo/ spatel03:12
ram5391_jamesdenton: cloudnull: so I'm deploying a _really_ small installation, headnode going to be doing all the fun stuff, how do I avoid that?03:13
jamesdentonram5391_ i would double check that file to make sure things are properly defined and parsed.03:13
ram5391_cloudnull: actually following your tutorial a bit03:13
spatelI am going to open bug anyway to see what folks thinking about this03:13
*** vnogin has quit IRC03:13
ram5391_jamesdenton: will do thanks, this is my config for reference: http://paste.openstack.org/show/731317/03:14
jamesdentonspatel go for it. i should be able to confirm soon enough. these are the G8s, right?03:14
spatelYes, HP DL360p G803:15
cloudnullram5391_ the issue is on line 125, storage1 doesn't have an ip03:15
jamesdenton^^03:15
jamesdentonThats why: KeyError: 'ip'.03:16
*** maddtux has joined #openstack-ansible03:16
ram5391_cloudnull: jamesdenton: *facepalm* thanks03:17
cloudnullno worries, it happens :)03:18
spateljamesdenton: this is interesting... i have spun 3 VM with 8vcp core and they works03:19
*** cshen has joined #openstack-ansible03:19
jamesdentonthese are 2x 8/16 CPUs?03:19
jamesdenton8c/16t03:20
spatelyou are talking about 3 VM ?03:20
spatelthey are 8vCPU / 8GB mem03:21
jamesdentonno, the computes. what are the CPU specs03:21
spatelCompute node has 32 Core / 32GB memory03:21
jamesdentonand can you run 'virsh vcpuinfo instance-XXXXXX' and report that back?03:21
spatellet me pastebin03:21
jamesdentoncloudnull what is the preference for rolling features on a per-OS basis... say, ubuntu, then centos, then suse, for example. Or is the expectation that all three be supported out of the gate?03:23
spateljamesdenton: here you go http://paste.openstack.org/show/731318/03:23
cloudnulljamesdenton i generally do ubuntu, suse, cent03:24
cloudnullhowever its kinda up to you03:24
*** cshen has quit IRC03:24
jamesdentoni guess the better question is.. do you merge the ubuntu patches, then go back and add support for the others?03:24
cloudnullyes03:24
jamesdentonk03:25
*** shyam89 has quit IRC03:25
cloudnulli'll just add a debug statement that says "not implemented yet..."03:25
cloudnullor something similar03:25
spateljamesdenton: my compute node CPU is Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz03:25
jamesdentonok cool03:25
jamesdentonspatel can you install numactl and report back: numactl --hardware03:26
spateljamesdenton: http://paste.openstack.org/show/731319/03:26
jamesdentondo you have hugepages reserved?03:27
spatelno03:28
spateli didn't configure that03:28
jamesdentonk03:28
spateli have tried that with 2M hugepages but same result so i have removed that option03:29
spatelas per result look like 8vCPU VMs works but 10vCPU vm doesn't work03:29
spatelthat is very strange..03:30
spatellet me try again and see.. 10vCPU VM03:30
jamesdentonbased on that vcpuinfo, it looks like the vcpus are bound to cores across both nodes, so that doesn't really appear to be an issue03:32
jamesdentonhow many vCPUs do you intend to assign to VMs on these nodes?03:33
spatelfor production application 15vCPU per VM (total 2VM)03:33
spatelmy application is CPU hungry VoIP realtime RTP stream03:34
spatelI am testing with 10vCPU lets see03:35
spatelThis is interesting when i launch with 10vCPU i get this error in nova.log --> No net device was found for VF 0000:03:09.7: PciDeviceNotFoundById: PCI device 0000:03:09.7 not found03:37
spatelvirsh list  shows VM is running but i can't get console :(03:37
*** shyam89 has joined #openstack-ansible03:37
spatelgoing to remove "hw:pci_numa_affinity_policy='preferred'" option and try03:38
jamesdentonk03:38
spatelGot this again - No net device was found for VF 0000:03:09.7: PciDeviceNotFoundById: PCI device 0000:03:09.7 not found03:40
spatelvm showing running but can't console it and ping it..03:41
spatellet me try 16vCPU and see03:41
spatellook like instance need to be correct vCPU combo03:41
openstackgerritKevin Carter (cloudnull) proposed openstack/ansible-role-python_venv_build master: Add the option to define pip index arguments  https://review.openstack.org/60745803:43
*** markvoelker has joined #openstack-ansible03:48
spateljamesdenton: ^^03:49
-spatel- 14 instance-000002a0 running03:49
-spatel- 15 instance-000002a3 running03:49
jamesdentonso 16 worked?03:49
spateli used 16vCP and 8GB memory and that works03:49
spatelbut if i try 10vCPU then it didn't work03:50
spatelvery odd03:50
spateli wonder if its related to Memory issue ?03:50
spatelyour memory need to be on same numa node ??03:50
spatellet me try more combination!03:51
* jamesdenton shrug03:51
spatelopenstack flavor create --id 19 --ram 10000 --vcpus 16 --disk 10 sriov-203:54
spatelin this case memory will go across numa lets see03:54
spateljamesdenton: so that works with 10G memory.. hmmm03:57
-spatel- 16 instance-000002a6 running03:57
-spatel- 17 instance-000002a9 running03:57
spatelboth VM up and pinging03:57
spatellet me try more combination03:57
jamesdentonnice03:58
spatelgoing to try 15vCPU and 14G mem03:59
jamesdentonhave you had success with odd vCPU counts?03:59
spatel10vCPU didn't work so now trying 15vCP04:01
spateli am going to try all number 1 by 104:01
jamesdentonscience.04:01
spatel:)04:01
spatelThat also works!04:05
spatelhow this thing got fixed itself??04:05
spatelit was broken earlier but right now look like everything working.. can't believe it04:06
jamesdentonwere you only trying 10 vCPU earlier?04:06
jamesdentoni can't recall. Either way, congrats. Now continue testing it and find the breaking points, and report back :D04:06
spatelafternoon i was trying 15 vCPU and they was causing issue04:07
spatelI am not going to leave it.. tomorrow i am going to pick other compute node and try to reproduce it again04:07
spatelgoing to try 10 vCPU again because that one is still broken04:08
*** shyam89 has quit IRC04:11
spatel10vCPU / 10GB memory flavor not working04:11
spatelvery odd look like flavor had issue, i have create similar size flavor and that works..04:16
spatelis it possible flavor had issue.. strange i have compare both flavor and they are same but still one is working other not04:16
jamesdentonfor 10/10?04:17
spatelyes04:18
jamesdentoninteresting.04:18
spatelone thing i did different, earlier i have add numa_policy on one of flavor but later i have removed it04:19
spatelmay be its showing it has been gone but its still there somewhere.. hmm04:19
jamesdentonhmmm.04:19
spatellet me add that setting on new flavor and try04:19
jamesdentoni'm gonna take off. Nice work tonight. Keep me posted if you don't mind04:20
*** markvoelker has quit IRC04:21
spateli will04:21
spateljamesdenton: thank you so much!! and will keep digging04:22
spatelgood night04:22
jamesdentonthanks! you too. see ya04:22
cloudnullnight all04:24
*** macza has joined #openstack-ansible04:26
*** macza has quit IRC04:30
*** gkadam has joined #openstack-ansible04:32
*** gkadam has quit IRC04:32
*** cshen has joined #openstack-ansible04:36
*** vnogin has joined #openstack-ansible04:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Add tasks to remove legacy files  https://review.openstack.org/60746204:41
*** cshen has quit IRC04:42
*** vnogin has quit IRC04:45
*** maddtux has quit IRC04:45
*** maddtux has joined #openstack-ansible04:46
*** chandankumar has quit IRC04:46
*** chandankumar has joined #openstack-ansible04:47
*** spatel has quit IRC04:49
*** shyamb has joined #openstack-ansible04:53
*** priteau has joined #openstack-ansible04:56
*** Bhujay has joined #openstack-ansible05:01
*** priteau has quit IRC05:01
*** Bhujay has quit IRC05:01
*** Bhujay has joined #openstack-ansible05:02
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Remove infectious distro service packages on source installs  https://review.openstack.org/60746605:02
*** ram5391_ has quit IRC05:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_barbican master: Remove infectious distro service packages on source installs  https://review.openstack.org/60746705:09
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: Remove infectious distro service packages on source installs  https://review.openstack.org/60746905:15
*** markvoelker has joined #openstack-ansible05:18
chandankumarodyssey4me: Hello05:29
chandankumarodyssey4me: https://review.openstack.org/#/c/591424/6/tasks/install/distro.yml@19 at this distro support for tempest role is failing05:30
chandankumarodyssey4me: need some help there05:30
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Remove infectious distro service packages on source installs  https://review.openstack.org/60746605:37
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Remove infectious distro service packages on source installs  https://review.openstack.org/60746605:39
*** udesale has joined #openstack-ansible05:41
*** mma has joined #openstack-ansible05:45
*** mma has quit IRC05:49
*** shyamb has quit IRC05:51
*** markvoelker has quit IRC05:52
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro  https://review.openstack.org/59142406:01
*** DanyC has joined #openstack-ansible06:11
*** mma has joined #openstack-ansible06:11
*** shyamb has joined #openstack-ansible06:21
*** DanyC has quit IRC06:22
*** DanyC has joined #openstack-ansible06:23
*** DanyC has quit IRC06:28
openstackgerritAndriy Shevchenko proposed openstack/openstack-ansible-openstack_hosts master: fix tox python3 overrides  https://review.openstack.org/60747306:28
*** vnogin has joined #openstack-ansible06:29
*** vnogin has quit IRC06:34
*** cshen has joined #openstack-ansible06:37
*** mma has quit IRC06:38
openstackgerritMax Kochubey proposed openstack/openstack-ansible-os_horizon master: An openstack-ansible deployment does not have any options to set the local_settings.py options for Horizon to support Keystone V3 multiple domains dropdown menu and its variants to choose. These options in local_settings.py are:  https://review.openstack.org/60747406:42
*** cshen has quit IRC06:46
openstackgerritMax Kochubey proposed openstack/openstack-ansible-os_horizon master: Horizon configuration to support domains dropdown  https://review.openstack.org/60747406:50
*** pcaruana has joined #openstack-ansible06:51
openstackgerritMax Kochubey proposed openstack/openstack-ansible-os_horizon master: Horizon configuration to support domains dropdown  https://review.openstack.org/60747406:52
*** cshen has joined #openstack-ansible07:01
*** tosky has joined #openstack-ansible07:03
*** monty has joined #openstack-ansible07:12
openstackgerritMax Kochubey proposed openstack/openstack-ansible-os_horizon master: Horizon configuration to support domains dropdown  https://review.openstack.org/60747407:13
*** aedc has joined #openstack-ansible07:15
*** mbuil has joined #openstack-ansible07:18
*** sep has quit IRC07:19
*** jroll has quit IRC07:19
*** logan- has quit IRC07:19
*** mrda has quit IRC07:19
*** jehane has quit IRC07:19
*** canori01 has quit IRC07:19
*** alongwayup has quit IRC07:19
*** mbuil_ has quit IRC07:19
*** odyssey4me has quit IRC07:19
*** monte has quit IRC07:19
*** bgmccollum has quit IRC07:19
*** jehane has joined #openstack-ansible07:22
*** olivierb has joined #openstack-ansible07:24
*** DanyC has joined #openstack-ansible07:24
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/60748107:24
*** vnogin has joined #openstack-ansible07:28
*** aedc has quit IRC07:31
*** sep has joined #openstack-ansible07:32
*** jroll has joined #openstack-ansible07:32
*** logan- has joined #openstack-ansible07:32
*** alongwayup has joined #openstack-ansible07:32
*** bgmccollum has joined #openstack-ansible07:32
*** odyssey4me has joined #openstack-ansible07:32
*** vnogin has quit IRC07:32
*** gkadam has joined #openstack-ansible07:44
*** hamzaachi has joined #openstack-ansible07:45
*** shyamb has quit IRC07:46
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-rabbitmq_server stable/rocky: rabbitmq_upgrade_check: Do not complain for upgrades on distro packages  https://review.openstack.org/60748707:55
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-rabbitmq_server stable/queens: rabbitmq_upgrade_check: Do not complain for upgrades on distro packages  https://review.openstack.org/60748807:55
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-rabbitmq_server stable/pike: rabbitmq_upgrade_check: Do not complain for upgrades on distro packages  https://review.openstack.org/60748907:55
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-rabbitmq_server stable/ocata: rabbitmq_upgrade_check: Do not complain for upgrades on distro packages  https://review.openstack.org/60749007:55
*** francois has joined #openstack-ansible08:00
*** mma has joined #openstack-ansible08:04
*** hamzaachi_ has joined #openstack-ansible08:05
*** DanyC has quit IRC08:08
*** shardy has joined #openstack-ansible08:11
*** hamzaachi has quit IRC08:13
*** sep has quit IRC08:13
*** jroll has quit IRC08:13
*** logan- has quit IRC08:13
*** alongwayup has quit IRC08:13
*** odyssey4me has quit IRC08:13
*** bgmccollum has quit IRC08:13
*** DanyC has joined #openstack-ansible08:17
*** markvoelker has joined #openstack-ansible08:18
jrosserThe are a lot of integrated build ubuntu jobs timing out and it looks like very slow apt installation - it's unclear if this slow repos or hosts slow to install08:22
*** sep has joined #openstack-ansible08:27
*** jroll has joined #openstack-ansible08:27
*** logan- has joined #openstack-ansible08:27
*** alongwayup has joined #openstack-ansible08:27
*** bgmccollum has joined #openstack-ansible08:27
*** odyssey4me has joined #openstack-ansible08:27
*** electrofelix has joined #openstack-ansible08:34
*** francois has quit IRC08:40
*** Emine has joined #openstack-ansible08:41
*** shyamb has joined #openstack-ansible08:42
*** francois has joined #openstack-ansible08:44
*** sep has quit IRC08:51
*** jroll has quit IRC08:51
*** logan- has quit IRC08:51
*** alongwayup has quit IRC08:51
*** odyssey4me has quit IRC08:51
*** bgmccollum has quit IRC08:51
*** markvoelker has quit IRC08:51
*** rgogunskiy has joined #openstack-ansible08:56
evrardjpgood morning09:00
evrardjpwow. I was unlogged from gerrit today. It's been a while that didn't happen.09:00
noonedeadpunkmorning evrardjp:) I have several questions about keepalived since friday. Do you have some time?09:05
*** sep has joined #openstack-ansible09:05
*** jroll has joined #openstack-ansible09:05
*** logan- has joined #openstack-ansible09:05
*** alongwayup has joined #openstack-ansible09:05
*** bgmccollum has joined #openstack-ansible09:05
*** odyssey4me has joined #openstack-ansible09:05
evrardjpI need to first catch up my thousand of things -- are you the one that did two PR during my holidays?09:06
evrardjpI will ping you back a little later if you don't mind09:06
noonedeadpunkevrardjp: yeah, that was me. And I didn't get why check was failed09:06
noonedeadpunkyep, sure09:07
evrardjpI now I applied for a new version of semaphore, so maybe my testing is broken now09:07
*** aedc has joined #openstack-ansible09:07
*** mma has quit IRC09:10
*** mma has joined #openstack-ansible09:11
*** Emine has quit IRC09:12
olivierbgood morning everyone09:12
*** priteau has joined #openstack-ansible09:13
olivierbevrardjp could you please have a quick look at https://review.openstack.org/606899 and https://review.openstack.org/606910. Trying to fix the great healthcheck-* playbooks09:13
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-tests stable/queens: common-tasks: nodepool: Set openSUSE OBS mirror for OpenStack CI  https://review.openstack.org/60750509:18
evrardjpolivierb: thanks09:21
evrardjpit makes sense and easy to review09:21
*** cshen has quit IRC09:21
olivierbevrardjp many thanks to you09:23
*** Emine has joined #openstack-ansible09:25
*** cshen has joined #openstack-ansible09:25
*** vnogin has joined #openstack-ansible09:26
evrardjpfdz to answer your question, I am not sure code was written up, and I am not familiar enough with designate to ensure this is the proper way to do things. Maybe you discussed dns_domain_ports in this channel already and got your answer? (it's about http://eavesdrop.openstack.org/irclogs/%23openstack-ansible/%23openstack-ansible.2018-01-19.log.html#t2018-01-19T13:28:51 )09:29
*** vnogin has quit IRC09:31
chandankumarodyssey4me: Hello09:40
chandankumarodyssey4me: https://review.openstack.org/#/c/591424/6/tasks/install/distro.yml for yum/dnf will I write a seperate task ?09:41
odyssey4mechandankumar: no, you have no need to - just remove those entries from the list and the default(omit) in the ternary will result in ansible leaving out that option for anything that is not zypper or apt09:46
odyssey4mechandankumar: basically the 'package' module is an action plugin which acts as an interface on top of the package manager modules under it - the package module will accept any of the options applicable to the underlying package modules, but it will pass the options to them all, and if one does not support it then it will error out09:47
odyssey4meso in this case you're saying if the package manager is zypper/apt, then pass down the update_cache option - otherwise, do not09:48
evrardjpodyssey4me: hey -- for https://review.openstack.org/#/c/607291/1/tasks/keystone_post_install.yml@24 I just realized it's a backport09:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Only do sshd enablement task on the first play host  https://review.openstack.org/60752209:55
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro  https://review.openstack.org/59142409:55
evrardjpodyssey4me: I think I will downgrade my vote -- it seems it's very unclear the reason we are doing this09:56
chandankumarodyssey4me: thanks,09:56
chandankumarodyssey4me: but still I am not getting how yum install will work for distro mode is used?09:56
odyssey4mechandankumar: what do you mean?09:56
chandankumarodyssey4me: sorry got it09:57
odyssey4meevrardjp: the issue is that in the nspawn container base images, sshd is masked so that it does not start -> for the repo server and keystone, we use rsync to copy things between the cluster members, that's why we need to add a task to enable them09:58
evrardjpok09:58
chandankumarodyssey4me: one more thing https://review.openstack.org/#/c/591424/8/tasks/install/distro.yml will I merge tempest and tempest plugin installation in a single task or keep it seperate?09:58
evrardjpunderstood09:58
evrardjpmaybe worth adding in the comment09:59
evrardjpwait09:59
evrardjpscratch that last comment09:59
*** shyamb has quit IRC10:01
*** shyamb has joined #openstack-ansible10:03
*** vnogin has joined #openstack-ansible10:06
*** Emine has quit IRC10:07
noonedeadpunkI don't know if it's known problem or not, but it seems that bootstrap-ansible.sh script from stable/rocky is not functional due to ansible-role-requirements.yml, as fails at cloning repos step http://paste.openstack.org/show/731284/10:11
*** vnogin has quit IRC10:11
*** kukacz has quit IRC10:12
*** kukacz has joined #openstack-ansible10:13
openstackgerritNicolas Bock proposed openstack/openstack-ansible-os_octavia master: Added suse vars  https://review.openstack.org/60730410:16
odyssey4mechandankumar: there's no reason to have two tasks if you're installing the same thing the same way10:19
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro  https://review.openstack.org/59142410:21
chandankumarodyssey4me: Done, Thanks :-)10:21
evrardjpnoonedeadpunk: rocky seems fine in periodic logs10:24
*** gkadam has quit IRC10:24
odyssey4menoonedeadpunk: I saw you note that yesterday, but I haven't seen the same. It's a bit concerning.10:25
*** udesale has quit IRC10:26
evrardjpodyssey4me: noonedeadpunk maybe worth deleting the roles and re-running it10:26
evrardjpI am expecting ansible module does a fancy thing and doesn't try to refetch all the references10:26
odyssey4meevrardjp: it's a bit concerning, given that we've not seen this happen before until recently10:31
*** shyamb has quit IRC10:34
noonedeadpunkevrardjp: yes. removing /etc/ansible/roles worked, thanks10:36
openstackgerritNicolas Bock proposed openstack/openstack-ansible master: Pretty-print output during bootstrap process  https://review.openstack.org/60752610:37
*** shyamb has joined #openstack-ansible10:41
*** vnogin has joined #openstack-ansible10:45
*** markvoelker has joined #openstack-ansible10:49
*** vnogin has quit IRC10:49
evrardjpodyssey4me: let me check the recent changes in git module10:54
evrardjpIt would be nice to know when this has started, as early 2.5 have the same patches as our 2.5.810:58
jamesdentonmornin11:01
evrardjphow are things jamesdenton ?11:20
jamesdentongood!11:20
jamesdentonhow about you?11:20
*** markvoelker has quit IRC11:22
nicolasbockHi, good morning11:30
jamesdentonhi11:30
nicolasbockCan I re-run a particular check on Zuul? Or is it all or nothing?11:30
hwoarangnicolasbock: all or nothing11:32
nicolasbockToo bad11:32
nicolasbockEven Travis-CI can do that ;)11:32
nicolasbockI mean re-run a particular job11:32
hwoarangyeah you can't11:32
nicolasbockoh well11:33
*** shyamb has quit IRC11:34
*** shyamb has joined #openstack-ansible11:34
*** macza has joined #openstack-ansible11:37
*** vollman has joined #openstack-ansible11:37
*** shyamb has quit IRC11:42
*** macza has quit IRC11:42
francoisevrardjp: yep thanks, I got a pointer yesterday to using neutron_ml2_conf_ini_overrides which worked great11:43
francoisand now I'm not so sure that I actually need dns_domain_ports instead of dns :/11:44
francoisstill testing :)11:44
*** hamzaachi_ has quit IRC11:52
olivierbhwoarang I replied to your concern in https://review.openstack.org/#/c/606899/1 ;-)12:00
hwoarangolivierb: if the fix is in rocky and master why not do a backport then?12:01
*** ansmith has quit IRC12:02
olivierbbecause the code has changed a lot and I think it was just "forgotten" aka was not a single fix/change12:02
*** shyamb has joined #openstack-ansible12:02
olivierbthis is a backport from my perspective12:02
olivierbbut not cherry-picked -x if this is what you mean12:03
*** udesale has joined #openstack-ansible12:03
*** Emine has joined #openstack-ansible12:14
*** hamzaachi_ has joined #openstack-ansible12:14
*** dave-mccowan has joined #openstack-ansible12:20
olivierbhwoarang concerning https://review.openstack.org/#/c/607007/ and if I understood cloudnull well, this is on a per release basis meaning all versions of rabbitmq + erlang are specific to master/rocky/... therefore this change only applies to queens12:23
*** vnogin has joined #openstack-ansible12:24
hwoarangok i see12:24
*** vnogin has quit IRC12:28
*** fghaas has joined #openstack-ansible12:34
*** kaiokmo has quit IRC12:49
odyssey4meif anyone's got some time, I've got a few patches ready for review - several of which are backports: https://goo.gl/k9cCfF12:51
*** kaiokmo has joined #openstack-ansible12:58
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_cinder master: Added volume usage collection, when cinder_ceilometer_enabled  https://review.openstack.org/60576913:01
*** udesale has quit IRC13:05
*** shyamb has quit IRC13:05
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_cinder master: Added volume usage collection, when cinder_ceilometer_enabled  https://review.openstack.org/60576913:07
*** shyamb has joined #openstack-ansible13:07
openstackgerritArx Cruz proposed openstack/openstack-ansible-os_tempest master: Enable stackviz support  https://review.openstack.org/60310013:08
*** ansmith has joined #openstack-ansible13:12
*** spatel_ has joined #openstack-ansible13:14
*** aedc has quit IRC13:18
spatel_jamesdenton: morning13:18
jamesdentonhi spatel_13:18
spatel_I did this configuration, tell me if you seeing anything wrong http://paste.openstack.org/show/731366/13:18
spatel_i have specified two nic eno1/eno2  in sriov_nic_agent13:19
spatel_but in nova.conf whitelist only one which i am using for VF eno213:19
jamesdentonit might work. not really sure. i would try to spin up small instances to consume all the VFs and see what happens13:22
spatel_I am testing it and its working13:23
spatel_i was just wanted to check if in future it cause any issue13:23
jamesdentonTBD13:23
*** maddtux has quit IRC13:28
mgariepyhwoarang, http://logs.openstack.org/89/605789/1/check/openstack-ansible-functional-opensuse-423/927ae60/job-output.txt.gz#_2018-10-03_01_34_04_23951613:32
mgariepyis this new or you already know about that and it's fixed ?13:32
hwoarangmgariepy: should be fixed by now...13:32
chandankumarodyssey4me: need some help here http://logs.openstack.org/24/591424/9/check/openstack-ansible-functional-centos-7/0d18ba5/job-output.txt.gz#_2018-10-03_12_14_28_31312313:34
chandankumarodyssey4me: I am not sure what I am doing wrong here https://review.openstack.org/#/c/591424/13:35
mgariepychandankumar, check my comment13:41
chandankumarmgariepy: Thanks :-)13:41
mgariepyyou are welcome13:42
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/rocky: Add variable for the ssh service  https://review.openstack.org/60729113:46
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro  https://review.openstack.org/59142413:47
*** kaiokmo has quit IRC13:47
openstackgerritMerged openstack/openstack-ansible stable/queens: Add count to ping command for predictive process termination  https://review.openstack.org/60689913:51
*** tosky__ has joined #openstack-ansible13:51
*** tosky has quit IRC13:51
*** kaiokmo has joined #openstack-ansible13:51
*** tosky__ is now known as tosky13:52
*** shyamb has quit IRC13:58
mnasercloudnull: you around?14:01
mnaseri'm building a compute node using LVM and i am having an issue where stuff runs under qemu user, but the lvm device is created under 'root' .. so i think it's unable to read it14:01
*** shyamb has joined #openstack-ansible14:01
*** olivierb_ has joined #openstack-ansible14:02
*** rpittau_ has joined #openstack-ansible14:02
*** olivierb has quit IRC14:03
*** rpittau has quit IRC14:03
*** spatel_ has quit IRC14:04
*** Bhujay has quit IRC14:06
*** Bhujay has joined #openstack-ansible14:07
*** spatel has joined #openstack-ansible14:07
*** shananigans has joined #openstack-ansible14:07
*** skiedude has joined #openstack-ansible14:15
*** Bhujay has quit IRC14:16
*** chandankumar is now known as chkumar|pyconind14:21
*** shyamb has quit IRC14:24
cloudnullmornings all14:24
cloudnullmnaser I am now14:25
mnasercloudnull: ^ about the lvm stuff.. not sure if you ran into that14:25
cloudnulllike the device ownership is "qemu" ?14:26
cloudnullin /dev/mapper/...14:26
noonedeadpunkFYI I've added yesterday's etherpad for berlin summit on the page https://wiki.openstack.org/wiki/Forum/Berlin2018#Etherpads_from_Teams_and_Working_Groups14:28
cloudnullnoonedeadpunk: excellent!14:29
mnasercloudnull: yeah.. but it's actually root, not qemu14:34
mnaserso qemu cant start up properly14:34
mnasermgariepy: how did you end up solving your slow big ram machine boot issues?14:34
mgariepynew kernel14:35
mgariepymnaser, the kernel in proposed fixed it.14:35
mnasermgariepy: ah but this isnt centos?14:35
mgariepynop it's not.14:35
mgariepywas ubunut14:35
mgariepyalso it was only with pike.14:36
mgariepyqueens has a new version of libvirt which didn't had the same issue.14:36
odyssey4memnaser: it seems that some of our product folks are a bit confused about our stance on xenial/bionic for rocky and stein given that devstack is not yet using bionic, but is only moving to use it in stein14:36
odyssey4meperhaps we should write it up as a spec to be clear about why we're doing the transition in rocky, rather than in stein... what do you think14:37
*** cshen has quit IRC14:37
*** ivve has joined #openstack-ansible14:38
openstackgerritPanagiotis Karalis proposed openstack/openstack-ansible-os_tacker master: Tacker uses OpenStack Barbican for secret keys  https://review.openstack.org/60578414:40
cloudnullmnaser is that just a permissions issue, someting you can chown / facl ?14:42
*** spatel has quit IRC14:42
*** spatel has joined #openstack-ansible14:44
*** weezS has joined #openstack-ansible14:48
shananigansShould be a quick one if anyone has the time: https://review.openstack.org/#/c/607334/14:48
*** spatel has quit IRC14:48
*** spatel has joined #openstack-ansible14:49
cloudnullanyone want to review https://review.openstack.org/#/c/607466 - should help resolve a source of transient failures ?14:50
cloudnull's/?/./g'14:50
*** iurygregory has joined #openstack-ansible14:50
*** KeithMnemonic has quit IRC14:51
*** spatel has quit IRC14:55
*** Emine has quit IRC14:58
*** rgogunskiy has quit IRC15:02
hwoarangcloudnull: oops my bad I guess :/ +215:03
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for "force_metadata" in dnsmasq  https://review.openstack.org/60760815:04
*** cshen has joined #openstack-ansible15:05
*** spatel_ has joined #openstack-ansible15:05
spatel_jamesdenton: ^^15:05
*** ArchiFleKs has quit IRC15:06
spatel_if i set "aggregate_instance_extra_specs:pinned='true', hw:cpu_policy='dedicated', hw:pci_numa_affinity_policy='preferred'" in flavor then its only allowing me to run instance on NUMA 0 and if i try to add instance in NUMA1 it saying no host available 500 error15:06
*** FuzzyFerric has joined #openstack-ansible15:07
spatel_If i remove those properties values then it allowing me to run instance on both NUMA node but without pinning :(15:07
*** FuzzyFerric has left #openstack-ansible15:08
*** FuzzyFerric has joined #openstack-ansible15:09
*** kwu83tw has joined #openstack-ansible15:09
*** kwu_83tw has joined #openstack-ansible15:09
*** cshen has quit IRC15:09
*** cshen has joined #openstack-ansible15:15
*** spatel_ has quit IRC15:17
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for "force_metadata" in dnsmasq  https://review.openstack.org/60760815:21
*** mma has quit IRC15:21
*** mma has joined #openstack-ansible15:32
*** mma has quit IRC15:33
*** pcaruana has quit IRC15:33
*** macza has joined #openstack-ansible15:39
*** hamzy has quit IRC15:40
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: Break out config files for each octavia service  https://review.openstack.org/60322815:40
*** hamzy has joined #openstack-ansible15:43
mnaserodyssey4me: i think that's a good idea, i was thinking that would probably be part of our documentation15:43
mnaseras of the upgrades15:43
mnasercloudnull: it seems to look like just a permission issue on the surface, i havent played a lot with facl but i dont think chown would work because it always creates new devices15:43
mnaserso things like /dev/dm-N appear15:43
*** spatel has joined #openstack-ansible15:44
spotzodyssey4me: Question for that ssl bug, If I check to see if openstack_external_ssl: false (not sure yet if I need to check for haproxy_ssl: false) can I tell it to use one jinja2 file over another? Or would it be more proper to have one file but select one set of contents over the other? I'd like to match what we're doing15:44
spateldamn it!! my client getting disconnect very often today15:44
spateljamesdenton: ^^15:44
*** spatel has quit IRC15:47
odyssey4mespotz: I don't think I understand the question. What do you mean by 'would it be more proper to have one file but select one set of contents over the other' ?15:48
spotzodyssey4me: so templates/openstack_dashboard.conf.j2 is the current file, for the patch I need a different virtual host config to be applied15:49
odyssey4mespotz: that template has conditionals in it already to change the content based on various settings...15:50
*** spatel has joined #openstack-ansible15:50
spotzodyssey4me: Hrm, !=on yo would think would take care of the issue, I wonder why it stopped functioning:(15:51
spotzCause we definitely need to turn off the recrite15:51
spotzrewrite even15:51
odyssey4mespotz: but that all keys off horizon_external_ssl - is that var being set correctly?15:52
spotzodyssey4me: Hrm, no one had given me that one:) I have haproxy_ssl and openstack_external_ssl. Let me build a new AIO with that, this might turn into a docs patch15:53
odyssey4mespotz: I think that's supposed to be set from group_vars. Take a look around before using it as an override.15:54
spotzodyssey4me: Glad I asked before I went too far down a rabbit hole:)15:56
spotzodyssey4me: So it sets based on openstack_external_ssl which I did have as false, so maybe not being passed correctly?15:58
skiedudeSo I've disabled haproxy SSL, I've enabled http endpoint traffic on external/internal. However going to tho the LB IP I'm being redirected to https,which isn't going to work with all SSL disabled16:00
skiedudeis there a horizon setting somewhere I missed to not force https?16:00
*** spatel has quit IRC16:00
*** spatel has joined #openstack-ansible16:01
*** FuzzyFerric has left #openstack-ansible16:04
mgariepyskiedude, the redirect is done in haproxy16:05
*** spatel has quit IRC16:06
skiedudethats what I figured, but I've disabled SSL, and there is no reference to 443, or https in the /etc/haproxy/haproxy.cfg16:06
*** gyee has joined #openstack-ansible16:06
skiedudehttps://pastebin.com/fZ9Mkesb16:07
skiedudeis the horizon section of the haproxy config, all http config'd16:07
*** spatel_ has joined #openstack-ansible16:08
skiedudehowever if I do a curl -I, I can see I'm getting 302'd to https16:09
mgariepyset horizon_external_ssl to true16:09
mgariepyhttps://github.com/openstack/openstack-ansible-os_horizon/blob/master/templates/openstack_dashboard.conf.j2#L1216:09
skiedudeok I can try that, this leads me to another question I've wondered, if I add this to the user_variables, do I just rerun the whol setup-openstack.yml, or is there documentation somewhere of what tags can be used16:10
skiedudeor do I need to dive into each role to find the tags16:10
mgariepyyou can just run the specific service16:10
mgariepyos_horizon in this case16:10
skiedudeok so I'd do an `openstack-ansible os-horizon-install.yml`16:11
*** shyamb has joined #openstack-ansible16:17
*** hamzaachi_ has quit IRC16:18
*** macza has quit IRC16:22
*** macza has joined #openstack-ansible16:22
*** AJaeger has joined #openstack-ansible16:23
cloudnullmnaser oh, so this is nova compute deploying VMs in logical volumes ?16:23
* cloudnull i think i was not understanding things -- needed coffee 16:23
cloudnullhwoarang all good :)16:23
AJaegeransible cores, for the python3-first goal, here's the list of open changes for your repos http://paste.openstack.org/show/731415/16:24
*** macza has quit IRC16:24
cloudnullthanks AJaeger!16:24
AJaegerthere are 6 "import zuul jobs from project-config" changes that need to be done first16:24
AJaegerBut they all fail;(16:24
noonedeadpunkI'm a bit stuck here with patch at pretty easy moment. Does this structure has sense to anyone? swift_oslomsg_notify_userid: "{{ swift_oslomsg_notify_userid | default('swift') }}"16:25
AJaegermnaser, cloudnull, could you figure out what to do with these, please?16:25
noonedeadpunkthe thing is, that for some reason swift uses swift_oslomsg_notify_* and not swift_oslomsg_rpc_* like other ones16:26
cloudnullnoonedeadpunk "{{ swift_oslomsg_notify_userid | default(swift_system_user_name) }}" -- assuming thats being added to the swift role16:26
cloudnullAJaeger ill have a look16:27
AJaegerthanks, cloudnull16:27
AJaegerevrardjp: on https://review.openstack.org/#/c/594666/ - I suggest you abandon that one.16:27
AJaegercloudnull, evrardjp, but if you do that, then you have to add this at a later time (which is not a problem)16:28
*** shyamb has quit IRC16:28
AJaegercloudnull, odyssey4me, for https://review.openstack.org/#/c/594755/ and https://review.openstack.org/#/c/597006/ - let me push a change that removes the docs job from that branch for project-config...16:29
*** olivierb_ has quit IRC16:29
noonedeadpunkcloudnull: not really, I'm defining varibales that were used in ceilometer https://github.com/openstack/openstack-ansible-os_ceilometer/blob/master/templates/ceilometer.conf.j2#L84-L8716:30
*** iurygregory has quit IRC16:33
noonedeadpunkoh, solution is too easy, and I may just put swift_oslomsg_notify_userid: "swift", as in case of re-defining this var globally it will be overrided. Thanks cloudnull:)16:33
AJaegermnaser, cloudnull, odyssey4me https://review.openstack.org/607636 is the project-config change to help merging the python3-first on stable/ocata for openstack-ansible-os_monasca .16:34
evrardjpAJaeger: it's a call for contributions at the same time :D16:34
evrardjpAJaeger: me and my hopes :)16:34
evrardjpAbandonned16:34
AJaegerevrardjp: thanks16:35
AJaegerevrardjp: also, could you +2 https://review.openstack.org/#/c/597006/ (https://review.openstack.org/#/c/594755/2 will fix it) and abandon https://review.openstack.org/#/c/594755/ , please?16:36
evrardjpofc16:37
AJaegerevrardjp: oh, that's your change - so need cloudnull to +2 ;)16:37
evrardjpyeah16:37
cloudnullwhich one?16:38
* cloudnull ready's my +2 fingers 16:38
AJaegercloudnull "evrardjp: also, could you +2 https://review.openstack.org/#/c/597006/ (https://review.openstack.org/#/c/594755/2 will fix it) and abandon https://review.openstack.org/#/c/594755/ , please?"16:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_monasca-agent stable/ocata: Setup branch for gerrit  https://review.openstack.org/59700616:40
noonedeadpunkSo if you are in good mood, probably you will set + for my https://review.openstack.org/#/c/605769/ ? :)16:40
*** kwu_83tw has quit IRC16:41
*** kwu83tw has quit IRC16:41
noonedeadpunkI've moved systemd task from post_install to main.yml as includes more obvious here as for me. But probably I shouldn't place "name" for include task.16:45
mnasercloudnull: yyes, nova-compute deploying VMs in logical volumes16:45
AJaegerthanks, cloudnull16:47
AJaegerSo, that leaves openstack/openstack-ansible-os_horizon and openstack/openstack-ansible-os_ironic - I hope openstack/openstack-ansible-os_neutron will work with next recheck ;(16:48
kaiokmohwoarang: permission denied on one of your repositories http://logs.openstack.org/45/588545/4/check/openstack-ansible-functional-opensuse-423/6422fa5/job-output.txt.gz#_2018-10-02_21_51_08_78672116:49
*** chkumar|pyconind has quit IRC16:51
AJaegerkaiokmo: download.opensuse.org has a problem today ;(16:51
odyssey4meAJaeger: if any of them are still stuck in the morning, then I'll take a crack at resolving them - I need to !computering for the day16:51
*** spatel_ has quit IRC16:52
AJaegerodyssey4me: thanks! Enjoy your !computering day!16:52
*** chandankumar has joined #openstack-ansible16:56
*** macza has joined #openstack-ansible16:57
*** spatel has joined #openstack-ansible16:57
openstackgerritKaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca master: Add support for CentOS 7  https://review.openstack.org/58854517:04
*** chandankumar has quit IRC17:07
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Fix of oslomsg undefined variables for services notifications  https://review.openstack.org/60765317:12
openstackgerritMerged openstack/openstack-ansible stable/rocky: Fix for proper package name depending on base OS distribution  https://review.openstack.org/60703117:35
openstackgerritMerged openstack/openstack-ansible-os_horizon master: SUSE: Add support for openSUSE Leap 15  https://review.openstack.org/60539017:39
*** olivierb has joined #openstack-ansible17:41
cloudnullmnaser is that on Rocky?17:43
mnasercloudnull: nope on a queens deployment17:43
cloudnulland the nova.conf has something like http://paste.openstack.org/show/731424/ defined ?17:44
cloudnullthats just about everything I have to do to make nova w/ LV instances go17:45
*** shardy has quit IRC17:47
mnasercloudnull: yeah that part all works but nova creates LVs which end up getting root:root permissions17:49
mnaserwhich i believe qemu doesnt have access to17:49
openstackgerritKaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca master: Add support for CentOS 7  https://review.openstack.org/58854517:49
cloudnullmaybe qemu needs to be added to the some admin group?17:50
*** ivve has quit IRC17:51
spotzskidude - work aruond is in this bug https://bugs.launchpad.net/openstack-ansible/+bug/179433717:53
openstackLaunchpad bug 1794337 in openstack-ansible "Apache and Horizon configs not automatically turning off SSL when overridden" [High,Confirmed] - Assigned to Amy Marrich (amy-marrich)17:53
cloudnullmnaser so when the new vm is created it fails due to not having permission to create a Logical volume ?17:56
mnasercloudnull: qemu-kvm seems to be stuck spinning at 100%.. the LV is already created (using nova with roothelper so thats fine)17:56
mnasermy theory to confirm it was, sudo -u qemu /bin/bash; dd if=/dev/vg_foo/bar_disk of=/dev/null gives me a permission denied17:57
mnaserand when going back to good o'l qcow2 images locally it worked fine17:57
cloudnullok. that was my next suggestion , rootwrap config being out of date17:57
cloudnulldo you have the error logs from nova17:59
cloudnulldoes it cause a stack trace?17:59
cloudnullor is it just hung17:59
mnasercloudnull: nova is fine, it boots up everything ok, i just see a hung qemu-kvm process18:02
mnaserfor all nova cares everything is up18:02
mnaserits just the instance is hung because (my assumption) that the `qemu` user cant access the device18:03
cloudnullon centos?18:03
cloudnullor ubuntu18:03
*** hamzaachi_ has joined #openstack-ansible18:04
*** kwu83tw has joined #openstack-ansible18:04
*** kwu_83tw has joined #openstack-ansible18:04
*** dw_ is now known as dw18:07
mnasercloudnull: centos18:09
*** spatel has quit IRC18:10
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: fix tox python3 overrides  https://review.openstack.org/60676518:14
*** strattao has joined #openstack-ansible18:15
openstackgerritMerged openstack/openstack-ansible-galera_client master: fix tox python3 overrides  https://review.openstack.org/60676218:16
*** spatel has joined #openstack-ansible18:19
openstackgerritMerged openstack/openstack-ansible-os_monasca-agent master: fix tox python3 overrides  https://review.openstack.org/60676818:21
*** pcaruana has joined #openstack-ansible18:24
*** spatel has quit IRC18:28
openstackgerritArx Cruz proposed openstack/openstack-ansible master: Add stackviz directory to the list of find_log_files  https://review.openstack.org/60608418:30
*** gyee has quit IRC18:50
*** spatel has joined #openstack-ansible18:50
*** pcaruana has quit IRC18:50
*** spatel has quit IRC18:58
*** spatel has joined #openstack-ansible18:58
*** hamzaachi_ has quit IRC19:10
*** kwu_83tw has quit IRC19:23
*** kwu83tw has quit IRC19:23
*** hamzaachi has joined #openstack-ansible19:23
*** spartakos has joined #openstack-ansible19:25
*** spatel has quit IRC19:29
*** spatel has joined #openstack-ansible19:31
*** vnogin has joined #openstack-ansible19:34
*** spatel has quit IRC19:38
*** canori01 has joined #openstack-ansible19:46
*** spatel has joined #openstack-ansible19:47
*** spatel has quit IRC19:56
*** spatel has joined #openstack-ansible19:58
*** spatel has quit IRC20:03
*** spatel has joined #openstack-ansible20:04
*** vnogin has quit IRC20:12
*** macza has quit IRC20:15
*** macza has joined #openstack-ansible20:16
*** spartakos has quit IRC20:17
*** gyee has joined #openstack-ansible20:24
openstackgerritKaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca master: Add support for CentOS 7  https://review.openstack.org/58854520:24
*** vnogin has joined #openstack-ansible20:26
*** ansmith has quit IRC20:30
*** spatel has quit IRC20:31
*** spatel has joined #openstack-ansible20:31
*** spatel has quit IRC20:36
*** spatel has joined #openstack-ansible20:37
*** vnogin has quit IRC20:42
*** ullbeking has quit IRC20:42
*** vnogin has joined #openstack-ansible20:43
*** cshen has quit IRC20:46
*** fghaas has quit IRC20:46
*** olivierb has quit IRC20:47
*** vnogin has quit IRC20:47
*** spatel has quit IRC20:50
spotzcloudnull: You here?20:52
*** spartakos has joined #openstack-ansible20:55
*** priteau has quit IRC21:01
*** hamzaachi has quit IRC21:06
*** spartakos has quit IRC21:08
*** cshen has joined #openstack-ansible21:13
cloudnullspotz i am now21:18
cloudnullfor a min more21:18
cloudnullmnaser i have a couple nodes with cent coming up on them21:18
spotzcloudnull: Ok so how to I debug whether a global_var is being passed?21:18
cloudnulli hope to have somethiong to try to recreate that issue21:18
cloudnullsorry, been afk most the day21:18
cloudnullspotz you can checkout the local facts in /etc/openstack_deploy/ansible_facts21:19
cloudnullto see if the var is being defined as a fact21:19
cloudnullyou can also add a `- debug: var=$global_var` to the playbook where you expect it to be used21:19
cloudnullthat way you can see if it works?21:19
*** kwu83tw has joined #openstack-ansible21:21
*** kwu_83tw has joined #openstack-ansible21:21
spotzcloudnull: Ok cause I think that might be the issue with turning off the ssl in my bugs, openstack_external_ssl isn't getting passed along21:21
spotzIt's supposed to be passed to the group_var horizon_external_ssl21:23
*** spatel has joined #openstack-ansible21:24
*** spartakos has joined #openstack-ansible21:26
evrardjpmnaser: I am back from holiday and I haven't followed everything yet -- is there a reason to hold the release of Rocky more? I'd rather do that tomorrow early morning if no one is against that21:28
mnaserevrardjp: welcome back.  let me double check21:28
*** spatel has quit IRC21:29
mnaserreviewing https://review.openstack.org/#/q/project:%255Eopenstack/openstack-ansible.*+AND+is:open+branch:stable/rocky21:29
evrardjpto what I checked all the pending ones were merged21:29
mnaserevrardjp: https://review.openstack.org/#/c/606933/ and https://review.openstack.org/#/c/606386/21:30
mnaserwhat do you think about those 2 specificaly?21:30
mnasersecond one affects new deploys and might not break that much21:31
mnaserbut first one seems heavily affecting upgrades21:31
evrardjpmnaser: I was thinking of others taht were more impactful last week21:31
evrardjpI think we shouldn't hold the release much more. We'll always find bugs21:32
evrardjpI'd rather we release and do . minor releases for bug fixes21:32
mnaserevrardjp: i'll let you decide if the first patch is major enough21:32
mnaseri'll leave it to be your call21:32
openstackgerritMerged openstack/openstack-ansible-os_glance master: Remove infectious distro service packages on source installs  https://review.openstack.org/60746621:33
evrardjpwell I don't take decisions, I prefer calling the community -- on that I discussed this morning, and people were keen on getting a release sooner rather than having this in. I still voted to get this in, if possible, but wanted to make sure you were okay21:33
evrardjpwe've released in the past a .0 with malfunctioning upgrades, sadly. There is no urgency (Nov 28th is deadline) but still... :D21:35
evrardjpassuming those two are in, I will suggest a release.21:35
evrardjppropose(21:35
evrardjp*21:35
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Provide support for "force_metadata" in dnsmasq  https://review.openstack.org/60760821:38
evrardjpI am off for today see you tomorrow21:39
*** vnogin has joined #openstack-ansible21:41
openstackgerritMerged openstack/openstack-ansible-ops master: multi-noda-aio loadbalancer routing issues fix  https://review.openstack.org/60733421:48
*** strattao has quit IRC21:52
openstackgerritMerged openstack/openstack-ansible-repo_server stable/rocky: Add variable for the ssh service  https://review.openstack.org/60693821:56
*** skiedude has quit IRC21:56
openstackgerritMerged openstack/openstack-ansible-repo_build stable/rocky: Update repo_build test-vars data  https://review.openstack.org/60567522:03
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/rocky: rabbitmq_upgrade_check: Do not complain for upgrades on distro packages  https://review.openstack.org/60748722:10
*** spartakos has quit IRC22:17
*** tosky has quit IRC22:24
*** flaper87 has quit IRC22:32
*** flaper87 has joined #openstack-ansible22:33
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/rocky: tasks: neutron_db_setup: Only create the DB from the first neutron server  https://review.openstack.org/60638622:36
*** shananigans has quit IRC22:48
*** macza has quit IRC22:54
*** macza_ has joined #openstack-ansible22:54
*** fatdragon has joined #openstack-ansible23:00
*** spartakos has joined #openstack-ansible23:02
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/pike: Clean up role tests  https://review.openstack.org/60386223:08
*** macza_ has quit IRC23:12
*** DanyC has quit IRC23:19
*** weezS has quit IRC23:20
*** vnogin has quit IRC23:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/pike: Fix OpenSSL import in test config  https://review.openstack.org/60393923:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/pike: import zuul job settings from project-config  https://review.openstack.org/59505523:38
*** vnogin has joined #openstack-ansible23:44
*** vnogin has quit IRC23:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-hardening master: docs: Write files in binary mode  https://review.openstack.org/60773823:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-hardening master: fix tox python3 overrides  https://review.openstack.org/60651023:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!