| *** macza_ has quit IRC | 00:03 | |
| *** sdake has joined #openstack-ansible | 00:04 | |
| *** dave-mccowan has quit IRC | 00:07 | |
| *** dxiri has joined #openstack-ansible | 00:15 | |
| *** sm806 has quit IRC | 00:17 | |
| *** sm806 has joined #openstack-ansible | 00:18 | |
| *** sm806 has quit IRC | 00:28 | |
| *** sm806 has joined #openstack-ansible | 00:29 | |
| *** cmart has quit IRC | 00:31 | |
| *** sdake has quit IRC | 01:08 | |
| *** DanyC_ has joined #openstack-ansible | 01:10 | |
| *** DanyC has quit IRC | 01:12 | |
| *** sm806 has quit IRC | 01:21 | |
| *** sm806 has joined #openstack-ansible | 01:21 | |
| *** hwoarang has quit IRC | 01:23 | |
| *** dxiri has quit IRC | 01:27 | |
| *** hwoarang has joined #openstack-ansible | 01:29 | |
| *** cyberpear has quit IRC | 01:29 | |
| *** gyee has quit IRC | 01:38 | |
| *** sdake has joined #openstack-ansible | 02:09 | |
| *** cshen has joined #openstack-ansible | 02:37 | |
| *** cshen has quit IRC | 02:41 | |
| *** sdake has quit IRC | 02:46 | |
| jamesdenton | evenin' | 02:52 |
|---|---|---|
| *** ansmith has quit IRC | 02:54 | |
| *** ansmith_ has joined #openstack-ansible | 02:54 | |
| *** dave-mccowan has joined #openstack-ansible | 03:06 | |
| *** DanyC has joined #openstack-ansible | 03:11 | |
| *** udesale has joined #openstack-ansible | 03:15 | |
| *** DanyC has quit IRC | 03:15 | |
| *** sdake has joined #openstack-ansible | 03:16 | |
| *** sdake has quit IRC | 03:17 | |
| *** sdake has joined #openstack-ansible | 03:22 | |
| *** sdake has quit IRC | 03:23 | |
| *** sdake has joined #openstack-ansible | 03:28 | |
| *** dave-mccowan has quit IRC | 03:32 | |
| *** sdake has quit IRC | 03:40 | |
| *** markvoelker has joined #openstack-ansible | 03:48 | |
| *** spsurya has joined #openstack-ansible | 04:14 | |
| *** markvoelker has quit IRC | 04:20 | |
| *** cshen has joined #openstack-ansible | 04:47 | |
| *** cshen has quit IRC | 04:51 | |
| *** gkadam has joined #openstack-ansible | 04:55 | |
| *** raukadah has quit IRC | 05:03 | |
| *** chandankumar has joined #openstack-ansible | 05:04 | |
| *** markvoelker has joined #openstack-ansible | 05:17 | |
| *** shyamb has joined #openstack-ansible | 05:19 | |
| *** shyamb has quit IRC | 05:28 | |
| *** sdake has joined #openstack-ansible | 05:30 | |
| *** cmart has joined #openstack-ansible | 05:37 | |
| *** markvoelker has quit IRC | 05:51 | |
| *** shyamb has joined #openstack-ansible | 05:53 | |
| *** eumel8 has joined #openstack-ansible | 05:53 | |
| *** sdake has quit IRC | 06:02 | |
| *** sdake has joined #openstack-ansible | 06:22 | |
| *** sdake has quit IRC | 06:26 | |
| *** rgogunskiy has joined #openstack-ansible | 06:26 | |
| *** gkadam has quit IRC | 06:27 | |
| *** ivve has joined #openstack-ansible | 06:36 | |
| *** sdake has joined #openstack-ansible | 06:43 | |
| *** markvoelker has joined #openstack-ansible | 06:48 | |
| *** shyamb has quit IRC | 06:51 | |
| *** shyamb has joined #openstack-ansible | 06:55 | |
| *** miloa has joined #openstack-ansible | 07:00 | |
| miloa | Good morning :) | 07:00 |
| *** sdake has quit IRC | 07:15 | |
| *** rgogunskiy has quit IRC | 07:18 | |
| *** markvoelker has quit IRC | 07:20 | |
| *** ChosSimbaOne has quit IRC | 07:23 | |
| *** ChosSimbaOne has joined #openstack-ansible | 07:23 | |
| *** cmart has quit IRC | 07:32 | |
| *** kopecmartin|off is now known as kopecmartin | 07:34 | |
| *** cshen has joined #openstack-ansible | 07:37 | |
| *** shyamb has quit IRC | 07:39 | |
| *** shyamb has joined #openstack-ansible | 07:40 | |
| jrosser | Morning | 07:46 |
| ChosSimbaOne | Morning :-) | 07:47 |
| fnpanic | Morning | 07:50 |
| *** aedc has quit IRC | 07:53 | |
| *** hamzaachi has joined #openstack-ansible | 07:57 | |
| *** shyamb has quit IRC | 07:58 | |
| *** gkadam has joined #openstack-ansible | 08:02 | |
| *** maxbab has joined #openstack-ansible | 08:03 | |
| *** markvoelker has joined #openstack-ansible | 08:18 | |
| *** DanyC has joined #openstack-ansible | 08:23 | |
| *** pcaruana has joined #openstack-ansible | 08:32 | |
| *** DanyC has quit IRC | 08:33 | |
| *** tosky has joined #openstack-ansible | 08:39 | |
| CeeMac | morning | 08:45 |
| miloa | Hi, On OSA aio stable/rocky, tag 18.14, install_method: distro, on a CentOS 7 VM, when I deploy, I've got a failed test in tempest. The cirros instance seems to start, but tempest cannot connect with ssh. | 08:49 |
| *** markvoelker has quit IRC | 08:50 | |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests https://review.openstack.org/638755 | 08:54 |
| *** shyamb has joined #openstack-ansible | 08:55 | |
| miloa | here is the tempest report : http://paste.openstack.org/show/746476/ | 08:55 |
| miloa | When I play only the tempest-install.yml playbook I have se same error. Any help would be appreciate, thanks :) | 08:58 |
| *** rgogunskiy has joined #openstack-ansible | 09:00 | |
| *** rgogunskiy has quit IRC | 09:00 | |
| *** aedc has joined #openstack-ansible | 09:06 | |
| *** electrofelix has joined #openstack-ansible | 09:11 | |
| *** aedc has quit IRC | 09:14 | |
| *** sdake has joined #openstack-ansible | 09:16 | |
| *** olivierbourdon38 has joined #openstack-ansible | 09:20 | |
| *** phasespace has joined #openstack-ansible | 09:21 | |
| *** shyamb has quit IRC | 09:21 | |
| *** olivierbourdon38 has quit IRC | 09:22 | |
| *** rgogunskiy has joined #openstack-ansible | 09:23 | |
| *** shyamb has joined #openstack-ansible | 09:24 | |
| *** udesale has quit IRC | 09:28 | |
| *** udesale has joined #openstack-ansible | 09:29 | |
| chandankumar | miloa: It appears to be ssh timeout | 09:34 |
| chandankumar | miloa: can you check whether 172.29.249.133 is pingable | 09:34 |
| chandankumar | miloa: or look at the down of cirros image booting output | 09:35 |
| *** shyamb has quit IRC | 09:36 | |
| *** shyamb has joined #openstack-ansible | 09:36 | |
| fnpanic | hi | 09:37 |
| fnpanic | i switched from containers to bare metal for the elk stuff using the overlay-invetor | 09:38 |
| fnpanic | cleared the containers from dynamic inventroy with inventory manage | 09:38 |
| fnpanic | but still the haproxy config points to the containers | 09:38 |
| fnpanic | any ideas? | 09:38 |
| fnpanic | inventory-manage .-G shows the correct groups | 09:39 |
| fnpanic | in the playbook run i see that the entries are skipped on haproxy config | 09:40 |
| fnpanic | why? | 09:41 |
| *** shyamb has quit IRC | 09:41 | |
| openstackgerrit | Dmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_horizon master: Moved compilemessages to handlers https://review.openstack.org/639960 | 09:43 |
| fnpanic | i tried with --tags haproxy-config and without | 09:43 |
| fnpanic | :-( | 09:43 |
| *** sdake has quit IRC | 09:46 | |
| *** markvoelker has joined #openstack-ansible | 09:47 | |
| *** rgogunskiy has quit IRC | 09:49 | |
| miloa | chandankumar: yes, it is an ssh timeout. The problem to check if 172.29.249.133 is pingable, is that tempest erase the vm at end of tests. | 09:51 |
| chandankumar | miloa: tempest cleans its stuff as a tear down process during the tests | 09:52 |
| fnpanic | i found it | 09:54 |
| fnpanic | looks like the groups ware lacking _all because i have not loaded the overlay inventory for the haproxy run | 09:54 |
| miloa | chandankumar: yes, i know :) so i will try to do it manually. | 09:56 |
| *** aedc has joined #openstack-ansible | 10:02 | |
| miloa | chandankumar: I create manualy a cirros instance with floating ip 172.29.249.111 from the aio host it is pinguable but not from the lxc utiliy container. | 10:06 |
| chandankumar | miloa: it is allinone scenario na? | 10:08 |
| chandankumar | miloa: sorry so tempest is running from lxc container? | 10:09 |
| miloa | chandankumar: yes it is OSA aio stable/rocky, tag 18.14, install_method: distro, on a CentOS 7 VM. | 10:09 |
| chandankumar | jrosser: hello | 10:10 |
| chandankumar | jrosser: ^ please have a look at miloa issue when free! thanks! | 10:10 |
| *** DanyC has joined #openstack-ansible | 10:11 | |
| miloa | chandankumar: at the end of aio deployment the playbook os-tempest-install.yml is played. And tempest run from utility container, the results are stored in : /openstack/log/aio1_utility_container-xxxxxx/utility/stestr_results.html | 10:12 |
| *** aedc has quit IRC | 10:13 | |
| chandankumar | miloa: can you attach and see the tempest workspace there and ping from there | 10:13 |
| odyssey4me | miloa typically that means there's an issue in the network config somewhere, although I don't know enough to help you troubleshoot it | 10:14 |
| odyssey4me | the container/host running tempest will need a route to the public/external interface | 10:14 |
| *** shyamb has joined #openstack-ansible | 10:14 | |
| chandankumar | miloa: there is a task also https://github.com/openstack/openstack-ansible-os_tempest/blob/master/tasks/tempest_resources.yml#L282 | 10:14 |
| chandankumar | which does the same for you | 10:14 |
| *** DanyC has quit IRC | 10:17 | |
| miloa | chandankumar: do you mean something like lxc-attach -n utility-container ping ... ? | 10:19 |
| chandankumar | miloa: lxc-attach -n utility container | 10:20 |
| chandankumar | it will take you the container then try from there | 10:20 |
| * chandankumar has not tried this scenario | 10:20 | |
| miloa | already done : "I create manualy a cirros instance with floating ip 172.29.249.111 from the aio host it is pinguable but not from the lxc utiliy container." | 10:21 |
| miloa | :) | 10:21 |
| *** markvoelker has quit IRC | 10:21 | |
| *** sohny has joined #openstack-ansible | 10:21 | |
| chandankumar | miloa: as odyssey4me said that might be the issue | 10:22 |
| jrosser | well - shouldnt eth0/lxcbr0 NAT the utility container to the instance IP? | 10:22 |
| jrosser | this sounds like the failure to forward on bridges again | 10:23 |
| *** udesale has quit IRC | 10:24 | |
| *** udesale has joined #openstack-ansible | 10:24 | |
| jrosser | normally in an AIO the default route on eth0 should allow ping/ssh to tempest VM | 10:25 |
| odyssey4me | jrosser well, that would depend on the network setup - assuming this is not a standard AIO | 10:25 |
| jrosser | miloa> chandankumar: yes it is OSA aio stable/rocky, tag 18.14, install_method: distro, on a CentOS 7 VM. | 10:26 |
| jrosser | ^ me wonders about centos not forwarding again | 10:26 |
| *** DanyC has joined #openstack-ansible | 10:27 | |
| chandankumar | jrosser: we have changed stuff on os_temepst side | 10:27 |
| odyssey4me | or perhaps whether that tag doesn't include the required fix | 10:27 |
| jrosser | odyssey4me: i want to re-organise the AIO networking a bit when i get time | 10:28 |
| chandankumar | afaik, openstack-ansible might have different network configuraiton | 10:28 |
| chandankumar | ? | 10:28 |
| jrosser | make a "public" network that is for neutron and wired into the utility container for tempest | 10:28 |
| jrosser | and start to make the mgmt network more isolated rather than overload it for all these things | 10:28 |
| odyssey4me | bother, it looks like the opensuse 150 image is gone: http://logs.openstack.org/29/639729/1/check/openstack-ansible-deploy-aio_lxc-opensuse-150/4a8668c/logs/host/aria2c-image-prestage.log.txt.gz | 10:29 |
| odyssey4me | or the path or file name has changed | 10:29 |
| chandankumar | is it http://zuul.openstack.org/builds?job_name=openstack-ansible-deploy-aio_distro_lxc-centos-7 the same scenario which miloa has deployed? | 10:30 |
| miloa | In the default user_variables.yml for aio there is : tempest_public_subnet_cidr: "172.29.248.0/22" and from the utility container I can ping 172.29.248.1 which is the br-vlan address. The problem would come from br-vlan not forwarding ? | 10:31 |
| jrosser | miloa: https://github.com/openstack/ansible-role-systemd_networkd/commit/242b3c3fb4a3f8ebeba5c24cf8c7a510cba14143 | 10:32 |
| noonedeadpunk | folks, let me know what you think about https://review.openstack.org/#/c/639960/ I'm not sure, that I've choose the correct way - probably it would be enough just to make code the same in 2 places instead of creating handler | 10:33 |
| jrosser | miloa: https://review.openstack.org/#/c/636162/ | 10:33 |
| odyssey4me | aha, that's the problem: http://logs.openstack.org/29/639729/1/check/openstack-ansible-deploy-aio_lxc-opensuse-150/4a8668c/logs/ara-report/result/3a02f4ec-f992-4138-a146-b2118b9dc847/ | 10:34 |
| *** sohny has quit IRC | 10:34 | |
| *** sdake has joined #openstack-ansible | 10:37 | |
| *** shyamb has quit IRC | 10:37 | |
| *** mkuf has quit IRC | 10:37 | |
| openstackgerrit | Dmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_horizon master: Set appropriate branch key in _horizon_translations_pull https://review.openstack.org/639978 | 10:39 |
| miloa | jrosser: thanks :) I checked on aio host : ipv4/ip_forward is set to 1 but conf/br-vlan/forwarding is set to 0, I will change it to 1 and replay the os-tempest-install.yml and let you know. | 10:40 |
| miloa | jrosser: \o/ first test to ping manualy created instance from the utility container now works. I start replay the os-tempest-install.yml... | 10:43 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Fix image download URL regex for opensuse-leap-15.0 https://review.openstack.org/639981 | 10:50 |
| odyssey4me | jrosser evrardjp https://review.openstack.org/639981 should resolve the current opensuse 15 build failures | 10:50 |
| *** aedc has joined #openstack-ansible | 10:59 | |
| *** mkuf has joined #openstack-ansible | 10:59 | |
| *** mkucia_ has quit IRC | 11:01 | |
| *** mkuf has quit IRC | 11:12 | |
| *** mkuf_ has joined #openstack-ansible | 11:12 | |
| *** markvoelker has joined #openstack-ansible | 11:18 | |
| *** sdake has quit IRC | 11:18 | |
| *** sdake has joined #openstack-ansible | 11:20 | |
| *** shyamb has joined #openstack-ansible | 11:20 | |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible stable/queens: Remove heat_api_cloudfront from haproxy services https://review.openstack.org/639145 | 11:29 |
| *** aedc has quit IRC | 11:30 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_system_user_name/group for tempest directories https://review.openstack.org/640005 | 11:33 |
| chandankumar | odyssey4me: ^^ I am not sure it is correct, feel free to take a look when free, thanks! | 11:33 |
| CeeMac | anyone got a workaround for live migrations failing with host key verifications issues? | 11:35 |
| CeeMac | should qemu+ssh work oob or do i need to tweak some settings | 11:35 |
| CeeMac | or revert to qemu+tcp? | 11:35 |
| miloa | jrosser: I played the os-tempest-install.yml after setting manualy conf/br-vlan/forwarding to 1, but it failed, and the strange thing is that the conf/br-vlan/forwarding is back to 0, steps : http://paste.openstack.org/show/746482/ | 11:48 |
| *** markvoelker has quit IRC | 11:50 | |
| *** mkuf_ is now known as mkuf | 11:51 | |
| miloa | jrosser: replaying os-tempest-install.yml with -vvv and --diff to try to understand why conf/br-vlan/forwarding is set back to 0... | 11:52 |
| CeeMac | interesting, compute1 has authorized_keys in /var/lib/nova/.ssh/ but compute 2 doesnt | 11:54 |
| CeeMac | shouldn't that be set up when running setup-openstack using the nova-key tag? | 11:54 |
| *** sdake has quit IRC | 11:55 | |
| *** rgogunskiy has joined #openstack-ansible | 12:00 | |
| *** sm806 has quit IRC | 12:04 | |
| *** sm806 has joined #openstack-ansible | 12:05 | |
| *** shyamb has quit IRC | 12:14 | |
| *** ansmith_ has quit IRC | 12:38 | |
| *** fdz has joined #openstack-ansible | 12:43 | |
| CeeMac | ok, got around that by setting the variable to regenerate keys and not running the playbooks with the tag | 12:43 |
| CeeMac | I think this is the second time i've had issues with tags in nova playbook :( | 12:43 |
| miloa | jrosser: some more element, I found that conf/br-vlan/forwarding is set back to 0 when tempest create a router. So I try it creating a router manually in horizon, and conf/br-vlan/forwarding is set back to 0 | 12:44 |
| jrosser | miloa: really?! | 12:44 |
| CeeMac | having an issue with 'guest CPU doesn't match specification: missing features: vmx' now :/ | 12:44 |
| miloa | yes | 12:44 |
| jrosser | wow | 12:44 |
| miloa | I set a " watch -n 1 -d cat /proc/sys/net/ipv4/conf/br-vlan/forwarding" to check when exactly is go back to 0 | 12:45 |
| miloa | and when tempest create a router or when I create a router "manually from horizon dashboard" it is set back to 0 | 12:46 |
| *** markvoelker has joined #openstack-ansible | 12:47 | |
| miloa | so it is not a problem with os_tempest, I do not understand why when a router is created it change the value of /proc/sys/net/ipv4/conf/br-vlan/forwarding to 0. | 12:48 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_system_user/group_name for tempest directories https://review.openstack.org/640005 | 12:51 |
| *** shyamb has joined #openstack-ansible | 12:53 | |
| *** shyamb has quit IRC | 12:58 | |
| *** shyamb has joined #openstack-ansible | 13:01 | |
| miloa | jrosser: when I do not select public network when creating the router it did not change br-vlan/forwarding. But if I select public network, it change the value, and in /var/log/messages of aio host I've got "Feb 28 12:56:33 localhost systemd: Starting Network Service..." | 13:02 |
| miloa | jrosser: so there is a restart or reload of network service. And the forwarding value for the br-vlan is reset. | 13:03 |
| *** sm806 has quit IRC | 13:11 | |
| *** sm806 has joined #openstack-ansible | 13:11 | |
| *** rgogunskiy has quit IRC | 13:16 | |
| *** strattao has joined #openstack-ansible | 13:18 | |
| *** markvoelker has quit IRC | 13:20 | |
| CeeMac | anybody got any thoughts on why deploying nova to 2 identical hosts with the same variables would result in kvm nested virtualisation support being enabled on 1 host, but not the other? | 13:29 |
| jrosser | miloa: do you mean the ansible restarts the networking, or creating the neutron router with cli/horizon restarts the networking? | 13:29 |
| miloa | jrosser: creating the neutron router with cli/horizon restarts the networking | 13:31 |
| jrosser | jamesdenton: ^^^ | 13:31 |
| jamesdenton | hi | 13:32 |
| jrosser | we got some more non-forwarding funnies on centos by the look of things | 13:32 |
| jamesdenton | I cannot explain why networkd does the things it does | 13:32 |
| *** shyamb has quit IRC | 13:32 | |
| jrosser | hahaha | 13:32 |
| jamesdenton | um, i noticed stable/rocky. Were those patches backported? | 13:32 |
| guilhermesp | mornin | 13:33 |
| jamesdenton | mornin | 13:33 |
| jrosser | miloa: did you apply the patches i linked, or just enable the forwarding by hand? | 13:33 |
| miloa | I enable forwarding by hand | 13:33 |
| guilhermesp | I've seen since yesterday this failing accross two prs I submitted http://logs.openstack.org/11/639811/1/check/openstack-ansible-functional-centos-7/dcf4eaa/logs/ara-report/result/ae01869d-4840-4fa8-b47a-251e376e67a3/ | 13:33 |
| jrosser | miloa: perhaps hand edit the networkd config file to add the forwarding option | 13:33 |
| CeeMac | hi jamesdenton , guilhermesp | 13:33 |
| guilhermesp | jamesdenton CeeMac o/ | 13:34 |
| jamesdenton | miloa i think you'll want to hand edit the file like jrosser mentioned | 13:34 |
| jamesdenton | guilhermesp I noticed many tempest failures yesterday just hadn't dug into it | 13:35 |
| guilhermesp | yes, just started to notice now | 13:35 |
| jamesdenton | CeeMac Did you notice particular configurations existing on one but not the other? Can you elaborate? | 13:36 |
| miloa | jrosser: yes, I was thinking of that, but I am trying to find if i can set ipv4.conf.br-vlan.forwarding=1 to sysctl.conf.d and check if it works | 13:36 |
| jamesdenton | miloa that does not work | 13:36 |
| jamesdenton | Well, i take that back. A '-w' may not be persistent. I don't know that we trying editing sysctl.conf | 13:37 |
| *** ansmith has joined #openstack-ansible | 13:38 | |
| CeeMac | jamesdenton, i was getting an error about 'vmx' capabilities | 13:39 |
| fnpanic | hi | 13:39 |
| CeeMac | so i was asking the question in #openstack and someone said thats a module parameter for kvm on intel cpu and to check 3a | 13:40 |
| fnpanic | i just wanted to do a run of os-horizon playbook | 13:40 |
| CeeMac | so I did, and 1 host is Y and the other is N | 13:40 |
| fnpanic | i am getting this error | 13:40 |
| fnpanic | http://paste.openstack.org/show/746498/ | 13:40 |
| CeeMac | i got around it by setting the cpu arch to x86_64 in the flavor but was curious how it happened | 13:40 |
| fnpanic | pretty strange | 13:40 |
| jamesdenton | that's a good question, i don't really know. | 13:41 |
| CeeMac | that, and live migration breaks the novnc console | 13:42 |
| CeeMac | are today's fun | 13:42 |
| CeeMac | also, tags dont work for me with os-nova-install, specifically nova-key | 13:44 |
| CeeMac | which caused me other issues earlier | 13:44 |
| miloa | jrosser and jamesdenton: I edit /etc/systemd/network/13-general-br-vlan.network and add in section [Network] the value : IPForward=ipv4 and... it works \o/ the value do not change. | 13:45 |
| jamesdenton | fnpanic what version is this? | 13:45 |
| jamesdenton | yes, tags may be broken in spots | 13:46 |
| miloa | jrosser and jamesdenton: replaying the os-tempest-install.yml playbook | 13:46 |
| CeeMac | jamesdenton, it was just a little unfortunate as I'd followed the official documentation for adding a new host and with the tag not working the nova keys werent populated on the new host | 13:47 |
| jamesdenton | jrosser Thoughts on this? https://review.openstack.org/#/c/637026/. Curious to know if this would be a good approach to fixing some of the tag issues we're seeing | 13:47 |
| jamesdenton | CeeMac Understandable. See that patch ^^ on why (i think) it's happening | 13:48 |
| * CeeMac is looking | 13:49 | |
| fnpanic | jamesdenton: rocky on 18.04 | 13:51 |
| CeeMac | the includes' are getting deprecated in ansible right? I'm sure i've seen purple messages about that when running playbooks | 13:51 |
| jamesdenton | include has been replaced by include_tasks and import_tasks, from what i understand. | 13:52 |
| CeeMac | ah,yeah. it was 'import_playbooks' i've seen the message about, which is replacing the include for playbooks | 13:53 |
| jamesdenton | but i can't speak authoritatively on that | 13:53 |
| CeeMac | so i guess its a common theme | 13:53 |
| miloa | jrosser jamesdenton: \o/ os-tempest-install.yml : aio1_utility_container-8d5d4380 : ok=41 changed=4 unreachable=0 failed=0 | 13:58 |
| jamesdenton | fnpanic i assume you ran thru an install of OSA and are later running the os-horizon playbook? | 13:58 |
| jamesdenton | congrats miloa | 13:58 |
| jrosser | miloa: cool! | 14:00 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Fix image download URL regex for opensuse-leap-15.0 https://review.openstack.org/639981 | 14:04 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/rocky: Fix image download URL regex for opensuse-leap-15.0 https://review.openstack.org/640032 | 14:05 |
| fnpanic | jamesdenton: exactly | 14:05 |
| fnpanic | jamesdenton: was doing some theme install stuff | 14:05 |
| fnpanic | how can i debug this? | 14:05 |
| fnpanic | the repo is reachable but the path it tries to access does not exist | 14:05 |
| odyssey4me | chandankumar could you indicate why it is you've chosen to do it that way rather than like http://eavesdrop.openstack.org/irclogs/%23openstack-ansible/%23openstack-ansible.2019-02-27.log.html#t2019-02-27T15:14:20 in https://review.openstack.org/#/c/640005/2/tasks/tempest_post_install.yml ? | 14:06 |
| mnaser | o/ | 14:13 |
| *** markvoelker has joined #openstack-ansible | 14:18 | |
| jamesdenton | yeah, for some reason it is not populating the version. that may be why it says undefined | 14:19 |
| jamesdenton | so the var may not be accessible. but i don't know how it's constructing the url | 14:19 |
| fnpanic | here is the -vvv output | 14:20 |
| fnpanic | the end | 14:20 |
| fnpanic | http://paste.openstack.org/show/746504/ | 14:20 |
| *** phasespace has quit IRC | 14:20 | |
| *** ianychoi has joined #openstack-ansible | 14:20 | |
| fnpanic | mhh where is the version coming from? | 14:21 |
| openstackgerrit | Martin Kopec proposed openstack/ansible-role-python_venv_build master: Fix link for the project documentation https://review.openstack.org/640040 | 14:24 |
| chandankumar | odyssey4me: first I was trying to create those dirs just by using ansible user itself whether it works or not, if not work then I would go through the os_nova way | 14:25 |
| fnpanic | i think i know what maybe happend | 14:26 |
| fnpanic | i did yesterday a git pull on the /opt/openstack-ansible | 14:26 |
| odyssey4me | chandankumar I think it would be better to just not apply a user/group and let the distro decide that based on the user doing the action. | 14:26 |
| fnpanic | maybe something is broken upstream? | 14:26 |
| fnpanic | i heard discussions about the repo containers recently | 14:27 |
| chandankumar | odyssey4me: sure, so we are providing more choices to users/distro let them decide how they want | 14:28 |
| chandankumar | odyssey4me: one more thing, since we are going to change the user, how we are going to make sure package installation works as it requires sudo privilages | 14:29 |
| odyssey4me | fnpanic you may need to apply https://review.openstack.org/639672 | 14:29 |
| chandankumar | odyssey4me: at this part https://github.com/openstack/openstack-ansible-os_tempest/blob/master/tasks/tempest_install.yml#L17 | 14:29 |
| *** maxbab has quit IRC | 14:29 | |
| odyssey4me | chandankumar the role is assuming that it is run as root - if you're using a different user, then you should apply 'become: yes' at the playbook | 14:30 |
| chandankumar | odyssey4me: is it not possible to apply at that task level as apart from that we donot need sudo privilages? as tempest is just an application | 14:31 |
| openstackgerrit | Gabriele Santomaggio proposed openstack/openstack-ansible-rabbitmq_server master: The pattern '^(?!(amqp.)|(.*_fanout_)|(reply_)).*' excludes: https://review.openstack.org/639299 | 14:32 |
| odyssey4me | chandankumar well, there are several things done in the role which assume root... of course it could be changed, and that'd be a nice change | 14:33 |
| chandankumar | odyssey4me: let me handle the user part and then go with that part, thanks :-) | 14:34 |
| *** marens has joined #openstack-ansible | 14:34 | |
| mnaser | odyssey4me: yeah assuming our roles dont run as root would be _neat_ | 14:35 |
| *** maxbab has joined #openstack-ansible | 14:36 | |
| odyssey4me | fnpanic also, do you have this patch in your git tree? https://github.com/openstack/openstack-ansible/commit/c75211306d41bd76babccd9273063eca49709b47 | 14:39 |
| odyssey4me | fnpanic if so, when you updated git did you bootstrap-ansible again, like you always should after updating git? | 14:40 |
| odyssey4me | updating the git repo for openstack-ansible I mean | 14:40 |
| mnaser | historically | 14:41 |
| mnaser | have we assumed our roles are openstack specific? | 14:41 |
| odyssey4me | mnaser sort-of, given that they're mostly only used within OSA | 14:41 |
| mnaser | odyssey4me: ah, i was hoping we can maybe slowly try to make our more infrastructure based roles less specific -- mostly around the context of https://review.openstack.org/#/c/639299/2 | 14:42 |
| odyssey4me | I see the discussion in https://review.openstack.org/639299 and it got me thinking that for the more generic roles, perhaps we should have a nice and easy flag to enable/disable the openstack assumptions. | 14:42 |
| fnpanic | odyssey4me: no did not upgrade | 14:42 |
| fnpanic | will need to follow the upgrade procedure | 14:43 |
| mnaser | i think we can document it or something, we would need to have a hard decision on this | 14:43 |
| odyssey4me | mnaser it'd be better to keep the stuff in the roles where possible, because it makes them easier to find and maintain - but have a flag to turn on the openstack use-case, then turn that flag on in group_vars... or another option is, in defaults, to check for the existance of certain groups which tells us it's an openstack environment | 14:44 |
| mnaser | odyssey4me: i like that, i think ceph-ansible does something similar? | 14:44 |
| *** dxiri has joined #openstack-ansible | 14:45 | |
| openstackgerrit | Mikael Loaec proposed openstack/openstack-ansible master: Forwarding for br-vlan in aio does not persist https://review.openstack.org/640053 | 14:45 |
| mnaser | https://github.com/ceph/ceph-ansible/blob/d7e77012ef4fe523762928c5d0081ff773be7068/roles/ceph-osd/tasks/main.yml#L89-L95 | 14:46 |
| odyssey4me | mnaser yeah, something like that - in this case we wouldn't need another task file though | 14:47 |
| *** aedc has joined #openstack-ansible | 14:49 | |
| *** markvoelker has quit IRC | 14:50 | |
| miloa | https://review.openstack.org/640053 if accepted, it would be cool if we can backport it to 18.1.4 because without it the users who follow the all in one quick install from doc will always have errors as 18.1.4 is the advised tag to use in the doc. | 14:51 |
| *** maxbab has quit IRC | 14:52 | |
| mnaser | miloa: the way it would work is that once we merge this and release a new version, the docs will update and advise to point at the newer version | 14:54 |
| mnaser | odyssey4me: how much do you feel like maybe posting about this to the ML for us to discuss it? :P | 14:54 |
| odyssey4me | mnaser I just posted in review. I don't really feel like it needs discussion, given that there's a simple enough solution. | 14:55 |
| evrardjp | mnaser: I think odyssey4me's solution is elegant for the rabbitmq part | 15:06 |
| evrardjp | but I think it should be done in a different commit :p | 15:07 |
| evrardjp | first adapt the bad default, then make it optional eventually | 15:07 |
| miloa | mnaser: ok, but i am a bit worry :) because users who wants to use openstack-ansible for their production (like us) begin with the aio and apply what they read in the doc for testing. So if it ends with errors perhaps they will no search more and go away :). Because actually the aio install always fails. :) | 15:07 |
| evrardjp | isn't that a bad experience for a first contributor to have to go through those hoops? | 15:07 |
| mnaser | evrardjp: are you nominating yourself to make that follow up patch :D | 15:08 |
| evrardjp | anyway -- I will help him | 15:08 |
| evrardjp | fine for me | 15:08 |
| jamesdenton | miloa You're saying the AIO fails with tempest, right? | 15:08 |
| miloa | yes | 15:08 |
| odyssey4me | evrardjp mnaser I'm happy to do the follow up if the new contributor can't see how it can be done, but if you're also happy to do it then great. | 15:10 |
| *** shyamb has joined #openstack-ansible | 15:10 | |
| miloa | but if we apply : https://review.openstack.org/640053 it must work. And the failure is not only tempest related. | 15:10 |
| evrardjp | I just want to help -- if it takes me an extra minute, it's not bad :) | 15:10 |
| odyssey4me | ++ | 15:10 |
| evrardjp | I also want to make sure the good practices are taught :) | 15:10 |
| jamesdenton | There were patches implemented to fix this in master, IIRC. They may just a) need to be backported and/or b) aio network build needs to be tweaked | 15:12 |
| jamesdenton | miloa you could always use ubuntu :D | 15:12 |
| *** ivve has quit IRC | 15:13 | |
| miloa | jamesdenton: not only tempest, because if connect to aio horizon and create a router you will not be able to ping or connect to your instances through lxc utility container nor from the aio host. | 15:13 |
| jamesdenton | right - the patches weren't tempest specific, but they set a ipforward config in the networkd template | 15:14 |
| miloa | jamesdenton: no, because it is our organisation choice to use CentOS. | 15:15 |
| jamesdenton | but for an AIO, the bridge configuration needs to call out 'ipforward: true', which may not be happening | 15:15 |
| jamesdenton | miloa that's fine, just teasing | 15:15 |
| miloa | jamesdenton: :) | 15:15 |
| chandankumar | odyssey4me: just one stupid question | 15:32 |
| chandankumar | odyssey4me: https://github.com/openstack/openstack-ansible-os_nova/blob/master/tasks/nova_pre_install.yml#L85 -> we need tempest user/group needs to be created na if not exists? | 15:33 |
| odyssey4me | chandankumar For tempest, I would think that we shouldn't create or use any user account specifically - it should just deploy using whatever user ansible is accessing the machine as | 15:35 |
| openstackgerrit | Gabriele Santomaggio proposed openstack/openstack-ansible-rabbitmq_server master: Improve the Highly Available (Mirrored) Queues policy https://review.openstack.org/639299 | 15:38 |
| *** hamzaachi has quit IRC | 15:39 | |
| *** shyamb has quit IRC | 15:42 | |
| *** markvoelker has joined #openstack-ansible | 15:47 | |
| *** sm806 has quit IRC | 15:56 | |
| *** sm806 has joined #openstack-ansible | 15:57 | |
| *** cmart has joined #openstack-ansible | 16:13 | |
| *** cshen has quit IRC | 16:13 | |
| *** udesale has quit IRC | 16:13 | |
| chandankumar | odyssey4me: let me modify my patch! | 16:15 |
| *** mathlin has quit IRC | 16:15 | |
| *** mathlin has joined #openstack-ansible | 16:16 | |
| *** markvoelker has quit IRC | 16:21 | |
| *** fdz has quit IRC | 16:25 | |
| *** strattao_ has joined #openstack-ansible | 16:28 | |
| *** strattao has quit IRC | 16:29 | |
| *** strattao_ is now known as strattao | 16:29 | |
| *** chandankumar is now known as raukadah | 16:34 | |
| *** devx has joined #openstack-ansible | 16:39 | |
| *** fdz has joined #openstack-ansible | 16:40 | |
| *** hamzy has quit IRC | 16:40 | |
| *** macza has joined #openstack-ansible | 16:41 | |
| *** fdz has quit IRC | 16:48 | |
| *** fdz has joined #openstack-ansible | 16:50 | |
| *** fdz has quit IRC | 16:56 | |
| *** sm806 has quit IRC | 16:56 | |
| *** sm806 has joined #openstack-ansible | 16:56 | |
| *** electrofelix has quit IRC | 16:59 | |
| *** sm806 has quit IRC | 17:03 | |
| *** sm806 has joined #openstack-ansible | 17:03 | |
| *** shananigans has joined #openstack-ansible | 17:05 | |
| *** gkadam has quit IRC | 17:08 | |
| *** strattao has quit IRC | 17:13 | |
| *** kopecmartin is now known as kopecmartin|off | 17:17 | |
| *** markvoelker has joined #openstack-ansible | 17:18 | |
| *** hogepodge has left #openstack-ansible | 17:20 | |
| *** cmart has quit IRC | 17:33 | |
| *** DanyC has quit IRC | 17:35 | |
| *** DanyC has joined #openstack-ansible | 17:35 | |
| *** hwoarang has quit IRC | 17:38 | |
| *** hwoarang has joined #openstack-ansible | 17:39 | |
| *** DanyC has quit IRC | 17:40 | |
| *** gyee has joined #openstack-ansible | 17:44 | |
| miloa | jamesdenton: are you using Ubuntu ? you do not have the br-vlan problem ? | 17:45 |
| *** cmart has joined #openstack-ansible | 17:49 | |
| *** markvoelker has quit IRC | 17:51 | |
| miloa | jamesdenton: if you are using Ubuntu, which method to you use ? source or distro ? because I just finish to deploy on CentOS AIO with method 'source' and there is no tempest fail. | 17:51 |
| *** strattao has joined #openstack-ansible | 17:51 | |
| * miloa wondering if the problem is related to RDO packages, 'cause with source install method there is no error. ref : https://review.openstack.org/640053 | 17:52 | |
| raukadah | miloa: if it is a packaging problem on rdo side, I will get it fixed! | 17:53 |
| miloa | raukadah: thanks :) | 17:54 |
| raukadah | cloudnull: around? | 17:55 |
| *** aludwar has quit IRC | 17:56 | |
| raukadah | cloudnull: I have an idea I want to experiment in ci remove action plugins path we are setting in ansible.cfg to check whether defaults /usr/share picks or not from pip insyall | 17:56 |
| raukadah | *install | 17:56 |
| *** fdz has joined #openstack-ansible | 17:59 | |
| jrosser | miloa: generally most people are using the source installs, distro *should* | 18:02 |
| jrosser | miloa: interested to hear why you choose the distro install :) | 18:02 |
| jrosser | i mean, distro *should* work | 18:02 |
| openstackgerrit | Chandan Kumar proposed openstack/ansible-role-python_venv_build master: [WIP]Use share/ansible/roles for data files https://review.openstack.org/640133 | 18:04 |
| raukadah | this whole ansible role path is a mess | 18:06 |
| raukadah | may be mazer can solve it | 18:06 |
| raukadah | unless you have multiple ansible.cfg files on system | 18:07 |
| miloa | jrosser: because distro install quickly :) and because I was thinking that distro (RDO package) are more stable in particular when you have to scale out and you are in production. Actually we are using AIO in order to learn. | 18:07 |
| miloa | jrosser: but the final objective is to use it to our pre-production cloud and then to our production (if there is one :) ) | 18:08 |
| *** dxiri has quit IRC | 18:08 | |
| miloa | jrosser: so if it works, i think i will stick to this channel for a long time. lol | 18:11 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: [wip] use requirments.txt for managing os_tempest dependency https://review.openstack.org/640138 | 18:12 |
| raukadah | mnaser: evrardjp as discussed on os_tempest deps management I have putted few patches https://review.openstack.org/#/q/topic:ostempest_packaging+(status:open+OR+status:merged) I will exercise it tomorrow | 18:13 |
| raukadah | feel free to take a look | 18:13 |
| *** hamzy has joined #openstack-ansible | 18:13 | |
| raukadah | as we have one action plugins | 18:14 |
| raukadah | using galaxy solves roles issue but not action plugin | 18:14 |
| evrardjp | raukadah: it does if you havne't configured things | 18:15 |
| evrardjp | but I have to go -- we can talk about that later | 18:15 |
| raukadah | mazer may solve it https://github.com/ansible/mazer/wiki/Module-Install-Use-Cases | 18:18 |
| jrosser | miloa: the distro vs source install in the AIO gate is 1hr20 vs 1hr50.... but for an AIO. I think the reality is that you are not going to gain a massive amount. | 18:21 |
| *** cmart has quit IRC | 18:22 | |
| jrosser | Just be clear why you make the choice - it’s much harder to locally patch your stuff with distro packages, that may or may not be important to you | 18:22 |
| miloa | jrosser: Thanks :), I am not the only one to decide :) and I think that using source for some people is something frightning. But I will propose it at our next team meeting. So if you have more point in favor of source vs distro. I will be happy to ear them :) | 18:26 |
| jrosser | There are just pros and cons both ways :) | 18:26 |
| raukadah | miloa: jrosser if you need stable go with distro, config is something distro nevers care about! | 18:27 |
| raukadah | may be I am naive in that area just a small college passout kid trying to learn stuff! | 18:28 |
| jrosser | So for the avoidance of doubt an OSA source install is stable. I don’t think that is a good basis to choose, on stability. | 18:29 |
| miloa | jrosser: about the br-vlan problem, I test a distro deploy adding "ipforward: true" to user_variables.yml and... it works :) so perhaps we only need to add something in the doc and not change de code :) | 18:29 |
| raukadah | jrosser: this topic is kind of debatable, it depends on users what they want! | 18:30 |
| raukadah | and what works for them! | 18:30 |
| jrosser | Indeed like I say pros and cos both ways, I don’t want a flamewar | 18:30 |
| raukadah | jrosser: :-) I totally agree :-) | 18:30 |
| miloa | Sorry, I have to go, many thanks to all for your help and advices :) see you tomorrow. | 18:32 |
| *** miloa has quit IRC | 18:35 | |
| *** sdake has joined #openstack-ansible | 18:44 | |
| *** cshen has joined #openstack-ansible | 18:47 | |
| *** markvoelker has joined #openstack-ansible | 18:47 | |
| *** cshen has quit IRC | 18:51 | |
| *** palendae has joined #openstack-ansible | 18:52 | |
| *** DanyC has joined #openstack-ansible | 19:10 | |
| *** pcaruana has quit IRC | 19:14 | |
| *** markvoelker has quit IRC | 19:21 | |
| *** DanyC has quit IRC | 19:28 | |
| *** KenCrandall has joined #openstack-ansible | 19:32 | |
| openstackgerrit | Nicolas Bock proposed openstack/openstack-ansible-openstack_hosts master: Add vendor override for openSUSE repositories https://review.openstack.org/639745 | 19:45 |
| *** sdake has quit IRC | 20:07 | |
| *** goldenfri has joined #openstack-ansible | 20:23 | |
| *** DanyC has joined #openstack-ansible | 20:29 | |
| *** Leo_m has joined #openstack-ansible | 20:29 | |
| *** hamzy has quit IRC | 20:39 | |
| *** hamzy has joined #openstack-ansible | 20:43 | |
| *** strattao has quit IRC | 20:44 | |
| *** cshen has joined #openstack-ansible | 20:47 | |
| *** cshen has quit IRC | 20:52 | |
| *** bruvik has quit IRC | 20:56 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Convert include to either import_playbook or include_tasks https://review.openstack.org/638562 | 20:59 |
| openstackgerrit | Merged openstack/openstack-ansible master: Remove broken conditions when including playbooks https://review.openstack.org/638575 | 21:00 |
| *** sdake has joined #openstack-ansible | 21:03 | |
| *** spatel has joined #openstack-ansible | 21:17 | |
| spatel | jamesdenton: what is that tweet about? | 21:17 |
| *** sdake has quit IRC | 21:23 | |
| spotz | bad day at Rackspace:( | 21:24 |
| *** sdake has joined #openstack-ansible | 21:25 | |
| *** vnogin has joined #openstack-ansible | 21:36 | |
| *** ansmith has quit IRC | 21:38 | |
| *** ppetit has quit IRC | 21:40 | |
| d34dh0r53 | yep, rough day | 21:42 |
| *** hamzy has quit IRC | 21:47 | |
| *** markvoelker has joined #openstack-ansible | 21:48 | |
| spotz | you ok d34dh0r53? | 21:49 |
| d34dh0r53 | yeah :( really sad day though | 21:49 |
| spotz | I know:( | 21:49 |
| *** sdake has quit IRC | 22:13 | |
| *** markvoelker has quit IRC | 22:22 | |
| * mnaser hands hugs | 22:24 | |
| *** cshen has joined #openstack-ansible | 22:47 | |
| *** cshen has quit IRC | 22:52 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/rocky: Drop SELinux support for CentOS 7 https://review.openstack.org/639617 | 22:53 |
| *** DanyC has quit IRC | 22:53 | |
| *** luksky has joined #openstack-ansible | 22:55 | |
| *** luksky has quit IRC | 23:03 | |
| *** eumel8 has quit IRC | 23:05 | |
| *** markvoelker has joined #openstack-ansible | 23:18 | |
| *** markvoelker has quit IRC | 23:24 | |
| *** markvoelker has joined #openstack-ansible | 23:24 | |
| *** shananigans has quit IRC | 23:34 | |
| *** ansmith has joined #openstack-ansible | 23:38 | |
| *** fdz has quit IRC | 23:44 | |
| *** Leo_m has quit IRC | 23:53 | |
| *** hwoarang has quit IRC | 23:57 | |
| *** hwoarang has joined #openstack-ansible | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!