Friday, 2019-07-19

*** weifan has quit IRC00:08
openstackgerritmelanie witt proposed openstack/openstack-ansible master: Revert "Use non-broken commit for NoVNC"  https://review.opendev.org/67164200:19
*** gokhani has quit IRC00:20
*** melwitt has joined #openstack-ansible00:23
*** vnogin has joined #openstack-ansible00:51
*** TxGirlGeek has joined #openstack-ansible00:56
*** vnogin has quit IRC00:56
*** BjoernT has joined #openstack-ansible00:57
*** BjoernT has quit IRC00:58
*** gyee has quit IRC01:00
openstackgerritMerged openstack/openstack-ansible-os_swift master: Convert dynamic includes to static imports  https://review.opendev.org/67132901:03
*** BjoernT has joined #openstack-ansible01:17
*** BjoernT has quit IRC01:24
*** TxGirlGeek has quit IRC02:05
*** joshualyle has joined #openstack-ansible02:22
*** vnogin has joined #openstack-ansible03:23
*** vnogin has quit IRC03:28
*** rpittau|afk is now known as rpittau03:44
*** udesale has joined #openstack-ansible04:04
*** shyamb has joined #openstack-ansible04:15
*** pcaruana has joined #openstack-ansible04:37
*** rpittau is now known as rpittau|Imonapla04:38
*** rpittau|Imonapla is now known as rpittau|flying04:38
*** poopcat has quit IRC04:51
*** poopcat has joined #openstack-ansible04:52
*** poopcat has quit IRC04:58
*** TxGirlGeek has joined #openstack-ansible05:22
*** TxGirlGeek has quit IRC05:23
*** KeithMnemonic has quit IRC05:24
*** raukadah is now known as chandankumar05:36
*** KeithMnemonic has joined #openstack-ansible05:40
*** udesale has quit IRC05:42
*** udesale has joined #openstack-ansible05:42
*** cshen has joined #openstack-ansible05:47
*** joshualyle has quit IRC05:49
*** shyamb has quit IRC05:50
*** KeithMnemonic has quit IRC05:51
*** jbadiapa has quit IRC06:03
*** udesale has quit IRC06:12
*** KeithMnemonic has joined #openstack-ansible06:15
*** udesale has joined #openstack-ansible06:17
*** stuartgr has quit IRC06:23
*** stuartgr has joined #openstack-ansible06:24
*** miloa has joined #openstack-ansible06:41
miloaMorning06:42
miloaI've got some questions about the ceph_client role. I saw that I can provide a file for ceph.conf, so osa does not get it from mons. But for keyrings i don't see any option to provide the files in order to not get from mons.06:47
*** shyamb has joined #openstack-ansible06:48
miloaThere is a variable to set to provide keyrings files "manualy" like ceph.conf file ?06:49
jrossermiloa: remeber that OSA just calls the ceph-ansible roles06:54
jrosserso you set vars in OSA host/group vars and these get picked up by ceph-ansible06:55
jrosserso it's more a question of if ceph-ansible can do what you want06:55
jrossermiloa: i'm assuming you are not able to have the playbooks ssh to the ceph mons to retrieve this data06:57
miloajrosser: the ceph_client role is part of ceph-ansible role ? because reading the code it seems that ceph_client is part of osa.06:59
jrosseroh right, yes thats correct06:59
jrosserceph_extra_confs i think07:00
jrossermiloa: there seems to be an example right here in the docs for keyrings coming from the deploy host https://github.com/openstack/openstack-ansible-ceph_client/blob/master/doc/source/configure-ceph.rst07:01
miloajrosser: yes I saw it, but seems to work only for extra conf files, but for the main/principal ceph.conf it seems it does not apply.07:03
jrosseri'm a bit confused - you asked about keyrings specifically?07:04
miloayes07:04
miloaIn the user_variables I can define my ceph.conf file content, but I can not specify keyrings files.07:05
jrosserand keyring_src/keyring_dest in ceph_extra_confs is not right? that seems to reference keyring sources on the deploy host07:07
miloathe problem is that it applies first ceph-auth (so as i cannot ssh to the mons it fails) then ceph-auth-extra where i can specify keyrings files.07:12
*** zbr has quit IRC07:15
*** zbr has joined #openstack-ansible07:16
*** joshualyle has joined #openstack-ansible07:22
*** tosky has joined #openstack-ansible07:24
*** shyamb has quit IRC07:34
*** shyamb has joined #openstack-ansible07:35
*** gokhani has joined #openstack-ansible07:38
*** ivve has joined #openstack-ansible07:44
*** dr_feelgood has quit IRC07:46
*** luksky11 has joined #openstack-ansible07:46
*** jbadiapa has joined #openstack-ansible07:49
*** dr_feelgood has joined #openstack-ansible07:50
*** shyamb has quit IRC07:59
*** shyamb has joined #openstack-ansible08:02
*** dr_feelgood has quit IRC08:03
*** dr_feelgood has joined #openstack-ansible08:05
*** rpittau|flying is now known as rpittau08:13
noonedeadpunkjrosser (and everyone) - I'd not vote on these sync tasks, as I'm going to drop xenial from vagrantfile08:17
noonedeadpunkI hope that this will just cause update of existing patches08:18
jrossernoonedeadpunk: yes i left them all unmerged because there was something odd about the opensuse additions too08:18
jrosserboth had the same box name for 15.0 and 15.108:18
noonedeadpunkSo you was already making fix for this?08:18
jrosserand it was unclear if that was intentional or a mistake08:18
noonedeadpunkAh, ok08:18
jrossernoonedeadpunk: this is ready https://review.opendev.org/#/c/671454/08:19
jrosserand this would be good to merge too as its a bugfix https://review.opendev.org/#/c/671157/08:20
jrossermiloa: i think that you should look at if its possible to add a new boolen default var to ceph_client which stops it from running ansible tasks against the mon hosts08:21
noonedeadpunkdon't we rely on .my.cnf in terms of mysql_db and mysql_user modules?08:22
noonedeadpunkSo since my.cnf will define host, there shouldn't be a problem?08:22
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible-galera_client/src/branch/master/templates/client.my.cnf.j208:23
noonedeadpunkor it covers the case of delegating to host, which doesn't have my.cnf ? But in this case it will be missing username and password08:26
miloajrosser: thanks, i will check that. Perhaps will try to propose some code modification (althrought, i am not a developper :) )08:26
jrossermiloa: dont worry :) you should be able to find examples in the rest of the code08:27
jrosseradding extra  "when: ceph_client_mon_access is true" to the tasks that fail should let you move through it step my step08:28
*** shyamb has quit IRC08:29
jrossernoonedeadpunk: so right now the ansible module tries to contact localhost which is the ansible default for that module https://docs.ansible.com/ansible/2.5/modules/mysql_db_module.html08:29
jrosseri'd have to dig a bit into the ansible code i think but it doesnt say anything about taking settings from the mysql config files08:29
jrosseralthough i don't have particularly extensive experience with mysql08:30
noonedeadpunkBut it has config_file which defaults to ~/.my.cnf08:30
noonedeadpunkhowever I'm not sure that it takes host from it, since it's a bit unclear....08:31
jrosserso the other thing is that https://opendev.org/openstack/openstack-ansible-galera_client/src/branch/master/templates/client.my.cnf.j2 could indeed be the source of the connection to 'localhost'08:32
jrossernow that you point to that file :)08:32
jrosserso i could easily try a test patch to that to try connecting to the actual hostname rather than localhost08:32
*** shyamb has joined #openstack-ansible08:32
*** gtarnaras has joined #openstack-ansible08:33
*** cshen has quit IRC08:33
noonedeadpunkWondering how safe it's to drop https://opendev.org/openstack/openstack-ansible-tests/src/branch/master/zuul.d/jobs.yaml#L131-L15008:38
*** dr_feelgood has quit IRC08:46
*** siqbal has joined #openstack-ansible08:46
*** dr_feelgood has joined #openstack-ansible08:49
*** cshen has joined #openstack-ansible08:50
jrossernoonedeadpunk: well, for tests on master that use the integrated repo and try to use xenial, they'll fail now anyway with this merged https://github.com/openstack/openstack-ansible/commit/8c0f5c119acec11fcae8284aef1ecdabb125ea3908:50
noonedeadpunkI'm more worried about ones w/o integrated tests08:51
jrosserjust beware theres a bionic job in the middle of the ones you linked08:51
noonedeadpunkyep, already saw it08:51
noonedeadpunkthanks)08:51
jrosseryes, i wonder how easy it is to find those08:52
noonedeadpunkat least found galera_client and nspawn_hosts08:52
jrosserslightly sad that you don't seem to be able to add filters with wildcards here http://zuul.openstack.org/builds?branch=master08:54
*** dr_feelgood has quit IRC08:54
noonedeadpunkyeah:(08:55
*** cshen has quit IRC08:55
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-galera_client master: Drop support for Ubuntu Xenial  https://review.opendev.org/67168508:57
*** shyamb has quit IRC08:58
*** shyamb has joined #openstack-ansible08:58
jrossernoonedeadpunk: shouldnt we convert the xenial job there to bionic? or is it a useless test now?08:59
noonedeadpunkI thought it's using integrated tests and xenial is just extra from templates09:00
noonedeadpunkso zuul is testing bionic09:00
noonedeadpunkat least queued it:)09:01
*** dr_feelgood has joined #openstack-ansible09:01
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-nspawn_hosts master: Drop support for Ubuntu Xenial  https://review.opendev.org/67168709:05
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-tests master: Drop support for Ubuntu Xenial  https://review.opendev.org/67168909:10
*** cshen has joined #openstack-ansible09:11
jrossernoonedeadpunk: yes sure but the removed xenial job was an special case ssl test?09:13
*** cshen has quit IRC09:16
noonedeadpunkhm, maybe I missunderstood smth, but shouldn't here https://opendev.org/openstack/openstack-ansible-galera_client/src/branch/master/tox.ini be smth called "ssl" then?09:26
noonedeadpunkor how it works then?09:27
noonedeadpunkjrosser: ^09:28
*** yolanda has quit IRC09:30
evrardjphey, did Taseer show up in this channel? I was in a trip, and I didn't have a chance to say hi09:35
*** cshen has joined #openstack-ansible09:38
*** gtarnaras has quit IRC09:41
*** gtarnaras has joined #openstack-ansible09:46
*** vnogin has joined #openstack-ansible09:55
*** vnogin has quit IRC10:01
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_gnocchi master: service_setup: refactor service setup to a single file  https://review.opendev.org/67047110:01
*** udesale has quit IRC10:05
*** udesale has joined #openstack-ansible10:06
*** shyamb has quit IRC10:13
*** shyamb has joined #openstack-ansible10:13
*** luksky11 has quit IRC10:28
*** shyamb has quit IRC10:41
*** udesale has quit IRC10:44
*** udesale has joined #openstack-ansible10:45
*** dr_feelgood has quit IRC10:46
*** udesale has quit IRC10:54
*** udesale has joined #openstack-ansible10:55
*** luksky11 has joined #openstack-ansible10:56
*** udesale has quit IRC11:02
*** kplant has joined #openstack-ansible11:15
*** shyamb has joined #openstack-ansible11:40
*** dr_feelgood has joined #openstack-ansible11:48
*** cshen has quit IRC11:48
*** dr_feelgood has quit IRC11:49
*** cshen has joined #openstack-ansible11:49
*** dr_feelgood has joined #openstack-ansible11:49
*** spatel has joined #openstack-ansible11:52
*** dr_feelgood has quit IRC12:01
*** dr_feelgood has joined #openstack-ansible12:02
*** spatel has quit IRC12:08
*** dr_feelgood has quit IRC12:09
*** dr_feelgood has joined #openstack-ansible12:09
*** dr_feelgood has quit IRC12:11
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Use systemd-journald instead of log files  https://review.opendev.org/67171112:11
*** dr_feelgood has joined #openstack-ansible12:12
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: service_setup: refactor service setup to a single file  https://review.opendev.org/67047312:13
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: service_setup: refactor service setup to a single file  https://review.opendev.org/67148412:14
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: service_setup: refactor service setup to a single file  https://review.opendev.org/67148412:16
mnaserevrardjp: not sure :X12:19
mnaserevrardjp: but i fixed this for you :) https://review.opendev.org/#/c/671488/12:19
*** udesale has joined #openstack-ansible12:21
*** joshualyle has quit IRC12:23
*** gokhani has quit IRC12:23
mnasercan i get reviews on this to fix our stable branches after backport: https://review.opendev.org/#/c/671569/12:24
*** dr_feelgood has quit IRC12:24
*** vnogin has joined #openstack-ansible12:29
*** shyamb has quit IRC12:30
*** dr_feelgood has joined #openstack-ansible12:32
openstackgerritMerged openstack/openstack-ansible-os_manila master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67160512:34
openstackgerritMerged openstack/openstack-ansible-ops master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158912:35
openstackgerritMerged openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162312:36
*** spatel has joined #openstack-ansible12:36
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_zun stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67171512:37
*** goldyfruit has quit IRC12:37
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67171612:39
*** shyamb has joined #openstack-ansible12:40
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158312:40
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158612:42
*** spatel has quit IRC12:42
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158512:43
*** shyamb has quit IRC12:44
*** shyamb has joined #openstack-ansible12:44
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158212:45
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67157712:45
*** dr_feelgood has quit IRC12:46
openstackgerritMerged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162412:46
*** poopcat has joined #openstack-ansible12:48
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Drop support for Ubuntu Xenial  https://review.opendev.org/67168712:48
*** udesale has quit IRC12:49
*** dr_feelgood has joined #openstack-ansible12:51
openstackgerritMerged openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162612:51
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158112:52
*** dr_feelgood has quit IRC12:53
*** udesale has joined #openstack-ansible12:53
openstackgerritMerged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67163112:54
*** dr_feelgood has joined #openstack-ansible13:00
*** dr_feelgood has quit IRC13:01
*** dr_feelgood has joined #openstack-ansible13:04
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_keystone stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67171913:10
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_cinder stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67172213:14
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_aodh stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67172413:18
*** shyamb has quit IRC13:19
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67172613:27
openstackgerritMerged openstack/openstack-ansible-tests master: sync: keep doc/requirements.txt syncd across all repos  https://review.opendev.org/67148813:29
openstackgerritMerged openstack/openstack-ansible-os_zun master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162213:30
noonedeadpunkmnaser: looks like swift passes journalctl and works http://logs.openstack.org/11/671711/1/check/openstack-ansible-deploy-aio_metal-ubuntu-bionic/33e0e41/logs/host/13:31
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/stein: Add placement client for neutron  https://review.opendev.org/67115713:32
*** dr_feelgood has quit IRC13:33
mnasernoonedeadpunk: nice :D13:34
*** goldyfruit has joined #openstack-ansible13:34
*** dr_feelgood has joined #openstack-ansible13:34
noonedeadpunkBut gnocchi and service setup has problems with bionic http://logs.openstack.org/71/670471/4/check/openstack-ansible-deploy-aio_distro_metal-ubuntu-bionic/38f6c7c/logs/ara-report/result/f15c55cf-cedc-438f-ad07-97b0c7487d3e/13:35
noonedeadpunkWhat makes things more interesting, that debian passed this part before recheck13:36
openstackgerritMerged openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67163313:36
*** dr_feelgood has quit IRC13:37
*** siqbal has quit IRC13:37
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158413:39
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162913:39
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162013:40
openstackgerritMerged openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67163513:40
openstackgerritMerged openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67163213:40
*** siqbal has joined #openstack-ansible13:40
miloajrosser: actually testing a patch on our pre-prod infra in order to provide keyrings from files for ceph_client role (ceph_auth.yml) if it works, will propose it to review :)13:40
jrossermiloa: thats fabulous - thanks for taking the time to dig into it13:41
openstackgerritMerged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159713:41
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161613:41
openstackgerritMerged openstack/openstack-ansible-os_placement master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161413:42
*** strattao has joined #openstack-ansible13:43
*** vnogin has quit IRC13:43
openstackgerritMerged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158013:43
openstackgerritMerged openstack/ansible-config_template master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67163013:44
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159413:44
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162813:45
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158713:46
openstackgerritMerged openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67163413:47
openstackgerritMerged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162713:47
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161013:47
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67172813:47
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67158813:48
openstackgerritMerged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161113:48
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67160413:49
openstackgerritMerged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161513:50
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162513:51
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67160213:51
*** poopcat1 has joined #openstack-ansible13:52
openstackgerritMerged openstack/openstack-ansible-os_mistral master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67160713:52
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_mistral stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173013:52
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_mistral stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173013:54
*** poopcat has quit IRC13:54
openstackgerritMerged openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159613:55
openstackgerritMerged openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159213:55
openstackgerritMerged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159813:56
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_mistral stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173013:56
*** cshen has quit IRC13:56
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_magnum stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173413:58
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161913:59
*** goldyfruit has quit IRC13:59
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67160613:59
*** goldyfruit has joined #openstack-ansible14:00
openstackgerritMerged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67162114:01
openstackgerritMerged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161714:01
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_blazar stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173514:01
openstackgerritMerged openstack/openstack-ansible-os_rally master: build: use upper-constraints.txt from rally-openstack  https://review.opendev.org/67156914:02
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_congress stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173714:05
openstackgerritMerged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67157914:05
openstackgerritMerged openstack/openstack-ansible-galera_client master: Drop support for Ubuntu Xenial  https://review.opendev.org/67168514:05
*** luksky11 has quit IRC14:06
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_sahara stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173814:06
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_trove stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67174114:08
*** spatel has joined #openstack-ansible14:15
mnaserjrosser: for upgrade jobs it looks like we're bootstrapping using master for older jobs14:20
mnaserso getting errors like nova_placement_service_password is not defined14:20
jrosserhmm14:20
jrosserwell, is this a sort of conceptual problem though14:21
jrosserthat we check out the master repo and boostrap14:21
jrosserthen checkout N-1 for the upgrade starting point14:21
mnaserright, in upgrade jobs, we should check out source branch, bootstrap that one, fully deploy it, and then run upgrade14:21
* jrosser needs to refresh how this works14:21
jrosserbtw saw your comment about git "ref is not a tree"14:22
jrosserwierdly all the reports of that we get here in irc from folks running into that in the wild are for the github repos, not the opendev ones14:23
jrosserlike unbound and so on14:23
* mnaser shrugs14:24
mnaseri.. dunno14:24
jrosseri'm sure i found an ansible related bug report, but it related to submodules14:26
mnaserjrosser: i wonder if it easier for us to add that variable and leave it undefined14:26
mnaserand let the upgrade utility stuff generate it14:26
mnaserseems like a hacky workaround tho :P14:26
mnaserjrosser: hmm i was wrong http://logs.openstack.org/05/671105/2/check/openstack-ansible-upgrade-aio_metal-centos-7/15b80c6/job-output.txt.gz#_2019-07-19_12_56_38_21642914:27
mnaserhttp://logs.openstack.org/05/671105/2/check/openstack-ansible-upgrade-aio_metal-centos-7/15b80c6/logs/etc/host/openstack_deploy/user_secrets.yml.tar.txt.gz14:29
mnaseri wonder where this is from14:29
jrosserso i see bootstrap-ansible run twice14:32
jrosserlooks like bootstrap-aio is done on master?14:33
mnaserok bootstrap-aio is done on master14:33
mnaserand then after that it checks out14:33
mnaserindeed we are bootstrapping twice jrosser14:34
mnaserwell i guess the biggest thing is that we are running the bootstrap-aio in master14:34
mnaserand yeah i think thats what you meant14:34
* mnaser looks14:34
jrosserin fact a super goog improvement would be to make the boostrap-aio script print the branch/sha as the very first thing it does14:35
mnaserahhh14:35
mnaseralso14:35
jrosserbecasue http://logs.openstack.org/05/671105/2/check/openstack-ansible-upgrade-aio_metal-centos-7/15b80c6/job-output.txt.gz#_2019-07-19_12_53_42_784742 on its own is really hard to backtrack and figure out exactly what version we are at14:35
mnaser{% if zuul.job is match('^openstack-ansible-deploy-([^-]+)-.*$') %}14:35
jrosserwell thats not going to help14:36
jrosser:)14:36
*** gtarnaras has quit IRC14:39
*** gtarnaras has joined #openstack-ansible14:42
*** luksky11 has joined #openstack-ansible14:46
openstackgerritMerged openstack/openstack-ansible master: Install placement osc plugin on utility machines  https://review.opendev.org/67163814:48
*** siqbal has quit IRC14:49
mnaserlogan-: any idea why the bootstrap stuff was moved to pre ?14:53
mnaserjust trying to gather if it was a "nice to have gate optimization" or beyond that14:54
*** tosky_ has joined #openstack-ansible14:59
openstackgerritMerged openstack/openstack-ansible-tests master: Drop support for Ubuntu Xenial  https://review.opendev.org/67168914:59
*** tosky has quit IRC15:02
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_blazar stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173515:07
*** tosky_ is now known as tosky15:10
*** poopcat1 is now known as poopcat15:12
spateljamesdenton: ty15:17
spatellogan-: did you guys figured out Ubuntu bridge flooding issue?15:18
logan-mnaser: yes... many reasons. overall job stability and the ability to implement custom scenarios in roles that consume integrated jobs.15:20
logan-2 job stability reasons are: 1) jobs that fail in pre-run are retried automatically by zuul. so doing boostrap-ansible in the pre-run is very beneficial for us because we sometimes see roles fail to clone from github, etc etc. we do some internet heavy operations during pre-run now so we get less job failures off the bat due to bad nodes. we also are slightly less likely to experience job timeouts because bootstrap-ansible no longer cuts15:22
logan- into the run phase timeout.15:22
logan-also, jobs that inherit from integrated repo jobs can implement custom configurations in the role (think the nova-lxd job setting up its custom user_variables, or other role scenario jobs we might want to build). the child jobs pre-run always runs after the parent job, so child jobs can inherit integrated jobs and do pre-runs with a fully bootstrapped AIO config already in place.15:23
logan-spatel: no, we've found that building a bridge outside of neutron on ubuntu configures ageing with 300 as default. so far it seems like it is only neutron specific bridges showing this behavior. have not determined why yet.15:26
spatellogan-: i am waiting for jamesdenton to chime in15:27
*** zbr is now known as zbr|out15:30
openstackgerritMikael Loaec proposed openstack/openstack-ansible-ceph_client master: Importing keyrings from files rather than from mons  https://review.opendev.org/67176215:30
*** luksky11 has quit IRC15:30
miloajrosser: here it is https://review.opendev.org/67176215:31
*** strattao has quit IRC15:31
noonedeadpunkfolks, can someone please help me to read the code? Since either it's smth really weired, or I'm missreading things...15:37
noonedeadpunkSo here we're iterating over a dict https://opendev.org/openstack/openstack-ansible-os_manila/src/branch/master/tasks/main.yml#L156 In case it's not defined, we're skipping this, right?15:37
noonedeadpunkand we're defining _manila_backends only inside https://opendev.org/openstack/openstack-ansible-os_manila/src/branch/master/tasks/manila_backends.yml which is included AFTER that one15:38
noonedeadpunkmoreover, it's going to be redefined since this set_fact is also iterating over groups...15:39
melwitthi, can anyone point me to where tempest test results are in a job run log? I'm missing it somehow http://logs.openstack.org/42/671642/1/check/openstack-ansible-deploy-aio_lxc-centos-7/8a480fa/logs/15:42
jrossermelwitt: http://logs.openstack.org/42/671642/1/check/openstack-ansible-deploy-aio_lxc-centos-7/8a480fa/logs/openstack/aio1_utility_container-5210902f/utility/stestr_results.html15:43
melwittthank you!15:43
melwittjrosser++15:43
jrossernp :)15:43
spateljrosser: i want to give end users to decide which compute node he/she can target just like admin, should i be playing nova_policy_overrides: ? or something else?15:45
jrosserspatel: i'm not sure, sorry. i've made flavors private to particular projects to give things like GPU, but thats not quite the same15:48
jrossernoonedeadpunk: so this accumulates a list of backends? https://opendev.org/openstack/openstack-ansible-os_manila/src/branch/master/tasks/manila_backends.yml#L3615:49
*** pcaruana has quit IRC15:49
*** rpittau is now known as rpittau|afk15:50
noonedeadpunkjrosser: I gues yes. But with_items confuses me. And that it's collected after NOT running manila_backend_cephfs.yml15:50
spateljrosser: sure, i am looking something like where end user can park machine to whatever compute host he want, i know we need to change policy.json but trying to push that out via override15:51
noonedeadpunksince it's never going to be defined (unless someone will define this inside user_variable)15:51
noonedeadpunkspatel: you may look at scheduler filters https://docs.openstack.org/nova/rocky/user/filter-scheduler.html15:52
melwittmnaser: I don't see that any novnc tests run as part of the CI jobs https://review.opendev.org/671642 how did you figure out that novnc consoles got broken in the past?15:53
noonedeadpunkspatel: actually if compute nodes are the same won't this solve your question? https://docs.openstack.org/senlin/stein/scenarios/affinity.html15:57
noonedeadpunkSo that users will be able to select whether to place their instances on the same or separate computing nodes15:58
jrossernoonedeadpunk: looks like there was a fairly massive patch to make ceph work at all https://opendev.org/openstack/openstack-ansible-os_manila/commit/b9809ef89dcb963dba43fa3fb91d2555b88e897d15:58
jrosserso i wonder if this has actually had much testing15:58
*** gyee has joined #openstack-ansible15:58
noonedeadpunkyeah...15:58
jrosseri had to pretty much un-brok the octavia role these last few weeks so i wonder how much actual real-life use some of this gets15:59
mnasermelwitt: so we used to have spice as default for the longest time ever but logan- pushed up a patch moving away from it15:59
mnaserlet me find it15:59
logan-did it merge? seemed like it was sitting in review forever15:59
mnaserhttps://review.opendev.org/#/c/662302/15:59
mnaserit did merge 7 days ago15:59
logan-ahh cool16:00
melwittmnaser: I mean I don't think I see any console test? http://logs.openstack.org/42/671642/1/check/openstack-ansible-deploy-aio_metal-ubuntu-bionic/63ee856/logs/openstack/aio1-utility/stestr_results.html16:00
mnasermelwitt: i think unfortunately we might not be running any console tests to shorten our run test times.. we should probably add it there16:00
mnasermelwitt: do you know of a good set of console tests we can add to our whitelists to catch this?16:01
melwittmnaser: ah, ok. was just curious how you discovered it the first time16:01
melwittmnaser: I think there's only two novnc tests total16:01
noonedeadpunkcloudnull: probably you can give some input regarding manila role and the part with _manila_backends?16:02
mnasermelwitt: i caught it in our own deployment when it broke on me ;p16:02
melwittmnaser: ah heh16:02
mnaserthe mnaser ci that is16:02
melwitt:D16:02
noonedeadpunkhuman monitoring is great:)16:03
melwittmnaser: yeah, so test_novnc is the one I know of for making sure console works https://github.com/openstack/tempest/blob/master/tempest/api/compute/servers/test_novnc.py16:03
mnaseryeah we run tempest.scenario.test_server_basic_ops right now16:04
mnaserhttps://opendev.org/openstack/openstack-ansible-os_tempest/src/branch/master/defaults/main.yml#L9316:05
melwittyeah, I see16:05
mnaserlet me add that16:05
mnaserunless you wanna push up a patch that adds it :D16:05
mnaser(if you're busy, no worries)16:05
melwittup to you :)16:05
mnasermelwitt: if you dont mind doing it and then that'll make it easier to land =P16:06
mnaseri can +2 it :P16:06
melwittoh, right16:06
melwittok, can do16:06
*** tosky has quit IRC16:08
noonedeadpunkjrosser: I think that's the answer about it's testing:) https://opendev.org/openstack/openstack-ansible-os_manila/src/branch/master/zuul.d/project.yaml16:09
mnaserlogan-: man it would really be nice if our stuff just assumed you have ansible and then did the rest from there16:11
mnaserand zuul ran those playbooks16:11
mnaser(for gate checks and stuff)16:12
jrossernoonedeadpunk: https://review.opendev.org/#/c/647856/16:12
logan-mnaser: its pivoting towards that.. the gate-check-commit at least has the ability to skip bootstrapping completely now which it did not have before16:13
logan-breaking things up into pre-run and run helped split that up16:13
noonedeadpunklooks like Kevin gave up adding tests16:13
* noonedeadpunk feels that manila is not going to come out from incubated state16:15
*** goldyfruit has quit IRC16:16
openstackgerritmelanie witt proposed openstack/openstack-ansible-os_tempest master: Add test_novnc to test nova vnc consoles  https://review.opendev.org/67176916:16
*** gtarnaras has quit IRC16:17
openstackgerritmelanie witt proposed openstack/openstack-ansible master: Revert "Use non-broken commit for NoVNC"  https://review.opendev.org/67164216:17
spatelnoonedeadpunk: thanks for that link.. lookiing16:18
*** goldyfruit has joined #openstack-ansible16:20
logan-mnaser: btw sorry it took a bit to look this up but the commit message on d8a0380 may explain the pre-run change a little better than I did above in case I missed anything16:21
mnaserlogan-: yeah its all good, i think i have a good idea of how i can work around it16:22
*** goldyfruit has quit IRC16:25
mnaserlogan-: btw i think we might hit a point where we need to just have a branchless openstack-ansible-ci repo16:26
mnaseresp for upgrade jobs16:26
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110516:27
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110516:27
logan-yeah16:30
logan-maybe we could change our use of the -tests repo to head that way16:31
*** goldyfruit has joined #openstack-ansible16:31
*** gtarnaras has joined #openstack-ansible16:32
*** gtarnaras has quit IRC16:33
*** gtarnaras has joined #openstack-ansible16:34
*** goldyfruit has quit IRC16:35
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Remove unused MAX_RETRIES  https://review.opendev.org/67177216:36
*** gtarnaras has quit IRC16:38
*** chandankumar is now known as raukadah16:39
*** nurdie has joined #openstack-ansible16:40
*** goldyfruit has joined #openstack-ansible16:47
*** mwe1 has quit IRC16:54
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_neutron master: Disable file log for Calico felix  https://review.opendev.org/67177516:57
openstackgerritMerged openstack/openstack-ansible-os_trove master: Add integrated coverage  https://review.opendev.org/66029817:00
tbarronnoonedeadpunk: so what are the blockers for OSA with manila?17:02
noonedeadpunktbarron: there are no CI, and some parts looks strange17:03
*** hamzaachi has joined #openstack-ansible17:03
tbarronnoonedeadpunk: so "just" a matter of no one working on it anymore I guess17:04
tbarronnoonedeadpunk: i'm just a manila guy and would like to see deployment tools besides just tripleo supporting it17:04
noonedeadpunkexactly:(17:04
jrosserit doesnt look like the role was ever got to a point that it had a sensible test setup17:04
jrosseronce thats in place the maintainance of it should be reasonably OK17:05
jrosserbut we never really got it finished it would seem17:05
tbarronnoonedeadpunk: jrosser: but i have my hands full with manila itself and my $job is for folks who use tripleo so17:05
tbarronnoonedeadpunk: jrosser: am happy to help e.g. on #openstack-manila if you hit issues that we might know something about17:06
tbarronnoonedeadpunk: jrosser: but don't have osa cycles personally even though I support the idea :)17:06
noonedeadpunktbarron: I guess we just need someone who uses it and aware of things.17:08
tbarronnoonedeadpunk: so feel free to add me to OSA reviews if you need manila side judgment ...17:09
*** poopcat has quit IRC17:15
openstackgerritMerged openstack/openstack-ansible stable/stein: Enable gating on distro_metal-ubuntu-bionic job  https://review.opendev.org/67157117:20
*** joshualyle has joined #openstack-ansible17:21
mnasernoonedeadpunk: if you can add manila coverage to gate, that'd be useful for us17:24
mnaserit's something i want us to add and i think its literally a matter of adding coverage, afaik cloudnull had it running17:24
mnaserits just a test thing17:24
noonedeadpunkFrom what I saw, it's not only about coverage:) But I think it's possible to achieve17:25
mnasercause i think i remebmer working on it a abit at the time17:25
mnaserit wasn't too far out afaik17:25
noonedeadpunkI'll write this down not to forget17:26
mnaserjrosser: if you get around nspawn .. that'd be nice17:27
mnasermelwitt: dang i think your thing didn't test it because: compute-feature-enabled.vnc_console17:29
mnaserthat's set to False17:30
mnaserhttp://logs.openstack.org/69/671769/1/check/openstack-ansible-deploy-aio_metal-ubuntu-bionic/3aa929a/logs/openstack/aio1-utility/tempest.log.txt.gz#_2019-07-19_17_06_58_04317:30
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67160117:31
*** gtarnaras has joined #openstack-ansible17:32
melwittmnaser: dangit. yeah, that would be a problem17:35
noonedeadpunkmnaser: am I right, that with migration to journalctl we don't need rsyslog_client? https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/common-playbooks/neutron.yml#L107-L12317:35
openstackgerritMerged openstack/openstack-ansible-os_zun stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67171517:36
*** gtarnaras has quit IRC17:37
mnasernoonedeadpunk: yes, then we don't longer need it yes17:39
openstackgerritmelanie witt proposed openstack/openstack-ansible-os_tempest master: Add test_novnc to test nova vnc consoles  https://review.opendev.org/67176917:40
*** gtarnaras has joined #openstack-ansible17:48
*** gtarnaras has quit IRC17:48
*** udesale has quit IRC17:48
openstackgerritMerged openstack/openstack-ansible-os_congress stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173717:49
*** tosky has joined #openstack-ansible17:49
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Drop creation of lig directories  https://review.opendev.org/67178317:50
*** strattao has joined #openstack-ansible17:50
noonedeadpunkok, so have everyone great weekends17:53
*** poopcat has joined #openstack-ansible17:55
openstackgerritMerged openstack/openstack-ansible-os_blazar stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173517:55
*** hamzaachi has quit IRC17:59
*** poopcat has quit IRC17:59
*** poopcat has joined #openstack-ansible18:02
kaiokmonoonedeadpunk: you too :)18:02
*** poopcat has quit IRC18:03
*** poopcat has joined #openstack-ansible18:04
openstackgerritMerged openstack/openstack-ansible-os_swift master: Use systemd-journald instead of log files  https://review.opendev.org/67171118:04
*** poopcat has quit IRC18:09
*** poopcat has joined #openstack-ansible18:10
mnasernoonedeadpunk: later D:18:11
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67171918:11
mnaserlogan-: you were around for when this was added back then.. whats the point of the varstest jobs?18:11
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67178418:15
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67157818:16
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67178518:16
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67178618:16
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67178718:16
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67178818:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67180218:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67180418:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67180518:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67180618:18
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67172218:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67180718:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67180818:18
openstackgerritMerged openstack/openstack-ansible-os_sahara stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173818:18
openstackgerritMerged openstack/openstack-ansible-os_magnum stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173418:18
openstackgerritMerged openstack/openstack-ansible-os_mistral stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67173018:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ops master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67180918:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159018:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159118:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181018:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159318:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181118:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159518:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181218:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181318:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181418:21
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67172418:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67159918:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67160018:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181518:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181618:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67160318:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181718:23
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_manila master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181818:23
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67181918:23
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_mistral master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182018:23
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182118:24
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182218:24
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161218:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67161318:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_placement master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182318:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182418:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182518:25
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182618:26
openstackgerritAndreas Jaeger proposed openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67180218:26
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182718:26
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67182918:27
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183018:27
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_zun master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183118:27
*** poopcat has quit IRC18:27
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183218:27
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183318:28
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183418:28
*** poopcat has joined #openstack-ansible18:28
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183518:28
openstackgerritMerged openstack/openstack-ansible-os_barbican stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67172818:28
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183618:29
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183718:29
*** poopcat has quit IRC18:29
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183818:29
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-config_template master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67183918:30
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67184018:30
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67184118:30
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67184218:31
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67184318:31
*** poopcat has joined #openstack-ansible18:31
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.opendev.org/67184418:31
*** hamzaachi has joined #openstack-ansible18:33
*** goldyfruit has quit IRC18:35
openstackgerritMerged openstack/openstack-ansible-os_trove stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67174118:36
*** luksky11 has joined #openstack-ansible18:41
openstackgerritMerged openstack/openstack-ansible-os_swift stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67171618:48
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/stein: Convert dynamic includes to static imports  https://review.opendev.org/67172618:48
* jrosser facepalm http://logs.openstack.org/16/671816/1/check/openstack-tox-docs/966d3bf/job-output.txt.gz#_2019-07-19_18_40_07_34170118:49
openstackgerritMohammed Naser proposed openstack/openstack-ansible-tests master: sync: fix documentation config  https://review.opendev.org/67184518:52
mnaserjrosser: yes18:53
mnaseri messed up big time18:53
mnaser:(18:53
mnaserthe patch above should fix it18:53
mnaserand kinda self-test18:53
jrosserat least it just pushes another revision rather than a whole new slew of patches18:53
mnaseryeah that's the nice part18:53
jrossermnaser: btw dmitry left a comment here which is kinda valid https://review.opendev.org/#/c/671454/18:56
jrosserbut the only place we install galera_client is the utility host, and nothing delegates db setup there atm18:57
mnaserare you sure?18:57
mnaseri think galera_client is setup on galera server too18:57
mnaserwhich is where we delegate18:57
mnaserjrosser: oh crap18:58
mnaseryou know why we havent hit this?18:58
mnaserall metal deploys18:58
mnaserlol18:58
mnasergalera_client runs in utility which is the same as galera which just works(tm)18:58
jrosserhah18:59
mnaserimho galera_client should run against galera_server too18:59
melwittmnaser: bah, need a nova conf setting to enable vnc too19:00
jrossermnaser: but today all the db setup tasks are delegated to galera[0] for containers or metal installs19:01
jrosserand stuff seems to be working19:01
*** goldyfruit has joined #openstack-ansible19:02
jrossermelwitt: do you need more than this is already enabling? https://github.com/openstack/openstack-ansible-os_nova/blob/51b6474082e929fcd61a410d32b1350dd25b9d60/defaults/main.yml#L280-L28319:06
melwittjrosser: I think I need this option enabled, it defaults to True, but the result in the test run implies that it's False https://github.com/openstack/nova/blob/master/nova/conf/vnc.py#L2819:07
melwittyeah I see it false here in the failing test run http://logs.openstack.org/42/671642/2/check/openstack-ansible-deploy-aio_metal-debian-stable/5dcbc0d/logs/etc/host/nova/nova.conf.txt.gz19:10
melwitt[vnc]enabled = False19:10
jrossermelwitt: https://opendev.org/openstack/openstack-ansible/src/branch/master/inventory/group_vars/nova_all.yml#L2319:13
*** hamzaachi has quit IRC19:14
jrosserthat means the default console type in the os_nova ansible role got recently patched to be novnc19:14
jrosserbut that var is overridden to spice when that role is consumed by openstack-ansible as a whole19:15
melwittoh, hm19:15
jrosserlogan-: did you intend to switch the integrated repo deploys from spice->novnc with this? https://review.opendev.org/#/c/662302/119:16
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Switch nova console type from spice to novnc  https://review.opendev.org/67184819:21
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Add test_novnc to test nova vnc consoles  https://review.opendev.org/67176919:21
jrossermelwitt: ^ lets see what that does19:21
*** kplant has quit IRC19:21
melwittjrosser: cool thanks19:23
mnaserjrosser: yeah it works because by default it listens to localhost i assume19:27
jrosseryes thats right19:28
*** hamzaachi has joined #openstack-ansible19:28
* jrosser patching to add the client role just now19:28
jrosserwell, no, it listens to 0.0.0.019:29
jrosserand the ansible module connects to localhost and that works19:29
jrosserwhen we bind to mgmt only it breaks19:29
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Run galera client role against galera hosts  https://review.opendev.org/67184919:30
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110519:32
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [WIP] Bind services to mgmt network addresses  https://review.opendev.org/67005119:33
jrossermnaser: youve seen those upgrade jobs are making containers?19:36
mnaserjrosser: yeah .. the scenario wasnt being picked up because of the openstack-ansible-deploy hardcode19:36
jrosserok19:36
mnaserso right now i havent even successfully gotten it to deploy N-1 :P19:36
*** joshualyle has quit IRC19:41
*** joshualyle has joined #openstack-ansible19:46
logan-jrosser: yes19:54
logan-interesting, I didn't know we were overriding it to spice somewhere else19:56
logan-mnaser: the varstest question... i'm not very familiar with that job. I know I glanced at it when I was working on the tests a couple months ago but I barely remember what it does.20:00
logan-I remember looking at it thinking about ripping it out and then it seemed like it might be marginally useful20:00
openstackgerritLogan V proposed openstack/openstack-ansible master: Stop creating calico log directory  https://review.opendev.org/67185620:05
mnaserlogan-: ack ok cool20:18
mnaserjrosser: so far so good... i think i might have at least the n-1 deploy part done successfully..20:19
mnaserits in os_tempset and it didnt create containers20:19
logan-:)20:19
logan-nice20:19
* mnaser is happy at the progress we're making recently20:19
mnasera lot of good clean-up an stability improvements20:19
mnaseronce we get stein=>master working well with ci, then we can backport to do rocky=>stein20:19
mnaserat least we'll have the proper "infrastructure" to do it20:20
jrosser++ to that, its really good work recently20:20
jrosserquite a lot of things tripping over service startup / db migrate race20:22
mnaseri think logically we should just always have db setup / mq setup before systemd stuff20:22
jrosserare things any different at upgrade because restarting services in handlers happens last20:31
*** strattao has quit IRC20:35
mnaserjrosser: we have a flush handlers at the end of every role afaik20:48
mnaserok neat20:48
mnaserwe have a clean n-1 deploy20:49
mnaserfatal: [localhost]: FAILED! => {"changed": false, "msg": "There are files in /etc/openstack_deploy/env.d which override the default inventory\nlayout in /home/zuul/src/opendev.org/openstack/openstack-ansible/inventory/env.d. The difference between these files\nshould be carefully reviewed to understand whether the changes are still necessary\nand applicable to the environment. If all the user-space20:49
mnaserenv.d files are necessary,\nthen please export SKIP_CUSTOM_ENVD_CHECK=true and re-run the playbook or\nrun-upgrade.sh script.\n"}20:49
mnaser#progress20:49
jrossermnaser: it looks like adding galera_client to the galera containers is making the lxc jobs look better too20:50
jrosserthere are some distro_metal failures related to db connection fail but i think we're just flushing out more things to tidy up20:51
*** hamzaachi has quit IRC20:59
mnaserjrosser: and it looks like my upgrade failures are because the env.d/aio_metal.yml files are not the same20:59
mnaserhttps://github.com/openstack/openstack-ansible/blob/master/scripts/upgrade-utilities/deploy-config-changes.yml#L43-L6521:00
mnaserim not sure the best way to go about this21:01
jrosseris this becasue we create a custom env.d specially for metal AIO test21:01
jrosserso it inevitably fails21:01
mnaseryeah21:01
mnaserim wondering how much coverage we lose by putting SKIP_CUSTOM_ENVD_CHECK ..21:01
jrosserwe give folks a huge freedom to reassign the functions to hosts as they choose21:02
jrosserand I think that this task is there to say "hey this is your problem at this point" when the environment looks different from default21:03
jrosseras the upgrade scripts can't be expected to deal with anything other than the default layout21:03
mnaserjrosser: but im wondering if we made something like removed a certain container or converged them into something else21:03
mnaserlike what if i was runnig all metal, and then had to upgrade and didn't have the placement config and now i have a placement container21:03
jrossernot that i recall, but that has happened in the past, with neutron stuff for example21:03
mnaseryeah and nova too21:04
mnaserand heat afaik21:04
mnaserwe converged them into a single container21:04
mnaserso there has been times where we've made adjustments21:04
jrosserso maybe actually having to drop a custom env.d file to enable an all metal AIO is something we shouldnt have to do21:05
jrosserperhaps that should be more native somehow21:05
mnaserwell i know that there's another way to do it cloudnull setup a while back21:05
jrosserthen this wouldnt get stuck at that env.d check21:05
mnaserwait maybe that never merged21:06
mnaserit was an openstack_user_config leve lthing21:06
jrosserwasnt that a flag per host just to do all metal21:06
mnaseryeah21:06
jrosseri think if we can do something outside messing with env.d that would be a good improvement21:07
mnaserhttps://review.opendev.org/#/c/635997/21:07
mnaserno_containers: true21:08
jrossercool - right i'm done for today, happy upgrades :)21:10
mnaserjrosser: take care!  have a good weekend21:10
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110521:15
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: metal: add docs + start using no_containers  https://review.opendev.org/67186221:15
ioninovnc works on stein fine?21:23
mnaserioni: yep21:23
*** luksky11 has quit IRC21:23
ionii know it had some problems with nova21:23
ionisome authorization issues21:23
mnaserioni: that's weird, it should be resolved in latest stein21:24
ioniok, i'll update to 19.0.021:24
ionii'm still on rc321:24
mnaserlet me know if you have issues21:24
mnaseryeah that might contribute21:24
ionihttps://review.opendev.org/#/c/671642/21:26
ionifound that21:27
mnaserothats actually something that resolves the previous bug that was fixed21:28
ioniok, so actually i still have to wait for stein, modifications are still in pending21:31
ionihttps://bugs.launchpad.net/openstack-ansible/+bug/182267621:31
openstackLaunchpad bug 1822676 in openstack-ansible "novnc no longer sets token inside cookie" [Undecided,In progress] - Assigned to melanie witt (melwitt)21:31
nurdieRocky 18.1.8 fresh epel-repo_build.repo file from ansible. I'm running CentOS7 and it's failing hard. Any ideas? https://pastebin.com/uNDqgDAr21:31
nurdieI want to scream "UPSTREAM PROBLEM" and turn my head, but I can download those from a browser just fine21:32
*** vnogin has joined #openstack-ansible21:32
*** vnogin has quit IRC21:32
nurdieI can also wget them just fine from the container21:33
nurdieopenstack-ansible playbooks/repo-build.yml -e repo_build_git_reclone=yes -e repo_build_wheel_rebuild=yes -e repo_build_venv_rebuild=yes21:35
nurdieI'm currently running that now21:35
*** tosky has quit IRC21:43
*** hamzaachi has joined #openstack-ansible21:57
*** spatel has quit IRC22:04
*** KeithMnemonic has quit IRC22:04
*** joshualyle has quit IRC22:23
openstackgerritMikael Loaec proposed openstack/openstack-ansible-ceph_client master: Importing keyrings from files rather than from mons  https://review.opendev.org/67176222:25
miloajrosser: In this 2nd patch https://review.opendev.org/671762 i corrected some problem with ceph_nova_secret, i didn't notice at first. I deployed on our pre-prod, using keyrings from files seems ok. Waiting to see what will say Zuul :) Have a good weekend.22:29
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-tests master: sync: make doc/requirements.txt pass linters  https://review.opendev.org/67187122:30
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Disable file log for Calico felix  https://review.opendev.org/67177522:30
*** miloa has quit IRC22:31
*** gyee has quit IRC22:34
*** nurdie_ has joined #openstack-ansible22:47
*** nurdie has quit IRC22:50
*** gyee has joined #openstack-ansible22:57
*** nurdie has joined #openstack-ansible23:23
*** nurdie has quit IRC23:31
*** nurdie has joined #openstack-ansible23:56
*** nurdie_ has joined #openstack-ansible23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!