Monday, 2020-05-18

*** stingrayza has joined #openstack-ansible00:22
*** also_stingrayza has quit IRC00:23
*** threestrands has joined #openstack-ansible00:43
openstackgerritBrin Zhang proposed openstack/openstack-ansible master: Bump hacking min version to 3.0.1  https://review.opendev.org/72873001:03
openstackgerritBrin Zhang proposed openstack/openstack-ansible master: Fix hacking min version to 3.0.1  https://review.opendev.org/72873001:36
*** spatel has quit IRC03:40
*** udesale has joined #openstack-ansible03:58
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-ansible04:33
ChosSimbaOneGood morning.06:14
*** spikysnow has quit IRC06:46
*** gkadam has joined #openstack-ansible07:04
*** gkadam has quit IRC07:05
*** yolanda has joined #openstack-ansible07:07
*** tosky has joined #openstack-ansible07:22
*** evrardjp has quit IRC07:28
*** rpittau|afk is now known as rpittau07:29
*** evrardjp has joined #openstack-ansible07:30
*** cp- has quit IRC07:31
*** cp- has joined #openstack-ansible07:32
*** pcaruana has quit IRC07:51
jrossermorning08:05
*** threestrands has quit IRC08:13
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-repo_server stable/stein: Fix repo_server always requiring git  https://review.opendev.org/72877608:16
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-haproxy_server master: [ussuri][goal] Update contributor documentation  https://review.opendev.org/72746008:19
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: [ussuri][goal] Update contributor documentation  https://review.opendev.org/72746208:19
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_neutron master: [ussuri][goal] Update contributor documentation  https://review.opendev.org/72740208:20
openstackgerritJonathan Rosser proposed openstack/ansible-hardening master: Add Centos-8 support  https://review.opendev.org/70946008:35
*** sshnaidm|off has joined #openstack-ansible08:47
*** sshnaidm|off is now known as sshnaidm08:47
openstackgerritJonathan Rosser proposed openstack/ansible-hardening master: Add Centos-8 support  https://review.opendev.org/70946009:04
*** jbadiapa has joined #openstack-ansible09:21
*** gshippey has joined #openstack-ansible09:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-tests master: Deploy modern ara for py3 deployments  https://review.opendev.org/72825909:40
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_neutron master: networking-ovn is now integrated into neutron  https://review.opendev.org/72880409:50
*** rpittau is now known as rpittau|bbl10:06
*** jbadiapa has quit IRC10:08
*** drokath has joined #openstack-ansible10:19
*** pcaruana has joined #openstack-ansible10:21
jrosserdmsimard: should we expect newer ARA to work on centos 7? https://zuul.opendev.org/t/openstack/build/cd4e4751b0504ca2a51c8662cf776b0310:49
kleiniWhat would be the best approach with OSA for central collection of log files?11:10
*** watersj has quit IRC11:11
*** udesale_ has joined #openstack-ansible11:40
jrosserkleini: everyone has their favourite 'best' here :) we have some stuff for basic rsyslog forwarding, but thats of limited use these days with everything going to journals11:42
jrosserthere is also journal forwarding to one of the log hosts using native systemd journal forwarding11:42
jrosseror you can pick up something like the ELK stack which we have code for here https://github.com/openstack/openstack-ansible-ops/tree/master/elk_metrics_7x11:43
*** udesale has quit IRC11:43
kleinithat sounds great. ELK was my first idea, too. will try to utilize that.11:57
jrosserkleini: my team had put loads of that code in so if you are stuck please ask12:00
jrosseri suspect the documentation might not have kept up with the code in places12:00
jrosserfor our lab putting ELK on 3 dedicated log nodes was fine, but for a prod env we've made something quite a lot larger than that12:01
*** watersj has joined #openstack-ansible12:02
*** rpittau|bbl is now known as rpittau12:12
*** rh-jelabarre has joined #openstack-ansible12:12
*** pcaruana has quit IRC12:14
kleiniMy production is currently just 10 compute nodes. ELK on containerized log hosts on 3 infra nodes should be hopefully sufficient12:17
watersjkleini, for storage you using ceph. How many nodes and how much storage if I may ask12:18
drokath@kleini By any chance did you do any offline installs ? (I will set up a dev environment for my team in the comming month, but the company i work for does not allow proxing to the outside)12:22
kleiniwatersj, that is a separate cluster not managed by OSA. just handcrafted. 6 nodes, 5 MONs, 36 OSDs, 64TB total space, somehow bonded gigabit networking running ancient Jewel version12:24
kleinidrokath, unfortunately my company is ruthlessly open, so I did not have to do an offline install.12:25
*** pcaruana has joined #openstack-ansible12:26
drokathAhah paradise ^^12:26
jrosserdrokath: i do something very close to an offline install12:27
drokathjrosser: so how did you manage the python dependencies ? so far i see i can clone all repo as bare localy along side a "reposync" for rpm dependencies.12:30
jrosserwe use an instance of devpi-server for that12:31
jrosserultimately you'll need some way to either allow that to have external access, or to somehow bootstrap it full of packages12:31
*** evrardjp has quit IRC12:36
dmsimardjrosser: it can work on EL7 but pretty hacky, can't support it I'm afraid12:36
jrosserdmsimard: should we pin back to a particular version for EL7?12:37
dmsimard0.x will work, 1.x not really12:37
jrosserok cool, i'll take a look at adding some logic for < centos812:38
dmsimardMain issues are py3 requirements and an out-of-date sqlite12:38
dmsimardSome people are installing an older version of django to workaround the sqlite error but I can't recommend that12:39
drokathjrosser: Alright thank you for the tip :-)12:40
jrosserdrokath: offline is possible - but it's not easy12:40
dmsimardThe API server runs easily in a container which can run on EL7, it's based on Fedora12:40
dmsimardThen you'd need py3 for the callback and set it up to send the data somewhere12:41
jrosserOSA allows you to hook into offline repos for git and python and apt and so on, but it's up to you to create an environment that provides all of those things offline12:41
drokathAnd that’s okay to work a little bit. So as far as dependencies go i should set up a pip proxy (using devpi-server for python dependencies listed in requirements.txt), use reposync for getting all rpm packages, and cloning all OSA repos listed in ansible-role-requirements.yml12:48
*** evrardjp has joined #openstack-ansible12:49
drokathAnd what shoud i do about the LXC containers12:50
jrosseryou can host the container image locally and override the URL in the lxc_hosts role defaults to pick that up12:51
jrosseryou need a git server as well, which you can do with the apache git module cgi12:52
jrosserdrokath: just getting the dependancies in requirements.txt is not good enough - you've got to do that recursively for all openstack services12:54
*** jbadiapa has joined #openstack-ansible13:03
drokathjrosser: Hum okay. So im better off setting a proxy, Bootstrapping OSA, and installing a test cluster outside the office to get all dependencies.13:05
drokathThank you very much for all the pointers13:05
jrossernoonedeadpunk: i think this is needed for the stein sha bump https://review.opendev.org/#/c/728776/13:09
*** jhesketh has quit IRC13:15
noonedeadpunkoh, sure13:17
noonedeadpunksorry, today is really awful day in some sense... like having no time for really helping out here:(13:17
noonedeadpunkbut will make up patches for our branching today for sure13:19
*** jhesketh has joined #openstack-ansible13:22
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update Magnum fedora image name  https://review.opendev.org/72774913:26
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-tests master: Deploy modern ara for py3 deployments  https://review.opendev.org/72825913:34
*** jhesketh has quit IRC13:41
openstackgerritMerged openstack/openstack-ansible-haproxy_server stable/train: Only restart rsyslog when it is installed  https://review.opendev.org/72870513:46
*** cshen has joined #openstack-ansible13:49
watersjwhat additional setting should I add so masakari monitor services are installed (instancemonitor, hostmonitor)13:50
*** d34dh0r53 has quit IRC13:51
watersji copied in etc/conf.d/masakari.example13:51
*** fghaas has joined #openstack-ansible13:52
*** d34dh0r53 has joined #openstack-ansible13:55
*** spatel has joined #openstack-ansible13:56
noonedeadpunkdmsimard: should we somehow configure ara in CI to get things dispalyed like on your collection host?14:21
noonedeadpunkI mean https://3d5f8e104b98e6ae1568-073541c2c949b4a8cbf06d070b6f5771.ssl.cf1.rackcdn.com/728259/14/check/openstack-ansible-functional-centos-8/834b08a/logs/ara-report/ is still displaying playbook name weirdly14:22
*** KeithMnemonic has joined #openstack-ansible14:25
jrossernoonedeadpunk: i'm not sure why it's not rendered anything14:36
jrosseri looked at this https://github.com/ansible-community/ara/blob/72c672a0bb9140a6bb62e560ed9d019187abb5a0/tests/basic.yaml#L17614:36
noonedeadpunkactually logs are rendered for centos 814:38
noonedeadpunkbut they don't for 7 (at least they did in sqlite while supposed to be html...14:38
noonedeadpunkand the most weird thing is the error about unrecognized arguments while report is in place14:39
noonedeadpunkso I'm totally confused about this14:39
prometheanfirewhat's the timeline for ussuri branching/release?14:41
jrossernoonedeadpunk: oh hmm let me have another look at the logs - i attempted to make it do the old thing for centos714:42
noonedeadpunkthat error is for centos 8, but didn't check 7 so close...14:43
openstackgerritMerged openstack/openstack-ansible-repo_server stable/stein: Fix repo_server always requiring git  https://review.opendev.org/72877614:54
openstackgerritMerged openstack/openstack-ansible-os_nova master: Fix UEFI boot support  https://review.opendev.org/72870915:03
dmsimardnoonedeadpunk: not at a computer right now but  that change might not be released yet15:06
dmsimardYeah: https://github.com/ansible-community/ara/commit/fb898cc4b3508fb890d6cde236cc3ce0a42799c615:06
dmsimardProbably due for a 1.4.115:07
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/stein: Bump SHAs for stable/stein  https://review.opendev.org/72869415:13
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Cleanup after repo_build and pip_install retirement  https://review.opendev.org/72742815:23
*** gyee has joined #openstack-ansible15:42
*** d34dh0r53 has quit IRC15:46
*** d34dh0r53 has joined #openstack-ansible15:56
*** pcaruana has quit IRC15:58
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-openstack_hosts master: CentOS 8 support  https://review.opendev.org/70945516:02
*** rpittau is now known as rpittau|afk16:06
*** pcaruana has joined #openstack-ansible16:10
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-nspawn_container_create master: Ensure that facts are gathered for newly created containers  https://review.opendev.org/72894516:25
*** cshen has quit IRC16:37
*** udesale_ has quit IRC16:41
noonedeadpunkjrosser: I'm resolving exact same issue for ^ with https://review.opendev.org/#/c/728052/16:44
noonedeadpunkor not...16:44
jrosserthe vars inclusion in systemd_service is breaking, and i just did a sandbox here and there are only very minimal facts for the functional test containers at the point it calls systemd_service16:51
jrosseransible_distribution<blah> is all missing, not sure how it worked before tbh16:51
noonedeadpunkSo I think like https://review.opendev.org/#/c/728052/3/playbooks/containers-nspawn-create.yml should also gather facts for them before even including role...16:55
noonedeadpunkBut okay, maybe it's different16:55
jrosseri think this is duplicating the facts gathering in the middle of that playbook, but i feel its needed in the role to make the functional tests work17:00
jrosseralso nspawn_container_create is one gigantic tasks/main.yml 8-O17:01
*** cshen has joined #openstack-ansible17:09
*** cshen has quit IRC17:13
openstackgerritLogan V proposed openstack/openstack-ansible-os_nova stable/train: Fix UEFI boot support  https://review.opendev.org/72896917:52
openstackgerritJonathan Rosser proposed openstack/ansible-role-systemd_networkd master: Do not rebuild initramfs for containers  https://review.opendev.org/72899518:52
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-nspawn_container_create master: Ensure that facts are gathered for newly created containers  https://review.opendev.org/72894518:53
*** also_stingrayza has joined #openstack-ansible18:53
*** stingrayza has quit IRC18:56
*** d34dh0r53 has quit IRC18:59
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-nspawn_hosts master: Create temporary /tmp for debian  https://review.opendev.org/72899719:02
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-nspawn_container_create master: Ensure that facts are gathered for newly created containers  https://review.opendev.org/72894519:03
*** rmcall has joined #openstack-ansible19:03
*** djhankb6 has joined #openstack-ansible19:04
*** djhankb has quit IRC19:06
*** djhankb6 is now known as djhankb19:06
*** redrobot has joined #openstack-ansible19:07
*** d34dh0r53 has joined #openstack-ansible19:07
*** cshen has joined #openstack-ansible19:10
*** cshen has quit IRC19:14
*** gshippey has quit IRC19:23
*** cshen has joined #openstack-ansible19:24
*** NewJorg has quit IRC19:57
*** NewJorg has joined #openstack-ansible19:58
*** cshen has quit IRC20:10
*** cshen has joined #openstack-ansible20:38
*** fghaas has left #openstack-ansible20:39
*** cshen has quit IRC20:42
openstackgerritJonathan Rosser proposed openstack/ansible-role-systemd_networkd master: Do not rebuild initramfs for containers  https://review.opendev.org/72899521:37
*** sshnaidm is now known as sshnaidm|afk22:00
openstackgerritJonathan Rosser proposed openstack/ansible-role-systemd_networkd master: Do not rebuild initramfs for containers  https://review.opendev.org/72899522:01
*** threestrands has joined #openstack-ansible22:06
*** spatel has quit IRC22:07
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-nspawn_hosts master: Use root user for apt tasks in debian buster  https://review.opendev.org/72899722:23
*** cshen has joined #openstack-ansible22:38
*** cshen has quit IRC22:44
*** drokath has quit IRC23:04
*** yolanda has quit IRC23:36
*** tosky has quit IRC23:39
*** spatel has joined #openstack-ansible23:41

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!