Tuesday, 2019-04-30

*** luksky has quit IRC00:08
*** gyee has quit IRC00:21
*** Weifan has quit IRC00:36
*** Weifan has joined #openstack-ansible00:36
*** Weifan has quit IRC00:36
*** Weifan has joined #openstack-ansible00:36
*** Weifan has quit IRC00:37
*** Weifan has joined #openstack-ansible00:37
*** Weifan has quit IRC00:38
*** Weifan has joined #openstack-ansible00:38
*** Weifan has quit IRC00:39
*** Weifan has joined #openstack-ansible00:39
*** Weifan has quit IRC00:39
*** Weifan has joined #openstack-ansible00:40
*** Weifan has quit IRC00:40
*** Weifan has joined #openstack-ansible00:40
*** Weifan has quit IRC00:41
*** Weifan has joined #openstack-ansible00:41
*** Weifan has quit IRC00:42
*** Weifan has joined #openstack-ansible00:42
*** Weifan has quit IRC00:43
*** Weifan has joined #openstack-ansible00:43
*** Weifan has quit IRC00:43
*** Weifan has joined #openstack-ansible00:44
*** Weifan has quit IRC00:48
*** witek has joined #openstack-ansible00:53
starbornFound it …00:55
*** ChosSimbaOne has quit IRC00:56
*** ChosSimbaOne has joined #openstack-ansible00:56
starbornhttp://eavesdrop.openstack.org/irclogs/%23openstack-ansible/%23openstack-ansible.2019-03-21.log.html One would assume that bug had been fixed by now.00:56
*** DanyC has joined #openstack-ansible01:01
*** kplant has quit IRC01:06
*** starborn has quit IRC01:12
_jannowhy does bootstrap-ansible.sh install somethings to /etc/ansible and others to /etc/openstack_deploy?01:27
*** BjoernT has joined #openstack-ansible01:29
*** DanyC has quit IRC01:55
*** BjoernT has quit IRC02:15
*** BjoernT has joined #openstack-ansible02:20
*** nicolasbock has quit IRC02:31
guilhermesp_janno: hum what do you mean exactly? You can see that all roles are cloned into /etc/ansible right? /etc/openstack_deploy is supposed to be your "workspace" of openstack-ansible, it's like the place you define ( through user_variables and openstack_user_config.yml for example) how your deployment looks like02:35
_jannoguilhermesp: yes, that's what I meant and I was wondering why some parts (the roles) are put into /etc/ansible/ and the others are meant to be located in /etc/openstack_deploy02:37
guilhermespI'd say that the default location for roles in ansible is /etc/ansible/roles.02:39
*** witek has quit IRC02:46
*** BjoernT has quit IRC02:58
*** raukadah is now known as chandankumar03:11
*** markvoelker has joined #openstack-ansible03:12
*** gkadam has joined #openstack-ansible03:49
*** cmart has joined #openstack-ansible03:51
*** udesale has joined #openstack-ansible04:08
*** cmart has quit IRC04:13
*** aedc has quit IRC05:32
*** ivve has joined #openstack-ansible05:43
openstackgerritChristian Zunker proposed openstack/openstack-ansible-os_nova stable/rocky: Stop deleting-and-creating RabbitMQ account on deploy  https://review.opendev.org/65644305:59
*** miloa has joined #openstack-ansible06:02
*** cshen has joined #openstack-ansible06:32
*** threestrands has joined #openstack-ansible06:46
*** ivve has quit IRC06:56
*** luksky has joined #openstack-ansible07:00
*** ivve has joined #openstack-ansible07:02
*** gkadam has quit IRC07:17
*** markvoelker has quit IRC07:38
*** aedc has joined #openstack-ansible07:40
*** pcaruana has joined #openstack-ansible07:40
noonedeadpunkevrardjp: seems that things got even worse...07:43
noonedeadpunkare you sure, that lxc got fixed inside new suse images?:)07:47
*** kopecmartin|off is now known as kopecmartin07:50
*** threestrands has quit IRC07:55
*** tosky has joined #openstack-ansible08:04
*** DanyC has joined #openstack-ansible08:12
*** DanyC has quit IRC08:13
*** hamzaachi has joined #openstack-ansible08:14
*** DanyC has joined #openstack-ansible08:15
*** luksky has quit IRC08:39
*** markvoelker has joined #openstack-ansible08:40
*** nwonknu has quit IRC08:51
*** nwonknu has joined #openstack-ansible08:57
openstackgerritChristian Zunker proposed openstack/openstack-ansible-tests stable/rocky: Stop deleting-and-creating RabbitMQ account on deploy  https://review.opendev.org/65647609:10
*** electrofelix has joined #openstack-ansible09:11
*** witek has joined #openstack-ansible09:52
*** witek has quit IRC10:11
*** aedc has quit IRC10:53
*** ostackz has joined #openstack-ansible11:06
ostackzHi, I have running Rocky cluster, trying to add LDAP/AD support - it works with manual config in keystone, but stuck when trying to deploy config with os-keystone-install.yml11:14
ostackzsomething related to bootstrap, more details: https://pastebin.com/raw/bHK1C7N4  can anyone please suggest where to dig?11:15
ostackzif I execute same keystone-manage command manually in keystone container - it seems to work, no output or error thrown, not getting why ansible cannot do it11:15
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Ensure systemd-journal-remote.socket service is started  https://review.opendev.org/65649611:18
ostackzjrosser thanks for the patch! ^ I now understood why mo remote logging did not work!11:26
jrosserostackz: could you test it out?11:27
jrosserif it works leaving a +1 and a comment on the patch would be really helpful11:27
ostackzI could rerun my rocky playbooks again, but I am stuck with keystone problem above11:28
ostackzfor now I started systemd-journal-remote.socket on receiveing end and logs started to arrive11:29
ostackzjrosser may be you have any advice how to overcome keystone reconfig problem above? P.S. this systemd-journal-remote.socket patch is related to rocky as well?11:33
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Update ansible to 2.7.10  https://review.opendev.org/65649911:36
jrosserostackz: the journal remote patch is currently for master, but if it is good/working and merges then it needs to be backported. things like this pretty much always are fixed first in master then later applied to the stable branches11:38
noonedeadpunkbtw, probably you know if it's supported to forward logs from systemd-journal to remote log server (like graylog)? As I've configured local.7 for syslog to be sent but didn't dig into journalctl11:38
jrosserostackz: did you check that keystone thing as the keystone user? see this https://opendev.org/openstack/openstack-ansible-os_keystone/src/branch/master/tasks/keystone_service_bootstrap.yml#L4011:53
ostackzjrosser nope I did as root, have to check what is the difference11:56
*** mkuf_ has joined #openstack-ansible11:57
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible to 2.7.10  https://review.opendev.org/65650111:57
ostackzjrosser I just reissued that keystone-manage command as keystone user - it executed successfully but it takes some time - may be it is timeout issue, will test12:00
*** mkuf has quit IRC12:01
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [WIP] test ceph-ansible 4.0.0 release candidate  https://review.opendev.org/65650312:03
*** ansmith has quit IRC12:06
*** udesale has quit IRC12:08
*** udesale has joined #openstack-ansible12:11
*** kplant has joined #openstack-ansible12:21
ostackzjrosser here is the problem why keystone bootstrap fails: Unhandled error: ValidationError: Role 4b49e36720f14ca5822da78f9f4ec06b is a domain-specific role. Unable to use a domain-specific role in a system assignment.12:21
*** shardy has quit IRC12:22
jrosserostackz: hmmm that is slightly past my keystone understanding12:26
ostackzok, will check if that role is some unneeded leftover from previous activities12:28
*** shardy has joined #openstack-ansible12:35
*** altlogbot_2 has quit IRC12:43
*** altlogbot_0 has joined #openstack-ansible12:45
*** ansmith has joined #openstack-ansible12:52
*** markvoelker has quit IRC12:52
*** markvoelker has joined #openstack-ansible12:52
*** mkuf has joined #openstack-ansible12:59
*** mkuf_ has quit IRC13:03
*** hamzaachi_ has joined #openstack-ansible13:11
*** hamzaachi has quit IRC13:14
*** jenglisch_ is now known as jenglisch13:17
*** nicolasbock has joined #openstack-ansible13:21
*** BjoernT has joined #openstack-ansible13:24
*** cmart has joined #openstack-ansible13:25
*** BjoernT has quit IRC13:25
*** grabes has joined #openstack-ansible13:25
*** hamzaachi__ has joined #openstack-ansible13:33
*** BjoernT has joined #openstack-ansible13:34
*** hamzaachi_ has quit IRC13:36
*** djhankb has quit IRC13:39
*** markvoelker has quit IRC13:39
*** markvoelker has joined #openstack-ansible13:40
*** cmart has quit IRC13:44
*** markvoelker has quit IRC13:44
*** BjoernT has quit IRC13:55
*** bootsha has joined #openstack-ansible13:57
*** nicolasbock has quit IRC13:58
*** ostackz has left #openstack-ansible14:01
*** BjoernT has joined #openstack-ansible14:08
*** kplant has quit IRC14:09
*** kplant has joined #openstack-ansible14:09
*** kplant has quit IRC14:11
jrosserlots of centos jobs failing like this http://logs.openstack.org/01/656501/1/check/openstack-ansible-functional-centos-7/640bb20/logs/host/aria2c-image-prestage.log.txt.gz14:15
*** pcaruana has quit IRC14:15
*** miloa has quit IRC14:19
*** gshippey has joined #openstack-ansible14:20
noonedeadpunk+114:25
noonedeadpunkseems like some infra issue14:25
*** kplant has joined #openstack-ansible14:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Ensure systemd-journal-remote.socket service is started  https://review.opendev.org/65649614:27
*** markvoelker has joined #openstack-ansible14:27
noonedeadpunkjrosser: systemd-journal-remote.socket is present by default or appears only after systemd_journal_remote_distro_package installation?14:34
*** shyamb has joined #openstack-ansible14:34
noonedeadpunkand there was problem with indent not in when clause, but with following "- name: Create journal directory"14:35
jrosserArgh14:35
* jrosser rushing too much14:36
*** aedc has joined #openstack-ansible14:37
*** shyamb has quit IRC14:42
*** pcaruana has joined #openstack-ansible14:45
*** ivve has quit IRC14:56
*** Miouge has joined #openstack-ansible14:57
jrossernoonedeadpunk: so certiainly for ubuntu that socket unit comes from the distro package https://packages.ubuntu.com/search?searchon=contents&keywords=systemd-journal-remote.socket&mode=exactfilename&suite=disco&arch=any14:58
*** bootsha has quit IRC14:58
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Ensure systemd-journal-remote.socket service is started  https://review.opendev.org/65649614:59
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-openstack_openrc stable/rocky: Change locale for openrc  https://review.opendev.org/65652715:01
*** aedc has quit IRC15:01
jrossernoonedeadpunk: yeah handler would be ideal but we need the code to fix up broken installs, so i think a dedicated task is the only way?15:03
noonedeadpunkYeah, good point15:03
noonedeadpunkso I've already set +2 :)15:03
*** cshen has quit IRC15:06
noonedeadpunkSo, after my research, I didn't found really easy and pleasent way to forward journalctl to graylog/elastic search... Either some intermediate host is required, which will be recieving journalctl from all cluster and transform it to gelf/beat and send to futher collector, or do such transformations on all hosts...15:06
noonedeadpunks/found/find/15:07
mgariepyhttps://github.com/openstack/openstack-ansible-ops/blob/master/graylog/graylog-forward-logs.yml15:07
mgariepynothing prevent you to send in gelf directly from each hosts.15:08
noonedeadpunkoh, that's really nice - missed it15:08
jrossernoonedeadpunk: you looked at the elk stack stuff on the ops repo?15:08
noonedeadpunkjrosser: mgariepy send link exactly to what I was looking for:)15:11
noonedeadpunkjust us usual clean forgot about checking ops repo15:12
jrosserits all quite tricky, part of logs in logfiles, part in journals and we have some missing log config too, for example heat-engine i think15:13
mgariepyor neutron net ns stuff last time i checked.15:14
jrosserneed to make bugs for these as theyre all relaitvely easy fixes15:15
mgariepyit might be better now, i really need to tests :) haha15:15
noonedeadpunkmgariepy: do you use graylog as well? I think I don't need to configure systemd-journal-remote https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/infra-journal-remote.yml once have journal2gelf, am I right?15:15
mgariepyi use graylog, but i was forwarding rsyslog to it. i havent had time to check the glef stuff more than the ops playbook.15:16
mgariepythe journal remote is for the receiver part afaik15:17
noonedeadpunkYeah, same for me - just forwarding rsyslog as for now, but with upgrade to ubuntu 18.04 it's missing lots of stuff...15:17
mgariepyi tested it on my testbed and it did fill the hdd the first time around15:17
mgariepyi'm still on 16.0415:17
mgariepy:D15:18
mgariepyhow the upgrade from 16.04 went?15:18
mgariepyor was it a new install ?15:18
noonedeadpunkpretty ok to be honest. cloudnull's notes helped a lot15:19
mgariepyclean install or release upgrade ?15:19
noonedeadpunkit was release upgrade15:19
mgariepyk15:19
mgariepyanyone here do understant the repobuild stuff more than i do ?15:20
mgariepyhttps://opendev.org/openstack/requirements/src/branch/stable/rocky/global-requirements.txt#L14815:20
mgariepyi'm wondering why i don't have this lib built on my repo server .. :S15:21
mgariepymaybe odyssey4me ?15:21
mgariepyare you guys at the summit ?15:21
noonedeadpunkI'm not:(15:21
jrossermgariepy: which release repo server?15:27
noonedeadpunkHm, seems, that I don't have it either....15:27
jrosseroh it's right there, rocky15:27
noonedeadpunkHave only osc-lib15:28
mgariepyyep rocky15:29
mgariepy18.1.615:29
noonedeadpunkI'm not sure if it's required in rocky, as there is no separate placement service - it's still part of the nova...15:29
mgariepyit's in the global-req15:29
mgariepyhttp://paste.openstack.org/show/750110/15:30
noonedeadpunkYeah, I understand, just saw recent patch https://review.opendev.org/#/c/654635/15:31
noonedeadpunkand not sure wether they were applied for old repo_build process15:31
mgariepycomputers are hard.. ;)15:32
mgariepyi'll get it in stein then.15:33
*** aedc has joined #openstack-ansible15:36
*** hjohnson1 has joined #openstack-ansible15:39
*** chandankumar is now known as raukadah15:40
*** cmart has joined #openstack-ansible15:52
*** BjoernT has quit IRC15:55
*** pcaruana has quit IRC15:55
*** BjoernT has joined #openstack-ansible16:02
openstackgerritAdolfo R. Brandes proposed openstack/openstack-ansible-os_magnum master: Support docker registry config options  https://review.opendev.org/65264816:03
*** gyee has joined #openstack-ansible16:12
*** BjoernT has quit IRC16:14
*** BjoernT has joined #openstack-ansible16:21
*** markvoelker has quit IRC16:45
*** markvoelker has joined #openstack-ansible16:45
*** markvoelker has quit IRC16:50
*** cmart has quit IRC16:50
*** cmart has joined #openstack-ansible16:53
cloudnullmornings all17:00
*** cshen has joined #openstack-ansible17:05
*** cshen has quit IRC17:09
prometheanfiremoin17:10
prometheanfirecloudnull: flight back was good?17:10
*** BjoernT has quit IRC17:11
d34dh0r53congrats prometheanfire17:12
*** Weifan has joined #openstack-ansible17:13
prometheanfireh17:14
prometheanfireheh17:14
*** udesale has quit IRC17:14
*** cmart has quit IRC17:30
*** markvoelker has joined #openstack-ansible17:37
*** ivve has joined #openstack-ansible17:44
*** aedc has quit IRC17:48
*** cmart has joined #openstack-ansible17:51
*** kopecmartin is now known as kopecmartin|off17:52
*** cshen has joined #openstack-ansible18:12
*** cmart has quit IRC18:15
*** markvoelker has quit IRC18:16
hjohnson1Has anyone had any problems with aria2... I just blew away my install to make one final production install and all of a sudden I get aria2 errors regarding "SSL initialization failed"... http://paste.openstack.org/show/750118/18:26
*** cshen has quit IRC18:28
*** DanyC has quit IRC18:29
hjohnson1This is on CentOS 718:34
*** hamzaachi__ has quit IRC18:36
*** electrofelix has quit IRC18:45
jrosserhjohnson1: a bunch of CI jobs are failing in the same way18:48
hjohnson1there must have been an update to aria2 lately then :-(18:49
jrosserthat URL is a redirect18:50
jrosserare you able to wget the image, and try the final URL directly?18:50
hjohnson1Yes... wget works fine... just not aria218:50
jrosserright but if aria2 cant follow the redirect for some reason, a fix might be to change the URL var to be the actual location18:51
hjohnson1Oh... ok. I get you. Let me check that out.18:51
jrosserhjohnson1: excellent, thanks18:52
hjohnson1Silly question... where do I put the URL change in the OSA script?18:53
*** Weifan has quit IRC18:54
jrosserhjohnson1: here https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/vars/redhat-7.yml#L1618:54
hjohnson1Cool.  Got it.  Trying it now.18:54
jrosserso in user_variables.yml you can override lxc_hosts_container_image_url18:54
hjohnson1Cool...18:58
*** pcaruana has joined #openstack-ansible19:10
*** BjoernT has joined #openstack-ansible19:16
hjohnson1jrosser: still no joy.  Changing the URL produced the same error :'(19:25
hjohnson1This type there is no redirect...19:27
*** vnogin has joined #openstack-ansible19:31
*** tosky has quit IRC19:34
hjohnson1jrosser: Well I solved the problem though it was kind of extreme.  After reading various articles, I downloaded the aria2 source, re-compiled and tried fetching the file and it worked fine for me.  I think the secret may have been to not link against gnutls but instead link against openssl.19:35
jrosserhjohnson1: omg :/19:35
jrossermnaser: ^ centos ariac2 brokenness by the look of it19:36
hjohnson1jrosser: mnaser: At least in my environment, it looks like it.  This was working as designed two days ago... now today its busted.19:37
*** cmart has joined #openstack-ansible19:43
*** aedc has joined #openstack-ansible19:53
*** DanyC has joined #openstack-ansible19:56
*** shardy has quit IRC20:07
*** cmart has quit IRC20:17
NobodyCamGood Afternoon OSA Folks20:18
NobodyCamis there newer version of https://docs.openstack.org/openstack-ansible/newton/developer-docs/ops-add-computehost.html20:19
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Remove the use of 'private' with include_role during bootstrap  https://review.opendev.org/65658220:21
NobodyCamh found it: https://docs.openstack.org/openstack-ansible/latest/admin/scale-environment.html20:21
*** vnogin has quit IRC20:22
*** pcaruana has quit IRC20:23
*** DanyC has quit IRC20:24
*** cmart has joined #openstack-ansible20:32
*** radeks has joined #openstack-ansible20:33
*** hamzaachi__ has joined #openstack-ansible20:40
*** radeks has quit IRC20:43
*** radeks has joined #openstack-ansible20:45
*** ansmith has quit IRC20:45
*** hamzaachi__ has quit IRC20:48
*** hamzaachi__ has joined #openstack-ansible20:48
*** hamzaachi__ has quit IRC20:50
*** Weifan has joined #openstack-ansible20:50
*** hamzaachi__ has joined #openstack-ansible20:50
*** hamzaachi__ has quit IRC20:51
*** hamzaachi__ has joined #openstack-ansible20:52
*** hamzaachi__ has quit IRC20:53
*** hamzaachi__ has joined #openstack-ansible20:53
*** Weifan has quit IRC20:55
hjohnson1Since I recompiled from source and manually upgraded to my aria2c, installation is going fine now... http://paste.openstack.org/show/750127/21:04
*** Weifan has joined #openstack-ansible21:17
*** Weifan has quit IRC21:20
*** kplant has quit IRC21:22
*** hjohnson1 has left #openstack-ansible21:25
*** Weifan has joined #openstack-ansible21:27
*** gshippey has quit IRC21:35
*** Weifan has quit IRC21:35
evrardjprelease21:38
evrardjpwoops21:38
evrardjpw/c21:38
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/stein: Prepare OSA release for Stein  https://review.opendev.org/65659521:50
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/stein: Bump global-requirement-pins before release  https://review.opendev.org/65659621:52
*** markvoelker has joined #openstack-ansible21:52
*** radeks has quit IRC21:53
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Bump requirement for master  https://review.opendev.org/65659821:54
*** ArchiFleKs has quit IRC21:55
*** cmart has quit IRC21:55
openstackgerritLogan V proposed openstack/openstack-ansible-os_neutron master: Use integrated repo scenario for Calico job  https://review.opendev.org/64583421:55
*** radeks has joined #openstack-ansible21:56
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Use opendev links  https://review.opendev.org/65659921:57
openstackgerritLogan V proposed openstack/openstack-ansible-os_neutron master: Use integrated repo scenario for Calico job  https://review.opendev.org/64583422:00
*** cmart has joined #openstack-ansible22:04
*** markvoelker has quit IRC22:09
*** BjoernT has quit IRC22:12
*** BjoernT has joined #openstack-ansible22:14
*** ansmith has joined #openstack-ansible22:15
*** markvoelker has joined #openstack-ansible22:21
*** dave-mccowan has joined #openstack-ansible22:22
*** Anticimex has joined #openstack-ansible22:27
*** hamzaachi__ has quit IRC22:33
*** radeks has quit IRC22:45
*** radeks has joined #openstack-ansible22:46
*** Anticimex has quit IRC22:50
*** Anticimex has joined #openstack-ansible22:51
*** markvoelker has quit IRC22:57
*** BjoernT has quit IRC22:58
*** ianychoi_ has quit IRC23:03
*** ianychoi_ has joined #openstack-ansible23:04
*** dave-mccowan has quit IRC23:06
openstackgerritLogan V proposed openstack/openstack-ansible master: Add Calico networking AIO scenario  https://review.opendev.org/64583123:28
openstackgerritLogan V proposed openstack/openstack-ansible master: Add Calico networking AIO scenario  https://review.opendev.org/64583123:40
*** cmart has quit IRC23:41
*** Weifan has joined #openstack-ansible23:53
*** radeks has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!