Sunday, 2020-06-21

*** wuchunyang has quit IRC00:02
*** sean-k-mooney has quit IRC00:05
*** wuchunyang has joined #openstack-kolla00:18
*** wuchunyang has quit IRC00:48
*** diurnalist has joined #openstack-kolla01:17
*** mcnugit has quit IRC02:34
*** mcnugit has joined #openstack-kolla03:50
*** oncall-pokemon has quit IRC04:00
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-kolla04:33
*** diurnalist has quit IRC04:34
*** abdysn has joined #openstack-kolla05:04
*** bsanjeewa has joined #openstack-kolla05:05
*** bsanjeewa_ has joined #openstack-kolla05:13
*** bsanjeewa has quit IRC05:16
*** dciabrin_ has joined #openstack-kolla06:33
*** dciabrin has quit IRC06:36
*** mcnugit has quit IRC06:46
*** wuchunyang has joined #openstack-kolla06:51
*** bsanjeewa has joined #openstack-kolla06:51
*** bsanjeewa_ has quit IRC06:53
*** bsanjeewa_ has joined #openstack-kolla07:22
*** bsanjeewa has quit IRC07:26
*** bsanjeewa has joined #openstack-kolla07:26
*** bsanjeewa_ has quit IRC07:27
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: fix prechecks failed when use venv with allinone  https://review.opendev.org/73702207:37
*** mcnugit has joined #openstack-kolla07:45
*** jonaspaulo has joined #openstack-kolla08:16
*** diurnalist has joined #openstack-kolla08:31
*** diurnalist has quit IRC08:36
*** kemopq has quit IRC08:39
*** bsanjeewa_ has joined #openstack-kolla08:58
*** bsanjeewa has quit IRC09:01
*** kemopq has joined #openstack-kolla09:10
openstackgerritMerged openstack/kolla stable/ussuri: Revert "Enable mod_wsgi in Nova API container"  https://review.opendev.org/73582109:33
*** born2bake has joined #openstack-kolla09:44
*** bsanjeewa has joined #openstack-kolla09:50
*** bsanjeewa_ has quit IRC09:53
*** ykarel has joined #openstack-kolla10:03
*** ykarel|away has quit IRC10:04
*** kemopq has quit IRC10:06
*** kevko has joined #openstack-kolla10:26
*** kevko has quit IRC10:38
*** kemopq has joined #openstack-kolla10:59
admin0checking if anyone is available who knows about the issue i am having ....  resolving hostnames11:12
*** kemopq has quit IRC11:29
*** kemopq has joined #openstack-kolla11:30
*** kemopq__ has joined #openstack-kolla11:42
*** kemopq has quit IRC11:43
*** kemopq__ has quit IRC11:47
*** kemopq has joined #openstack-kolla11:52
*** jovial[m] has quit IRC11:55
sorin-mihaiadmin0, not long ago i noticed some issues on my deployment, i ended up adding A records in the public DNS pointing to the private IPs, that's why i asked how do you verify the resolving12:06
admin0sorin-mihai, .. if hostnames are say  k1.domain.com,  it should resolve to the API ip ?12:07
admin0and when i do hostname and hostname -f , should it show k1 or full k1.domain.com ?12:08
sorin-mihai'hostname' depends on /etc/hostname, it should contain 'k1' only, while /etc/hosts should have 'ip k1.domain.com k1' and the ip should be the IP that you actually use to connect to the node, not 127.0.1.1. in my case, 'host' never resolves properly, apparently it doesn't read /etc/hosts, hence the need to add A records in public DNS12:14
admin0sorin-mihai, https://gist.github.com/a1git/b1b692d99e7e22823111b5dd31638705 -- this is what i have so far12:15
sorin-mihaialso, if you changed the hostname after the OS installation, maybe 'hostnamectl set-hostname k1' will fix it12:16
admin0my server has 2 ips .. one for ssh and one for its API network12:16
admin010.11.12.x is for ssh , 172.29.236.x is for the api network  ( the deploy has dual ips, so can connect to both)12:16
sorin-mihaihow is /etc/hosts looking?12:17
admin0its there .. like 91 - 10112:17
admin0i have not added anything in /etc/hosts yet12:17
sorin-mihaialso, hostname should output only a1, so you need to fix it with the hostnamectl command and check if /etc/hostname is updated12:18
admin0ok12:19
admin0so add api_ip     host.domain.com host  and set hostname to just host and not host.domain.com12:19
admin0i will do and report12:19
sorin-mihaisince you're not adding A records in public DNS, i'd just make sure that /etc/hosts in all nodes is the same12:20
admin0so hostname returns host , hostname -f returns host.domain.com and  in /etc/hosts, it has    api_ip host.domain.com host12:22
admin0i am going to try again now12:23
admin0did not worked12:24
admin0stuck in the same error message12:24
admin0sorin-mihai, i updated in the comment what i see https://gist.github.com/a1git/b1b692d99e7e22823111b5dd3163870512:26
admin0the error it barbs out HostVars object' has no attribute u'x.x.x.x' -- here the x.x.x.x ip seems to be random based on what it picks up first .. so that ip rotates12:27
*** Tony31 has quit IRC12:29
sorin-mihaito me, it looks like ansible is not actually able to connect and if it does, is not able to write the file12:34
*** kemopq has quit IRC12:39
sorin-mihaiadmin0, is there any diff between your /usr/local/share/kolla-ansible/ansible/roles/baremetal/tasks/pre-install.yml and https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/baremetal/tasks/pre-install.yml ?12:44
sorin-mihaialso, maybe try to bootstrap again with -vvvv and before that double check if the user you're using is able to use sudo without password12:47
admin0the diff is this 1 line added when:  ansible_distribution_major_version == '8'12:58
*** bsanjeewa_ has joined #openstack-kolla12:59
admin0sorin-mihai, i did - https://asciinema.org/a/CgkB1VGNEraJPUsUvIoTGpgTh13:02
*** bsanjeewa has quit IRC13:03
sorin-mihairight, so the nodes are reachable. it's a bit over my understanding, but it looks like you're using root in the deployment node. have you tried to use a normal user with sudo rights? i see 'establish ssh connection for user: none' is the root user used in the other nodes too? do you have entries in /root/.ssh/config in the deployment node pointing to all the other nodes?13:17
*** kemopq has joined #openstack-kolla13:17
*** also_stingrayza has joined #openstack-kolla13:20
sorin-mihaiadmin0, i'd sugest that a ~/.ssh/config look like this http://paste.openstack.org/raw/CrTY88GPZAKQPwdvG6qf/13:22
*** diurnalist has joined #openstack-kolla13:22
*** stingrayza has quit IRC13:22
sorin-mihaiobviously, not necessarily exactly the same, there are also other options that can be set, but the extra options in Host * in my case have been helpful to keep the connection alive in certain networks and i've kept it as a default everywhere13:22
admin0i don't see how the keepalive connection thing solves the undefined variable error ansible is giving13:23
sorin-mihaitrue, but the question is if you have entries in the ansible node for all the other nodes13:24
sorin-mihaiin ~/.ssh/config i mean13:24
admin0i am using ips in multinode .. the user executing the ansible playbook is  root itself .. and root can login well by doing ssh 172.29.236.11 -ip address13:25
sorin-mihaiwhat about other ansible commands, are they functional?13:26
*** diurnalist has quit IRC13:26
sorin-mihailike i said, a bit over my understanding, but i think that this is just a ansible connectivity issue, even if the nodes are reachable by ping and 'ssh ip' works. i'd use the hostnames from /etc/hosts in the ansible inventory file, instead of IPs, and adding entries for each hostname in ~/.ssh/config using the api IPs. given your use case with 2 classes of IPs, i'd have a 2nd entry per host, with the management IP that would not13:35
sorin-mihaibe used by ansible. maybe i'm overcomplicating this13:35
*** bsanjeewa_ has quit IRC13:53
*** abdysn has quit IRC13:55
admin0 ansible -i multinode all -m ping  works fine ..what i did was  setup DNS .. so that a1.mero.cloud resolves internally from the internal dns the servers are using, and then also added a1.mero.cloud and its api ip to /etc/hosts and re-ran the playbook .. gives me the same error14:06
admin0i fail to understand from the ansible erorr what exactly its complaining about and what i need to fix14:07
admin0also in the documentation, there is no mention of what hostname to set and how to set it so that bootstrap does not fail14:07
admin0and also its bootstrap .. its supposed to fix stuff14:07
*** wuchunyang has quit IRC14:27
*** wuchunyang has joined #openstack-kolla14:28
sorin-mihaiadmin0, have you tried other ansible commands? try a whoami playbook or something like that. i have the feeling that the ping module only pings but doesn't ssh. i might be totally wrong, though14:37
admin0sorin-mihai,  https://gist.github.com/a1git/2235f640a9d629f5acd62ad158fbf038 -- see that i have used both hostname as well as IPs14:38
admin0i appreciate your help, but i think its directed towards the wrong thing .. there is no ssh issue :)14:39
*** kemopq has quit IRC14:42
openstackgerritwu.chunyang proposed openstack/kolla-ansible master: nova-cell role clone failed  https://review.opendev.org/73718214:44
*** kemopq has joined #openstack-kolla14:46
*** jonaspaulo has quit IRC15:19
*** mcnugit has quit IRC15:55
*** diurnalist has joined #openstack-kolla16:06
*** wuchunyang has quit IRC16:10
*** diurnalist has quit IRC16:49
*** faizy98 has joined #openstack-kolla17:07
*** mgoddard has quit IRC17:26
*** mgoddard has joined #openstack-kolla17:31
*** faizy98 has left #openstack-kolla18:06
*** mcnugit has joined #openstack-kolla19:16
*** kevko has joined #openstack-kolla19:27
openstackgerritHongbin Lu proposed openstack/kolla-ansible master: [DNM] Test Zun job with TLS  https://review.opendev.org/73719219:37
*** kevko has quit IRC19:38
*** mcnugit has quit IRC19:42
*** hongbin has joined #openstack-kolla19:49
*** kemopq has quit IRC19:55
*** diurnalist has joined #openstack-kolla20:00
*** kemopq has joined #openstack-kolla20:00
*** diurnalist has quit IRC20:10
*** hongbin has quit IRC20:18
*** hongbin has joined #openstack-kolla21:44
*** sorin-mihai has quit IRC21:47
*** born2bake has quit IRC22:18
openstackgerritHongbin Lu proposed openstack/kolla-ansible master: [DNM] Test Zun job with TLS  https://review.opendev.org/73719222:22
*** mcnugit has joined #openstack-kolla23:05
openstackgerritHongbin Lu proposed openstack/kolla-ansible stable/rocky: [DNM] Test Zun job  https://review.opendev.org/73399723:08
openstackgerritHongbin Lu proposed openstack/kolla-ansible stable/rocky: [DNM] Test Zun job  https://review.opendev.org/73399723:09
*** mcnugit has quit IRC23:13
openstackgerritHongbin Lu proposed openstack/kolla stable/rocky: Add /var/lib/kolla/venv/bin to Zun exec_dirs  https://review.opendev.org/73719823:31
openstackgerritHongbin Lu proposed openstack/kolla stable/rocky: Add /var/lib/kolla/venv/bin to Zun exec_dirs  https://review.opendev.org/73719823:33
openstackgerritHongbin Lu proposed openstack/kolla-ansible master: [DNM] Test Zun job with TLS  https://review.opendev.org/73719223:48

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!