Thursday, 2020-09-24

*** brinzhang has joined #openstack-kolla00:35
*** williampiv has quit IRC00:56
*** wuchunyang has joined #openstack-kolla01:00
r3ap3rI feel like I'm almost to the finish line with this Openstack setup. I can create everything except storage related items. When I try to upload an image from Horizon or by using `openstack image create` it sits there for about 20 mins or so and then times out? I've looked at both Ceph and Glance related logs during my upload attempts and I don't really see anything that points to a particular issue? If I look in01:20
r3ap3rCeph, a new image gets created in the `images` pool with the appropriate size of what I'm uploading to Openstack. I see HAproxy querying `glance_api` and Glance doing its thing. I get a timeout error `Failed to store image ea72c38a-485c-4cb7-a42d-67f6299a5f89 Store Exception timed out: socket.timeout: timed out`. Then it just repeats three errors over and over again. I'm not sure where to go at this point. It01:20
r3ap3rjust seems like it is timing out and not really giving me anything to go on. Maybe I'm missing a log somewhere in the process? Has anyone experienced this and wouldn't mind giving me a nudge? Thanks in advance.01:20
*** wuchunyang has quit IRC01:30
*** wuchunyang has joined #openstack-kolla01:55
*** wuchunyang has quit IRC02:25
*** zzzeek has quit IRC02:40
*** zzzeek has joined #openstack-kolla02:41
*** zzzeek has quit IRC02:50
*** zzzeek has joined #openstack-kolla02:52
*** williampiv has joined #openstack-kolla02:56
*** dave-mccowan has quit IRC03:47
*** skramaja has joined #openstack-kolla04:11
mnasiadkar3ap3r: how big is the image?04:16
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-kolla04:33
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker  https://review.opendev.org/74395804:35
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638904:37
*** brinzhang_ has joined #openstack-kolla04:37
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638904:40
*** brinzhang has quit IRC04:41
*** williampiv has quit IRC05:21
*** skramaja has quit IRC05:29
*** skramaja has joined #openstack-kolla05:29
*** abdysn has joined #openstack-kolla05:30
*** recyclehero has quit IRC05:35
*** recyclehero has joined #openstack-kolla05:35
openstackgerritMichal Nasiadka proposed openstack/kolla master: Add missing heat deps for deb-binary  https://review.opendev.org/75394405:38
*** shyamb has joined #openstack-kolla05:40
*** cah_link has joined #openstack-kolla06:02
openstackgerritMerged openstack/kayobe master: CI: Fix kayobe-tox-molecule job  https://review.opendev.org/75379106:19
yoctozeptor3ap3r: it sounds like glance could not reach osds?06:27
*** vishalmanchanda has joined #openstack-kolla06:30
*** shyamb has quit IRC06:51
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Fix default mode in haproxy_single_service_split  https://review.opendev.org/75395406:55
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/train: Fix default mode in haproxy_single_service_split  https://review.opendev.org/75395506:55
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible stable/stein: Fix default mode in haproxy_single_service_split  https://review.opendev.org/75395606:55
*** shyamb has joined #openstack-kolla07:11
*** also_stingrayza has joined #openstack-kolla07:18
*** stingrayza has quit IRC07:19
mnasiadkayoctozepto: that was my second question :)07:26
*** shyam89 has joined #openstack-kolla07:27
*** shyamb has quit IRC07:30
yoctozeptoseems bifrost is failing us again07:32
*** zzzeek has quit IRC07:33
yoctozeptotesting that in https://review.opendev.org/75396207:34
patchbotpatch 753962 - bifrost - [DNM] Run jobs in CI - 1 patch set07:34
yoctozepto(either it fails too or it is not well tested)07:34
*** born2bake has joined #openstack-kolla07:34
*** zzzeek has joined #openstack-kolla07:36
yoctozepto5 possible suspects https://review.opendev.org/#/q/project:openstack/bifrost+status:merged+branch:master+after:2020-09-2307:37
yoctozeptodown to 2 suspects07:38
yoctozeptohttps://review.opendev.org/#/c/752473/07:38
patchbotpatch 752473 - bifrost - Ensure that repositories are owned by the running ... (MERGED) - 2 patch sets07:38
yoctozeptohttps://review.opendev.org/#/c/752466/07:38
patchbotpatch 752466 - bifrost - Move CLI validation to bifrost-keystone-client-config (MERGED) - 3 patch sets07:38
yoctozepto(as these 2 missed the kolla in testing)07:38
yoctozeptoboils down to https://review.opendev.org/75246607:39
patchbotpatch 752466 - bifrost - Move CLI validation to bifrost-keystone-client-config (MERGED) - 3 patch sets07:39
*** dougsz has joined #openstack-kolla07:40
mgoddardmorning07:41
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker  https://review.opendev.org/74395807:45
*** bengates has joined #openstack-kolla07:56
*** shyam89 has quit IRC07:57
openstackgerritMerged openstack/kayobe master: Docker registry basic auth  https://review.opendev.org/73885608:00
openstackgerritMerged openstack/kayobe master: docs: Move development section under contributor guide  https://review.opendev.org/75251308:00
*** zzzeek has quit IRC08:01
*** zzzeek has joined #openstack-kolla08:01
*** jbadiapa has joined #openstack-kolla08:02
*** k_mouza has joined #openstack-kolla08:09
*** shyamb has joined #openstack-kolla08:17
*** e0ne has joined #openstack-kolla08:17
recycleherohi kolla08:41
recycleheroI promise I will ask this 1 Q and be off to real deployment08:41
recycleherolets assume I have deployed the AIO inventory. after lunching 10 instances I will change the inventory to multinode and cinder machanism to NFS. how does the mariadb and instances volumes get transferred?08:43
*** jovial[m] has quit IRC08:46
recycleherois it done with "kolla-ansible -i INVENTORY"08:46
recyclehero?08:46
*** k_mouza has quit IRC08:49
recyclehero*"kolla-ansible -i INVENTORY reconfigure"08:50
*** k_mouza has joined #openstack-kolla08:50
* recyclehero scared08:51
*** jovial[m] has joined #openstack-kolla08:53
yoctozeptorecyclehero: they don't get "transferred"; they will stay where they are09:02
*** Abdallahyas has joined #openstack-kolla09:13
*** abdysn has quit IRC09:14
recycleheroso for volumes they stay where they are and for mariadb they get synced with the one that stay in the same place with glera, right?09:14
recycleherobut the new volumes get created in the nfs space09:14
*** kevko has joined #openstack-kolla09:17
*** also_stingrayza is now known as stingrayza09:20
*** shyam89 has joined #openstack-kolla09:25
*** LinPeiWen has quit IRC09:26
*** LinPeiWen has joined #openstack-kolla09:26
*** shyamb has quit IRC09:26
*** jaicaa has quit IRC09:27
openstackgerritMerged openstack/kayobe master: Performance: Parallelise Kolla Ansible host vars generation  https://review.opendev.org/74535409:27
*** abdysn has joined #openstack-kolla09:32
*** Abdallahyas has quit IRC09:35
*** jovial[m] has quit IRC09:38
openstackgerritMerged openstack/kolla-ansible master: Bump minimum Ansible version to 2.9  https://review.opendev.org/75377609:40
*** jovial[m] has joined #openstack-kolla09:51
openstackgerritMark Goddard proposed openstack/kayobe stable/ussuri: Performance: Parallelise Kolla Ansible host vars generation  https://review.opendev.org/75405309:54
openstackgerritPierre Riteau proposed openstack/kayobe master: Bump Ansible version range to 2.9 - 2.9  https://review.opendev.org/75405409:55
*** zzzeek has quit IRC09:57
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker  https://review.opendev.org/74395809:59
*** zzzeek has joined #openstack-kolla10:00
*** jaicaa has joined #openstack-kolla10:02
openstackgerritMerged openstack/kolla-ansible master: Allow setting container_proxy per service  https://review.opendev.org/75324610:05
openstackgerritMerged openstack/kolla stable/ussuri: Release note for using stable sources  https://review.opendev.org/75268210:05
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker  https://review.opendev.org/74395810:09
openstackgerritPierre Riteau proposed openstack/kayobe master: Remove unneeded doc requirements in molecule tox env  https://review.opendev.org/75406010:13
*** shyam89 has quit IRC10:16
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker  https://review.opendev.org/74395810:16
*** gfidente has joined #openstack-kolla10:22
*** kevko has quit IRC10:23
*** dougsz has quit IRC10:26
openstackgerritMerged openstack/kayobe master: Add missing barbican.conf support  https://review.opendev.org/75290010:28
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Performance: Parallelise Kolla Ansible host vars generation  https://review.opendev.org/75406410:40
*** JamesBenson has joined #openstack-kolla11:06
*** JamesBenson has quit IRC11:06
*** JamesBenson has joined #openstack-kolla11:06
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: Introduce 'kolla_infra_install_type' variable  https://review.opendev.org/70698211:11
openstackgerritMerged openstack/kayobe master: Remove unneeded doc requirements in molecule tox env  https://review.opendev.org/75406011:23
mgoddardare we aware of this issue in Debian CI: Nova requires QEMU version 4.0.0 or greater.11:26
hrwshit11:30
mnasiadkamgoddard, yoctozepto: Can we merge this? https://review.opendev.org/#/c/749632/3 - I'm fed up with waiting for pool drain after keepalived VIP moves somewhere else :)11:31
patchbotpatch 749632 - kolla-ansible - Reduce the use of SQLAlchemy connection pooling - 3 patch sets11:31
yoctozeptomgoddard: not seen it yet11:31
r3ap3rmnasiadka: I'm testing with Cirros so ~16MBs. Starting small before going any larger.11:32
mnasiadkar3ap3r: so it really seems like glance can't connect to your OSDs11:32
r3ap3ryoctozepto: ok, I will look into that. I do have Proxmox successfully using Ceph although the setup is completely different for that.11:33
r3ap3rThanks guys for the nudge, I'll let you know if I find anything. :)11:34
*** kevko has joined #openstack-kolla11:42
*** shyamb has joined #openstack-kolla11:47
*** priteau has joined #openstack-kolla12:00
*** zzzeek has quit IRC12:09
openstackgerritPierre Riteau proposed openstack/kayobe stable/ussuri: CI: Fix kayobe-tox-molecule job  https://review.opendev.org/75407512:11
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638912:11
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638912:11
*** zzzeek has joined #openstack-kolla12:12
openstackgerritPierre Riteau proposed openstack/kayobe master: Performance: avoid set_fact in Kolla Ansible host vars  https://review.opendev.org/74556912:16
openstackgerritPierre Riteau proposed openstack/kayobe master: Performance: avoid set_fact in Kolla Ansible host vars  https://review.opendev.org/74556912:17
*** shyamb has quit IRC12:21
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638912:28
*** zzzeek has quit IRC12:40
*** zzzeek has joined #openstack-kolla12:42
*** Abdallahyas has joined #openstack-kolla12:47
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker  https://review.opendev.org/74395812:48
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638912:48
openstackgerritMark Goddard proposed openstack/kayobe stable/train: CI: Fix kayobe-tox-molecule job  https://review.opendev.org/75408212:50
*** abdysn has quit IRC12:50
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: CI: Fix kayobe-tox-molecule job  https://review.opendev.org/75408212:52
*** recyclehero has quit IRC12:56
*** recyclehero has joined #openstack-kolla12:56
*** skramaja has quit IRC12:58
*** skramaja has joined #openstack-kolla12:59
*** priteau has quit IRC13:02
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Fix keystone-startup.sh  https://review.opendev.org/75408513:17
*** priteau has joined #openstack-kolla13:21
*** wuchunyang has joined #openstack-kolla13:21
*** also_stingrayza has joined #openstack-kolla13:33
*** stingrayza has quit IRC13:33
*** priteau has quit IRC13:33
openstackgerritMerged openstack/kayobe stable/train: CI: Fix kayobe-tox-molecule job  https://review.opendev.org/75408213:42
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Fix keystone-startup.sh  https://review.opendev.org/75408513:44
*** TrevorV has joined #openstack-kolla13:46
openstackgerritMerged openstack/kayobe stable/ussuri: CI: Fix kayobe-tox-molecule job  https://review.opendev.org/75407513:49
openstackgerritMichal Nasiadka proposed openstack/kolla master: Add missing heat deps for deb-binary  https://review.opendev.org/75394413:52
*** cah_link has quit IRC13:52
*** recyclehero has quit IRC13:57
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker  https://review.opendev.org/74395813:58
*** recyclehero has joined #openstack-kolla14:04
*** dave-mccowan has joined #openstack-kolla14:30
*** shyamb has joined #openstack-kolla14:31
*** dave-mccowan has quit IRC14:34
*** shyam89 has joined #openstack-kolla14:39
*** shyamb has quit IRC14:42
*** shyam89 has quit IRC14:45
*** k_mouza has quit IRC14:59
openstackgerritMerged openstack/kolla-ansible master: CI: add magnum scenario, also covering octavia  https://review.opendev.org/65203015:01
*** k_mouza has joined #openstack-kolla15:06
*** dciabrin has quit IRC15:11
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638915:19
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638915:22
*** k_mouza has quit IRC15:27
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services  https://review.opendev.org/67638915:29
*** k_mouza has joined #openstack-kolla15:37
*** k_mouza has quit IRC15:37
*** k_mouza has joined #openstack-kolla15:37
*** wuchunyang has quit IRC15:44
*** e0ne has quit IRC15:50
*** ozzzo has quit IRC15:50
*** Abdallahyas has quit IRC15:56
*** bengates has quit IRC15:56
*** priteau has joined #openstack-kolla15:59
*** kevko has quit IRC16:05
*** shyamb has joined #openstack-kolla16:05
mlozahello, I'm hitting the following bug https://bugs.launchpad.net/keystone/+bug/1895723. I have 3x control nodes, if that matters. Is there a workaround?16:06
openstackLaunchpad bug 1895723 in kolla-ansible "Keystone is restarting due to stale primary key" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka)16:06
*** shyamb has quit IRC16:06
mnasiadkamloza: patch is underway, check the bottom of bug report16:07
mnasiadkaJust apply it locally16:07
mlozamnasiadka: sounds good16:13
*** ozzzo has joined #openstack-kolla16:14
*** k_mouza has quit IRC16:15
*** k_mouza has joined #openstack-kolla16:22
*** k_mouza has quit IRC16:46
*** gfidente has quit IRC17:07
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for encrypting Ironic API  https://review.opendev.org/75154317:09
*** skramaja has quit IRC17:33
openstackgerritNing Yao proposed openstack/kolla-ansible master: unify the wsgi logfile name  https://review.opendev.org/73019117:56
*** recyclehero has quit IRC18:36
*** hamzaachi has joined #openstack-kolla18:40
*** hamzaachi has quit IRC18:40
*** recyclehero has joined #openstack-kolla18:43
*** priteau has quit IRC18:58
*** openstackgerrit has quit IRC19:14
*** recyclehero has quit IRC19:30
*** TrevorV has quit IRC19:35
*** zzzeek has quit IRC20:12
*** zzzeek has joined #openstack-kolla20:14
*** JamesBenson has quit IRC20:14
*** zzzeek has quit IRC20:18
*** zzzeek has joined #openstack-kolla20:20
*** born2bake has quit IRC20:22
*** zzzeek has quit IRC20:25
*** zzzeek has joined #openstack-kolla20:26
*** zzzeek has quit IRC20:30
*** zzzeek has joined #openstack-kolla20:33
*** zzzeek has quit IRC20:43
*** zzzeek has joined #openstack-kolla20:46
*** zzzeek has quit IRC20:51
*** zzzeek has joined #openstack-kolla20:53
*** recyclehero has joined #openstack-kolla22:17
*** zzzeek has quit IRC22:24
*** zzzeek has joined #openstack-kolla22:25
*** vishalmanchanda has quit IRC22:39
*** zzzeek has quit IRC22:44
*** zzzeek has joined #openstack-kolla22:46
*** zzzeek has quit IRC23:43
*** zzzeek has joined #openstack-kolla23:45

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!