Friday, 2020-04-17

*** cdearborn has quit IRC00:28
*** ricolin has joined #openstack-kolla01:14
*** cah_link1 has joined #openstack-kolla01:36
*** cah_link has quit IRC01:38
*** cah_link1 is now known as cah_link01:38
openstackgerritXing Zhang proposed openstack/kolla-ansible master: Remove task for adding octavia to admin project  https://review.opendev.org/72024302:21
*** igordc has joined #openstack-kolla02:46
*** igordc has quit IRC02:52
*** igordc has joined #openstack-kolla02:52
*** igordc has quit IRC02:57
*** evrardjp has quit IRC04:37
*** evrardjp has joined #openstack-kolla04:37
*** kevinz has joined #openstack-kolla04:42
*** ykarel|away is now known as ykarel04:51
*** skramaja has joined #openstack-kolla04:53
*** jovial[m] has quit IRC05:10
*** mnasiadka has quit IRC05:10
openstackgerritMerged openstack/kolla-ansible master: CI: Set post timeout to half hour  https://review.opendev.org/72049605:14
*** jovial[m] has joined #openstack-kolla05:15
*** mnasiadka has joined #openstack-kolla05:15
*** k_mouza has joined #openstack-kolla05:19
*** k_mouza has quit IRC05:23
sri_morning05:36
*** oklhost has joined #openstack-kolla05:39
oklhostHi @all05:39
oklhostI got some issues while deploying monasca with help of kolla-ansible. All containers are up and running, but monasca-api-error.log is full of errors: ImportError: No module named enum. Also after enabling monasca, the central logging seems broken. I would be very grateful to get a tip here. We're planning to migrate a lot of our VMware workloads to OpenStack, but a lot of these monitoring tools not working after deployment. Same for05:44
oklhost cloudkitty, but for now I disabled cloudkitty.05:44
*** bline has quit IRC05:56
*** dking has quit IRC05:58
*** nikparasyr has joined #openstack-kolla06:18
*** dougsz has joined #openstack-kolla06:48
*** xinliang has joined #openstack-kolla06:55
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477906:55
*** cah_link1 has joined #openstack-kolla07:11
*** cah_link has quit IRC07:12
*** cah_link1 is now known as cah_link07:12
*** jbadiapa has joined #openstack-kolla07:19
*** rpittau|afk is now known as rpittau07:19
*** bengates has joined #openstack-kolla07:23
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477907:26
*** bersace has joined #openstack-kolla07:28
*** born2bake has joined #openstack-kolla07:29
*** bengates has quit IRC07:34
*** bengates has joined #openstack-kolla07:34
cosmicsoundconnecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). _do_conn /var/lib/kolla/venv/lib/python3.6/site-packages/cinder/volume/drivers/rbd.py:43107:40
cosmicsoundInitialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 15880.4, 'free_capacity_gb': 15831.53, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info':07:43
cosmicsound'ceph:/etc/ceph/ceph.conf:e315504e-ec57-42ae-84dc-24ad28a677a1:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'rbd-1', 'replication_enabled': False, 'provisioned_capacity_gb': 320, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title':07:43
cosmicsound'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. init_capabilities07:43
cosmicsound/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/volume/driver.py:79107:43
*** well100 has joined #openstack-kolla07:54
well100hello07:54
*** threestrands has quit IRC07:56
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477908:00
openstackgerritPierre Riteau proposed openstack/kayobe master: Docs: Ansible tuning  https://review.opendev.org/72054208:01
well100you are support bgpvpn?08:02
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477908:04
mnasiadkamorning08:06
mnasiadkawell100: you mean bagpipe?08:06
well100mnasiadka: this mean https://docs.openstack.org/networking-bgpvpn/train/user/index.html08:07
mnasiadkawell100: I'm asking which driver.08:08
well100yes bagpipe08:08
mnasiadkaI don't see it installed in Kolla Neutron containers - so no support out of the box08:09
*** seco has joined #openstack-kolla08:09
mnasiadkabut if you build your own images and add bagpipe with template-override plus override neutron configs in kolla-ansible - it should work08:10
hrwelo08:12
hrwmnasiadka: https://review.opendev.org/#/c/720566/ CI job needs your vote08:12
patchbotpatch 720566 - kolla - CI: add kolla-ansible-debian-source-aarch64 job - 2 patch sets08:12
*** e0ne has joined #openstack-kolla08:13
hrwand https://review.opendev.org/#/c/720480/ so there will be working something to test ;d08:14
patchbotpatch 720480 - kolla - nova-libvirt: fix after centos 7 removal damage - 1 patch set08:14
mnasiadkahrw: will do - ansible lint long lines needs your vote - https://review.opendev.org/#/c/702429/ :)08:18
patchbotpatch 702429 - kolla-ansible - Ansible lint: lines longer than 160 chars - 8 patch sets08:18
hrwwill do08:19
hrwapproved08:20
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477908:23
*** ykarel is now known as ykarel|lunch08:26
oklhostno one has an idea about my problem? :(08:29
*** e0ne_ has joined #openstack-kolla08:30
*** e0ne has quit IRC08:30
cosmicsoundgood day08:30
mnasiadkaoklhost: this sounds like a bug - please raise one on launchpad.net - please write in the bug what distro you use, what install type (source/binary) and what openstack release (stein/train/whatever)08:31
oklhostthx!08:32
oklhostFor me it looks like the apache is configured using wsgi-2.7 but the venv is 3.608:33
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477908:33
oklhost[Fri Apr 17 07:31:26.730698 2020] [wsgi:error] [pid 29:tid 139675178346240] [remote 10.38.1.14:35918] mod_wsgi (pid=29): Target WSGI script '/monasca-api/monasca_api/api/wsgi.py' cannot be loaded as Python module.08:33
oklhost[Fri Apr 17 07:31:26.730746 2020] [wsgi:error] [pid 29:tid 139675178346240] [remote 10.38.1.14:35918] mod_wsgi (pid=29): Exception occurred processing WSGI script '/monasca-api/monasca_api/api/wsgi.py'.08:33
oklhost[Fri Apr 17 07:31:26.730765 2020] [wsgi:error] [pid 29:tid 139675178346240] [remote 10.38.1.14:35918] Traceback (most recent call last):08:33
oklhost[Fri Apr 17 07:31:26.730787 2020] [wsgi:error] [pid 29:tid 139675178346240] [remote 10.38.1.14:35918]   File "/monasca-api/monasca_api/api/wsgi.py", line 18, in <module>08:33
oklhost[Fri Apr 17 07:31:26.730846 2020] [wsgi:error] [pid 29:tid 139675178346240] [remote 10.38.1.14:35918]   File "/var/lib/kolla/venv/lib/python3.6/site-packages/monasca_api/api/server.py", line 21, in <module>08:33
oklhost[Fri Apr 17 07:31:26.730893 2020] [wsgi:error] [pid 29:tid 139675178346240] [remote 10.38.1.14:35918]     from oslo_config import cfg08:33
oklhost[Fri Apr 17 07:31:26.730900 2020] [wsgi:error] [pid 29:tid 139675178346240] [remote 10.38.1.14:35918]   File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_config/cfg.py", line 39, in <module>08:33
oklhost[Fri Apr 17 07:31:26.731319 2020] [wsgi:error] [pid 29:tid 139675178346240] [remote 10.38.1.14:35918]     import enum08:33
hrwmnasiadka: https://paste.centos.org/view/c39381eb08:33
hrwoklhost: use pastebin.com08:33
cosmicsoundanyone seen this on cinder / ceph before?  https://mdb.uhlhost.net/uploads/8806154cd23bf430/image.png08:33
mnasiadkaoklhost: or paste.openstack.org - or any paste08:33
oklhostWell, sorry08:34
mnasiadkahrw: looks good :)08:34
hrwmnasiadka: run.yml is worse08:35
oklhosthttp://paste.openstack.org/raw/792300/08:36
mnasiadkahrw: one thing at a time - I've added E303 to skip list (git used in place of git module)08:36
oklhostI use ubuntu with "source" in globals.yml, downloaded all images from docker hub and pushed it to our local registry08:36
mnasiadkahrw: and I'm thinking if we shouldn't add E305 for run.yml - because that will be a lot of rewriting...08:37
hrwmnasiadka: :)08:37
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: Lint CI ansible rules  https://review.opendev.org/72066408:38
hrwsmall steps08:38
hrwmnasiadka: most of run.yml E305 can probably be command instead of shell08:39
hrwmnasiadka: just need to make sure that scripts are executable08:39
hrwright?08:39
mnasiadkatrue08:40
mnasiadkamgoddard: rework or skip? ^^08:40
mgoddardmnasiadka: we don't need to lint our test playbooks08:41
cosmicsoundhttp://paste.openstack.org/show/792302/08:41
mgoddardat least not right now08:41
mgoddardwe've spent enough time linting this cycle :)08:42
cosmicsoundthis is repeating endlessly08:42
cosmicsoundand it seems it has the same request name08:42
mnasiadkamgoddard: makes sense, let me see how to nicely exclude it08:43
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: kibana/debian: use upstream package on all architectures  https://review.opendev.org/71861208:47
cosmicsoundwheni create a machine the volumes are created. and all works, yet the logs are not positive08:48
cosmicsoundhttp://paste.openstack.org/show/792303/08:51
cosmicsoundCould this be a bug?08:51
cosmicsoundit does not make sense one request passes and some periodic repetitive request isnt08:52
mnasiadkacosmicsound: where do you see an error?08:52
cosmicsound2020-04-17 08:49:47.972 35 DEBUG cinder.volume.drivers.rbd [req-76749fbb-e4dd-4efa-8b04-1784370e2e35 - - - - -] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). _do_conn /var/lib/kolla/venv/lib/python3.6/site-packages/cinder/volume/drivers/rbd.py:43108:54
cosmicsoundhere08:54
cosmicsoundsame request repeating and. getting timeout -1?08:54
cosmicsoundlast lines08:54
mnasiadkano, timeout is set to -108:54
cosmicsoundok08:55
cosmicsoundso thats all normal08:55
mnasiadkaand it's repeating, because it's how it works - it's collecting driver status - better focus on finding logs with ERROR08:56
cosmicsoundthanks for the tip08:58
cosmicsoundi have none :D08:58
cosmicsoundat the moment08:58
mnasiadkacosmicsound: you are the first person to look in the logs when everything works :)08:58
cosmicsoundhttps://mdb.uhlhost.net/uploads/08a46c4a93effa3e/image.png08:59
cosmicsound:D08:59
cosmicsoundhave some warnings, i mostly need to either check more or open bugs :D08:59
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477909:00
*** k_mouza has joined #openstack-kolla09:02
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: Fix service_mapped_to_host filter for common services  https://review.opendev.org/72066909:09
*** bornie2bake has joined #openstack-kolla09:12
*** tonythomas has joined #openstack-kolla09:17
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Remove task for adding octavia to admin project  https://review.opendev.org/72024309:24
*** ykarel|lunch is now known as ykarel09:25
openstackgerritMerged openstack/kayobe master: Update inventory templates for Ussuri  https://review.opendev.org/72052109:28
openstackgerritMerged openstack/kolla-ansible master: Ansible lint: lines longer than 160 chars  https://review.opendev.org/70242909:29
openstackgerritXing Zhang proposed openstack/kolla-ansible master: Remove task for adding octavia to admin project  https://review.opendev.org/72024309:33
openstackgerritXing Zhang proposed openstack/kolla-ansible master: Remove task for adding octavia to admin project  https://review.opendev.org/72024309:33
*** k_mouza has quit IRC09:47
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Remove octavia user from admin project  https://review.opendev.org/72024309:50
openstackgerritMark Goddard proposed openstack/kayobe master: Allow OVS bridges to connect directly to interface  https://review.opendev.org/70503709:51
*** k_mouza has joined #openstack-kolla09:58
bornie2bakehi.. maybe its a weird question... but is there any way to make horizon loading faster? :)10:02
hrwbornie2bake: run it of faster machine?10:03
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CentOS 8: CI: Test CentOS 7 to 8 migration  https://review.opendev.org/71160110:03
bornie2bakemachine: 64gb ram, 16 cpu's10:03
*** numans has quit IRC10:08
*** skramaja_ has joined #openstack-kolla10:08
*** numans has joined #openstack-kolla10:10
*** skramaja has quit IRC10:10
openstackgerritMark Goddard proposed openstack/kayobe master: Avoid writing out requirements.txt in kolla-ansible role  https://review.opendev.org/70785310:15
*** e0ne_ has quit IRC10:21
*** e0ne has joined #openstack-kolla10:22
*** gfidente|afk is now known as gfidente10:22
mrungeHi there, there is still a change for the collectd container up, it makes things easier. could anyone take a quick loog at https://review.opendev.org/#/c/718671 ?10:24
patchbotpatch 718671 - kolla (stable/train) - add collectd-pmu, collectd-rtd and collectd-turbos... - 2 patch sets10:24
*** xinliang has quit IRC10:29
*** rpittau is now known as rpittau|bbl10:30
*** bornie2bake has quit IRC10:31
hrwyoctozepto, mgoddard: https://review.opendev.org/#/c/714393/ https://review.opendev.org/#/c/714394/ - ideas for better solutions?10:40
patchbotpatch 714393 - kolla-ansible - nova: support dev_mode for API bootstrap - 1 patch set10:40
patchbotpatch 714394 - kolla-ansible - nova-cell: for dev_mode it is 'nova' - 1 patch set10:40
*** cah_link has quit IRC10:41
*** k_mouza has quit IRC10:43
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477910:44
openstackgerritMerged openstack/kolla-ansible master: Add support for encrypting cinder api.  https://review.opendev.org/70966310:45
hrwyoctozepto: https://paste.centos.org/view/98258cf1 is what you suggested?10:45
openstackgerritMerged openstack/kolla-ansible master: OVN: Followup changes  https://review.opendev.org/72043010:47
*** numans has quit IRC10:59
*** bengates has quit IRC10:59
*** bengates has joined #openstack-kolla10:59
*** bengates has quit IRC11:02
*** bengates has joined #openstack-kolla11:03
*** dannins has quit IRC11:03
*** k_mouza has joined #openstack-kolla11:04
born2bakemanila-related question: I have external ceph deployed via ceph-ansible, mds-cephfs is active. Deployed manila with enable_manila_backend_cephfs_native; https://docs.openstack.org/kolla-ansible/train/reference/storage/manila-guide.html following this guide, creating share using CEPHFS instead of NFS, share is created with error. In the logs: manila-scheduler.log - InvalidParameterValue: You must create a share type in advance, and specify in11:05
born2bakerequest body or set default_share_type in manila.conf. However, default share type is specified in the first step of the guide - manila type-create default_share_type True11:05
openstackgerritMark Goddard proposed openstack/kayobe master: Improve SSH known host error messages  https://review.opendev.org/72068711:08
openstackgerritMerged openstack/kayobe stable/train: CentOS 8: seed VM & bifrost  https://review.opendev.org/72027811:09
openstackgerritMerged openstack/kolla master: nova-libvirt: fix after centos 7 removal damage  https://review.opendev.org/72048011:10
openstackgerritMerged openstack/kolla master: CI: add kolla-ansible-debian-source-aarch64 job  https://review.opendev.org/72056611:10
hrwdown to 17 opened patches ;D11:11
*** e0ne has quit IRC11:25
*** e0ne has joined #openstack-kolla11:25
*** dougsz has quit IRC11:35
*** nikparasyr has quit IRC11:35
born2bakemanila-related question: I have external ceph deployed via ceph-ansible, mds-cephfs is active. Deployed manila with enable_manila_backend_cephfs_native; https://docs.openstack.org/kolla-ansible/train/reference/storage/manila-guide.html following this guide, creating share using CEPHFS instead of NFS, share is created with error. In the logs: manila-scheduler.log - InvalidParameterValue: You must create a share type in advance, and specify in11:40
born2bakerequest body or set default_share_type in manila.conf. However, default share type is specified in the first step of the guide - manila type-create default_share_type True11:40
openstackgerritMerged openstack/kolla stable/train: Add vitrage-persistor image  https://review.opendev.org/71917611:40
openstackgerritMerged openstack/kolla stable/stein: Add vitrage-persistor image  https://review.opendev.org/71917811:40
*** nikparasyr has joined #openstack-kolla11:41
*** jonaspaulo has joined #openstack-kolla11:48
*** hjensas has quit IRC11:52
*** bengates has quit IRC12:04
*** bengates has joined #openstack-kolla12:04
*** cah_link has joined #openstack-kolla12:07
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CentOS 8: CI: Test CentOS 7 to 8 migration  https://review.opendev.org/71160112:14
*** rpittau|bbl is now known as rpittau12:19
*** hjensas has joined #openstack-kolla12:21
*** e0ne has quit IRC12:23
*** e0ne has joined #openstack-kolla12:23
yoctozeptohrw: could be, my memory is limited ;-)12:32
*** ykarel is now known as ykarel|afk12:35
*** ykarel|afk is now known as ykarel12:39
*** negronjl has quit IRC12:42
*** negronjl has joined #openstack-kolla12:43
yoctozeptois it just me or stable branches CI is severly butchered?12:49
stingrayzahey folks o/12:50
stingrayzaquick q: the oom-killer on one of my kolla compute nodes nuked a couple of vms - has anyone seen something like this before? surely it shouldn't have been scheduled there if there wasn't enough space to run it?12:52
stingrayzaand is there anything I can do to stop it from happening again...12:54
openstackgerritWill Szumski proposed openstack/kayobe master: Add support for encrypted block devices  https://review.opendev.org/72004013:02
openstackgerritMerged openstack/kolla-ansible master: Remove octavia user from admin project  https://review.opendev.org/72024313:05
*** eliaswimmer has quit IRC13:11
kplantstingrayza: are you running pinned or shared?13:12
stingrayzakplant: I _think_ pinned (If I understand the question). There's no block storage (not yet running cinder), instances use local storage on each compute node and are generally tied to that compute node for their lifetime.13:14
kplantsorry, i meant pinned or shared cpus :-)13:15
stingrayzanp :) I don't know - how would I check?13:15
kplantwell, if you haven't configured it - you're using shared vcpus13:15
kplantthere's a setting in nova you can set so you can't over subscribe memory13:15
kplantlet me find it13:16
stingrayzathanks!13:16
kplant[default] / ram_allocation_ratio13:16
kplantif you set that to <= 1.0, it won't schedule more than the available memory on the machine13:17
stingrayzayup (just stumbled across this) https://docs.openstack.org/nova/latest/admin/cpu-topologies.html13:17
kplantover subscribing vcpus is cool (sometimes), but imo oversubscribing ram isn't :-)13:17
kplanti would also set that ratio to something < 1.0 to leave memory for the os,nova,etc.13:18
stingrayzayeah - that's pretty much the same view as I have...13:18
stingrayzaany way to see what the system is using for that value if I haven't explicitly set it?13:18
stingrayza(my old cluster before k-a was set to 1.0 somewhere along the line)13:19
kplantyou can use osprofiler to dump the running nova.conf, iirc13:19
born2bakemanila-related question: I have external ceph deployed via ceph-ansible, mds-cephfs is active. Deployed manila with enable_manila_backend_cephfs_native; https://docs.openstack.org/kolla-ansible/train/reference/storage/manila-guide.html following this guide, creating share using CEPHFS instead of NFS, share is created with error. In the logs: manila-scheduler.log - InvalidParameterValue: You must create a share type in advance, and specify in13:20
born2bakerequest body or set default_share_type in manila.conf. However, default share type is specified in the first step of the guide - manila type-create default_share_type True13:20
kplantlooks like default for [default]/initial_ram_allocation_ratio is 1.513:20
stingrayzaah, gotcha. yeah - that's not going to work for me - our use-case is ram heavy and that's always our first thing to run out of13:23
stingrayzacool. let me set to 1.0 and see how I go from there...13:23
stingrayzathanks, kplant!13:23
kplantyw, gl13:24
*** jimcrowleyibm has joined #openstack-kolla13:25
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/train: CentOS 8: CI: Test CentOS 7 to 8 migration  https://review.opendev.org/71160113:30
*** ykarel is now known as ykarel|afk13:31
*** cdearborn has joined #openstack-kolla13:39
*** bornie2bake has joined #openstack-kolla13:46
*** averi has joined #openstack-kolla13:54
*** averi has left #openstack-kolla13:56
*** TrevorV has joined #openstack-kolla14:15
*** bengates has quit IRC14:27
*** bengates has joined #openstack-kolla14:27
*** dking has joined #openstack-kolla14:28
*** e0ne has quit IRC14:28
*** jimcrowleyibm has quit IRC14:28
*** jimcrowleyibm has joined #openstack-kolla14:30
*** seco has quit IRC14:30
dkingmgoddard: Would you happen to be around this morning (evening for you)?14:32
*** e0ne has joined #openstack-kolla14:34
mgoddarddking: hi, yes I'm around. What's up?14:34
dkingFirst, I saw your code review. That does seem helpful for me. I think I was also missing the deploy step, but seeing the code from A Universe From Nothing is very helpful.14:35
dkingI have a few questions at the moment before the weekend, though. One of them is that I noticed that in https://docs.openstack.org/kayobe/latest/configuration/network.html#configuring-network-roles, should it instead be external_net_names as a list, rather than external_net_name as a string? The inline comments say that the later is deprecated. It would work as it is, but I was wondering if external_net_names might be14:37
*** skramaja has joined #openstack-kolla14:39
mgoddarddking: external_net_names is the preferred approach14:40
mgoddardI'll update the docs14:40
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Fix ntp and chrony in mixed CentOS 7 and 8 environments  https://review.opendev.org/72073114:40
dkingThanks. That's a small thing. I just missed the difference in the name, and it caused me to some cconfusion.14:40
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Remove unused rgw_port ceph variable  https://review.opendev.org/72073214:42
mgoddarddking: thanks for raising it14:42
dkingCurrently, my issue is that I'm getting that error about "The Python 2 bindings for rpm are needed for this module." So, I'm assuming that somewhere, maybe something is trying to use Python 3? I know this is probably more of an Ansible question, but I'm having trouble locating where that is.14:42
openstackgerritPierre Riteau proposed openstack/kayobe stable/train: Prevent openrc files from using wrong OS_CACERT value  https://review.opendev.org/72073314:43
openstackgerritMark Goddard proposed openstack/kayobe master: Docs: fix reference to deprecated external_net_name  https://review.opendev.org/72073414:43
*** yevi has joined #openstack-kolla14:43
mgoddarddking: which version/branch are you using?14:44
mgoddardand is it CentOS 7 or 8?14:44
dkinghttp://paste.openstack.org/show/792333/14:44
dkingCentOS 7 on both the Ansible host and the seed host.14:44
mgoddardand which version/branch of kayobe?14:45
*** skramaja_ has quit IRC14:46
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: [DNM] OVN IPv6  https://review.opendev.org/72073514:46
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: [DNM] OVN IPv6  https://review.opendev.org/72073514:47
dkingThat may be a good question. I was just looking at that I've been using Train, but I don't know that I specified anything on this particular attempt. This time, I just installed with "pip install kayobe".14:47
openstackgerritPierre Riteau proposed openstack/kayobe master: Use upper constraints when installing or updating packages  https://review.opendev.org/72073614:47
mgoddarddking: you should be able to run kayobe --version14:48
dkingkayobe 7.0.014:49
mgoddarddking: you shouldn't need the arguments:14:52
mgoddard -i $KAYOBE_CONFIG_PATH/inventory --kolla-config-path $KOLLA_CONFIG_PATH --kolla-venv $base_path/venvs/kolla-ansible14:52
mgoddardespecially if you sourced kayobe-config/kayobe-env14:53
dkingI'm no longer using A Universe From Nothing. I'm just using it as a starting point. I was having an error with virtual seed host, and so I moved back to just using Kayobe.14:55
*** bornie2bake has quit IRC14:55
dkingI've just been reading its configs to get an idea of a sane set of configs to start with, and looking at the scripts to get an idea of the right way to deploy.14:55
dkingWhatever happened, it must have been my mistake. I just tried running "kayobe control host bootstrap" again, and I got the same error, which I didn't get before. I don't recall making any changes to the python version, though. I just had to pip install selinux.14:58
*** seco has joined #openstack-kolla14:59
mgoddarddking: do you have 'localhost ansible_connection=local' in the inventory?14:59
dkingYes, it's there in the hosts file in the inventory.15:00
mgoddarddking: ok, I'm going to try running through the early install on CentOS 715:01
*** bengates has quit IRC15:01
*** bengates_ has joined #openstack-kolla15:01
dkingOkay. I may have to try making a new venv and try again.15:01
*** seco has quit IRC15:03
*** skramaja has quit IRC15:05
*** ykarel|afk is now known as ykarel15:06
dkingIs there a way to start fresh with Kayobe?15:07
dkingOther than Re-OSing the Ansible host?15:08
*** bline has joined #openstack-kolla15:08
mgoddarddking: yeah apart from a few packages everything should be wipeable by removing $base_dir15:09
kplanthey mgoddard - anything on the roadmap to add support for https://docs.openstack.org/adjutant/latest/index.html in kolla/k-a ?15:10
kplanti might take a stab at building a container for it if not15:10
mgoddardkplant: not that I'm aware of. Bear in mind that it had some questions around it during the PTL election: https://etherpad.opendev.org/p/victoria-leaderless15:14
mgoddardkplant: eventually the main lead Adrian remembered to step up, but it highlighted that the project has not yet had an official release15:14
mgoddarddking: I was able to run the following in a CentOS 7.7 VM: http://paste.openstack.org/show/792337/15:17
mgoddarddking: that may give you something to compare with15:18
*** ricolin has quit IRC15:19
openstackgerritMerged openstack/kolla stable/train: add collectd-pmu, collectd-rtd and collectd-turbostat to C8  https://review.opendev.org/71867115:19
dkingThanks. I'm sure I mucked something up myself, probably when I was trying to handle the selinux issue.15:20
openstackgerritRadosław Piliszek proposed openstack/kolla master: Cleanup py27 support  https://review.opendev.org/72075115:20
dkingmgoddard: I see that you run "kayobe playbook run venvs/kayobe/share/kayobe/ansible/ip-allocation.yml". So, that's before kayobe seed host configure?15:20
mgoddarddking: it was just a shortcut to run the playbook that failed for you. It's part of the seed host configure command15:21
dkingor is that just how to run that one play from "kayobe seed host configure" that I'm having the current trouble executing?15:21
dkingOkay.15:21
dkingIt's good to know that I can do that to run individual parts.15:22
dkingAlso, https://github.com/openstack/kayobe-config-dev is a different repo than what I was using. I was using the one without "-dev". Is kayobe-config-dev recommended?15:23
kplantmgoddard: i had no idea, i guess i thought the project was further along than it is. i don't want to make work for other people, especially when it's something uncertain15:24
mgoddarddking: that's our testing/development all-in-one config. We use it in CI and local development15:25
mgoddarddking: kayobe-config is the raw unconfigured config, you should use that15:25
dkingOkay. I might take a look at it, though, especially if it's what's used in CI.15:26
mgoddardkplant: I don't think it's dead, but I'd suggest doing some research if you think it might be useful for you15:26
mgoddarddking: yeah, might be useful. It's not dissimilar to the a-u-f-n config, just for a single host15:26
dkingAnd I have another question for in the future. I haven't made it that far yet, but  I noticed that bifrost runs in a container on the seed host. Once things are up, I'll want to be able to poll the inventory remotely. Would I just be able to expose the port of the running container so that I could make ironic requests?15:27
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox  https://review.opendev.org/69477915:28
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Cleanup py27 support  https://review.opendev.org/72075215:30
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Cleanup py27 support  https://review.opendev.org/72075215:35
openstackgerritQitao proposed openstack/kolla-ansible master: Add vitrage-persistor service  https://review.opendev.org/71536415:35
mgoddarddking: the container uses host networking, so you can access the APIs15:40
kplantmgoddard: yeah i'm still going to pursue it personally, just want to respect other peoples time before i bother them about getting this into k/ka :-)15:40
dkingThat's even better! Thanks for your help.15:40
*** sean-k-mooney has quit IRC15:41
openstackgerritRadosław Piliszek proposed openstack/kolla-cli master: Cleanup py27 support  https://review.opendev.org/72075415:42
dkingA quick question, though. I had tried, very briefly, to setup bifrost previously, using instructions that I think were part of a quickstart using kolla-ansible. However, I seem to recall that the image was broken, and was told that it had something to do with changes to Python 2 -> 3. I'm assuming there are checks done for CI for Kayobe that make sure that whatever bifrost image or source is being used is working corr15:44
mgoddarddking: there was a lot of churn while we added support for python 3 & centos 8, but it's now pretty stable. We test a seed deploy in CI15:45
dkingOkay. Thank you very much. I feel a bit better knowing that was addressed.15:47
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Fix ntp and chrony in mixed CentOS 7 and 8 environments  https://review.opendev.org/72073115:55
*** ykarel is now known as ykarel|away15:57
openstackgerritMark Goddard proposed openstack/kayobe stable/train: Fix ntp and chrony in mixed CentOS 7 and 8 environments  https://review.opendev.org/72073115:59
openstackgerritRadosław Piliszek proposed openstack/kayobe master: Cleanup py27 support  https://review.opendev.org/72076416:04
*** e0ne has quit IRC16:04
*** e0ne_ has joined #openstack-kolla16:04
openstackgerritRadosław Piliszek proposed openstack/kolla-cli master: Cleanup py27 support  https://review.opendev.org/72075416:05
openstackgerritRadosław Piliszek proposed openstack/kolla-cli master: Cleanup py27 support  https://review.opendev.org/72075416:06
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Cleanup py27 support  https://review.opendev.org/72075216:07
openstackgerritRadosław Piliszek proposed openstack/kolla master: Cleanup py27 support  https://review.opendev.org/72075116:07
*** rpittau is now known as rpittau|afk16:17
*** gfidente is now known as gfidente|afk16:20
openstackgerritRadosław Piliszek proposed openstack/kayobe master: Cleanup py27 support  https://review.opendev.org/72076416:26
*** negronjl has quit IRC16:29
*** hamzy__ has joined #openstack-kolla16:31
*** hamzy_ has quit IRC16:31
*** negronjl has joined #openstack-kolla16:33
*** evrardjp has quit IRC16:37
*** bengates_ has quit IRC16:37
*** evrardjp has joined #openstack-kolla16:37
*** bengates has joined #openstack-kolla16:38
*** kevinz has quit IRC16:40
sri_cosmicsound: hi are you able solve the the rgw keystone integration ?16:43
*** bengates has quit IRC16:44
sri_cosmicsound: I've created new lab today, I was able to create swift endpoints and it's working, let me know i can give the my notes16:45
*** gfidente|afk has quit IRC16:46
*** igordc has joined #openstack-kolla17:04
*** igordc has quit IRC17:09
openstackgerritRadosław Piliszek proposed openstack/kolla-cli master: Cleanup py27 support  https://review.opendev.org/72075417:10
yoctozeptosri_: you can share this even in a bug report so that all benefit17:12
sri_yoctozepto: sure :)  http://paste.openstack.org/show/792344/17:15
*** k_mouza has quit IRC17:16
*** nikparasyr has quit IRC17:18
yoctozeptosri_: thanks!17:21
sri_:)17:29
born2bakesri_ did you have any autharization issues? My setup is pretty much similar to yours and its still not working for me :/17:33
born2bakeWhen I open object store in horizon, getting kicked. when i am trying to use openstack container list as an admin - 401 unauthorized error :/17:34
sri_no, did you restart the ceph mon and rgw after updating config  ?17:34
sri_born2bake: can you see any error messages in rgw logs ?17:36
born2bake2020-04-17T19:08:23.924+0300 7f76f3f9f700  1 op->ERRORHANDLER: err_no=-1 new_err_no=-117:37
born2bake2020-04-17T19:08:23.924+0300 7f76f3f9f700  1 ====== req done req=0x7f7808510870 op status=0 http_status=401 latency=0s ======17:37
*** e0ne_ has quit IRC17:38
*** e0ne has joined #openstack-kolla17:38
sri_born2bake: my setup is string forward Installed the ceph with ceph-ansible, then installed the openstack with k-a then updated the ceph.conf in rgw section, restarted the ceph rgw and mon. then create the swift endpoints17:45
born2bakeso did I :) how did you restart ceph rgw and mon on the node?17:46
sri_born2bake: systemctl restart ceph-mon@cloudnodesite1.service,   systemctl restart ceph-radosgw@rgw.cloudnodesite1.rgw0.service17:47
*** e0ne_ has joined #openstack-kolla17:49
*** e0ne has quit IRC17:49
sri_born2bake: FYI  this is all-in-one setup, ceph and openstack running in the same server17:49
born2bakesame for me :)17:49
yeviFor me, with Train release, I use this path `/swift/v1/AUTH_%\(project_id\)s` for rgw keystone integration17:51
*** dciabrin has quit IRC18:00
cosmicsoundSri_ my integration still fails for now18:42
cosmicsoundpm details18:42
cosmicsoundanyone here running working reverse dns with designate?18:42
cosmicsoundi have some issues gettings the right pools details in place. Think there might be some issues with the built in template or is just me done something wrong.18:43
sri_cosmicsound: hmm, I've done this with stein and train both working, how did rgw keyring was created ?18:47
cosmicsoundAt initial command to give permissions18:49
*** dciabrin has joined #openstack-kolla18:52
sri_cosmicsound: I did not give any permissions, installed ceph using c-a, that's it18:56
*** e0ne_ has quit IRC18:56
*** e0ne has joined #openstack-kolla18:56
cosmicsoundRight18:57
cosmicsoundwell something is wrong surely18:57
cosmicsoundEverything works except swift18:58
cosmicsoundi think my keystone integration or something is broken18:58
cosmicsoundsri_ can you share your ceph.conf part with rgw settings?18:59
sri_cosmicsound: http://paste.openstack.org/show/792344/19:00
openstackgerritMark Goddard proposed openstack/kayobe master: WIP: Revove support for CentOS 7 and Python 2  https://review.opendev.org/72081819:02
*** dougsz has joined #openstack-kolla19:15
*** cah_link1 has joined #openstack-kolla19:19
*** cah_link has quit IRC19:20
*** cah_link1 is now known as cah_link19:20
*** e0ne has quit IRC19:26
*** jimcrowleyibm has quit IRC19:48
*** jimcrowleyibm has joined #openstack-kolla19:48
*** cah_link has quit IRC19:51
openstackgerritMerged openstack/kolla stable/train: Fix that the cyborg database init failed.  https://review.opendev.org/72037019:57
openstackgerritMerged openstack/kolla-ansible master: Remove unused rgw_port ceph variable  https://review.opendev.org/72073219:57
openstackgerritMerged openstack/kolla-ansible master: Add vitrage-persistor service  https://review.opendev.org/71536419:57
*** TrevorV has quit IRC20:04
*** dougsz has quit IRC20:33
*** dougsz has joined #openstack-kolla20:34
*** dougsz has quit IRC20:38
openstackgerritMark Goddard proposed openstack/kayobe master: WIP: Revove support for CentOS 7 and Python 2  https://review.opendev.org/72081821:12
*** jimcrowleyibm has quit IRC21:28
yeviCuriosity question, I am new to Kolla-ansible, but not new to openstack. After doing a couple installs I strated to dig around the configs and noticed that you still have a value for using port 35357 for auth_url which I thought was depricated in queens after switching to identity v3 for the auth_uri over port 5000. Is it still there for backwards compatabilty?21:33
*** tonythomas has quit IRC21:56
*** jbadiapa has quit IRC21:57
born2bakesri_ thanks a lot! swift worked lol :)22:15
sri_born2bake: glad to hear that 👍22:29
*** igordc has joined #openstack-kolla23:08
openstackgerritJames Kirsch proposed openstack/kolla master: Add stunnel container for Glance service  https://review.opendev.org/72085023:24
*** igordc has quit IRC23:27
*** born2bake has quit IRC23:43
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for encrypting glance/heat api  https://review.opendev.org/70713123:45
openstackgerritJames Kirsch proposed openstack/kolla-ansible master: Add support for encrypting glance/heat api  https://review.opendev.org/70713123:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!