Monday, 2020-11-02

« Sunday, 2020-11-01 Index Tuesday, 2020-11-03 »
*** LinPeiWen has joined #openstack-kolla00:40
*** zzzeek has quit IRC00:49
*** zzzeek has joined #openstack-kolla00:50
*** dswebb has quit IRC01:59
*** k_mouza has joined #openstack-kolla02:16
*** k_mouza has quit IRC02:21
dmsimardo/ i'm experimenting with metrics in ara and this is some data I have for kolla-ansible: http://paste.openstack.org/raw/799590/02:40
dmsimard^ takes the 10000 longest tasks and then gets metrics about them02:40
dmsimardand this is a query with the latest 10000 tasks from kolla-ansible: http://paste.openstack.org/raw/799591/02:42
*** xinliang has joined #openstack-kolla02:44
*** xinliang has quit IRC03:14
*** wuchunyang has joined #openstack-kolla03:44
*** wuchunyang has quit IRC04:01
*** skramaja has joined #openstack-kolla04:13
*** zzzeek has quit IRC04:26
*** zzzeek has joined #openstack-kolla04:28
*** benj_ has quit IRC05:04
*** benj_ has joined #openstack-kolla05:07
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-kolla05:33
*** wuchunyang has joined #openstack-kolla05:46
*** vishalmanchanda has joined #openstack-kolla06:22
*** abdysn has joined #openstack-kolla06:28
*** xinliang has joined #openstack-kolla06:36
*** e0ne has joined #openstack-kolla07:02
*** skramaja has quit IRC07:14
*** skramaja has joined #openstack-kolla07:15
*** brinzhang has joined #openstack-kolla07:26
*** cah_link has joined #openstack-kolla07:27
*** cah_link has quit IRC07:34
*** cah_link1 has joined #openstack-kolla07:34
*** cah_link1 is now known as cah_link07:37
*** skramaja has quit IRC07:37
*** skramaja has joined #openstack-kolla07:38
*** xinliang has quit IRC07:40
*** xinliang has joined #openstack-kolla07:41
mnasiadkadmsimard: I think there's something wrong with sorting :)08:31
*** bengates has joined #openstack-kolla08:55
*** bengates has quit IRC08:55
*** brinzhang_ has joined #openstack-kolla08:55
*** bengates has joined #openstack-kolla08:55
*** brinzhang has quit IRC08:58
*** gfidente has joined #openstack-kolla09:00
*** dougsz has joined #openstack-kolla09:01
*** brinzhang0 has joined #openstack-kolla09:05
*** brinzhang0 has quit IRC09:06
*** brinzhang0 has joined #openstack-kolla09:07
*** brinzhang0 has quit IRC09:08
*** brinzhang0 has joined #openstack-kolla09:08
*** brinzhang_ has quit IRC09:08
*** born2bake has joined #openstack-kolla09:20
*** rpittau|afk is now known as rpittau09:22
*** nikparasyr has joined #openstack-kolla09:22
*** abdysn has quit IRC09:24
hrwwmorning09:35
*** hrw is now known as Guest8422409:38
*** hrww is now known as Hrw09:38
*** Hrw is now known as hrw09:38
openstackgerritlikui proposed openstack/kolla-ansible master: Use TOX_CONSTRAINTS_FILE  https://review.opendev.org/76079909:42
openstackgerritMichal Nasiadka proposed openstack/kolla master: WIP: Install es-curator from binary repos  https://review.opendev.org/75935409:45
*** cah_link has quit IRC09:45
*** cah_link has joined #openstack-kolla09:45
*** cah_link has quit IRC09:47
*** cah_link has joined #openstack-kolla09:48
openstackgerritlikui proposed openstack/kolla-ansible master: update lower-constraints.txt  https://review.opendev.org/76080209:49
*** k_mouza has joined #openstack-kolla09:53
*** k_mouza has quit IRC09:57
*** k_mouza has joined #openstack-kolla09:58
*** gfidente has quit IRC10:08
*** gfidente has joined #openstack-kolla10:21
*** devfaz has quit IRC10:27
*** devfaz has joined #openstack-kolla10:28
*** born2bake has quit IRC10:29
*** xinliang has quit IRC10:31
*** hjensas|PTO is now known as hjensas10:38
*** abdysn has joined #openstack-kolla10:50
*** dougsz has quit IRC10:51
*** Abdallahyas has joined #openstack-kolla10:54
*** k_mouza has quit IRC10:55
*** k_mouza has joined #openstack-kolla10:56
*** abdysn has quit IRC10:58
*** dougsz has joined #openstack-kolla11:07
dmsimardmnasiadka: yeah.. the column sort is alphabetical :/11:28
*** Abdallahyas has quit IRC11:29
*** abdysn has joined #openstack-kolla11:29
mgoddarddmsimard: looks neat. Can you aggregate by task name (rather than module name)11:32
dmsimardmgoddard: I was thinking about that too. You can filter for a task name (full or partial) but it'd still provide a breakdown per action11:34
dmsimardi wonder how well actually aggregating by task name would work11:35
openstackgerritMerged openstack/kayobe master: docs: Add initial all-in-one scenario  https://review.opendev.org/74858211:35
mgoddarddmsimard: https://github.com/stackhpc/ansible-scaling/11:35
mgoddarddmsimard: the scripts I used from there can aggregate by play, role and task11:36
mgoddardtask was useful11:36
mgoddarddmsimard: this in particular: https://github.com/stackhpc/ansible-scaling/blob/master/tools/profile-parser.py11:37
dmsimardit should be simple enough to aggregate per task name rather than action, I guess we can put it under an argument, fwiw the patch that implements the new command: https://review.opendev.org/#/c/760736/11:38
patchbotpatch 760736 - recordsansible/ara - cli: Add command 'ara task metrics' - 3 patch sets11:38
mgoddarddmsimard: I don't have logs to share, but my rough workflow was: aggregate by play, go through plays in order11:41
mgoddardthen for each play, filter tasks for that play, aggregate by task11:42
hrwmgoddard: what do we miss to make a release?11:42
dmsimardyeah, makes sense11:42
mgoddardhrw: anything not done on here: https://docs.openstack.org/kolla/latest/contributor/release-management.html11:42
dmsimardara already has all of the data inside a database so it's relatively easy, no need for parsing :p11:42
mgoddarddmsimard: you laugh, but I had fun with pandas :)11:44
hrwmgoddard: thx11:44
*** brinzhang0 has quit IRC11:48
dmsimardoh yeah it'd be cool to graph the data too11:57
dmsimardi also did some benchmarking to measure performance improvements: https://ara.recordsansible.org/blog/2020/11/01/benchmarking-ansible-and-ara-for-fun-and-science/11:58
dmsimardnever used pandas before11:58
*** Luzi has joined #openstack-kolla12:08
*** stingrayza has joined #openstack-kolla12:27
*** also_stingrayza has quit IRC12:30
mnasiadkauhh, master k-a jobs in hell - https://zuul.opendev.org/t/openstack/build/0a71216e9b534485a6911f1767c11c57/log/primary/logs/kolla/nova/nova-compute.txt#712:49
r3ap3rDidn't expect to see that first thing this morning when I fired up irc?? lol ^12:52
*** kwazar has joined #openstack-kolla12:54
*** JamesBenson has joined #openstack-kolla12:54
*** Luzi has quit IRC13:20
bjoloperhaps a "stupid" question but... if i want to use vlan tenant networks instead of vxlan. how do i do that in kolla? cant really find any docs about it13:42
mnasiadkabjolo: enable provider networks?13:43
bjoloisnt that something else?13:43
bjoloi use provider networks to be able to deploy VMs directly on external network. i.e. no L3 router13:44
mnasiadkaah, misread the question13:45
bjolowhat i want to do is for a tenant to create their own private networks, but using vlan tags instead of vxlan overlay13:45
bjolono worries :)13:46
bjolowe want to test the overhead of vxlan vs vlan tagged tenant networks. hence the question13:46
mnasiadkawell, if you already have provider networks, so you have a physnet you can use - I haven't really done that in the past, but what stops it from working? :)13:47
mgoddardbjolo: enable_neutron_provider_networks13:49
mgoddardbjolo: and vlan_ranges in ml2_conf.ini13:49
bjoloim kinda lost on the config13:49
bjoloi need to specify a bridge for vlan mapping13:50
*** dmsimard has quit IRC13:51
*** dmsimard has joined #openstack-kolla13:51
bjoloneed to mention, im doing everything on a single interface13:51
bjolobond0 but still just one interface13:51
bjolohttp://paste.openstack.org/show/799601/13:55
bjolothings get deployed and i can create a network, but all ports fails to bind13:55
bjolobond0 is intended to be used directly by neutron for vlan tagged networks (via br-vlan i quess). But the bridgemappings done by kolla also gives it physnet4 and list it as a flat network13:57
bjoloshould i just change the ml2.conf config from:13:58
bjolo[ml2_type_vlan]13:58
bjolo network_vlan_ranges = br-vlan:2036:204013:58
bjoloto13:58
bjolo[ml2_type_vlan]13:58
bjolo network_vlan_ranges = physnet4:2036:204013:59
*** dave-mccowan has quit IRC14:00
*** dmsimard has quit IRC14:03
*** dmsimard has joined #openstack-kolla14:03
*** dave-mccowan has joined #openstack-kolla14:05
dmsimardmgoddard: aggregated by task name: http://paste.openstack.org/raw/799602/14:09
dmsimard(after filtering for the 10000 longest tasks)14:09
ozzzoI'm setting up a Train all-in-one POC following these instructions: https://docs.openstack.org/kolla-ansible/train/user/quickstart.html14:10
mgoddarddmsimard: nice! 1 hour spent bootstrapping nova?14:10
dmsimardover 151 times, yes14:10
ozzzoif I set ansible_python_interpreter: /opt/openstack/bin/python in globals.yml, then I get this error running the prechecks:14:10
ozzzofatal: [localhost]: FAILED! => {"changed": false, "msg": "The Python 2 bindings for rpm are needed for this module. If you require Python 3 support use the `dnf` Ansible module instead.. The Python 2 yum module is needed for this module. If you require Python 3 support use the `dnf` Ansible module instead."}14:10
mgoddardozzzo: system-site-packages14:11
*** dardelean has joined #openstack-kolla14:17
mgoddardbjolo: +1 to physnet414:18
ozzzomgoddard: that fixed it, ty!14:21
*** TrevorV has joined #openstack-kolla14:23
dmsimardmgoddard: here's metrics for a recent enough individual playbook http://paste.openstack.org/raw/799603/14:25
dmsimardah, paste truncated it :(14:25
mgoddarddmsimard: what is --playbook 1376?14:26
dmsimardnon-truncated version https://gist.githubusercontent.com/dmsimard/af850e3405146056c1a767d0485f31f4/raw/d75ab0f11871376759b6ef06a559d03cbd2f7d17/kolla.txt14:26
dmsimardmgoddard: this one https://api.demo.recordsansible.org/playbooks/1376.html14:26
openstackgerritMichal Arbet proposed openstack/kolla master: Add fluent-logger to images - source, binary-debian  https://review.opendev.org/75985514:46
*** vishalmanchanda has quit IRC14:46
*** wuchunya_ has joined #openstack-kolla14:46
*** e0ne_ has joined #openstack-kolla14:47
*** e0ne has quit IRC14:48
*** xinliang has joined #openstack-kolla14:53
*** wuchunya_ has quit IRC14:56
*** abdysn has quit IRC14:58
dmsimardmgoddard: aggregating by path is kinda neat too: http://paste.openstack.org/raw/799606/15:14
mgoddarddmsimard: +!15:15
mgoddard115:15
mgoddarddmsimard: can you output to CSV?15:16
dmsimardmgoddard: ofc, it uses cliff underneath (same thing as openstackclient)15:16
mgoddardack15:16
dmsimardin csv: http://paste.openstack.org/raw/799608/15:17
*** skramaja has quit IRC15:19
mgoddarddmsimard: if you're looking for more bells and whistles to add, you could track the number of ok/changed/skipped/failed hosts and/or items15:27
dmsimardmgoddard: so there is already 'ara host list' but in fact I already have a WIP for 'ara host metrics': http://paste.openstack.org/raw/799610/15:30
*** nikparasyr has left #openstack-kolla15:40
*** xinliang has quit IRC15:46
*** LinPeiWen has quit IRC16:00
*** ivan_lin has quit IRC16:00
*** cah_link has quit IRC16:00
*** ivan_lin has joined #openstack-kolla16:00
*** cah_link has joined #openstack-kolla16:03
*** kwazar has quit IRC16:08
*** dking has joined #openstack-kolla16:09
*** k_mouza has quit IRC16:12
*** cah_link has quit IRC16:26
*** dosaboy has quit IRC16:29
*** k_mouza has joined #openstack-kolla16:33
*** cah_link has joined #openstack-kolla16:34
openstackgerritMichal Nasiadka proposed openstack/kayobe master: Add support for ML2 flat network configuration  https://review.opendev.org/76095516:37
*** cah_link has quit IRC16:51
ozzzoI finished building the POC but when I try to build a VM it fails with "could not find capabilities for domaintype=kvm"17:00
ozzzowhen I list hypervisors, it shows up as type QEMU17:00
ozzzodid I miss a setting?17:01
*** rpittau is now known as rpittau|afk17:08
*** dking has quit IRC17:12
*** dking has joined #openstack-kolla17:25
*** dougsz has quit IRC17:33
*** bengates has quit IRC17:34
*** dardelean has quit IRC17:45
*** k_mouza has quit IRC17:57
*** e0ne has joined #openstack-kolla18:08
*** e0ne_ has quit IRC18:11
*** k_mouza has joined #openstack-kolla18:16
*** k_mouza has quit IRC18:18
*** jonaspaulo has joined #openstack-kolla18:41
*** k_mouza has joined #openstack-kolla18:53
*** k_mouza has quit IRC18:57
*** k_mouza has joined #openstack-kolla19:19
*** k_mouza has quit IRC19:24
ozzzoit looks like I'm missing kvm support. If I change virt_type to qemu in nova.conf then I can build a VM, but I think I need them to be kvm20:08
ozzzoI tried installing qemu-kvm but that didn't seem to make a difference.20:08
r3ap3rozzzo: the `virt_type` should be defined in the `globals.yml`. Is there a reason you are defining it in a `nova.conf`?20:29
r3ap3rozzzo: also, is the all-in-one a VM or a physical host?20:29
ozzzodoesn't globals.yml only determine what goes into nova.conf when you build the system?20:30
ozzzoit's a VM20:30
ozzzoI didn't rebuild everything with qemu, I just changed it in nova.conf and restarted the nova containers as a test20:30
r3ap3rOk, so since it is a VM, you have to use `qemu` to essentially run "nested" virtual machines.20:30
r3ap3rWhen using libvirt, `qemu` is for using virtualized compute and `kvm` is used for physical compute.20:31
r3ap3rozzzo: in your `globals.yml` for train, look for the option `nova_compute_virt_type`, this needs to be set to `qemu` for using a VM all-in-one setup. After that is set, you do not have to define it in your `nova.conf` as this is for "extras" that would be configured in addition to what is in your `globals.yml`. I hope this helps?20:35
ozzzooic, so I can change it in globals.yml and restart the nova containers, and they will pick it up?20:36
r3ap3rozzzo: You would have to do a `kolla-ansible -i all-in-one reconfigure` for the `nova-*` containers to pick up the new configuration but yes, that is pretty much it as far as that particular configuration is concerned.20:37
ozzzoWhen I googled around people were talking about nested kvm20:38
ozzzodoes that not work on train?20:39
ozzzohttps://askubuntu.com/questions/607212/launch-instance-in-openstack-always-results-in-error-no-valid-host-was-found?rq=120:39
ozzzothe linked article is talking about devstack but I was hoping to do that on kolla20:40
ozzzobut, virsh doesn't see my vms20:40
r3ap3rozzzo: nested "kvm" requires a physical host but setting the `nova_compute_virt_type` to `qemu` is essentially setting up nested virtualization or are you trying to setup nested virtualization within your VM in which Openstack Train is being installed?20:41
*** dosaboy has joined #openstack-kolla20:42
ozzzomaybe I misunderstood the article; I thought he was saying that he setup Openstack in a virtual environment, which is what I'm doing20:42
r3ap3rozzzo: oh, yeah, after reading the article above that you linked, setting the `nova_compute_virt_type` to `qemu` and letting Kolla-Ansible do the rest achieves what they are doing in the article.20:43
ozzzoit's not possible to do nested kvm?20:45
r3ap3rozzzo: ^ that will allow you to spin up virtual machines inside the virtual machine that is hosting your Openstack all-in-one.20:45
ozzzowith kolla-ansible?20:45
r3ap3rYes, with Kolla-Ansible.20:45
ozzzoI can make it work with qemu, but I was hoping to use kvm20:46
ozzzoI don't remember the details but ISTR trouble with qemu in the past20:47
r3ap3rozzzo: with qemu, you more or less get the same capabilities and features as kvm. If you are strictly testing, qemu should work fine. When you go production with it, instead of defining `qemu`, just leave it `kvm` and you should more or less get the same results. See https://docs.openstack.org/kolla-ansible/train/reference/compute/libvirt-guide.html for additional details. :-)20:48
*** farda has joined #openstack-kolla20:48
ozzzook I'll try it, ty for your advice20:48
r3ap3rNp. 😉20:49
*** farda has quit IRC20:59
*** farda has joined #openstack-kolla21:00
*** farda has quit IRC21:07
*** TrevorV has quit IRC21:29
*** gfidente has quit IRC21:32
*** e0ne has quit IRC21:42
*** jonaspaulo has quit IRC22:01
*** e0ne has joined #openstack-kolla22:09
*** e0ne has quit IRC22:25
*** dave-mccowan has quit IRC22:52
*** k_mouza has joined #openstack-kolla23:20
*** k_mouza has quit IRC23:24
*** k_mouza has joined #openstack-kolla23:31
*** k_mouza has quit IRC23:36
« Sunday, 2020-11-01 Index Tuesday, 2020-11-03 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!