| *** rphillips has quit IRC | 00:39 | |
| *** rphillips has joined #openstack-kolla | 00:39 | |
| *** zhanglong has joined #openstack-kolla | 01:12 | |
| *** cah_link1 has joined #openstack-kolla | 01:32 | |
| *** xinliang has joined #openstack-kolla | 01:32 | |
| *** cah_link has quit IRC | 01:33 | |
| *** cah_link1 is now known as cah_link | 01:33 | |
| *** dking_desktop has joined #openstack-kolla | 01:38 | |
| *** xinliang has quit IRC | 01:42 | |
| *** pbing19 has quit IRC | 02:14 | |
| *** ricolin_ has joined #openstack-kolla | 03:46 | |
| *** ricolin_ has quit IRC | 04:17 | |
| *** hongbin has quit IRC | 04:20 | |
| *** kao112111 has quit IRC | 04:21 | |
| *** ykarel|away is now known as ykarel | 04:32 | |
| *** vishalmanchanda has joined #openstack-kolla | 04:58 | |
| *** dking_desktop has quit IRC | 05:26 | |
| *** evrardjp has quit IRC | 05:36 | |
| *** evrardjp has joined #openstack-kolla | 05:36 | |
| *** cah_link1 has joined #openstack-kolla | 05:59 | |
| *** cah_link has quit IRC | 06:00 | |
| *** cah_link1 is now known as cah_link | 06:00 | |
| *** e0ne has joined #openstack-kolla | 06:29 | |
| *** e0ne has quit IRC | 06:34 | |
| *** cah_link has quit IRC | 06:34 | |
| *** abdysn has joined #openstack-kolla | 06:45 | |
| *** e0ne has joined #openstack-kolla | 07:03 | |
| *** e0ne has quit IRC | 07:07 | |
| *** k_mouza has joined #openstack-kolla | 07:12 | |
| *** k_mouza has quit IRC | 07:16 | |
| *** e0ne has joined #openstack-kolla | 07:18 | |
| *** e0ne has quit IRC | 07:23 | |
| *** pbing19 has joined #openstack-kolla | 07:32 | |
| openstackgerrit | Rajat Dhasmana proposed openstack/kolla master: Add nfs dependencies to glance container https://review.opendev.org/714391 | 07:37 |
|---|---|---|
| *** dougsz has joined #openstack-kolla | 07:56 | |
| *** e0ne has joined #openstack-kolla | 07:57 | |
| *** dougsz has quit IRC | 08:00 | |
| *** bengates has joined #openstack-kolla | 08:04 | |
| hrw | mnorning | 08:06 |
| hrw | 746M /opt/stack | 08:06 |
| hrw | deployed with dev_mode | 08:06 |
| *** jbadiapa has joined #openstack-kolla | 08:08 | |
| *** pbing19 has quit IRC | 08:09 | |
| *** bengates has quit IRC | 08:13 | |
| *** bengates has joined #openstack-kolla | 08:14 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: nova: support dev_mode for API bootstrap https://review.opendev.org/714393 | 08:16 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: nova-cell: for dev_mode it is 'nova' https://review.opendev.org/714394 | 08:17 |
| *** pbing19 has joined #openstack-kolla | 08:17 | |
| *** cah_link has joined #openstack-kolla | 08:19 | |
| *** dougsz has joined #openstack-kolla | 08:20 | |
| cosmicsound | TASK [kibana : Wait for kibana port] this one is a killer | 08:23 |
| *** ykarel is now known as ykarel|lunch | 08:31 | |
| *** pbing19 has quit IRC | 08:37 | |
| *** arxcruz|off is now known as arxcruz|rover | 08:37 | |
| *** ktibi has joined #openstack-kolla | 08:48 | |
| *** reph has joined #openstack-kolla | 08:50 | |
| *** rpittau|afk is now known as rpittau | 08:52 | |
| mnasiadka | morning | 08:54 |
| yoctozepto | hrw: good catches there! | 08:55 |
| *** reph has quit IRC | 08:56 | |
| yoctozepto | morning hrw and mnasiadka (and possibly others) | 08:56 |
| yoctozepto | mnasiadka: I fixed ovn change, now needs some thorough reviewing | 08:56 |
| mnasiadka | yoctozepto: saw something over the weekend, thanks | 08:57 |
| yoctozepto | mnasiadka: I also created a lottery-mode change in https://review.opendev.org/714123 | 08:57 |
| patchbot | patch 714123 - kolla-ansible - WIP/DNM: geneve testing - 8 patch sets | 08:57 |
| *** jonaspaulo has joined #openstack-kolla | 08:57 | |
| yoctozepto | you can spin the wheel and randomly succeed or fail | 08:57 |
| yoctozepto | good for testing your lotto luck | 08:57 |
| yoctozepto | no relevant errors, no relevant warnings, no nothing | 08:58 |
| yoctozepto | sometimes getting connectivity, sometimes not :D | 08:58 |
| mnasiadka | yoctozepto: net_mlx5: cannot load glue library: libibverbs.so.1: cannot open shared object file: No such file or directory | 08:58 |
| mnasiadka | yoctozepto: this is interesting I would say | 08:58 |
| yoctozepto | mnasiadka: who cares about infiniband here | 08:59 |
| yoctozepto | mnasiadka: ubu/deb do not have it, it's c8 thingy | 08:59 |
| yoctozepto | mnasiadka: happens on any run | 08:59 |
| mnasiadka | yoctozepto: I would be worries if it wouldn't happen on any run :D | 08:59 |
| mnasiadka | *worried | 09:00 |
| mnasiadka | yoctozepto: the success factor of this job - is it influenced by the nodepool provider we use? | 09:02 |
| mnasiadka | yoctozepto: in other words - is ovh worse than others, as usually? :D | 09:03 |
| yoctozepto | mnasiadka: you mean whether it's openly very hostile or not? | 09:03 |
| hrw | yoctozepto: would be nice to check is kolla_dev_mode directory usable in precheck but that overkill | 09:03 |
| yoctozepto | ack, lemme check | 09:03 |
| yoctozepto | hrw: we could run some job with dev mode, at least periodically | 09:03 |
| yoctozepto | it went lame ;p | 09:03 |
| hrw | yoctozepto: it works | 09:07 |
| hrw | no need to create more and more weird ci checks | 09:07 |
| hrw | do not be like nova where I send patch at 15:59 yesterday and still get some 3rdparty CI reports | 09:08 |
| hrw | yoctozepto: those dev_mode patches are more a signal than solution | 09:09 |
| hrw | both need to be cleaned etc | 09:09 |
| yoctozepto | hrw: sure, no problem, and agreed it definitely should not be running on each change in 3 flavors... | 09:10 |
| yoctozepto | I would add a periodic though on one of them | 09:11 |
| yoctozepto | to have at least any insight into how well it behaves still ;p | 09:11 |
| *** zhanglong has quit IRC | 09:11 | |
| yoctozepto | mnasiadka: checked, no correlation present | 09:11 |
| yoctozepto | mnasiadka: rack/ovh both with successes and failures | 09:11 |
| hrw | multitail++ | 09:11 |
| mnasiadka | then it's very interesting | 09:11 |
| yoctozepto | mnasiadka: agreed | 09:12 |
| *** whoami-rajat has joined #openstack-kolla | 09:12 | |
| hrw | yoctozepto: Deprecated: Option "api_servers" from group "glance" is deprecated for removal - nova change to do | 09:13 |
| *** ykarel|lunch is now known as ykarel | 09:14 | |
| *** pbing19 has joined #openstack-kolla | 09:17 | |
| yoctozepto | hrw: yeah, mnasiadka was on deprec hunt I believe | 09:17 |
| hrw | cpu_mode = none is fun | 09:19 |
| hrw | I have 4 instances running | 09:19 |
| hrw | all logless | 09:19 |
| hrw | and consoleless | 09:19 |
| *** numans has joined #openstack-kolla | 09:22 | |
| *** reph has joined #openstack-kolla | 09:27 | |
| yoctozepto | hrw: odd, this should be the 'easiest' for qemu | 09:28 |
| hrw | https://paste.centos.org/view/69e435fb | 09:28 |
| hrw | simple qemu call ;D | 09:29 |
| *** diga has joined #openstack-kolla | 09:32 | |
| hrw | WARNING nova.virt.libvirt.driver [-] Running Nova with a QEMU version less than 4.0.0 is deprecated. The required minimum version of QEMU will be raised to 4.0.0 in the next release. | 09:37 |
| hrw | hm. | 09:37 |
| *** e0ne has quit IRC | 09:39 | |
| *** e0ne_ has joined #openstack-kolla | 09:39 | |
| mnasiadka | yoctozepto: yeah, I'll come back to that this week it seems | 09:46 |
| mnasiadka | as long as my daughter will not want to play with me on ps4 whole day long | 09:46 |
| yoctozepto | mnasiadka: playing on switch is fine? :D | 09:47 |
| mnasiadka | yoctozepto: I have only ps4, fully occupied by a nearly-7-year-old... | 09:47 |
| yoctozepto | mnasiadka: you're just jealous! | 09:48 |
| mnasiadka | yoctozepto: of course I am, better to play than to deploy bloody ceph :) | 09:52 |
| yoctozepto | mnasiadka: nah, ceph always whispers: let's play a game :D | 09:53 |
| *** ktibi_ has joined #openstack-kolla | 09:57 | |
| mgoddard | morning all | 09:58 |
| *** ktibi has quit IRC | 10:00 | |
| *** k_mouza has joined #openstack-kolla | 10:00 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: CentOS 8: Build bifrost image https://review.opendev.org/713509 | 10:10 |
| openstackgerrit | Merged openstack/kolla master: Zun: add zun-cni-daemon image https://review.opendev.org/708273 | 10:16 |
| *** dougsz has quit IRC | 10:19 | |
| *** reph has quit IRC | 10:20 | |
| *** dougsz has joined #openstack-kolla | 10:32 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CentOS 8: Enable overcloud upgrade job https://review.opendev.org/712723 | 10:33 |
| *** reph has joined #openstack-kolla | 10:34 | |
| *** reph has quit IRC | 10:50 | |
| *** cah_link has quit IRC | 10:54 | |
| cosmicsound | greets mgoddard | 10:56 |
| mgoddard | hey cosmicsound | 10:57 |
| cosmicsound | hows going | 10:58 |
| *** cah_link has joined #openstack-kolla | 11:02 | |
| mgoddard | good thanks. The sun is shining, always helps | 11:03 |
| mgoddard | You? | 11:03 |
| cosmicsound | same here just had a walk in sun. now moving on with kolla testing | 11:05 |
| hrw | nova patch rewritten. | 11:20 |
| *** ricolin_ has joined #openstack-kolla | 11:23 | |
| *** kplant has joined #openstack-kolla | 11:26 | |
| *** kplant has quit IRC | 11:26 | |
| *** sylar has joined #openstack-kolla | 11:28 | |
| *** sylar is now known as kplant | 11:28 | |
| *** cah_link has quit IRC | 11:28 | |
| *** e0ne_ has quit IRC | 11:32 | |
| *** e0ne has joined #openstack-kolla | 11:39 | |
| *** skramaja has joined #openstack-kolla | 11:40 | |
| openstackgerrit | Merged openstack/kolla-ansible master: cirros: upgrade to 0.5.1 https://review.opendev.org/711182 | 11:41 |
| hrw | juhu! | 11:42 |
| *** evrardjp has quit IRC | 11:44 | |
| *** e0ne has quit IRC | 11:45 | |
| *** rpittau is now known as rpittau|bbl | 11:47 | |
| *** evrardjp has joined #openstack-kolla | 11:50 | |
| *** skramaja has quit IRC | 11:54 | |
| *** skramaja has joined #openstack-kolla | 11:54 | |
| hrw | hm. I start to wonder how I did my work on 16GB of ram... 12/32 in constant use | 12:10 |
| openstackgerrit | Merged openstack/kolla stable/train: CI: Install tox https://review.opendev.org/713616 | 12:10 |
| openstackgerrit | Merged openstack/kolla-ansible stable/stein: CI: install tox https://review.opendev.org/713619 | 12:10 |
| openstackgerrit | Merged openstack/kolla-ansible stable/rocky: CI: install tox https://review.opendev.org/713621 | 12:10 |
| *** jimcrowleyibm has joined #openstack-kolla | 12:14 | |
| *** evrardjp has quit IRC | 12:27 | |
| *** e0ne has joined #openstack-kolla | 12:28 | |
| *** Fl1nt has joined #openstack-kolla | 12:34 | |
| Fl1nt | Good afternoon everyone! | 12:34 |
| *** cah_link has joined #openstack-kolla | 12:35 | |
| *** evrardjp has joined #openstack-kolla | 12:38 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: CentOS 8: Drop trickle install to build freezer https://review.opendev.org/711637 | 12:44 |
| *** Abdallahyas has joined #openstack-kolla | 12:44 | |
| kplant | any of you guys do ipv6 tenant networks in your clouds? | 12:47 |
| *** abdysn has quit IRC | 12:47 | |
| osmanlicilegi | kplant: I used it for few weeks without any problem. the reason why I switched back to ipv4 is it's not possible to use dvr with ipv6. | 12:52 |
| kplant | did you have to peer neutron with your upstream router? | 12:52 |
| *** pbing19 has quit IRC | 12:55 | |
| *** Luzi has joined #openstack-kolla | 12:55 | |
| *** chrizl has joined #openstack-kolla | 12:55 | |
| *** Luzi_ has joined #openstack-kolla | 13:00 | |
| osmanlicilegi | kplant: In theory no, in practice yes :) If I understood correctly about your concern, I used ipv6-address-mode=slaac not to have conflicting issues with router. | 13:01 |
| kplant | what's what i was thinking of doing as a stop-gap | 13:01 |
| *** Luzi has quit IRC | 13:01 | |
| kplant | but i think that'll require two NICs since the vlan for ipv6 will be different from the per-project vxlans for ipv4 | 13:02 |
| osmanlicilegi | I think so | 13:06 |
| kplant | okay, just making sure i wasn't over complicating this | 13:07 |
| kplant | i think the best solution is to do bgp between neutron and the upstream router | 13:07 |
| kplant | and then cut /64s for each project network | 13:07 |
| kplant | too bad we can't do dhcpv6-pd :-( | 13:07 |
| *** rpittau|bbl is now known as rpittau | 13:08 | |
| osmanlicilegi | good point. imho, bgp is a must for a problem free ipv6 network. | 13:08 |
| kplant | i think cloudnull and i were talking maybe a year ago about using bgp to eliminate the need for wasting IPs with neutron routers | 13:09 |
| kplant | and just routing through 1918 space | 13:09 |
| kplant | so it might be helpful there too | 13:10 |
| kplant | wasting IPv4 addresses* | 13:10 |
| *** ykarel is now known as ykarel|away | 13:10 | |
| cloudnull | that was a long while back :D | 13:10 |
| kplant | yeah, at least a year i think | 13:12 |
| *** sorin-mihai__ is now known as sorin-mihai | 13:12 | |
| *** zhanglong has joined #openstack-kolla | 13:17 | |
| *** gfidente has joined #openstack-kolla | 13:32 | |
| *** reph has joined #openstack-kolla | 13:36 | |
| *** TrevorV has joined #openstack-kolla | 13:38 | |
| *** gfidente is now known as gfidente|pto | 13:39 | |
| *** reph has quit IRC | 13:41 | |
| *** Luzi_ has quit IRC | 13:44 | |
| Fl1nt | guys, let say I've got an interface named eno1.101 and that I set this interface as my neutron_external_interface, it will be linked to the br-ex, but are we OK that that interface shouldn't have an IP right? | 13:45 |
| Fl1nt | I want to use that NIC which is a vlan one, in order to create a flat network within my deployment. | 13:45 |
| kplant | that interface should _not_ have an IP | 13:45 |
| kplant | if it does, it will become unreachable | 13:45 |
| Fl1nt | ok, right, we're on sync so. thanks a lot! | 13:46 |
| Fl1nt | ok, let me test something with the rocky k-a release so. | 13:46 |
| *** sorin-mihai has quit IRC | 13:53 | |
| *** reph has joined #openstack-kolla | 13:54 | |
| mgoddard | yoctozepto, hrw, mnasiadka: I'm going to propose some final rocky releases | 14:07 |
| hrw | go for it | 14:08 |
| *** noxoid has joined #openstack-kolla | 14:08 | |
| kplant | hmmm does enable_neutron_provider_networks allow non-admins to attach instances to provider nets? | 14:13 |
| Fl1nt | @mgoddard, can you add swift multi-policies/multi-region from Alexis request? https://bugs.launchpad.net/kolla-ansible/train/+bug/1844752 | 14:13 |
| openstack | Launchpad bug 1844752 in kolla-ansible train "Swift role does not deploy multi-policies ring files" [Medium,Fix released] - Assigned to Alexis Deberg (adeberg) | 14:13 |
| mgoddard | kplant: that's right | 14:14 |
| kplant | crap | 14:14 |
| kplant | thanks | 14:14 |
| mgoddard | :) | 14:14 |
| mgoddard | Fl1nt: I'm not a swift expert. Commit message suggests at least multi-policy | 14:16 |
| mgoddard | Fl1nt: in general, kolla supports multiple regions: https://docs.openstack.org/kolla-ansible/latest/user/multi-regions.html | 14:17 |
| mgoddard | I don't know if we're missing something for Swift | 14:17 |
| Fl1nt | yep, but I worked with Alexis, (actually created the cloud platform from which this request come from) and it's implicit to the ring thing. | 14:17 |
| Fl1nt | nope, that little fix is doing everything | 14:17 |
| Fl1nt | as zone/region are embedded within ring files. | 14:18 |
| Fl1nt | at creation. | 14:18 |
| Fl1nt | so just that fix would be enough ^^ | 14:18 |
| *** hongbin has joined #openstack-kolla | 14:19 | |
| mgoddard | that's good | 14:20 |
| Fl1nt | thanks a lot!! | 14:20 |
| mgoddard | so for my understanding, would you include the ring files for all regions? | 14:20 |
| Fl1nt | yes, you need to include all ring files to | 14:20 |
| Fl1nt | so let say you have region 1 2 3 you'll have obj_[1:3] / container_[1:3] etc | 14:21 |
| Fl1nt | actually not, nevermind, I mixed things a bit. Swift rings aren't that easy to keep in mind ^^ | 14:23 |
| Fl1nt | so | 14:23 |
| Fl1nt | if you have multiple policies | 14:23 |
| Fl1nt | P1 P2 P3 | 14:23 |
| Fl1nt | you'll have obj_P1 obj_P2 etc ring files | 14:23 |
| *** Trevor_V has joined #openstack-kolla | 14:23 | |
| mgoddard | hmm. Maybe a cleaner solution would have been to configure the entire list rather than always having container.ring.gz etc | 14:24 |
| Fl1nt | within these policies ring file, you'll declare at build time with region and zone they handle ^^ | 14:24 |
| Fl1nt | actually you need the default container.ring.gz as they're used and define your default policu | 14:24 |
| openstackgerrit | Merged openstack/kayobe master: CentOS 8: Enable overcloud upgrade job https://review.opendev.org/712723 | 14:24 |
| Fl1nt | policy sorru | 14:25 |
| Fl1nt | sorry | 14:25 |
| Fl1nt | -_- | 14:25 |
| Fl1nt | a completely clean solution would be to generate all rings and config from the disk creation (as you do it with kayobe If I'm not wrong). | 14:26 |
| mgoddard | thanks for the explanation :) | 14:27 |
| *** TrevorV has quit IRC | 14:27 | |
| Fl1nt | you're welcome, honestly, swift ring management and building is a mess, I tend to use CEPH as backend as much as possible but some customers being... back in 90's and a little bit resistant... I sometimes need to deal with that ^^ | 14:28 |
| openstackgerrit | Merged openstack/kolla stable/train: CentOS 8: Enable hacluster and masakari images https://review.opendev.org/714055 | 14:31 |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: CI: CentOS 8: Enable Masakari job and periodics https://review.opendev.org/714059 | 14:31 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe master: CI: Add overcloud host configure job https://review.opendev.org/710277 | 14:33 |
| *** TrevorV has joined #openstack-kolla | 14:34 | |
| yoctozepto | mgoddard: care to wait for mariadb fix? | 14:35 |
| yoctozepto | mgoddard: I *think* I could deliver today | 14:36 |
| mgoddard | yoctozepto: I think we should merge it after final release | 14:36 |
| yoctozepto | mgoddard: ok | 14:37 |
| *** Trevor_V has quit IRC | 14:37 | |
| mgoddard | we can always direct people to stable/rocky | 14:37 |
| yoctozepto | mgoddard: yeah, right, I could break it | 14:37 |
| yoctozepto | in some weird way | 14:37 |
| mgoddard | it happens | 14:37 |
| mgoddard | and it's quite a critical part | 14:37 |
| yoctozepto | the codebase has drifted a considerable "bit" | 14:37 |
| yoctozepto | yeah, agreed | 14:37 |
| mgoddard | as have mariadb versions | 14:37 |
| *** Abdallahyas has quit IRC | 14:45 | |
| *** ricolin_ has quit IRC | 15:01 | |
| *** ricolin_ has joined #openstack-kolla | 15:01 | |
| openstackgerrit | Rajat Dhasmana proposed openstack/kolla master: Add nfs dependencies to glance container https://review.opendev.org/714391 | 15:06 |
| *** riuzen has joined #openstack-kolla | 15:06 | |
| *** evrardjp has quit IRC | 15:07 | |
| riuzen | Got this error when execute command kolla-genpasswd. https://paste.ubuntu.com/p/KCNY5nRzR7/ whats wrong? | 15:08 |
| *** evrardjp has joined #openstack-kolla | 15:11 | |
| hrw | ok, time to redeploy | 15:23 |
| *** zhanglong has quit IRC | 15:30 | |
| yoctozepto | hrw, mgoddard: https://review.opendev.org/714475 | 15:30 |
| patchbot | patch 714475 - project-config - Cache CirrOS 0.5.1 - 1 patch set | 15:30 |
| mgoddard | yoctozepto: nice job | 15:32 |
| mgoddard | one patch closer to infra-core | 15:32 |
| yoctozepto | mgoddard: haha, thanks ;p | 15:32 |
| hrw | commented | 15:33 |
| yoctozepto | hrw: will we be doing aarch64 solely on 0.5.1? | 15:37 |
| hrw | yoctozepto: there is only one ver of cirros in k-a | 15:39 |
| hrw | on all 3 archs | 15:39 |
| hrw | I just not mentioned ppc64le one as we lack CI for it | 15:39 |
| yoctozepto | hrw: asked if we want to cache 0.4.0 for it, but I guess not, we can move kolla CI to any version and devstack probably does not care below Ussuri | 15:41 |
| yoctozepto | hrw: so 0.5.1 only it is | 15:41 |
| hrw | yep | 15:41 |
| hrw | if someone uses 0.4.0 on aarch64 then should stop | 15:41 |
| *** KeithMnemonic has joined #openstack-kolla | 15:42 | |
| yoctozepto | ++ | 15:42 |
| *** dking_desktop has joined #openstack-kolla | 15:46 | |
| Fl1nt | ok, so, I've redeployed my neutron_external_interface without IP, from within the router I can ping the switch ip (GW) but I can't ping or ssh the instance, and yes, that instance got ICMP and SSH opened up to everyone just in case ^^ | 15:48 |
| Fl1nt | weird thing is, my router qg interface got a 10.1.1.18/24 IP then the FIP is attached as a 10.1.1.123/32 is that normal? | 15:49 |
| yoctozepto | hrw: https://review.opendev.org/#/c/714481/1 | 15:50 |
| patchbot | patch 714481 - project-config - Cache CirrOS 0.5.1 for AArch64 too - 1 patch set | 15:50 |
| hrw | +1 | 15:50 |
| Fl1nt | when I created my "FIP" network, I created it from the admin use admin panel>network | 15:51 |
| Fl1nt | then | 15:51 |
| Fl1nt | new network | 15:51 |
| Fl1nt | network name <dummy> | 15:51 |
| Fl1nt | external network | 15:51 |
| yoctozepto | Fl1nt: yeah, they are /32 | 15:51 |
| Fl1nt | flat from physnet1 | 15:51 |
| Fl1nt | attributed to admin tenant | 15:52 |
| yoctozepto | is 10.1.1.18 pingable? | 15:52 |
| *** skramaja has quit IRC | 15:52 | |
| Fl1nt | yes | 15:52 |
| Fl1nt | from within the router | 15:52 |
| Fl1nt | isn't the router suppose to handle some iptables rules? | 15:57 |
| *** klindgren_ has joined #openstack-kolla | 16:03 | |
| *** klindgren has quit IRC | 16:03 | |
| hrw | deployment ends | 16:04 |
| Fl1nt | Is the br-int supposed to carry all my router interfaces? my qr and qg ports/interfaces are handled by the br-int which in turn is connected to the br-ex using the patch int-br-ex. | 16:05 |
| Fl1nt | Is that correct? | 16:05 |
| Fl1nt | I always thought my router should be connected to both br-ex (through qg interface) and to the br-int (through qr interface) the then itself connect to br-tun through peer between patch-tun <-> patch-int | 16:07 |
| *** e0ne has quit IRC | 16:08 | |
| *** e0ne has joined #openstack-kolla | 16:08 | |
| *** pbing19 has joined #openstack-kolla | 16:12 | |
| hrw | meh, spawning instance takes ages... | 16:22 |
| *** klindgren has joined #openstack-kolla | 16:24 | |
| *** klindgren_ has quit IRC | 16:25 | |
| yoctozepto | Fl1nt: br-int is where most magic happens | 16:37 |
| hrw | GIWO$TGHWOT | 16:39 |
| hrw | one day I will store working globals.yml in safe | 16:39 |
| hrw | 40 minutes for deploy, 3.5 minutes for 'sorry, failed to spawn' | 16:41 |
| *** reph has quit IRC | 16:42 | |
| kplant | (-: | 16:42 |
| *** pbing19 has quit IRC | 16:43 | |
| *** iniazi has quit IRC | 16:46 | |
| yoctozepto | ;D | 16:46 |
| *** iniazi has joined #openstack-kolla | 16:46 | |
| Fl1nt | ok, let's try something easier, I'll create a private network, that network is using vxlan underneath. then let's try to ping that machine from another node in that vxlan. | 16:47 |
| *** cah_link1 has joined #openstack-kolla | 16:50 | |
| *** cah_link has quit IRC | 16:51 | |
| *** cah_link1 is now known as cah_link | 16:51 | |
| *** pbing19 has joined #openstack-kolla | 16:55 | |
| *** rpittau is now known as rpittau|afk | 17:08 | |
| *** diga has quit IRC | 17:10 | |
| *** bengates has quit IRC | 17:11 | |
| Fl1nt | hum... how do you test your private vxlan are working ? | 17:15 |
| kplant | define are working :-) | 17:18 |
| kplant | if you mean can pass traffic to L2 adjacent things, just add another instance to vxland | 17:18 |
| kplant | vxlan* | 17:18 |
| *** cah_link1 has joined #openstack-kolla | 17:19 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Fix kolla-ansible stop with heterogeneous hosts https://review.opendev.org/714496 | 17:21 |
| *** cah_link has quit IRC | 17:22 | |
| *** cah_link1 is now known as cah_link | 17:22 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Fix kolla-ansible stop with heterogeneous hosts https://review.opendev.org/714496 | 17:22 |
| hrw | multinode without ceph should still work, right? | 17:23 |
| kplant | i think it just uses lvm | 17:23 |
| kplant | but it's been a while since i've tested that | 17:24 |
| mgoddard | hrw: some caveats - glance filestore needs NFS or to only run on one host | 17:24 |
| mgoddard | although we set up single host by default | 17:24 |
| Fl1nt | For now, I've a bunch of VM using 192.168.0.0/24 addresses, but my underlying neutron_tunnel_interface is eno1.32 with network 10.32.0.0/24. | 17:25 |
| Fl1nt | So I'm looking for a way to jump onto my VMs from the hypervisor | 17:25 |
| Fl1nt | in order to test that my tunnels are working fine | 17:26 |
| hrw | managed to run tempest against k-a deployment and now wonder about adding second compute | 17:26 |
| hrw | even without shared storage | 17:26 |
| hrw | Ran: 875 tests in 629.7935 sec. | 17:26 |
| hrw | - Passed: 561 | 17:26 |
| hrw | - Skipped: 158 | 17:26 |
| hrw | - Expected Fail: 0 | 17:26 |
| hrw | - Unexpected Success: 0 | 17:26 |
| hrw | - Failed: 156 | 17:26 |
| *** reph has joined #openstack-kolla | 17:26 | |
| hrw | Sum of execute time for each test: 6905.4520 sec. | 17:26 |
| hrw | 156 ;( | 17:26 |
| hrw | tempest log is usual openstack one. close to useless | 17:27 |
| Fl1nt | can I add a vnic from my hypervisor onto the linux bridge which the VMs tap are linked to ? | 17:29 |
| *** reph has quit IRC | 17:31 | |
| *** reph has joined #openstack-kolla | 17:32 | |
| *** evrardjp has quit IRC | 17:36 | |
| *** evrardjp has joined #openstack-kolla | 17:36 | |
| *** pbing19 has quit IRC | 17:37 | |
| *** pbing19 has joined #openstack-kolla | 17:37 | |
| *** e0ne has quit IRC | 17:38 | |
| *** ktibi_ has quit IRC | 17:40 | |
| *** pbing19 has quit IRC | 17:43 | |
| *** pbing19 has joined #openstack-kolla | 17:43 | |
| *** TrevorV has quit IRC | 17:45 | |
| kplant | https://docs.openstack.org/kolla-ansible/latest/reference/networking/provider-networks.html states "For provider networks compute hosts must have external bridge created and configured by Ansible tasks like it is already done for tenant DVR mode networking." | 17:47 |
| kplant | is that something k-a has? or do i need to do that on my own | 17:47 |
| mgoddard | kplant: it's the same requirement as on your network hosts - neutron_external_interface must exist | 17:48 |
| kplant | i figured as much, but for some reason i can't pass any traffic | 17:49 |
| kplant | i see the traffic egressing my interface with the vlan tag, and that's about it | 17:49 |
| Fl1nt | oh, so we end up within almost the same issue ^^ | 17:50 |
| Fl1nt | I'm fighting since this morning with my external_network part of the install too. | 17:51 |
| Fl1nt | except that I'm stuck with FIP not working. | 17:51 |
| * hrw off | 17:52 | |
| Fl1nt | I even reinstall without DVR and Provider network just to be sure it's not something conflicting xD | 17:52 |
| kplant | FIP is fine for me | 17:52 |
| kplant | but bridging a provider network directly to an instance, not so much | 17:53 |
| Fl1nt | so we have to opposite issue actually ^^ | 17:53 |
| Fl1nt | my provider network using this neutron_external_interface actually works fine ^^ | 17:53 |
| kplant | intardesting | 17:55 |
| *** riuzen has quit IRC | 17:56 | |
| Fl1nt | so, my network node get a nic.vlanID interface as neutron_external_interface my compute nodes get something similar, all those nodes are attached to a switch that have vlanID access port for each nic of them all. | 17:58 |
| Fl1nt | that switch is the gateway (10.1.1.254) for that external/provider network. | 17:59 |
| Fl1nt | when using it as a provider network (flat) it works | 18:00 |
| Fl1nt | when trying to use it as a FIP pool, it doesn't. | 18:00 |
| mgoddard | Fl1nt: if the switch port is access mode, you want untagged on the host right? | 18:00 |
| kplant | mgoddard: ugh, my port descriptions were wrong on my switch | 18:01 |
| kplant | you were absolutely right | 18:01 |
| Fl1nt | @mgoddard, sorry, they're trunked ports... my mistake, I'm looking at too many things today. | 18:03 |
| Fl1nt | so my nic is tagged on the host | 18:03 |
| Fl1nt | not on OS | 18:03 |
| mgoddard | k | 18:03 |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic to Keystone service https://review.opendev.org/713986 | 18:05 |
| Fl1nt | so mistery amplify, I can't ping my vm private IP from the router... definitely something bad in between. | 18:18 |
| *** e0ne has joined #openstack-kolla | 18:19 | |
| *** e0ne has quit IRC | 18:20 | |
| *** hongbin has quit IRC | 18:22 | |
| Fl1nt | guys, where do you install your DHCP agent on host or controller/network node when _NOT_ doing DVR or provider network but only private vxlan and FIP? | 18:23 |
| Fl1nt | I did used my controllers. | 18:27 |
| *** reph has quit IRC | 18:27 | |
| kplant | yeah, same | 18:29 |
| kplant | if you don't have dedicated neutron nodes | 18:29 |
| kplant | controller | 18:29 |
| Fl1nt | I'm asking dumb question since an hours but this issue is just making me feel like if all I learned about OS networking wasn't right ^^ | 18:31 |
| Fl1nt | @kplant, how are your IPTables within your router? | 18:32 |
| *** k_mouza has quit IRC | 18:32 | |
| kplant | what's your root problem? maybe i can help | 18:32 |
| *** e0ne has joined #openstack-kolla | 18:32 | |
| Fl1nt | I can't get my VMs to get a proper FIP, and those instances that get a private IP 192.168.0.0/24 can't be pingged from the router itself, but they correctly get IPs from DHCP namespace and DHCP namespace correctly send FIP address to the router that correctly put it on the vnic qrbalbal | 18:34 |
| Fl1nt | it's like my router is missing IPTables rules | 18:34 |
| kplant | can your vms talk to each other on the vxlan? | 18:34 |
| Fl1nt | that's the tricky part, I don't know how to try that | 18:37 |
| Fl1nt | can I just add a new vnic to the linux bridge where the instances TAP are linked and then snif it ? | 18:38 |
| kplant | just make two VMs on the same vxlan | 18:39 |
| kplant | and ping one from the other | 18:39 |
| kplant | and yes you can sniff with "ip netns <name> tcpdump -i blah blah" | 18:40 |
| Fl1nt | I can't access those VMs, they're on a private lan. | 18:40 |
| kplant | use the console | 18:40 |
| Fl1nt | the virsh one? or the vnc/spice one? | 18:40 |
| kplant | whichever works for you | 18:40 |
| Fl1nt | can't access spice/vnc, virsh console domID from within nova_libvirt just show the message about escape char ^^ | 18:41 |
| kplant | oof | 18:41 |
| *** k_mouza has joined #openstack-kolla | 18:41 | |
| Fl1nt | yeah ^^ | 18:41 |
| kplant | let's talk about your neutron interface | 18:41 |
| Fl1nt | yep | 18:42 |
| kplant | is it a real interface or sub interface | 18:42 |
| Fl1nt | it's a real interface on the host | 18:42 |
| Fl1nt | vlan interface | 18:42 |
| kplant | well | 18:42 |
| kplant | that's a sub-interface :-) | 18:42 |
| Fl1nt | that's a vnic yes | 18:42 |
| kplant | so you feed neutron a vlan interface which means you're already tagging | 18:42 |
| Fl1nt | yep | 18:43 |
| kplant | and mapping that to something like 'physnet1' ? | 18:43 |
| Fl1nt | exactly sir | 18:43 |
| kplant | and you're creating a flat provider network in openstack? | 18:43 |
| kplant | with physnet1 | 18:43 |
| Fl1nt | yes | 18:43 |
| kplant | did you test that vlan interface before your deploy? | 18:43 |
| Fl1nt | yes | 18:44 |
| Fl1nt | it work | 18:44 |
| kplant | when you created your router, can you see it in the arp table? | 18:44 |
| kplant | it should take some ip in the subnet you gave it | 18:44 |
| Fl1nt | yes | 18:44 |
| Fl1nt | and it's pingable and the GW switch too | 18:44 |
| kplant | sweet | 18:44 |
| kplant | and your security groups allow the types of traffic you want? | 18:45 |
| kplant | ie: ssh | 18:45 |
| Fl1nt | yep ICMP and SSH from anywhere | 18:45 |
| kplant | hmm | 18:46 |
| Fl1nt | when I tcpdump the qr/qg nic, I see the 10.1.1.x -> 192.168.0.x request, but that doesn't go anywhere | 18:46 |
| *** k_mouza has quit IRC | 18:46 | |
| Fl1nt | hence why I'm thinking about a missing flow or iptable rule | 18:47 |
| kplant | that's weird | 18:47 |
| kplant | so how do you _know_ your instance is getting an address via dhcp | 18:47 |
| Fl1nt | virsh on the compute node know about it on the dominfo and iface info | 18:48 |
| kplant | can you ping it from your ip net namespace? | 18:49 |
| kplant | 'ip netns <name> exec ping 192.168.0.x' | 18:49 |
| Fl1nt | nope | 18:49 |
| kplant | and this is just a vxlan? | 18:49 |
| Fl1nt | yes | 18:49 |
| kplant | linuxbr, ovs? | 18:49 |
| Fl1nt | ovs | 18:49 |
| kplant | did you build tunnel interfaces on your nodes and specify them in globals.yml? | 18:50 |
| Fl1nt | yes | 18:50 |
| kplant | hah | 18:50 |
| kplant | it's hard for me to really go on much else without direct access to it | 18:50 |
| Fl1nt | yeah, don't worry, I'll finish to figure that out at some point ^^ | 18:50 |
| kplant | virsh console doesn't work? | 18:51 |
| Fl1nt | nope | 18:51 |
| Fl1nt | well, it work as I get it | 18:51 |
| Fl1nt | but I can't input anything except for escape chars | 18:51 |
| Fl1nt | ok, you know what, I'll see that later on tomorrow morning :D that's enough headhashes for today ^^ | 18:52 |
| Fl1nt | thanks a loooooot for your help @kplant | 18:52 |
| kplant | hey, one more thing | 18:52 |
| Fl1nt | yes sure | 18:52 |
| kplant | make sure your instance is built with the correct options so serial console is working | 18:52 |
| kplant | or try something like centos7 generic cloud | 18:53 |
| kplant | just to be sure | 18:53 |
| Fl1nt | that's actually the image that I use ^^ | 18:53 |
| kplant | O_O | 18:53 |
| Fl1nt | don't get any journal neither on the instances once up and running... weird. | 18:54 |
| kplant | can you paste your globals.yml when you get a chance? | 18:55 |
| kplant | something soudns very unhappy | 18:55 |
| Fl1nt | yep, I'll have it on tomorrow, I've closed the VPN for now ^^ | 18:56 |
| Fl1nt | I'm more and more thinking about a nova issue actually | 18:56 |
| kplant | yeah honestly everything with neutron sounds pretty good | 18:56 |
| Fl1nt | what's weird is virsh thinking its VMs are up and running and I almost trust it as everything related to the VMs (nic/storage/etc) are their as expected. | 18:57 |
| Fl1nt | I'll try to make them launch a simple ISO to see if they boot up at least. | 18:57 |
| kplant | i would try to access the console immediately after the vm is started | 18:58 |
| kplant | see if you catch any output | 18:58 |
| Fl1nt | I'll do that too | 18:58 |
| Fl1nt | maybe at some point I'll try to redirect the TTYConsole to my own terminal. | 18:59 |
| *** hongbin has joined #openstack-kolla | 19:18 | |
| *** ricolin_ has quit IRC | 19:24 | |
| cosmicsound | what most users here have OVS or ODL ? | 19:34 |
| Fl1nt | @kplant, solved... I'm just stupid... | 19:44 |
| Fl1nt | it ended up that I used a stale centos-7-generic image... | 19:44 |
| Fl1nt | tested a cirros and it work like a charm. | 19:44 |
| kplant | :-) | 19:44 |
| Fl1nt | @cosmicsound, ovs | 19:44 |
| Fl1nt | so, all in all, I banged my head around my office all day long for a stupid non working image, I should have know that it didn't want from neutron at the begining of the day when I checked the router and that nothing strange happened and that my compute nodes where correctly receiving IPs from the DHCP namespace... | 19:46 |
| Fl1nt | what a wonderful day \o/ | 19:46 |
| *** vishalmanchanda has quit IRC | 19:46 | |
| *** reph has joined #openstack-kolla | 19:53 | |
| *** Fl1nt has quit IRC | 19:55 | |
| *** reph has quit IRC | 19:57 | |
| *** dougsz has quit IRC | 20:14 | |
| *** thatcher_ has joined #openstack-kolla | 20:30 | |
| *** e0ne has quit IRC | 20:31 | |
| *** thatcher_ has quit IRC | 20:34 | |
| *** thatcher_ has joined #openstack-kolla | 20:37 | |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend HAProxy traffic to Keystone service https://review.opendev.org/713986 | 21:32 |
| openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting backend Keystone HAProxy traffic https://review.opendev.org/713986 | 21:33 |
| *** cah_link1 has joined #openstack-kolla | 22:20 | |
| *** noxoid has quit IRC | 22:20 | |
| *** cah_link has quit IRC | 22:21 | |
| *** cah_link1 is now known as cah_link | 22:21 | |
| *** ktibi_ has joined #openstack-kolla | 22:39 | |
| *** ktibi_ has quit IRC | 22:44 | |
| *** cah_link1 has joined #openstack-kolla | 23:18 | |
| *** cah_link has quit IRC | 23:20 | |
| *** cah_link1 is now known as cah_link | 23:20 | |
| *** mrunge has quit IRC | 23:30 | |
| *** mrunge has joined #openstack-kolla | 23:31 | |
| *** pbing19 has quit IRC | 23:43 | |
| *** jonaspaulo has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!