Wednesday, 2019-04-03

« Tuesday, 2019-04-02 Index Thursday, 2019-04-04 »
*** wolverineav has joined #openstack-neutron00:00
*** iyamahat__ has joined #openstack-neutron00:04
*** liuyulong is now known as liuyulong|away00:05
*** wolverineav has quit IRC00:06
*** iyamahat_ has quit IRC00:07
*** armax has quit IRC00:24
*** iyamahat_ has joined #openstack-neutron00:26
*** wolverineav has joined #openstack-neutron00:28
*** iyamahat__ has quit IRC00:29
openstackgerritReedip proposed openstack/networking-ovn master: Modify Member operations and Pool status changes  https://review.openstack.org/63658900:52
*** wolverineav has quit IRC00:58
*** wolverineav has joined #openstack-neutron01:02
openstackgerritMerged openstack/neutron-lib master: rehome neutron.objects.common_types  https://review.openstack.org/64563701:04
*** wolverineav has quit IRC01:06
*** abaindur has joined #openstack-neutron01:06
*** abaindur has quit IRC01:09
*** abaindur has joined #openstack-neutron01:09
*** binh___ has joined #openstack-neutron01:10
*** manjeets has quit IRC01:12
*** nhbinh_ has quit IRC01:12
*** phasespace has quit IRC01:12
*** kklimonda has quit IRC01:12
*** spotz has quit IRC01:12
*** ijw has quit IRC01:12
*** kklimonda has joined #openstack-neutron01:12
*** ijw has joined #openstack-neutron01:16
*** wolverineav has joined #openstack-neutron01:18
*** mmethot has quit IRC01:19
*** ijw has quit IRC01:21
*** wolverineav has quit IRC01:22
*** igordc has quit IRC01:29
*** wolverineav has joined #openstack-neutron01:39
*** iyamahat_ has quit IRC01:40
*** iyamahat_ has joined #openstack-neutron01:40
*** hongbin has joined #openstack-neutron01:41
*** wolverineav has quit IRC01:43
*** cshen has joined #openstack-neutron01:44
*** cshen has quit IRC01:48
*** iyamahat_ has quit IRC01:57
*** yamahata has quit IRC01:57
*** whoami-rajat has joined #openstack-neutron01:57
*** mriedem has quit IRC02:07
*** binh___ has quit IRC02:08
*** binh___ has joined #openstack-neutron02:08
*** spsurya has joined #openstack-neutron02:12
openstackgerritDongcan Ye proposed openstack/neutron-vpnaas master: Skip reporting status for HA backup routers  https://review.openstack.org/61126902:14
*** dsneddon has quit IRC02:15
*** gkadam has joined #openstack-neutron02:37
*** dsneddon has joined #openstack-neutron02:39
*** cheng1 has quit IRC02:55
*** dsneddon has quit IRC02:55
*** cheng1 has joined #openstack-neutron02:58
*** hongbin has quit IRC03:00
*** dsneddon has joined #openstack-neutron03:17
*** dsneddon has quit IRC03:24
*** cheng1 has quit IRC03:30
*** cheng1 has joined #openstack-neutron03:33
*** nicolasbock has quit IRC03:33
*** wolverineav has joined #openstack-neutron03:40
*** armax has joined #openstack-neutron03:41
*** cshen has joined #openstack-neutron03:44
*** wolverineav has quit IRC03:44
openstackgerritYAMAMOTO Takashi proposed openstack/networking-midonet master: Switch to tap-as-a-service-tempest-plugin  https://review.openstack.org/64930903:46
*** cshen has quit IRC03:49
*** dsneddon has joined #openstack-neutron04:00
*** dsneddon has quit IRC04:05
*** yamahata has joined #openstack-neutron04:09
*** ramishra has joined #openstack-neutron04:17
*** igordc has joined #openstack-neutron04:18
*** dsneddon has joined #openstack-neutron04:41
*** dsneddon has quit IRC04:47
*** whoami-rajat has quit IRC04:57
*** dsneddon has joined #openstack-neutron05:17
*** ratailor has joined #openstack-neutron05:18
*** dsneddon has quit IRC05:24
*** lemko has joined #openstack-neutron05:42
*** dsneddon has joined #openstack-neutron05:45
openstackgerritReedip proposed openstack/networking-ovn master: Modify Member operations and Pool status changes  https://review.openstack.org/63658905:50
openstackgerritReedip proposed openstack/networking-ovn master: Add Unit testing for Octavia OVN Driver  https://review.openstack.org/60194805:55
*** lajoskatona has joined #openstack-neutron06:00
*** gvrangan has joined #openstack-neutron06:10
*** ccamposr has joined #openstack-neutron06:13
*** hjensas has quit IRC06:16
openstackgerritMerged openstack/neutron master: Agent configuration bandwidth report change  https://review.openstack.org/63179306:17
openstackgerritMerged openstack/neutron master: Switch all grenade jobs to be non voting and non gating temporary  https://review.openstack.org/64936406:17
*** janki has joined #openstack-neutron06:17
*** sridharg has joined #openstack-neutron06:18
*** cshen has joined #openstack-neutron06:22
*** gcheresh has joined #openstack-neutron06:25
*** slaweq has joined #openstack-neutron06:26
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Revert "Disable fullstack job from gate and make it non-voting"  https://review.openstack.org/64892406:26
*** binh___ has quit IRC06:28
*** pcaruana has joined #openstack-neutron06:36
zigotidwellr: The issue looks like in SQLAlchemy, according to Mike: https://github.com/sqlalchemy/sqlalchemy/issues/458406:37
*** pcaruana has quit IRC06:38
*** pcaruana has joined #openstack-neutron06:38
openstackgerritMerged openstack/neutron master: Do not call update_device_list in large sets  https://review.openstack.org/63864606:39
*** rpittau|afk is now known as rpittau06:50
*** luksky has joined #openstack-neutron06:50
*** dsneddon has quit IRC06:50
*** phasespace has joined #openstack-neutron06:52
*** jpena|off is now known as jpena06:55
*** hjensas has joined #openstack-neutron06:58
*** tkajinam has quit IRC06:58
*** cheng1 has quit IRC07:02
*** tkajinam has joined #openstack-neutron07:03
openstackgerritYAMAMOTO Takashi proposed openstack/networking-midonet master: Switch to tap-as-a-service-tempest-plugin  https://review.openstack.org/64930907:03
*** cheng1 has joined #openstack-neutron07:04
*** gvrangan has quit IRC07:07
*** whoami-rajat has joined #openstack-neutron07:13
*** awalende has joined #openstack-neutron07:13
*** tesseract has joined #openstack-neutron07:16
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Remove oslosphinx from lower-constraints  https://review.openstack.org/64906407:18
*** ralonsoh has joined #openstack-neutron07:18
*** aedc has quit IRC07:19
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Set HA failover bridges veth pair devices UP  https://review.openstack.org/64778407:20
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Packets getting lost during SNAT with too many connections  https://review.openstack.org/63647307:21
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Mock OVSBrdge.clear_minimum_bandwidth_qos in fullstack tests  https://review.openstack.org/64608207:21
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Mark neutron-tempest-iptables_hybrid-fedora voting  https://review.openstack.org/64281807:22
*** jistr is now known as jistr|afk07:22
*** dsneddon has joined #openstack-neutron07:25
*** shachar has quit IRC07:30
*** tssurya has joined #openstack-neutron07:32
*** iyamahat has joined #openstack-neutron07:35
*** dsneddon has quit IRC07:41
*** snapiri has joined #openstack-neutron07:46
*** abaindur has quit IRC07:56
*** igordc has quit IRC08:04
*** lennyb has joined #openstack-neutron08:04
*** ramishra has quit IRC08:07
*** dsneddon has joined #openstack-neutron08:08
*** dsneddon has quit IRC08:13
*** armax has quit IRC08:17
*** ramishra has joined #openstack-neutron08:19
*** lucasagomes has joined #openstack-neutron08:20
*** priteau has joined #openstack-neutron08:29
*** jiteka1 has quit IRC08:30
*** lemko has quit IRC08:31
*** aedc has joined #openstack-neutron08:34
openstackgerritYenuganti Vasudha proposed openstack/networking-odl master: Re-enable support for multiple router-associations to a single bgpvpn for opendaylight  https://review.openstack.org/61443108:35
*** jlibosva has joined #openstack-neutron08:43
*** dsneddon has joined #openstack-neutron08:43
*** tkajinam has quit IRC08:45
*** wolverineav has joined #openstack-neutron08:45
*** luksky has quit IRC08:46
*** wolverineav has quit IRC08:50
*** dsneddon has quit IRC08:52
*** salmankhan has joined #openstack-neutron08:56
openstackgerritRoman Safronov proposed openstack/neutron-tempest-plugin master: Add test_reuse_ip_address_with_other_fip...  https://review.openstack.org/64943509:02
*** ccamposr has quit IRC09:03
*** ccamposr has joined #openstack-neutron09:04
openstackgerritReedip proposed openstack/networking-ovn master: Update LoadBalancer Documentation  https://review.openstack.org/63738009:12
openstackgerritReedip proposed openstack/networking-ovn master: Update LoadBalancer Documentation  https://review.openstack.org/63738009:16
openstackgerritYAMAMOTO Takashi proposed openstack/networking-midonet master: Switch to tap-as-a-service-tempest-plugin  https://review.openstack.org/64930909:17
*** luksky has joined #openstack-neutron09:18
*** jangutter has quit IRC09:21
*** jangutter has joined #openstack-neutron09:22
*** jlibosva has quit IRC09:23
*** dsneddon has joined #openstack-neutron09:25
*** dsneddon has quit IRC09:32
*** whoami-rajat has quit IRC09:37
openstackgerritThomas Morin proposed openstack/networking-bgpvpn master: [DNM] lower-constraints: align pyscopg version to global reqs  https://review.openstack.org/64954609:42
*** davidsha has joined #openstack-neutron09:47
*** markvoelker has joined #openstack-neutron09:55
NewBrucetjena all - have a net node misbehaving in ovs09:56
NewBruce2019-04-03T09:53:06.402Z|1214787|poll_loop(handler41)|INFO|wakeup due to [POLLIN] on fd 30 (unknown anon_inode:[eventpoll]) at ../lib/dpif-netlink.c:2786 (99% CPU usage)09:56
NewBrucehas anyone seen this before? Reluctant to kill the process before getting further into troubleshooting so as not to loose debug info09:57
NewBrucenothing is actually running on the machine, freshly rebooted and ovs-vswitchd is consuming 800% CPU constantly09:57
*** yamamoto has quit IRC09:58
*** yamamoto has joined #openstack-neutron10:01
*** yamamoto has quit IRC10:03
*** dsneddon has joined #openstack-neutron10:06
*** dalvarez has quit IRC10:12
*** ltomasbo has quit IRC10:12
*** dsneddon has quit IRC10:12
*** jlibosva has joined #openstack-neutron10:14
*** jpena has quit IRC10:16
*** yamamoto has joined #openstack-neutron10:22
openstackgerritThomas Morin proposed openstack/networking-bgpvpn master: lower-constraints: align pyscopg version to global reqs  https://review.openstack.org/64954610:22
openstackgerritRoman Safronov proposed openstack/neutron-tempest-plugin master: Add test_reuse_ip_address_with_other_fip...  https://review.openstack.org/64943510:23
*** salmankhan has quit IRC10:26
*** salmankhan has joined #openstack-neutron10:26
*** markvoelker has quit IRC10:27
*** jpena has joined #openstack-neutron10:29
openstackgerritJakub Libosvar proposed openstack/networking-ovn master: Add unittest tree structure check  https://review.openstack.org/64957510:32
*** nicolasbock has joined #openstack-neutron10:33
*** Dinesh_Bhor has quit IRC10:34
*** jlibosva has quit IRC10:37
*** ltomasbo has joined #openstack-neutron10:39
*** dsneddon has joined #openstack-neutron10:40
*** ltomasbo has left #openstack-neutron10:41
*** dsneddon has quit IRC10:46
openstackgerritReedip proposed openstack/networking-ovn master: TrivialChange: Generalize exception logging in Octavia Driver  https://review.openstack.org/64921310:46
*** wolverineav has joined #openstack-neutron10:46
*** wolverineav has quit IRC10:51
*** tbachman has quit IRC10:51
*** ramishra has quit IRC10:56
*** mvkr has quit IRC11:01
*** jistr|afk is now known as jistr11:02
*** dalvarez has joined #openstack-neutron11:02
*** jpena is now known as jpena|lunch11:02
*** ramishra has joined #openstack-neutron11:04
*** aedc has quit IRC11:07
*** dsneddon has joined #openstack-neutron11:13
*** yamamoto has quit IRC11:15
*** hoonetorg has joined #openstack-neutron11:16
*** yamamoto has joined #openstack-neutron11:20
*** hjensas has quit IRC11:21
*** dsneddon has quit IRC11:22
*** markvoelker has joined #openstack-neutron11:24
*** liuyulong|away is now known as liuyulong11:30
*** ratailor has quit IRC11:36
*** jlibosva has joined #openstack-neutron11:38
*** rcernin has quit IRC11:38
*** jlibosva has quit IRC11:46
openstackgerritMerged openstack/neutron master: Revert "Disable fullstack job from gate and make it non-voting"  https://review.openstack.org/64892411:47
*** cshen has quit IRC11:49
*** cshen has joined #openstack-neutron11:50
*** dsneddon has joined #openstack-neutron11:51
openstackgerritMerged openstack/networking-ovn master: Fix a few pylint warnings  https://review.openstack.org/64501511:52
*** mvkr has joined #openstack-neutron11:54
*** markvoelker has quit IRC11:57
*** dsneddon has quit IRC11:57
*** hjensas has joined #openstack-neutron11:59
*** jpena|lunch is now known as jpena12:02
*** dsneddon has joined #openstack-neutron12:07
*** ramishra has quit IRC12:10
*** tbachman has joined #openstack-neutron12:12
*** odyssey4me has quit IRC12:12
*** ramishra has joined #openstack-neutron12:12
*** dsneddon has quit IRC12:13
*** aedc has joined #openstack-neutron12:18
*** mmichelson has joined #openstack-neutron12:18
*** whoami-rajat has joined #openstack-neutron12:19
*** shilpasd has joined #openstack-neutron12:23
shilpasdhi: can anybody help me, doing stack but failing with error as: 'neutron-dhcp-agent: no process found, neutron-l3-agent: no process found, neutron-metadata-agent: no process found, neutron-openvswitch-agent: no process found'12:24
*** aedc has quit IRC12:25
*** aedc has joined #openstack-neutron12:25
*** odyssey4me has joined #openstack-neutron12:26
*** priteau has quit IRC12:36
*** mmethot has joined #openstack-neutron12:36
*** janki has quit IRC12:38
*** priteau has joined #openstack-neutron12:38
*** sridharg has quit IRC12:38
yamamotonjohnston_: ping12:40
*** priteau has quit IRC12:44
*** wolverineav has joined #openstack-neutron12:47
*** hjensas has quit IRC12:48
*** hjensas has joined #openstack-neutron12:49
*** dsneddon has joined #openstack-neutron12:50
*** wolverineav has quit IRC12:52
tidwellrzigo: Thanks for the pointers. Sounds like the problem is on the sqlalchemy side of things then, nothing consumers need to change?12:53
*** dsneddon has quit IRC12:56
*** jmlowe has quit IRC12:57
*** gaoyan has joined #openstack-neutron13:00
*** cshen has quit IRC13:02
*** hjensas has quit IRC13:03
*** cshen has joined #openstack-neutron13:03
*** boden has joined #openstack-neutron13:04
njohnston_yamamoto: pong13:04
yamamotonjohnston_: do you have any idea? https://bugs.launchpad.net/neutron/+bug/182299913:05
openstackLaunchpad bug 1822999 in networking-midonet "ml2 create_port_bulk produces incompatible port context to drivers" [Critical,New]13:05
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Change provider network segmentation ID in OVS agent  https://review.openstack.org/63298413:05
yamamotothe mac address in question seems to be converted in the new create_port_bulk. but i'm not sure how to fix it as my knowledge about OVO things is rather weak.13:07
*** ygk_12345 has joined #openstack-neutron13:09
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Mock OVSBrdge.clear_minimum_bandwidth_qos in fullstack tests  https://review.openstack.org/64608213:10
*** lemko has joined #openstack-neutron13:10
*** mriedem has joined #openstack-neutron13:10
ygk_12345hi all13:11
ygk_12345i noticed on rocky setup that some of the neutron namesapces  are missing13:11
ygk_12345when I do a ip netns it is showing Error: Peer netns reference is invalid.13:11
davidshaygk_12345: do you have the L3-agent's service plugin enabled?13:12
ygk_12345davidsha: yes13:12
ygk_12345i can see l3 agent service is running on the compute node13:13
ygk_12345ProcessExecutionError: Exit code: 1; Stdin: ; Stdout: ; Stderr: setting the network namespace "qrouter-6aff88d4-6d54-4674-8a2b-17168cbe873b" failed: Invalid argument13:13
openstackgerritYAMAMOTO Takashi proposed openstack/neutron master: Add a midonet non-voting job  https://review.openstack.org/64960713:13
ygk_12345setting the network namespace "qrouter-6aff88d4-6d54-4674-8a2b-17168cbe873b" failed: Invalid argumen13:13
ygk_12345davidsha: thats what I see13:13
davidshaand it's just looping that is it?13:13
ygk_12345davidsha: yes13:14
ygk_12345davidsha: strange13:14
ygk_12345davidsha: but when we reboot the compute node it is getting fixed13:14
davidshaygk_12345: ya, thats a weird one13:14
njohnston_yamamoto: Yes, I think I can see where that would be an issue.  This is a relic of the shift to using the Port OVO object, which uses netaddr.EUI instead of string for MAC address.  The dashed form is it's default translation to string.  Let me see how I can go about fixing that.13:14
ygk_12345davidsha: donno whats causing this13:15
davidshaygk_12345: sorry I have to run in a few mins, after restarting does it eventually get back to that state is it?13:15
ygk_12345davidsha: yes again13:16
liuyulongygk_12345, try to set that router "admin-state" down, and then up. The CLI will be: openstack router set --disable/enable router_id13:17
davidshaygk_12345: ya it's an unusual one, I don't think I can help, but the l3-meeting is in 45 mins in #openstack-meeting you could ask them in the "opens" section of the meeting or during the "bugs" sections13:17
*** wolverineav has joined #openstack-neutron13:19
*** hjensas has joined #openstack-neutron13:19
*** wolverineav has quit IRC13:23
*** dsneddon has joined #openstack-neutron13:28
yamamotonjohnston_: thank you13:28
njohnston_yamamoto: working on a change now, I'll the push a DNM change with a depends on in networking-midonet to make sure this addresses the issue13:28
yamamotonjohnston_: sure. in that case please look at centos jobs because ubuntu ones are all broken right now.13:29
openstackgerritRoman Safronov proposed openstack/neutron-tempest-plugin master: Add test_reuse_ip_address_with_other_fip...  https://review.openstack.org/64943513:29
*** dklyle has quit IRC13:30
ygk_12345liuyulong: when I create a router manually it is getting created but no namspace still13:31
ygk_12345liuyulong: i see this when I use ip netns13:31
ygk_12345liuyulong: Error: Peer netns reference is invalid.13:31
*** dklyle has joined #openstack-neutron13:31
*** elod_off has quit IRC13:31
*** elod_off has joined #openstack-neutron13:32
openstackgerritNate Johnston proposed openstack/neutron master: Ensure that bulk port dicts have unix-style MAC addresses  https://review.openstack.org/64961513:33
liuyulongygk_12345, did you enable "dvr" ? If yes, only when there are ports hosted to that compute node, the router namespace will be created there. If no dvr, compute node will have any qrouter-namespace ordinarily.13:33
*** dsneddon has quit IRC13:34
ygk_12345liuyulong: oh is it ?13:34
liuyulongIf no dvr, compute node will have no qrouter-namespace ordinarily.13:34
ygk_12345liuyulong: but the command "neutron l3-agent-list-hosting-router 3b75ce9d-3285-4937-aadc-2a03cd8806df" is showing a compute node but whne I see in it no namespace at all13:35
openstackgerritNate Johnston proposed openstack/neutron master: Make networking-ovn-tempest-dsvm-ovs-release job voting  https://review.openstack.org/64081213:35
liuyulongPlease paste your neutron.conf, l3-agent.ini to this side: http://paste.openstack.org. （Remember to erase sensitive information）13:36
liuyulongygk_12345, ^^13:36
openstackgerritRoman Safronov proposed openstack/neutron-tempest-plugin master: Add test_reuse_ip_address_with_other_fip...  https://review.openstack.org/64943513:37
openstackgerritNate Johnston proposed openstack/networking-midonet master: [DNM] Test bulk port mac fix  https://review.openstack.org/64961713:39
ygk_12345liuyulong: http://paste.openstack.org/show/748806/13:40
ygk_12345liuyulong: http://paste.openstack.org/show/748807/13:40
liuyulongygk_12345, So, both "dvr" and "l3_ha" are not enabled. And your compute node l3 agent mode is "legacy".13:43
ygk_12345liuyulong:  No process started for 3b75ce9d-3285-4937-aadc-2a03cd8806df disable /openstack/venvs/neutron-18.1.4/lib/python2.7/site-packages/neutron/agent/linux/external_process.py:11813:44
liuyulongygk_12345, then make sense now, your router can be scheduled to all these agents.13:44
ygk_12345liuyulong: so what should I do now ?13:44
liuyulongygk_12345, why your neutron version is "18.1.4" ? We just release 14.0.0.rc1.13:46
ygk_12345liuyulong: it is openstack ansible rocky13:46
liuyulongygk_12345, so may I know which guide you use to install the openstack?13:47
ygk_12345liuyulong: https://docs.openstack.org/project-deploy-guide/openstack-ansible/latest/13:47
*** aniketh has joined #openstack-neutron13:48
*** cheng1__ has joined #openstack-neutron13:48
*** jmlowe has joined #openstack-neutron13:49
liuyulongyou should follow the 'rocky' related page: https://docs.openstack.org/project-deploy-guide/openstack-ansible/rocky/13:50
ygk_12345liuyulong: we followed that only13:51
liuyulongygk_12345, This deployment guide is quite non-transparent for me (maybe you too) I can not find anything useful to do the trouble-shooting. You can paste the LOG error to the  http://paste.openstack.org.13:53
*** shachar has joined #openstack-neutron13:53
*** oanson has quit IRC13:55
liuyulongygk_12345, or you can following this 'bug' guide to report your problem to the bugs.launchpad.net/neutron.  https://docs.openstack.org/neutron/pike/contributor/policies/bugs.html#bug-report-template13:56
*** snapiri has quit IRC13:56
ygk_12345liuyulong: ok13:57
liuyulonglatest link: https://docs.openstack.org/neutron/latest/contributor/policies/bugs.html#bug-report-template13:57
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Format generated MAC addresses using eui48.mac_unix_expanded  https://review.openstack.org/64962313:58
*** mlavalle has joined #openstack-neutron14:01
*** igordc has joined #openstack-neutron14:01
*** awalende has quit IRC14:03
*** njohnston_ is now known as njohnston14:03
*** awalende has joined #openstack-neutron14:03
*** dsneddon has joined #openstack-neutron14:05
*** awalende_ has joined #openstack-neutron14:07
*** awalende has quit IRC14:08
openstackgerritYAMAMOTO Takashi proposed openstack/networking-midonet master: [DNM] Test bulk port mac fix  https://review.openstack.org/64961714:09
ygk_12345liuyulong: reported this https://bugs.launchpad.net/neutron/+bug/182302314:09
openstackLaunchpad bug 1823023 in neutron "l3 namespaces" [Undecided,New]14:09
*** awalende_ has quit IRC14:11
openstackgerritNate Johnston proposed openstack/neutron master: [DNM] CI test  https://review.openstack.org/64459414:15
*** dklyle has quit IRC14:15
*** ramishra has quit IRC14:16
*** dsneddon has quit IRC14:21
*** ygk_12345 has quit IRC14:22
liuyulongygk_12345, for the "legacy" router, only after it set gateway. BTW, can you paste the error traceback to the bug? https://bugs.launchpad.net/neutron/+bug/182302314:22
openstackLaunchpad bug 1823023 in neutron "legacy router namespaces absence or error run exec" [Undecided,New]14:22
liuyulongor add router interface to it, the router then will do the schedule procedure, and the namespace will be created on l3-agent hosts then.14:24
*** yamamoto has quit IRC14:26
*** yamamoto has joined #openstack-neutron14:26
*** yamamoto has quit IRC14:26
*** dsneddon has joined #openstack-neutron14:27
*** yamamoto has joined #openstack-neutron14:27
*** yamamoto has quit IRC14:27
*** cheng1__ has quit IRC14:27
*** yamamoto has joined #openstack-neutron14:28
*** ramishra has joined #openstack-neutron14:32
*** cheng1 has quit IRC14:32
*** awalende has joined #openstack-neutron14:35
*** armax has joined #openstack-neutron14:35
*** cheng1 has joined #openstack-neutron14:35
ralonsohnjohnston, trivial fix: https://review.openstack.org/#/c/649623/14:36
njohnstonralonsoh: Cool, I like it; I think it can coexist with https://review.openstack.org/649615 so let's get them both merged14:37
ralonsohnjohnston, I saw your patch 10 secs ago14:38
njohnston:-)14:38
ralonsohnjohnston, one comment:   netaddr.mac_unix should be mac_unix_expanded14:38
ralonsohto add the leading zeros14:38
*** awalende has quit IRC14:39
*** dsneddon has quit IRC14:40
*** dklyle has joined #openstack-neutron14:41
*** iballou has joined #openstack-neutron14:41
openstackgerritNate Johnston proposed openstack/neutron master: Ensure that bulk port dicts have unix-style MAC addresses  https://review.openstack.org/64961514:42
igordcthose seem like no-brainers14:42
njohnstonralonsoh: +1 fixed14:43
ralonsohnjohnston, +114:43
*** luksky has quit IRC14:47
*** cshen has quit IRC14:52
openstackgerritboden proposed openstack/neutron master: use api def ALIAS in supported_extension_aliases  https://review.openstack.org/63730414:55
amorinhey all14:56
amorindo you know if we can prevent a live migration of instance is neutron agent is dead?14:56
amorinis there any mechanism to correlate neutron / nova on this?14:56
*** ramishra has quit IRC14:57
zigotidwellr: Sorry for the lag. Indeed, nothing from consumer, as much as Mike Bayer wrote.14:57
*** gcheresh has quit IRC14:57
slaweqamorin: I think that in current releases as we have multiple port binding feature, nova can try to bind port before migration and not start it when binding will fail14:58
slaweqamorin: but this feature was introduced in Rocky IIRC and I don't know how nova is using it TBH14:58
slaweqamorin: probably sean-k-mooney is the best person to ask about ^^14:59
amorinok thanks slaweq14:59
sean-k-mooneyi see my name15:00
sean-k-mooneyreading back15:00
amorinthanks15:00
amorinI am running newton release fyi15:00
*** dsneddon has joined #openstack-neutron15:01
amorinand, it happen that I am doing live migration of instances from hosts which are having dead neutron agent (but nova is not)15:01
sean-k-mooneyam if you are using a new enough neutron/nova e.g. one that useisn the new multiple port biding workflow we should failt to create teh inactive port binding on the destination if the compute agent is dead as the ml2 driver should fail to create the binding15:01
amorinand because of this, neutron server is setting the port into binding_failed15:01
sean-k-mooneyamorin: so is the agent dead on the source node or the destination?15:03
amorinon the source ndoe15:03
amorinnode*15:04
sean-k-mooneyok well for newton i think we use the old flow where the portbinding is not updated untill post livemigration on the destiation compute node15:04
sean-k-mooneyso i dont think a failed neutron agent should break that15:05
amorinit is on my side :p15:05
sean-k-mooneybefore the migration the port should have vif_type=ovs or whatever the backend you are using is15:06
amorinyes,15:06
sean-k-mooneyas long as the destiation is a live it should be able to update the binding using the old flow15:06
sean-k-mooneyso what you need to do is use the force down option in nove to prevent new instance being scudeld to the source node15:06
sean-k-mooneyamorin: https://specs.openstack.org/openstack/nova-specs/specs/liberty/implemented/mark-host-down.html15:07
sean-k-mooneyamorin: actullly you dont need to force it down you need to disabel the compute service15:11
amorinhum, I dont get how it can solve my issu15:11
sean-k-mooneydisableing the compute service will prevent the nova scheduler selecting the host as a destiation15:11
sean-k-mooneyeither for new vm or migrations15:11
*** iballou_ has joined #openstack-neutron15:12
*** phasespace has quit IRC15:12
amorinagree, but my issue on that source host is having neutron agent dead, and I try to live migrate instances from it to a new destination host (which is fine)15:12
sean-k-mooneyso you can do opentack compute servce --disable --disable-reason " neutron agent is dead" <host> <nova-compute>15:12
amorinah ok, so disabling the host will just prevent any action15:13
sean-k-mooneyam no it will allow you to migrate off but we would not expect migrating off to fail.15:13
sean-k-mooneyare you seeing the migration fail?15:13
amorinyes, it fails and set the instances in error, with binding_failed15:14
amorinand then I am stuck, I cant do nothing with ports in binding_failed states15:14
*** iballou has quit IRC15:15
sean-k-mooneyam well you can detach them and reattch them to rebind them15:16
sean-k-mooneynova did not start using the new workflow until rocky https://specs.openstack.org/openstack/nova-specs/specs/rocky/implemented/neutron-new-port-binding-api.html15:17
sean-k-mooneyso in the old workflow the portbinding were not updated until post live migrate15:17
*** ccamposr has quit IRC15:17
sean-k-mooneyso the port should not go to binding failed unless teh destination node agent was down15:17
amorinthat's a weird part of my implementation then15:18
sean-k-mooneylet me quickly look at teh ml2 driver are you using the intreee ml2/ovs or something else15:19
amorinI have a custom mechanism driver, but the code which is setting my port in binding_failed is the following:15:20
amorinhttps://github.com/openstack/neutron/blob/master/neutron/plugins/ml2/drivers/mech_agent.py#L11415:20
sean-k-mooneyright i was going to say if it was ml2/ovs https://github.com/openstack/neutron/blob/newton-eol/neutron/plugins/ml2/drivers/openvswitch/mech_driver/mech_openvswitch.py#L73-L80 was likely where it was failing15:22
amorinand here https://github.com/openstack/neutron/blob/newton-eol/neutron/plugins/ml2/managers.py#L73715:22
sean-k-mooneyagents = context.host_agents(self.agent_type)15:22
sean-k-mooneyshould be retruning the agents on the destination15:22
amorinthe port data I receive contains something like that: u'binding:profile': {u'migrating_to': u'host__destination__'},15:24
amorinbut with u'binding:host_id': u'host__source__',15:24
*** gcheresh has joined #openstack-neutron15:24
*** gaoyan has quit IRC15:25
sean-k-mooneythe ports shoudl be setup by https://github.com/openstack/nova/blob/newton-eol/nova/compute/manager.py#L5570-L557515:26
sean-k-mooneyby set i mean bound15:26
sean-k-mooneythat passes the destination as the host15:26
sean-k-mooneyas it is run on the destination compute node15:26
*** wwriverrat has quit IRC15:27
sean-k-mooneymaybe this is failing https://github.com/openstack/nova/blob/newton-eol/nova/compute/manager.py#L5617-L562115:27
amorinah yes, that's maybe the one which is setting my port in binding_failed15:28
*** mvkr has quit IRC15:28
sean-k-mooneythis is what that function does15:28
sean-k-mooneyhttps://github.com/openstack/nova/blob/newton-eol/nova/network/neutronv2/api.py#L311-L33615:28
sean-k-mooneyso the teardown call clear the port profile                 # Reset the port profile15:29
sean-k-mooney                self._clear_migration_port_profile(15:29
sean-k-mooneycontext, instance, admin_client, ports)15:29
sean-k-mooneybut that should not cause the port to be rebound15:30
amorinwhat is doing this one?15:30
amorinhttps://github.com/openstack/nova/blob/newton-eol/nova/compute/manager.py#L557815:31
sean-k-mooney sorry that is the call the updated the port bining the other just modify the profile15:32
amorinI will dig in the code and try to figure that out15:33
amorinthanks anyway15:33
amorinfor the tips15:33
sean-k-mooneysure thing i need to jump on a call but it ends up calling https://github.com/openstack/nova/blob/newton-eol/nova/network/neutronv2/api.py#L2388-L244915:34
sean-k-mooneythat is what updated the host id15:34
amorinyup, thanks15:35
sean-k-mooneyamorin: if the migration reverted for any reason it would endupt with the ports in binding failed so that might be what is happening15:36
*** goldyfruit has joined #openstack-neutron15:37
*** gcheresh has quit IRC15:44
*** jlibosva has joined #openstack-neutron15:49
*** tssurya has quit IRC15:49
*** jlibosva has quit IRC15:53
*** manjeets has joined #openstack-neutron15:54
*** rpittau is now known as rpittau|afk15:57
*** phasespace has joined #openstack-neutron15:58
*** nicolasbock has quit IRC16:02
openstackgerritMerged openstack/networking-ovn master: Add unittest tree structure check  https://review.openstack.org/64957516:04
*** jlibosva has joined #openstack-neutron16:05
*** lucasagomes has quit IRC16:07
*** jlibosva has quit IRC16:09
*** dsneddon has quit IRC16:10
*** imacdonn has quit IRC16:12
*** imacdonn has joined #openstack-neutron16:13
*** jpena is now known as jpena|off16:14
*** jlibosva has joined #openstack-neutron16:15
*** jlibosva has quit IRC16:20
*** yamamoto has quit IRC16:30
*** iyamahat has quit IRC16:31
*** yamahata has quit IRC16:31
*** jlibosva has joined #openstack-neutron16:31
*** tidwellr has quit IRC16:32
*** dsneddon has joined #openstack-neutron16:33
*** jlibosva has quit IRC16:36
*** dsneddon has quit IRC16:38
openstackgerritboden proposed openstack/neutron master: use trunk constants from neutron-lib  https://review.openstack.org/64967216:39
*** gkadam has quit IRC16:42
*** iyamahat has joined #openstack-neutron16:44
*** spsurya has quit IRC16:46
*** iyamahat_ has joined #openstack-neutron16:47
*** tidwellr has joined #openstack-neutron16:47
*** cshen has joined #openstack-neutron16:47
*** jlibosva has joined #openstack-neutron16:47
*** tesseract has quit IRC16:49
*** iyamahat has quit IRC16:49
*** davidsha has quit IRC16:50
*** cshen has quit IRC16:51
*** jlibosva has quit IRC16:52
*** luksky has joined #openstack-neutron16:55
*** wolverineav has joined #openstack-neutron16:57
*** rkukura has joined #openstack-neutron16:59
*** yamahata has joined #openstack-neutron17:03
*** aedc has quit IRC17:07
*** dsneddon has joined #openstack-neutron17:08
*** prometheanfire has joined #openstack-neutron17:14
prometheanfirenot sure what the issue is, but doing constraints updates and hit this bug/issue http://logs.openstack.org/08/649508/2/check/cross-neutron-py35/73dc06e/testr_results.html.gz17:14
prometheanfirehttps://review.openstack.org/64950817:14
prometheanfireso far it's only neutron hitting it17:14
*** yamamoto has joined #openstack-neutron17:22
*** spsurya has joined #openstack-neutron17:27
ralonsohprometheanfire, I reproduced the error locally. Seems to be an error in the sqlalchemy package (or maybe we are using it wrong)17:31
*** yamamoto has quit IRC17:32
*** yamamoto has joined #openstack-neutron17:33
*** ijw has joined #openstack-neutron17:40
*** jlibosva has joined #openstack-neutron17:44
*** jlibosva has quit IRC17:48
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Specify FROM clause to join from  https://review.openstack.org/64968117:51
*** jmlowe has quit IRC17:52
*** tidwellr has quit IRC17:53
*** tidwellr has joined #openstack-neutron17:54
*** jmlowe has joined #openstack-neutron17:55
*** wolverineav has quit IRC17:56
*** wolverineav has joined #openstack-neutron17:57
ralonsohprometheanfire, ^^ this patch17:58
*** yamamoto has quit IRC18:00
*** wolverineav has quit IRC18:09
*** wolverineav has joined #openstack-neutron18:10
*** igordc has quit IRC18:14
*** cshen has joined #openstack-neutron18:15
*** cshen has quit IRC18:20
*** samueldmq has joined #openstack-neutron18:25
*** yamamoto has joined #openstack-neutron18:37
*** jlibosva has joined #openstack-neutron18:39
*** jlibosva has quit IRC18:43
*** yamamoto has quit IRC18:45
*** igordc has joined #openstack-neutron18:50
*** nicolasbock has joined #openstack-neutron18:51
*** jmlowe has quit IRC18:57
*** jlibosva has joined #openstack-neutron19:01
*** tbachman has quit IRC19:08
*** salmankhan has quit IRC19:08
*** tbachman has joined #openstack-neutron19:10
*** wolverineav has quit IRC19:10
*** wolverineav has joined #openstack-neutron19:10
*** wolverineav has quit IRC19:15
*** aedc has joined #openstack-neutron19:17
*** ijw has quit IRC19:20
*** rkukura has quit IRC19:21
*** boden has quit IRC19:25
openstackgerritMerged openstack/neutron master: Mark neutron-tempest-iptables_hybrid-fedora voting  https://review.openstack.org/64281819:31
*** boden has joined #openstack-neutron19:32
*** abaindur has joined #openstack-neutron19:36
*** abaindur has quit IRC19:39
*** abaindur has joined #openstack-neutron19:39
*** abaindur has quit IRC19:42
*** abaindur has joined #openstack-neutron19:42
*** rkukura has joined #openstack-neutron19:43
*** jmlowe has joined #openstack-neutron19:48
prometheanfireralonsoh: should I wait for that patch or hold back sqlalchemy first?19:51
*** wolverineav has joined #openstack-neutron19:58
*** mriedem has quit IRC20:01
*** mriedem has joined #openstack-neutron20:06
ralonsohprometheanfire, I'll try to merge the neutron patch ASAP20:09
*** mrhillsman is now known as mrhillsman_bbiab20:11
*** cshen has joined #openstack-neutron20:17
*** igordc has quit IRC20:18
*** awalende has joined #openstack-neutron20:20
*** jlibosva has quit IRC20:20
*** aniketh has quit IRC20:21
*** cshen has quit IRC20:25
*** whoami-rajat has quit IRC20:29
*** iballou_ has quit IRC20:33
openstackgerritNate Johnston proposed openstack/neutron master: Ensure that bulk port dicts have unix-style MAC addresses  https://review.openstack.org/64961520:35
*** gcheresh has joined #openstack-neutron20:37
*** rcernin has joined #openstack-neutron20:45
*** wolverineav has quit IRC20:49
*** abaindur has quit IRC20:50
*** ralonsoh has quit IRC20:54
*** spsurya has quit IRC20:59
*** igordc has joined #openstack-neutron20:59
*** mmethot has quit IRC21:00
*** gcheresh has quit IRC21:04
openstackgerritMerged openstack/neutron-interconnection master: Add service common constants  https://review.openstack.org/63117721:05
*** pcaruana has quit IRC21:06
*** mmichelson has quit IRC21:06
*** abaindur has joined #openstack-neutron21:18
*** slaweq has quit IRC21:38
*** boden has quit IRC21:39
*** rcernin has quit IRC21:42
abaindurHow come the fip namespace no longer has a default route?21:44
*** goldyfruit has quit IRC21:46
*** slaweq has joined #openstack-neutron21:55
*** awalende has quit IRC21:59
*** slaweq has quit IRC22:00
*** wolverineav has joined #openstack-neutron22:06
*** wolverineav has quit IRC22:12
*** mlavalle has quit IRC22:15
*** cshen has joined #openstack-neutron22:21
*** cshen has quit IRC22:26
*** nicolasbock has quit IRC22:34
*** wwriverrat has joined #openstack-neutron22:40
*** yamamoto has joined #openstack-neutron22:43
*** dsneddon has quit IRC22:43
*** abaindur has quit IRC22:44
*** yamamoto has quit IRC22:47
*** dsneddon has joined #openstack-neutron22:50
*** yamamoto has joined #openstack-neutron23:00
*** wolverineav has joined #openstack-neutron23:02
*** tkajinam has joined #openstack-neutron23:04
*** slaweq has joined #openstack-neutron23:06
*** wolverineav has quit IRC23:06
*** abaindur has joined #openstack-neutron23:07
*** slaweq has quit IRC23:10
*** iballou_ has joined #openstack-neutron23:13
*** cshen has joined #openstack-neutron23:18
*** cshen has quit IRC23:23
*** abaindur has quit IRC23:48
*** abaindur has joined #openstack-neutron23:49
*** abaindur has quit IRC23:53
*** wolverineav has joined #openstack-neutron23:56
*** tbachman has quit IRC23:58
« Tuesday, 2019-04-02 Index Thursday, 2019-04-04 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!