Tuesday, 2019-10-22

« Monday, 2019-10-21 Index Wednesday, 2019-10-23 »
*** k_mouza has joined #openstack-kolla01:04
*** k_mouza has quit IRC01:09
*** billp has quit IRC02:15
*** BrunoD has quit IRC02:19
*** spsurya has joined #openstack-kolla02:50
*** openstackgerrit has joined #openstack-kolla03:14
openstackgerritpengyuesheng proposed openstack/kayobe master: Switch to Ussuri jobs  https://review.opendev.org/68991303:14
*** skramaja has joined #openstack-kolla04:29
*** skramaja has quit IRC05:03
*** tonythomas has quit IRC05:15
*** janki has joined #openstack-kolla05:30
*** cah_link has joined #openstack-kolla05:54
yoctozeptomorning06:24
*** dpawlik has joined #openstack-kolla06:27
*** skramaja has joined #openstack-kolla06:32
*** igordc has joined #openstack-kolla06:34
*** pcaruana has joined #openstack-kolla06:47
*** igordc has quit IRC06:48
mnasiadkamorning06:57
*** dpawlik has quit IRC07:01
*** dpawlik has joined #openstack-kolla07:02
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI  https://review.opendev.org/67637607:19
osmanlicilegimorning07:28
mnasiadkayoctozepto: replied to your comments in the ceph keys change, happy with answers? I'll work on it today so we can start thinking about merging it07:29
mnasiadkaand surprisingly ceph-ansible change is close to being ready, need to add integration with radosgw as swift endpoint and manila CephFS native and NFS07:30
mnasiadkaand then can work on docs07:30
openstackgerritMerged openstack/kolla master: Use Train release for all OpenStack projects  https://review.opendev.org/68972807:32
yoctozeptomnasiadka: glad to hear that07:37
*** priteau has joined #openstack-kolla07:42
*** ivve has joined #openstack-kolla07:43
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Revert "Use Train release for all OpenStack projects"  https://review.opendev.org/68999907:44
hrwMORNING07:45
*** janki has quit IRC07:46
mnasiadkayoctozepto: the file globs thing... well, we support that now, in cinder and manila - but still nova key needs to be strictly defined. either we deprecate the file globs (which I personally I'm in for) or leave as is...07:50
mnasiadkain order not to break anything07:51
BlinkizI tried to only use python3 in a new dev environment with kolla-ansible 8.0.1. It does not seem to work. kolla-ansible wants the "python" and baremetal play installs python2 on the baremetal nodes. Is there some flag I should use to only use python3 or is it not supported?07:52
*** janki has joined #openstack-kolla07:52
yoctozeptomnasiadka: ah, right, but that glob was/is lame07:53
yoctozeptobetter not advertise it this way07:53
mnasiadkayoctozepto: yeah, it is - as said I prefer to remove that functionality :)07:53
yoctozeptoBlinkiz: that could be a bug07:53
yoctozeptowe focused on python3 in the containers07:54
yoctozeptoand tooling07:54
yoctozeptobut yeah, k-a could still be dependent on 207:54
osmanlicilegiyoctozepto: according to your comment at https://review.opendev.org/#/c/689870/2/ansible/roles/baremetal/templates/docker_systemd_service.j2, I didn't know docker_config, I'll switch to it. should I move docker_systemd_service.j2 as is or remove the change?07:54
Blinkizokay07:54
yoctozeptoalso, python3 is more like train, not stein anyway07:54
Blinkizgot it. I just wait then for train07:54
yoctozeptoosmanlicilegi: you should try configuring via json07:55
openstackgerritMerged openstack/kolla master: Fix python3 compatibility for barbican  https://review.opendev.org/68978908:03
openstackgerritDincer Celik proposed openstack/kolla-ansible master: [docker] Added a new flag docker_disable_default_network  https://review.opendev.org/68987008:04
openstackgerritDincer Celik proposed openstack/kolla-ansible master: [docker] Added a new flag docker_disable_default_network  https://review.opendev.org/68987008:06
osmanlicilegiyoctozepto: it's your turn :]08:07
openstackgerritDincer Celik proposed openstack/kolla stable/stein: Fix python3 compatibility for barbican  https://review.opendev.org/69000308:07
*** amoralej|off is now known as amoralej08:12
*** dougsz has joined #openstack-kolla08:14
openstackgerritDincer Celik proposed openstack/kolla-ansible master: [docker] Added a new flag docker_disable_default_network  https://review.opendev.org/68987008:19
openstackgerritDincer Celik proposed openstack/kolla-ansible master: [docker] Added a new flag docker_disable_default_network  https://review.opendev.org/68987008:21
*** k_mouza has joined #openstack-kolla08:22
*** dpawlik has quit IRC08:31
stingrayzamorning o/08:36
hrwhi stingrayza08:39
*** gfidente has joined #openstack-kolla08:46
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI  https://review.opendev.org/67637608:59
*** dpawlik has joined #openstack-kolla09:01
*** rgogunskiy has joined #openstack-kolla09:12
openstackgerritMerged openstack/kolla-ansible master: [nova][train] Remove deprecated RetryFilter  https://review.opendev.org/68933709:23
*** k_mouza has quit IRC09:33
*** dpawlik has quit IRC09:48
*** k_mouza has joined #openstack-kolla09:48
*** k_mouza has quit IRC09:49
*** k_mouza has joined #openstack-kolla09:50
*** dpawlik has joined #openstack-kolla10:02
*** janki has quit IRC10:07
*** pcaruana has quit IRC10:16
*** pcaruana has joined #openstack-kolla10:21
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Provide sensible default cell group names  https://review.opendev.org/69003910:43
dougszyoctozepto: ^ Is that what you were thinking for the default groups names?10:44
dougszAlso, if anyone has a chance to look at this one quickly, it's already got one +2: https://review.opendev.org/#/c/681301/10:48
*** k_mouza_ has joined #openstack-kolla10:52
*** k_mouza has quit IRC10:54
hrwdougsz: typo to fix ;(10:57
dougszsharp eye hrw10:58
openstackgerritDoug Szumski proposed openstack/kolla-ansible master: Typo fix in docs  https://review.opendev.org/69004211:00
hrwdougsz: why not merge both? D:11:02
hrw+211:02
hrw+w+2 to previous one11:03
dougszhrw: it saves bumping off the existing +2 over a trivial fix11:03
dougszthanks for taking a look11:04
*** k_mouza_ has quit IRC11:04
*** k_mouza has joined #openstack-kolla11:07
openstackgerritMerged openstack/kolla master: Switch upper constraints in kolla-toolbox to use releases.o.o  https://review.opendev.org/68974411:15
openstackgerritMerged openstack/kolla master: Switch OPENSTACK_RELEASE to train  https://review.opendev.org/68972911:16
openstackgerritMerged openstack/kolla-ansible master: Update documentation on overriding config files  https://review.opendev.org/68130111:16
*** amoralej is now known as amoralej|lunch11:23
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI  https://review.opendev.org/67637611:26
*** tonyb has joined #openstack-kolla11:31
*** dpawlik has quit IRC11:31
openstackgerritDincer Celik proposed openstack/kolla-ansible master: [docker] Added a new flag docker_disable_default_network  https://review.opendev.org/68987011:37
*** dpawlik has joined #openstack-kolla11:43
*** jdwidari has joined #openstack-kolla11:50
*** dpawlik has quit IRC11:55
*** kplant has joined #openstack-kolla12:00
*** dpawlik has joined #openstack-kolla12:01
*** cah_link has quit IRC12:01
*** cah_link has joined #openstack-kolla12:02
*** jdwidari has quit IRC12:13
*** dpawlik has quit IRC12:20
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI  https://review.opendev.org/67637612:32
*** dpawlik has joined #openstack-kolla12:36
openstackgerritNuman Siddique proposed openstack/kolla master: ovn: Create the ovn dbs only if the schema file exists  https://review.opendev.org/69006512:40
BlinkizI have now tried to solve this error for 2 hours but I can not find the solution.12:51
BlinkizI can not connect to ceph backend.12:52
BlinkizERROR glance_store._drivers.rbd InvalidArgumentError: [errno 22] error connecting to the cluster12:52
Blinkizhttps://paste.ubuntu.com/p/GtCpsYmJmh/12:52
BlinkizNeither glance nor cinder can connect on this new deploy.12:52
BlinkizThe thing is that I do not know where to troubleshoot anymore.12:53
openstackgerritMerged openstack/kolla-ansible master: Zun: add Cinder (volume) iSCSI support  https://review.opendev.org/68290012:56
openstackgerritMerged openstack/kolla stable/queens: Bump OpenStack versions for Queens EM  https://review.opendev.org/68974112:56
*** amoralej|lunch is now known as amoralej12:59
*** radeks has joined #openstack-kolla13:00
*** csmart has quit IRC13:07
*** jovial[m] has quit IRC13:07
priteauBlinkiz: Have you checked ceph-mon logs?13:08
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI  https://review.opendev.org/67637613:09
mnasiadkaBlinkiz: external ceph?13:10
Blinkizexternal ceph, yes13:10
mnasiadkaare you sure the keyring and ceph.conf are in the glance-api container?13:10
Blinkizmnasiadka, yes. "docker exec -it glance_api ls /etc/ceph" and I see two files. ceph.conf and the keyring.13:12
mnasiadkawhat openstack release are you running? and please share ceph.conf somewhere on paste13:13
mnasiadkaand the glance.conf13:13
Blinkizceph.conf: https://paste.ubuntu.com/p/GTyq4w9twd/   glance-api.conf: https://paste.ubuntu.com/p/BpN2XXrbM5/13:15
BlinkizAm running kolla-ansible 8.0.1 with openstack_release: "stein"13:16
Blinkizkolla_install_type: "source" and kolla_base_distro: "ubuntu"13:16
mnasiadkaso you should have librbd supporting the bracketed format of mon host13:16
mnasiadkabut you can try changing that to non bracketed format and checking if it helps :)13:16
Blinkizmnasiadka, yes, it started to work13:18
openstackgerritMerged openstack/kolla-ansible stable/stein: Fix placement being enabled always instead of with nova  https://review.opendev.org/68969513:18
Blinkizmnasiadka, Changed into "mon host = 192.168.39.12:6789,192.168.39.17:6789192.168.39.19:6789"13:18
mnasiadkaout of curiosity, what's librbd version in the container?13:18
Blinkizmnasiadka, I do not know? :) which container should I look into?13:19
kplantglance,cinder,etc. anything that has a ceph client13:19
mnasiadkaBlinkiz: glance-api, rpm -vqa | grep rbd13:19
*** schwicht has joined #openstack-kolla13:20
Blinkizmnasiadka, got it. It's 12.2.12-0ubuntu0.18.04.313:20
BlinkizHmm. My ceph is version 14.2.413:21
BlinkizI deployed ceph with ceph-ansible using there stable-4.0 branch.13:22
mnasiadkaGood morning, ceph client libraries from old ceph release13:22
mnasiadkaBlinkiz: please raise a bug and assign to me :)13:22
Blinkizmnasiadka, Thank you for helping me find the problem.13:23
BlinkizNow I can do a workaround at least13:23
Blinkizmnasiadka, Sure, I create a bug13:23
*** dave-mccowan has joined #openstack-kolla13:25
*** cah_link has quit IRC13:26
*** radeks has quit IRC13:29
*** radeks_ has joined #openstack-kolla13:29
*** dave-mccowan has quit IRC13:29
Blinkizmnasiadka, https://bugs.launchpad.net/kolla-ansible/+bug/184930413:30
openstackLaunchpad bug 1849304 in kolla-ansible "Ubuntu source has old rbd package" [Undecided,New]13:30
*** jdwidari has joined #openstack-kolla13:56
*** rgogunskiy has quit IRC14:11
*** igordc has joined #openstack-kolla14:23
*** dpawlik has quit IRC14:30
openstackgerritNuman Siddique proposed openstack/kolla master: ovn: Create the ovn dbs only if the schema file exists  https://review.opendev.org/69006514:40
*** pcaruana has quit IRC14:58
*** hjensas has quit IRC15:04
yoctozeptodougsz: aye15:05
yoctozeptoif only it worked though15:05
yoctozeptomnasiadka: are old client libraries unable to connect to new clusters?15:06
yoctozeptoI have cluster on mimic already15:07
yoctozeptoand it seems to work fine with kolla-ansible stein on centos715:07
dougszyoctozepto: sounds like a reasonable request!15:11
openstackgerritMerged openstack/kolla-ansible master: Typo fix in docs  https://review.opendev.org/69004215:12
*** ivve has quit IRC15:13
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI  https://review.opendev.org/67637615:30
mnasiadkayoctozepto: they are able, but they don't support bracketed mon_host variable - which is in ceph.conf generated by ceph-ansible for nautilus15:31
mnasiadkayoctozepto: I just wanted Blinkiz to raise a bug, so we can update the docs15:32
*** hjensas has joined #openstack-kolla15:38
yoctozeptomnasiadka: ah, did not read the contents15:43
yoctozeptothanks for the background15:43
*** jbadiapa has quit IRC15:44
*** jbadiapa has joined #openstack-kolla15:45
*** k_mouza has quit IRC15:47
*** k_mouza_ has joined #openstack-kolla15:47
*** jbadiapa has quit IRC15:50
*** jcmdln has quit IRC15:52
*** skramaja has quit IRC15:55
mnasiadkayoctozepto: you're welcome :)16:01
*** BrunoD has joined #openstack-kolla16:03
BrunoDhi, i still have issue with kolla/neutron and external interface with 2 network interface.16:04
BrunoDneutron-server.log:2019-10-22 17:39:30.428 20 ERROR neutron.plugins.ml2.managers [req-a37d9a40-39da-4dd6-94f9-399fa42fd40e d7178e525f0f4763b1591a23782e3512 3304869fcf634e0b8c26a46a1fa83156 - default default] Failed to bind port 24626fb4-44a2-4c9e-aeb8-bae9f7f7cfde on host compute02 for vnic_type normal using segments [{'id':16:12
BrunoD'b2d97cfa-d765-4511-9242-6b50312f3474', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ee6302bb-f89d-4028-8006-6e98db2f2e9c'}]16:13
*** dpawlik has joined #openstack-kolla16:15
*** rpittau is now known as rpittau|afk16:17
*** igordc has quit IRC16:20
yoctozeptoBrunoD: needs logs from some agent16:22
yoctozeptoserver is just the api layer16:22
mnasiadkayeah, neutron-openvswitch-agent logs from compute0216:26
yoctozeptomnasiadka: or linuxbridge16:26
BrunoDoki16:26
mnasiadkayeah, that's flat so it might be linuxbridge16:27
mnasiadka:)16:27
BrunoD2019-10-21 18:25:03.183 6 ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Interface enp1s0 for physical network physnet1 does not exist. Agent terminated!16:28
BrunoDas all is installed by kolla where i can set physnet1 for compute node ?16:29
yoctozeptoit's the neutron external interface you set16:30
kplantdo you have an interface named enp1s0 on that node? :D16:30
BrunoDno :-(16:31
*** hjensas has quit IRC16:31
BrunoDno :-(16:31
mnasiadkaso why did you configure it to use enp1s0? :)16:33
BrunoDnetwork_interface: "eno1"# These can be adjusted for even more customization. The default is the same as# the 'network_interface'. These interfaces must contain an IPv4 address.#kolla_external_vip_interface: "{{ network_interface }}"#api_interface: "{{ network_interface }}"#storage_interface: "{{ network_interface }}"#cluster_interface: "{{16:33
BrunoDnetwork_interface }}"#swift_storage_interface: "{{ storage_interface }}"#swift_replication_interface: "{{ swift_storage_interface }}"#tunnel_interface: "{{ network_interface }}"#dns_interface: "{{ network_interface }}"#octavia_network_interface: "{{ network_interface }}"# This is the raw interface given to neutron as its external network port.16:33
BrunoDEven# though an IP address can exist on this interface, it will be unusable in most# configurations. It is recommended this interface not be configured with any IP# addresses for that reason.neutron_external_interface: "enp1s0"# Valid options are [ openvswitch, linuxbridge, vmware_nsxv, vmware_nsxv3, vmware_dvs, opendaylight ]# if vmware_nsxv3 is16:33
BrunoDselected, enable_openvswitch MUST be set to "no" (default is yes)neutron_plugin_agent: "linuxbridge"16:33
BrunoDmy need is quiet simple a controller node with 2 network interface with one external to octavia and 2 compute node with one network interface (eno1)16:35
BrunoDwhen all were based on eno1 only all work fine but i can't set an external network to ocavia16:35
BrunoDand i am getting mad :_)16:38
*** pcaruana has joined #openstack-kolla16:41
*** dpawlik has quit IRC16:42
*** k_mouza has joined #openstack-kolla16:42
*** k_mouza has quit IRC16:43
*** k_mouza_ has quit IRC16:44
mnasiadkaBrunoD: you can set neutron_external_interface in host/group vars in inventory, so it's different on those computes16:47
BrunoDlike that ?16:52
BrunoD[network]10.194.132.195  external_network=enp1s0 ansible_user=kolla become=true ansible_connection=local[compute]10.194.132.195  external_network=enp1s0 ansible_user=kolla ansible_become=true ansible_connection=ssh10.194.132.196  external_network=eno1 ansible_user=kolla ansible_become=true ansible_connection=ssh10.194.132.194  external_network=eno116:52
BrunoDansible_user=kolla ansible_become=true ansible_connection=ssh[octavia]10.194.132.195 external_network=enp1s0 ansible_user=kolla ansible_become=true ansible_connection=ssh16:52
*** pcaruana has quit IRC16:52
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Ceph-Ansible CI  https://review.opendev.org/67637616:54
*** dougsz has quit IRC16:57
*** gfidente is now known as gfidente|afk17:06
*** BrunoD has quit IRC17:09
*** k_mouza has joined #openstack-kolla17:13
*** jbadiapa has joined #openstack-kolla17:13
*** quantomworks has joined #openstack-kolla17:17
*** k_mouza has quit IRC17:17
*** priteau has quit IRC17:22
*** jcmdln has joined #openstack-kolla17:26
*** amoralej is now known as amoralej|off17:45
*** LaurentDumont has joined #openstack-kolla17:45
LaurentDumontHi everyone, would there be any inherent reason why a router would be deleted when I create two external networks?17:46
LaurentDumontThe router "external" gateway is only one of the two.17:46
LaurentDumontI see a TooManyExternalNetworks and a "no agent is compatible with the router" when I do that17:46
*** amoralej|off is now known as amoralej17:46
LaurentDumontThis is with Kolla Stein with a fresh deployment with the latest container.17:47
*** amoralej is now known as amoralej|off17:50
yoctozeptoLaurentDumont: router can only have one external gateway17:50
yoctozeptothough it should not disappear automatically when you have twp17:51
LaurentDumontThat's the case, only one of the two external network is assigned to that router.17:51
yoctozeptoand that's it17:51
LaurentDumontOne internal and one external for SNAT and floating IPs.17:51
LaurentDumontJust to note, the second "external" network is actually more like a provider network and it works correctly. I just saw the error when I also marked it as external if for some reason I wanted to use that pool for floating IP or on another router.17:53
LaurentDumontThose resources are created through Terraform.17:53
yoctozeptoLaurentDumont: you make my brain boil, could help if you painted it out and told what you want to work and does not18:09
LaurentDumontSure - let me write it down more clearly.18:10
*** igordc has joined #openstack-kolla18:14
*** ivve has joined #openstack-kolla18:15
*** jonaspaulo has joined #openstack-kolla18:23
*** spsurya has quit IRC18:30
*** igordc has quit IRC18:47
*** igordc has joined #openstack-kolla18:56
*** dpawlik has joined #openstack-kolla18:57
*** pcaruana has joined #openstack-kolla19:04
*** dpawlik has quit IRC19:09
*** jdwidari has quit IRC19:10
*** pcaruana has quit IRC19:19
*** amoralej|off is now known as amoralej19:21
*** amoralej is now known as amoralej|off19:24
*** henriqueof has joined #openstack-kolla19:27
*** hjensas has joined #openstack-kolla19:36
LaurentDumontyoctozepto - A small summary of the issue I see : http://paste.openstack.org/show/785487/19:43
*** dpawlik has joined #openstack-kolla19:48
*** kplant has quit IRC19:48
*** radeks_ has quit IRC20:01
LaurentDumontThe more I'm playing with this, the more I think I'm hitting : https://review.opendev.org/#/c/682418/20:10
LaurentDumontWhich I'm just surprised never popped up before as having more than one Network marked external must be pretty common?20:11
LaurentDumontMaybe not within the same project though.20:11
*** dpawlik has quit IRC20:35
*** amoralej|off is now known as amoralej20:44
*** billp has joined #openstack-kolla20:51
*** schwicht has quit IRC21:12
*** schwicht has joined #openstack-kolla21:23
*** schwicht has quit IRC21:52
*** schwicht has joined #openstack-kolla21:56
*** jonaspaulo has quit IRC22:03
*** quantomworks has quit IRC22:04
*** gfidente|afk has quit IRC22:18
*** ivve has quit IRC22:45
*** csmart has joined #openstack-kolla22:48
*** schwicht has quit IRC23:21
*** jbadiapa has quit IRC23:43
*** igordc has quit IRC23:55
*** schwicht has joined #openstack-kolla23:59
« Monday, 2019-10-21 Index Wednesday, 2019-10-23 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!