Monday, 2019-07-01

*** schwicht has quit IRC00:07
*** schwicht has joined #openstack-ansible00:12
*** kplant has quit IRC00:21
*** schwicht has quit IRC00:48
*** tinwood has quit IRC02:08
*** tinwood has joined #openstack-ansible02:10
*** joshualyle has quit IRC02:27
*** joshualyle has joined #openstack-ansible02:28
*** BjoernT has joined #openstack-ansible03:10
*** BjoernT has quit IRC04:07
*** BjoernT has joined #openstack-ansible04:09
*** BjoernT has quit IRC04:19
*** bradm has quit IRC05:13
*** udesale has joined #openstack-ansible05:18
*** shyamb has joined #openstack-ansible05:24
*** jbadiapa has joined #openstack-ansible05:45
*** rpittau|mtg is now known as rpittau|afk05:49
*** udesale has quit IRC05:59
*** cshen has joined #openstack-ansible06:27
*** luksky has joined #openstack-ansible06:28
*** shyamb has quit IRC06:44
jrosserMorning06:49
*** ivve has joined #openstack-ansible07:05
ChosSimbaOnemorning :-)07:11
*** shyamb has joined #openstack-ansible07:13
*** mwe1 has joined #openstack-ansible07:14
*** tosky has joined #openstack-ansible07:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia stable/stein: Ensure that admin endpoint is used to configure octavia quota  https://review.opendev.org/66836907:26
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia stable/rocky: Ensure that admin endpoint is used to configure octavia quota  https://review.opendev.org/66837307:34
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia stable/stein: Use the admin endpoint to upload glance images  https://review.opendev.org/66837407:35
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia stable/rocky: Use the admin endpoint to upload glance images  https://review.opendev.org/66837507:35
*** pcaruana has joined #openstack-ansible07:44
*** rpittau|afk is now known as rpittau07:44
*** shyamb has quit IRC07:59
*** Emine has joined #openstack-ansible08:20
*** CeeMac has joined #openstack-ansible08:43
*** cshen has quit IRC08:43
*** udesale has joined #openstack-ansible08:55
*** shyamb has joined #openstack-ansible08:58
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Save iptables rules for all Debian derivative operating systems  https://review.opendev.org/66839409:18
*** cshen has joined #openstack-ansible09:22
*** cshen has quit IRC09:29
*** adrianreza has quit IRC09:48
*** cshen has joined #openstack-ansible09:52
*** vnogin has joined #openstack-ansible09:56
*** cshen has quit IRC10:03
*** martinkennelly has joined #openstack-ansible10:04
*** cshen has joined #openstack-ansible10:09
*** vnogin has quit IRC10:39
*** brtknr has quit IRC10:41
*** brtknr has joined #openstack-ansible10:42
*** vnogin has joined #openstack-ansible10:43
*** shyamb has quit IRC10:52
*** brtknr has quit IRC10:53
*** brtknr has joined #openstack-ansible10:53
*** vnogin has quit IRC11:04
*** kplant has joined #openstack-ansible11:09
*** shyamb has joined #openstack-ansible11:09
*** cshen has quit IRC11:11
*** cshen has joined #openstack-ansible11:14
*** pcaruana has quit IRC11:36
*** luksky has quit IRC11:46
*** shyamb has quit IRC11:48
CeeMacafternoon11:52
*** cshen has quit IRC12:00
*** shyamb has joined #openstack-ansible12:02
*** ansmith has quit IRC12:10
jamesdentongood day12:15
*** cshen has joined #openstack-ansible12:16
*** schwicht has joined #openstack-ansible12:18
spotzhey12:20
*** cshen has quit IRC12:20
jamesdentonhey spotz12:20
spotzhow goes jamesdenton?12:21
jamesdentonit goes, it goes12:21
jamesdentonyou? how's your summer?12:21
*** electrofelix has joined #openstack-ansible12:30
*** schwicht has quit IRC12:30
*** schwicht has joined #openstack-ansible12:31
CeeMacjamesdenton: just the man i was hoping to see!12:35
jamesdenton:|12:35
jamesdenton:D12:35
CeeMacoh, and Hi, etc :D12:35
jamesdenton<formalities>12:36
CeeMac</formalities>12:36
ionihey jamesdenton12:36
ionican i pm you?12:36
jamesdentonhi ioni12:36
jamesdentonsure12:36
*** cshen has joined #openstack-ansible12:37
*** luksky has joined #openstack-ansible12:37
CeeMacdo you happen to have run into a scenario where there are 2 routers in a project connected to the same tenant network, and one loses access to the network?12:37
CeeMacone is one the 'public' external network the other is on a share_as_external provider network12:38
jamesdentonhmm12:40
jamesdentoni can't say i've seen that exact scenario. I have seen two routers connected to the same tenant network, one of them is the 'external' and the other has a leg into a vlan. host routes on the VMs and routes on the router itself to get things to go where they need to do12:41
jamesdentonbut i haven't seen one or the other lose access12:42
*** cshen has quit IRC12:42
CeeMacIt's odd12:45
*** ansmith has joined #openstack-ansible12:45
CeeMacI can see the qr ports in both netns have the correct ip12:45
CeeMacBut the IP route command on one of the routers no longer has the network there for that interface12:46
CeeMacAnd I can't ping each other from the routers12:47
jamesdentonhmm, that is weird. is the interface LOWER_UP?12:48
*** schwicht has quit IRC12:50
jrosserseems today is networks-on-fire day here too12:50
CeeMacyes, both are LOWER_UP12:51
CeeMachi jrosser12:51
jrossersurprise requirement for  [placement] section in neutron.conf12:51
jamesdentonwhaaaat12:51
jamesdentonCeeMac You can try unscheduling that router from the L3 agent, then reschedule, and it should rebuild the bits12:52
jrosserjamesdenton: https://github.com/openstack/neutron/blob/e0331ce0a31e3691ac5ee4691989728bb8402e89/devstack/lib/placement#L5-L1412:52
jrosserserves me right for using a segmented provider network12:52
jamesdentoninteresting.12:53
* jamesdenton is way behind on his neutroning12:53
jrosserand it blows up gigantically too, even if you don't connect to the segmented network you can't create routers12:53
CeeMacjamesdenton: say what now? how do i do that?12:53
jamesdentonAhem.. .turn to page 41812:54
jamesdentonj/k12:54
jamesdentonone sec12:54
*** shyam89 has joined #openstack-ansible12:54
*** shyamb has quit IRC12:54
* CeeMac goes to find manual12:54
CeeMacthe routers are HA if that helps?12:54
CeeMacor hinders12:55
jamesdentonCeeMac : openstack network agent remove router / network agent add router12:55
jamesdentonNaw, i don't think so. But it may be easier to just set router admin down/up12:55
jamesdentonin that case12:55
CeeMacyeah i might try that first12:55
jamesdentonopenstack router set --disable / --enable12:55
CeeMacremove sounds too much like delete for my liking on a monday afternoon12:56
jamesdentonYeah, better save it for Friday afternoon12:56
CeeMacok, that disabled the whole router12:59
CeeMacbut the good news is it came back up on the other NN and is working now12:59
CeeMacneed to work out how to manually fail over12:59
CeeMacand what caused this issue13:00
jamesdentonYeah, there is no way to trigger a manual failover via API AFAIK13:00
CeeMacbbiab /meeting13:01
jamesdentonSo basically what that did was remove the namespace and veths, then rebuild them everywhere it needed to13:01
jamesdentonk13:01
spotzjamesdenton: Not bad, raining in TX everyday it seems so far13:03
*** shyam89 has quit IRC13:04
*** spatel has joined #openstack-ansible13:14
spatelMorning! folk,13:14
spatelThis is very strange issue, i have noticed stein didn't install rsyslog client on any container or anyehwere.13:15
spatelis this something changed in stein deployment of OSA? or i am missing something here, I think rsyslogd is default feature which doesn't need any special config to install.13:17
*** schwicht has joined #openstack-ansible13:17
*** cshen has joined #openstack-ansible13:22
*** BjoernT has joined #openstack-ansible13:27
*** cshen has quit IRC13:27
*** BjoernT_ has joined #openstack-ansible13:33
*** BjoernT has quit IRC13:34
*** cshen has joined #openstack-ansible13:37
*** vnogin has joined #openstack-ansible13:44
*** jeh has joined #openstack-ansible13:57
*** schwicht has quit IRC14:00
*** pcaruana has joined #openstack-ansible14:06
*** schwicht has joined #openstack-ansible14:09
*** vnogin has quit IRC14:12
*** kaiokmo has quit IRC14:19
*** udesale has quit IRC14:34
*** udesale has joined #openstack-ansible14:34
*** cshen has quit IRC14:44
BjoernT_Can I get https://review.opendev.org/#/c/664753/ and https://review.opendev.org/#/c/665218/ +2 and merged ?14:54
*** pcaruana has quit IRC14:56
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Update default test amphora image from xenial to bionic  https://review.opendev.org/66708515:02
jamesdentonBjoernT_ -115:04
spotzjamesdenton: which did you just -1, I think we were reviewing on top of each other:(15:04
jamesdentoni'm just kidding15:05
jamesdentonlol15:05
jamesdentonsorry15:05
spotzgrrrr *phhbt*15:05
*** BjoernT_ is now known as BjoernT15:10
jrosserif i need to add a [placement] client section to neutron.conf, which credentials do i use there for username/password/blah in that section?15:27
*** ivve has quit IRC15:30
spotzjrosser: Hrm, only added it to nova. I would assume the same?15:36
jamesdentonit looks like nova.conf uses nova_service_user_name and nova_service_password, so maybe neutron_service_user_name and neutron_service_password?15:36
jrossera bunch of stuff was switched round recently in nova https://review.opendev.org/#/c/658177/15:37
jrosserso it seems like the creds of the client service are the right thing to use15:38
gillesMoHello ! I'm fighing with livre block migration. My instance moves but the resulting instance is borken, and cannot reboot (disk size seems to have changed and the root filesystem cannot be mounted)15:46
gillesMoPerhaps, becaus my images are raw, and the instance is created on a qcow2 file based on the image file ?15:46
*** weshay is now known as weshay_PTO15:52
*** pcaruana has joined #openstack-ansible15:53
*** luksky has quit IRC15:56
spatelgillesMo: what version are you running?16:02
spatelgillesMo: i am having same issue with queen still not found any workaround, look like its nova bug, it start copy disk and abort in been and at same time it delete disk from source compute.16:03
spatelI have lost bunch of machine and later found this is bug or something else going.. since then i stop doing block-migration (my workaround is to re-size instance and move to new compute node)16:04
spateljrosser: do you know why rsyslog client not getting install on any container which recently i am deploying?16:04
spateldid we create something in recent deployment?16:06
gillesMospatel: Rocky16:10
gillesMoAnd same with Queens just before16:10
spateli think that bug still continue...16:11
spatelI am deploying stein lets see if its there also16:12
gillesMoAt least, live migration works with shared storage here (Ceph), but for my few compute hosts with SSD, I need to stop instances if I need to reboot the host...16:13
gillesMoseems that this bug can be related : https://bugs.launchpad.net/nova/rocky/+bug/182900016:22
openstackLaunchpad bug 1829000 in OpenStack Compute (nova) queens "live migration (block-migrate) may failed if instance image is deleted in glance" [Medium,In progress] - Assigned to Lee Yarwood (lyarwood)16:22
spatelbut this is live migration related... in my openstack live-migration working fine..16:23
spatelonly block migration is borked16:23
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/stein: Prevent autoremoval of packages on bare metal  https://review.opendev.org/66475316:25
*** chandankumar is now known as raukadah16:34
*** rpittau is now known as rpittau|afk16:36
*** schwicht has quit IRC16:37
*** Emine has quit IRC16:39
*** goldyfruit has joined #openstack-ansible16:44
goldyfruitjrosser, o/16:45
jrosserhello!16:45
jrossergoldyfruit: this is what blew up https://review.opendev.org/#/c/668326/16:46
jrosserevery couple of weeks we increment our SHA of all the underlying openstack services, and for the last couple of attempts its failed on that 'openstack complete' command16:46
jrossersadly you can't see what went wrong from the CI log so i had to reproduce it in a VM16:47
*** udesale has quit IRC16:48
goldyfruitjrosser, outch!16:49
goldyfruitBut so far, Qinling is not part of openstack-ansible so maybe you don't really need this client16:50
jrosseryeah, i'd like to understand how that got into there16:50
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Add placement client for neutron.  https://review.opendev.org/66852616:52
spateljrosser: any thought of rsyslog client16:55
jrosserlogan-: do we need to do some of this https://review.opendev.org/#/q/topic:fix-credentials-scoping for the os_neutron role? I've just had to add a [placement] section and not sure if i'm doing it right16:55
spatelits not getting deploy on any container..16:55
jrosserspatel: i can take a look tomorrow - i have to travel now16:58
spatelno worry16:59
spateljust wanted to see if its on-going issue or something changed in new deployment16:59
*** gyee has joined #openstack-ansible17:01
*** ansmith has quit IRC17:01
*** schwicht has joined #openstack-ansible17:04
*** ansmith has joined #openstack-ansible17:04
*** electrofelix has quit IRC17:38
*** luksky has joined #openstack-ansible17:39
*** ivve has joined #openstack-ansible17:42
openstackgerritBjoern Teipel proposed openstack/openstack-ansible master: Revert ansible-playbook link to the unmodified binary  https://review.opendev.org/66818517:59
*** weifan has joined #openstack-ansible18:32
*** kaiokmo has joined #openstack-ansible18:38
*** weifan has quit IRC18:49
*** martinkennelly has quit IRC19:14
*** kplant has quit IRC19:17
*** schwicht has quit IRC19:18
jrossergoldyfruit: twe install all of the clients that are listed in upper-constraints https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/utility-install.yml#L89-L114, so that explains how the qinling client got there19:42
*** weifan has joined #openstack-ansible19:49
*** hamzy has quit IRC20:02
*** hamzy has joined #openstack-ansible20:07
jrosserreviews/merge here would be good https://review.opendev.org/#/c/665600/520:30
logan-jrosser: yes we probably do need that for neutron20:37
*** ansmith has quit IRC20:38
*** pcaruana has quit IRC20:41
openstackgerritLogan V proposed openstack/openstack-ansible-os_neutron master: Use neutron credentials when connecting to other APIs  https://review.opendev.org/66855920:49
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Automatically create and import keypair if it doesn't exist  https://review.opendev.org/60614320:49
openstackgerritMerged openstack/openstack-ansible master: Imported Translations from Zanata  https://review.opendev.org/66560020:50
*** hwoarang has quit IRC21:06
*** hwoarang has joined #openstack-ansible21:09
*** weifan has quit IRC21:15
*** weifan has joined #openstack-ansible21:17
*** weifan has quit IRC21:20
*** mhayden has quit IRC21:26
*** mhayden has joined #openstack-ansible21:26
*** weifan has joined #openstack-ansible21:33
*** kplant has joined #openstack-ansible21:34
*** BjoernT has quit IRC21:52
*** weifan has quit IRC21:58
*** weifan has joined #openstack-ansible22:05
*** weifan has quit IRC22:09
*** hamzy has quit IRC22:18
*** weifan has joined #openstack-ansible22:24
*** luksky has quit IRC22:47
*** hamzy has joined #openstack-ansible22:57
*** mrda has quit IRC22:58
*** spatel has quit IRC22:58
*** mrda has joined #openstack-ansible22:59
*** hwoarang has quit IRC23:00
*** hwoarang has joined #openstack-ansible23:01
*** tosky has quit IRC23:08
*** hwoarang has quit IRC23:14
*** hwoarang has joined #openstack-ansible23:17
*** weifan has quit IRC23:22
*** spatel has joined #openstack-ansible23:49
*** spatel has quit IRC23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!