Monday, 2020-02-03

*** tetsuro_ has quit IRC00:00
*** tetsuro has joined #openstack-nova00:01
*** damien_r has joined #openstack-nova00:09
*** damien_r has quit IRC00:12
*** alex_xu has joined #openstack-nova00:30
*** Liang__ has joined #openstack-nova01:00
*** damien_r has joined #openstack-nova01:14
*** damien_r has quit IRC01:14
*** damien_r has joined #openstack-nova01:14
*** Dinesh_Bhor has quit IRC01:28
*** Dinesh_Bhor has joined #openstack-nova01:34
*** vishalmanchanda has joined #openstack-nova01:57
*** tetsuro_ has joined #openstack-nova01:58
*** tetsuro has quit IRC02:01
*** brinzhang has joined #openstack-nova02:19
*** damien_r has quit IRC02:20
*** rcernin has joined #openstack-nova02:27
*** damien_r has joined #openstack-nova02:34
*** brinzhang has quit IRC02:48
*** brinzhang has joined #openstack-nova02:48
*** brinzhang has quit IRC02:51
*** brinzhang has joined #openstack-nova02:51
*** brinzhang_ has joined #openstack-nova02:55
*** brinzhang_ has quit IRC02:56
*** brinzhang has quit IRC02:58
*** brinzhang_ has joined #openstack-nova02:58
*** brinzhang_ has quit IRC03:00
*** brinzhang_ has joined #openstack-nova03:00
*** rcernin has quit IRC03:31
*** links has joined #openstack-nova03:48
*** mkrai has joined #openstack-nova03:55
*** tetsuro_ has quit IRC04:07
*** tetsuro has joined #openstack-nova04:08
*** psachin has joined #openstack-nova04:29
*** Liang__ has quit IRC04:53
*** damien_r has quit IRC05:06
*** yedongcan has joined #openstack-nova05:23
*** hongbin has joined #openstack-nova05:23
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-nova05:34
*** icarusfactor has joined #openstack-nova05:36
*** factor has quit IRC05:38
*** yedongcan has quit IRC05:40
*** yedongcan has joined #openstack-nova05:41
*** brinzhang has joined #openstack-nova05:48
*** brinzhang__ has joined #openstack-nova05:48
*** udesale has joined #openstack-nova05:49
*** brinzhang__ has quit IRC05:49
*** icarusfactor has quit IRC06:02
brinzhanggibi: can you restore these https://review.opendev.org/#/q/status:abandoned+project:openstack/nova+branch:master+topic:bp/action-event-fault-details, if not, I will complete this BP based on these, otherwise I will need to resubmit, but it is very similar.06:13
brinzhanggibi: s/if not/""/06:14
brinzhangalex_xu: and you also can restore these.06:15
brinzhanggibi, alex_xu: thanks.06:15
*** hongbin has quit IRC06:16
*** ratailor has joined #openstack-nova06:17
*** brinzhang has quit IRC06:24
*** brinzhang has joined #openstack-nova06:31
*** HagunKim has quit IRC06:32
*** tetsuro_ has joined #openstack-nova06:35
*** brinzhang has quit IRC06:36
*** brinzhang has joined #openstack-nova06:36
*** tetsuro has quit IRC06:39
*** brinzhang has quit IRC06:39
*** brinzhang has joined #openstack-nova06:39
*** brinzhang has quit IRC06:43
*** brinzhang has joined #openstack-nova06:45
*** brinzhang has quit IRC06:46
*** Luzi has joined #openstack-nova06:48
*** brinzhang has joined #openstack-nova06:51
*** brinzhang_ has joined #openstack-nova06:53
*** brinzhang_ has quit IRC06:53
*** brinzhang_ has joined #openstack-nova06:54
*** brinzhang_ has joined #openstack-nova06:55
*** brinzhang has quit IRC06:56
*** brinzhang_ has quit IRC06:56
*** brinzhang_ has joined #openstack-nova06:57
*** brinzhang_ has joined #openstack-nova06:59
*** brinzhang_ has quit IRC06:59
*** lpetrut has joined #openstack-nova07:09
*** dpawlik has joined #openstack-nova07:12
*** dpawlik has quit IRC07:13
*** dpawlik has joined #openstack-nova07:14
*** tetsuro_ has quit IRC07:14
*** tetsuro has joined #openstack-nova07:14
*** Liang__ has joined #openstack-nova07:16
*** dtantsur|afk is now known as dtantsur07:20
*** ircuser-1 has quit IRC07:32
*** tkajinam has quit IRC07:36
*** tkajinam has joined #openstack-nova07:38
*** slaweq has joined #openstack-nova07:38
*** pcaruana has joined #openstack-nova07:43
*** iurygregory has joined #openstack-nova07:51
*** damien_r has joined #openstack-nova07:54
*** yedongcan has quit IRC07:57
*** yedongcan has joined #openstack-nova07:59
*** ralonsoh has joined #openstack-nova07:59
*** maciejjozefczyk has joined #openstack-nova07:59
*** tkajinam_ has joined #openstack-nova08:01
*** tkajinam has quit IRC08:04
*** rpittau|afk is now known as rpittau08:05
*** luksky has joined #openstack-nova08:09
*** tesseract has joined #openstack-nova08:14
*** maciejjozefczyk_ has joined #openstack-nova08:14
*** maciejjozefczyk has quit IRC08:17
*** yedongcan has quit IRC08:21
*** yedongcan has joined #openstack-nova08:23
*** tetsuro has quit IRC08:27
*** tosky has joined #openstack-nova08:29
*** maciejjozefczyk_ has quit IRC08:37
*** tkajinam_ has quit IRC08:38
*** ociuhandu has joined #openstack-nova08:46
*** tetsuro has joined #openstack-nova08:48
*** ociuhandu has quit IRC08:50
*** ociuhandu has joined #openstack-nova09:02
*** ociuhandu has quit IRC09:07
*** maciejjozefczyk_ has joined #openstack-nova09:14
*** brinzhang_ has joined #openstack-nova09:18
*** brinzhang_ has quit IRC09:20
*** brinzhang_ has joined #openstack-nova09:20
*** tetsuro has quit IRC09:21
*** brinzhang__ has joined #openstack-nova09:30
*** xek has joined #openstack-nova09:30
openstackgerritSundar Nadathur proposed openstack/nova master: ksa auth conf and client for Cyborg access  https://review.opendev.org/63124209:31
openstackgerritSundar Nadathur proposed openstack/nova master: Add Cyborg device profile groups to request spec.  https://review.opendev.org/63124309:31
openstackgerritSundar Nadathur proposed openstack/nova master: Define Cyborg ARQ binding notification event.  https://review.opendev.org/69270709:31
openstackgerritSundar Nadathur proposed openstack/nova master: Create and bind Cyborg ARQs.  https://review.opendev.org/63124409:31
openstackgerritSundar Nadathur proposed openstack/nova master: Pass accelerator requests to each virt driver from compute manager.  https://review.opendev.org/69858109:31
openstackgerritSundar Nadathur proposed openstack/nova master: Compose accelerator PCI devices into domain XML in libvirt driver.  https://review.opendev.org/63124509:31
openstackgerritSundar Nadathur proposed openstack/nova master: Delete ARQs for an instance when the instance is deleted.  https://review.opendev.org/67373509:31
openstackgerritSundar Nadathur proposed openstack/nova master: Enable hard/soft reboot with accelerators.  https://review.opendev.org/69794009:31
openstackgerritSundar Nadathur proposed openstack/nova master: Enable start/stop of instances with accelerators.  https://review.opendev.org/69955309:31
openstackgerritSundar Nadathur proposed openstack/nova master: Enable and use COMPUTE_ACCELERATORS trait.  https://review.opendev.org/69955409:31
openstackgerritSundar Nadathur proposed openstack/nova master: Bump compute rpcapi version and reduce Cyborg calls.  https://review.opendev.org/70422709:31
openstackgerritSundar Nadathur proposed openstack/nova master: Add cyborg tempest job.  https://review.opendev.org/67099909:31
*** brinzhang_ has quit IRC09:33
*** derekh has joined #openstack-nova09:39
*** maciejjozefczyk_ has quit IRC09:42
*** maciejjozefczyk has joined #openstack-nova09:43
*** yedongcan has quit IRC09:51
openstackgerritSundar Nadathur proposed openstack/nova master: Enable and use COMPUTE_ACCELERATORS trait.  https://review.opendev.org/69955409:52
openstackgerritSundar Nadathur proposed openstack/nova master: Bump compute rpcapi version and reduce Cyborg calls.  https://review.opendev.org/70422709:52
openstackgerritSundar Nadathur proposed openstack/nova master: Add cyborg tempest job.  https://review.opendev.org/67099909:52
*** yedongcan has joined #openstack-nova09:52
*** jaosorior has joined #openstack-nova10:01
*** davidsha has joined #openstack-nova10:08
*** brinzhang__ has quit IRC10:14
*** ociuhandu has joined #openstack-nova10:18
*** yedongcan has quit IRC10:21
*** ociuhandu has quit IRC10:23
*** ociuhandu has joined #openstack-nova10:47
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove extra instance.save() calls related to qos SRIOV ports  https://review.opendev.org/70226110:49
openstackgerritBalazs Gibizer proposed openstack/nova master: Use common server create function for qos func tests  https://review.opendev.org/70135310:50
openstackgerritBalazs Gibizer proposed openstack/nova master: Enable live migration with qos ports  https://review.opendev.org/69906610:52
openstackgerritBalazs Gibizer proposed openstack/nova master: Support unshelve with qos ports  https://review.opendev.org/70475910:55
*** martinkennelly has joined #openstack-nova10:58
*** links has quit IRC11:18
*** Liang__ has quit IRC11:20
*** tkajinam has joined #openstack-nova11:28
openstackgerritBalazs Gibizer proposed openstack/nova master: Reduce gen conflict in COMPUTE_STATUS_DISABLED handling  https://review.opendev.org/70486611:28
*** rpittau is now known as rpittau|bbl11:42
*** ociuhandu has quit IRC11:44
*** ociuhandu has joined #openstack-nova11:45
*** ociuhandu has quit IRC11:48
*** ociuhandu has joined #openstack-nova11:48
*** ociuhandu has quit IRC11:51
*** luksky has quit IRC11:52
*** shilpasd has joined #openstack-nova12:04
*** ociuhandu has joined #openstack-nova12:09
*** vishalmanchanda has quit IRC12:12
*** ociuhandu has quit IRC12:15
*** ociuhandu has joined #openstack-nova12:16
*** luksky has joined #openstack-nova12:17
*** shilpasd has quit IRC12:30
*** damien_r has quit IRC12:35
openstackgerritBalazs Gibizer proposed openstack/nova master: Support unshelve with qos ports  https://review.opendev.org/70475912:36
*** ociuhandu has quit IRC12:54
*** ociuhandu has joined #openstack-nova12:54
*** udesale_ has joined #openstack-nova12:55
*** shilpasd has joined #openstack-nova12:56
*** udesale has quit IRC12:57
*** ratailor has quit IRC12:57
*** ratailor has joined #openstack-nova12:58
*** ociuhandu has quit IRC13:00
openstackgerritHuachang Wang proposed openstack/nova master: metadata: export the vCPU IDs that are pinning on the host CPUs  https://review.opendev.org/68893613:01
openstackgerritHuachang Wang proposed openstack/nova master: Create 'mixed' instance from PCPU and VCPU resources  https://review.opendev.org/70543713:01
openstackgerritHuachang Wang proposed openstack/nova master: [WIP] Create 'mixed' instance from PCPU and VCPU resources  https://review.opendev.org/70543713:05
openstackgerritHuachang Wang proposed openstack/nova master: [WIP] metadata: export the vCPU IDs that are pinning on the host CPUs  https://review.opendev.org/68893613:05
*** damien_r has joined #openstack-nova13:13
*** psachin has quit IRC13:16
*** ratailor has quit IRC13:21
*** derekh has quit IRC13:24
*** tbachman has joined #openstack-nova13:26
*** rpittau|bbl is now known as rpittau13:34
*** vishalmanchanda has joined #openstack-nova13:43
*** tbachman has quit IRC13:50
*** jmlowe has joined #openstack-nova13:57
*** rlljorge has joined #openstack-nova14:00
rlljorgeHi folks, some chance some one look for : https://bugs.launchpad.net/nova/+bug/186073914:02
openstackLaunchpad bug 1860739 in OpenStack Compute (nova) "Cinder backup failed for restore volume snapshot (for instance snapshot)" [Undecided,Confirmed]14:02
*** jmlowe has quit IRC14:03
stephenfinbauzas: Think you could keep marching through this today? https://review.opendev.org/#/c/697155/14:07
bauzasstephenfin: lemme try14:07
stephenfinta. lmk if you've any questions14:07
sean-k-mooneystephenfin: do you need me to take a look at that seriese too or will i leave it to bauzas et al14:08
sean-k-mooneythats the nova net begone series right14:09
bauzassean-k-mooney: you can surely review them if you want14:09
bauzasI'm not really a nova-net expert so having more eyes is better14:09
stephenfinI will never turn down reviewers14:09
bauzasany review is helpful FWIW14:10
*** jmlowe has joined #openstack-nova14:10
sean-k-mooneywell basically im just going to double check the commit message and the code make sense and you are not breaking the neutorn path14:10
bauzaseven if I (sometimes/always/somehow/pick the one you prefer) disagree with the review and associated comments14:10
sean-k-mooneystephenfin: by the way once this is complete i want to do a pass over os-vif to delete the nova-net only bits14:11
sean-k-mooneywe have a few object fields that i think are only there for nova-net so i want to deprecate them and then likely remove them early in V although we could maybe do it in u. time will tell.14:13
sean-k-mooneythings like this https://github.com/openstack/os-vif/blob/master/os_vif/objects/network.py#L3314:14
sean-k-mooneythe multi_host flag is for nova networks and i dont think we ever use it in os-vif14:14
sean-k-mooneyok we technically do but only in the linux bridge driver and even so only with nova-networks https://github.com/openstack/os-vif/blob/1e4cf6160efc7fb4fd8279bd2a666e4d72f4fb6c/vif_plug_linux_bridge/linux_bridge.py#L10114:15
*** tkajinam has quit IRC14:16
*** derekh has joined #openstack-nova14:17
sean-k-mooneydansmith: by the way is your ephemeral object class merged in ovo yet?14:17
sean-k-mooneyi would like to use it to clean up this crap https://github.com/openstack/os-vif/blob/master/os_vif/objects/network.py#L41-L47 but i might just copy the base class for now like we did in nova if it is not merged14:18
francoisphello lyarwood, stephenfin, doing code rework for https://review.opendev.org/#/c/669674/ and I have a question for you:14:21
francoispstephenfin you put in a comment at nova/conf/compute.py, line 871:14:21
francoisp"If something is failing to complete after 5 loops, surely that's an issue that bumping the value will only mask?"14:21
francoispI understand we want do do away with the config option, and stick with a hard-coded value for max number of re-tries.14:21
francoispare you suggesting we use a lower value (ex.: max 3 retries) ?14:21
*** Luzi has quit IRC14:22
stephenfinno, I'm only questioning the need to make this configurable rather than hard code it14:22
stephenfin5 is fine. I'm don't think we'd want to go bigger than that though14:22
stephenfinfrancoisp: ^14:22
efriedsean-k-mooney: https://review.opendev.org/#/c/702049/14:23
sean-k-mooneyefried: cool thanks that is the one i was looking for14:23
sean-k-mooneyefried: so ya ill just bump the min version and use that14:23
sean-k-mooneyill wait till after m2 however to do that14:23
efriedThat's in nova, no bump14:23
sean-k-mooneyoh sorry i taught that was the ovo one14:24
sean-k-mooneyos-vif does not import form nova so i either need to copy that or wait for it to merge in ovo14:24
sean-k-mooneythis is the ovo review https://review.opendev.org/#/c/701795/14:24
efriedoh, yeah, the ovo one hasn't merged yet https://review.opendev.org/#/c/701795/14:24
efriedyeah14:25
sean-k-mooneylooks like dansmith's -w was to wait for concensus on the nova review but since we have merged it i think we are good provided this version matches the nova one14:26
dansmithsean-k-mooney: I was waiting for us to land it in nova and be happy with that definition14:27
sean-k-mooneyefried: ill proably submit a relase patch for os-vif on friday ahead of m2 next week and ill add you once its up14:27
dansmithI haven't circled back since I got back from being out, and I thought you were going to think of better names... :)14:28
sean-k-mooneywe could. i know i suggested that but i havent really found one that is better14:28
sean-k-mooneyill likely just submit the patches to os-vif to use it and leave the bottom one with -w until your happy with it then14:30
*** ignaziocassano1 has joined #openstack-nova14:33
gibidansmith: hi! updated and responded in https://review.opendev.org/#/c/702261/14:33
ignaziocassano1Hello All, anyone could help me on openstack queens cinder with unity iscsi driver ? Often when a vm is migrated or a volume is detached , nova compute log resports errors with the command multipath -f comman (map in use)14:33
sean-k-mooneythat ^ sound vaguly familar but maybe lyarwood would know if that is a know issue that is maybe fixed14:35
dansmithgibi: ack, will look post-caffeination14:36
gibidansmith: thanks14:36
lyarwoodsean-k-mooney: I think that came up on the ML recently and I asked for logs14:37
efriedsean-k-mooney: Am I to understand that blockdiag accepted your fix?14:37
lyarwoodignaziocassano1: can you write that up in a bug with logs?14:37
sean-k-mooneyefried: they merged a similar one that does the same thing but also updates the change log14:37
*** mdbooth has joined #openstack-nova14:37
sean-k-mooneyso basically yes14:37
efriedsean-k-mooney: okay, cool, so we should blacklist 2.0.0 in u-c and accept, what, 2.0.1 once they cut it?14:38
sean-k-mooneyya basically14:38
sean-k-mooneywe can blacklist it now if we want too but i dont know what the eta is on the 2.0.1 release is14:38
efriedWell, we know 2.0.0 is busted, but it also doesn't seem to be affecting anyone but us, so...14:39
sean-k-mooneyoh its already done14:39
sean-k-mooneyhttps://github.com/blockdiag/blockdiag/compare/2.0.0...2.0.114:40
ignaziocassano1lyqrwood: I am using centos 7.....how can open a bug ? Which site must I use ?14:40
*** eharney has joined #openstack-nova14:41
sean-k-mooneyefried: want me to submit the patch to the requiremetns repo14:41
lyarwoodignaziocassano1: https://bugs.launchpad.net/os-brick/+filebug - if you could include DEBUG logs showing the volume attachment and attempt to detach that would be super useful14:42
ignaziocassano1thanks14:42
*** nweinber has joined #openstack-nova14:42
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove unused nova-network objects  https://review.opendev.org/69715614:44
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove unused parameters  https://review.opendev.org/70397414:44
efriedsean-k-mooney: sure14:45
sean-k-mooneyok ill do it shortly once i finish my current review14:45
sean-k-mooneyefried: did we already merge stephens fix14:47
efriedyes14:47
efriedsean-k-mooney: https://review.opendev.org/#/c/705263/14:47
sean-k-mooneycool im just going to blacklist it in gr we could raise the min version in nova if we want to removed the monkey patching seperatly14:48
sean-k-mooneyim not going to raise the lower constratin in the requirements repo.14:48
ignaziocassano1lyarwood: I opened a bug. Did you know if I will receive email when someone will work on it ?14:50
lyarwoodignaziocassano1: can you share the bug URL here?14:50
*** dtantsur is now known as dtantsur|brb14:50
ignaziocassano1https://bugs.launchpad.net/os-brick/+bug/186169114:50
openstackLaunchpad bug 1861691 in os-brick "openstack queens emc iscsi errors migrating volume and or detaching volumes" [Undecided,New]14:50
ignaziocassano1I attached the nova-compute log14:51
ignaziocassano1mmm I must change the description14:51
ignaziocassano1It happens when I migrate a vm or detach a volume14:52
lyarwoodignaziocassano1: do you have any logs showing the volume being attached?14:53
ignaziocassano1I included the nova-compute log ...the problem occurs non kvm node. I also have the volume log. Dow you want I attach it ?14:54
*** tbachman has joined #openstack-nova14:54
*** brinzhang has joined #openstack-nova14:54
*** brinzhang has quit IRC14:55
ignaziocassano1When I migrate a vm , os-brick try to use the command "multipath -f xxxxxxxx" to flusj the device. As reported in nova compute log, it finds "map in use"14:57
sean-k-mooneyefried: oh its already blacklisted14:58
efriedcool14:58
sean-k-mooneyim not sure we want the upper constratis file to cap it at 2.0.1 however14:58
ignaziocassano1So, often the vm migrates but remains in error state and horizon shows the vm on old node14:59
lyarwoodignaziocassano1: this channel isn't really for support but yeah `map in use` errors suggest the multipath device is being used by multiple instances, normally due to c-vol or os-brick bugs15:00
lyarwoodignaziocassano1: make sure both nova, os-brick and cinder are fully updated15:01
ignaziocassano1lyarwood: they are fully updated with last queens released on centos15:01
dansmithefried: I know you have other stuff going on which is probably delaying your ability to run through the cyborg patches. If you could at least hit the profile groups thing, that would be helpful: https://review.opendev.org/#/c/63124315:02
efriedsean-k-mooney: certainly not until that's releaced15:02
efrieddansmith: ack15:02
dansmithefried: knowing that latest version of that matches your expectation and what should be done is important15:02
dansmiththanks15:02
dansmithsean-k-mooney: last I heard you had deployed the cyborg set in devstack and had identified some real issue, but I don't know what that was, and it's been a while.. have you done it recently?15:03
sean-k-mooneyefried: it is alredy on pypi also its weired i have blockdiag in my local requiremetns but i dont see it on master. ill talk to the release folks and make sure we are good15:03
*** Sundar has joined #openstack-nova15:03
sean-k-mooneydansmith: no but i can do it again tomorrow15:03
ignaziocassano1lyarwood: I am sure the device is not used by multiple instances. I tried substituing the command "multipath -f" with "mutipath -r" in /usr/lib/python2.7/site-packages/os_brick/initiator/linuxscsi.py and it works . But flush and reload are different operations :-(15:04
sean-k-mooneydansmith: the issue was the patches needed to be rebased for root required and cyboge had a python 3 issue15:04
dansmithsean-k-mooney: ah okay, good to know, thanks15:04
sean-k-mooneydansmith: sundar has rebased the cybog patch chain so it should work15:04
dansmithgotcha, I remember now15:04
*** artom has joined #openstack-nova15:04
openstackgerritStephen Finucane proposed openstack/nova master: objects: Remove custom comparison methods  https://review.opendev.org/47228515:04
*** mriedem has joined #openstack-nova15:05
sean-k-mooneyill kick off devstack stacking in the backgound and if it stack ill let you know what i find.15:05
dansmiththanks15:05
ignaziocassano1lyarwood: keep in minf all volumes I attach have lvm inside them. Is it possible lvm on kvm node lock them ?15:06
Sundarsean-k-mooney: Yes. I have also updated the Nova patch series, with all expected functionality, including the RPCAPI version bump to pass ARQ UUIDs from the conductor to manager.15:06
sean-k-mooneydansmith: you have ipv6 connectivity right? when its stacked i can proably just add your public key to the vm if you want to take alook later15:06
dansmithI do15:07
sean-k-mooneySundar: cool15:07
*** jmlowe has quit IRC15:07
*** jdillaman has joined #openstack-nova15:07
*** ociuhandu has joined #openstack-nova15:07
sean-k-mooneycool i can always port forward but i have my router handing out public ipv6 adress to my openstack vms by default so if i tweek the security group rule it shoudl work15:09
lyarwoodignaziocassano1: if you're host is also using LVM and has a default filter then yes it could be picking them all up15:13
lyarwoodyour*15:14
ignaziocassano1lyarwood: I added the filter filter = [ "a|^/dev/sda|", "r|.*|" ] because I use lvm on kvm node only on /dev/sda but it does not resolve15:16
ignaziocassano1lyarwood: has the above filter a correct syntax ?15:17
*** lpetrut has quit IRC15:18
*** jmlowe has joined #openstack-nova15:18
*** jmlowe has quit IRC15:19
lyarwoodignaziocassano1: sorry I don't have the bandwidth to debug this with you at the moment15:21
ignaziocassano1lyarwood: I wrote all information on the bug I opened. I hope someone can help.15:22
*** eharney has quit IRC15:25
*** mloza has joined #openstack-nova15:25
*** ignaziocassano1 has quit IRC15:27
*** eharney has joined #openstack-nova15:33
sean-k-mooneydansmith: Sundar efried just as an fyi this is the local.conf im using to deploy the cyborg env. the only thing you need to do manually is install the correct version of the cyborg client15:34
sean-k-mooneyhttp://paste.openstack.org/show/789067/15:34
artomstephenfin, reply about the 3/2 split here: https://review.opendev.org/#/c/672595/6415:34
artomLet's get this sorted so we can both move on ;)15:34
dansmithsean-k-mooney: why is that? shouldn't it come in via reqs?15:35
sean-k-mooneythe cyborg plugin does not install it15:36
sean-k-mooneydevstack plugin that is15:36
sean-k-mooneyits not needed for nova its just for osc15:36
sean-k-mooneyso i dont have to use curl15:36
dansmithoh you mean you have to install the cyborg osc plugin?15:37
sean-k-mooneyya15:37
dansmithokay gotcha15:37
*** mmidolesov has joined #openstack-nova15:37
stephenfinartom: Could just do a negative test?15:37
stephenfinactually, nvm15:37
sean-k-mooneythats why im also checking out  the openstack sdk from a review branch15:37
*** shilpasd has quit IRC15:37
sean-k-mooneythat isnt neededed by nova15:37
sean-k-mooneyits just for osc15:38
stephenfinartom: I'm dumb and don't see the problem you're pointing out with that comment. Can you restate it for me? :)15:38
artomstephenfin, image the ascii diagram on the first "line", but with VM1 on N215:38
mmidolesovDoes anayone know why functional-py36 returns TIMED_OUT in nova when rechecking patch? This happens for quite some time now.15:38
artomIf we then live migrate it, and we end up with the ascii diagram on the second "line", we have no way of knowing whether that's because NUMA live migration worked and updated the XML, or just because that's the old behaviour anyways15:39
sean-k-mooneymmidolesov: in the gate?15:39
sean-k-mooneyi have not seen that on any patches i have reviewd lately15:39
stephenfinOh, so you're saying if it ended up landing on node 2, we wouldn't really be testing anything? Fair point. Could you just force the instances onto separate hosts though?15:40
stephenfinUsing the 'host' parameter from...2.53?15:40
sean-k-mooneymmidolesov: if you are seing it on patche you pushed it might mean the mocking is not done correctly15:40
sean-k-mooneystephenfin: the anti affintiy filer might be better15:41
stephenfinsean-k-mooney: any reason?15:41
sean-k-mooneyim not sure tempest suppofrt the host parmater currently15:41
artomstephenfin, we can force on separate hosts, but... can we force on specific NUMA nodes? Or, can we count that they'll be assigned to instances deterministically?15:41
sean-k-mooneyand we dont know what the host would be called generically15:41
sean-k-mooneyartom: no we cant force to a specif numa node15:41
artomstephenfin, IOW, I want a situation where we *know for sure* that without the NUMA live migration feature, we'd have ended up with overlapping instances on the destination15:42
sean-k-mooneywe should not rely on the ordering15:42
sean-k-mooneyit tecnically is determisitic but only if we run serially15:42
artomSo 1. is that a fair thing to want? 2. can we achieve it with a less artificial NUMA topology15:42
sean-k-mooneyso we shoudl froce it with the pinsets15:43
sean-k-mooneyartom: no we do not want to exposee the ability to select a host numa node15:43
stephenfinsean-k-mooney: we can't do different pinsets on different hosts15:43
sean-k-mooneytelcos want that but that is too invaisive to be a thing in the flavor15:43
artomsean-k-mooney, except we can't have different pinsets per "host" in func tests15:43
stephenfinnot easily15:43
sean-k-mooneystephenfin: in tempest we can are you talking about func tests?15:44
*** ociuhandu has quit IRC15:44
sean-k-mooneyi was assuming whitebox15:44
stephenfinnah, artom's giant live migration functional test15:44
dansmithSundar: this can be abandoned, right? it still looks as if it's in the stack, despite being very outdated: https://review.opendev.org/#/c/673939/115:44
Sundarsean-k-mooney: The local.conf seems fine to me. You are pulling in one more patch than what you need.15:45
Sundardansmith: Yes15:45
sean-k-mooneySundar: the uuid one15:45
sean-k-mooneyya i know that log was annoying me15:45
Sundardansmith: I'll ping the developer15:45
dansmithSundar: I can do it15:45
*** ociuhandu has joined #openstack-nova15:45
Sundarsean-k-mooney: The more egregious one about the bad UUID is already fixed: https://review.opendev.org/#/c/702785/15:46
Sundardansmith: OK, thanks15:46
dansmithSundar: what about the two WIP ones underneath?15:46
dansmithI think those are all effectively orphaned15:46
stephenfinartom: create three instances15:47
Sundardansmith: Yes. The to-be-abandoned patch is based on very old versions of my patches.15:47
dansmithSundar: ack, will get those too15:47
dansmithoh nm, I see,15:48
dansmiththose are when the current patches were marked as WIP, nevermind15:48
artomstephenfin, go on...15:48
SundarBut only 73939 nees to be abandoned15:48
stephenfinartom: if you've two nodes on N1 and one on N2, move one of the former15:48
Sundardansmith: Others are part of the Nova patch series15:48
stephenfin*two instances on N115:48
Sundardansmith: I meant 67393915:49
stephenfinand if you've one instance on N1 and two on N2, move one of the latter15:49
dansmithSundar: I abandoned two and it looks cleaner nwo15:49
artomstephenfin, that... seems like it's equally complex :/15:49
stephenfinguaranteed XML regeneration15:49
artomAs in, we need to figure out the instance on the host with 2 of them that's pinned to the "equivalent" NUMA node as the other instance on the host with 1 instance15:49
Sundardansmith: https://review.opendev.org/#/c/631244/26 is part of the current patch series15:50
dansmithSundar: yes I see now, which is why I said this: [07:48:13]  <dansmith>those are when the current patches were marked as WIP, nevermind15:50
artomstephenfin, my "counter-offer" would be keep things as is, but with a nice ASCII diagram explaining the thing15:51
*** ociuhandu has quit IRC15:52
dansmithefried: Sundar sean-k-mooney: I have a couple comments high up on the stack, but nothing critical.. I want to get another ack from sean-k-mooney's local testing, efried to look at the resources patch and then I think I'm good removing the -2 on the base patch15:52
dansmithefried: alternately if you want to trade me the -2 responsibility on the base I can hold that torch15:53
efrieddansmith: let's do that, yah15:53
stephenfinartom: I'm reluctant to do that because I'm supposed to know this stuff yet it takes me ages to re-parse this patch each time I review it :(15:53
stephenfinso that doesn't bode well for long-term maintainability of same15:54
artomstephenfin, I think any way you cut it it'll be complex :(15:54
sean-k-mooneyat somepoint having the ability to pass different config to different services/computes in the functional test would be useful. we often want to do it but never do because its complex to do15:57
artomsean-k-mooney, CONF is global - I didn't find a way to make it work15:57
artomstephenfin, ah, though of a thing:15:58
sean-k-mooneyit is but i think we could mock it differently per service i just have not trided doing that15:58
artom2 hosts, 2 NUMA nodes each, N1: CPUs 0, 1, N2: CPUs 3, 415:59
artomStart with vcpu_dedicated_set = 0, 1 on both hosts, boot 2 instances15:59
artomThey're now both on CPUs 0, 115:59
artomOn different hosts15:59
*** eharney has quit IRC15:59
artomChange vcpu_dedicated_set to 0-4 on both hosts15:59
artomLive migrate an instance15:59
efriedcdent did some work to make conf not global in placement (incl tests). Could follow that lead.15:59
sean-k-mooneyefried: ya i think he started passing the config to where its needed right?16:00
sean-k-mooneyi was thinking we might be able to have different code paths have different mocks and avoid that16:01
stephenfinthat could work. My only concern is that those config options are used for reporting the HostState object to the scheduler, so you'd have to restart all services I think16:01
*** gyee has joined #openstack-nova16:04
*** dtantsur|brb is now known as dtantsur16:05
openstackgerritStephen Finucane proposed openstack/nova master: Handle unset 'connection_info'  https://review.opendev.org/68699716:06
stephenfinefried: Added the requested test for that oldish patch ^16:06
stephenfinartom: wait, we don't need to figure out what NUMA node is which. Force two instance to one host, the remainder to another, then live migrate/revert both of those first two instances?16:08
stephenfinthey should both end up on the same NUMA node when live migrated16:08
sean-k-mooneystephenfin: that is what the intel nfv ci used to do16:09
sean-k-mooneywe booted 3 vms16:09
sean-k-mooney2 using anti affinity filter and then one more that we then live migrated16:09
sean-k-mooneyat least i think that is what we did16:09
sean-k-mooneyso that would work16:09
artomstephenfin, ohhh, by live migrating 2 instances, we force that "overlap"16:10
*** nicolasbock has joined #openstack-nova16:10
sean-k-mooneyyou dont need to migrate 216:10
artomWell...16:10
artomNot quite16:10
stephenfin'zactly. That seems super obvious16:10
sean-k-mooneyby booting 2 vms one on each if we rely on the ordering we know they will use teh cam cpus16:11
openstackgerritBalazs Gibizer proposed openstack/nova master: Support unshelve with qos ports  https://review.opendev.org/70475916:11
artomstephenfin, heh, so to be honest, it's *not* obvious to me, but OK16:11
artomLike, I need to think about that more than my 3/2 split :)16:11
sean-k-mooneyactully ya we just need 2 vms16:11
stephenfinsean-k-mooney and I need to think about it less16:12
stephenfin2/1 split16:12
stephenfin:P16:12
sean-k-mooneyif we are ok with relying on the ordering and call it out in the test with a doc comment16:12
gibistephenfin: you were +2 and and needed dansmith's oppinion on https://review.opendev.org/#/c/702261 now dansmith is +2 on that patch. Could you re-review at some point?16:12
openstackgerritBalazs Gibizer proposed openstack/nova master: Enable unshelve with qos ports  https://review.opendev.org/70547516:13
stephenfinsure, I'll grab it after this meeting16:13
sean-k-mooneythen just boot two vms with the host option to ensure they are booted on different hosts16:13
sean-k-mooneyand then live migate16:13
stephenfinsean-k-mooney: so rely on the fact they'll land on NUMA node #0?16:13
artomsean-k-mooney, and hope they both land on the "same" NUMA node on each host?16:13
sean-k-mooneywe use functools.permuations to iterate over the compute nodes in the same order16:13
sean-k-mooneyartom: the current libvirt code will16:14
artomI suppose we could fail the test if we detect one of the instances went to NUMA node 116:14
sean-k-mooneybut its an implemenation detial16:14
sean-k-mooneyif we ever break that the fucntest will fail16:14
sean-k-mooneybut its valid for the current code16:14
stephenfinI though we made a point of not making that contract, but that would work for me to keep this moving16:14
stephenfinjust stick the note in that we're making assumptions16:14
sean-k-mooneyoh actuly that wil break potentally with placment in the future16:14
stephenfinwe can rework the test then16:15
sean-k-mooneyyep16:15
artomAnd re-visit this conversation?16:15
artomUgh16:15
stephenfinartom: But we'll all be rich and living in Barbados or somewhere by then16:15
sean-k-mooneyartom: without the ablity to pass differnt configs i think that is the simplest thing we can do at the momemt16:15
stephenfinso what does it matter16:15
artomstephenfin, *glare*16:16
sean-k-mooney:)16:16
*** mkrai has quit IRC16:17
*** mlavalle has joined #openstack-nova16:18
*** mmidolesov has quit IRC16:22
*** ociuhandu has joined #openstack-nova16:23
*** eharney has joined #openstack-nova16:23
*** luksky has quit IRC16:32
*** udesale_ has quit IRC16:32
*** rpittau is now known as rpittau|afk16:33
*** ociuhandu has quit IRC16:34
openstackgerritMykola Yakovliev proposed openstack/nova master: Fix boot_roles in InstanceSystemMetadata  https://review.opendev.org/69804016:40
*** vishalmanchanda has quit IRC16:42
*** ociuhandu has joined #openstack-nova16:55
*** TxGirlGeek has joined #openstack-nova16:59
*** spatel has joined #openstack-nova17:06
artomsean-k-mooney, stephenfin, I *really* don't like relying on both VMs landing on NUMA node #0, because you made the very good point that it could change with placement17:09
artomAnd I *don't* think pushing this conversation down the line is fair17:09
artomSo I'll got with my "change vcpu_dedicated_set" for both computes idea17:09
*** ociuhandu has quit IRC17:09
* bauzas didn't paid attention to the chan and regrets17:10
*** ociuhandu has joined #openstack-nova17:10
bauzassean-k-mooney: efried: trying to decode() https://review.opendev.org/#/c/552924/17:10
bauzasin particular what's written on https://etherpad.openstack.org/p/mem_page_size_and_placement17:10
efriedbauzas: Sure, ask away.17:11
sean-k-mooneyill be back in two seconds just getting water17:11
bauzasefried: so, the current proposal was nacked because of two things :17:11
efriedTL;DR: Memory in "grandchild" providers according to page size.17:11
bauzas1/ the memory split case17:12
*** spatel has quit IRC17:12
bauzas2/ the group_policy=isolate issue17:12
bauzasfor 1/, IIUC the alternative that seems to have consensus is to have a grand-child RP17:12
efriedIf you see it that crisply, cool. For me it was more a nebulous mess of "lots of things are hard to do"17:12
efriedYes17:13
bauzasI need to process this information but that seems reasonable to me17:13
bauzasbut for 2/, I don't see any counter-proposal17:13
efriedFor 2/, the grandchild concept makes group_policy *moot*17:13
efriedmeaning we can ignore it and let the other parts of the code (e.g. bandwidth stuff) set it as needed.17:13
bauzasah cool, I missed the whole point17:13
sean-k-mooneybauzas: becasue of how it modeled in the tree with same_tree we dont care what group_policy is set to17:14
bauzasok, I'll sharp my pen and write a new rev17:14
efriedbtw, this was one of the things we noticed when we were working on the 'nested magic' design for placement.17:14
sean-k-mooneyin the 3 level proposal17:14
efried...that group_policy no longer really makes sense.17:14
bauzasthat's a very good alternative then, thanks both of you for the better proposal17:14
* bauzas opens a new Atom tab and checkout the corresponding git branch17:15
*** ociuhandu has quit IRC17:15
*** ociuhandu has joined #openstack-nova17:17
*** eharney has quit IRC17:19
*** ociuhandu has quit IRC17:20
*** ociuhandu has joined #openstack-nova17:21
sean-k-mooneyefried: one minor point. so we have same_subtree=!NUMA_1,NUMA_217:24
*** davidsha has quit IRC17:24
sean-k-mooneyright17:24
sean-k-mooneywe technically should be doing that for each of the multi numa ones if we want to skip that in the numa filter17:24
efriedI don't believe so, no.17:24
sean-k-mooneyok then without group_policy=isolate we are not guarenteed that we get the correct behavior17:25
sean-k-mooneythat said the numa toplogy filter could do the check17:26
efriedsean-k-mooney: See https://docs.openstack.org/placement/train/specs/train/implemented/2005575-nested-magic-1.html#default-group-policy-to-none17:26
sean-k-mooneyso i dont see it as a blocker17:26
efriedThough that asserts that we did default it. We didn't.17:27
efriedanyway, yeah, I think you're right.17:28
efriedAnd the bw code defaults it to 'none' https://docs.openstack.org/releasenotes/nova/train.html#other-notes17:28
sean-k-mooneyyes17:28
efriedgibi: I can't remember what the motivation was for that ^17:28
efriedwhether there was a strong reason for it to be 'none', or if it was more or less a coin toss just so we didn't bounce the placement request.17:28
sean-k-mooneyso with out support for not same_subtree we cant fully express the constratis without group_policy=isolate17:29
efriedBecause this (numa stuff) gives a decent motivation to "default" (conceivably even enforce) isolate.17:29
sean-k-mooneyefried: none is the correct default17:29
sean-k-mooneyefried: if we default to isolate you cant have two ports with a bandwith request17:29
sean-k-mooneyform the same backend17:29
sean-k-mooneye.g. you cant booth a vm with two ovs ports with min bandwith17:30
efriedmm, so that would be a limitation if we always set it to 'isolate' for NUMA17:30
sean-k-mooneyyes17:30
sean-k-mooneywhich is why we cant do that17:30
efriedwell17:30
sean-k-mooneyand why im saying the numa toplogy filter should handel it17:30
efriedwe would have to weigh whether it's better or worse to have that limitation vs using the ntf17:30
sean-k-mooneye.g. filter based on the allcoation and ensure there are the expecte number of numa nodes or we addn "same_subtree=!...."17:31
efriedyeah, I think that's probably the right call. Perhaps we should look into designing the granular isolation thing suggested in the spec.17:31
sean-k-mooneywe could17:32
*** eharney has joined #openstack-nova17:32
sean-k-mooneybut i think for this case the not same_subtree is more useful17:32
efriedIt won't be simple, I'm afraid. Which is why we didn't do it yet.17:32
sean-k-mooneythe not_same_subtree is usful for nic for bonding reasons too17:32
efriedYeah, there's all kinds of anti-affinity use cases17:33
sean-k-mooneyso you can ask for VFs from different PFs17:33
*** spatel has joined #openstack-nova17:33
sean-k-mooneyyep17:33
*** evrardjp has quit IRC17:33
*** evrardjp has joined #openstack-nova17:34
spatelsean-k-mooney: I have question, i have project name foo and it has bunch of instance and now i want to rename foo project to "bar" is that possible?17:34
sean-k-mooneyi think so17:34
sean-k-mooneyyou do that in keystone17:34
sean-k-mooneywe just recorred the uuid in nova i think17:34
sean-k-mooneyso the uuid wont change but the name that is shown to the user should be able too17:35
sean-k-mooneythat siad i have never tried it17:35
spatelsean-k-mooney: interesting... let me try and see..17:36
spateli am trying to standardize name across multiple openstack cloud17:36
spatelsean-k-mooney: does cellv2 technology stable enough to deploy?  I am tried of managing isolated cloud :(17:37
spateltired*17:38
sean-k-mooneyit is enabled by default on all clouds after pike17:38
sean-k-mooneyso yes17:38
sean-k-mooneyall deployment are cellv2 deployment with 1 cell17:38
openstackgerritStephen Finucane proposed openstack/nova master: tox: Integrate mypy  https://review.opendev.org/67620817:39
openstackgerritStephen Finucane proposed openstack/nova master: mypy: Add type annotations to 'nova.pci'  https://review.opendev.org/67620917:39
spatelsean-k-mooney: default 1 Cell and if i want to add more cell i can do that right without major changes17:39
spatelright?17:39
sean-k-mooneyyep17:40
spatelsean-k-mooney: Thanks!!! let me do some research :)17:44
*** Sundar has quit IRC17:53
*** ociuhandu_ has joined #openstack-nova17:54
*** ociuhandu has quit IRC17:57
*** ociuhandu_ has quit IRC17:59
*** derekh has quit IRC18:00
openstackgerritGhanshyam Mann proposed openstack/nova master: Deprecate base rules in favor of new rules  https://review.opendev.org/70162418:01
spatelsean-k-mooney: openstack project set foo_project --name bar_project   works :)18:04
lyarwoodhttps://paste.centos.org/view/69c69b50 - Has anyone seen this when running `$ tox -evenv -- tempest verify-config -uro /tmp/tmp.TdRrD4s6eN`18:10
lyarwoodPermissionError: [Errno 13] Permission denied: '/opt/stack/tempest/.tox/venv/log/.lock'18:10
lyarwoodah nvm, I mounted /opt/stack as root over sshfs, fail!18:14
sean-k-mooneyspatel: cool18:17
sean-k-mooneyspatel: i theory i did not know if a reason why it would not work but untill you try its hard to know18:18
sean-k-mooneyspatel: one thing to keep in mind is the legacy openrc file you use for loggin in sometimes have the project names in them18:19
sean-k-mooneybut they normally have the project uuid18:19
sean-k-mooneyif they only have the name they would have to be updated but if you use the cloud.yaml or openrc file with the uuid then renameing shoudl be fine18:19
*** martinkennelly has quit IRC18:21
spatelsean-k-mooney: Yes.. i will deal with that.. we mostly use terraform so its going to be lots of change but one time18:21
sean-k-mooneyspatel: ya while slightly annoying, the uuid is fixed so in generally you should prefer using that anyway.18:23
spatelsean-k-mooney: ++ (totally with you)18:24
openstackgerritMerged openstack/nova stable/queens: Add functional recreate test for bug 1829479 and bug 1817833  https://review.opendev.org/69969818:27
openstackbug 1829479 in OpenStack Compute (nova) "The allocation table has residual records when instance is evacuated and the source physical node is removed" [Medium,In progress] https://launchpad.net/bugs/1829479 - Assigned to Matt Riedemann (mriedem)18:27
openstackbug 1817833 in OpenStack Compute (nova) "Check compute_id existence when nova-compute reports info to placement" [Medium,In progress] https://launchpad.net/bugs/1817833 - Assigned to Matt Riedemann (mriedem)18:27
*** luksky has joined #openstack-nova18:37
*** ralonsoh has quit IRC18:51
*** eharney has quit IRC19:02
*** eharney has joined #openstack-nova19:14
*** eharney has quit IRC19:17
*** martinkennelly has joined #openstack-nova19:19
*** martinkennelly has quit IRC19:22
*** rlljorge has quit IRC19:36
*** tbachman has quit IRC19:37
openstackgerritGhanshyam Mann proposed openstack/nova master: Fix os-attach-interfaces policy to be admin_or_owner  https://review.opendev.org/70513519:39
openstackgerritGhanshyam Mann proposed openstack/nova master: Remove old policy enforcement in attach_interfaces  https://review.opendev.org/70512719:39
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing attach_interfaces policies  https://review.opendev.org/70512619:40
*** dtantsur is now known as dtantsur|afk19:53
openstackgerritMerged openstack/nova master: Remove extra instance.save() calls related to qos SRIOV ports  https://review.opendev.org/70226119:55
openstackgerritMerged openstack/nova master: Use common server create function for qos func tests  https://review.opendev.org/70135319:55
openstackgerritFrançois Palin proposed openstack/nova master: Add retry to cinder API calls related to volume detach  https://review.opendev.org/66967419:56
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing attach_interfaces policies  https://review.opendev.org/70512619:58
*** tesseract has quit IRC20:01
*** irclogbot_1 has quit IRC20:05
*** irclogbot_2 has joined #openstack-nova20:06
openstackgerritVictor Coutellier proposed openstack/nova master: Non-Admin user can filter their instances by more filters  https://review.opendev.org/70160920:10
openstackgerritVictor Coutellier proposed openstack/nova master: Non-Admin user can filter their instances by more filters  https://review.opendev.org/70160920:13
openstackgerritArtom Lifshitz proposed openstack/nova master: Functional tests for NUMA live migration  https://review.opendev.org/67259520:22
openstackgerritArtom Lifshitz proposed openstack/nova master: NUMA LM: Add func test for bug 1845146  https://review.opendev.org/68740420:22
openstackbug 1845146 in OpenStack Compute (nova) train "NUMA aware live migration failed when vCPU pin set" [High,Fix committed] https://launchpad.net/bugs/1845146 - Assigned to Dan Smith (danms)20:22
openstackgerritArtom Lifshitz proposed openstack/nova master: func tests: move _run_periodics() into own mixin  https://review.opendev.org/70554520:22
openstackgerritArtom Lifshitz proposed openstack/nova master: tests: work around malformed serial XML  https://review.opendev.org/70554620:22
*** artom has quit IRC20:26
*** mlavalle has quit IRC20:29
*** jmlowe has joined #openstack-nova20:37
*** maciejjozefczyk has quit IRC20:40
openstackgerritMerged openstack/nova master: nova-net: Remove use of legacy 'FloatingIP' object  https://review.opendev.org/69715320:47
*** TxGirlGeek has quit IRC20:51
*** eharney has joined #openstack-nova20:53
*** TxGirlGeek has joined #openstack-nova21:00
openstackgerritMykola Yakovliev proposed openstack/nova master: Fix boot_roles in InstanceSystemMetadata  https://review.opendev.org/69804021:03
*** TxGirlGeek has quit IRC21:07
*** TxGirlGeek has joined #openstack-nova21:07
*** TxGirlGeek has quit IRC21:08
*** nicolasbock has quit IRC21:29
*** jmlowe has quit IRC21:31
*** tbachman has joined #openstack-nova21:35
*** bjolo has quit IRC21:47
*** artom has joined #openstack-nova21:49
*** nweinber has quit IRC21:50
*** dpawlik has quit IRC21:53
*** slaweq has quit IRC22:02
*** ircuser-1 has joined #openstack-nova22:07
*** slaweq has joined #openstack-nova22:11
*** slaweq has quit IRC22:16
*** xek has quit IRC22:29
*** mriedem has left #openstack-nova22:35
*** tkajinam has joined #openstack-nova22:53
*** spatel has quit IRC22:56
*** slaweq has joined #openstack-nova23:11
*** slaweq has quit IRC23:15
*** damien_r has quit IRC23:16
*** jaosorior has quit IRC23:34
*** jaosorior has joined #openstack-nova23:50
*** damien_r has joined #openstack-nova23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!