Tuesday, 2015-06-23

*** markvoelker has joined #openstack-nova00:00
*** r-daneel has quit IRC00:01
*** mtanino has joined #openstack-nova00:03
*** xyang1 has quit IRC00:06
*** sorrison_laptop has joined #openstack-nova00:06
*** Longgeek has joined #openstack-nova00:13
*** dave-mccowan has quit IRC00:14
*** asettle has joined #openstack-nova00:15
*** tpeoples has quit IRC00:15
*** hemna is now known as hemnafk00:19
*** claudiub has joined #openstack-nova00:19
openstackgerritJim Rollenhagen proposed openstack/nova-specs: Add multiple compute host support for Ironic driver  https://review.openstack.org/19445300:19
openstackgerritxing-yang proposed openstack/nova: Add os-brick based LibvirtVolumeDriver for ScaleIO  https://review.openstack.org/19445400:20
*** lyarwood has quit IRC00:22
*** lyarwood has joined #openstack-nova00:22
*** doude_ has joined #openstack-nova00:27
*** doude has quit IRC00:28
*** jasondotstar has quit IRC00:29
*** jamielennox|away is now known as jamielennox00:29
*** isd has joined #openstack-nova00:30
*** eliqiao1 has left #openstack-nova00:35
*** browne has quit IRC00:35
*** browne has joined #openstack-nova00:36
*** ociuhandu has quit IRC00:38
*** mriedem has quit IRC00:43
*** electrocucaracha has quit IRC00:44
*** nelsnelson has quit IRC00:44
*** isd has quit IRC00:45
*** Longgeek has quit IRC00:46
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Add common function for v2.1 API flavor_get.  https://review.openstack.org/13656800:47
openstackgerritMatt Riedemann proposed openstack/nova: cells: add devstack/tempest-dsvm-cells-rc for gating  https://review.openstack.org/19441100:48
*** pixelb has joined #openstack-nova00:48
*** nihilifer has quit IRC00:51
*** vilobhmm has joined #openstack-nova00:51
mikalI just re-realized that we're using an orphaned import of oslo-incubator's policy module00:52
*** yingjun has joined #openstack-nova00:52
mikalDoes anyone remember if someone is working on porting us to the graduated thing?00:52
mikaldims: ^---00:52
*** ijw_ has quit IRC00:54
*** bradjones has quit IRC00:54
*** ijw_ has joined #openstack-nova00:54
*** dims has quit IRC00:55
claudiubmikal: hi. I was wondering if you have some time to take a look at the hyper-v cluster spec? :) https://review.openstack.org/#/c/188374/00:56
*** dims has joined #openstack-nova00:57
mikalclaudiub: I am pretty sure I already have that open in a tab. I'll try and take a look sometime later today.00:57
claudiubmikal: awesome! thanks! :D00:58
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Not pass secgroup values if not specified  https://review.openstack.org/19204300:58
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Add jsonschema validation for creating secgroup  https://review.openstack.org/18954400:58
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Remove unused "id" and "rules" from secgroup body  https://review.openstack.org/19202900:58
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Fix a request body template for secgroup tests  https://review.openstack.org/19203100:58
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Fix test_create_security_group_with_no_name  https://review.openstack.org/19203000:59
*** dsanders has quit IRC00:59
*** bradjones has joined #openstack-nova00:59
*** bradjones has quit IRC00:59
*** bradjones has joined #openstack-nova00:59
*** aloga has quit IRC01:00
*** dboik has joined #openstack-nova01:02
openstackgerritZhenzan Zhou proposed openstack/nova: Bypass ironic server not available issue  https://review.openstack.org/17368101:04
*** bradjones has quit IRC01:07
openstackgerritJim Rollenhagen proposed openstack/nova-specs: Ironic: Multiple compute host support  https://review.openstack.org/19445301:07
*** dboik has quit IRC01:07
*** bradjones has joined #openstack-nova01:09
*** bradjones has quit IRC01:09
*** bradjones has joined #openstack-nova01:09
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: [WIP] Kicking the oslo.service tires  https://review.openstack.org/19290001:12
*** Longgeek has joined #openstack-nova01:15
*** jasondotstar has joined #openstack-nova01:15
*** Kennan has quit IRC01:16
*** Kennan has joined #openstack-nova01:16
*** nic has quit IRC01:19
*** nic has joined #openstack-nova01:22
*** cing has joined #openstack-nova01:23
*** patrickeast has quit IRC01:23
*** wwriverrat has quit IRC01:24
*** sdake has joined #openstack-nova01:24
*** sdake_ has joined #openstack-nova01:27
*** aloga has joined #openstack-nova01:29
*** sdake has quit IRC01:31
openstackgerritChung Chih, Hung proposed openstack/nova: Use monotonic.monotonic and stopwatches instead of time.time  https://review.openstack.org/19407301:31
*** yamahata has quit IRC01:33
openstackgerritChung Chih, Hung proposed openstack/nova: Use monotonic.monotonic and stopwatches instead of time.time  https://review.openstack.org/19407301:34
*** alexpilotti has quit IRC01:40
*** zzzeek has quit IRC01:43
*** otter768 has joined #openstack-nova01:44
*** asettle has quit IRC01:44
*** dramakri has quit IRC01:44
openstackgerritRui Chen proposed openstack/nova-specs: CreateVM supports subnet specified  https://review.openstack.org/16963801:45
*** nic has quit IRC01:45
*** IanGovett has quit IRC01:48
*** otter768 has quit IRC01:49
*** LukeHinds has quit IRC01:52
*** park_heijlong has joined #openstack-nova01:55
*** sdake_ has quit IRC01:58
*** sdake has joined #openstack-nova01:58
*** unicell1 has quit IRC02:02
*** liusheng has joined #openstack-nova02:02
*** claudiub has quit IRC02:04
*** cfriesen_ has joined #openstack-nova02:06
*** sdake has quit IRC02:07
*** tjones1 has quit IRC02:10
*** Marga_ has joined #openstack-nova02:12
*** patrickeast has joined #openstack-nova02:14
*** hanzhang has joined #openstack-nova02:17
*** zzzeek has joined #openstack-nova02:17
*** sorrison_laptop has quit IRC02:20
*** sorrison_laptop has joined #openstack-nova02:21
*** sorrison_laptop has quit IRC02:22
*** yingjun has quit IRC02:25
*** ctrath has joined #openstack-nova02:26
*** adrian_otto has joined #openstack-nova02:28
*** adrian_otto1 has joined #openstack-nova02:29
*** bkopilov has quit IRC02:29
*** yingjun has joined #openstack-nova02:30
*** lyarwood has quit IRC02:32
*** lyarwood has joined #openstack-nova02:32
*** adrian_otto has quit IRC02:33
*** adrian_otto1 has quit IRC02:33
*** dims has quit IRC02:36
*** zhenguo has joined #openstack-nova02:40
*** zzzeek has quit IRC02:41
*** annashen has joined #openstack-nova02:42
*** ctrath has quit IRC02:42
*** pixelb has quit IRC02:42
*** pixelb has joined #openstack-nova02:42
*** linkedinyou has joined #openstack-nova02:46
*** dave-mccowan has joined #openstack-nova02:47
*** jasondotstar has quit IRC02:47
*** yingjun has quit IRC02:49
*** asettle has joined #openstack-nova02:51
*** ctrath has joined #openstack-nova02:52
*** rushiagr_away is now known as rushiagr02:53
*** Longgeek has quit IRC02:55
*** vilobhmm has quit IRC02:55
*** yingjun has joined #openstack-nova02:56
*** ctrath has quit IRC03:08
*** Nikolay_St has joined #openstack-nova03:09
*** ijw_ has quit IRC03:10
*** ijw_ has joined #openstack-nova03:11
*** dsanders has joined #openstack-nova03:12
*** Nikolay_St has quit IRC03:15
*** ijw_ has quit IRC03:16
*** electrocucaracha has joined #openstack-nova03:17
*** annashen has quit IRC03:19
openstackgerritshihanzhang proposed openstack/nova: Optimize validate_networks  https://review.openstack.org/17574203:19
*** erlon has quit IRC03:20
*** jogo has joined #openstack-nova03:22
*** garyk has quit IRC03:22
*** wwriverrat has joined #openstack-nova03:22
*** Longgeek has joined #openstack-nova03:23
*** achanda has joined #openstack-nova03:25
*** sdake has joined #openstack-nova03:25
*** Marga_ has quit IRC03:26
*** tobe has joined #openstack-nova03:26
*** sdake_ has joined #openstack-nova03:27
*** electrocucaracha has quit IRC03:30
*** electrocucaracha has joined #openstack-nova03:30
*** sdake has quit IRC03:31
*** sdake__ has joined #openstack-nova03:32
*** rushiagr is now known as rushiagr_away03:32
*** dsanders has quit IRC03:32
*** dave-mccowan has quit IRC03:33
*** mgarza has joined #openstack-nova03:35
*** sdake_ has quit IRC03:35
openstackgerritFei Long Wang proposed openstack/nova: Refactor image's code to support both versions  https://review.openstack.org/14487503:38
*** achanda has quit IRC03:39
*** harlowja has quit IRC03:43
*** yingjun has quit IRC03:44
*** otter768 has joined #openstack-nova03:45
*** coolsvap|away is now known as coolsvap03:47
*** bkopilov has joined #openstack-nova03:47
*** yingjun has joined #openstack-nova03:48
*** avishay_ has joined #openstack-nova03:49
*** rajesht has joined #openstack-nova03:50
*** otter768 has quit IRC03:50
*** garyk has joined #openstack-nova03:51
*** ajayaa has joined #openstack-nova03:54
*** vilobhmm has joined #openstack-nova03:56
*** yingjun has quit IRC03:56
*** tojuvone has joined #openstack-nova03:57
*** mgarza has quit IRC03:58
*** iamjarvo has joined #openstack-nova03:59
*** brad[] has joined #openstack-nova03:59
*** dramakri has joined #openstack-nova03:59
*** dramakri has left #openstack-nova04:00
*** Longgeek has quit IRC04:00
*** Longgeek has joined #openstack-nova04:00
*** kiran-r has joined #openstack-nova04:01
*** pixelb has quit IRC04:06
*** dsanders has joined #openstack-nova04:09
*** unicell has joined #openstack-nova04:09
*** rushiagr_away is now known as rushiagr04:11
*** Marga_ has joined #openstack-nova04:14
*** rushiagr is now known as rushiagr_away04:14
*** mtanino has quit IRC04:15
*** rushiagr_away is now known as rushiagr04:15
*** jogo has quit IRC04:16
*** mestery has joined #openstack-nova04:19
*** kaisers has quit IRC04:19
*** jogo has joined #openstack-nova04:20
*** kaisers has joined #openstack-nova04:22
*** sdake__ has quit IRC04:24
*** ildikov has quit IRC04:24
*** iamjarvo has quit IRC04:25
*** dsanders has quit IRC04:27
openstackgerritZhang Ni proposed openstack/nova-specs: Improve nova attach volume api to support disk-bus  https://review.openstack.org/18597304:28
*** Longgeek has quit IRC04:29
*** Marga_ has quit IRC04:31
*** cfriesen_ has quit IRC04:31
openstackgerritZhang Ni proposed openstack/nova-specs: Add volume type to create server API  https://review.openstack.org/18781204:32
*** Longgeek has joined #openstack-nova04:32
*** electrocucaracha has quit IRC04:33
*** brad[] has quit IRC04:35
*** Marga_ has joined #openstack-nova04:36
*** lyarwood has quit IRC04:37
*** lyarwood has joined #openstack-nova04:38
*** Marga_ has quit IRC04:38
*** mgarza_ has joined #openstack-nova04:38
*** Marga_ has joined #openstack-nova04:38
openstackgerritgaryk proposed openstack/nova: VMware: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18908504:39
*** husanu has quit IRC04:39
*** Nikolay_St has joined #openstack-nova04:40
openstackgerritZhang Ni proposed openstack/nova-specs: Improve nova attach volume api to support disk-bus  https://review.openstack.org/18597304:41
*** mgarza__ has joined #openstack-nova04:41
*** husanu has joined #openstack-nova04:41
*** deepthi has joined #openstack-nova04:42
*** mgarza_ has quit IRC04:43
*** arnaud___ has joined #openstack-nova04:43
*** linkedinyou has quit IRC04:49
*** mestery has quit IRC04:49
*** husanu has quit IRC04:50
*** takedakn has joined #openstack-nova04:51
*** husanu has joined #openstack-nova04:52
*** brad[] has joined #openstack-nova04:54
*** _gryf|afk is now known as _gryf04:58
*** dsanders has joined #openstack-nova04:59
*** asettle has quit IRC05:00
openstackgerritgaryk proposed openstack/nova: VMware: add support for cores per socket  https://review.openstack.org/18794205:01
*** husanu has quit IRC05:01
*** takedakn has quit IRC05:01
*** unicell1 has joined #openstack-nova05:02
*** husanu has joined #openstack-nova05:03
openstackgerritgaryk proposed openstack/nova: VMware: create common object for limits, reservations and shares  https://review.openstack.org/17905905:03
*** nkrinner has joined #openstack-nova05:04
*** unicell has quit IRC05:04
*** krtaylor has quit IRC05:05
*** armax has joined #openstack-nova05:08
*** tobe has quit IRC05:11
*** boris-42 has quit IRC05:12
*** Nikolay_St has quit IRC05:13
openstackgerritgaryk proposed openstack/nova: VMware: Resource limits for memory  https://review.openstack.org/17906005:14
*** jmccrory has quit IRC05:15
*** jmccrory has joined #openstack-nova05:16
*** yingjun has joined #openstack-nova05:16
*** tobe has joined #openstack-nova05:17
*** Marga_ has quit IRC05:17
openstackgerritgaryk proposed openstack/nova: VMware: store extra_specs object  https://review.openstack.org/17906105:18
openstackgerritgaryk proposed openstack/nova: VMware: add resource limits for disk  https://review.openstack.org/17906205:18
*** isd has joined #openstack-nova05:18
*** tobe has quit IRC05:19
openstackgerritgaryk proposed openstack/nova: VMware: add in vnic resource limitations  https://review.openstack.org/18020205:23
*** patrickeast has quit IRC05:23
*** patrickeast has joined #openstack-nova05:24
*** krtaylor has joined #openstack-nova05:25
*** irenab has joined #openstack-nova05:25
openstackgerritgaryk proposed openstack/nova: VMware: support limits via image meta data  https://review.openstack.org/18094205:26
*** lyarwood has quit IRC05:31
*** lyarwood has joined #openstack-nova05:31
openstackgerritArtom Lifshitz proposed openstack/nova-specs: Support --all-tenants in floatingips-list  https://review.openstack.org/17138905:35
*** fawadkhaliq has joined #openstack-nova05:38
*** ildikov has joined #openstack-nova05:41
*** arnaud___ has quit IRC05:42
*** arnaud___ has joined #openstack-nova05:44
*** otter768 has joined #openstack-nova05:46
*** sudipto has joined #openstack-nova05:48
*** arnaud___ has quit IRC05:48
*** otter768 has quit IRC05:51
*** salv-orlando has joined #openstack-nova05:54
*** patrickeast has quit IRC05:56
*** husanu has quit IRC05:56
*** salv-orlando has quit IRC05:56
*** doron_afk has joined #openstack-nova05:57
*** avishay_ is now known as avishay05:57
*** vilobhmm has quit IRC05:58
*** salv-orlando has joined #openstack-nova05:58
*** husanu has joined #openstack-nova05:58
openstackgerritQin Zhao proposed openstack/nova: Use host AZ instead of instance AZ in scheduler request_spec  https://review.openstack.org/17426906:01
*** annashen has joined #openstack-nova06:01
*** radek__ has joined #openstack-nova06:02
*** exploreshaifali has joined #openstack-nova06:02
*** yingjun has quit IRC06:04
*** radek__ has quit IRC06:06
*** radek__ has joined #openstack-nova06:07
*** shihanzhang has joined #openstack-nova06:11
*** Kennan has quit IRC06:11
*** Kennan2 has joined #openstack-nova06:11
*** oro has joined #openstack-nova06:13
*** hanzhang has quit IRC06:14
*** isd has quit IRC06:16
*** mgarza__ has quit IRC06:16
*** browne has quit IRC06:17
*** lpetrut has joined #openstack-nova06:18
*** yingjun has joined #openstack-nova06:19
*** nihilifer has joined #openstack-nova06:21
*** tobe has joined #openstack-nova06:22
*** ssurana has joined #openstack-nova06:23
*** ssurana has quit IRC06:25
*** belmoreira has joined #openstack-nova06:26
*** ssurana has joined #openstack-nova06:27
*** dsanders has quit IRC06:29
*** wanghua has joined #openstack-nova06:32
openstackgerritHiroyuki Eguchi proposed openstack/nova: qemu-img convert should be skipped when migrating  https://review.openstack.org/19451606:34
*** ianbrown has quit IRC06:38
*** ssurana has quit IRC06:38
*** shihanzhang has quit IRC06:39
*** lyarwood has quit IRC06:39
*** ndipanov has joined #openstack-nova06:40
*** markvoelker has quit IRC06:40
*** lyarwood has joined #openstack-nova06:41
*** rushiagr is now known as rushiagr_away06:42
*** exploreshaifali has quit IRC06:43
openstackgerritHans Lindgren proposed openstack/nova: Remove/deprecate unused parts of the compute node object  https://review.openstack.org/18675706:44
openstackgerritHans Lindgren proposed openstack/nova: Make ComputeNode.service_id nullable to match db schema  https://review.openstack.org/16928406:44
*** deepthi has quit IRC06:44
openstackgerritAbhishek Kekane proposed openstack/nova: libvirt: Kill rsync/scp processes before deleting instance  https://review.openstack.org/19298606:45
openstackgerritHans Lindgren proposed openstack/nova: Avoid querying for Service in resource tracker  https://review.openstack.org/16928806:46
*** ndipanov has quit IRC06:47
*** hanzhang has joined #openstack-nova06:49
*** armax has quit IRC06:49
*** sahid has joined #openstack-nova06:51
*** mmedvede has quit IRC06:53
*** Kennan2 is now known as Kennan06:53
*** dsanders has joined #openstack-nova06:53
*** fawadkhaliq has quit IRC06:55
*** mpaolino has joined #openstack-nova06:55
*** fawadkhaliq has joined #openstack-nova06:55
*** Longgeek_ has joined #openstack-nova06:56
*** Nikolay_St has joined #openstack-nova06:56
*** abhishekk has joined #openstack-nova06:57
*** sahid has quit IRC06:59
*** sahid has joined #openstack-nova06:59
*** Longgeek has quit IRC06:59
openstackgerritRajesh Tailor proposed openstack/nova: Remove unnecessary ValueError exception  https://review.openstack.org/19052507:01
*** lyarwood has quit IRC07:03
*** doron_afk is now known as doron_07:03
*** lyarwood has joined #openstack-nova07:03
*** avishay_ has joined #openstack-nova07:04
*** avishay has quit IRC07:05
*** bkopilov has quit IRC07:05
*** dsanders has quit IRC07:05
*** RuiChen has joined #openstack-nova07:06
*** Jabadia has joined #openstack-nova07:07
*** park_heijlong has quit IRC07:08
*** lyarwood has quit IRC07:09
*** lyarwood has joined #openstack-nova07:09
*** jlanoux has joined #openstack-nova07:10
*** matrohon has joined #openstack-nova07:11
*** vilobhmm has joined #openstack-nova07:13
*** dsanders has joined #openstack-nova07:16
*** annashen has quit IRC07:16
*** avishay_ has quit IRC07:18
*** park_heijlong has joined #openstack-nova07:19
*** moshele has joined #openstack-nova07:20
*** doron_ is now known as doron_afk07:20
*** haypo has joined #openstack-nova07:20
*** haypo has quit IRC07:20
*** haypo has joined #openstack-nova07:20
*** matrohon has quit IRC07:20
openstackgerritPrashantUpadhyay proposed openstack/nova: check for volume size  https://review.openstack.org/19452307:20
bauzastonyb: around ?07:21
*** prashup has joined #openstack-nova07:21
*** bkopilov has joined #openstack-nova07:21
tonybbauzas: Yup07:21
tonybbauzas: but not for too long :(07:21
tonybbauzas: I assume this is related to my email ;P07:21
*** oro has quit IRC07:22
bauzastonyb: coolio, Australians and Frenchs can be discussing not only for the Rugby World Cup then07:22
tonybbauzas: :)07:22
openstackgerritwangxiyuan proposed openstack/nova: Remove an useless variable and fix a typo in api  https://review.openstack.org/18711807:22
bauzastonyb: so, pinging you because it's public, right?07:22
bauzastonyb: I mean, okay for discussing here?07:22
tonybbauzas: Yup all public, but we'd still like some attention / validation07:23
bauzastonyb: okay07:23
sudiptojohnthetubaguy, Hi, https://review.openstack.org/#/c/192760/ in this review, dansmith mentions that we should not actually drop the table column from the table and wanted me to create a whitelist of attributes that need cleanup in the test_migrations.py - to have a list of attributes that can be cleaned up from the DB in the 'M' release. Your thoughts?07:23
bauzastonyb: so https://bugs.launchpad.net/nova/+bug/145622807:23
openstackLaunchpad bug 1456228 in OpenStack Security Advisory "Trusted vm can be powered on untrusted host" [Undecided,Incomplete]07:23
bauzastonyb: I saw that bug a couple of times before07:24
tonybbauzas: okay.  good to know07:24
*** romainh has joined #openstack-nova07:24
tonybbauzas: So the basic outline of the bug sounds feasible but I don't have the hardware nor the expertise to triage it07:25
*** wwriverrat has quit IRC07:25
tonybbauzas: I suspect it's not a nova bug.  but IF the modified server does update the Attestation service then it would be a nova issue07:26
tonybbauzas: but really the nova code is just an interface to that service (IIUC)07:26
openstackgerritheijlong proposed openstack/nova: Merge used-limits functional tests of v2 and v2.1  https://review.openstack.org/17421507:28
*** lpetrut has quit IRC07:29
bauzastonyb: sorry I'm otp07:31
bauzastonyb: still there in 10 mins ?07:31
tonybbauzas: 5?07:31
bauzastonyb: trying07:32
*** ijuwang_away has quit IRC07:32
tonybbauzas: Sorry to be a pain but my wife's holding dinner for me.07:32
tonybbauzas: I can get back online in say 90mins and we can chat longer if that's a better option?07:32
*** boris-42 has joined #openstack-nova07:32
*** lucasagomes has joined #openstack-nova07:32
*** ijuwang_away has joined #openstack-nova07:32
*** avishay_ has joined #openstack-nova07:32
tonybbauzas: Sorry I'm going to have to bail.  I'll be back when the kids are in bed about 90mins from now07:36
tonybbauzas: sorry :(07:36
bauzastonyb: okay, sorry about that07:37
*** salv-orl_ has joined #openstack-nova07:37
bauzastonyb: so, ping me if you have time later on, we can discuss on the TrustedFilter07:37
bauzastonyb: tbc, my opinion is that the TrustedFilter should be landed in hell (or out-of-tree)07:38
bauzastonyb: because that's the only in-tree filter which calls an API for saying OK or not07:38
*** fawadkhaliq has quit IRC07:39
*** salv-orlando has quit IRC07:40
bauzastonyb: in the meantime, I'll provide some insights on the bug07:40
*** markvoelker has joined #openstack-nova07:41
openstackgerritQin Zhao proposed openstack/nova: Use host AZ instead of instance AZ in availability zone filter  https://review.openstack.org/17426907:42
openstackgerritQin Zhao proposed openstack/nova: Consolidate code to get the correct availability zone of an instance  https://review.openstack.org/14956207:42
*** mpavone has joined #openstack-nova07:43
*** fawadkhaliq has joined #openstack-nova07:44
*** markvoelker has quit IRC07:46
*** linkedinyou has joined #openstack-nova07:46
*** otter768 has joined #openstack-nova07:47
*** markus_z has joined #openstack-nova07:47
*** dsanders has quit IRC07:47
*** sahid has quit IRC07:49
*** sahid_ has joined #openstack-nova07:49
*** hanzhang has quit IRC07:49
*** hanzhang has joined #openstack-nova07:50
*** claudiub has joined #openstack-nova07:51
*** otter768 has quit IRC07:51
*** masayukig has quit IRC07:52
*** linkedinyou has quit IRC07:53
*** masayukig has joined #openstack-nova07:54
*** deepthi has joined #openstack-nova07:55
*** cjwei has quit IRC07:55
*** avishay_ has quit IRC07:56
*** avishay__ has joined #openstack-nova07:56
openstackgerritAndreas Scheuring proposed openstack/nova-specs: Spec to Add 'macvtap' as vif type to novas libvirt driver.  https://review.openstack.org/18228007:57
*** kiran-r has quit IRC07:57
*** salv-orl_ has quit IRC07:58
*** LukeHinds has joined #openstack-nova07:58
*** sahid_ has quit IRC07:59
*** sahid has joined #openstack-nova07:59
*** salv-orlando has joined #openstack-nova08:00
*** claudiub has quit IRC08:00
*** mpaolino has quit IRC08:01
*** mpaolino has joined #openstack-nova08:03
*** chen12 has joined #openstack-nova08:04
*** karimb has joined #openstack-nova08:04
chen12hello.I get an error for nova when install devstack,anyone know how to fix this : http://paste.openstack.org/show/315959/08:04
*** claudiub has joined #openstack-nova08:05
*** claudiub|2 has joined #openstack-nova08:07
lifelesschen12: you'remissing some tags from the openstack repo08:08
chen12lifeless, how to add these tags ?? I already run  "git pull origin master"08:09
lifelesslets check08:09
lifelessgit tag08:09
chen12lifeless, and I have run clean.sh & stack.sh in devstack....08:10
chen12lifeless, http://paste.openstack.org/show/315960/08:10
*** vilobhmm has quit IRC08:10
*** claudiub has quit IRC08:10
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: scheduler: weight nodes based on their cached images  https://review.openstack.org/17330408:11
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: Add new image cache monitor in compute nodes  https://review.openstack.org/17330308:11
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: vmware: add image_cache_manager property  https://review.openstack.org/18760208:11
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: compute monitors: set update delta from base class  https://review.openstack.org/17398708:11
lifelessyeah you're missing 12.0.0a008:11
lifelesswhat's your git remote for origin ?08:12
johnthetubaguysudipto: yeah, I think he has a good point, although we totally need to get those rules written up. I think he added some new rules recently08:12
markus_zchen12: You could try "RECLONE=yes" in the "local.conf" file. Or in the existing nova repository "git fetch --tags".08:13
*** claudiub has joined #openstack-nova08:14
johnthetubaguybauzas: ah, thats the last filter that does nasty things, interesting, do we give them a good way to do it with meters, or something, instead?08:14
openstackgerritSergey Nikitin proposed openstack/nova: Added server tags support in nova-api  https://review.openstack.org/12894008:14
openstackgerritSergey Nikitin proposed openstack/nova: Added method exists to the Tag object  https://review.openstack.org/17810308:14
bauzasjohnthetubaguy: the problem with that filter is that it's checking something out of Nova08:14
bauzasjohnthetubaguy: the other filters are checking the HostState only08:15
johnthetubaguybauzas: agreed08:15
johnthetubaguybauzas: I am saying, did we give them a good way to get that data into the HostState08:15
bauzasjohnthetubaguy: well, I'm usually -1 for some metrics not provided by the virt driver08:15
johnthetubaguybauzas: sounds a bit like the metric/meetering stuff might do that08:15
*** yingjun has quit IRC08:15
johnthetubaguybauzas: well the virt driver can call out to the service and report those stats, although they may dislike that approach08:16
bauzasjohnthetubaguy: the rule is that we're providing the metrics returned by the virt driver08:16
*** claudiub|2 has quit IRC08:16
johnthetubaguybauzas: yes, I am saying make the virt driver return that info08:16
bauzasjohnthetubaguy: so, given that, perhaps something running on the node which would be called by the virt driver would be OK08:16
bauzasjohnthetubaguy: lemme think about that08:16
bauzasjohnthetubaguy: the main problem I have is that I dunno how the Attestation API is returning True or False08:17
johnthetubaguybauzas: its a horrible thing to do, but I love the use case08:17
chen12lifeless, origin  https://git.openstack.org/openstack/nova.git (fetch)  & origin  https://git.openstack.org/openstack/nova.git (push)08:17
chen12markus_z, lifeless "git fetch --tags" works08:18
lifelesscool08:18
lifelesswonder why it was missing in the first place though08:18
lifelessthis isn't the first report08:18
lifelessI think I'll ask infra to check the mirrors08:18
bauzasjohnthetubaguy: what I need to understand is why we need an Attestation API, if that Attestation API is opensource or not08:18
*** avishay has joined #openstack-nova08:18
bauzasjohnthetubaguy: and see how we can have the drivers using it or not08:18
markus_zchen12: lifeless: It could be a new execution of "stack.sh" on an existing devstack installation.08:18
markus_zThe tag was introduced 5 days ago.08:19
markus_zhttps://git.openstack.org/cgit/openstack/nova/refs/08:19
openstackgerritSergey Nikitin proposed openstack/nova: Removed extra '-' from rest_api_version_history.rst  https://review.openstack.org/19453608:19
bauzasjohnthetubaguy: but you know, it would be like the same problem as raised by mikal here http://lists.openstack.org/pipermail/openstack-dev/2015-June/067630.html08:19
bauzasjohnthetubaguy: which means that we would have an in-tree dependency on an external tool08:19
johnthetubaguybauzas: so I thought it was a rest API in this case, I guess its not08:20
lifelessmarkus_z: no, it can't be that08:20
johnthetubaguybauzas: but yes, we have that problem all over the place, sadly :(08:20
*** avishay__ has quit IRC08:20
lifelessmarkus_z: because the error indicates that the new master branch is present08:20
lifelessmarkus_z: which means a git pull was done08:20
bauzasjohnthetubaguy: I think the idea is, we use the nova-scheduler as something we know uncompromised08:20
johnthetubaguybauzas: I agree08:21
bauzasjohnthetubaguy: because using nova-compute for checking its own state if it's compromised is kinda weird08:21
johnthetubaguybauzas: I am saying the virt driver calls the API and reports the stat to the scheduler08:21
garykjohnthetubaguy: can you please assign the bp https://blueprints.launchpad.net/openstack/?searchtext=cells-instance-migration to me. i have spoke with alaski about this and have posted an initial implementation08:21
johnthetubaguybauzas: true, although its more about the hypervisor than the nova-compute VM, as I understood it08:21
lifelessmarkus_z: unless devstack does omething really weird?08:21
bauzasjohnthetubaguy: but since the virt thing is running on something potentially compromised, how can we be sure that what's reported by that virt driver is safe ?08:21
lifelessmarkus_z: 20:21 < clarkb> anyone can check, http://git0X.openstack.org:8080/cgit/openstack/nova looks like 01 is missing it08:22
lifelessmarkus_z: from -infra.08:22
bauzasjohnthetubaguy: the Attestation API is not checking the VM, rather the host08:22
johnthetubaguygaryk: did you add the blueprint tag to your patches? I don't see them on the whiteboard of the blueprint08:22
bauzasjohnthetubaguy: IIUC again, since I have zero understanding on which software is giving us that08:22
garykjohnthetubaguy: yes08:22
johnthetubaguybauzas: yes, its checking the host, understood08:22
*** yassine_ has joined #openstack-nova08:22
garykjohnthetubaguy: at the moment it is one patch. not sure i understand08:22
johnthetubaguygaryk: my bad, I thought that was the spec for some reason08:23
garykjohnthetubaguy: you gotta get out the spec weeds and back into the trenches :)08:23
johnthetubaguygaryk: cool, that should be assigned to you know, I think08:23
markus_zlifeless: thanks for the info, this will safe me some time08:23
chen12markus_z, lifeless it not just happened for nova, my horizon has the same issue too.08:24
johnthetubaguygaryk: code, what is that?08:24
lifelesschen12: ok, so do a fetch --tags, then use te git0X urls to figure out which ones are msising it and report in -infra08:24
garykmy thinking is that it is something that is interpretted - in the past compiled08:24
*** alex_klimov has joined #openstack-nova08:25
*** danpb has joined #openstack-nova08:25
*** yingjun has joined #openstack-nova08:25
chen12lifeless, what is  git0X ?  =>> Your requested host "git0x.openstack.org" could not be resolved by DNS.08:26
lifelesschen12: X should be a number :)08:26
bauzasjohnthetubaguy: okay, lemme open a thread for that, asking for more details08:26
johnthetubaguybauzas: you are right though, the host claim-ing its not comprimised is odd08:27
openstackgerritDeepak C Shetty (deepakcs) proposed openstack/nova: Nova part of volume snapshot improvements  https://review.openstack.org/17281308:27
openstackgerritDeepak C Shetty (deepakcs) proposed openstack/nova: objects: Add support for OnlineSnapshotStatus object  https://review.openstack.org/19453808:27
johnthetubaguybauzas: I think this go back to the idea of adding an API to add to the host stats08:27
*** deepthi has quit IRC08:27
bauzasjohnthetubaguy: what I would appreciate is a logic invert where https://github.com/OpenAttestation/OpenAttestation would populate its views to the Scheduler metrics08:27
johnthetubaguyso some intermediate service periodically updates the host stats via the scheduler REST API (yes, the thing that doesn't exist yet)08:27
*** Marga_ has joined #openstack-nova08:28
openstackgerritTang Chen proposed openstack/nova: Add realize_host_maintenance() API to conductor.  https://review.openstack.org/19453908:28
openstackgerritTang Chen proposed openstack/nova: Add realize_host_maintenance() API to compute.  https://review.openstack.org/19454008:28
openstackgerritTang Chen proposed openstack/nova: Enable synchronous live migration in libvirt driver.  https://review.openstack.org/19454108:28
openstackgerritTang Chen proposed openstack/nova: Enable host maintenance mode in libvirt driver.  https://review.openstack.org/19454208:28
openstackgerritTang Chen proposed openstack/nova: Add unit tests for libvirt host maintenance mode.  https://review.openstack.org/19454308:28
bauzasjohnthetubaguy: yeah that, like we did for aggregates and instances08:28
*** Marga_ has quit IRC08:28
johnthetubaguybauzas: yeah, I think we are thinking along the same lines here08:28
bauzasjohnthetubaguy: okay, lemme draft thru some bits08:28
sudiptojohnthetubaguy, ok - so shall i just go ahead with the whitelist idea for now?08:28
bauzasjohnthetubaguy: in the ML08:28
*** Marga_ has joined #openstack-nova08:29
garyklifeless: you familiar with the script for checking the validity of requirements?08:30
lifelessgaryk: intimiately08:31
garyksweet.08:31
lifelessgaryk: more salty, but sure.08:31
garykquick question - in neutron there was the split out of drivers08:31
lifelessyes, I believe so.08:32
garykin the test requirements we have: https://github.com/openstack/vmware-nsx/blob/master/test-requirements.txt#L508:32
openstackgerritAnkit Agrawal proposed openstack/nova: Test patch libvirt race condition (do not merge)  https://review.openstack.org/19173208:32
garykthe script validation no barfs on that - http://logs.openstack.org/60/194360/1/check/gate-vmware-nsx-requirements/b294b53/console.html08:32
lifeless(sorry, bad humor :))08:32
garykis there anyway of having it skip that line?08:32
garyksimilar to # noqa for pep808:33
lifelesswell08:33
lifelessperhaps08:34
lifelessletme look08:34
garykgracias08:34
chen12lifeless, o....  Thanks!08:34
lifelessoh08:34
lifelessthats the one I haven't poked around inside much yet08:35
lifelessgaryk: so, those lines aren't valid08:35
lifelessgaryk: update-requirements has special logic to preserve them08:35
park__heijlongjohnthetubaguy: could you help to continue to take a review about https://review.openstack.org/#/c/184201/, thank you in advance.08:35
lifelessgaryk: but project-requirements-change.py which is newer as I understand it is more rigorous08:35
*** linkedinyou has joined #openstack-nova08:35
johnthetubaguypark__heijlong: its on my list08:36
garykok, i'll take a look… oof08:36
*** linkedinyou has quit IRC08:36
park__heijlongjohnthetubaguy: sure, sorry for interrupt, thank you~08:37
lifelessgaryk: so, I've argued before that the neutron split-out here should just say 'neutron' in requirements.txt08:37
lifelessgaryk: possibly version locked08:37
garyki hear you. in this case we want to take the current master branch08:38
lifelesssure08:38
lifelessbut those files end up in packaging metadata when you do sdist08:38
lifelesswhat you do for testing can and should be decoupled08:38
garykthat is, the branch lives in parallel to the master branch and when we cut a stable we freeze that one08:38
lifelesse.g. as a constraints file08:38
*** moshele has quit IRC08:38
*** lpetrut has joined #openstack-nova08:39
lifelessgaryk: sure, thats orthogonal though08:40
openstackgerritSergey Nikitin proposed openstack/nova: Removed extra '-' from rest_api_version_history.rst  https://review.openstack.org/19453608:42
lifelessgaryk: that said, I know some of the bits are still very rough - e.g. pip install -c is only in git at the moment, not a release08:42
garykok, thanks. i am just not sure what we should do. we have the global bot posting the requiremenst but the check fails. what do you suggest?08:45
*** prashup has quit IRC08:46
lifelesswell, it doesn't make sense that the two sides be inconsistent08:47
lifelessso you could put a patch together to the infra script to make it handle utls08:47
lifelessurls08:47
garyklifeless: ok, will try that08:47
lifelessbut - fair warning08:47
lifelessyou may get pushback08:47
lifelessseparately, you could examine why you need the url08:48
*** lpetrut1 has joined #openstack-nova08:48
lifelesslike, what in your test setup is consuming it08:48
*** lpetrut has quit IRC08:48
lifelessand just move it somewhere else. e.g. tox.ini08:48
*** rgerganov__ is now known as rgerganov08:48
openstackgerritMarkus Zoeller (markus_z) proposed openstack/nova: devref: virtual machine states and transitions  https://review.openstack.org/19102108:48
lifelessfor instance, removing it and putting it in requirements.txt (where it should be) as 'neutron', with an install_command of 'pip install -e https://....; pip install -r {deps}08:49
lifelessmight work08:49
*** arnaud____ has joined #openstack-nova08:49
*** prashup has joined #openstack-nova08:49
rgerganovalex_xu_: gilliard: hi guys, any chance you can take a look at https://review.openstack.org/#/c/148509/ again?08:49
*** moshele has joined #openstack-nova08:50
*** pixelb has joined #openstack-nova08:51
garyklifeless: do you by any chance have an example of that?08:52
lifelessgaryk: nope08:52
lifelessgaryk: sorry; only the discussions I've had with neutron folk about this :)08:52
garykok, thanks08:52
*** aix has quit IRC08:53
openstackgerritMarkus Zoeller (markus_z) proposed openstack/nova: devref: virtual machine states and transitions  https://review.openstack.org/19102108:54
*** arnaud____ has quit IRC08:54
lifelessgaryk: but install_command is a tox thing08:54
*** humble_ has joined #openstack-nova08:54
lifelessgaryk: so the idea is you'd install neutron and then the dep in requirements becomes a no-op in a testing context08:54
lifelessgaryk: which is all you want anyway, right?08:54
*** lyarwood has quit IRC08:55
lifelessgaryk: or you can use zuul-cloner08:55
*** lyarwood has joined #openstack-nova08:55
lifelessgaryk: which AIUI you're really meant to since you want the ZUUL_REF08:55
lifelessgaryk: if you don't have the ZUUL_REF being tested you can let bad things thread the needle08:55
kashyapmarkus_z: Hi, for the patch you just pushed, you might also want to add the rendered version (from staging, once available?) as a comment to see the output result.08:56
lifelessgaryk: we should perhaps -> #openstack-neutron :)08:56
markus_zkashyap: sure, I'll do that08:56
kashyapmarkus_z: Thanks.08:57
abhishekkjohnthetubaguy: hi, could you please review nova-specs https://review.openstack.org/135387 when you get time, thank you in advance.08:57
*** wanghua has quit IRC08:58
chen12lifeless, should this ok ?  https://storyboard.openstack.org/#!/story/200030008:58
*** humble__ has joined #openstack-nova08:59
lifelesschen12: seems reasonable; I have no idea if thats the rgiht place to file09:00
lifelesspuppet-cgit is the logic for managing the cgit stuff, not operational maintenance of the mirrors09:01
lifelesschen12: I'd mention that in -infra and see if you get any bites09:01
*** pkonisze has joined #openstack-nova09:01
*** pkonisze has quit IRC09:01
*** pkonisze has joined #openstack-nova09:01
lifelesschen12: ah, you're not in #openstack-infra09:02
*** avishay has quit IRC09:02
*** avishay_ has joined #openstack-nova09:02
chen12lifeless, ok.  it is my first bug report to infra...09:02
*** humble_ has quit IRC09:02
johnthetubaguychen12: if there are missing tags, I would reach out to ttx who will know the best person to ask09:03
*** mpavone has quit IRC09:03
lifelesswe have jhesketh on it in -infra09:04
chen12johnthetubaguy, what is "ttx"09:04
jheskethlifeless: well looking, no promises09:04
ttxthat would be me09:05
*** pkonisze has quit IRC09:05
johnthetubaguychen12: he is one of the release managers, thiery I always ask him about tags09:05
*** pkoniszewski has joined #openstack-nova09:05
ttxLooks like it's an issue in the GIT farm09:05
chen12ttx, johnthetubaguy  o, good to know that ! Thanks!09:05
johnthetubaguyoh, so I totally got the wrong end of the stuck here, could be a git mirror issue I guess?09:06
johnthetubaguyhttp://git01.openstack.org:8080/cgit/openstack/nova Missing tag  2014.1.5 &  12.0.0a009:06
ttxhttp://git.openstack.org/cgit/openstack/nova/refs/tags definietly has them09:06
ttxso some stale mirror issue maybe09:06
johnthetubaguyyeah, ignore me sorry, I got overexcited09:06
garyklifeless: yes, we should move to neutron09:06
ttxgit01 is missing them, git02 has them09:07
*** aix has joined #openstack-nova09:07
johnthetubaguyah, fun fun09:07
*** pbrooko has joined #openstack-nova09:08
openstackgerritgaryk proposed openstack/nova: Cells: add instance cell registration utility to nova-manage  https://review.openstack.org/19388909:10
tdurakovjohnthetubaguy: hi John! cvould you look again on spec: https://review.openstack.org/#/c/183057/ I added Alternatives sections09:11
openstackgerritStephen Finucane proposed openstack/nova-specs: Add virt-driver CPU thread pinning  https://review.openstack.org/19422109:12
openstackgerritStephen Finucane proposed openstack/nova-specs: trivial: Change file permissions for spec  https://review.openstack.org/19455909:12
tdurakovdanpb: Hi, seen spec you left in comment to my09:14
tonybbauzas: ping?09:14
tdurakovdanpb: there are  no enums too09:14
bauzastonyb: pong09:14
bauzastonyb: so I commented https://bugs.launchpad.net/nova/+bug/145622809:15
openstackLaunchpad bug 1456228 in OpenStack Security Advisory "Trusted vm can be powered on untrusted host" [Undecided,Incomplete]09:15
tonybbauzas: Yeah moving it out of tree would be nice, perhaps something we could talk about un Tokyo09:15
danpbtdurakov: what spec ?09:15
tdurakovhttps://review.openstack.org/#/c/183057/509:15
tdurakovdanpb ^09:15
bauzastonyb: as I discussed with johnthetubaguy, I'll open a thread for discussing at least how to change its behaviour09:15
tonybbauzas: cool.09:16
bauzastonyb: from a security pov, it sounds weird to rely on something out of Nova for checking if an host is good or not09:16
*** park_heijlong has quit IRC09:16
*** bkopilov has quit IRC09:17
bauzastonyb: and for example, the bug shows how it's not really useful since the host can be compromised and the instances left in there09:17
*** markvoelker has joined #openstack-nova09:17
tonybbauzas: Yeah.  It's strange.09:17
bauzastonyb: so I don't want to discuss here on how to cheat with that, but I can see at least one hack vector09:17
*** yamahata has joined #openstack-nova09:18
tonybbauzas: +109:18
openstackgerritStephen Finucane proposed openstack/nova-specs: trivial: Change file permissions for spec  https://review.openstack.org/19455909:18
openstackgerritStephen Finucane proposed openstack/nova-specs: Add virt-driver CPU thread pinning  https://review.openstack.org/19422109:18
bauzastonyb: I'm not part of the nova-sec group, do you know how we can safely discuss about that filter and the possible issues ?09:19
tonybbauzas: so power on != create right and the scheduler is only consiluted on create (and migrate/resize right)09:19
bauzastonyb: exactly09:19
tonybbauzas: Cool.09:19
bauzastonyb: there is one opensource project trying to consider that, btw.09:20
bauzastonyb: fyi https://wiki.openstack.org/wiki/Watcher09:20
tonybbauzas: Well there isn't a list right now but an email to me, mikal, alaski, dansmith and johnthetubaguy would be a good starting place09:20
bauzastonyb: that just means that's out of Nova for checking the current state09:21
bauzastonyb: ack, will do09:21
ekarlsobauzas: isn't there terracotta too ? or the neat project as it was called09:22
*** markvoelker has quit IRC09:22
bauzasekarlso: possibly, Congress is also trying to have such of a live check09:22
*** afazekas has joined #openstack-nova09:22
tonybbauzas: Hmm interesting.09:22
ekarlsobauzas: :|09:22
bauzasekarlso: my point is just : this is out of Nova09:22
*** jcoufal has joined #openstack-nova09:23
*** afazekas has quit IRC09:23
tonybbauzas: I was thinking of taking are more "packaging" approach and just move the unmaintained filters into another repo that can be installed alongside nova and the filters will be available.09:23
*** pbrooko has quit IRC09:23
bauzasgiven an orchestrator called Foo, make sure that Foo has alarms, triggers and actions09:23
openstackgerritGhanshyam Mann proposed openstack/nova: Merge availability_zone tests between v2 and v2.1  https://review.openstack.org/17101709:23
tonybbauzas: not an API for actually talking to the scheduler.09:24
*** afazekas has joined #openstack-nova09:24
*** pbrooko has joined #openstack-nova09:24
bauzastonyb: that's totally possible, but since TrustedFilter is in-tree, we can't just drop it09:24
*** pbrooko has quit IRC09:24
tonybbauzas: right.09:24
bauzastonyb: well, my take on that is that something has to provide stats to the scheduler09:25
openstackgerritQin Zhao proposed openstack/nova: Use migration object in compute manager  https://review.openstack.org/19456509:25
bauzastonyb: for the moment, the "something" is purely nova-compute and nova-api09:25
jheskethttx: can you please check if git01 is still missing the tags you were looking at?09:25
bauzastonyb: but I'm okay if that something becomes "foo" or whatever else09:26
bauzas(call it neutron, cinder or foo)09:26
tonybbauzas: Yeah.09:26
ttxjhesketh: now shows them at http://git01.openstack.org:8080/cgit/openstack/nova/refs/tags09:26
tonybbauzas: small steps ;P09:26
bauzastonyb: eh :)09:27
jheskethttx: thanks09:27
bauzastonyb: the smallest step for Nova I found being claimed is https://www.openstack.org/summit/vancouver-2015/summit-videos/presentation/openstack-is-doomed-and-it-is-your-fault09:27
*** pbrooko has joined #openstack-nova09:28
bauzastonyb: I assume the next step being to rewrite everything in golang09:28
tonybbauzas: That's on my list of presentations to watch09:28
openstackgerritAbhishek Kekane proposed openstack/nova: libvirt: Kill rsync/scp processes before deleting instance  https://review.openstack.org/19298609:28
tonybbauzas: not rust? ;p09:28
bauzastonyb: well, just a bit of disclaimer, this presentation is a bit opiniated :p09:28
*** bkopilov has joined #openstack-nova09:29
kashyapSo many volume related bugs, ugh.09:29
*** Nisha_away has joined #openstack-nova09:29
* kashyap wonders if anyone has any comments on - https://bugs.launchpad.net/nova/+bug/145425209:30
openstackLaunchpad bug 1454252 in OpenStack Compute (nova) "Support offline migration of attached volumes when VM is inactive" [High,Confirmed]09:30
*** MarcF has quit IRC09:30
tonybbauzas: I *never* would have got that from the title :D09:30
tonybbauzas: Are you coming to the mid-cycle?09:30
bauzastonyb: unfortunately not :(09:30
tonybbauzas: Ahh phooey09:30
bauzastonyb: I was willing to, but my dreams hitted the reality wall09:31
bauzastonyb: so I'll gently hassle mikal and johnthetubaguy to ask for a remote connectivity :)09:31
tonybbauzas: Yeah that can happen :(09:31
tonybbauzas: Sounds good.09:31
tonybbauzas: I'll poke mikal to bring the microphone that we used last time and try to get a hangout laptop or similar09:32
bauzastonyb: on my own, I'll set myself on the Rochester TZ09:32
tonybbauzas: Actually we should ask matt what will be in the room ....09:32
*** alexpilotti has joined #openstack-nova09:32
tonybbauzas: ekk that'll be hard :(09:32
bauzastonyb: not really, only like being awake till 1am09:33
tonybbauzas: hehe okay09:33
*** Alexandra_ has joined #openstack-nova09:34
*** Alexandra_ has quit IRC09:34
*** Alexandra_ has joined #openstack-nova09:35
*** yingjun has quit IRC09:35
openstackgerritGhanshyam Mann proposed openstack/nova: Merge security groups tests between v2 and v2.1  https://review.openstack.org/17367109:35
*** jasondotstar has joined #openstack-nova09:37
*** bkopilov has quit IRC09:38
openstackgerritPeter Savage proposed openstack/python-novaclient: Added marker functionality to flavours and images  https://review.openstack.org/19321209:38
*** bkopilov has joined #openstack-nova09:38
openstackgerritRui Chen proposed openstack/nova: Set task_state=None when booting instance failed  https://review.openstack.org/18714509:38
openstackgerritRui Chen proposed openstack/nova: Refactor network API 'get_instance_nw_info'  https://review.openstack.org/14603609:38
johnthetubaguytonyb: its several rooms joined together, which makes the in room mic situation a bit tricky, from what he mentioned, although one good mic in the middle can go a long way to help I guess09:40
*** nihilifer_ has joined #openstack-nova09:40
bauzasjohnthetubaguy: I'm a bit lost with that, does that mean there could be multiple discussions (and agendas) at the same time ?09:41
tonybjohnthetubaguy: Yeah esp if we plan ahead a little so that discussions where remote people like bauzas are in the room with the mic09:41
tonybanyway /me stops -1'ing patches and checks if he's still married ;P09:42
tonybbauzas: Thanks for you help.09:42
bauzastonyb: np, I now have to write down some thougts09:43
lxslitonyb: pretty sure you are though mikal may be asleep by now09:44
rgerganovclaudiub: please remove your -1 on https://review.openstack.org/13562509:44
johnthetubaguybauzas: no, its just tricky with AV equipment in that room09:44
bauzasjohnthetubaguy: you mean about the room capacity ?09:45
*** nihilifer has quit IRC09:46
johnthetubaguybauzas: no its just each room has its own mic and speakers, so its tricky when we are spread between the rooms, at least thats my impression09:46
*** nihilifer_ has quit IRC09:46
bauzasjohnthetubaguy: aaaah, but all the attendees are in the same room at the same time ?.09:46
*** nihilifer has joined #openstack-nova09:47
johnthetubaguytonyb: +1 for planning ahead a bit, I was hoping mriedman and mikal would start an etherpad off and things for that soon, I should ping them about that09:47
johnthetubaguybauzas: yeah, its just the "one" room is actually multiple rooms with some walls opened, I think09:47
*** otter768 has joined #openstack-nova09:48
bauzasjohnthetubaguy: oh ack09:48
bauzasjohnthetubaguy: anyway, I don't want to slow down the discussions09:49
johnthetubaguybauzas: I mean it should be OK, well as OK as normal, just not sure we can count on any in room audio stuff, although I am sure we can work around most of that quite easily09:49
bauzasjohnthetubaguy: so if I can hear, that's cool, but I should probably only lurk09:49
bauzasjohnthetubaguy: since you know, I'm like very slow when speaking09:50
danpbhmm, gerrit seens to have gone awol09:50
bauzasusually, I mean09:50
*** nihilifer_ has joined #openstack-nova09:50
johnthetubaguydanpb: ah, so its not just me, thats some good news09:50
kashyapAh, I thought it was just me. /me was feverishly refreshing a review like for 4 times.09:50
*** oomichi has joined #openstack-nova09:51
danpbjohnthetubaguy: http://downforeveryoneorjustme.com/review.openstack.org says its everyone :-)09:51
kashyapIt's back up. It's told me "it's just you" :-)09:52
*** deepthi has joined #openstack-nova09:53
*** otter768 has quit IRC09:53
*** xgsa has quit IRC09:53
*** nihilifer has quit IRC09:54
*** oomichi has quit IRC09:54
bauzasdanpb: oooooh, I love that website, so handy09:56
*** yassine_ has quit IRC09:57
*** oomichi has joined #openstack-nova09:57
sahidjohnthetubaguy: hello, any chance you take a look at https://review.openstack.org/#/c/139688/ ?09:57
sahidi think we were close09:58
johnthetubaguysahid: its on my massive queue09:58
sahidahah... yes :)09:58
*** humble__ has quit IRC09:58
johnthetubaguysahid: there are currenly 60 specs that need a review09:59
sahidjohnthetubaguy: yes i try to help by pointing them close to be merged10:00
sahidalready +2ed for example to make a wipe10:00
*** chen12 has quit IRC10:00
*** nihilifer_ has quit IRC10:00
*** chen12 has joined #openstack-nova10:00
*** dims has joined #openstack-nova10:06
*** xgsa has joined #openstack-nova10:07
*** ndipanov has joined #openstack-nova10:07
*** oro has joined #openstack-nova10:09
*** IanGovett has joined #openstack-nova10:13
*** fawadkhaliq has quit IRC10:15
*** avishay_ has quit IRC10:16
*** avishay__ has joined #openstack-nova10:16
*** Nisha_away has quit IRC10:19
*** oro has quit IRC10:19
*** thorst has joined #openstack-nova10:20
*** cing has quit IRC10:20
openstackgerritMoshe Levi proposed openstack/nova-specs: Add spec to enhance PCI passthrough whitelist to support regex  https://review.openstack.org/17957710:25
*** tojuvone has quit IRC10:25
*** varunarya has joined #openstack-nova10:26
*** salv-orlando has quit IRC10:29
johnthetubaguysahid: about the set admin root password thing, I think we need to add a note in there about the guest agent, as danpb mentioned in his comments10:29
johnthetubaguysahid: thanks for the other updates though, I am good to merge it apart from that detail, its different to how xenapi works, so I think its worth calling out (well its a different image property, I think, because its a different required guest agent)10:30
*** oomichi has quit IRC10:31
sudiptojohnthetubaguy, do you consider this good for merge now: https://review.openstack.org/#/c/180983/ ?10:31
sudiptojohnthetubaguy, sorry if it's already in your queue :)10:31
johnthetubaguysudipto: its on my list10:31
sudiptojohnthetubaguy, thx.10:31
markus_zkashyap: FYI: http://docs-draft.openstack.org/21/191021/4/check/gate-nova-docs/edb3901//doc/build/html/vmstates.html10:38
garykdanpb: would it be possible that you please look at https://review.openstack.org/19267510:38
kashyapmarkus_z: Yep, thanks.10:38
*** tobe has quit IRC10:39
*** ociuhandu has joined #openstack-nova10:40
*** doron_afk has quit IRC10:40
openstackgerritSylvain Bauza proposed openstack/nova: WIP: Deprecate TrusterFilter  https://review.openstack.org/19459210:41
bauzasjohnthetubaguy: tonyb: FYI http://lists.openstack.org/pipermail/openstack-dev/2015-June/067766.html10:42
* bauzas going out to lunch10:42
* johnthetubaguy is now thinking about lunch... mmm, food, yummy10:43
sahiddanpb: about hw_qemu_guest_agent10:48
* StevenK is currently cooking spaghetti for dinner if that helps johnthetubaguy at all ...10:48
*** pbrooko has quit IRC10:49
openstackgerritMark Goddard proposed openstack/nova: Refresh instance info cache within lock  https://review.openstack.org/19459710:49
sahid'im not sure it is relevant to ask user to set this property, why not just ccatach exception raised from libvirt if the agent in not running?10:49
johnthetubaguysahid: so from what danpb said, the user has to do that, else libvirt will just not contact the guest agent, or something like that10:50
johnthetubaguysahid: seems to be what happens already10:51
*** doron_afk has joined #openstack-nova10:51
johnthetubaguysahid: it should really be something the deployer sets on the base images and gets inherited by snapshots, so it is not "too" exposed to the user, in theory, although ideally we could just detect all this stuff10:51
johnthetubaguyStevenK: :)10:52
sahidjohnthetubaguy: hum... we do a manual check in the driver before to invoke libvirt10:52
openstackgerritMark Goddard proposed openstack/nova: Refresh instance info cache within lock  https://review.openstack.org/19459710:53
sahidyes i guess that makes sense we can do the job in the API to return the error directly10:53
sahidif image does not have the requirement10:53
johnthetubaguysahid: so I think thats what XenAPI does in some cases, but I don't 100% remember10:54
johnthetubaguysahid: can't be done in the API though, its driver specific10:54
*** coolsvap is now known as coolsvap|away10:55
sahidjohnthetubaguy: yes we need some specific information like virt_type which is driver specific10:55
*** yamahata has quit IRC10:55
johnthetubaguysahid: so this sucks, its a cast, so the API just silently returns success: https://github.com/openstack/nova/blob/master/nova/virt/xenapi/vmops.py#L130910:55
johnthetubaguysahid: my bad, it is already kinda handled: https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L299610:56
*** lyarwood has quit IRC10:57
johnthetubaguysahid: I would just follow the existing pattern for now10:57
*** lyarwood has joined #openstack-nova10:57
sahidjohnthetubaguy: ok no problem let's do that10:57
*** gszasz has joined #openstack-nova10:58
openstackgerritsahid proposed openstack/nova-specs: libvirt: set admin root password  https://review.openstack.org/18750910:59
*** jamielennox is now known as jamielennox|away11:00
johnthetubaguysahid: do ping me when you have that updated, and I can ack that to speed things up11:03
*** markvoelker has joined #openstack-nova11:06
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Add rootwrap daemon mode support  https://review.openstack.org/18069511:07
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: [WIP] Add timing information for rootwrap daemon  https://review.openstack.org/19460211:07
sahidjohnthetubaguy: it's done11:07
sahidin the user impact section11:07
*** hanzhang has quit IRC11:07
johnthetubaguysahid: you got the link handy?11:07
sahidhttps://review.openstack.org/#/c/187509/6/specs/liberty/approved/libvirt-set-admin-password.rst,cm11:07
*** liusheng has quit IRC11:08
*** RuiChen has quit IRC11:08
*** liusheng has joined #openstack-nova11:08
*** kiwik-chenrui has joined #openstack-nova11:08
*** hanzhang has joined #openstack-nova11:08
johnthetubaguysahid: I was thinking a bit more detail, but I think that will become very clear when you start coding, so I will go for that one, thanks11:09
sahidoops :)11:10
*** tojuvone has joined #openstack-nova11:10
*** markvoelker has quit IRC11:11
*** Alexandra_ has quit IRC11:11
*** mpavone has joined #openstack-nova11:11
*** irenab has quit IRC11:12
*** irenab has joined #openstack-nova11:13
*** ZZelle has quit IRC11:14
*** ZZelle has joined #openstack-nova11:14
*** varunarya has quit IRC11:15
openstackgerritDaniel Berrange proposed openstack/nova-specs: VIF port config versioned objects and driver plugin library  https://review.openstack.org/19366811:15
*** aix has quit IRC11:15
prashupsahid11:17
prashupi was making the change in v2.111:17
prashupbut i dont know how to test v2.1 from CLI11:17
prashuphelp !!!!11:17
prashup@sahid ^^^11:17
sahidprashup: ?11:19
abhishekkprashup: you need to use curl11:20
johnthetubaguyprashup: I think there is a spec talk talks about adding the CLI support for v2.1, not sure its approved yet11:20
prashupthere is no way to test v2.1 from CLI ??11:20
abhishekkprashup: no as of now11:20
prashupok11:21
prashupi m new to nova, openstack and this would be mine first checkin.11:21
prashupcan you guys tell me how to test it through curl request?11:21
abhishekkprashup: ohhh11:21
prashupor any doc i can go through11:21
prashup?11:21
abhishekkprashup: api.openstack.org might be useful11:22
openstackgerritDaniel Berrange proposed openstack/nova-specs: VIF port config versioned objects and driver plugin library  https://review.openstack.org/19366811:22
prashupthanks11:22
abhishekkprashup: which command you want to run?11:22
prashupnova boot11:22
prashupboot from volume to be specific11:23
*** baoli has joined #openstack-nova11:23
abhishekkprashup: ok, I will give you the curl command, you need to change token and host in that command11:23
*** yassine_ has joined #openstack-nova11:24
prashuphow would i get token ? when i see nova CLI using debug flag i see it takes care of it11:24
* johnthetubaguy runs away to lunch11:24
*** oro has joined #openstack-nova11:24
abhishekkprashup: keystone token-get, when you are running curl command then you need to generate token by yourself and pass it to curl11:27
openstackgerritClaudiu Belu proposed openstack/nova-specs: Adds Hyper-V Shielded VMs spec  https://review.openstack.org/19289211:28
*** aix has joined #openstack-nova11:28
*** jcoufal has quit IRC11:29
*** salv-orlando has joined #openstack-nova11:30
abhishekkprashup: curl -g -i -X POST http://10.69.4.177:8774/v2.1/cdce26c324134f65aa2424f25574f1a5/os-volumes_boot -H "User-Agent: python-novaclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-Auth-Token: 0a9563261c04449bbd63ecc9af2d873d" -d '{"server": {"name": "nova1", "imageRef": "", "block_device_mapping_v2": [{"source_type": "volume", "delete_on_termination": false, "boot_index": 0, "uuid": "2edda400-6b10-4118-bb32-1d1611:30
abhishekkd5c5c1a0", "destination_type": "volume"}], "flavorRef": "2", "max_count": 1, "min_count": 1}}'11:30
abhishekkprashup: replace 10.69.4.177 with your controller node ip and "0a9563261c04449bbd63ecc9af2d873d" with id of "keystone token-get" output11:31
*** lyarwood has quit IRC11:33
*** lyarwood has joined #openstack-nova11:33
*** salv-orlando has quit IRC11:36
prashupsure thanks abhishekk11:37
abhishekkprashup: also you need to pass voume_id in uuid :)11:37
prashupyeah that i will11:38
prashup:)11:38
abhishekkprashup: great11:38
prashupi will also need to add size11:38
prashup;)11:38
*** kiran-r has joined #openstack-nova11:38
*** ociuhandu has quit IRC11:39
*** doron_afk is now known as doron_11:39
abhishekk:)11:41
*** lucasagomes is now known as lucas-hungry11:42
*** pbrooko has joined #openstack-nova11:42
*** deepthi has quit IRC11:43
*** zhenguo has quit IRC11:43
*** novaUser has joined #openstack-nova11:44
*** novaUser has left #openstack-nova11:44
*** sdake has joined #openstack-nova11:46
*** prashup has quit IRC11:46
*** sdake_ has joined #openstack-nova11:47
*** otter768 has joined #openstack-nova11:49
*** dprince has joined #openstack-nova11:49
*** otter768 has quit IRC11:50
*** otter768 has joined #openstack-nova11:50
*** sdake has quit IRC11:50
*** avishay__ has quit IRC11:53
*** salv-orlando has joined #openstack-nova11:54
*** sdake_ has quit IRC11:54
*** husanu has quit IRC11:56
*** fawadkhaliq has joined #openstack-nova11:57
*** husanu has joined #openstack-nova11:58
*** ociuhandu has joined #openstack-nova11:59
*** mpavone has quit IRC12:00
*** otter768 has quit IRC12:00
openstackgerritPetrut Lucian proposed openstack/nova: Hyper-V: Fixes method retrieving free SCSI controller slot on V1  https://review.openstack.org/19461612:02
*** moshele has quit IRC12:02
*** pask81 has joined #openstack-nova12:05
*** markvoelker has joined #openstack-nova12:05
*** mtanino has joined #openstack-nova12:05
*** jasondotstar has quit IRC12:06
*** kes has joined #openstack-nova12:06
openstackgerritPeter Savage proposed openstack/python-novaclient: Added marker functionality to flavours and images  https://review.openstack.org/19321212:06
*** sudipto has quit IRC12:07
*** romainh has quit IRC12:09
markus_zanybody here from XEN?12:10
*** obondarev has quit IRC12:10
openstackgerritsean mooney proposed openstack/nova-specs: Filter - aggregate flavour extra spec affinity filter  https://review.openstack.org/18387612:11
BobBallsure markus_z12:12
openstackgerritAlexandre Levine proposed openstack/nova-specs: delete_on_termination modification spec  https://review.openstack.org/19414412:12
openstackgerritSergey Nikitin proposed openstack/nova: Added server tags support in nova-api  https://review.openstack.org/12894012:13
markus_zBobBall: Cool, can you maybe help me to understand the "host maintenance mode"?12:13
BobBallBest to ask that in #xen-api12:13
markus_zBobBall: Could it be that the "evacuate instances from host" is the same: http://docs.openstack.org/developer/nova/support-matrix.html#operation_evacuate12:13
BobBalloh12:13
BobBallNot really12:13
BobBallWell - do you mean host maintenance mode in XAPI?12:14
BobBallor in openstack in general?12:14
*** pask81 has quit IRC12:14
samueldmqsdague: morning12:14
*** moshele has joined #openstack-nova12:15
sdaguesamueldmq: morning12:15
markus_zBobBall: I'm confused what the feature means in the support matrix from OpenStack.12:15
samueldmqsdague: I'd like to agree with you the points in the meeting today that would be the most productive for both nova and keystone sides12:15
markus_zThe title and the text doesn't fit together12:15
*** raildo has joined #openstack-nova12:15
*** claudiub has quit IRC12:15
sdaguesamueldmq: sounds good, what are you thinking?12:15
samueldmqsdague: I think i) unified vs not unified, and then if not unified: CMS or /policy ?12:16
BobBallGot it.  The feature is effectively that if you want to do maintenance on a host then you can evacuate all instances and mark the host as being in maintenance mode.  Once all instances are off you can then power down the host and replace a HDD or whatever then bring it out of this "maintenance mode"12:16
markus_zBobBall: The funny thing is, the XEN driver does an evacuate when setting the host in maintenance mode: https://github.com/openstack/nova/blob/master/nova/virt/xenapi/host.py#L5612:16
sdaguesamueldmq: define what you mean by unified or not unified?12:16
samueldmqsdague: (I am not assuming we've agreed on anything, just exploring the possibilities)12:16
samueldmqsdague: unified policy, what ayoung wants12:16
markus_zBobBall: OK, that means the title in the support matrix is wrong, isn't it?12:17
*** ctrath has joined #openstack-nova12:17
sdagueunified meaning that keystone owns all the policy files?12:17
BobBallI think the official name is "Evacuate host" rather than putting it into maintenance mode.  johnthetubaguy?12:17
samueldmqsdague: yes somehow, and has all those problems with microversions, people running on master, etc12:17
johnthetubaguyBobBall: we have things in the API, I believe12:17
sdaguesamueldmq: right, which I think it is a non starter :)12:17
johnthetubaguyBobBall: I mean, we have both things in the API12:17
sdaguebut sure, we can discuss that part first12:18
samueldmqsdague: he isn't still convinced, so the meeting is a good place to talk all together, and have an agreement12:18
samueldmqsdague: yes but I think this is the major disagreement we have right now12:18
johnthetubaguymarkus_z: I want to remove that xenapi stuff really, its totally untested, and just doesn't map very well12:18
*** VW_ has joined #openstack-nova12:18
markus_zBobBall: I tried to clarify it via ML http://openstack.markmail.org/thread/nd37hdnop3zelzbk12:18
*** mgarza_ has joined #openstack-nova12:19
BobBallWell my interpretation of that feature is that the header is correct12:19
samueldmqsdague: besides that, we should be ok in something like we've in those sequence diagrams (not assuming /policy or CMS)12:19
samueldmqsdague: sounds good this first point ?12:19
sdagueyeh, that sounds reasonable. Honestly though, I feel like it doesn't turn into an execution plan.12:19
sdaguebecause an execution plan is "what's the first incremental step forward"12:20
BobBallAh - joy.  I see that this is another case of something being implemented in two places historically :)12:20
johnthetubaguyBobBall: evacuate is nothing to do with maintenance mode stuff12:20
BobBallNo?12:20
BobBallOK then I'm confused too12:20
markus_zjohnthetubaguy: I still don't get my head around what the expectations are when starting "host maintenance mode".12:20
openstackgerritDaniel Berrange proposed openstack/nova: libvirt: mark NUMA huge page mappings as shared access  https://review.openstack.org/17636012:20
samueldmqsdague: no that's not the execution plan at all, that's the agreement on the roadmap12:21
johnthetubaguymarkus_z: its a complete mess around host maintenance mode, frankly the current feature is totally usable, IMHO12:21
*** oro has quit IRC12:21
johnthetubaguyBobBall: evacuate is about when a host is dead, and to do your best to start the instance on a new host12:21
sdaguesamueldmq: so... I feel like it is both too detailed and not detailed enough. I think the roadmap shouldn't be sequence diagrams12:22
johnthetubaguyBobBall: if its not boot from volume, it will look to the user like a rebuild (i.e. they loose all their data)12:22
sdaguethe roadmap should be a vision12:22
BobBallOK - so there is no OpenStack way of saying "Let's take this host out of usage for some maintenance"12:22
BobBall(apart from this maintenance mode for XenAPI)12:22
sdagueand then we think about the things that could be done to get us closer to that vision, that would have incremental benefits, and support getting closer to it over time12:22
samueldmqsdague: ok the sequence diagrams tehre are the scope for L12:23
johnthetubaguysdague: samueldmq: I am very curious about the context around roadmaps?12:23
samueldmqsdague: what I am trying to do there is to i) roadmap and ii) scope for L, based on roadmap12:23
samueldmqsdague: if that makes snese12:23
* bauzas notices review.o.o is still on holiday12:23
samueldmqjohnthetubaguy: hi, we're talking about dynamic policies corss-porject effort :)12:23
BobBallbauzas: WFM12:24
*** claudiub has joined #openstack-nova12:24
*** kiran-r has quit IRC12:24
johnthetubaguysamueldmq: ah, gotcha12:24
sdaguesamueldmq: sure, I guess, we disagree on the fact that those sequence diagrams are scope for L12:24
bauzasBobBall: fixed just now12:24
samueldmqjohnthetubaguy: we've some initial iteration on ideas from keystone side (https://wiki.openstack.org/wiki/DynamicPolicies)12:24
bauzasBobBall: was not working like 5 secs before12:24
BobBallheh :)12:24
samueldmqjohnthetubaguy: and now we come here to hear you guys, your needs, requirements and ideas12:24
johnthetubaguybauzas: its been really flakey this morning12:24
bauzasjohnthetubaguy: just joined -infra, saw some discussion in there, will see12:25
samueldmqsdague: that's an initial iteration, that will change once we introduce nova requirements/needs/ideas12:25
samueldmqsdague: don't see that as something wrote in stone, we're open, remember12:25
*** zzz_pczesno is now known as pczesno12:25
sdaguesamueldmq: ok, sure12:25
*** ivasev has joined #openstack-nova12:25
samueldmqsdague: so point i) we get agreement on wheter unify or not12:25
*** pask81 has joined #openstack-nova12:25
johnthetubaguysamueldmq: so I am actually very against policy being updated via API, I want it to happen in sync with my code deploy really, and like all the other configuration I push out12:26
johnthetubaguysamueldmq: now a lot of the other parts are super useful12:26
*** mpavone has joined #openstack-nova12:26
*** aysyanne has joined #openstack-nova12:26
*** agentle has joined #openstack-nova12:26
*** pask81 has quit IRC12:26
*** pask81 has joined #openstack-nova12:27
johnthetubaguysdague: we should totally tidy up our policy plan, and share that with keystone, seems like our ideas our converging12:27
markus_zjohnthetubaguy: BobBall: Should the title "Evacuate instances from host" be "Set host into maintenance mode"? This would mean a "missing" for s390x too.12:27
sdaguejohnthetubaguy: well, it's all colliding here12:27
sdaguethe keystone meeting today is going to be part of this discussion12:27
markus_zI put a "complete" into it because I thought the "nova evacuate" calls are meant.12:27
openstackgerritsahid proposed openstack/nova: libvirt: add os_admin_user to use with set admin password  https://review.openstack.org/18592112:27
openstackgerritsahid proposed openstack/nova: libvirt: enchance libvirt to set admin password  https://review.openstack.org/18591012:27
johnthetubaguysamueldmq: my feedback on that wiki is mostly that its not clear what problems you are trying to solve, but maybe thats just how I think about things, not sure12:28
johnthetubaguysdague: ah, OK12:28
samueldmqsdague: point ii) we try to redefine scope for L12:28
*** edmondsw has joined #openstack-nova12:28
BobBallmarkus_z: That'd work for me - clearly a quicker fix than working out what to do properly with the XenAPI implementation.12:28
johnthetubaguymarkus_z: BobBall: you are mixing up two different things here I think, I would talk about "nova evacuate <server-uuid>" and its per instance not per host12:29
bauzasjohnthetubaguy: that's sometimes confusing because the CLI provides an host-evacuate stuff which calls sequentially the evacuate API12:30
samueldmqjohnthetubaguy: I don't understand what 'very against policy being updated via API', so the policy should not be able to be updated via API ?12:30
markus_zjohnthetubaguy: There is "nova host-evacuate <host>" too12:30
johnthetubaguymarkus_z: BobBall: there are plans to deprecating that current hypervisor metrics to be replaced by a new more explicit "feature classification" system, but I haven't started work on that yet12:30
johnthetubaguybauzas: agreed12:30
*** atuvenie has joined #openstack-nova12:30
samueldmqsdague: is that something we're still missing in the discussion ^?12:30
johnthetubaguysamueldmq: I think its important to update policy at the same time you update your code, and A/B test policy, etc, like its possible today12:31
sdaguesamueldmq: I think it comes down to the fact there is no vision here12:31
*** aix has quit IRC12:31
johnthetubaguysamueldmq: now maybe some of that is silly, but its quite a change that I suspect deployers will have a strong opinion on, I guess12:32
*** fawadkhaliq has quit IRC12:32
*** romainh has joined #openstack-nova12:32
sdagueand policy means different things to different parts of the openstack stack. For instance, in nova we're mostly thinking about policy in terms of very granular function points. And all my conversations in keystone talk about the benefits here in expanding the custom roles that can exist.12:32
sdaguejohnthetubaguy: so, if this was in layers12:33
johnthetubaguysdague: good point, I like the idea of keystone "owning" the definition of a role, FWIW12:33
sdaguepolicy in code, policy in patch files, policy applied dynamically via API12:33
sdagueyou wouldn't be opposed to an API right?12:33
sdagueyou are just opposed to an API as base source of truth12:33
johnthetubaguysdague: yeah, thats a good way of putting it12:34
johnthetubaguysdague: dymanic overide seems handy, but seems like a massive PITA for most of the changes12:34
*** ivasev has quit IRC12:34
johnthetubaguysdague: mostly wearing my large deployer hat for that bit of the conversation12:35
samueldmqsdague: nice, the way johnthetubaguy I understood him liek against the API to changing policy rules/roles dynamically, and that basically would be against all dynamic policy work12:35
*** agentle has quit IRC12:35
*** agentle has joined #openstack-nova12:36
johnthetubaguysamueldmq: yeah, I am cool with the dynamic, just moving to all dynamic seems like a disaster12:36
*** bkopilov has quit IRC12:36
BobBalljohnthetubaguy: Don't suppose you know what step is in progress with spawn stalled at 70%?12:36
johnthetubaguy(but I don't feel like I am not seeing the full picture here, yet)12:36
*** ajayaa has quit IRC12:37
*** MVenesio has joined #openstack-nova12:37
samueldmqjohnthetubaguy: we're basically moving from the old .json files, and allowing admins to customize via API, getting warnings if changing the defaults (cc sdague)12:37
johnthetubaguyBobBall: agent is 80% I guess its the one before12:37
sdaguejohnthetubaguy: yeh, I think the issue is there really isn't a full picture as of yet12:37
samueldmqjohnthetubaguy: also, we could do some validation on the rules, for example, roles used in policy rules MUST exist12:37
sdagueso I picked together all the things I thought were must haves for people, and built my own picture, and am just telling that to everyone :)12:37
johnthetubaguysdague: yep, I have something similar in my head12:38
samueldmqjohnthetubaguy: basically we would be guiding people to write policies the right way12:38
johnthetubaguysdague: although, to you point, its a different partial picture12:38
samueldmqjohnthetubaguy: also, better defaults policies in the oopenstack ecosystem is on the roadmap :)12:38
*** tojuvone has quit IRC12:38
*** tojuvone has joined #openstack-nova12:38
markus_zjohnthetubaguy: I'm very interested in that new feature classification system. If you need support, call me.12:39
*** kylek3h has quit IRC12:39
johnthetubaguysamueldmq: so I don't see the wiki having a listing of problems we are trying to solve, I mean it sounds cool, but I am worried about it12:39
johnthetubaguymarkus_z: thanks for the offer, I want to get that kicked off, but yes, will need lots of help with that :)12:39
kashyapmarkus_z: Where is the feature classifcation stuff?12:39
samueldmqjohnthetubaguy: ok so the issues behind the usecases, right ?12:39
*** MVenesio has quit IRC12:39
johnthetubaguykashyap: doesn't exist yet, its in my head, as discussed at the summit12:39
kashyapAh, okay.12:40
johnthetubaguysamueldmq: not really, ignore the use cases, talk about issues deployers and devs have today, then see where that goes12:40
markus_zIs there an etherpad of the discussion? I couldn't attent the last summit. I'll be at the midcycle event in July.12:40
markus_zjohnthetubaguy: ^12:41
johnthetubaguymarkus_z: kashyap: https://wiki.openstack.org/wiki/Design_Summit/Liberty/Etherpads#Nova then see: https://etherpad.openstack.org/p/YVR-nova-functional-testing-feature-classification12:41
markus_zthanks12:41
openstackgerritAlexandre Levine proposed openstack/nova-specs: delete_on_termination modification spec  https://review.openstack.org/19414412:41
*** prashup has joined #openstack-nova12:42
*** dave-mccowan has joined #openstack-nova12:42
*** boris-42 has quit IRC12:42
johnthetubaguysamueldmq: the problem is we really need to capture how our users use the current system, deploying policy just like any other configuration, different policy for different API endpoints, and all that kind of thing12:42
*** lucas-hungry is now known as lucasagomes12:43
*** mwagner_afk has joined #openstack-nova12:43
johnthetubaguysamueldmq: certainly we have four types of nova-api nodes, two types of keystone, with different policy for each, three or four types of compute "admin" / "support", etc, etc12:43
*** ivasev has joined #openstack-nova12:43
johnthetubaguysamueldmq: I mean there is an argument that says most of that is totally nuts, but its what people are doing today12:43
samueldmqjohnthetubaguy: oh sure, different endpoints can have different policies12:44
johnthetubaguysamueldmq: and when you deploy the new code, you have old APIs with the old policy, and new APIs with the new policy, and you drain and go from one to the other, each having been though QA independently to check they work, etc, etc.12:45
johnthetubaguyall part of the same endpoint, but behind a loadbalancer that deals with the draining, etc12:45
samueldmqjohnthetubaguy: if they're behind a loadbalancer, they will have the same endpoint URL, which implies they'll all have the same policy12:46
samueldmqjohnthetubaguy: we'll take care of this fetching/caching strategy at keystonemiddleware12:46
johnthetubaguysamueldmq: they don't have the same policy during the deployment of new code12:46
*** aix has joined #openstack-nova12:47
samueldmqjohnthetubaguy: how can you provide different versions of the same service behind a, lets's say, HAProxy ?12:47
johnthetubaguysamueldmq: older code runs on older (tested) policy, new code starts using the new policy, (think live upgrades).12:47
*** rfolco has joined #openstack-nova12:47
johnthetubaguysamueldmq: the REST API is backwards compatible, so you can slowly update the nodes without people noticing12:48
samueldmqjohnthetubaguy: the policy should be backwards compatible as well, shoudln't it ?12:49
johnthetubaguysamueldmq: yes, but its not QAed like that currently, as it goes out with the new code, which is nice and simple, just like how all other config works12:49
*** pask81 has quit IRC12:50
samueldmqjohnthetubaguy: that will be very easy to do with microversions, and how we represent them in the polciy file12:50
johnthetubaguysamueldmq: not saying it has to be like that always, just saying, you are fundamentally changing how our deployment process would have to work, so thats going to take time to evolve12:50
*** pask81 has joined #openstack-nova12:50
samueldmqjohnthetubaguy: let's say we do like : 'create_server': {'2.0':'role:admin', '2.1':'role:admin or role:server_admin'}12:50
samueldmqjohnthetubaguy: we shouldn't change the policy for a given microvesion12:51
*** amotoki has joined #openstack-nova12:51
*** coolsvap|away is now known as coolsvap12:51
samueldmqjohnthetubaguy: to keep compatibility, it is shipped with the api microversion altogether12:51
samueldmqjohnthetubaguy: if that makes sense12:51
johnthetubaguysamueldmq: its more about the QA process, you test the new policy, you A/B test it on your production nodes, then finally flip it across12:51
*** salv-orlando has quit IRC12:52
johnthetubaguysamueldmq: that can be independent or directly tied to code changes12:52
johnthetubaguynow its a use case we might want to exclude, but we need a transition period, etc, etc12:52
johnthetubaguysamueldmq: all as I am saying is having an API to change policy isn't a requirement I have as a deployer, it would be much more hard work than just a .json file that my ansible scripts update in a nice controlled way12:53
*** atuvenie_ has joined #openstack-nova12:54
johnthetubaguyanyways, I should really find a way of writing this up, IRC is getting no where here12:54
openstackgerritDaniel Berrange proposed openstack/nova: libvirt: set caps on maximum live migration time  https://review.openstack.org/16225412:55
openstackgerritDaniel Berrange proposed openstack/nova: libvirt: support management of downtime during migration  https://review.openstack.org/16225312:55
*** toure has joined #openstack-nova12:56
samueldmqjohnthetubaguy: yes please do, keystone is very open to hear to potential corner cases, concerns in this subject12:57
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Add rootwrap daemon mode support  https://review.openstack.org/18069512:57
samueldmqjohnthetubaguy: that's what sdague did, he has some concerns/ideas, and we'll be discussing some of them today12:57
openstackgerritAlex Xu proposed openstack/nova-specs: Allow specifying cpu model/features in flavor extra-specs or image metadata  https://review.openstack.org/16898212:57
*** atuvenie has quit IRC12:57
openstackgerritDaniel Berrange proposed openstack/nova: ironic: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18936212:58
openstackgerritDaniel Berrange proposed openstack/nova: objects: convert config drive to use ImageMeta object  https://review.openstack.org/18932312:58
openstackgerritDaniel Berrange proposed openstack/nova: libvirt: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18811912:58
openstackgerritDaniel Berrange proposed openstack/nova: libvirt: make instance compulsory in blockinfo APIs  https://review.openstack.org/18811812:58
openstackgerritDaniel Berrange proposed openstack/nova: utils: ignore block device mapping in system metadata  https://review.openstack.org/19262712:58
openstackgerritDaniel Berrange proposed openstack/nova: hyperv: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18930212:58
openstackgerritDaniel Berrange proposed openstack/nova: objects: add virtual 'image_meta' property to Instance object  https://review.openstack.org/19014512:58
openstackgerritDaniel Berrange proposed openstack/nova: virt: convert hardware module to use nova.objects.ImageMeta  https://review.openstack.org/18878912:58
openstackgerritDaniel Berrange proposed openstack/nova: libvirt: convert to use instance.image_meta property  https://review.openstack.org/19014612:58
openstackgerritDaniel Berrange proposed openstack/nova: compute: convert manager to use nova.objects.ImageMeta  https://review.openstack.org/18968512:58
openstackgerritDaniel Berrange proposed openstack/nova: xenapi: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18879012:58
samueldmqjohnthetubaguy: the idea is to have a big win in this dynamic policy subject all togehter, if you have important concerns, please come with them from the beggining12:58
samueldmqjohnthetubaguy: you're also invited to the keystone meeting today (18 utc)12:58
johnthetubaguysamueldmq: I guess my thing, is I hope we don't have to loose static policy, for where thats useful12:58
samueldmqjohnthetubaguy: so you still want ot have the old policy.json files ? and always be customizing inside them using an out-of-band mechanism?12:59
samueldmqjohnthetubaguy: no change to what we have today in the way they're distributed/customized?12:59
openstackgerritVladik Romanovsky proposed openstack/nova-specs: libvirt: virtio-net multiqueue  https://review.openstack.org/12882513:00
johnthetubaguysamueldmq: the idea in my head seems to want the old policy files, basically, but with the addition of dynamic policy over-rides13:00
sdaguesamueldmq: right, so that's the part which isn't all that clear, and why we need a big vision of where we are going.13:00
sdagueand a concept level description13:01
johnthetubaguysamueldmq: over time, you could consider removing the static policy files, if people don't want them anymore, so you get a smooth transition from the old world to the new world13:01
*** coolsvap is now known as coolsvap|away13:01
samueldmqjohnthetubaguy: sdague so keep the static policy files consistent with the defaults in the code in nova13:01
samueldmqjohnthetubaguy: so if people don't want to use policy.json they enable dynamic policies13:01
samueldmqwe plan to be backwards compatible13:02
*** moshele has quit IRC13:02
*** xyang1 has joined #openstack-nova13:02
*** mpavone has quit IRC13:02
johnthetubaguysamueldmq: I want the default policy file empty, well full of comments, generated from the policy thats in the code, but you want to be able to discover the policy and over-ride in the API, ideally13:02
samueldmqjohnthetubaguy: so policies would still be kept as today, nothing would be dynamic besides the generation of the policy.json in the nova side13:03
samueldmqsdague: yes I think we need that description13:03
samueldmqjohnthetubaguy: I'll write up a second version of that api, starting from the problems we're trying to solve13:04
johnthetubaguysamueldmq: I like the idea of over-riding the policy via an admin API call, but that would over-ride the existing systems13:04
johnthetubaguysamueldmq: that would be great13:04
samueldmqjohnthetubaguy: sure that way we will be syncrhonizing13:04
samueldmqjohnthetubaguy: I think we're talking the same thing (at least the same direction) all the time, but in different languages13:05
samueldmqjohnthetubaguy: sdague I need to step in a meeting right now, talk to you later, thanks13:05
johnthetubaguysamueldmq: I think we are quite close here13:05
alex_xu_danpb, dansmith, appreciate some help on https://review.openstack.org/#/c/168982/10, I updated it using configration file to define the abstact cpumodel, hope I can catch the last chance before freeze13:05
*** sudipto has joined #openstack-nova13:06
*** moshele has joined #openstack-nova13:06
alex_xu_johnthetubaguy: ^ appreciate if you have time review that spec also :)13:06
*** prashup has quit IRC13:07
johnthetubaguysamueldmq: so the end user policy discoverability is the reason you need a sync I guess, but I keep thinking that needs to live in the projects, but thats a slightly separate conversation, potentially13:07
*** coolsvap|away is now known as coolsvap13:08
johnthetubaguyalex_xu_: can't promise right now, but thats surely an important one13:09
*** changbl_ has quit IRC13:17
alex_xu_johnthetubaguy: I understand, thanks anyway!13:17
*** elmiko has left #openstack-nova13:17
*** kylek3h has joined #openstack-nova13:17
*** jasondotstar has joined #openstack-nova13:17
*** scheuran has joined #openstack-nova13:17
*** openstack has quit IRC13:17
*** openstack has joined #openstack-nova13:18
-cameron.freenode.net- [freenode-info] if you're at a conference and other people are having trouble connecting, please mention it to staff: http://freenode.net/faq.shtml#gettinghelp13:18
*** _gryf is now known as _gryf|afk13:20
johnthetubaguybauzas: at least the freeze is getting folks to update their specs, but thats something for the nova-meeting on thursday I think, we need to keep folks productive, on both sides of the equation13:21
bauzasjohnthetubaguy: yeah, my take is that it seems people are just afraid of missing the deadline, so are just trying to ping many people asking for reviews13:21
ijuwang_awayback13:22
*** ijuwang_away is now known as ijuwang13:22
johnthetubaguybauzas: true13:24
*** abhishekk has quit IRC13:25
bauzasto be clear, people asking for reviews related to the scheduler can drop their changes in https://etherpad.openstack.org/p/liberty-nova-priorities-tracking L4713:27
ndipanovalso worth noting that 5 or so ppl that are on the spec core combined with 2x +2s are a massive bottleneck13:27
*** eharney has joined #openstack-nova13:27
*** mriedem has joined #openstack-nova13:27
ndipanovall of this was decided by inertia and never re-examined13:27
ndipanovnot to bring up all the other well known problems with the spec review process13:28
johnthetubaguyndipanov: thats exactly why I want all of nova-core to have +2 on there, but not +W, but I was voted down, but we need to revisit that13:28
ndipanovI am not surprised at all that you were voted down13:29
*** ajayaa has joined #openstack-nova13:29
mriedemthere was a vote? i just remember a lot of 'meh' and shoulder shrugging13:29
*** aix has quit IRC13:29
danpbjohnthetubaguy: you could declare yourself el presidente non-benevolent dictator for life and change it :-)13:29
*** prashup has joined #openstack-nova13:30
ndipanovI feel that specs work well for some things13:31
ndipanovand very poorly for others13:31
ndipanovand the issues where they don't work is where we hit problems13:32
*** kiwik-chenrui has quit IRC13:32
*** kiwik-chenrui has joined #openstack-nova13:32
*** sdake_ has joined #openstack-nova13:32
*** fawadkhaliq has joined #openstack-nova13:33
*** rlrossit has joined #openstack-nova13:33
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: [WIP] Add timing information for rootwrap daemon  https://review.openstack.org/19460213:34
scheuranHi I'm trying to get a new vif_type approved for liberty. Is there any process for this, especially due to the os-vif-library planned?13:34
scheurandoes this effort mean that new vif_types are totally blocked for liberty?13:34
ndipanovexample - some specs by bauzas and around cells were extremely useful for me to understand the problem and think about it13:35
johnthetubaguyndipanov: its normally us using specs poorly for some things13:35
johnthetubaguyndipanov: where you can't design it up front you shouldn't, I have been pushing hard on that in my reviews13:35
bauzasagreed on the fact that we need to incrementally find a good cursor for saying if it needs a spec or not13:36
*** artom has joined #openstack-nova13:36
dansmithwe've said "no need for a spec" more times this cycle than any others13:36
bauzasyup13:36
johnthetubaguydansmith: +113:36
dansmithsurely the incremental improvement plan applies to this process as well :)13:36
mriedemdansmith: johnthetubaguy: are specs needed for new vif types then?13:36
mriedemthose are fairly mechanical, like new libvirt volume drivers13:37
johnthetubaguymriedem: they are in my list of "stuck" specs right now13:37
*** artom has quit IRC13:37
mriedemscheuran: i'd get a bp and spec up today just in case the generic vif magic bullet doesn't happen13:37
ndipanovbut I find it hard to argue these things as I am in general for a default-to-open approach :)13:37
bauzastbc, I didn't want to open a can of worms, just try to see if we can lower the stress by saying "you miss the deadline ? no worries, we can still handle that if that deserves the project"13:37
*** thangp has joined #openstack-nova13:37
ndipanovwell tbh that's what I understood the "open" exception process to be...13:38
bauzasplease, don't see me trying to put the baby with the baby's bath water13:38
bauzass/put/throw or whatever good English metaphor applies here13:39
*** garyk has quit IRC13:39
*** fawadkhaliq has quit IRC13:39
scheuranmriedem: thx, it's already up - just needs another round of review13:39
openstackgerritwuhao proposed openstack/nova-specs: Add previous page links for Nova GET servers API  https://review.openstack.org/16504113:40
*** jecarey has joined #openstack-nova13:41
*** doron_ has quit IRC13:41
markus_zBobBall: About the "maintenance mode" thingy, I'll send an update on the mailing list. Would be great if you could have a look at it from a xen perspective.13:42
*** aix has joined #openstack-nova13:42
*** tonytan4ever has joined #openstack-nova13:42
mriedemscheuran: this is yours right? https://review.openstack.org/#/c/182280/13:42
scheuranmriedm: yes13:43
scheuranmriedm: I guess the big question is if it can be approved in parallel to the planned os-vif-library stuff, or if I should update the text in order to depend on the new way that is proposed13:45
*** vladikr has joined #openstack-nova13:45
mriedemscheuran: do you have a link to os-vif-library?13:45
mriedemi see two other specs that were approved for liberty already for new vif types13:45
mriedemhttp://specs.openstack.org/openstack/nova-specs/specs/liberty/approved/vif-driver-ib-passthrough.html13:45
mriedemhttp://specs.openstack.org/openstack/nova-specs/specs/liberty/approved/vif-type-tap.html13:45
scheuranhttps://review.openstack.org/#/c/19366813:46
*** coolsvap is now known as coolsvap|away13:46
danpbmriedem: oh hmm - i'd very much like us to refuse any vif types for liberty13:46
danpbuntil we have the os-vif stuff done13:47
danpbmriedem: url is https://review.openstack.org/#/c/193668/13:47
*** varunarya has joined #openstack-nova13:47
*** pczesno is now known as zzz_pczesno13:48
*** zzz_pczesno is now known as pczesno13:48
mriedemso we're also holding the volume driver specs hostage until os-brick? https://review.openstack.org/#/c/181941/ and https://review.openstack.org/#/c/184295/13:49
scheurandanpb: sure that would be the ideal thing, but in some cases it's just not possible to reuse an existing type due to different plug/unplug operations or to slightly different xml syntax13:49
mriedemscheuran: i think what danpb is saying is your new type goes in the os-vif-library13:50
mriedemthen nova and neutron use the shared library13:50
mriedemscheuran: we have the same issue with volume drivers copied between cinder and nova13:50
mriedemand os-brick is supposed to solve that13:50
ndipanovjohnthetubaguy, can we take a look at this - it's a bug fix, and it's stuck waiting for an opinion on some schema details that can easily be worked out in review13:50
ndipanovhttps://review.openstack.org/#/c/193576/13:50
*** kes has quit IRC13:51
*** ppal has joined #openstack-nova13:51
*** ppal has left #openstack-nova13:51
scheuranmriedem: yes, once it's there. Would you propose to update the spec in order to depend on the new os-vif project?13:51
openstackgerritSylvain Bauza proposed openstack/nova: Add to_dict() to ImageMeta and ImageMetaProps objects  https://review.openstack.org/18647413:52
openstackgerritSylvain Bauza proposed openstack/nova: Add RequestSpec methods for primitiving into dicts  https://review.openstack.org/18719713:52
openstackgerritSylvain Bauza proposed openstack/nova: Use RequestSpec object in HostManager  https://review.openstack.org/19125113:52
openstackgerritSylvain Bauza proposed openstack/nova: Use the same pci_requests field for all filters and HostManager  https://review.openstack.org/19125013:52
openstackgerritSylvain Bauza proposed openstack/nova: Remove unnecessary method in FilterScheduler  https://review.openstack.org/18848513:52
openstackgerritSylvain Bauza proposed openstack/nova: Consider that all scheduler calls are IO Ops  https://review.openstack.org/18848613:52
openstackgerritSylvain Bauza proposed openstack/nova: Create RequestSpec object  https://review.openstack.org/14552813:52
openstackgerritSylvain Bauza proposed openstack/nova: Use RequestSpec object in the FilterScheduler  https://review.openstack.org/18848713:52
bauzasjaypipes: heya13:52
danpbscheuran: the whole point of the os-vif project is to decouple the plug/unplug operations from the vif type, precisely so we can reuse them13:52
bauzasjaypipes: so sounds like I have to ping some people for asking for reviews ;)13:52
johnthetubaguyndipanov: its on my queue, but its a massive queue right now I am afraid13:52
*** ssurana has joined #openstack-nova13:52
*** salv-orlando has joined #openstack-nova13:52
bauzasjaypipes: because it's the general situation :)13:52
*** agentle has joined #openstack-nova13:53
scheurandanpb: right, I got that. The question is, how can I proceed with my new vif_type required?13:53
bauzasjaypipes: so given our lovely hangout, would appreciate if you could fire some comments for https://review.openstack.org/#/c/179224/ :)13:53
mriedemscheuran: it looks like your spec already calls out danpb's os-vif-library spec13:53
mriedemas a dependency13:53
scheurandanpb: should I update the spec and say, it will be implemented along the new approach (once approved)?13:54
*** mpavone has joined #openstack-nova13:54
scheuranmriedem: yes, but some details explain the part with the xml should still be implemented in the classical way13:54
scheuranbut I could generalize this13:54
*** moshele is now known as moshele_13:55
mriedemscheuran: have you reviewed https://review.openstack.org/#/c/193668/ and made sure it will work with what you need to do?13:55
jaypipesbauzas: yup, it's on my queue.13:55
*** xyang1 has quit IRC13:56
*** electrocucaracha has joined #openstack-nova13:56
*** salv-orlando has quit IRC13:57
scheuranmriedem: yes. Both directions would work. Getting the new vif_type in the old way, would not break this new feature. But I could also implement it in the new way13:57
scheuranmriedem: that would also work, if all the vif_types will be generalized like pointed out13:58
scheuranI already offered my help for bringing things forward....13:58
*** browne has joined #openstack-nova13:59
*** baoli has quit IRC13:59
*** rwsu has joined #openstack-nova14:01
*** otter768 has joined #openstack-nova14:01
*** agentle has quit IRC14:01
bauzasjaypipes: coolio, so I can just drop from the channel, right ? :)14:01
*** tpeoples has joined #openstack-nova14:02
*** bkopilov has joined #openstack-nova14:02
*** baoli has joined #openstack-nova14:02
ndipanovjohnthetubaguy, thanks anyway...14:03
mriedemscheuran: comments inline in your spec14:04
mriedemscheuran: i'm a bit confused about the security group thing14:04
*** burt has joined #openstack-nova14:05
scheuranmriedem: thx14:05
*** otter768 has quit IRC14:05
sahidmriedem, johnthetubaguy - any chance you remove -2 from this serie https://review.openstack.org/#/c/185910/14:07
mriedemsahid: the bp isn't approved14:07
*** xgsa has quit IRC14:08
mriedemoh i see the spec is though https://review.openstack.org/#/c/187509/14:08
mriedemsahid: removed my -214:08
sahidcool :)14:08
*** zz_jgrimm is now known as jgrimm14:09
*** jmccrory has quit IRC14:10
*** busterswt has joined #openstack-nova14:11
*** jmccrory has joined #openstack-nova14:11
*** sdake_ has quit IRC14:12
*** xgsa has joined #openstack-nova14:13
*** varunarya has quit IRC14:14
*** artom has joined #openstack-nova14:15
*** marun has joined #openstack-nova14:16
*** varunarya has joined #openstack-nova14:16
*** mgarza_ has quit IRC14:17
*** karimb has quit IRC14:17
*** iamjarvo has joined #openstack-nova14:19
larsks58737314:19
dansmithlarsks: I disagree14:20
dansmithlarsks: I think it's 40818514:20
*** vladikr has quit IRC14:21
*** marun has quit IRC14:22
*** karimb has joined #openstack-nova14:24
markus_zjohnthetubaguy: Would you please remove your -2 from https://review.openstack.org/#/c/188058/ The spec is pushed.14:25
markus_z?14:25
*** dboik has joined #openstack-nova14:25
*** VW_ has quit IRC14:26
mriedemmarkus_z: the spec isn't approved14:26
mriedemmarkus_z: the -2 is on your nova change until the spec is approved14:26
mriedemhttps://review.openstack.org/#/c/194222/14:26
markus_zmriedem: ah, ok, wasn't sure about that14:26
markus_zIt hit me by surprise that a spec was needed for that. Sounded trivial to me.14:27
*** electroc_ has joined #openstack-nova14:27
*** electrocucaracha has quit IRC14:28
*** nkrinner has quit IRC14:29
mriedemhemnafk: with the os-brick change, will we still need libvirt volume drivers to do the get_config call?  i see that most of the LibvirtFibreChannelVolumeDriver is removed in https://review.openstack.org/#/c/175569/ but get_config is still there14:29
*** jasondotstar has quit IRC14:31
*** gszasz has quit IRC14:31
*** nihilifer has joined #openstack-nova14:31
mriedemha https://review.openstack.org/#/c/194412/14:33
bauzasjohnthetubaguy: oh btw. I think https://review.openstack.org/#/c/181054/ isn't necessary since it's only needing 2 conf flags and the implem seems trivial. Your opinion ?14:33
mriedembug as feature https://review.openstack.org/#/c/194412/14:33
bauzas(I know that you're busy, I don't want a review, just an opinion saying if modifying a filter needs a spec)14:33
bauzasMHO is that it's not needed14:34
*** ctrath has quit IRC14:34
openstackgerritArtom Lifshitz proposed openstack/nova-specs: Support --all-tenants in floatingips-list  https://review.openstack.org/17138914:34
*** adrian_otto has joined #openstack-nova14:35
artomjohnthetubaguy, melwitt, and anyone else who's into reviewing API specs, I think I've addressed the concerns about pagination in the above, can I ask you for some more reviews on the above14:35
lxsligilliard: ^^14:35
*** vladikr has joined #openstack-nova14:36
artomI'm not normally this pushy, but the deadline is approaching ;)14:36
*** afazekas has quit IRC14:36
jaypipesbauzas: lol14:38
kashyapmarkus_z: Your nice descriptive email is buried under quoted text. :-)14:38
markus_zkashyap: Oh, did I screw it?14:39
bauzaskashyap: my layout is fine14:39
kashyapmarkus_z: Nah, layout is good.14:39
markus_zI thought appending the new stuff at the bottom of a mail is what most people do.14:40
kashyapIt appeared as a new thread to me.14:40
*** adrian_otto has quit IRC14:41
kashyapPlease ignore my bike-shedding on that. Just that your propose a solution, you could have added a "proposal" to the subject.14:41
lxsliI haven't seen the email in question but... when bottom-quoting, I wish people would snip more aggressively14:41
markus_zkashyap: Ah, that's my fault, I didn't have the original mail and I had to copy&paste from the internet14:41
lxslisometimes I have to scroll past three pages of quotes to see "+1", it's annoying14:42
*** gszasz has joined #openstack-nova14:42
jaypipesjohnthetubaguy, danpb: https://review.openstack.org/#/c/128825/ from vladikr looks good to go now.14:42
kashyapmarkus_z: Just that these days the 140-character attention is the rage, and I slightly wondered if people concerend will read through.14:43
jaypipeskashyap: damn that Twitter.14:43
kashyaplxsli: If you're using `mutt` for mail reader, there's an excellent little trick to rescue: toggle-quoted command ('T' by default)14:44
*** moshele_ has quit IRC14:44
kashyapjaypipes: :-)14:44
*** xyang1 has joined #openstack-nova14:44
*** adrian_otto has joined #openstack-nova14:44
*** gszasz has quit IRC14:44
*** gszasz has joined #openstack-nova14:45
bauzasnova-scheduler meeting in 15 mins on #openstack-meeting14:45
*** gszasz has quit IRC14:45
bauzasfolks having questions or review requests re: to the scheduler can join14:45
*** jasondotstar has joined #openstack-nova14:46
markus_zkashyap: hm, yeah, maybe it I'll put it on top the next time. I just make the changes I suggested and wait for the yelling :)14:46
*** thedodd has joined #openstack-nova14:47
*** gszasz has joined #openstack-nova14:47
*** adrian_otto1 has joined #openstack-nova14:47
*** mgarza_ has joined #openstack-nova14:48
*** heyongli has quit IRC14:49
*** adrian_otto has quit IRC14:49
*** adrian_otto has joined #openstack-nova14:50
edleafeit's always best to trim the quoted text to just the section you're replying to.14:50
*** heyongli has joined #openstack-nova14:50
jrolljaypipes: hey, I pushed up that spec from yesterday's conversation https://review.openstack.org/#/c/194453/214:51
*** sdake has joined #openstack-nova14:51
jaypipesjroll: rock on, thank you. I'll review it shortly.14:51
*** kiran-r has joined #openstack-nova14:51
*** adrian_otto1 has quit IRC14:52
*** adrian_otto1 has joined #openstack-nova14:52
jrolljaypipes: cool, thanks in advance :)14:52
*** erlon has joined #openstack-nova14:52
*** agireud has joined #openstack-nova14:53
jaypipesjroll: -214:53
jaypipesjroll: just kiddin ;)14:53
jroll:)14:53
dansmithjohnthetubaguy: I propose we drop this spec, unblock ildikov, and do the spec for the big work in M as proposed: https://review.openstack.org/#/c/193510/14:53
*** IanGovett has quit IRC14:53
*** tojuvone has quit IRC14:54
lxslikashyap: hehe yes I know it thanks - but I don't know ahead of time when someone will do it14:54
*** adrian_otto has quit IRC14:54
*** adrian_otto1 has quit IRC14:55
lxslikashyap: I do sometimes resort to that for the ridiculous threads but I usually just stop reading them14:55
lxslikashyap: also, mutt for the win \o/14:55
*** VW_ has joined #openstack-nova14:55
*** mleroy_ has joined #openstack-nova14:56
ildikovdansmith: thanks for the proposal14:57
dansmithildikov: sorry you had to write a spec to show it, but I'm thankful you did.. helps make it clear14:58
ildikovdansmith: johnthetubaguy: I'm fine with doing the first phase without a spec if there is an agreement on this and it is documented14:58
*** zzzeek has joined #openstack-nova14:58
*** adrian_otto has joined #openstack-nova14:58
*** yamahata has joined #openstack-nova14:58
*** IanGovett has joined #openstack-nova14:59
johnthetubaguydansmith: thats cool, seems like the bits left are a spec-less blueprint, with the other bit for M14:59
dansmithjohnthetubaguy: could do that too14:59
ildikovdansmith: np, it is important to be on the same page, so it's worth it14:59
*** unicell has joined #openstack-nova15:01
dansmithjohnthetubaguy: ah, did you just approve that bp?15:01
johnthetubaguyildikov: dansmith: so my take is, we don't need a blueprint for your patch, but its handy to track things, so I have just approved the BP: https://blueprints.launchpad.net/nova/+spec/optional-on-shared-storage-flag-in-rebuild-instance15:01
dansmithah, looks like so15:01
johnthetubaguydansmith: yeah, I figured we don't need one, but it could be handy due to the cross release thingy15:02
*** adrian_otto1 has joined #openstack-nova15:02
*** kiran-r has quit IRC15:02
dansmithcool, so ildikov please drop the first spec and go for the code :)15:02
*** ijw_ has joined #openstack-nova15:02
dansmithjohnthetubaguy: and it was already created15:02
*** matrohon has joined #openstack-nova15:02
johnthetubaguydansmith: exactly15:02
*** unicell1 has quit IRC15:02
*** adrian_otto1 has quit IRC15:02
*** ctrath has joined #openstack-nova15:03
*** adrian_otto has quit IRC15:03
*** artom has quit IRC15:03
bauzaslast call for boarding on nova-scheduler meeting at #openstack-meeting15:03
ildikovjohnthetubaguy: dansmith: ok, cool, tnx15:04
openstackgerritAndreas Scheuring proposed openstack/nova-specs: Spec to Add 'macvtap' as vif type to novas libvirt driver.  https://review.openstack.org/18228015:04
ildikovjohnthetubaguy: dansmith: we will abandon the review and refer to the Launchpad BP15:04
dansmithildikov: cool, thanks15:04
johnthetubaguyildikov: perfect15:04
edleafelxsli: jaypipes: scheduler meeting now15:04
*** bauzas is now known as JustinBieber15:04
johnthetubaguyildikov: we can keep that backlog spec going, they are not affected by the freeze, FWIW, at least thats my plan A15:05
mriedemgmann: what's up with this comment about all_tenants in the v2.1 servers API? http://git.openstack.org/cgit/openstack/nova/tree/nova/api/openstack/compute/plugins/v3/servers.py#n33115:05
mriedemgmann: it says to remove the commented out code at some point - can we do that?15:05
*** JustinBieber is now known as NotJustinBieber15:05
scheuranmriedem: I just updated the spec regarding macvtap-vif15:05
mriedemgmann: i'm wondering if server list --all-tenants is basically not enforced today15:05
mriedemfor v2.115:05
ildikovdansmith: johnthetubaguy: can we do smth with the service status change notification one: https://review.openstack.org/#/c/182350/ ? It will be delayed by two releases if we don't have it done in L15:06
*** NotJustinBieber is now known as bauzas15:06
johnthetubaguyildikov: why will it be delated by two releases?15:06
ildikovjohnthetubaguy: IIUC the second part of the spec has to land in M in order to follow the upgrade path15:06
*** vilobhmm has joined #openstack-nova15:06
*** claudiub has quit IRC15:07
*** garyk has joined #openstack-nova15:07
ildikovjohnthetubaguy: I meant that most probably it can land in N the earliest as hopefully the notification tidy up work will take place in M15:07
dansmithildikov: I'll have to look at that one15:07
*** r-daneel has joined #openstack-nova15:07
scheuranmriedem: it's now written in a more generic way, mentioning the os-vif-library as way to implement it if it will come15:07
dansmithildikov: let us continue on our queues15:07
*** atuvenie__ has joined #openstack-nova15:08
johnthetubaguyildikov: now I see what you are saying, if we can get help fixing notifications now, that would be much quicker, but yeah, let me think about all that15:08
ildikovdansmith: sure, sorry :) I will be available for a while in case of anything pops up, like for the onSharedStorage one15:09
mriedemalex_xu_: can you reivew this when you get a chance? https://review.openstack.org/#/c/171389/15:09
*** claudiub has joined #openstack-nova15:10
ildikovjohnthetubaguy: I quickly discussed it with dansmith, so we will help as much as we can in that process, but it seems that in L we can only get to figure out a design, but most likely the implementation will fall into M the earliest15:10
edleafemriedem: alex_xu_ has a new daughter today. He might not be around much. :)15:10
mriedemsorry i need to see a doctor's note15:11
dansmithildikov: well, that was my estimation of achievable bits based on inertia15:11
*** atuvenie_ has quit IRC15:11
*** sudipto has quit IRC15:11
*** varunarya has quit IRC15:12
*** vilobhmm has quit IRC15:12
dansmithvladikr: https://review.openstack.org/#/c/128825/1215:12
dansmithvladikr: am I nuts?15:12
ildikovdansmith: considering that we are in the Liberty release and the notification tidy up process has been discussed several times for a very long while now in different levels that estimation sounds reasonable15:13
* dansmith waits for someone to compliment his discerning eye15:13
vladikrdansmith, reading..15:13
*** READ10 has joined #openstack-nova15:14
vladikrdansmith, I think I don't see what you see..15:14
dansmithokay, let me pull it down15:15
openstackgerritNikola Dipanov proposed openstack/nova: libvirt: Always default device names at boot  https://review.openstack.org/18963215:15
openstackgerritNikola Dipanov proposed openstack/nova: virt: add get_device_name_for_instance to the base driver class  https://review.openstack.org/18063715:15
openstackgerritNikola Dipanov proposed openstack/nova: libvirt: implement get_device_name_for_instance  https://review.openstack.org/18063815:15
johnthetubaguyildikov: so I am looking at this a bit differently, we need some new folks to step up and help drive the notification, because the current folks are currently busy till at least the end of L with the current more/equally important work, so if we can get some people to help with the coding, it could happen quicker15:16
dansmithvladikr: jaypipes: danpb: http://pastebin.com/1WAthCDg15:17
dansmithvladikr: unicode character 0xd0b015:17
danpbdansmith: ?15:17
dansmithdanpb: see my comment on https://review.openstack.org/#/c/12882515:17
danpbeverything looks normal when i view it15:18
dansmithhttp://www.fileformat.info/info/unicode/char/0430/index.htm15:18
*** dsanders has joined #openstack-nova15:18
dansmithdepends on how your platform renders that ^15:18
danpbjust like a normal letter a15:19
ildikovjohnthetubaguy: I haven't seen a spec for it yet. is there any?15:19
dansmithdanpb: it's not ascii though, it's a two-byte unicode a15:19
*** gszasz has quit IRC15:20
danpbi guess my fonts just happen to make it look the same as an ascii a15:20
johnthetubaguyildikov: thats the next required step, get someone to write up a spec (this is one of the post summit follow up steps that I requested help for on the ML, I don't think anyone has stepped up yet)15:20
vladikrdansmith, okay.. let me resend it..15:20
*** belmoreira has quit IRC15:21
ildikovjohnthetubaguy: I cannot promise anything until have an estimation about the amount of work needed15:21
johnthetubaguyildikov: its basically use olso.versionedobjects to model the notification payloads, and add versioning, its a relatively large chunk of work15:21
dansmithjohnthetubaguy: and support both formats for a while during a transition...15:22
dansmith(somehow)15:22
ildikovjohnthetubaguy: yeap, I heard about versionedobjects, would need to take a deeper look though15:23
openstackgerritVladik Romanovsky proposed openstack/nova-specs: libvirt: virtio-net multiqueue  https://review.openstack.org/12882515:23
*** kiran-r has joined #openstack-nova15:23
ildikovjohnthetubaguy: dansmith: I think writing up a spec would be good to start by one of the current folks15:23
dansmithvladikr: +W, thanks15:24
johnthetubaguyildikov: agreed, just they are all super busy right now15:24
vladikrdansmith, thanks15:24
ildikovjohnthetubaguy: dansmith: in order to consider all the aspects, etc.15:24
dansmithvladikr: if you look at gerrit's diff you'll see I'm not the only one that can tell the difference :P15:24
johnthetubaguyildikov: its a todo list I am tracking, but its not going to be quick if folks can't step up an help, thats the crux of it15:24
vladikrdansmith, yeah, I've seen it now15:24
ildikovjohnthetubaguy: I got that part, this is why I menioned the estimation we had with dansmith as it sounds quite reasonable, even if it's not exactly what we all would desire15:25
*** mpaolino has quit IRC15:25
*** amotoki has quit IRC15:26
ildikovjohnthetubaguy: it seems like a chicken-egg problem from the point of view that until we don't have a spec to start with we will not have folks to join, but until we don't have folks who could join we don't have the bandwidth to start15:26
*** rajesht has quit IRC15:26
dansmithildikov: right, infinite bandwidth is not a reasonable expectation15:26
dansmithsome things have to come after others and in reality, the versioning of notifications and your service notifications are fairly low on the priority list15:27
*** rotbeard has joined #openstack-nova15:27
*** changbl_ has joined #openstack-nova15:28
ildikovjohnthetubaguy: to avoid misunderstandings, I'm totally on your side, but I cannot volunteer to write up a spec, as even if I would have the bandwidth it would take much time and I'm sure that wouldn't be that useful on the first place maybe not even on the second... :S15:28
ildikovdansmith: service notifications are not a big change and does not really make it harder to do the versioning15:29
ildikovdansmith: as much as I can see15:29
dansmithildikov: the more notifications we have, the more compatibility we have to maintain15:29
dansmithildikov: agree it's not massive, nor did I ever say that one has to follow the other necessarily15:30
*** jwcroppe_ has quit IRC15:30
dansmithildikov: but on the scale of relative importance, service notifications are not critical, IMHO15:30
*** jwcroppe has joined #openstack-nova15:30
*** kfox1111 has joined #openstack-nova15:31
*** matrohon has quit IRC15:32
johnthetubaguyildikov: understood15:32
*** gszasz has joined #openstack-nova15:32
ildikovdansmith: I agree that it's not the most critical item on the list15:32
*** armax has joined #openstack-nova15:33
*** mestery has joined #openstack-nova15:34
dansmithildikov: just marked the M part of the evacuate spec as -2 to avoid confusion about it landing in M15:34
*** amotoki has joined #openstack-nova15:35
*** Flcn has joined #openstack-nova15:35
dansmithildikov: when M specs open, move it into that directory and ping me to drop the -215:35
*** jwcroppe has quit IRC15:35
ildikovdansmith: but seem more imprtant than delaying it for an undefined amount of time15:35
*** mestery_ has joined #openstack-nova15:35
dansmithildikov: well, that's the infinite bandwidth problem, but you can certainly make the argument that it's worth doing before the refactor15:35
ildikovdansmith: sure, thanks for the administartion on it15:35
dansmithlike I said, I'm not entirely opposed...15:35
FlcnHello! Does anybody here use more than 2 external neutron network per VM?15:36
*** kiranr has joined #openstack-nova15:36
ildikovdansmith: well, it is a small scope change, I don't know how much we can do it in a way to prepare for the refactor too, but if there is a chance for that, then we are open to follow that way15:38
*** matrohon has joined #openstack-nova15:38
mriedemmelwitt: can you link me to your low hanging fruit etherpad again?15:38
*** mestery has quit IRC15:39
ildikovjohnthetubaguy: do you have the link to the help request mail?15:39
*** mestery_ is now known as mestery15:40
*** kiran-r has quit IRC15:40
*** destiny has quit IRC15:40
*** haypo has quit IRC15:41
*** sdake has quit IRC15:42
kfox1111Hi all. I'm looking to get some more nova folks taking a look at: https://review.openstack.org/#/c/186617/ Please take a look if you have a minute.15:42
*** mgarza_ has quit IRC15:42
*** marun has joined #openstack-nova15:43
*** mgarza_ has joined #openstack-nova15:43
ildikovmriedem: https://etherpad.openstack.org/p/nova-low-hanging-fruit15:45
ndipanovlxsli, interesting https://review.openstack.org/#/c/84906/19/specs/juno/persistent-resource-claim.rst15:45
ndipanovbut this is merged for juno15:46
ndipanovwhat about L15:46
*** lyarwood has quit IRC15:46
lxslindipanov: yes I'd like to revive that in Muppet or Narnia15:46
*** jwcroppe has joined #openstack-nova15:46
*** lyarwood has joined #openstack-nova15:46
ndipanovhmm15:46
*** pbrooko has quit IRC15:47
ndipanovlet me think about it15:47
lxslindipanov: it has to queue behind resource-objects, request-spec, bauzas said your HostState stuff as well15:47
*** mgarza_ has quit IRC15:47
ndipanovI might do some things differently in that case15:47
*** atuvenie__ has quit IRC15:47
johnthetubaguyildikov: I not sure where that is right now, the key bit is this etherpad: https://etherpad.openstack.org/p/YVR-nova-liberty-summit-action-items15:47
lxslindipanov: yeah it will need to be re-proposed and updated I'm sure15:47
mriedemildikov: thanks15:48
ndipanovwell so here's the thing about this15:48
mriedemrlrossit: fyi https://etherpad.openstack.org/p/nova-low-hanging-fruit15:48
ndipanovcurrently instead of having a claim object15:48
bauzasndipanov: that's what we agreed on like 10 mins ago :)15:48
*** dsanders has quit IRC15:48
ildikovjohnthetubaguy: ok, thanks15:49
ndipanovwe just consume those resources using the instance15:49
*** yassine_ has quit IRC15:49
ndipanovso this also goes back to the story we never really figured out15:49
ildikovmriedem: np15:49
ndipanovwhy do we need request_spec, instance, claim, filter_specs... all of which keep data about the same thing more or less15:49
ndipanovit just becomes very difficult to program against15:50
*** armax has quit IRC15:50
ndipanovso I'd like to sort that out first15:51
ndipanovbut I'm realistic15:51
bauzasfor the moment, resource-objects doesn't pretend to be persisted :)15:51
*** marun has quit IRC15:51
ndipanovbauzas, yeah I am not sure how I feel about it15:51
*** mgarza_ has joined #openstack-nova15:51
ndipanovI think that the fact that resource object and filter specs are leaked into compute hosts15:52
johnthetubaguybauzas: is someone still working on the overall vision thing for this stuff? the devref doc?15:52
ndipanovis a critical design flaw15:52
bauzasndipanov: what do you mean by filter specs ?15:52
lxslindipanov: requests and claims are quite different to me - one is abstract (some CPUs), the other is concrete (CPUs 2+3)15:52
lxslindipanov: but I agree some of the other stuff seems redundant15:52
ndipanovlxsli, true15:52
ndipanovI'm not saying that we should not have them, just that we should have a clear picture and a programming model15:53
johnthetubaguywe need to store the user request separate to what they got, thats not quite the same thing15:53
johnthetubaguylike the scheduler hints, etc15:53
bauzasndipanov: that's the main difference between the RequestSpec and any resource object15:53
johnthetubaguyafter a resize, its interesting to know its not what they requested at first, I guess15:53
ndipanovjohnthetubaguy, currently it's all kind of on the instance but not really15:53
ndipanovwith a bunch of stuff that is not15:53
*** fawadkhaliq has joined #openstack-nova15:53
bauzasndipanov: the RequestSpec is there for keeping a trace of what the user asked15:53
bauzasndipanov: not what the instance is about, or what it became15:54
*** electroc_ is now known as electrocucaracha15:54
bauzasjohnthetubaguy: devref for what ? the big scheduler changes ? that's on my due :(15:54
ndipanovbut currently it leaks into the compute service15:54
bauzasndipanov: agreed, that's another problem we need to solve15:55
bauzasndipanov: and see why it's needed on the compute side15:55
*** marun has joined #openstack-nova15:55
ndipanovI don't think it is, it's just used for the retry filter spec15:56
jaypipesdansmith: what am I looking at in that paste above?15:56
*** beagles is now known as beagles_brb15:56
bauzasndipanov: okay, lemme take some time for code reviewing, it deserves your question15:56
dansmithjaypipes: proof that vladikr had a unicode 'a' in there instead of the ascii one15:57
jaypipesdansmith: oooohhh...15:57
dansmithjaypipes: it's no longer relevant though, as it's been fixed :)15:57
ndipanovfwiw - I think the instance should be the central object15:57
jaypipesndipanov: fwiw, I think the nova.objects.DanSmith should be the central object.15:57
*** rwsu has quit IRC15:58
ndipanovjaypipes, that's an awesome april 1st commit :D15:58
dansmithjaypipes: oh man, I'd hate to see the methods people add to that object...15:58
*** ZZelle is now known as ZZelle-away15:58
bauzasndipanov: um, you're right, we're just passing request_spec over the wire but not reading it - fantastic15:58
*** unicell has quit IRC15:59
jaypipesdansmith: nova.objects.DanSmith.get_off_my_lawn().15:59
ndipanovbauzas, but we read filter_spec15:59
bauzasndipanov: and it seems filt_props is only given for the retry dict15:59
*** dboik_ has joined #openstack-nova15:59
bauzasndipanov: yup15:59
ndipanovor properties or whatever it's called15:59
*** dboik_ has quit IRC15:59
*** sahid has quit IRC15:59
bauzasndipanov: filter_properties indeed15:59
ndipanovjaypipes, nova.objects.DanSmith.get_off_my_lawn(*kids)15:59
*** dboik_ has joined #openstack-nova15:59
dansmithndipanov: +215:59
jaypipesndipanov: ! yes :)16:00
jaypipesnova.objects.DanSmith.avoid_humans(*mock.ANY)16:00
*** chen12 has quit IRC16:00
edleafenova.objects.DanSmith.no(your_proposal)16:00
jaypipes:)16:00
jaypipeslmao16:00
*** hemnafk is now known as hemna16:01
ndipanovhahaha16:01
dansmithheh16:01
*** chen12 has joined #openstack-nova16:01
jaypipesdansmith: we are quickly rounding out your object interface here.16:01
dansmithlol16:01
bauzasndipanov: so given that, I think that's fine - provided any call to select_dest() is reading the Spec object and persisting it back, we no longer need to pass either filt_props or request_sepc16:01
*** otter768 has joined #openstack-nova16:02
scheuranCan anyone please take the macvtap-vif spec on its review agenda? It's updated to be either implemented along the proposed os-vif-library way or in the classical way, if os-vif will not make it. (https://review.openstack.org/#/c/182280). Thx16:02
bauzasndipanov: we're just passing them because we don't persist the retry dict16:02
ndipanovdef is_approved(proposal): return False16:02
ndipanovbauzas, well not sure retries need to be persisted16:03
*** dboik has quit IRC16:03
ndipanovbut yeah that whole intreaction needs a rework16:03
ndipanovthat;s basically what I meant by fixing the scheduler interface16:03
*** jgrimm is now known as zz_jgrimm16:03
danpbdansmith: would like your opinion on this, since it is talking about objectifying the VIF type config data and objectification is your speciality https://review.openstack.org/#/c/193668/16:03
dansmithdanpb: yeah, I was trying to avoid it, but I should probably dig in :/16:04
*** armax has joined #openstack-nova16:05
*** sdake has joined #openstack-nova16:05
markus_zanyone from hyper-v around?16:05
claudiubmarkus_z: hi.16:06
*** arnaud____ has joined #openstack-nova16:06
*** READ10 has quit IRC16:06
markus_zclaudiub: Hi, I'm not sure if you followed the discussion about the "evacuate" vs. "host maintenance mode".16:06
markus_zclaudiub: http://lists.openstack.org/pipermail/openstack-dev/2015-June/067787.html16:07
*** otter768 has quit IRC16:07
markus_zclaudiub: I think hyper-v was mislead here too16:07
johnthetubaguymarkus_z: I should totally write up all the different things, I have a feeling I started something on that somewhere16:07
dansmithmriedem: are you looking at danpb's of-vif thing? you probably should, given it's relation to brick16:08
*** alex_klimov has quit IRC16:08
*** armax has quit IRC16:08
dansmither, os-vif16:08
mriedemdansmith: it's living comfortably in a browser tab16:08
mriedemcurrently reaping the results of https://review.openstack.org/#/c/192348/16:09
mriedemsdague: i have the race figured out for bug 1249065 now16:10
openstackbug 1249065 in OpenStack Compute (nova) "Nova throws 400 when attempting to add floating ip (instance.info_cache.network_info is empty)" [Medium,Confirmed] https://launchpad.net/bugs/124906516:10
mriedemgiven that extra logging16:10
mriedem\o/16:10
markus_zclaudiub: The bottom line is, I think hyper-v's checkmark here is a mistake: http://docs.openstack.org/developer/nova/support-matrix.html#operation_evacuate16:12
*** achanda has joined #openstack-nova16:12
markus_zI'm preparing a patch for s390 and I would add hyper-v too if you can confirm this.16:13
*** nihilifer has quit IRC16:13
*** romainh has left #openstack-nova16:13
*** veena has joined #openstack-nova16:13
claudiubmarkus_z: yeah. got it. I will check it out. Add me to cc to it please.16:13
*** iamjarvo has quit IRC16:13
claudiubmarkus_z: thanks for bringing it up. :)16:14
*** tonytan4ever has quit IRC16:17
*** ijw_ has quit IRC16:17
*** scheuran has quit IRC16:17
*** nic has joined #openstack-nova16:19
*** mpavone has quit IRC16:20
*** samueldmq has quit IRC16:21
*** annashen has joined #openstack-nova16:22
*** marun has quit IRC16:23
*** salv-orlando has joined #openstack-nova16:23
*** samueldmq has joined #openstack-nova16:24
openstackgerritMarkus Zoeller (markus_z) proposed openstack/nova: hypervisor support matrix: fix "evacuate" for s390 and hyper-v  https://review.openstack.org/19473016:24
*** yamahata has quit IRC16:24
openstackgerritEarle F. Philhower, III proposed openstack/nova: Add os_brick-based VolumeDriver for HGST connector  https://review.openstack.org/19441216:26
jaypipesmriedem, dansmith: you'll be delighted to hear that Jules has just ordered diapers for one of the pugs.16:27
dansmithjaypipes: lol16:27
dansmithjaypipes: pictures please, when available16:27
jaypipesdansmith: but of course.16:28
*** _kiran_ has joined #openstack-nova16:28
*** mestery has quit IRC16:28
jaypipesjohnthetubaguy: are you around? did you catch my request from yesterday about snikitin's server instance tagging spec?16:29
*** lucasagomes is now known as lucas-dinner16:29
*** krtaylor has quit IRC16:29
*** markus_z has quit IRC16:29
*** dims has quit IRC16:30
hemnamriedem, ping16:31
*** kiranr has quit IRC16:32
johnthetubaguyjaypipes: I am around, I haven't got back around to review that one yet16:32
*** dims has joined #openstack-nova16:33
johnthetubaguyjust as a heads up its liberty-1 tagging time, let me know if you see things that mean we shouldn't tag16:34
*** ijw_ has joined #openstack-nova16:35
johnthetubaguymriedem: I guess there are no major bugs for gate, or needing to go onto stable that we should wait for before cutting liberty-1?16:35
*** _kiran_ has quit IRC16:36
*** _kiran_ has joined #openstack-nova16:36
sdaguemriedem: what was it?16:37
*** beagles_brb is now known as beagles16:38
*** varunarya has joined #openstack-nova16:38
*** jlanoux has quit IRC16:38
*** Flcn has quit IRC16:39
*** arnaud____ has quit IRC16:40
*** Flcn has joined #openstack-nova16:41
openstackgerritZhang Ni proposed openstack/nova-specs: Improve nova attach volume api to support disk-bus  https://review.openstack.org/18597316:41
*** fawadk has joined #openstack-nova16:42
*** rotbeard has quit IRC16:42
*** fawadkhaliq has quit IRC16:42
mriedemsdague: there is a race where instance A is releasing fixed ip X at the same time that instance B is associating with fixed ip X, and before the fixed IP is marked as allocated to instance B is released and disassociated in the DB (tihnking from instance A but at that point it's associated with instance B)16:43
*** davideagnello has quit IRC16:43
*** jasondotstar has quit IRC16:43
*** dsanders has joined #openstack-nova16:43
*** kiranr has joined #openstack-nova16:43
mriedemsdague: and since the dhcp agent callback doesn't have memory of which instance it should be disassociating from, it just disassociates from $whatevs16:43
mriedemand then kablammo16:43
sdaguenice16:43
*** atuvenie__ has joined #openstack-nova16:44
*** davideagnello has joined #openstack-nova16:44
*** oro has joined #openstack-nova16:45
mriedemso i guess there could be a couple of fixes....we could keep track of which instance should be associated with an IP when releasing it and if those don't line up we don't disassociate b/c we assume it's changed,16:46
mriedemor we could just re-associate when the new instance B marks the fixed_ip as allocated=True16:46
ndipanovdansmith, so regarding this https://review.openstack.org/#/c/193576/16:46
ndipanovI just remembered one point16:46
*** baoli has quit IRC16:46
*** _kiran_ has quit IRC16:47
*** Mike_D_laptop has joined #openstack-nova16:47
ndipanovif we do end up creating a migration_context16:47
ndipanovwhich I think we should and I think it should live on the instance16:47
ndipanovthen our queries in the resource tracker look like this:16:47
ndipanovselect my migrations16:48
ndipanovfor mig in migrations16:48
ndipanovselect my instance16:48
ndipanovto get to the needed data16:48
ndipanovnow we do this already even though it;s not ideal16:48
ndipanovso we are not breaking anything16:48
dansmithndipanov: we can optimize that in MigrationList to fill out a lazy property of .instance on the migrations in a single go, right?16:49
openstackgerritDmitry Guryanov proposed openstack/nova-specs: virtozzo storage volume driver in libvirt  https://review.openstack.org/18429516:49
*** unicell has joined #openstack-nova16:49
*** marzif_ has joined #openstack-nova16:50
*** ctrath has quit IRC16:50
*** baoli has joined #openstack-nova16:51
*** krtaylor has joined #openstack-nova16:51
*** ildikov has quit IRC16:51
*** jasondotstar has joined #openstack-nova16:52
ndipanovdansmith, yes that was my idea basically16:54
ndipanovwe should do it anyway really16:54
dansmithaye16:54
*** promulo has joined #openstack-nova16:54
ndipanovnote that some but not all of these isntances are likely already loaded by the previous query16:55
ndipanovso maybe the other way around might acutally be better16:55
*** apuimedo has joined #openstack-nova16:55
*** brad[] has quit IRC16:55
danpbdansmith: am I right in thinking the tenant user end can inject arbitrary key=value data to the guest, via cloud-init / metadata service ?16:55
dansmithdanpb: yes16:56
*** sudipto has joined #openstack-nova16:56
danpbah yeah, the --meta key=val arg to nova boot, populates a  /meta_data.json file16:56
dansmithdanpb: limited to 255 chars per, and limited by quota16:56
*** karimb has quit IRC16:56
mriedemvishy: are you around for a nova-network question?16:58
*** BobBall is now known as BobBall_AWOL16:59
mriedemdamn, meeting16:59
mriedemdansmith: if you have a sec, do you have any idea why we can't mark the fixed ip as allocated=True during associate here? http://git.openstack.org/cgit/openstack/nova/tree/nova/network/manager.py#n90516:59
mriedemdoes the vif have to be created first?17:00
*** patrickeast has joined #openstack-nova17:00
mriedembasically, associate, vif and allocated need to be atomic17:00
mriedemand they aren't today17:00
mriedembrb17:00
dansmithmriedem: maybe the async network allocate in compute manager?17:00
*** zz_jgrimm is now known as jgrimm17:01
dansmithoh, no17:01
dansmithwe do it right below17:01
*** whenry has joined #openstack-nova17:01
*** dontalton has joined #openstack-nova17:01
dansmithmriedem: so create the vif, and pass it into the associate call to do it atomically?17:02
*** electrocucaracha has quit IRC17:02
dansmithmriedem: does associate need to be atomic with the rest of those things, or just cleanup on failure?17:03
*** baoli has quit IRC17:03
*** ctrath has joined #openstack-nova17:03
*** husanu has quit IRC17:03
*** agireud has quit IRC17:04
*** agireud has joined #openstack-nova17:05
*** matrohon has quit IRC17:05
*** husanu has joined #openstack-nova17:05
*** fawadk has quit IRC17:06
*** veena has quit IRC17:10
hemnasdague, any way to see what was in the /etc/nova/* for a gate-nova-python27 check?   I don't get why my patch is failing the py27 test upstream http://logs.openstack.org/69/175569/17/check/gate-nova-python27/520b9ad/console.html17:10
hemnasdague, for this patch https://review.openstack.org/#/c/175569/17   I did touch the compute.filters, but the commands rootwrap is complaining about are in the computer.filters file.17:12
sdaguehemna: you are missing mocks for rootwrap iscsi calls17:12
sdaguehttp://logs.openstack.org/69/175569/17/check/gate-nova-python27/520b9ad/console.html#_2015-06-22_23_48_07_42817:12
hemnahrmm17:13
hemnaI can't reproduce this locally17:13
hemnaI run tox -epy27 and don't get any complaints17:13
sdagueright, because there is an extra check in the gate to make sure you didn't try to run sudo17:13
*** electrocucaracha has joined #openstack-nova17:14
hemnaugh, wish it would say what test it was running that caused that failure17:14
sdagueso where new rootwrap calls are being added in your code, you need to mock those out17:14
sdaguewell, it doesn't know17:14
sdagueit just knows sudo attempts were in syslog17:15
sdaguebut you can see what commands are run17:15
sdagueand you know what files you changed17:15
sdaguecross referencing shouldn't be too bad17:15
hemnaso those are just dumps from syslog it found ?17:15
sdagueyep17:15
hemnaah ok17:15
sdaguesudo /usr/local/jenkins/slave_scripts/jenkins-sudo-grep.sh post17:15
sdaguethat's what goes and tries to find those things17:15
hemnaok thanks, I was confused where that was coming from17:16
hemnawhich probably means I have them in my local syslog17:16
*** angdraug has joined #openstack-nova17:16
hemnajust didn't know they were in there.17:16
hemnaok thanks17:16
sdagueno prob17:16
openstackgerritTracy Jones proposed openstack/nova: Cleanup of compute api reboot method  https://review.openstack.org/12742717:16
*** mleroy_ has quit IRC17:18
*** kiranr has quit IRC17:19
*** dboik_ has quit IRC17:20
*** Flcn has quit IRC17:23
*** dboik has joined #openstack-nova17:24
*** mestery has joined #openstack-nova17:25
*** harlowja has joined #openstack-nova17:26
*** ildikov has joined #openstack-nova17:27
*** tjones1 has joined #openstack-nova17:28
openstackgerritTracy Jones proposed openstack/nova: Cleanup of compute api reboot method  https://review.openstack.org/12742717:28
*** baoli has joined #openstack-nova17:29
*** VW_ has quit IRC17:30
mriedemdansmith: i think just cleanup on failure17:31
*** rwsu has joined #openstack-nova17:31
mriedemdansmith: i was thinking the same, create the vif and pass that into associate17:31
*** electrocucaracha has quit IRC17:31
mriedemand if it's there, mark the fixed ip as allocated=True when we associate17:31
mriedemdansmith: although that would be an api change to the fixed ip object so we couldn't backport it as far as i know17:32
*** gyee_ has quit IRC17:33
*** rwsu has quit IRC17:33
mriedemwe could definitely reduce the scope of the race by getting the vif up front before calling associate17:34
mriedembut w/o a lock or a change to the db api it's not a complete fix of the race17:34
*** gyee has joined #openstack-nova17:36
dansmithmriedem: yeah.. if it doesn't need to be atomic, just clean-up-able, we can just do a better job there of catching failure and undoing the association, right?17:37
dansmithmaybe a helper method and we try..except: fip.disassociate() ?17:38
*** rwsu has joined #openstack-nova17:39
*** ZZelle has joined #openstack-nova17:39
*** rwsu has quit IRC17:42
*** varunarya has quit IRC17:42
*** rwsu has joined #openstack-nova17:42
*** tonytan4ever has joined #openstack-nova17:43
mriedemdansmith: there isn't a failure17:44
mriedemthat's the thing17:44
*** marun has joined #openstack-nova17:44
mriedemthe failure comes later when we try to associate a floating IP and there is no nw_info in the instance_info_cache17:44
mriedemb/c get_instance_nw_info can't build the nw info model since there is no fixed IP association17:44
dansmithokay I'm confused17:45
mriedemwe could definitely fail earlier in this process if by the time we leave allocate_for_instance, there is no nw_info to return17:45
openstackgerritQin Zhao proposed openstack/nova: Use flavor object in compute manager  https://review.openstack.org/19476117:45
mriedembut i just wanted to fix the race17:45
mriedemdansmith: this should show the failure steps https://bugs.launchpad.net/nova/+bug/1249065/comments/4517:46
openstackLaunchpad bug 1249065 in OpenStack Compute (nova) "Nova throws 400 when attempting to add floating ip (instance.info_cache.network_info is empty)" [Medium,Triaged] - Assigned to Matt Riedemann (mriedem)17:46
mriedemto fix the race, associated/vif/allocated need to be set at the same time in the db api17:46
mriedemor a lock....but i'd like to avoid a lock17:46
*** irenab has joined #openstack-nova17:47
openstackgerritQin Zhao proposed openstack/nova: Use flavor object in compute manager  https://review.openstack.org/19476117:47
mriedemanywho, i think i have the steps to move forward with 2 patches, first patch moves vif allocation before associate, that narrows the race but doesn't fix it - but could be backported to stable/kilo,17:47
dansmithmriedem: hmm, wow, that takes some thinkin'17:47
mriedem2nd patch updates the associate rpc api/db api to pass in the vif17:48
mriedemif vif: allocated=True17:48
mriedemduring association17:48
mriedemyeah, the dhcpagent callback is the wild card17:48
mriedemi loves me some externally managed callbacks17:48
*** dramakri has joined #openstack-nova17:49
dansmithmriedem: so is it that this IP was used by one instance, then another in quick succession and the dhcp_agent callback from the first breaks the second?17:49
mriedemyup17:49
dansmithis the bug then that we allow that to happen? like, the first instance's dhcp_agent shouldn't break the allocation of the second, right?17:49
*** armax has joined #openstack-nova17:50
*** tjones1 has quit IRC17:50
mriedemlike, http://logs.openstack.org/42/175742/10/check/check-tempest-dsvm-nova-v21-full/2850b02/logs/screen-n-net.txt.gz#_2015-06-23_05_10_55_45917:50
mriedemwhen we get to http://git.openstack.org/cgit/openstack/nova/tree/nova/network/manager.py#n111417:51
mriedemif it's not allocated and it's not leased, don't disassociate17:51
dansmithwell,17:51
mriedemi think the reason i was avoiding that was because those warnings show up a ton in non failure runs17:51
dansmithmore like, I feel like we should know what instance is trying to do the release17:52
dansmiththat release code seems pretty fragile and assume-y17:52
mriedemdansmith: yeah, and we don't have that info17:52
mriedemyes, very much so17:52
dansmither, presumptuous17:52
mriedemyeah, it's a real dick :)17:52
dansmithhaha17:52
mriedemhttp://goo.gl/oh4pY817:52
mriedem84% of the time that shows up, it's not in a failing job17:53
mriedemand it shows up a ton17:53
dansmiththat doesn't mean it's right17:53
mriedemi know, i'm sure there is some other legacy whack a mole check in n-net somewhere to handle it17:53
dansmithlike, it could be causing other issues depending on when it's failing I'd think17:53
mriedemhrm, i wonder how much this race contributes to our old buddy the ssh timeout bug17:54
dansmithright17:54
dansmiththat's what I was thinking17:54
*** toure has quit IRC17:54
dansmithalthough that happens on neutron too17:54
mriedemyeah17:54
dansmithbut it's also hard to define, so maybe this is related to the nova-network side of the failure17:54
*** toure has joined #openstack-nova17:54
*** fawadkhaliq has joined #openstack-nova17:54
*** toure has quit IRC17:55
mriedemright, so another option i was thinking of was tracking in the network manager a map of associated fixed_ip/instance relationships before and after a lease/release, so when we hit http://git.openstack.org/cgit/openstack/nova/tree/nova/network/manager.py#n1114 - if it's not associated with what we thought it should be in the cache, we don't disassociate17:55
mriedembut i feel like that is racy also17:56
dansmithsi17:56
dansmithso, just looking at how this is plumbed makes me want to stab something17:56
*** Nikolay_St has quit IRC17:56
*** toure has joined #openstack-nova17:56
mriedemi'm pretty confident that making the associated/allocated thing atomic would fix this17:56
dansmithI think it would fix this race,17:57
dansmithbut it doesn't fix the fragility of what is going on here17:57
dansmithlet me look at some things, just a sec17:57
mriedemoh yeah, btw, this would also have to be fixed for the VlanManager :(17:58
mriedemhttp://git.openstack.org/cgit/openstack/nova/tree/nova/network/manager.py#n193917:58
mriedemsince it's allocate_fixed_ip method follows the same pattern17:59
mriedemit's just that we test FlatDHCPManager in the gate17:59
dansmithso, what I was thinking17:59
*** busterswt has quit IRC17:59
*** mpaolino has joined #openstack-nova17:59
dansmithis that we write out information that tells dhcpbridge what instance currently owns an IP, so that we can pass in the instance_uuid when we make that call17:59
*** mtanino has quit IRC18:00
dansmithor,18:00
openstackgerritJoe Gordon proposed openstack/nova-specs: trivial: Change file permissions for spec  https://review.openstack.org/19455918:00
*** mestery has quit IRC18:00
*** Mike_D_laptop1 has joined #openstack-nova18:00
*** mestery has joined #openstack-nova18:01
*** Mike_D_laptop has quit IRC18:01
*** mwagner_afk has quit IRC18:02
dansmithmriedem: we have the mac address of the thing doing the delete18:02
*** otter768 has joined #openstack-nova18:02
dansmithmriedem: we should pass that over rpc and not do the thing if they don't match, no?18:02
*** ociuhandu has quit IRC18:03
dansmithI can cook up that change if you want18:03
mriedemno i got this one :)18:03
mriedemdibs18:03
dansmithuh!18:03
mriedemlet me check out the mac thing18:03
dansmithdoesn't the prescriber of the fix get automatic dibs?18:04
*** ericksonfgds is now known as ericksonsantos18:04
*** electrocucaracha has joined #openstack-nova18:04
mriedemlet me consult the playground rules handbook quick18:04
*** iamjarvo has joined #openstack-nova18:05
*** armax has quit IRC18:05
*** achanda_ has joined #openstack-nova18:06
mriedemdansmith: i don't think that will work18:06
mriedemthe mac is on the vif18:06
mriedemand when we hit this: http://git.openstack.org/cgit/openstack/nova/tree/nova/network/manager.py#n111418:06
mriedemthe vif isn't associated with the fixed IP yet18:06
*** nic has quit IRC18:06
*** VW_ has joined #openstack-nova18:06
mriedemthat happens here http://git.openstack.org/cgit/openstack/nova/tree/nova/network/manager.py#n92018:07
dansmithmriedem: you look up the vif based on the mac, which gives you the instance_uuid, which you can compare to the association, right?18:07
*** jasondotstar has quit IRC18:07
*** otter768 has quit IRC18:07
mriedemdansmith: ah, gotcha18:07
mriedemsounds like backdoor action to me18:07
mriedemi like it18:07
dansmithheh18:08
jogojaypipes: your thoughts on https://review.openstack.org/#/c/191914/ would be appreciated18:08
dansmithI totally get a co-authored-by on this if no dibs18:08
*** achanda has quit IRC18:08
dansmithjogo: when is (or was) your last day?18:09
mriedemdansmith: so, this is still an rpc api change to release_fixed_ip right - which means no backport, which is fine, but i'm looking for "something" to backport, which i think could be at least re-arranging the order of the vif create and the fixed_ip.associate call18:09
mriedemdansmith: yeah i was going to co-author18:09
dansmithmriedem: yeah, I think you change the ordering for the backport to narrow the window and then fix it for realz with the rpc change18:09
mriedemcool, just checking18:09
mriedembtw, i don't think jogo is actually quitting,18:09
mriedemhe just said he is to be left alone18:10
dansmithmriedem: we *can* backport things like this if we need to18:10
*** mestery has quit IRC18:10
dansmithbut it doesn't sound like this is serious enough, especially if you narrow it significantly with the easy part18:10
mriedemyeah18:10
mriedemwell, that's the hope anyway18:11
mriedemb/c the db api call or vif create is taking just long enough to fudge it up18:11
dansmithyeah18:11
jogodansmith: friday18:11
dansmiththe proper fix will also make this not super-effing-scary in terms of one instance un-associating another's fixed18:11
jogomriedem: hehe18:11
dansmithjogo: this coming friday?18:11
*** agireud has quit IRC18:11
jogodansmith: the 26th18:12
dansmithokay, so we still have a few days to talk you out of it, right?18:12
mriedemwe should have a going away party18:12
jogodansmith: yup18:12
jogomriedem: yup18:12
dansmithjogo: don't do it.18:12
*** moshele_ has joined #openstack-nova18:13
*** armax has joined #openstack-nova18:13
*** jasondotstar has joined #openstack-nova18:14
*** mpaolino has quit IRC18:14
jogodansmith: looking over the specs there are just so many I don't want to deal with18:15
jogosuch as https://review.openstack.org/#/c/194453/218:15
jogoand that isn't even a bad one18:15
mriedembug jogo, the gate is relatively benign now, stable dep hell isn't happening so much anymore18:16
mriedemjogo: there is just so much to live for now18:16
jogomriedem: haha18:16
mriedemwe might have a fix for the ssh timeout n-net bug finally18:16
mriedemcome on18:16
jogomriedem: that reminds me have to revsit what is breaking in multinode18:16
jogomriedem: btw http://imgh.us/nova.svg18:16
*** fawadkhaliq has quit IRC18:16
*** artom has joined #openstack-nova18:16
mtreinishmriedem: I don't believe you, that bug will never be fixed18:16
jogopreliminary diagram18:16
mriedemascii, please18:16
*** Marga_ has quit IRC18:17
*** achanda_ has quit IRC18:17
*** amotoki has quit IRC18:17
*** agireud has joined #openstack-nova18:17
mtreinishjogo: I think you need a legend18:17
mtreinishunless you know what you're looking at the different line types don't mean anything18:17
*** achanda has joined #openstack-nova18:17
*** armax has quit IRC18:18
jogomtreinish: yup, I do18:18
*** danpb has quit IRC18:19
jogowas trying to replace http://docs.openstack.org/developer/nova/architecture.html18:19
*** artom has quit IRC18:21
*** tjones1 has joined #openstack-nova18:22
jogohaha neutron unit tests are broken18:23
*** artom has joined #openstack-nova18:24
*** Flcn has joined #openstack-nova18:24
openstackgerritDan Smith proposed openstack/nova-specs: Add keep-jogo spec  https://review.openstack.org/19477418:26
dansmithrequest -2s and -1s please ^^18:26
dansmither, wait, +2s and +1s I guess :D18:26
mriedemha18:27
*** lpetrut1 has quit IRC18:27
mriedempreviously-next-employer?18:28
dansmithyeah, assuming he changes his mind, they'd be previously-next18:28
jogoso this is fun https://bugs.launchpad.net/nova/+bug/146230518:32
openstackLaunchpad bug 1462305 in OpenStack Compute (nova) "multi-node test causes nova-compute to lockup" [High,In progress] - Assigned to Joe Gordon (jogo)18:32
jogothe hung nova-compute won't respond to SIGUSR118:32
jogoso no guru meditation for me18:32
jogodansmith: nice spec18:33
dansmith\o/18:33
*** annashen has quit IRC18:33
*** ijw_ has quit IRC18:35
jogoany ideas on how to further debug https://bugs.launchpad.net/nova/+bug/1462305 ?18:36
openstackLaunchpad bug 1462305 in OpenStack Compute (nova) "multi-node test causes nova-compute to lockup" [High,In progress] - Assigned to Joe Gordon (jogo)18:36
*** markmcclain has quit IRC18:36
*** burt has quit IRC18:38
*** burt has joined #openstack-nova18:38
dansmithjogo: hung such that it won't do SIGUSR1 means probably blocked in C-land right?18:39
jogodansmith: or something funny with eventlet?18:39
jogodansmith: but that makes sense to me18:39
dansmithcould be either yawh18:39
dansmither, yeah18:39
dansmithso a gdb-attach stack trace maybe if it's available18:40
dansmiththe gdb stack trace would tell you if it's handling the signal and blocking on something in eventlet too I think18:40
jogoharlowja: have an eventlet question for you if your around18:41
harlowjajogo uh oh, whats up18:42
* harlowja may or may not know, ha18:42
jogoharlowja: how does eventlet work with signal.signal18:42
jogohttps://docs.python.org/2/library/signal.html18:42
*** aix has quit IRC18:42
*** burt has quit IRC18:42
jogoharlowja: we have a hung nova-compute that isn't responding to SIGUSR118:42
*** marzif_ has quit IRC18:43
*** burt has joined #openstack-nova18:43
harlowjahmmm, wonder if something is absorbing it18:44
jogoharlowja: when nova-compute is running normally SIGUSR1 works18:44
*** lyarwood has quit IRC18:44
jogoharlowja: just when nova-compute is hung, it breaks18:44
*** lyarwood has joined #openstack-nova18:44
jogoharlowja: example http://logs.openstack.org/40/194540/1/check/check-tempest-dsvm-multinode-full/1c35401/logs/screen-n-cpu.txt.gz18:44
harlowjaany idea where hung in that log?18:45
jogoharlowja: iptables (last line)18:45
harlowjak18:45
jogoharlowja: no output after that18:46
openstackgerritEd Leafe proposed openstack/nova: Make NoValidHost exceptions clearer  https://review.openstack.org/19478018:46
harlowjahmmm, thinking18:47
jogoharlowja: thanks18:47
harlowjanp18:47
jogoif this was just a deadlock in how we use ... locks, then I would expect the sigusr1 (GMR) stuff to work18:48
harlowjahttps://github.com/openstack/nova/blob/master/nova/network/linux_net.py#L446 that code i guess?18:48
jogobut maybe some eventlet thing is preventing that18:48
jogoharlowja: roughly yeah. only see this in multihost/multinode18:48
harlowjak18:48
*** moshele_ has quit IRC18:49
jogodansmith: I could do gdb, would have to get infra to help though18:50
dansmithjogo: yeah18:50
*** belmoreira has joined #openstack-nova18:51
jogodansmith: since running out of ideas I think that may be the next step18:51
*** oro has quit IRC18:51
*** rwsu has quit IRC18:51
harlowjaya, i'd be interested in knowing where it is at18:51
*** irenab has quit IRC18:52
*** nihilifer has joined #openstack-nova18:52
*** rwsu has joined #openstack-nova18:53
*** electrocucaracha has quit IRC18:53
harlowjai've seen similar kind of lockups when things aren't monkey patched, but this doesn't seem to be that18:54
harlowja*or when certain things are monkey patched, and certain things aren't18:54
*** baoli has quit IRC18:54
harlowjaany chance that could be part of it?18:54
jogoharlowja: the lockup part probably not. but GMR not working ... let me check18:55
*** baoli has joined #openstack-nova18:56
harlowjai do see https://github.com/eventlet/eventlet/blob/master/eventlet/hubs/hub.py#L8 but thats probably ok (periodic alarms)18:56
jogoharlowja: we monkeypatch before calling gmr18:56
harlowjamonkey patch all the things? or just some of them?18:56
jogoharlowja: see nova/cmd/compute.py18:57
harlowjak18:58
harlowjahmmm, i didn't think the 'utils.monkey_patch()' was eventlet monkey patching18:58
harlowjaalthough i hope https://github.com/openstack/nova/blob/master/nova/cmd/__init__.py does whats needed18:59
jogooh right18:59
*** nic has joined #openstack-nova18:59
harlowjaalthough 'eventlet.monkey_patch(os=False, thread=False)' is bad, but ya, oh well19:00
thomasemSo, looks like novaclient doesn't honor bypass_url anymore?19:00
jogoharlowja: anyway stepping out to lunch, if you have any ideas they would be appreciated. But for now i think attaching gdb is the best bet19:00
harlowjajogo agreed, gdb would be really useful19:00
*** electrocucaracha has joined #openstack-nova19:01
harlowjaalso figuring out which eventlet hub thats using might be useful to19:02
harlowjaprobably should dump that out somewhere19:02
harlowja*in the future19:02
*** mgarza_ has quit IRC19:04
*** Nikolay_St has joined #openstack-nova19:05
*** rwsu has quit IRC19:05
*** Longgeek_ has quit IRC19:07
melwittthomasem: it should, if it's not, it's a bug. what version are you using?19:08
thomasemmelwitt: looking into it. 2.26.0, I see a fix for this problem going in to 2.25.0, so it may be some other environmental issue19:09
*** electrocucaracha has quit IRC19:10
*** busterswt has joined #openstack-nova19:11
*** whenry has quit IRC19:11
*** markmcclain has joined #openstack-nova19:11
*** dramakri has left #openstack-nova19:11
melwittthomasem: are you using --bypass-url to specify the bypass url? if that doesn't work, it would help us if you open a bug against novaclient about it19:12
*** LukeHinds has quit IRC19:12
thomasemmelwitt: false alarm, I think :)19:12
*** Mike_D_laptop1 has quit IRC19:12
thomasemmelwitt: sorry for that19:12
*** markmcclain has quit IRC19:12
openstackgerritDavanum Srinivas (dims) proposed openstack/nova-specs: Add rootwrap-daemon-mode blueprint  https://review.openstack.org/10540419:12
thomasemmelwitt: If I do discover it's a problem, I'll open a bug and probably submit a patch for it.19:12
thomasemmelwitt: Thanks for your time on it19:12
*** ctrath has left #openstack-nova19:13
*** dramakri has joined #openstack-nova19:13
*** markmcclain has joined #openstack-nova19:13
melwittthomasem: okay, I will be sad if that's broken again. :) sure, sounds good19:13
*** ayoung has joined #openstack-nova19:13
thomasemLOL, yeah, right?19:13
*** rwsu has joined #openstack-nova19:13
*** ctrath has joined #openstack-nova19:13
*** atuvenie__ has quit IRC19:13
*** ctrath has left #openstack-nova19:15
*** mgarza_ has joined #openstack-nova19:15
*** sudipto has quit IRC19:16
thomasemmelwitt: confirmed false alarm, just saw the requests go through fine.19:16
thomasemSleep easy19:16
melwittthomasem: haha, yay19:16
thomasemhuzzah19:17
mriedemi thought mox was strict about the order of calls?19:17
mriedemi.e. if A is called before B but you mox then out in the opposite order it would fail?19:17
*** scheuran has joined #openstack-nova19:17
harlowjajogo http://bugs.python.org/issue13697 may be releated (not sure); getting that gdb backtrace would be great :)19:18
*** busterswt has quit IRC19:18
harlowjaif ^ is releavant, lifeless might have some idears19:18
openstackgerritQin Zhao proposed openstack/nova: Make compute rpc api to send instance object  https://review.openstack.org/19479119:21
*** openstackgerrit has quit IRC19:21
artommriedem, thanks for your review of the all tenants floating IPs spec.19:22
mriedemartom: np19:22
*** openstackgerrit has joined #openstack-nova19:22
artomI'm wondering what you meant by a change in policy.json having a security impact...19:22
artomThe spec template doesn't really mention policy.json in the security section.19:22
*** yamahata has joined #openstack-nova19:23
mriedemartom: well, maybe it's just a deployment impact, but i'd think that changes to the default policy.json are security related19:23
artomShould I just mention "it's an admin API by default, it's proabably a bad idea for operators to open this up to everyone" ?19:23
*** yamahata has quit IRC19:24
mriedemartom: doesn't there have to be an entry in the default policy.json and then the floating_ips extension has to check for that policy setting when all_tenants is used?19:24
mriedemlike in fping19:24
*** yamahata has joined #openstack-nova19:24
*** ctrath has joined #openstack-nova19:24
mriedemartom that's why i added ken'ichi19:25
mriedemfor the api questions19:25
mriedemmight want to ask sdague about the policy.json question19:25
*** achanda has quit IRC19:26
artommriedem, that pinged him. Do I need to do it twice more, like for Cthulhu?19:26
artom;)19:26
*** husanu has quit IRC19:26
mriedemno, more than once makes him swallow your soul in the water deep19:26
mriedem*watery19:26
artomNot much left to swallow...19:27
*** lpetrut has joined #openstack-nova19:27
*** husanu has joined #openstack-nova19:28
*** lyarwood has quit IRC19:29
*** lyarwood has joined #openstack-nova19:29
*** fifieldt_ has joined #openstack-nova19:31
artommriedem, next point! The ceilometer thing was reverted out, no? https://review.openstack.org/#/c/99212/19:32
artomSo it shouldn't be polling the API anymore (anyways the API hasn't existed for like a year)19:32
mriedemartom: i assumed you were going to be adding that back into ceilometer19:33
mriedemhence the need for the api in onva19:33
mriedem*nova19:33
artommriedem, nope, it's users who are asking it.19:33
artomApparently some admins want to do it, since the client advertised that we could19:33
*** fifieldt has quit IRC19:34
*** annashen has joined #openstack-nova19:34
*** belmoreira has quit IRC19:35
*** Mike_D_laptop has joined #openstack-nova19:36
bauzasmriedem: heard about nova.tests.unit.objects.test_instance.TestRemoteInstanceObject.test_save_objectfield_missing_instance_row failure ?19:36
mriedembauzas: heard about it?19:36
mriedemno19:36
bauzasmriedem: tried to see logstash and there are some failures19:36
bauzasmriedem: http://logstash.openstack.org/#eyJzZWFyY2giOiJidWlsZF9uYW1lOlwiZ2F0ZS1ub3ZhLXB5dGhvbjI3XCIgQU5EIG1lc3NhZ2U6XCJ0ZXN0dG9vbHMubWF0Y2hlcnMuX2ltcGwuTWlzbWF0Y2hFcnJvclwiIEFORCBidWlsZF9zdGF0dXM6XCJGQUlMVVJFXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjYwNDgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0MzUwODgyMjQ1NjN919:37
*** Longgeek has joined #openstack-nova19:38
bauzasmriedem: so was wondering if you were aware of it b/c http://status.openstack.org/elastic-recheck/ doesn't provide it19:38
*** dprince has quit IRC19:38
bauzasmriedem: a good opportunity for merging a patch for e-r ? :)19:39
mriedembauzas: that query is really generic19:39
mriedemany mismatch failure in nova unit tests would hit that19:39
*** Marga_ has joined #openstack-nova19:39
*** iamjarvo has quit IRC19:39
*** electrocucaracha has joined #openstack-nova19:39
*** annashen has quit IRC19:40
mriedemi first need to figure out why mox isn't verifying the order of calls on moxed out calls19:40
bauzasmriedem: build_name:"gate-nova-python27" AND message:"testtools.matchers._impl.MismatchError: &lt;bound method Instance.save of Instance" AND build_status:"FAILURE" would be better19:40
*** thorst has quit IRC19:40
*** tonytan4ever has quit IRC19:40
bauzasmriedem: and you're right, using this new message shows that the failure is really new19:41
bauzashttp://logstash.openstack.org/#eyJzZWFyY2giOiJidWlsZF9uYW1lOlwiZ2F0ZS1ub3ZhLXB5dGhvbjI3XCIgQU5EIG1lc3NhZ2U6XCJ0ZXN0dG9vbHMubWF0Y2hlcnMuX2ltcGwuTWlzbWF0Y2hFcnJvcjogJmx0O2JvdW5kIG1ldGhvZCBJbnN0YW5jZS5zYXZlIG9mIEluc3RhbmNlXCIgQU5EIGJ1aWxkX3N0YXR1czpcIkZBSUxVUkVcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQzNTA4ODM5OTU4Mn0=19:41
*** rwsu has quit IRC19:41
*** tonytan4ever has joined #openstack-nova19:41
mriedembauzas: is there a bug reported?19:41
bauzasmriedem: none I found, so I'm gonna create it and match it for the e-r query19:41
mriedemhttp://goo.gl/LjaHFH19:41
mriedemyeah, showed up in the last 24 hours19:42
mriedemso what did we merge that touches that code?19:42
bauzasmriedem: lemme see19:42
bauzasmriedem: before doing all the things, I wanted to see if you were aware of that19:42
bauzasmriedem: now that it seems it's a new failure, I'll look at it19:42
*** aix has joined #openstack-nova19:43
*** sambol has joined #openstack-nova19:43
*** achanda has joined #openstack-nova19:43
*** tjones1 has quit IRC19:43
openstackgerritArtom Lifshitz proposed openstack/nova-specs: Support --all-tenants in floatingips-list  https://review.openstack.org/17138919:44
*** Mike_D_laptop has quit IRC19:44
*** rwsu has joined #openstack-nova19:45
*** tonytan4ever has quit IRC19:45
*** rdo has quit IRC19:45
*** tonytan4ever has joined #openstack-nova19:46
jaypipesanybody got the priorities etherpad or wiki page handy?\19:46
jaypipesbauzas: ^?19:46
mriedemjaypipes: https://etherpad.openstack.org/p/liberty-nova-priorities-tracking19:47
jaypipesdanke19:47
*** rdo has joined #openstack-nova19:47
bauzasmriedem: FYI, https://bugs.launchpad.net/nova/+bug/146808719:48
openstackLaunchpad bug 1468087 in OpenStack Compute (nova) "py27 job failing on test_save_objectfield_missing_instance_row" [High,Confirmed]19:48
bauzasmriedem: creating the e-r query, and trying to bisect the bug19:49
lifelessharlowja: heh, that was a fun investigation :)19:50
harlowjalifeless i bet :)19:50
lifelessjogo: ^ whats the context w.r.t. RLock ?19:51
*** tonytan4ever has quit IRC19:51
*** rwsu has quit IRC19:51
lifelessoh I see, eventlet using the python RLock will naturally suffer the same race19:51
harlowjajogo lifeless  https://bugs.launchpad.net/nova/+bug/146230519:52
openstackLaunchpad bug 1462305 in OpenStack Compute (nova) "multi-node test causes nova-compute to lockup" [High,In progress] - Assigned to Joe Gordon (jogo)19:52
harlowjahttp://logs.openstack.org/40/194540/1/check/check-tempest-dsvm-multinode-full/1c35401/logs/screen-n-cpu.txt.gz19:52
harlowja^ dead in water (but jogo hopefully can get a gdb trace from infra?)19:52
harlowjaso i was thinking/looking for something that might be releated19:52
harlowjaand stumbled into that bug19:52
*** tonytan4ever has joined #openstack-nova19:52
*** sdake has quit IRC19:54
dimsjogo: around? can you please peek at this rootwrap spec when you get a chance - https://review.openstack.org/#/c/105404/19:54
dimsjogo: implementation is ready as well (https://review.openstack.org/#/c/180695/) but that can wait19:55
*** Marga_ has quit IRC19:56
*** brad[] has joined #openstack-nova19:56
*** Marga_ has joined #openstack-nova19:57
*** tjones1 has joined #openstack-nova19:58
jogodims: looking19:59
*** gholler has joined #openstack-nova20:03
*** otter768 has joined #openstack-nova20:03
*** annegentle has joined #openstack-nova20:04
*** thangp has quit IRC20:05
*** achanda has quit IRC20:06
*** greghaynes has quit IRC20:08
*** gholler has quit IRC20:09
*** otter768 has quit IRC20:09
*** gholler has joined #openstack-nova20:09
*** ndipanov has quit IRC20:10
*** romainh has joined #openstack-nova20:10
jogodims: needs one quick respin then +2 from me20:11
*** thorst has joined #openstack-nova20:12
*** Marga_ has quit IRC20:13
*** Flcn has quit IRC20:14
*** Marga_ has joined #openstack-nova20:14
*** Marga_ has quit IRC20:15
*** Marga_ has joined #openstack-nova20:15
*** gszasz has quit IRC20:15
*** prashup has quit IRC20:15
openstackgerritSylvain Bauza proposed openstack/nova: Add to_dict() to ImageMeta and ImageMetaProps objects  https://review.openstack.org/18647420:16
openstackgerritSylvain Bauza proposed openstack/nova: Add RequestSpec methods for primitiving into dicts  https://review.openstack.org/18719720:16
openstackgerritSylvain Bauza proposed openstack/nova: Use RequestSpec object in HostManager  https://review.openstack.org/19125120:16
openstackgerritSylvain Bauza proposed openstack/nova: Use the same pci_requests field for all filters and HostManager  https://review.openstack.org/19125020:16
openstackgerritSylvain Bauza proposed openstack/nova: Remove unnecessary method in FilterScheduler  https://review.openstack.org/18848520:16
openstackgerritSylvain Bauza proposed openstack/nova: Consider that all scheduler calls are IO Ops  https://review.openstack.org/18848620:16
openstackgerritSylvain Bauza proposed openstack/nova: Create RequestSpec object  https://review.openstack.org/14552820:16
openstackgerritSylvain Bauza proposed openstack/nova: Use RequestSpec object in the FilterScheduler  https://review.openstack.org/18848720:16
*** tonytan4ever has quit IRC20:16
*** annegentle has quit IRC20:18
*** annegentle has joined #openstack-nova20:18
bauzasargh, review.o.o is still flakey20:19
*** Sukhdev has joined #openstack-nova20:20
*** iamjarvo has joined #openstack-nova20:22
*** jasondotstar has quit IRC20:22
*** jogo has quit IRC20:25
melwittmriedem: where is the thing where you see mox not verifying order of calls? I also thought it does20:25
*** jogo has joined #openstack-nova20:26
mriedemmelwitt: in http://git.openstack.org/cgit/openstack/nova/tree/nova/tests/unit/network/test_manager.py#n92220:26
mriedemmelwitt: i have a change where virtual_interface_get_by_instance_and_network is called before fixed_ip_associate_pool20:26
mriedembut the test doesn't fail20:26
*** toure has quit IRC20:29
*** Nikolay_St has quit IRC20:30
melwittmriedem: yeah, I thought that should fail. only thing I can think so far is if somehow the mox from mox3 is different, since that's where mox is coming from in oslo.test20:30
mriedemmelwitt: yeah, that's what i was wondering20:31
mriedemhttps://github.com/openstack/oslotest/commit/9e0c8ad2c251274128499a7fcfb591c488d27d2b20:31
*** baoli has quit IRC20:31
*** dontalton has quit IRC20:32
*** dontalton has joined #openstack-nova20:33
*** greghaynes has joined #openstack-nova20:33
*** greghaynes has quit IRC20:33
*** claudiub has quit IRC20:34
*** nic has quit IRC20:34
*** haypo has joined #openstack-nova20:38
*** vladikr has quit IRC20:39
*** rwsu has joined #openstack-nova20:39
*** ajayaa has quit IRC20:41
melwittmriedem: maybe you already saw this but it intends to verify ordering from the look of the tests, I don't see a test that verifies it raises UnexpectedMethodCallError if calls are made out of order though https://github.com/openstack/mox3/blob/master/mox3/tests/test_mox.py other than that you can sanity test substituting to use plain mox and see what it does. the docs say it's strict about ordering and that's been my experience with it20:43
*** claudiub has joined #openstack-nova20:44
mriedemmelwitt: i see a few self.assertRaises(mox.UnexpectedMethodCallError, call) in there20:45
mriedemmelwitt: i could maybe poke that bear later, for now i just wrote new tests20:45
mriedemsince this has to be backported anyway20:45
*** Nikolay_St has joined #openstack-nova20:46
melwittmriedem: I thought those were boolean like called when not expected to be called, but I could have missed something20:46
melwittmriedem: okay, cool20:47
*** promulo has quit IRC20:48
*** annashen has joined #openstack-nova20:51
*** htruta has quit IRC20:52
bauzasmelwitt: hey, while you're here, I have a question for you :)20:54
bauzasmelwitt: https://bugs.launchpad.net/nova/+bug/146808720:54
openstackLaunchpad bug 1468087 in OpenStack Compute (nova) "py27 job failing on test_save_objectfield_missing_instance_row" [High,Confirmed]20:54
bauzasmelwitt: for some reason the unittest you added is failing since 24h20:54
bauzasmelwitt: tbc, it's not failing all of times, but rather racing20:55
bauzasmelwitt: and on the remote side only20:55
dimsjogo: thanks20:55
*** ivasev has quit IRC20:56
*** changbl_ has quit IRC20:56
*** alexpilotti has quit IRC20:57
*** scheuran has quit IRC20:58
openstackgerritMatt Riedemann proposed openstack/nova: Reduce window for allocate_fixed_ip / release_fixed_ip race in nova-net  https://review.openstack.org/19481520:58
mriedemdansmith: melwitt: sdague: that's part one ^20:58
bauzasmelwitt: like if the mocks were not working20:58
bauzasmelwitt: unfortunately, we don't know which field method is ok20:59
*** ociuhandu has joined #openstack-nova20:59
openstackgerritDavanum Srinivas (dims) proposed openstack/nova-specs: Add rootwrap-daemon-mode blueprint  https://review.openstack.org/10540421:00
*** Nikolay_St has quit IRC21:02
*** Raildo_ has joined #openstack-nova21:03
bauzasmelwitt: no worries, I'm going off, I'll be looking at the problem by tomorrow21:03
haypojogo, hi. for https://review.openstack.org/#/c/194128/ "Make gate-nova-python34 voting" i have no strong opinion on adding a py34 gate, not only py34 check. the first version of my spec added both jobs21:03
*** annegentle has quit IRC21:03
*** chen12 has quit IRC21:04
haypoi'm now unable to find logs of the discussion on the py34 gate. maybe it was on irc, sorry i don't remember21:04
*** chen12 has joined #openstack-nova21:04
*** lyarwood has quit IRC21:04
*** lyarwood has joined #openstack-nova21:05
dansmithalaski: oops, sorry I missed your comments on the migration status patch21:07
dansmithalaski: no vote meant it didn't get seen21:07
dansmithalaski: I'll circle bac21:07
dansmithk21:07
*** Nikolay_1t has joined #openstack-nova21:07
*** alex_klimov has joined #openstack-nova21:07
dimsjogo: https://review.openstack.org/105404 is ready! thanks21:07
alaskidansmith: no worries.  It wasn't quite enough for a -121:07
*** lpetrut has quit IRC21:08
*** eharney has quit IRC21:09
*** radek__ has quit IRC21:10
melwittbauzas: looking into it, I forgot I added that test21:10
*** aysyanne has quit IRC21:10
*** Marga_ has quit IRC21:10
jogohaypo: without the gate job we can and will wedge things21:11
jogoan easy example would be a patch that expands the set of tests to run under py3421:11
haypojogo, the rationale was "it's unlikely" :-)21:11
*** adrian_otto has joined #openstack-nova21:11
ctrathmriedem: so, how does moving the vif call to the beginning of the try block reduce the race window?21:11
jogohaypo: with the number of patches we approve daily unlikely will happen21:11
haypojogo, ok. i don't think that it will add so much workload to the openstack infra21:12
mriedemctrath: b/c today the order is associate / allocate vif21:13
mriedemctrath: the release_fixed_ip method is checking association and allocated flags21:13
ctrathmriedem: I'm assuming that get_by_instance_and_network just adds padded time before getting the address21:13
mriedemctrath: so we want to reduce any amount of time it takes to set the allocated flag to True21:13
mriedemctrath: there is also _add_virtual_interface21:13
jogohaypo: if we hit any resource issues we can revisit this yeah21:13
openstackgerritdane-fichter proposed openstack/nova-specs: Nova Support of Glance Image Signing  https://review.openstack.org/18887421:14
haypojogo, it sounds like a good plan. in my short experience of openstack, it's really annoying when a gate is broken (for any reason)21:14
ctrathmriedem: ok.. I'm also assuming that the real fix in release_fixed_ip is going to take time and investigation, thus the reason for this "hack"?21:15
openstackgerritdane-fichter proposed openstack/nova-specs: Nova Support of Glance Image Signing  https://review.openstack.org/18887421:15
mriedemctrath: we know what the real fix is and i'm working on that21:15
mriedemctrath: but it requires rpc api version changes which we generally don't want to backport to stable branches21:15
ctrathgotcha.. thanks21:15
mriedemso the first patch is a tactical backportable patch for stable21:15
*** rlrossit has left #openstack-nova21:15
mriedemthen we do the rpc api version change21:15
*** annegentle has joined #openstack-nova21:16
*** fawadkhaliq has joined #openstack-nova21:17
ctrathmriedem: is there a way to test to see if the address is not yet released?21:17
jogohaypo: yup, it makes developers stabby21:17
mriedemctrath: so the dhcpagent callback is what's calling release_fixed_ip21:18
mriedemso that's on a different thread21:18
*** karimb has joined #openstack-nova21:18
mriedemctrath: so the fix is going to be to see if the released mac is the same as the vif that is associated with the instance that is tied to the fixed IP being released,21:18
mriedemif not, it's the wrong vif and the wrong instance and we should ignore release_fixed_ip21:18
ctrathok.. That's fine.. I'm wondering if we could try to get the address in a for loop until we successfully obtain it, or fail at a given timeout21:19
*** matrohon has joined #openstack-nova21:19
*** tonytan4ever has joined #openstack-nova21:20
mriedemctrath: well, there is another way to fix this, which is making the association between the fixed_ip and instance atomic with setting the fixed_ip.allocated flag to True21:20
mriedemin the db api21:20
mriedemb/c then release_fixed_ip would see that the fixed IP is allocated and won't disassociate it21:20
*** fawadkhaliq has quit IRC21:21
mriedemwe could potentially do both changes, but both require rpc api version changes so neither are backportable really21:21
*** oro has joined #openstack-nova21:22
ctrathyeah, Ok.  I was trying to see if there was a better way of adverting this other than lengthining the time window21:22
openstackgerritWalter A. Boring IV (hemna) proposed openstack/nova: Switch to using os-brick  https://review.openstack.org/17556921:22
mriedemctrath: we're fixing release_fixed_ip first b/c it's dangerous on it's own given it can potentially disassociate fixed IPs from the wrong instance - we need the mac comparisong regardless21:22
openstackgerritWalter A. Boring IV (hemna) proposed openstack/nova: Add os_brick-based VolumeDriver for HGST connector  https://review.openstack.org/19441221:24
openstackgerritWalter A. Boring IV (hemna) proposed openstack/nova: Add os-brick based LibvirtVolumeDriver for ScaleIO  https://review.openstack.org/19445421:24
*** thorst has quit IRC21:26
*** Nikolay_1t has quit IRC21:27
melwittdansmith: I noticed on your patch that fixes the test_save_objectfield_missing_instance_row, the serialize_entity gets stuck in a loop doing the remote test, do you understand it? http://logs.openstack.org/05/192805/3/gate/gate-nova-python27/da81c4f/testr_results.html.gz21:28
*** matrohon has quit IRC21:28
dansmithmelwitt: hmm, I saw that once locally and then never again after repeated attempts21:28
dansmithso, no... I'll have to think on it a bit21:28
*** krtaylor has quit IRC21:29
melwittdansmith: okay. I'll recheck it then, I think your patch will fix the bug that bauzas is looking into with that unit test failing sometimes (because of attr not set)21:29
dansmithwell, we don't want to merge this if it's doing this21:30
dansmithI just didn't see it again, but it's clearly still a problem21:30
*** adrian_otto has quit IRC21:30
melwittokay21:31
*** romainh has quit IRC21:32
*** Nikolay_St has joined #openstack-nova21:33
*** annegentle has quit IRC21:34
*** annegentle has joined #openstack-nova21:34
*** iamjarvo has quit IRC21:34
openstackgerritWalter A. Boring IV (hemna) proposed openstack/nova: Switch to using os-brick  https://review.openstack.org/17556921:40
openstackgerritWalter A. Boring IV (hemna) proposed openstack/nova: Add os_brick-based VolumeDriver for HGST connector  https://review.openstack.org/19441221:40
openstackgerritWalter A. Boring IV (hemna) proposed openstack/nova: Add os-brick based LibvirtVolumeDriver for ScaleIO  https://review.openstack.org/19445421:40
openstackgerritTracy Jones proposed openstack/nova: Cleanup of compute api reboot method  https://review.openstack.org/12742721:43
*** kentb1 has joined #openstack-nova21:44
*** electrocucaracha has quit IRC21:46
melwittdansmith: looking at it, I'm guessing it's because the test is manipulating _changed_fields without actually setting the field to anything, and might be messing up the serialize logic. ideally, the test should just set the field to something instead of adding to changed fields21:46
*** kentb1 has quit IRC21:48
dansmithhmm, I dunno it's trying to load ec2_ids21:48
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/19432521:48
*** electrocucaracha has joined #openstack-nova21:49
dansmithoh21:50
*** annashen has quit IRC21:51
dansmithso actually I should just make that the list of things that touch instance_extra21:51
*** jecarey has quit IRC21:51
dansmithjust because they are a _save_thing() doesn't mean they should be in this test21:51
dansmithand ec2_ids is one of those21:51
openstackgerritClaudiu Belu proposed openstack/nova-specs: Adds Hyper-V Shielded VMs spec  https://review.openstack.org/19289221:53
*** thedodd has quit IRC21:53
melwittdansmith: hm, okay21:53
dansmithor just move this test to the non-remote class21:54
dansmithbecause it's mocking out things that make sense for us to do, but that are just confusing the serialization stuff21:54
*** ianbrown has joined #openstack-nova21:54
*** Nikolay_St has quit IRC21:54
*** haypo has quit IRC21:55
melwittdansmith: it's just because there isn't any ec2 ids set for the fake instance then? yeah, I wasn't think of remote when I wrote that21:55
dansmithwell,21:55
dansmithbecause it's not set, but we're telling the thing that it _is_set21:56
dansmithso the serialization stuff wants to serialize it since it's set21:56
dansmithbut it's not, so the getattr triggers a load21:56
melwittah, yeah21:56
dansmithso I'll just move it21:56
melwittokay, cool. makes sense21:57
dansmithincoming21:58
openstackgerritDan Smith proposed openstack/nova: Remove compat_instance()  https://review.openstack.org/19270821:58
openstackgerritDan Smith proposed openstack/nova: Fix testing object fields with missing instance rows  https://review.openstack.org/19280521:58
*** marun has quit IRC21:59
*** oro has quit IRC21:59
*** chen12 has quit IRC22:00
*** Nikolay_St has joined #openstack-nova22:00
openstackgerritJoe Gordon proposed openstack/nova: Replace ascii art architecture diagram with svg image  https://review.openstack.org/19484022:01
*** agireud has quit IRC22:01
jogomriedem: ^22:02
*** burt has quit IRC22:03
mtreinishjogo: heh, https://review.openstack.org/#/c/194840/1/doc/source/images/architecture.svg is totally hand editable in an editor :)22:03
jogool22:04
jogolol22:04
harlowjagood think that dia stuff is opensource :-P22:04
*** otter768 has joined #openstack-nova22:04
harlowja*thing22:04
jogotoo bad the dia file isn't22:04
harlowja* https://review.openstack.org/cat/194840%2C1%2Cdoc/source/images/architecture.svg%5E0 (for those that want to view it)22:04
*** claudiub has quit IRC22:05
harlowjashould render in all (less than 5 year old) browsers22:05
*** edmondsw has quit IRC22:05
jogoharlowja: neat! how did you do that22:05
*** electrocucaracha has quit IRC22:05
jogoerr find it22:05
harlowjajogo http://i.imgur.com/Yph3auH.png22:06
harlowjaclick on that download link, and thats ^22:06
openstackgerritMatt Riedemann proposed openstack/nova: Check mac for instance before disassociate in release_fixed_ip  https://review.openstack.org/19484322:06
harlowjathe little arrow thingy22:06
*** electrocucaracha has joined #openstack-nova22:06
jogoahh slick22:06
*** karimb has quit IRC22:06
mtreinishharlowja: heh, I was going to make a joke about using lynx but it did the right thing and asked would you like to download the image file22:07
jogohaha22:07
harlowjanon-terminal based, (less than 5 year old) browsers22:07
harlowja* http://caniuse.com/#search=svg22:07
harlowjaall those, ha22:07
jogoharlowja: so just not IE822:08
harlowjaseems so22:08
harlowjaoh well22:08
*** annegent_ has joined #openstack-nova22:09
*** otter768 has quit IRC22:09
harlowjaand some old andriod browsers (that apparently have partial support)22:09
mtreinishharlowja: that site doesn't even mention lynx... :(22:09
harlowjalol22:09
harlowjahttps://lists.nongnu.org/archive/html/lynx-dev/2010-08/msg00007.html ( SVG support in Lynx)22:10
harlowjalol22:10
harlowjaso who knows, something may work there :-P22:10
*** Raildo_ has quit IRC22:11
*** xgsa has quit IRC22:11
*** annegentle has quit IRC22:13
*** annashen has joined #openstack-nova22:13
*** annashen has quit IRC22:13
*** annashen has joined #openstack-nova22:13
*** chen12 has joined #openstack-nova22:15
*** xgsa has joined #openstack-nova22:17
* dansmith channels mriedem 22:17
dansmithgd pep822:17
*** Sukhdev has quit IRC22:19
*** dontalton2 has joined #openstack-nova22:19
*** mriedem has quit IRC22:20
*** husanu has quit IRC22:20
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: Enable python34 tests for nova/tests/unit/objects/test*.py  https://review.openstack.org/18778522:20
*** Nikolay_St has quit IRC22:20
*** Nikolay_St has joined #openstack-nova22:21
*** jgrimm is now known as zz_jgrimm22:21
*** rfolco has quit IRC22:21
*** annegent_ has quit IRC22:22
*** husanu has joined #openstack-nova22:22
*** annegentle has joined #openstack-nova22:22
*** gyee has quit IRC22:23
*** yamahata has quit IRC22:23
dimsdansmith: seen the test_save_objectfield_missing_instance_row intermittent error yet?22:25
dansmithdims: in my patch or in general?22:25
dimsdansmith: general i think now - https://bugs.launchpad.net/nova/+bug/146808722:26
openstackLaunchpad bug 1468087 in OpenStack Compute (nova) "py27 job failing on test_save_objectfield_missing_instance_row" [High,Confirmed]22:26
dansmithdims: I see your bug and raise you a patch: https://review.openstack.org/#/c/192805/22:26
*** xyang1 has quit IRC22:26
dimsdansmith: yay!22:27
*** gyee has joined #openstack-nova22:27
tjones1melwitt or dansmith: i've modifed part of manage.py to convert to using objects.  Im looking for the unit tests to run (since i don't want to spend 2 hours running them all).  For example, I grepped for VpnCommands to see if i could find the tests and i don't see any.  Are there unit tests for nova/cmd/manage.py?  if you don't know off hand i can keep looking (or run all tests)22:28
dansmithtjones1: nova/tests/unit/test_manage.py?22:28
*** alex_klimov has quit IRC22:28
tjones1dansmith: so simple22:28
tjones1thanks22:28
tjones1let me look for that object22:29
openstackgerritDan Smith proposed openstack/nova: Remove compat_instance()  https://review.openstack.org/19270822:29
openstackgerritDan Smith proposed openstack/nova: Fix testing object fields with missing instance rows  https://review.openstack.org/19280522:29
tjones1dansmith: ah no wonder.  no tests for VpnCommands22:29
tjones1thanks for the pointer22:30
dansmithnp22:30
dimsdansmith: need 2 obj_reset_changes? one before and one after save?22:31
*** ijuwang is now known as ijuwang_away22:32
*** dboik has quit IRC22:32
dimsdansmith: ah gotcha we are using the same instance and testing all the fields. nm22:32
*** kylek3h has quit IRC22:32
*** gholler has quit IRC22:34
*** annashen has quit IRC22:35
melwittdims: I'm still trying to understand what is going on in that failure, what "mismatch method returned none" means22:37
melwittdims: I think dansmith's patch will fix it, but I'm not clear on exactly what's wrong yet22:38
dimsmelwitt: save was supposed to throw an exception and it doesn't22:38
dansmithno22:38
dimsit returns None instead22:38
melwittoh /facepalm22:39
dansmithwell, the bug is actually a different thing22:39
dansmithbut it's probably related22:39
dansmiththis moves it out of the Remote class anyway, which I'm sure will fix it22:39
*** zzzeek has quit IRC22:40
dansmiththe test is mucking with stuff that is going to break the remoting regardless22:40
dimsdansmith: right, was explaining what the testtools.matchers._impl.MismatchError is tell us22:40
dimstelling us22:40
dansmithdims: oh right, sorry22:40
* dansmith retracts his no22:40
dims:)22:40
*** ctrath has quit IRC22:42
*** mdrabe has quit IRC22:44
openstackgerritTracy Jones proposed openstack/nova: WIP - convert direct db calls to objects  https://review.openstack.org/19485122:45
*** rwsu has quit IRC22:47
*** Nikolay_St has quit IRC22:48
*** Nikolay_St has joined #openstack-nova22:48
melwittdansmith: I wonder if it's because the test mock.patch.object(instance) instead of mock.patch('nova.objects.Instance.save...') so the exception doesn't get raised after it's made the remote trip22:52
*** IanGovett has quit IRC22:54
*** baoli has joined #openstack-nova22:58
*** annashen has joined #openstack-nova22:58
*** baoli has quit IRC22:59
*** baoli has joined #openstack-nova23:00
*** r-daneel has quit IRC23:00
dansmithmelwitt: could be yeah, but it should be repeatable that way I'd think23:03
*** annegentle has quit IRC23:03
*** annegentle has joined #openstack-nova23:05
*** artom has quit IRC23:05
*** mriedem has joined #openstack-nova23:05
mriedemdansmith: gd is right23:05
dansmithheh23:06
*** baoli has quit IRC23:06
*** artom has joined #openstack-nova23:06
*** sdake has joined #openstack-nova23:07
dansmithmriedem: +2 this: https://review.openstack.org/#/c/192805/23:07
*** tonytan4ever has quit IRC23:08
dansmithit happens to fix https://bugs.launchpad.net/nova/+bug/146808723:08
openstackLaunchpad bug 1468087 in OpenStack Compute (nova) "py27 job failing on test_save_objectfield_missing_instance_row" [High,Confirmed]23:08
*** annegentle has quit IRC23:10
mriedemlooking23:11
*** dboik has joined #openstack-nova23:12
*** ijw_ has joined #openstack-nova23:13
*** dboik has quit IRC23:14
mriedem+Walrus23:15
dansmith+Woohoo23:15
*** Nikolay_St has quit IRC23:15
openstackgerritMatt Riedemann proposed openstack/nova: Fix testing object fields with missing instance rows  https://review.openstack.org/19280523:15
mriedemdansmith: and then i went and f'ed up your topic branch23:16
mriedemadded the bug tag to the commit message23:16
*** Nikolay_St has joined #openstack-nova23:16
dansmithheh, okay23:16
*** dontalton2 has quit IRC23:16
*** dontalton has quit IRC23:16
dansmithit didn't set out to fix the bug, it's just a happy coincidence23:16
dansmithbut as you wish23:16
*** lucas-dinner has quit IRC23:17
kfox1111johnthetubaguy: how are we doing with the nova instance user spec for the spec freeze? the barbican and keystone ptl's have both +1'ed it.23:20
*** erlon has quit IRC23:20
*** angdraug has quit IRC23:21
mriedemit's going to be a terrible couple of weeks for johnthetubaguy23:21
kfox1111heh. yeah.23:22
*** mgarza_ has quit IRC23:22
kfox1111and for us folks trying so hard not to have to wait another 6 months. :/23:23
*** sdake_ has joined #openstack-nova23:23
*** jasondotstar has joined #openstack-nova23:23
mriedemi know, it's all terrible23:24
openstackgerritMichael Still proposed openstack/nova: libvirt: Kill rsync/scp processes before deleting instance  https://review.openstack.org/19298623:24
*** otter768 has joined #openstack-nova23:25
*** VW_ has quit IRC23:26
*** sdake has quit IRC23:26
*** ijw_ has quit IRC23:28
*** ijw_ has joined #openstack-nova23:28
*** ZZelle has quit IRC23:35
*** hemna is now known as hemnafk23:37
*** mriedem has quit IRC23:38
*** mriedem has joined #openstack-nova23:39
*** sdake_ has quit IRC23:40
*** Nikolay_St has quit IRC23:42
*** annashen has quit IRC23:42
*** Nikolay_St has joined #openstack-nova23:43
*** tjones1 has quit IRC23:47
*** isq has quit IRC23:54
*** dims has quit IRC23:56
*** ijw_ has quit IRC23:58
*** moshele_ has joined #openstack-nova23:58
*** moshele_ has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!