Wednesday, 2018-08-22

openstackgerritDan Smith proposed openstack/nova master: Batch results per cell when doing cross-cell listing  https://review.openstack.org/59269800:15
openstackgerritDan Smith proposed openstack/nova master: List instances from all cells explicitly  https://review.openstack.org/59371700:15
openstackgerritDan Smith proposed openstack/nova master: Make instance_list perform per-cell batching  https://review.openstack.org/59313100:15
openstackgerritDan Smith proposed openstack/nova master: Record cell success/failure/timeout in CrossCellLister  https://review.openstack.org/59426500:15
openstackgerritDan Smith proposed openstack/nova master: WIP: Optimize global marker re-lookup in multi_cell_list  https://review.openstack.org/59457700:15
*** gyee has quit IRC00:19
*** harlowja has quit IRC00:23
*** moshele has quit IRC00:25
*** imacdonn has quit IRC00:49
*** imacdonn has joined #openstack-nova00:49
*** gbarros has quit IRC01:01
*** mhen has quit IRC01:11
*** tbachman has joined #openstack-nova01:19
*** s1061123 has quit IRC01:21
*** rcernin_ has joined #openstack-nova01:23
*** gouthamr has quit IRC01:23
*** rcernin has quit IRC01:25
*** s1061123 has joined #openstack-nova01:27
*** tbachman has quit IRC01:38
*** gbarros has joined #openstack-nova01:44
*** Dinesh_Bhor has joined #openstack-nova01:55
*** rcernin has joined #openstack-nova02:00
*** rcernin_ has quit IRC02:03
*** hongbin has joined #openstack-nova02:22
*** lei-zh has joined #openstack-nova02:24
*** lei-zh has quit IRC02:33
*** lei-zh1 has joined #openstack-nova02:33
*** gouthamr has joined #openstack-nova02:36
*** edmondsw has quit IRC02:45
*** edleafe has quit IRC02:46
*** edleafe has joined #openstack-nova02:48
*** gbarros has quit IRC02:49
*** psachin has joined #openstack-nova02:51
*** tbachman has joined #openstack-nova03:02
*** Sundar has joined #openstack-nova03:06
*** tetsuro_ has joined #openstack-nova03:10
*** tetsuro has quit IRC03:10
*** Sundar has quit IRC03:11
*** brinzhang has joined #openstack-nova03:14
*** nicolasbock has quit IRC03:32
*** hongbin has quit IRC03:33
*** lei-zh1 has quit IRC03:41
openstackgerritMerged openstack/nova master: Making consistent used of GiB and MiB in API ref  https://review.openstack.org/55998504:03
*** Dinesh_Bhor has quit IRC04:04
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Make monkey patch work in uWSGI mode  https://review.openstack.org/59228504:04
openstackgerritSam Morrison proposed openstack/nova master: Allow ability for non admin users to use all filters on server list.  https://review.openstack.org/52655804:06
*** Bhujay has joined #openstack-nova04:16
openstackgerritGhanshyam Mann proposed openstack/nova master: Merge extended server attributes extension response  https://review.openstack.org/58459004:27
*** tbachman has quit IRC04:27
*** Dinesh_Bhor has joined #openstack-nova04:43
*** tbachman has joined #openstack-nova04:59
*** moshele has joined #openstack-nova05:00
*** tbachman_ has joined #openstack-nova05:01
*** moshele has quit IRC05:02
*** tbachman has quit IRC05:04
*** tbachman_ is now known as tbachman05:04
*** sdake has quit IRC05:13
*** sdake has joined #openstack-nova05:13
*** Dinesh_Bhor has quit IRC05:24
*** Dinesh_Bhor has joined #openstack-nova05:28
*** alex_xu has joined #openstack-nova05:31
*** edmondsw has joined #openstack-nova05:34
*** lei-zh has joined #openstack-nova05:35
openstackgerritMerged openstack/nova master: Merge config drive extension response into server controller  https://review.openstack.org/58422305:37
*** sdake has quit IRC05:50
*** Luzi has joined #openstack-nova05:51
*** sdake has joined #openstack-nova05:51
*** sdake has quit IRC06:02
*** sdake has joined #openstack-nova06:04
*** moshele has joined #openstack-nova06:06
*** dpawlik has joined #openstack-nova06:08
*** dpawlik has quit IRC06:13
*** dpawlik has joined #openstack-nova06:15
*** ccamacho has joined #openstack-nova06:20
*** ccamacho has quit IRC06:20
*** ccamacho has joined #openstack-nova06:20
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Make monkey patch work in uWSGI mode  https://review.openstack.org/59228506:21
*** ircuser-1 has joined #openstack-nova06:21
*** adrianc has joined #openstack-nova06:26
*** pcaruana has joined #openstack-nova06:41
maciejjozefczykmriedem_away: I'll review that, thanks06:47
*** tssurya has joined #openstack-nova06:47
*** claudiub has joined #openstack-nova06:49
openstackgerritMerged openstack/nova master: Use CONF.long_rpc_timeout in post_live_migration_at_destination  https://review.openstack.org/58866806:51
*** rcernin has quit IRC07:07
*** ispp has joined #openstack-nova07:08
*** Dinesh_Bhor has quit IRC07:10
*** ispp has quit IRC07:12
*** dtantsur|afk is now known as dtantsur07:22
*** evrardjp has joined #openstack-nova07:26
*** sahid has joined #openstack-nova07:28
*** luksky11 has joined #openstack-nova07:29
*** alexchadin has joined #openstack-nova07:31
*** ccamacho has quit IRC07:33
*** tbachman has quit IRC07:34
*** jpena|off is now known as jpena07:47
*** adrianc has quit IRC07:50
*** macza has joined #openstack-nova08:01
*** macza has quit IRC08:05
*** ccamacho has joined #openstack-nova08:16
*** ccamacho has quit IRC08:25
*** ccamacho has joined #openstack-nova08:26
*** holser_ has joined #openstack-nova08:26
*** pcaruana has quit IRC08:28
*** pcaruana has joined #openstack-nova08:30
*** s10 has joined #openstack-nova08:30
*** skatsaounis has quit IRC08:31
*** cdent has joined #openstack-nova08:31
*** skatsaounis has joined #openstack-nova08:37
*** davidsha has joined #openstack-nova08:44
*** josecastroleon has joined #openstack-nova09:00
*** sambetts_ is now known as sambetts09:00
*** brinzhang has quit IRC09:01
*** brinzhang has joined #openstack-nova09:01
*** moshele has quit IRC09:05
*** moshele has joined #openstack-nova09:05
*** elod has quit IRC09:06
*** elod has joined #openstack-nova09:12
*** brinzhang has quit IRC09:12
*** ttx has joined #openstack-nova09:17
*** alexchadin has quit IRC09:17
*** lei-zh has quit IRC09:20
*** alexchadin has joined #openstack-nova09:21
*** claudiub has quit IRC09:23
openstackgerritSergii Golovatiuk proposed openstack/nova master: libvirt: Always escape IPv6 addresses when used in migration URI  https://review.openstack.org/58954809:26
*** maciejjozefczyk has quit IRC09:28
*** Dinesh_Bhor has joined #openstack-nova09:32
*** moshele has quit IRC09:34
*** moshele has joined #openstack-nova09:45
*** ccamacho has quit IRC09:54
openstackgerritStephen Finucane proposed openstack/nova master: conf: Gather 'live_migration_scheme', 'live_migration_inbound_addr'  https://review.openstack.org/45657209:55
openstackgerritStephen Finucane proposed openstack/nova master: conf: Convert 'live_migration_inbound_addr' to HostAddressOpt  https://review.openstack.org/45657309:55
*** ccamacho has joined #openstack-nova09:55
openstackgerritStephen Finucane proposed openstack/nova master: conf: Add three new '[libvirt] live_migration_*' options  https://review.openstack.org/45657109:55
*** josecastroleon has quit IRC09:56
*** maciejjozefczyk has joined #openstack-nova09:57
*** sean-k-mooney has joined #openstack-nova10:00
openstackgerritChen proposed openstack/nova master: Normalize dashless 'resource provider create' uuid  https://review.openstack.org/56719110:04
*** jaosorior_ has quit IRC10:05
*** Dinesh_Bhor has quit IRC10:07
openstackgerritStephen Finucane proposed openstack/nova master: api: Remove unnecessary default parameter  https://review.openstack.org/56445110:09
*** Dinesh_Bhor has joined #openstack-nova10:10
*** alexchadin has quit IRC10:13
*** alexchadin has joined #openstack-nova10:14
*** alexchadin has quit IRC10:14
*** alexchadin has joined #openstack-nova10:15
*** alexchadin has quit IRC10:15
openstackgerritStephen Finucane proposed openstack/nova master: objects: Remove legacy '_from_dict' functions  https://review.openstack.org/53741410:21
*** Dinesh_Bhor has quit IRC10:25
*** lei-zh has joined #openstack-nova10:27
openstackgerritSurya Seetharaman proposed openstack/nova master: WIP: Record cell success/failure/timeout in CrossCellLister  https://review.openstack.org/59426510:27
openstackgerritSurya Seetharaman proposed openstack/nova master: Add get_by_cell_and_project() method to InstanceMappingList  https://review.openstack.org/59165610:27
openstackgerritSurya Seetharaman proposed openstack/nova master: Return a minimal construct for nova list when a cell is down  https://review.openstack.org/56778510:27
*** Dinesh_Bhor has joined #openstack-nova10:28
openstackgerritStephen Finucane proposed openstack/nova master: conf: Use new-style choice values  https://review.openstack.org/53092410:34
openstackgerritStephen Finucane proposed openstack/nova master: Modify PciDevice.uuid generation code  https://review.openstack.org/53048710:37
openstackgerritStephen Finucane proposed openstack/nova master: Add an online migration for PciDevice.uuid  https://review.openstack.org/53090510:37
*** adrianc has joined #openstack-nova10:39
*** s10 has quit IRC10:42
*** nicolasbock has joined #openstack-nova10:44
openstackgerritSurya Seetharaman proposed openstack/nova master: Record cell success/failure/timeout in CrossCellLister  https://review.openstack.org/59426510:45
openstackgerritSurya Seetharaman proposed openstack/nova master: WIP: Optimize global marker re-lookup in multi_cell_list  https://review.openstack.org/59457710:45
*** lei-zh has quit IRC10:46
*** dave-mccowan has joined #openstack-nova10:47
*** alexchadin has joined #openstack-nova10:48
kashyapmdbooth: Hi, I saw the scrollback discussion here this morning, and you pointed to your "essay code comment" about Nova consuming block device job events10:50
kashyapmdbooth: That is still indeed a thing, as you guessed10:51
kashyapAs the relevant upstrema libvirt bug is still open: https://bugzilla.redhat.com/show_bug.cgi?id=138216510:51
openstackbugzilla.redhat.com bug 1382165 in libvirt "virDomainGetBlockJobInfo: Adjust job reporting based on QEMU stats & the "ready" field of `query-block-jobs`" [Unspecified,New] - Assigned to libvirt-maint10:51
kashyapAnd Eric Blake (from libvirt) did acknowledge:10:51
kashyap[quote]10:51
kashyapYes, changing Nova to use event handlers is a good idea.  But I'm ALSO10:51
kashyapin favor of fixing libvirt to work around the qemu bug, by intentionally10:51
kashyapmunging the output to state cur<end (even if qemu reported cur==end) if10:51
kashyapqemu reports ready:false10:51
kashyap[/quote]10:51
*** alexchadin has quit IRC10:53
mdboothkashyap: Ah, ok. I wondered if the same applied to live migration, events, that is the preferred api being the events.10:54
mdboothdanpb seemed to be saying not.10:55
kashyapmdbooth: I see.  Dan knows the migration internals much better, obviously.10:56
*** slagle has quit IRC11:01
*** alexchadin has joined #openstack-nova11:04
*** josecastroleon has joined #openstack-nova11:08
*** erlon has joined #openstack-nova11:12
sean-k-mooneykashyap: the qemu bug might actully be a libvirt bug in a way. dan asked me to open a bug for the fact libvirt did not fail the compatilblity check when we removed setting the host_mtu on the interface as part of a migration11:14
kashyapsean-k-mooney: Yeah, saw that discussion scroll-by.  Do file the upstream bug before you forget :-)11:14
kashyapsean-k-mooney: Here's a convenient URL: https://bugzilla.redhat.com/enter_bug.cgi?product=Virtualization%20Tools&component=libvirt11:15
*** jaosorior has joined #openstack-nova11:15
*** Dinesh_Bhor has quit IRC11:16
sean-k-mooneyi will i have it written on my whiteboard. i need to check a few things in nova also to confim if there is something we can do in this case. such as setting the mtu for vhost-user interface in the xml.11:16
sean-k-mooneyi left out vhost-uesr because i was told setting the mtu in the vswich was all that was required, and non of the example show setting it in qemu but i will test it and see what happens.11:17
kashyapYep, noted.  Nice, you seem to have a physical whiteboard.  /me was thinking of getting such a thing for a while.11:17
*** ccamacho has quit IRC11:18
sean-k-mooneyya im terible at justing any kind of software tooling to track tings but makeing a note on a phyicla whiteboard works for me11:18
*** alexchadin has quit IRC11:19
sean-k-mooney/justing/using/11:19
* kashyap got used to Emacs Org-Mode for the last 4 years11:19
kashyapQuite happy with it11:19
*** jpena is now known as jpena|lunch11:20
sean-k-mooneyhehe but then i would have to learn emacs11:20
* kashyap uses (and learnt) Emacs _just_ for Org-Mode ;-)11:21
*** alexchadin has joined #openstack-nova11:22
*** ccamacho has joined #openstack-nova11:25
*** claudiub has joined #openstack-nova11:30
*** macza has joined #openstack-nova11:38
*** gibi_off is now known as gibi11:40
* gibi waves11:40
sean-k-mooneyo/11:40
*** macza has quit IRC11:43
*** mriedem_away is now known as mriedem11:54
*** mriedem has left #openstack-nova11:57
*** mriedem has joined #openstack-nova11:57
*** mriedem has quit IRC12:01
*** mriedem has joined #openstack-nova12:01
openstackgerritSergii Golovatiuk proposed openstack/nova master: libvirt: Always escape IPv6 addresses when used in migration URI  https://review.openstack.org/58954812:08
mriedemsean-k-mooney: in case you haven't seen, https://review.openstack.org/#/c/594508/ was the tactical fix for the live migration bug you were hitting where we incorrectly activate the dest host port binding even on migration failure - for rocky rc3 i'm proposing that we just ignore that event since we're not properly checking the job status;12:14
mriedemsean-k-mooney: then the patch on top of that *does* check the job status for that event12:14
mriedembut i have less confidence in the 2nd patch where we check job status12:15
mriedemsince it sounds like job info might be somewhat unreliable depending on when you get the job info object12:15
mriedemi've tried to be conservative and unless we can determine that it completed successfully, it just falls back to the previous behavior for that event (before rocky)12:16
*** jpena|lunch is now known as jpena12:20
*** rmart04 has joined #openstack-nova12:31
*** psachin has quit IRC12:32
openstackgerritSurya Seetharaman proposed openstack/nova master: [WIP] Add scatter_gather_single_cell utility  https://review.openstack.org/59494712:35
openstackgerritSurya Seetharaman proposed openstack/nova master: [WIP] Add scatter_gather_single_cell utility  https://review.openstack.org/59494712:37
*** rnoriega_ has joined #openstack-nova12:38
*** klosp has joined #openstack-nova12:49
mriedemsahid: i see you asked for the reno on https://review.openstack.org/#/c/589548/ - do we really need a release note for this?12:49
sean-k-mooneymriedem: i had not i was away having lunch. ill take a look now12:50
dr_gogeta86hi guys12:51
dr_gogeta86who can help me with this nova-manage problem12:52
dr_gogeta86says doesn't have the grant for nova_api database12:52
dr_gogeta86but on the other two controllers is it ok12:52
dr_gogeta86with the same nova.conf12:52
tssuryadr_gogeta86: are you sure the [api_database] is set on the nova.conf you are trying ?12:53
dr_gogeta86yep12:53
dr_gogeta86and is the same along controllers12:53
tssuryawhat is the nova-manage command that you are running ?12:53
dr_gogeta86but the error says ... it tries without password12:54
dr_gogeta86 /usr/bin/nova-manage --log-file /tmp/test_verbose  --verbose api_db sync12:54
tssuryaah auth issues..?12:54
tssuryadoesn't look like a "nova-manage problem" not sure then..12:55
sahidmriedem: that seemed good to have it, i don't have strong opinion, you probably have better of view than me in such topic12:56
mriedemwe can leave it, frickler also asked for one12:56
dr_gogeta86tssurya, i dunno12:57
dr_gogeta86even on nova12:58
dr_gogeta86write(1, "error: (pymysql.err.OperationalE"..., 115error: (pymysql.err.OperationalError) (1045, u"Access denied for user 'nova'@'10.20.105.31' (using password: NO)")12:58
mriedemdr_gogeta86: same user trying to run nova-manage on all the systems with the same permissions?12:58
mriedemcompare the nova user permissions12:58
mriedemor whatever you're using to run the command12:58
dr_gogeta86all nodes got the same nova.conf12:59
mriedemi'm not talking about nova.conf12:59
dr_gogeta86how to check it ?12:59
mriedemare you able to run other nova-manage commands?13:01
openstackgerritMatt Riedemann proposed openstack/nova master: libvirt: Always escape IPv6 addresses when used in migration URI  https://review.openstack.org/58954813:02
dr_gogeta86mriedem, no13:03
dr_gogeta86but i dunno why happen just in one node13:03
dr_gogeta86i've also checked the grant is there13:04
tssuryamriedem: any known gate issues or do we just recheck? http://logs.openstack.org/50/594050/6/gate/tempest-slow/fe8c5c0/job-output.txt.gz#_2018-08-22_11_44_24_316767, http://logs.openstack.org/50/594050/6/gate/tempest-slow/fe8c5c0/job-output.txt.gz#_2018-08-22_11_48_21_89067813:05
alex_xumriedem: yes, gmann is on vacation13:06
klosphi, does anyone have tips about the best way/docs to start learn how nova "works" internally? My goal in principle is not to commit anything, but I am working in a proof of concept where I would use OpenStack/nova to program an FPGA instead of booting VMs13:07
dr_gogeta86mriedem, i've strace it doesn't read nova.conf13:10
mriedemtssurya: recheck13:13
mriedemklosp: you probably want to talk to the cyborg team13:13
openstackgerritMerged openstack/nova stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky  https://review.openstack.org/59073113:18
klospmriedem: thanks for the tip. I am aware of cyborg project but I am looking for some simpler and faster solution for demo only. In my understanding cyborg need driver support also from vendor and I am not aware that the FPGA vendor I am using will support it in the short term13:20
*** Bhujay has quit IRC13:21
openstackgerritMerged openstack/osc-placement stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/58977313:21
*** bodgix has joined #openstack-nova13:21
*** eharney has joined #openstack-nova13:21
dr_gogeta86if i allow a grant on mysql without password it works just on one node13:22
dr_gogeta86and doesn't work in the others13:22
*** sahid has quit IRC13:25
openstackgerritMerged openstack/osc-placement stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky  https://review.openstack.org/58977413:27
dr_gogeta86nova-manage where did he get db settings ?13:29
dr_gogeta86directly from nova.conf13:29
dr_gogeta86or some other service ?13:29
*** josecastroleon has quit IRC13:44
*** josecastroleon has joined #openstack-nova13:44
mriedemdr_gogeta86: nova.conf13:44
dr_gogeta86doesn't fit13:44
mriedemsean-k-mooney: is there anything bad that can happen if we are plugging an inactive port?13:44
dr_gogeta86i've replaced a strange value as address13:44
dr_gogeta86doesn't change in what i see with strace13:44
sean-k-mooneymriedem: i am not sure. it would depend on the backend i think.13:45
mriedemovs13:45
mriedemSuccessfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a9:39,bridge_name='br-int',has_traffic_filtering=True,id=b835ff51-0262-4237-ab52-7b08206bd099,network=Network(6c9a79d8-b508-4a97-a15d-bf4acee8b4a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb835ff51-02')13:45
sean-k-mooneymriedem: for linux bridge we are just using brctl to say when a netdev with this name appears attach it to this bridge13:45
sean-k-mooneyfor ovs its similar but depends on if its hybridg plug true/false or vhost-user13:46
sean-k-mooneyvhost user is safe13:46
mriedemthis is the gate so not vhostuser13:47
mriedem"ovs_hybrid_plug": false13:47
sean-k-mooneyhybridge-plug=false is the same as linux bridge. we are just adding a port to ovs for a netdev that currently does not exists. ovs will wire it up when it gets created13:47
*** r-daneel has joined #openstack-nova13:48
sean-k-mooneyhybrid-plug=true is less safe. we are adding a veth pair to ovs and adding the other end to a linux bridge. traffic can flow form ovs to the linux bridge and back but it cant leave the linux bridge and enter the host.13:49
mriedemok was just trying to debug a gate failure with resize revert https://bugs.launchpad.net/nova/+bug/178840313:49
openstackLaunchpad bug 1788403 in OpenStack Compute (nova) "test_server_connectivity_cold_migration_revert randomly fails ssh check" [Medium,Confirmed]13:49
mriedemthis test does a cold migratoin and then reverts,13:49
mriedemthen tries to ssh into the guest which intermittently fails13:49
mriedembut tempest asserts the floating IP is active before trying to ssh13:50
sean-k-mooneymriedem: my gess would be mac learning gets messed up because of RARP packets emited by qemu as part of the migrate. i would have to check however.13:51
sean-k-mooneypluging the deactivated port should not cause issues however13:51
mriedemok13:53
mriedemwe also aren't waiting for any vif unplug/plug events before saying the server is active,13:53
mriedembut that seems to be on purpose13:53
mriedemhttps://review.openstack.org/#/c/179228/13:54
sean-k-mooneydid you repoduce this locally by the way. it would be interesting to see if the vm actully had an ip when it failed. i can try to repoduce after i test your live migration lifcycled event fixes if that would help13:55
mriedemno this is something i've seen failing in the gate13:55
sean-k-mooneythe gate job was just default ovs live migration env13:56
mriedemthis isn't live migration13:57
mriedemcold migrate13:57
mriedemit's also totally intermittent13:57
sean-k-mooneysorry yes that is what i ment13:57
sean-k-mooneyits just a default ovs multnode devstack install.13:57
dr_gogeta86mriedem, CONF = nova.conf.CONF  what is this ?13:59
mriedemit's a global13:59
*** alexchadin has quit IRC13:59
mriedemvariable that contains the conf information13:59
*** awaugama has joined #openstack-nova13:59
*** gouthamr has quit IRC14:00
sean-k-mooneydr_gogeta86: its just creating an alias to the global config object that was populated when the config was read on start up as mriedem said14:01
dr_gogeta86i'm wandering why doesn't read the correct one14:01
dr_gogeta86i dunno which one at this point14:01
sean-k-mooneydr_gogeta86: you can spcify the config to read with --config-file or --config-dir e.g. nova-manage --config-dir /etc/nova or nova-manage --config-file /etc/nova/nova.conf14:03
sean-k-mooneydr_gogeta86: that should be the default behavior however14:03
sean-k-mooneyso you should not need too14:03
*** nicolasbock has quit IRC14:04
*** klosp has quit IRC14:04
*** s10 has joined #openstack-nova14:05
dr_gogeta86i need to14:05
dr_gogeta86cause if put  --config-file /etc/nova/nova.conf14:05
dr_gogeta86works like a charm14:05
sean-k-mooneylet me check the code to see what the default path actully is14:06
dr_gogeta86tnx you14:06
*** Luzi has quit IRC14:07
s10Is there any way to specify custom logging config for nova-api running under uwsgi without using separate nova.conf for nova-api/nova-scheduler/nova-conductor? For simple nova-api we can pass --log-config-append option, but for uwsgi it seems not possible.14:08
*** moshele has quit IRC14:10
*** alex_xu has quit IRC14:10
*** alexchadin has joined #openstack-nova14:10
openstackgerritDan Smith proposed openstack/nova master: Make RecordWrapper record RequestContext and expose cell_uuid  https://review.openstack.org/59457214:11
dansmithyikun_: Kevin_Zheng tssurya: fixed that one thing in the tests ^14:12
dansmithI have suddenly collected a "cells performance mafia" following14:12
tssuryadansmith: :P (ack)14:12
dansmithtssurya: I certainly don't want to insert myself in front of any of your patches, but if you are waiting on another set anyway, it might make sense to go at the end of this series14:13
dansmithas you said14:13
*** efried is now known as efried_goatin14:14
tssuryayea, looks like the last patches needed from gmann are not there yet and existing last one needs update, so I can go after you..14:14
dansmithokay14:15
tssuryahowever I will wait for your initial patches so start geting merged before rebasing, since some are WIPs14:15
dr_gogeta86sean-k-mooney, no news14:15
dr_gogeta86?14:15
*** jiapei has joined #openstack-nova14:16
tssuryadr_gogeta86: the default path is /etc/nova/nova.conf, you need not have to put it explicitly14:16
dansmithtssurya: ack, let's plan to have the cells meeting today so we can get melwitt and mriedem on board with getting all these merged quickly14:16
tssuryadansmith: cool :)14:17
dr_gogeta86but doens't14:17
holser_thanks mriedem14:18
sean-k-mooneytssurya: actully looking at the code i can find where we set the defult. for the wsgi scipt for the api and placement i found it but i dont see it anywayre for the rest of the agents or command files14:18
*** mlavalle has joined #openstack-nova14:22
sean-k-mooneydr_gogeta86: i assume this is a production deployment where you need a password to connect to the db and not devstack correct14:23
*** dabukalam has quit IRC14:25
sean-k-mooneydr_gogeta86: tssurya i think the reason nova-manage works for devstack deployments without --config-file is that devstack install allows access to the db from localhost without any password14:25
*** munimeha1 has joined #openstack-nova14:26
*** dpawlik has quit IRC14:27
*** nicolasbock has joined #openstack-nova14:31
*** jdillaman has joined #openstack-nova14:32
mriedembut i plan on talking about cross cell migration in the cells meeting...14:33
mriedeman infinitely more fun topic14:33
*** alexchadin has quit IRC14:33
*** sahid has joined #openstack-nova14:33
*** tbachman has joined #openstack-nova14:40
openstackgerritDan Smith proposed openstack/nova master: Batch results per cell when doing cross-cell listing  https://review.openstack.org/59269814:41
openstackgerritDan Smith proposed openstack/nova master: List instances from all cells explicitly  https://review.openstack.org/59371714:41
openstackgerritDan Smith proposed openstack/nova master: Make instance_list perform per-cell batching  https://review.openstack.org/59313114:41
openstackgerritDan Smith proposed openstack/nova master: Record cell success/failure/timeout in CrossCellLister  https://review.openstack.org/59426514:41
openstackgerritDan Smith proposed openstack/nova master: WIP: Optimize global marker re-lookup in multi_cell_list  https://review.openstack.org/59457714:41
*** s10 has quit IRC14:47
openstackgerritMatt Riedemann proposed openstack/nova master: Wait for network-vif-plugged on resize revert  https://review.openstack.org/59506914:48
*** gouthamr has joined #openstack-nova14:50
openstackgerritMatt Riedemann proposed openstack/nova master: Wait for network-vif-plugged on resize revert  https://review.openstack.org/59506914:51
*** mmedvede is now known as mmedvede_14:55
*** mmedvede_ is now known as mmedvede14:55
*** tonyb has quit IRC15:04
*** efried_goatin is now known as efried15:06
*** rnoriega_ is now known as rnoriega15:07
dansmithmriedem: I think we should be good on this now: https://review.openstack.org/#/c/591735/515:07
*** pcaruana has quit IRC15:10
melwitt.15:10
mriedemying wang doesn't think so15:19
*** r-daneel has quit IRC15:23
*** r-daneel has joined #openstack-nova15:24
*** macza has joined #openstack-nova15:29
*** openstackgerrit has quit IRC15:31
*** efried has quit IRC15:36
*** efried has joined #openstack-nova15:36
*** openstackgerrit has joined #openstack-nova15:38
openstackgerritsahid proposed openstack/nova master: compute: reset instance events  https://review.openstack.org/42002615:38
*** luksky11 has quit IRC15:41
*** tbachman has quit IRC15:41
*** nicolasbock has quit IRC15:43
*** nicolasbock has joined #openstack-nova15:49
*** pcaruana has joined #openstack-nova15:49
*** tssurya has quit IRC15:53
*** erlon is now known as _erlon_15:55
openstackgerritBalazs Gibizer proposed openstack/nova-specs master: Add subtree filter for GET /resource_providers  https://review.openstack.org/59523615:55
*** _erlon_ is now known as erlon15:58
openstackgerritEric Fried proposed openstack/nova master: Compute: Handle reshaped provider trees  https://review.openstack.org/57623616:03
openstackgerritBalazs Gibizer proposed openstack/nova-specs master: Placement: support mixing required traits with any traits  https://review.openstack.org/56574116:03
*** gouthamr has quit IRC16:05
openstackgerritEric Fried proposed openstack/nova master: [placement] Regex consts for placement schema  https://review.openstack.org/59186316:09
openstackgerritEric Fried proposed openstack/nova master: [placement] Add /reshaper handler for POST  https://review.openstack.org/57692716:09
openstackgerritEric Fried proposed openstack/nova master: reshaper: Look up provider if not in inventories  https://review.openstack.org/58503316:09
openstackgerritEric Fried proposed openstack/nova master: Make get_allocations_for_resource_provider raise  https://review.openstack.org/58459816:09
openstackgerritEric Fried proposed openstack/nova master: Report client: Real get_allocs_for_consumer  https://review.openstack.org/58459916:09
openstackgerritEric Fried proposed openstack/nova master: Report client: get_allocations_for_provider_tree  https://review.openstack.org/58464816:09
openstackgerritEric Fried proposed openstack/nova master: Report client: _reshape helper, placement min bump  https://review.openstack.org/58503416:09
openstackgerritEric Fried proposed openstack/nova master: Report client: update_from_provider_tree w/reshape  https://review.openstack.org/58504916:09
openstackgerritEric Fried proposed openstack/nova master: Compute: Handle reshaped provider trees  https://review.openstack.org/57623616:09
*** jpena is now known as jpena|off16:09
efriedDoes anyone have the power to remove a bogus review? viz https://review.openstack.org/#/c/584598/16:10
efriedNot that we would necessarily let that stop us from merging the thing, but it's potentially distracting.16:10
openstackgerritBalazs Gibizer proposed openstack/nova-specs master: Network bandwidth resource provider  https://review.openstack.org/59524316:11
*** efried is now known as efried_rollin16:14
melwittefried: not that I know of. I think if anyone could, it might be infra people16:14
*** tbachman has joined #openstack-nova16:14
efried_rollinight16:15
dansmithtrivial change'll fix it :)16:17
*** tbachman_ has joined #openstack-nova16:17
dansmiththat person has been -1ing with no comment on a lot of patches16:17
melwittyeah. I'm wondering if they're scripting it16:18
*** tbachman has quit IRC16:19
*** tbachman_ is now known as tbachman16:19
mriedemthey are -1ing changes that have other -1s on them16:22
mriedema few +1s i guess https://review.openstack.org/#/q/reviewer:wangying%2540gohighsec.com16:22
mriedemso probably not scripted16:22
mriedemgiven the small sample size16:22
mriedemKevin_Zheng: ^ shame them on wechat :)16:23
openstackgerritMerged openstack/nova master: Handle binding_failed vif plug errors on compute restart  https://review.openstack.org/58749816:25
mriedemlyarwood: weren't you just working on fixing something like this? http://logs.openstack.org/50/594050/6/check/nova-next/af897cc/logs/screen-n-cpu.txt.gz?level=TRACE#_Aug_22_13_55_27_69424316:25
mriedemseems this volume detach from live/persistent domain thing needs to be fixed every other week16:25
*** Sundar has joined #openstack-nova16:26
*** sahid has quit IRC16:27
mriedemah yes https://github.com/openstack/nova/commit/636c7461dee4002571da6e99986eb17e9a28b0f4#diff-ec64afccc111bbe81f5c85b27d73b41b16:27
Sundarefried: Please ping me when you have the time16:27
*** moshele has joined #openstack-nova16:28
*** masayukig has quit IRC16:28
Sundarsean-k-mooney: Hope you have seen the updated os-acc spec (#link https://review.openstack.org/#/c/577438/). It should reflect the feedback you gave.16:29
mriedemtssurya needs to re-propose the handling a down cell spec for stein16:31
*** davidsha has quit IRC16:31
openstackgerritMatthew Booth proposed openstack/nova-specs master: Add serial numbers for local disks  https://review.openstack.org/59524716:32
*** jiapei has quit IRC16:35
sean-k-mooneySundar: i have not had time to fully review this sorry. ill try to get back to it by the end of the week16:35
openstackgerritMatt Riedemann proposed openstack/nova stable/queens: Wait for network-vif-plugged before starting live migration  https://review.openstack.org/59173516:37
openstackgerritMatt Riedemann proposed openstack/nova stable/queens: DNM: Debug patch to test live migration waiting  https://review.openstack.org/59177516:37
mriedemdansmith: are you also going to do ^ for pike?16:38
mriedembecause https://review.openstack.org/#/c/591762/16:38
dansmithI had assumed we would yeah16:38
*** macza_ has joined #openstack-nova16:42
openstackgerritDan Smith proposed openstack/nova master: Batch results per cell when doing cross-cell listing  https://review.openstack.org/59269816:43
openstackgerritDan Smith proposed openstack/nova master: List instances from all cells explicitly  https://review.openstack.org/59371716:43
openstackgerritDan Smith proposed openstack/nova master: Make instance_list perform per-cell batching  https://review.openstack.org/59313116:43
openstackgerritDan Smith proposed openstack/nova master: Record cell success/failure/timeout in CrossCellLister  https://review.openstack.org/59426516:43
openstackgerritDan Smith proposed openstack/nova master: Optimize global marker re-lookup in multi_cell_list  https://review.openstack.org/59457716:43
openstackgerritDan Smith proposed openstack/nova master: Clarify which context is used by do_query()  https://review.openstack.org/59525016:43
dansmithmriedem: FYI the last patch removes an extra db hit we do in the listing process which was a fixme from the original work16:45
dansmithprobably small and not super impactful, but..fewer is better16:45
*** gouthamr has joined #openstack-nova16:46
*** gouthamr has left #openstack-nova16:46
*** macza has quit IRC16:46
*** rmart04 has quit IRC17:01
*** gyee has joined #openstack-nova17:03
*** gbarros has joined #openstack-nova17:10
openstackgerritMerged openstack/nova master: libvirt: Always escape IPv6 addresses when used in migration URI  https://review.openstack.org/58954817:16
*** sambetts is now known as sambetts|afk17:23
*** awaugama has quit IRC17:25
*** rnoriega has quit IRC17:25
*** sambetts|afk has quit IRC17:25
*** DinaBelova has quit IRC17:25
*** mmedvede has quit IRC17:25
*** cfriesen has quit IRC17:25
*** cburgess has quit IRC17:25
*** mchlumsky has quit IRC17:25
*** aloga has quit IRC17:25
*** sayalilunkad has quit IRC17:25
*** jpena|off has quit IRC17:25
*** panda|off has quit IRC17:25
*** mtreinish has quit IRC17:25
*** N3l1x has quit IRC17:25
*** dulek has quit IRC17:25
*** cseader has quit IRC17:25
*** ericyoung has quit IRC17:25
*** obre has quit IRC17:25
*** gnuoy has quit IRC17:25
*** jlvillal has quit IRC17:25
*** afazekas_ has quit IRC17:25
*** hemna has quit IRC17:25
*** dims has quit IRC17:25
*** Anticimex has quit IRC17:25
*** corvus has quit IRC17:25
*** Gorian has joined #openstack-nova17:25
*** DinaBelova has joined #openstack-nova17:26
*** jlvillal has joined #openstack-nova17:27
*** holser_ has quit IRC17:30
*** cfriesen has joined #openstack-nova17:31
*** cburgess has joined #openstack-nova17:32
imacdonnCould someone help me understand (or point me to a good description of) the deprecation of nova-consoleauth? From the way it's described, it sounds like you can just not run the service, but when I do that 'nova get-vnc-console ... novnc' gets an "unknown error" (HTTP 504)17:33
*** Guest92900 has joined #openstack-nova17:34
*** dims_ has joined #openstack-nova17:35
*** jpena has joined #openstack-nova17:36
*** markvoelker has quit IRC17:39
melwittimacdonn: sec, looking for docs link17:50
*** mtreinish has joined #openstack-nova17:53
*** Sundar has quit IRC17:54
melwittimacdonn: https://docs.openstack.org/nova/latest/user/cellsv2-layout.html#consoleauth-service-and-console-proxies and the release notes https://docs.openstack.org/releasenotes/nova/rocky.html#relnotes-18-0-0-0b2-stable-rocky-upgrade-notes17:55
imacdonnmelwitt: OK... will review - I just found https://review.openstack.org/#/c/557489/ too17:55
imacdonnSomehow I missed that upgrade release notes.... maybe was looking at the wrong version of release notes .. thans17:56
imacdonnthanks*17:56
*** sean-k-mooney has quit IRC17:57
imacdonnmelwitt: Actually, though, this still seems to suggest that I can "just not run the service" ... and that's not working for me17:58
melwittyeah, sorry. indeed you are supposed to be able to not run the service17:59
*** mmedvede has joined #openstack-nova17:59
melwittimacdonn: do you have a single cell deployment or multiple cells?18:00
imacdonnmelwitt: single cell, not counting cell018:00
*** eharney has quit IRC18:01
melwittdo you have a trace you can pastebin of the nova-api log and nova-novnc18:02
imacdonnmelwitt: I guess I'll enable debug logging and see what I can get ... wanted to make sure I wasn't missing a required config change or something first18:03
melwitthere's examples from the gate of what the configs should look like for the cell and compute host http://logs.openstack.org/58/540258/13/check/tempest-full-py3/f59f34a/controller/logs/etc/nova/nova_cell1_conf.txt.gz http://logs.openstack.org/58/540258/13/check/tempest-full-py3/f59f34a/controller/logs/etc/nova/nova-cpu_conf.txt.gz18:05
*** hemna has joined #openstack-nova18:08
*** mriedem is now known as mriedem_lunch18:14
*** ChanServ has quit IRC18:16
melwittimacdonn: I made a mistake, sorry. you do have to run the consoleauth service in Rocky still. being able to discontinue running it will be in Stein18:19
imacdonnmelwitt: Oooh okay .... so ... uhm ... it's not really deprecated yet, then ....... ?18:19
melwittimacdonn: it's deprecated but not yet removed. in rocky it's doing things side-by-side, then in stein we can remove it18:20
imacdonnmelwitt: where my definition of "deprecated" is something like "you can still do this, but you really shouldn't, and you should do it the new way instead"18:20
melwittyeah, I see what you mean. and the docs are wrong saying you can stop running it in rocky, so I need to fix that18:21
imacdonnmelwitt: yes, that was going to be my next point ;)18:21
*** ChanServ has joined #openstack-nova18:22
*** barjavel.freenode.net sets mode: +o ChanServ18:22
melwittyeah, apologies for that. I'll work on some updates to the docs right now18:22
melwittmriedem_lunch ^ think this will be another thing for rc318:23
imacdonnno problem! Thanks for working through it with me18:23
imacdonnpart of my practice for each new release is to review logs for deprecation warnings, and eliminate as many as I can18:24
melwittthat's a good practice. sorry that doc threw a wrench in it18:25
imacdonnGlad to catch it before the release!18:26
melwittyes, definitely. thank you for that18:26
imacdonnnp18:27
*** dtantsur is now known as dtantsur|afk18:43
*** moshele has quit IRC18:46
*** mriedem_lunch is now known as mriedem18:55
mriedemimacdonn: can you report a bug that the docs are wrong?19:00
imacdonnmriedem: ok19:00
melwittI'm in the middle of writing up a bug19:01
* imacdonn applies brakes19:01
melwittheh19:02
mriedemhttps://www.youtube.com/watch?v=Vvwq1FZ6gxE19:02
imacdonn:)19:03
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Handle binding_failed vif plug errors on compute restart  https://review.openstack.org/59531719:05
melwitthttps://bugs.launchpad.net/nova/+bug/178847019:06
openstackLaunchpad bug 1788470 in OpenStack Compute (nova) "release notes and docs erroneously say that nova-consoleauth doesn't have to run in Rocky " [Medium,New] - Assigned to melanie witt (melwitt)19:06
*** adrianc has quit IRC19:16
*** mriedem has quit IRC19:35
*** mriedem has joined #openstack-nova19:39
*** pcaruana has quit IRC19:47
*** efried_rollin is now known as efried19:47
mriedemso uh, i could use some reviews on this rc3 potential fix https://review.openstack.org/#/c/594508/19:54
mriedem"fix"19:54
*** panda has joined #openstack-nova19:55
melwittI'll review the rc3 things today. it's been a distracting day19:55
mriedemi'll review yours if you review mine19:56
mriedemthe other one, approved yesterday morning, is still humping its way through the gate19:57
melwittok, cool. I saw on the todos etherpad20:01
*** gbarros has quit IRC20:01
*** erlon has quit IRC20:07
*** dpawlik has joined #openstack-nova20:12
*** tssurya has joined #openstack-nova20:20
*** mdrabe has quit IRC20:22
*** tssurya has quit IRC20:24
*** mdrabe has joined #openstack-nova20:24
*** tssurya has joined #openstack-nova20:25
*** tonyb has joined #openstack-nova20:26
mriedemdansmith: i'm slowly climbing multi-cell list batch mountain20:28
mriedemnearly at the summit20:28
mriedemoxygen....depleting...20:28
*** aloga has joined #openstack-nova20:30
*** ericyoung has joined #openstack-nova20:33
*** gbarros has joined #openstack-nova20:33
*** tssurya has quit IRC20:35
*** tssurya has joined #openstack-nova20:35
melwittI found that the console code in compute is storing token auths in both the database and nova-consoleauth for rocky, and I'm struggling to understand why. it was like that before I took on the patch series. I assume it was just so operators could keep using nova-consoleauth as the storage backend for a cycle, if they for some reason wanted to20:41
melwittinitially, I thought maybe it was to support rolling upgrades, but I don't think storing new tokens in nova-consoleauth helps with that20:41
*** harlowja has joined #openstack-nova20:42
*** eandersson has joined #openstack-nova20:45
eanderssonIs compute_driver used by any other service then nova-compute?20:46
eanderssonCan you have nova-compute-ironic on the same box as nova-conductor, api etc?20:46
tssuryamriedem: ack, I'll repropose..20:56
openstackgerritDan Smith proposed openstack/nova master: Make CELL_TIMEOUT a constant  https://review.openstack.org/59457020:57
openstackgerritDan Smith proposed openstack/nova master: Stash the cell uuid on the context when targeting  https://review.openstack.org/59457120:57
openstackgerritDan Smith proposed openstack/nova master: Make RecordWrapper record RequestContext and expose cell_uuid  https://review.openstack.org/59457220:57
openstackgerritDan Smith proposed openstack/nova master: Clarify which context is used by do_query()  https://review.openstack.org/59525020:57
openstackgerritDan Smith proposed openstack/nova master: Batch results per cell when doing cross-cell listing  https://review.openstack.org/59269820:57
openstackgerritDan Smith proposed openstack/nova master: List instances from all cells explicitly  https://review.openstack.org/59371720:57
openstackgerritDan Smith proposed openstack/nova master: Make instance_list perform per-cell batching  https://review.openstack.org/59313120:57
openstackgerritDan Smith proposed openstack/nova master: Record cell success/failure/timeout in CrossCellLister  https://review.openstack.org/59426520:57
openstackgerritDan Smith proposed openstack/nova master: Optimize global marker re-lookup in multi_cell_list  https://review.openstack.org/59457720:57
*** jpena is now known as jpena|off20:57
melwitteandersson: no, compute_driver shouldn't be used for any other service (though I see one check for it in the novnc proxy since the xen driver doesn't support a new enough novnc version, IIRC). and AFAIK, you could run nova-compute-ironic on the same box as nova-conductor, etc, but I'm not sure it's recommended. maybe TheJulia can advise21:00
eanderssonI see - we figured as much, and didn't see any issues21:00
TheJuliabest to keep it to where you run ironic-conductor or ironic-api anyhow21:00
TheJuliaminimize latency between connections and also keep access to logs relatively close if they are needed21:01
mriedemthe api looks at compute_driver in one case for bdm device name21:01
mriedemi think21:01
TheJuliaBut that is just my take for sanity :)21:01
mriedemif you're using xen21:01
melwittok, I didn't see that in my grepping21:02
mriedemeandersson: http://codesearch.openstack.org/?q=is_xenapi&i=nope&files=&repos=21:04
mriedemhttp://git.openstack.org/cgit/openstack/nova/tree/nova/cmd/novncproxy.py#n4321:04
eanderssonThanks!21:10
*** gouthamr has joined #openstack-nova21:11
*** holser_ has joined #openstack-nova21:18
*** tbachman has quit IRC21:28
*** dansmith is now known as htimsnad21:34
*** tssurya has quit IRC21:38
openstackgerritChris Dent proposed openstack/nova master: [placement] Add /reshaper handler for POST  https://review.openstack.org/57692721:41
*** munimeha1 has quit IRC21:41
*** hongbin has joined #openstack-nova21:45
*** hongbin has left #openstack-nova21:45
*** dpawlik has quit IRC21:53
*** mriedem has quit IRC21:55
*** mriedem1 has joined #openstack-nova21:56
*** mriedem1 is now known as mriedem21:59
*** bodgix has quit IRC22:01
*** bodgix has joined #openstack-nova22:06
*** mlavalle has quit IRC22:15
*** holser_ has quit IRC22:26
*** rcernin has joined #openstack-nova22:34
*** holser_ has joined #openstack-nova22:34
*** ChanServ has quit IRC22:49
openstackgerritMerged openstack/nova master: Filter out instances without a host when populating AZ  https://review.openstack.org/59405022:53
openstackgerritMerged openstack/nova master: Remove ChanceScheduler  https://review.openstack.org/57638422:54
*** macza_ has quit IRC22:56
*** ChanServ has joined #openstack-nova23:03
*** barjavel.freenode.net sets mode: +o ChanServ23:03
*** jamesdenton has quit IRC23:09
*** holser_ has quit IRC23:10
*** slagle has joined #openstack-nova23:17
*** jdillaman has quit IRC23:19
*** cdent_ has joined #openstack-nova23:41
*** cdent has quit IRC23:44
*** cdent_ is now known as cdent23:44
*** gbarros has quit IRC23:46
*** gouthamr has quit IRC23:48
*** r-daneel has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!