Thursday, 2020-08-13

*** hongbin has quit IRC00:04
*** hongbin has joined #openstack-nova00:05
*** gyee has quit IRC00:21
*** rambo_li has joined #openstack-nova00:27
*** songwenping_ has joined #openstack-nova00:28
*** mlavalle has quit IRC00:30
*** hamalq has quit IRC00:36
*** rambo_li has quit IRC00:41
*** hongbin has quit IRC00:41
*** spatel has joined #openstack-nova00:56
*** zhanglong has joined #openstack-nova01:01
*** hongbin has joined #openstack-nova01:06
*** rcernin has quit IRC01:11
*** rcernin has joined #openstack-nova01:11
*** zhanglong has quit IRC01:13
*** zhanglong has joined #openstack-nova01:14
*** nweinber has joined #openstack-nova01:15
*** Liang__ has joined #openstack-nova01:23
*** avolkov has quit IRC01:25
*** eandersson has quit IRC01:29
*** eandersson has joined #openstack-nova01:29
*** songwenping__ has joined #openstack-nova01:38
*** nweinber has quit IRC01:39
*** songwenping_ has quit IRC01:41
*** rambo_li has joined #openstack-nova01:50
*** songwenping_ has joined #openstack-nova01:53
*** songwenping__ has quit IRC01:56
*** spatel has quit IRC02:09
*** spatel has joined #openstack-nova02:14
*** spatel has quit IRC02:16
*** openstackgerrit has joined #openstack-nova02:22
openstackgerritrenminmin proposed openstack/nova master: Fix instance booted with snapshot image and bdms  https://review.opendev.org/74582102:22
*** lbragstad has quit IRC02:32
*** songwenping_ has quit IRC02:42
*** songwenping_ has joined #openstack-nova02:43
openstackgerritMerged openstack/nova master: Detach is broken for multi-attached fs-based volumes  https://review.opendev.org/74171202:50
*** Liang__ has quit IRC03:01
*** xinranwang__ has joined #openstack-nova03:02
*** rcernin has quit IRC03:06
*** Liang__ has joined #openstack-nova03:14
*** psachin has joined #openstack-nova03:31
*** ayoung has quit IRC03:48
*** ayoung has joined #openstack-nova03:48
*** rcernin has joined #openstack-nova03:52
*** ayoung has quit IRC03:53
*** ayoung has joined #openstack-nova03:56
*** lseki has quit IRC04:01
*** Liang__ has quit IRC04:02
*** eharney has quit IRC04:05
*** Liang__ has joined #openstack-nova04:05
*** zhanglong has quit IRC04:06
*** mkrai has joined #openstack-nova04:23
*** eharney has joined #openstack-nova04:24
*** CeeMac has quit IRC04:26
*** hongbin has quit IRC04:26
*** vishalmanchanda has joined #openstack-nova04:33
*** evrardjp has joined #openstack-nova04:33
*** Liang__ has quit IRC04:34
*** ratailor has joined #openstack-nova04:34
openstackgerritHarshavardhan Metla proposed openstack/nova master: Raising a failure in case of 403  https://review.opendev.org/73506804:53
*** sridharg has joined #openstack-nova05:10
*** JamesBenson has quit IRC05:25
*** JamesBenson has joined #openstack-nova05:27
*** JamesBenson has quit IRC05:31
*** jsuchome has joined #openstack-nova05:45
*** songwenping__ has joined #openstack-nova06:01
*** zhanglong has joined #openstack-nova06:02
*** CeeMac has joined #openstack-nova06:04
*** songwenping_ has quit IRC06:04
*** brinzhang has quit IRC06:06
*** zhanglong has quit IRC06:11
*** rambo_li has quit IRC06:12
*** zhanglong has joined #openstack-nova06:21
*** songwenping_ has joined #openstack-nova06:28
*** xinranwang__ has quit IRC06:31
*** songwenping__ has quit IRC06:31
*** markvoelker has joined #openstack-nova06:45
*** slaweq has joined #openstack-nova06:46
*** Liang__ has joined #openstack-nova06:46
*** zhanglong has quit IRC06:48
*** markvoelker has quit IRC06:49
*** JamesBenson has joined #openstack-nova06:50
*** zhanglong has joined #openstack-nova06:51
*** JamesBenson has quit IRC06:55
*** maciejjozefczyk has joined #openstack-nova06:57
*** bbowen has quit IRC06:59
*** mvorwerk has joined #openstack-nova07:21
*** mkrai has quit IRC07:21
*** tesseract has joined #openstack-nova07:22
*** Liang__ has quit IRC07:23
*** Liang__ has joined #openstack-nova07:24
*** mkrai has joined #openstack-nova07:26
*** markvoelker has joined #openstack-nova07:35
*** markvoelker has quit IRC07:39
*** tosky has joined #openstack-nova07:42
*** zhanglong has quit IRC07:46
*** markvoelker has joined #openstack-nova07:50
*** markvoelker has quit IRC07:51
*** zhanglong has joined #openstack-nova07:54
*** nightmare_unreal has joined #openstack-nova08:05
openstackgerritAlexandre Arents proposed openstack/nova master: Rebase qcow2 images when unshelving an instance  https://review.opendev.org/69608408:07
*** maciejjozefczyk_ has joined #openstack-nova08:14
*** maciejjozefczyk has quit IRC08:15
*** maciejjozefczyk has joined #openstack-nova08:15
*** mkrai has quit IRC08:17
*** maciejjozefczyk_ has quit IRC08:19
openstackgerritJie Li proposed openstack/nova master: fix revert resize failed  https://review.opendev.org/74602008:27
*** belmoreira has joined #openstack-nova08:30
*** brinzhang has joined #openstack-nova08:43
*** mkrai has joined #openstack-nova08:48
*** JamesBenson has joined #openstack-nova08:51
*** JamesBenson has quit IRC08:56
*** links has joined #openstack-nova09:03
*** rcernin has quit IRC09:05
*** avolkov has joined #openstack-nova09:14
*** Liang__ has quit IRC09:24
*** JamesBenson has joined #openstack-nova09:26
*** JamesBenson has quit IRC09:30
*** jangutter has quit IRC09:47
*** jangutter has joined #openstack-nova09:47
*** rcernin has joined #openstack-nova09:57
*** brinzhang_ has joined #openstack-nova09:58
*** songwenping__ has joined #openstack-nova09:58
*** brinzhang has quit IRC10:01
*** songwenping_ has quit IRC10:02
*** songwenping__ has quit IRC10:02
*** songwenping__ has joined #openstack-nova10:02
*** bbowen has joined #openstack-nova10:07
*** mvorwerk has quit IRC10:17
*** mkrai has quit IRC10:28
*** mkrai has joined #openstack-nova10:31
*** mvorwerk has joined #openstack-nova10:32
*** brinzhang0 has joined #openstack-nova10:33
*** brinzhang_ has quit IRC10:36
*** brinzhang has joined #openstack-nova10:37
*** brinzhang0 has quit IRC10:39
*** nightmare_unreal has quit IRC10:40
*** rcernin has quit IRC10:40
*** rcernin has joined #openstack-nova10:47
*** songwenping_ has joined #openstack-nova10:48
*** songwenping__ has quit IRC10:51
*** rcernin has quit IRC11:00
*** jangutter has quit IRC11:01
*** songwenping_ has quit IRC11:29
*** songwenping_ has joined #openstack-nova11:29
*** brinzhang_ has joined #openstack-nova11:32
*** brinzhang has quit IRC11:36
*** mkrai has quit IRC11:43
*** raildo has joined #openstack-nova11:49
*** mvorwerk has quit IRC11:56
*** songwenping__ has joined #openstack-nova11:58
*** songwenping_ has quit IRC12:01
*** mvorwerk has joined #openstack-nova12:09
*** zhanglong has quit IRC12:10
*** brinzhang0 has joined #openstack-nova12:13
*** brinzhang_ has quit IRC12:16
*** brinzhang0 has quit IRC12:26
*** songwenping_ has joined #openstack-nova12:28
*** mvorwerk has quit IRC12:30
*** songwenping__ has quit IRC12:31
*** ayoung has quit IRC12:33
openstackgerritMerged openstack/nova master: [Trivial] Remove wrong format_message() conversion  https://review.opendev.org/74428012:35
*** songwenping__ has joined #openstack-nova12:43
*** ayoung has joined #openstack-nova12:45
*** nweinber has joined #openstack-nova12:46
*** JamesBenson has joined #openstack-nova12:46
*** songwenping_ has quit IRC12:47
*** mvorwerk has joined #openstack-nova12:47
*** JamesBenson has quit IRC12:51
openstackgerritMark Goddard proposed openstack/nova master: docs: fix aggregate weight multiplier property names  https://review.opendev.org/74612812:53
*** JamesBenson has joined #openstack-nova13:01
*** dklyle has quit IRC13:07
*** ociuhandu has quit IRC13:09
*** mvorwerk has quit IRC13:10
*** lseki has joined #openstack-nova13:12
*** lbragstad has joined #openstack-nova13:13
*** ratailor has quit IRC13:14
*** mkrai has joined #openstack-nova13:15
*** songwenping_ has joined #openstack-nova13:23
*** ociuhandu has joined #openstack-nova13:24
*** songwenping__ has quit IRC13:26
*** mvorwerk has joined #openstack-nova13:27
*** ociuhandu has quit IRC13:29
*** tkajinam has quit IRC13:32
*** mvorwerk has quit IRC13:42
*** dave-mccowan has quit IRC13:59
*** dave-mccowan has joined #openstack-nova14:00
*** ociuhandu has joined #openstack-nova14:02
*** ociuhandu_ has joined #openstack-nova14:19
*** dave-mccowan has quit IRC14:21
*** ociuhandu has quit IRC14:22
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in baremetal nodes policies  https://review.opendev.org/74171614:28
openstackgerritGhanshyam Mann proposed openstack/nova master: Pass the actual target in baremetal nodes policy  https://review.opendev.org/74171714:28
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in networks policies  https://review.opendev.org/74256614:31
openstackgerritGhanshyam Mann proposed openstack/nova master: Pass the actual target in networks policy  https://review.opendev.org/74256814:31
*** dklyle has joined #openstack-nova14:33
openstackgerritGhanshyam Mann proposed openstack/nova master: Add scope and new default roles in extensions policies  https://review.opendev.org/74304614:34
artomIs logstash... working?14:36
artomI'm trying to understand if "Multiple possible networks found, use a Network ID to be more specific" in the nova-next job is a recurring thing14:36
*** songwenping__ has joined #openstack-nova14:43
*** songwenping_ has quit IRC14:46
*** mkrai has quit IRC14:52
*** mkrai_ has joined #openstack-nova14:52
*** sridharg has quit IRC14:52
*** k_mouza has joined #openstack-nova14:54
sean-k-mooneyartom: its a few days delayed14:55
sean-k-mooneyi think 3-5 days14:56
*** ayoung has quit IRC14:56
sean-k-mooneyartom: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Multiple%20possible%20networks%20found,%20use%20a%20Network%5C%2214:57
sean-k-mooneyset it to 30days and you get hits14:57
artomAh yes, indeed. I feel like we've hit this before, for a different job14:58
artomgmann ^^ sound familiar?14:58
sean-k-mooneywe have hit this many times14:58
sean-k-mooneyits a tempest bug14:58
sean-k-mooneythe tests are not wrtten correctly14:58
artomI kinda figured that already :P14:59
artomI was looking for a previous fix that I could plagiarize to avoid having to think about this ;)14:59
artomOr to straight up "delegate" to someone else :P14:59
sean-k-mooneythe first failure was in this requiremnt update to neutron libs https://review.opendev.org/#/c/74523715:01
sean-k-mooneythat may or may not be related to the cause15:02
*** mlavalle has joined #openstack-nova15:10
gmannartom: sean-k-mooney yeah, we fixed this issue while we see error.15:12
artomgmann, do you remember what the fix was? Do we need to redo it somewhere else?15:15
*** JamesBen_ has joined #openstack-nova15:16
gmannby default, tempest tests does not pass the dedicated network while creating server so we go test by test and request for unique network to be created for test15:16
gmannartom: yeah15:16
*** JamesBenson has quit IRC15:17
gmannartom: https://review.opendev.org/#/c/721767/15:17
*** songwenping_ has joined #openstack-nova15:17
gmannwhich test failing?15:17
artomgmann, looks like we're hitting it in tempest.scenario.test_server_advanced_ops.TestServerAdvancedOps.test_server_sequence_suspend_resume15:18
artomAnd something else, but I can't figure out the test from the kibana info15:18
gmannartom: ah that is scenario test which always has the unique network, let me confirm15:19
sean-k-mooneythere are a number of test failing15:20
*** songwenping__ has quit IRC15:20
sean-k-mooneytempest-AttachInterfacesTestJSON tempest-test_creds-167978404015:22
gmannfor API tests, root cause is same and we can fix it in Tempest side15:22
sean-k-mooneyactully i need to filter out passing jobs15:23
sean-k-mooneyapparently we have some tests that try to create that error15:23
artomsean-k-mooney, ah, it would explain why https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_1a8/744280/6/check/nova-next/1a8a26e/controller/logs/screen-n-api.txt is from a passing job15:24
artomI guess start by fixing test_server_sequence_suspend_resume then?15:24
sean-k-mooneyoh so 212 hits instead of ~50015:25
sean-k-mooneyand some of those have failure that are not related to this15:26
sean-k-mooneythis will be annoying to fine a query for15:26
gmanntest_server_sequence_suspend_resume  does not explicit create the network and test try to get one from neutron - https://github.com/openstack/tempest/blob/master/tempest/scenario/manager.py#L25715:26
gmannartom: the fix i mentioned will not help for test_server_sequence_suspend_resume , we need to do either create the network explicitly or add some common logic in scenario manager also like we do in API test15:27
lyarwoodI'm supposed to be running the meeting at the top of the hour but I've ended up home alone with my 10 week old who is wide awake and causing chaos, would anyone mind stepping in and running it this week?15:28
gmannthis query -http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22HTTP%20exception%20thrown:%20Multiple%20possible%20networks%20found,%20use%20a%20Network%20ID%20to%20be%20more%20specific.%5C%22%20AND%20NOT%20message:%5C%22AttachInterfacesTestJSON%5C%22%20AND%20tags:%5C%22screen-n-api.txt%5C%22&from=7d15:29
*** k_mouza has quit IRC15:30
*** vishalmanchanda has quit IRC15:32
*** admin0 has joined #openstack-nova15:32
admin0when i run nova-manage --debug db sync  .. it says ERROR: Could not access cell0. .. i check the username and password and the user (nova_api) can acess nova_cell0 database .. what could be wrong ?15:32
admin0or does nova_api need access to nova database also ?15:34
sean-k-mooneythis is the query i came up with http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Multiple%20possible%20networks%20found,%20use%20a%20Network%5C%22%20AND%20NOT%20message:%5C%22AttachInterfacesTestJSON%5C%22%20AND%20NOT%20message:%5C%22tempest-test_creds%5C%22%20%20AND%20NOT%20build_status:%5C%22SUCCESS%5C%22&from=30d15:34
*** swp20 has joined #openstack-nova15:35
*** songwenping_ has quit IRC15:36
sean-k-mooneyadmin0: nova manage gets the db creds from the nova.conf15:36
admin0i have validated it and it is correct15:36
admin0is there a way to debug what actually it is using15:37
gmannyeah, AttachInterfacesTestJSON is most in failing15:37
admin0--debug does not seem to produce that much of a log15:37
sean-k-mooneygmann: right but none of those builds failed15:37
lyarwoodAttributeError: module 'libvirt' has no attribute 'VIR_ERR_DEVICE_MISSING' - whops, my bad.15:38
sean-k-mooneywell wehn the failed that was nto the issue15:38
gmannyeah15:38
admin0sean-k-mooney,  i did a grep mysql /etc/nova.conf .. then installed mysql-client .. and then when i do mysql -h (hostname as in the conf) -u username -p ( copy paste of the password) .. it works just fine i can login and select the database15:39
gmannartom: sean-k-mooney do you have  link where test_server_sequence_suspend_resume   failing ?15:39
admin0i did a create table and drop table ( the same test table) to validate that the login is rw15:40
sean-k-mooneyadmin0: odd im not certin what the issue is off the top of my head15:41
admin0is there a way to get more verbose/debug steps in nova-manage db sync ?15:41
*** belmoreira has quit IRC15:42
*** sangeet has joined #openstack-nova15:42
admin0nova-manage --debug  api_db sync and nova-manage --debug  cell_v2 map_cell0  worked fine .. only in db sync its giving issues15:44
*** priteau has joined #openstack-nova15:47
artomgmann, https://zuul.opendev.org/t/openstack/build/0c87381c639e4d629fa2bd48ea2da4f215:48
gmannartom: thanks, i can try to build logic of creating unique network in scenario test too but may be during weekend or tomorrow.15:49
gmannfailing scenario tests on this should be less-frequent than API tests or rare15:50
*** mgoddard has quit IRC15:54
lyarwoodI'm supposed to be running the meeting at the top of the hour but I've ended up home alone with my 10 week old who is wide awake and causing chaos, would anyone mind stepping in and running it this week?15:55
lyarwood^ can anyone take this?15:55
lyarwoodor we skip this week15:56
gmannlyarwood: sorry, i will be in internal meeting at the same time, even would not be able to join too15:58
lyarwoodor mum is home, I can run through the agenda quickly15:59
lyarwood#openstack-meeting-3 for a very quick meeting if people have anything16:00
*** mgoddard has joined #openstack-nova16:01
*** jsuchome has quit IRC16:10
sean-k-mooneyvery efficent of you16:10
sean-k-mooneylyarwood:  ^16:11
sean-k-mooneyyou should run all meetings :)16:11
lyarwoodhaha I didn't prep and just rushed through everything, 10/10.16:11
lyarwoodI'll sort the agenda out ahead of time next week while gibi_pto_24th is still out16:11
lyarwoodapologies for the mess today16:12
toskyI just wanted thanks for the Zuul v3 effort and please keep going but you were faster :'(16:14
*** mriedem has joined #openstack-nova16:14
*** songwenping_ has joined #openstack-nova16:18
lyarwoodtosky: hehe sorry and thanks, will keep pushing until M3, have the evacuate stuff worked out locally, just need to test and push.16:21
*** swp20 has quit IRC16:21
*** mkrai_ has quit IRC16:22
*** psachin has quit IRC16:25
*** tesseract has quit IRC16:30
*** songwenping_ has quit IRC16:31
*** songwenping_ has joined #openstack-nova16:31
*** gyee has joined #openstack-nova16:40
*** ociuhandu_ has quit IRC16:43
*** admin0 has left #openstack-nova16:43
*** tosky has quit IRC16:43
*** ociuhandu has joined #openstack-nova16:44
*** songwenping__ has joined #openstack-nova16:48
*** ociuhandu has quit IRC16:50
*** songwenping_ has quit IRC16:51
*** jangutter has joined #openstack-nova16:54
*** ociuhandu has joined #openstack-nova16:57
*** ociuhandu has quit IRC17:04
sangeetI need help. I am doing "nova-manege db sync" and it faile with error "ERROR: Could not access cell0.". "nova-manage cell_v2 map_cell0" "nova-manage api_db sync" were run successfully before. I have ssl enabled in my deployment. The issue seems that _url_cfg.connection in _TransactionFactory object is somehow not corect for nova_cell0. Hence the DB is rejection the connection. Please see http://paste.openstack.org/show/796820/.17:17
sangeetBut connection in [cell0_database] in nova.conf is set correctly. Where is _TransactionFactory object reading the connection value form?17:17
sean-k-mooneysangeet: your the second person to ask abou this in 2 hours :)17:19
sangeetInteresting17:19
sangeetsean-k-mooney was it answered? Sorry I can not scroll up for previous chats.17:20
sean-k-mooneyam no17:20
sean-k-mooneysame bhavior "nova-manage --debug  api_db sync and nova-manage --debug  cell_v2 map_cell0" bot worked by sync failed17:20
sangeet:-(17:21
sean-k-mooneyi think if you want to run sync on cell017:21
sean-k-mooneyyou need to create a second config adn set teh database connection to point to cell017:22
sean-k-mooneyat least i think you had to do that in the past e.g. nova-manage did not read cell0_database17:22
sean-k-mooneybut i could be miss remembering17:22
sangeetThat is waht I have set .. please look at http://paste.openstack.org/show/796820/.17:23
sean-k-mooneylet me compare to my devstack17:23
sean-k-mooneyso have17:24
sean-k-mooney[database]17:24
sean-k-mooneyconnection = mysql+pymysql://root:password@127.0.0.1/nova_cell0?charset=utf817:24
sean-k-mooney[api_database]17:24
sean-k-mooneyconnection = mysql+pymysql://root:password@127.0.0.1/nova_api?charset=utf817:24
sean-k-mooneyso my db is point to cell0 in the conotler config at least17:25
sean-k-mooneymy cell1 contoller then point to cell117:26
sean-k-mooney[database]17:26
sean-k-mooneyconnection = mysql+pymysql://root:password@127.0.0.1/nova_cell1?charset=utf817:26
sangeetsean-k-mooney - Please not .. if I do a new openstack deployment with ssl it is working fine. Its only when I am doing an update from no ssl to ssl, I see the issue. Somehow url_cfg.connection in _TransactionFactory object  is taking old connection17:26
sangeetfor nova_cell0 only17:27
sean-k-mooneynova_cell0  is special17:27
sean-k-mooneyits not a real cell17:27
sean-k-mooneyit has a special meanin in the code17:27
sean-k-mooneyi dont know what [cell0_database] is17:28
sangeetnova.conf has correct values as well ... so just can't figure out how the connection is still old link17:28
sean-k-mooneyi have never seen the "[cell0_database]" config section before17:29
sean-k-mooneyand its not in our config docs17:29
*** links has quit IRC17:30
sean-k-mooneysangeet: did you deploy with openstack helm?17:33
sangeetyes17:33
sean-k-mooneythen its a helm bug i think17:33
sean-k-mooneyhttps://opendev.org/openstack/openstack-helm/src/branch/master/nova/values.yaml#L172417:34
sean-k-mooneyit is the only thing that creats that config section17:34
sean-k-mooneyi cant see anything in any other tool that does and i dont see any code that uses it in nova17:34
sean-k-mooneythere are also not docs related to it17:34
sean-k-mooneybased on http://codesearch.openstack.org/?q=cell0_database&i=nope&files=&repos=17:34
sangeetIts ok ... we can ignore [cell0_database]. Even [database] has correct value of connection.17:36
*** priteau has quit IRC17:36
sean-k-mooneyit does but cell0_database might be breaking nova manage somehow17:37
*** priteau has joined #openstack-nova17:45
sean-k-mooneysangeet: can you try adding --local_cell17:45
sean-k-mooneyi think i know why its failing17:47
sean-k-mooneyas i said that config option is not valid. no code in nova exits to use it17:48
sean-k-mooneywehn you dont pass --loca_cell we lookup the cell0 from the db17:48
sean-k-mooneyhttps://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L188-L18917:48
sean-k-mooneyso unless you have updated the cell0 database connection string in the cell maping table it will use the old value17:49
sean-k-mooneysangeet: if you pass --local_cell it will skip that lookup although it wont update the schem of cell017:50
sean-k-mooneyyou will have to do that manually17:50
sangeetIt is automated but let me try manually17:50
sean-k-mooneybut ya in anycae openstack helm has a bug17:50
sangeetyou are saying run nova-manabe db sync --local_cell?17:50
sean-k-mooneyyes17:51
sangeetLet me try that real quick17:51
sean-k-mooneyopenstack helm is not generting correct local.confs and as a result the automated db sync will fail if you are going form non ssl to ssl17:52
sean-k-mooneysince it will use the non ssl connection string from the db17:52
sangeetawesome ... that worked. Can you please explain what --local_cell opetion does17:52
*** priteau has quit IRC17:53
sean-k-mooneyit tells nova manage not to lookup the db connection string form nova_api.cell_mappings db table17:53
sangeetInterestinfg17:53
sean-k-mooneyyou need to run nova-manage db sync on one contoler on each cell wehn you use --local-cell17:54
sean-k-mooneysangeet: alternitvily you can just update teh connection string in the cell mappign table in the nova_api db17:54
sean-k-mooneyin my devstack deployment its just mysql+pymysql://root:password@127.0.0.1/nova_cell0?charset=utf817:54
sean-k-mooneybut you would need to add the ssl parmater to your version17:54
sangeetLet me see what I have in the my database17:55
sean-k-mooneymysql -e "select database_connection from nova_api.cell_mappings where name='cell0';"17:56
sean-k-mooneyby the way you should not really paste the result publicy17:56
sean-k-mooneysince it has the password in it...17:56
sean-k-mooneyanyway it does not have the ssl cert info right17:57
sangeetYou are correct .. it is without ssl17:57
*** songwenping_ has joined #openstack-nova17:57
sean-k-mooneyyep so you could just update it and then it would work17:57
sangeetgoing back to useing --local-cell, do you see any issue with it? Also when you say "you need to run nova-manage db sync on one contoler on each cell wehn you use --local-cell"17:59
sean-k-mooneyby should work i mean nova manage shoudl work without --local-cell and as a result the automated update should work too17:59
sangeetdoes it mean I have to run on each node17:59
sean-k-mooneyno so each cell has its own db right17:59
sangeetyes18:00
sean-k-mooneyso each cell db needs to be updated18:00
sean-k-mooneywehn you use --local-cell it only update well the locall cell db18:00
sean-k-mooneynot all deployment have db access between cells18:00
sangeetwill "nova-manage db sync  --local-cell" not update all cells?18:00
*** songwenping__ has quit IRC18:01
sean-k-mooneycorrect it only updates the cell pointed to in the database section18:01
sangeetbut "nova-manage db sync " does all?18:01
sean-k-mooneyactully no18:01
sean-k-mooneyit does the local cell and cell018:01
sean-k-mooneyyou need to run nova-manage in each cell anyway18:02
sean-k-mooneyhttps://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L185-L18618:02
sangeetSo it mean I run the command with our without   --local-cell, it will update same cells?18:03
sean-k-mooneyno the default behavor is to update the cell in [database]/connection and cell018:04
sean-k-mooneyso if you run the command on the host with the conducto for cell1 it will update cell1 and cell018:04
sean-k-mooneyran on the host with the conductor for cell2 it will update cell2 and cell018:05
sean-k-mooneyif you add --local-cell it will skip updating cell018:05
sean-k-mooneyunless [database]/connection point to cell018:05
sean-k-mooneybasically the nova.conf used by the nova api should have [database]/connection pointing at cell0, each conductors nova.conf should have [database]/connection pointing at the cell db18:06
sean-k-mooneyand the compute services should not have the database details defiend at all18:07
sean-k-mooneyopenstack helm shoudl then be automatinn runing the db sync once for each cell db using the correct cofigs18:08
sean-k-mooneyand the simplet way to do that is to delegate runing nova-magange db sync to the first conductor host in each cell18:08
sean-k-mooneyyou can safly run it on each conductor host18:09
sean-k-mooneyas it is not destructive its just wasteful to do it18:09
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Do not reference VIR_ERR_DEVICE_MISSING when libvirt is < v4.1.0  https://review.opendev.org/74621018:09
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Do not reference VIR_ERR_DEVICE_MISSING when libvirt is < v4.1.0  https://review.opendev.org/74621018:12
*** songwenping__ has joined #openstack-nova18:13
*** songwenping_ has quit IRC18:16
*** songwenping_ has joined #openstack-nova18:28
*** songwenping__ has quit IRC18:32
*** songwenping__ has joined #openstack-nova18:33
*** songwenping_ has quit IRC18:36
*** songwenping_ has joined #openstack-nova18:42
*** songwenping_ has quit IRC18:43
*** songwenping_ has joined #openstack-nova18:43
*** songwenping__ has quit IRC18:45
*** songwenping_ has quit IRC18:47
*** maciejjozefczyk has quit IRC18:47
*** songwenping_ has joined #openstack-nova18:48
*** openstackgerrit has quit IRC19:02
sangeetsean-k-mooney .. thanks a lot for your help19:21
sean-k-mooneysangeet: no worries hopefully if admin0 comes back and sees this it might help them too19:39
*** nweinber has quit IRC20:09
*** tosky has joined #openstack-nova20:10
*** dave-mccowan has joined #openstack-nova20:23
*** suryasingh has quit IRC20:24
*** slaweq has quit IRC20:37
*** slaweq has joined #openstack-nova20:43
*** slaweq has quit IRC20:48
mnaserdoes nova run ceph jobs on every commit?20:56
*** raildo has quit IRC20:59
dansmithyes21:03
eanderssonbtw I have a PR open for cloud-init for the OpenStack Datasource to increase the retry limit when identifying the metadata service. The current defaults only allows a single failure before giving up. https://github.com/canonical/cloud-init/pull/50121:29
eanderssonIf anyone has any thoughts feel free to drop a comment.21:30
*** songwenping__ has joined #openstack-nova21:33
*** songwenping_ has quit IRC21:37
*** jmlowe has quit IRC21:42
*** jmlowe has joined #openstack-nova21:43
*** openstackgerrit has joined #openstack-nova21:45
openstackgerritMerged openstack/nova master: Fix FIP policy for admin_or_owner  https://review.opendev.org/74181121:45
*** prometheanfire has joined #openstack-nova21:47
prometheanfirecan we get more cores on https://review.opendev.org/744992 (oneliner, with comment)21:47
melwittprometheanfire: done21:58
*** mgoddard has quit IRC22:00
*** rcernin has joined #openstack-nova22:00
prometheanfirethanks22:01
*** songwenping_ has joined #openstack-nova22:03
*** swp20 has joined #openstack-nova22:05
*** mgoddard has joined #openstack-nova22:05
*** songwenping__ has quit IRC22:06
*** songwenping_ has quit IRC22:07
*** mriedem has left #openstack-nova22:16
openstackgerritMerged openstack/nova master: Add new default roles in multinic policies  https://review.opendev.org/74233022:21
openstackgerritMerged openstack/nova master: Correct the check_str and pass actual target in FIP pools policy  https://review.opendev.org/74179722:21
openstackgerritMerged openstack/nova master: Handle Neutron errors in _post_live_migration()  https://review.opendev.org/72976322:22
*** prometheanfire has left #openstack-nova22:24
*** songwenping_ has joined #openstack-nova22:33
*** songwenping__ has joined #openstack-nova22:36
*** swp20 has quit IRC22:36
*** songwenping_ has quit IRC22:40
*** tkajinam has joined #openstack-nova22:58
*** ociuhandu has joined #openstack-nova23:00
*** ociuhandu has quit IRC23:05
*** mlavalle has quit IRC23:08
*** tosky has quit IRC23:09
*** ircuser-1 has quit IRC23:29

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!