Tuesday, 2017-08-22

*** thorst has quit IRC00:02
*** Apoorva_ has joined #openstack-nova00:04
*** crushil has joined #openstack-nova00:04
*** iceyao has joined #openstack-nova00:05
*** Apoorva has quit IRC00:06
*** dtp has quit IRC00:08
*** iceyao has quit IRC00:09
*** yangyapeng has joined #openstack-nova00:11
*** yangyapeng has quit IRC00:11
*** rajathagasthya has quit IRC00:16
*** Swami has quit IRC00:17
*** yamamoto_ has joined #openstack-nova00:18
*** felipemonteiro has quit IRC00:18
*** tetsuro has joined #openstack-nova00:21
*** yamamoto_ has quit IRC00:24
*** catintheroof has quit IRC00:25
*** thorst has joined #openstack-nova00:25
*** thorst has quit IRC00:26
*** slaweq has joined #openstack-nova00:28
*** felipemonteiro has joined #openstack-nova00:29
*** kdaigo has joined #openstack-nova00:30
*** esberglu has quit IRC00:33
*** slaweq has quit IRC00:33
*** sterdnotshaken has quit IRC00:33
*** kdaigo has quit IRC00:35
*** Shunli has joined #openstack-nova00:36
*** kiennt has joined #openstack-nova00:36
*** zhurong has joined #openstack-nova00:45
*** litao__ has joined #openstack-nova00:52
*** gmann has joined #openstack-nova01:01
*** mtanino has quit IRC01:03
*** sbezverk has joined #openstack-nova01:07
*** _pewp_ has quit IRC01:13
*** yangyapeng has joined #openstack-nova01:15
*** _pewp_ has joined #openstack-nova01:16
*** yangyape_ has joined #openstack-nova01:20
*** yangyapeng has quit IRC01:20
*** yamamoto_ has joined #openstack-nova01:21
*** yamamoto_ has quit IRC01:26
*** tbachman has joined #openstack-nova01:26
*** thorst has joined #openstack-nova01:26
*** thorst has quit IRC01:31
*** hongbin has joined #openstack-nova01:34
*** gcb has joined #openstack-nova01:36
openstackgerritMichael Still proposed openstack/nova master: Move lvm handling to privsep.  https://review.openstack.org/49551601:46
openstackgerritMichael Still proposed openstack/nova master: Move xend existence probes to privsep.  https://review.openstack.org/49553801:46
openstackgerritMichael Still proposed openstack/nova master: Move shred to privsep.  https://review.openstack.org/49553701:46
openstackgerritMichael Still proposed openstack/nova master: Cleanup mount / umount and associated rmdir calls  https://review.openstack.org/49442301:46
openstackgerritMichael Still proposed openstack/nova master: WIP / Aspirational: we don't need rootwrap any more.  https://review.openstack.org/49554201:46
openstackgerritMichael Still proposed openstack/nova master: Move loopback setup and removal to privsep.  https://review.openstack.org/49566401:46
openstackgerritMichael Still proposed openstack/nova master: Move libvirt usages of chown to privsep.  https://review.openstack.org/47197201:46
openstackgerritMichael Still proposed openstack/nova master: Don't shell out to mkdir, use ensure_tree()  https://review.openstack.org/49232601:46
openstackgerritMichael Still proposed openstack/nova master: Move the idmapshift binary into privsep.  https://review.openstack.org/49554101:46
openstackgerritMichael Still proposed openstack/nova master: Move ploop commands to privsep.  https://review.openstack.org/49232501:46
openstackgerritMichael Still proposed openstack/nova master: Read from console ptys using privsep.  https://review.openstack.org/48948601:46
mikal(And then git review crashed)01:47
*** thorst has joined #openstack-nova01:51
*** thorst has quit IRC01:51
*** tbachman has quit IRC02:05
*** yamahata has quit IRC02:10
*** gcb has quit IRC02:12
*** bkopilov has quit IRC02:13
*** gcb has joined #openstack-nova02:15
*** guimaluf has quit IRC02:21
*** guimaluf has joined #openstack-nova02:21
*** yamamoto_ has joined #openstack-nova02:22
*** mvk_ has quit IRC02:25
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi: cached images should be cleaned up by time  https://review.openstack.org/46595402:27
*** yamamoto_ has quit IRC02:28
*** catintheroof has joined #openstack-nova02:30
openstackgerritLingyong Xu proposed openstack/os-vif master: Using assertIsNone() instead of assertEqual(None)  https://review.openstack.org/49606602:31
*** mvk_ has joined #openstack-nova02:36
*** Apoorva_ has quit IRC02:38
*** Apoorva has joined #openstack-nova02:38
*** Apoorva has quit IRC02:42
*** hongbin has quit IRC02:48
*** afantijiangxl has joined #openstack-nova02:50
*** thorst has joined #openstack-nova02:52
*** hongbin has joined #openstack-nova02:54
*** afantijiangxl is now known as afanti02:56
*** yamamoto has joined #openstack-nova02:56
*** nicolasbock has quit IRC02:57
*** thorst has quit IRC02:57
*** catintheroof has quit IRC02:57
*** yamamoto has quit IRC03:02
*** itlinux has joined #openstack-nova03:05
*** xinliang has quit IRC03:07
*** gbarros has joined #openstack-nova03:14
*** iceyao has joined #openstack-nova03:15
*** gbarros has quit IRC03:18
*** _pewp_ has quit IRC03:19
*** itlinux has quit IRC03:21
*** _pewp_ has joined #openstack-nova03:23
*** artom has quit IRC03:24
*** sree has joined #openstack-nova03:26
*** sree has quit IRC03:31
*** bkopilov has joined #openstack-nova03:31
*** itlinux has joined #openstack-nova03:35
*** itlinux has quit IRC03:36
*** dave-mccowan has quit IRC03:40
*** baoli has joined #openstack-nova03:40
*** udesale has joined #openstack-nova03:42
*** baoli has quit IRC03:47
*** links has joined #openstack-nova03:51
*** baoli has joined #openstack-nova03:53
*** thorst has joined #openstack-nova03:53
*** hongbin has quit IRC03:56
*** baoli has quit IRC03:58
*** hongbin has joined #openstack-nova03:58
*** thorst has quit IRC03:59
*** shan has joined #openstack-nova03:59
*** baoli has joined #openstack-nova03:59
*** diga has joined #openstack-nova04:01
*** yamamoto has joined #openstack-nova04:03
*** baoli has quit IRC04:04
*** hongbin has quit IRC04:04
*** baoli has joined #openstack-nova04:05
*** yamamoto has quit IRC04:09
*** baoli has quit IRC04:09
*** baoli has joined #openstack-nova04:11
*** baoli has quit IRC04:15
*** itlinux has joined #openstack-nova04:16
*** itlinux has quit IRC04:16
*** esberglu has joined #openstack-nova04:21
*** sree has joined #openstack-nova04:22
*** moshele has joined #openstack-nova04:29
*** esberglu has quit IRC04:31
*** moshele has quit IRC04:37
*** sree has quit IRC04:47
*** sree has joined #openstack-nova04:48
*** moshele has joined #openstack-nova04:48
*** itlinux has joined #openstack-nova04:49
*** trinaths has joined #openstack-nova04:51
*** lajoskatona has joined #openstack-nova04:54
*** thorst has joined #openstack-nova04:54
*** markvoelker has quit IRC04:54
*** thorst has quit IRC04:58
*** baoli has joined #openstack-nova05:00
*** masber has quit IRC05:02
*** baoli has quit IRC05:04
*** baoli has joined #openstack-nova05:04
*** yamamoto has joined #openstack-nova05:05
*** yamamoto has quit IRC05:10
*** itlinux has quit IRC05:17
*** gcb has quit IRC05:21
*** gcb has joined #openstack-nova05:23
*** psachin has joined #openstack-nova05:24
*** claudiub has joined #openstack-nova05:27
*** mkrcmari__ has joined #openstack-nova05:28
*** links has quit IRC05:30
*** mvk_ has quit IRC05:31
*** links has joined #openstack-nova05:33
*** sree has quit IRC05:34
*** hoonetorg has quit IRC05:34
*** sree has joined #openstack-nova05:34
*** lpetrut has joined #openstack-nova05:36
*** baoli has quit IRC05:37
*** sree has quit IRC05:39
*** edmondsw has joined #openstack-nova05:42
openstackgerritBéla Vancsics proposed openstack/nova master: Transform instance.resize.error notifications  https://review.openstack.org/41788205:43
*** vvargaszte has joined #openstack-nova05:43
*** ratailor has joined #openstack-nova05:44
*** edmondsw has quit IRC05:47
*** yangyape_ has quit IRC05:48
*** yangyapeng has joined #openstack-nova05:49
*** hoonetorg has joined #openstack-nova05:49
*** mdnadeem has joined #openstack-nova05:50
*** diga has quit IRC05:54
*** chyka has joined #openstack-nova05:54
*** masber has joined #openstack-nova05:55
*** thorst has joined #openstack-nova05:55
openstackgerritjichenjc proposed openstack/nova master: Do not attempt volume swap when guest is stopped/suspended  https://review.openstack.org/38979805:56
*** kiennt has quit IRC05:58
*** chyka has quit IRC05:59
*** thorst has quit IRC05:59
*** slaweq has joined #openstack-nova06:04
*** yamamoto has joined #openstack-nova06:06
*** kiennt has joined #openstack-nova06:09
*** yamamoto has quit IRC06:12
*** Oku_OS-away is now known as Oku_OS06:13
*** sridharg has joined #openstack-nova06:14
*** hoonetorg has quit IRC06:14
*** lpetrut has quit IRC06:14
openstackgerritBéla Vancsics proposed openstack/nova master: Transform keypair.delete notification  https://review.openstack.org/46394606:16
*** lpetrut has joined #openstack-nova06:18
*** hoonetorg has joined #openstack-nova06:21
*** dixiaoli has joined #openstack-nova06:21
*** kiennt has quit IRC06:22
*** lpetrut has quit IRC06:29
*** yamahata has joined #openstack-nova06:32
*** iceyao has quit IRC06:32
*** iceyao has joined #openstack-nova06:33
*** iceyao has quit IRC06:34
openstackgerritjichenjc proposed openstack/nova master: WIP: fix race condition  https://review.openstack.org/49445806:35
*** armax has quit IRC06:39
*** rcernin has joined #openstack-nova06:45
*** pcaruana has joined #openstack-nova06:45
*** slaweq_ has joined #openstack-nova06:46
*** slaweq_ has quit IRC06:50
openstackgerritjichenjc proposed openstack/nova master: Move common definition into common layer  https://review.openstack.org/48949106:51
openstackgerritjichenjc proposed openstack/nova master: WIP:check query param for service's index function  https://review.openstack.org/48949206:51
*** Atom1234 has joined #openstack-nova06:52
*** jistr is now known as jistr|trng06:53
*** jpena|off is now known as jpena06:54
*** markvoelker has joined #openstack-nova06:55
*** thorst has joined #openstack-nova06:56
*** ircuser-1 has joined #openstack-nova06:58
*** kiennt has joined #openstack-nova06:59
*** thorst has quit IRC07:00
*** vvargaszte has quit IRC07:01
*** vvargaszte has joined #openstack-nova07:03
*** sahid has joined #openstack-nova07:06
*** tesseract has joined #openstack-nova07:20
*** vvargaszte has quit IRC07:28
*** belmoreira has joined #openstack-nova07:29
*** markvoelker has quit IRC07:29
*** edmondsw has joined #openstack-nova07:30
*** yamahata has quit IRC07:31
*** psachin has quit IRC07:34
*** edmondsw has quit IRC07:35
-openstackstatus- NOTICE: Gerrit is going to be restarted due to slow performance07:36
-openstackstatus- NOTICE: Gerrit has been restarted successfully07:41
*** chyka has joined #openstack-nova07:44
*** priteau has joined #openstack-nova07:47
*** chyka has quit IRC07:48
openstackgerritMerged openstack/nova master: Reset client session when placement endpoint not found  https://review.openstack.org/49353607:51
openstackgerritDamon Li proposed openstack/nova master: Fix bug on vmware driver attach volume failed  https://review.openstack.org/49614007:53
*** dikonoor has joined #openstack-nova07:55
*** thorst has joined #openstack-nova07:57
*** jangutter has joined #openstack-nova08:00
openstackgerritMerged openstack/nova master: trivial: Remove dead function, variable  https://review.openstack.org/49151208:00
*** thorst has quit IRC08:01
*** alexchadin has joined #openstack-nova08:09
*** jogo has quit IRC08:09
*** derekh has joined #openstack-nova08:13
jaosoriorAnybody here acquainted with vnc? I'm trying to configure TLS between libvirt and nova-novnc, and I keep getting: Unsupported security types: 1908:14
*** jogo has joined #openstack-nova08:19
*** jogo has quit IRC08:19
*** jogo has joined #openstack-nova08:19
*** markvoelker has joined #openstack-nova08:26
*** lpetrut has joined #openstack-nova08:28
*** shan has quit IRC08:29
*** zhouyaguo has quit IRC08:29
*** shan has joined #openstack-nova08:29
stephenfinjaosorior: I was pretty sure TLC wasn't supported yet?08:30
* stephenfin goes to find spec to implement it08:31
*** zhouyaguo has joined #openstack-nova08:31
*** zhouyaguo has quit IRC08:31
*** zhouyaguo has joined #openstack-nova08:31
stephenfinjaosorior: Aye, not implemented yet https://specs.openstack.org/openstack/nova-specs/specs/ocata/approved/websocket-proxy-to-host-security.html08:31
jaosoriorstephenfin: oh, alright08:32
jaosoriorthanks :)08:32
stephenfinjaosorior: Anytime :)08:33
jaosoriorstephenfin: so, the only option is to use something else than no-vnc that supports VenCrypt, right?08:33
stephenfinjaosorior: tbh, I'm not sure. You'll have to ask someone more knowledgeable than me08:34
stephenfincan't hurt to try, though? :)08:34
*** yamamoto has joined #openstack-nova08:35
*** dtantsur|afk is now known as dtantsur08:36
*** cdent has joined #openstack-nova08:36
*** damien_r1 has joined #openstack-nova08:39
*** mvk_ has joined #openstack-nova08:39
*** damien_r has quit IRC08:41
*** mkrcmari__ has quit IRC08:43
openstackgerritChris Dent proposed openstack/nova master: Update RT aggregate map less frequently  https://review.openstack.org/48963308:46
*** mnestratov|2 has joined #openstack-nova08:51
*** mkrcmari__ has joined #openstack-nova08:54
*** mvk_ has quit IRC08:57
*** thorst has joined #openstack-nova08:57
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce basic framework for security proxying  https://review.openstack.org/34539608:57
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce framework for RFB authentication  https://review.openstack.org/34539708:57
openstackgerritStephen Finucane proposed openstack/nova master: console: introduce the VeNCrypt RFB authentication scheme  https://review.openstack.org/34539808:57
openstackgerritStephen Finucane proposed openstack/nova master: console: provide an RFB security proxy implementation  https://review.openstack.org/34539908:57
*** iceyao has joined #openstack-nova08:58
*** yamamoto has quit IRC08:59
*** yamamoto has joined #openstack-nova08:59
*** yamamoto has quit IRC08:59
*** ociuhandu has quit IRC08:59
*** markvoelker has quit IRC09:00
openstackgerritStephen Finucane proposed openstack/nova-specs master: Websockify security proxy framework  https://review.openstack.org/49616009:01
*** thorst has quit IRC09:02
*** mvk has joined #openstack-nova09:03
*** mkrcmari__ has quit IRC09:06
*** phuongnh has joined #openstack-nova09:07
*** chyka has joined #openstack-nova09:10
*** chyka has quit IRC09:15
*** brault has quit IRC09:16
*** brault_ has joined #openstack-nova09:16
*** sambetts|afk is now known as sambetts09:21
*** phuongnh has quit IRC09:29
*** Shunli has quit IRC09:30
*** gixxer1k has joined #openstack-nova09:32
*** gixxer1k has quit IRC09:32
*** faizy has joined #openstack-nova09:40
*** nicolasbock has joined #openstack-nova09:56
*** markvoelker has joined #openstack-nova09:57
*** thorst has joined #openstack-nova09:58
*** yamamoto has joined #openstack-nova10:00
*** nicolasbock has quit IRC10:01
*** thorst has quit IRC10:03
*** yangyapeng has quit IRC10:04
*** dixiaoli has quit IRC10:04
*** kiennt has quit IRC10:05
*** zhouyaguo has quit IRC10:05
*** yamamoto has quit IRC10:05
*** alexchadin has quit IRC10:05
*** zhouyaguo has joined #openstack-nova10:05
*** tbachman has joined #openstack-nova10:06
*** alexchadin has joined #openstack-nova10:07
*** alexchadin has quit IRC10:10
*** alexchadin has joined #openstack-nova10:11
*** alexchadin has quit IRC10:13
*** nicolasbock has joined #openstack-nova10:13
*** zhurong has quit IRC10:17
*** yamamoto has joined #openstack-nova10:30
*** markvoelker has quit IRC10:31
openstackgerritDamon Li proposed openstack/nova master: Fix bug on vmware driver attach volume failed  https://review.openstack.org/49614010:33
*** sree has joined #openstack-nova10:35
*** udesale has quit IRC10:36
*** sree has quit IRC10:39
*** dtantsur is now known as dtantsur|bbl10:40
*** zhouyaguo has quit IRC10:44
*** baoli has joined #openstack-nova10:45
*** baoli has quit IRC10:49
*** kristaps_ has joined #openstack-nova10:52
*** sean-k-m1 has joined #openstack-nova10:53
*** vvargaszte has joined #openstack-nova10:53
*** tbachman has quit IRC10:54
*** shan has quit IRC10:54
*** sean-k-mooney has quit IRC10:54
*** shan has joined #openstack-nova10:54
*** lvdombrkr has quit IRC10:54
*** bkopilov has quit IRC10:56
*** slaweq_ has joined #openstack-nova10:59
*** DinaBelova has quit IRC11:00
*** aignatov has quit IRC11:00
*** DinaBelova has joined #openstack-nova11:00
*** htruta has quit IRC11:00
*** StevenK has quit IRC11:00
*** htruta has joined #openstack-nova11:00
*** junbo has quit IRC11:01
*** slaweq has quit IRC11:01
*** lyarwood_ has quit IRC11:01
*** Dinesh_Bhor has quit IRC11:01
*** aignatov has joined #openstack-nova11:01
openstackgerritLajos Katona proposed openstack/nova master: Add functional migrate force_complete test  https://review.openstack.org/49620211:01
*** kukacz has quit IRC11:01
*** stephenfin has quit IRC11:01
*** toabctl has quit IRC11:01
*** StevenK has joined #openstack-nova11:02
*** lyarwood_ has joined #openstack-nova11:02
*** alex_xu has quit IRC11:02
*** toabctl has joined #openstack-nova11:04
*** Dinesh_Bhor has joined #openstack-nova11:05
*** junbo has joined #openstack-nova11:05
*** stephenfin has joined #openstack-nova11:05
*** alex_xu has joined #openstack-nova11:06
*** edmondsw has joined #openstack-nova11:06
*** thorst has joined #openstack-nova11:07
*** kukacz has joined #openstack-nova11:07
*** edmondsw has quit IRC11:10
*** thorst has quit IRC11:11
*** tbachman has joined #openstack-nova11:11
*** alexchadin has joined #openstack-nova11:13
*** yamamoto has quit IRC11:18
openstackgerritDamon Li proposed openstack/nova master: Fix bug on vmware driver attach volume failed  https://review.openstack.org/49614011:25
*** lyarwood_ has quit IRC11:26
openstackgerritDamon Li proposed openstack/nova master: Fix bug on vmware driver attach volume failed  https://review.openstack.org/49614011:27
*** markvoelker has joined #openstack-nova11:28
*** yamamoto has joined #openstack-nova11:30
*** ociuhandu has joined #openstack-nova11:43
*** rmart04 has joined #openstack-nova11:44
*** edmondsw has joined #openstack-nova11:45
*** yamamoto has quit IRC11:46
*** yamamoto has joined #openstack-nova11:48
*** ratailor has quit IRC11:53
*** faizy has quit IRC11:55
*** faizy has joined #openstack-nova11:57
*** faizy has quit IRC11:58
*** tetsuro has quit IRC11:58
*** faizy has joined #openstack-nova11:58
*** litao__ has quit IRC11:58
*** markvoelker has quit IRC12:01
*** vvargaszte has quit IRC12:01
*** yamamoto has quit IRC12:03
*** yamamoto has joined #openstack-nova12:04
*** artom has joined #openstack-nova12:06
*** carthaca_ has quit IRC12:07
*** carthaca_ has joined #openstack-nova12:07
*** baoli has joined #openstack-nova12:08
*** yamamoto has quit IRC12:10
*** thorst has joined #openstack-nova12:11
cdentmriedem: am I correct that you and dan are actively working on the new placement bugs from last night and the todo there for other people is to review?12:11
*** yamamoto has joined #openstack-nova12:12
*** baoli has quit IRC12:12
*** vvargaszte has joined #openstack-nova12:12
*** elod has quit IRC12:12
*** mdnadeem has quit IRC12:15
*** faizy has quit IRC12:15
*** efoley has joined #openstack-nova12:20
*** vvargaszte has quit IRC12:21
*** shan has quit IRC12:24
*** slaweq_ has quit IRC12:25
*** slaweq has joined #openstack-nova12:26
*** slaweq has quit IRC12:30
*** efoley_ has joined #openstack-nova12:31
*** efoley_ has quit IRC12:31
*** mdnadeem has joined #openstack-nova12:32
*** markvoelker has joined #openstack-nova12:32
*** dave-mccowan has joined #openstack-nova12:34
*** slaweq has joined #openstack-nova12:34
*** psachin has joined #openstack-nova12:35
*** lyan has joined #openstack-nova12:36
*** gixxer1k has joined #openstack-nova12:36
*** gixxer1k has quit IRC12:37
*** udesale has joined #openstack-nova12:37
*** psachin has quit IRC12:39
*** psachin has joined #openstack-nova12:39
VAhlWhere can I find the different state than an Virtual Instance have during upstart? I got a problem when configure nova to go to an cephcluster. Where the instance "hangs" in "build"-state for hours. Can not find any information in the logs that can help me.12:41
*** jmlowe has joined #openstack-nova12:41
*** felipemonteiro has quit IRC12:43
*** felipemonteiro has joined #openstack-nova12:43
*** elod has joined #openstack-nova12:43
*** pchavva has joined #openstack-nova12:44
openstackgerritEric Fried proposed openstack/nova master: Glance download: only fsync files  https://review.openstack.org/45109412:48
*** thorst is now known as thorst_afk12:49
*** bkopilov has joined #openstack-nova12:49
*** kylek3h has joined #openstack-nova12:50
*** pchavva has quit IRC12:51
*** alexchadin has quit IRC12:51
*** trinaths has left #openstack-nova12:51
*** alexchadin has joined #openstack-nova12:51
*** esberglu has joined #openstack-nova12:53
*** mtanino has joined #openstack-nova12:55
*** zhurong has joined #openstack-nova12:56
mriedemcdent: correct12:57
mriedemprobably need to move dan's change before mine as mine is a mess and dan's fix is arguably more important12:57
*** jpena is now known as jpena|lunch12:58
*** gbarros has joined #openstack-nova12:59
*** gbarros has quit IRC12:59
*** bhagyashris has joined #openstack-nova12:59
*** pooja_jadhav has joined #openstack-nova13:04
*** awaugama has joined #openstack-nova13:05
*** felipemonteiro_ has joined #openstack-nova13:07
*** mtanino has quit IRC13:07
*** gbarros has joined #openstack-nova13:07
*** Atom1234 has quit IRC13:11
*** yamamoto has quit IRC13:12
*** yamamoto has joined #openstack-nova13:14
*** baoli has joined #openstack-nova13:18
*** vvargaszte has joined #openstack-nova13:18
*** lyan has quit IRC13:18
*** lyan has joined #openstack-nova13:19
stephenfinmdbooth: Have I mentioned how much I like your commit messages?13:20
stephenfinI feel I may have13:20
*** vvargaszte has joined #openstack-nova13:21
*** vvargaszte has quit IRC13:21
*** yamamoto has quit IRC13:22
*** baoli has quit IRC13:22
*** vvargaszte has joined #openstack-nova13:24
*** voelzmo has joined #openstack-nova13:27
*** felipemonteiro__ has joined #openstack-nova13:29
*** mdnadeem has quit IRC13:29
*** cdent has quit IRC13:30
*** felipemonteiro_ has quit IRC13:32
*** pchavva has joined #openstack-nova13:33
*** vvargaszte has left #openstack-nova13:35
*** xyang1 has joined #openstack-nova13:37
*** eharney has joined #openstack-nova13:38
*** carthaca_ has quit IRC13:40
*** carthaca_ has joined #openstack-nova13:40
*** sree has joined #openstack-nova13:41
*** burt has joined #openstack-nova13:45
*** sree has quit IRC13:45
*** vvargaszte has joined #openstack-nova13:47
bhagyashrisdansmith, jaypipes, melwitt: Hi, I want to discuss regarding bfv case, I have done some testing on the stable/pike and what i observed is even if I have boot the instance from volume then in that case it allocates the disk_gb as the flavor root_gb in both compute_nodes and allocations table but after applying the patch [1]: https://review.openstack.org/#/c/428481/ on stable/pike then it makes the correct allocations. So why these two patche13:49
bhagyashris[1][2] are ignored in the pike. [1]: https://review.openstack.org/#/c/428481/ [2]: https://review.openstack.org/#/c/428505/13:49
*** vvargaszte has quit IRC13:49
lajoskatona:ew13:49
lajoskatona:w13:49
*** vvargaszte has joined #openstack-nova13:50
*** slaweq has quit IRC13:51
*** mdnadeem has joined #openstack-nova13:51
*** lajoskatona has quit IRC13:52
*** crushil has quit IRC13:52
*** lucasxu has joined #openstack-nova13:54
*** alexchadin has quit IRC13:55
*** alexchadin has joined #openstack-nova13:56
*** yamahata has joined #openstack-nova13:56
*** crushil has joined #openstack-nova13:59
*** hongbin has joined #openstack-nova13:59
*** voelzmo has quit IRC14:01
*** igordc has joined #openstack-nova14:02
*** felipemonteiro__ has quit IRC14:02
*** moshele has quit IRC14:03
*** dikonoor has quit IRC14:04
*** marst has joined #openstack-nova14:11
*** voelzmo has joined #openstack-nova14:11
*** jmlowe has quit IRC14:13
openstackgerritMerged openstack/nova master: Add functional force live migrate test  https://review.openstack.org/49517014:13
*** armax has joined #openstack-nova14:14
openstackgerritMerged openstack/nova master: Add functional live migrate test  https://review.openstack.org/49581114:15
*** zhurong has quit IRC14:19
*** links has quit IRC14:20
*** yamamoto has joined #openstack-nova14:23
*** _pewp_ has quit IRC14:26
*** pk_jadhav has joined #openstack-nova14:27
*** yamamoto has quit IRC14:28
*** pooja_jadhav has quit IRC14:30
*** _pewp_ has joined #openstack-nova14:30
*** alexchadin has quit IRC14:34
*** eharney has quit IRC14:34
mriedemdansmith: we should probably re-order the stack here https://review.openstack.org/#/c/496032/ so that yours goes first as it's basically ready and mine is kind of a mess14:35
dansmithmriedem: we can't because mine will fail if the allocation doesn't get doubled14:36
dansmithmriedem: are you working on those unit test failures?14:36
mriedemdansmith: my change can't go in like this, it changes the api behavior on that force flag14:37
mriedemso i likely have to pass a skip_filters flag to select_destinations now14:37
mriedemor have conductor create the allocations for the dest, which we talked about not wanting to do14:37
dansmithmriedem: I missed the discussion on what this changes14:38
mriedemhangout?14:38
dansmithokay14:38
dansmithmriedem: https://hangouts.google.com/call/ouqrk7fijja6pkeeackdtnuc7iu14:38
*** jianghuaw has quit IRC14:40
*** jmlowe has joined #openstack-nova14:40
*** mtanino has joined #openstack-nova14:40
*** udesale has quit IRC14:44
tobascointeresting, this patch was merged 2 years and 9 months ago and still exists in master https://review.openstack.org/#/c/109537/14:49
*** eharney has joined #openstack-nova14:49
tobascoso you cannot boot vm:s from cinder volumes using vda since then14:49
tobascohitting this when testing upgrade between liberty->mitaka14:50
*** felipemonteiro_ has joined #openstack-nova14:56
*** felipemonteiro__ has joined #openstack-nova14:57
*** bhagyashris has quit IRC14:57
openstackgerritElod Illes proposed openstack/nova master: Cover migration fail case with functional test  https://review.openstack.org/49628014:57
*** bhagyashris has joined #openstack-nova14:58
*** kp_jadhav has joined #openstack-nova14:58
*** gouthamr has joined #openstack-nova14:59
*** chyka has joined #openstack-nova15:00
*** felipemonteiro_ has quit IRC15:01
*** pk_jadhav has quit IRC15:01
smcginnistobasco: Still hitting that? Someone else in the cinder channel yesterday was having trouble with that too.15:02
*** jpena|lunch is now known as jpena15:02
smcginnistobasco: This worked for them for the first attempt, then they got DB errors after that: https://review.openstack.org/#/c/428481/15:03
tobascosmcginnis: hm is that really related thought15:04
tobascoim comparing and trying to figure out why it check source_type in mitaka and destination_type in master for the BDM, I assume that part has been severely changed.15:05
smcginnistobasco: Oh, probably not. Sorry, I scanned that too quickly.15:05
tobascosmcginnis: thanks thought :)15:05
*** Oku_OS is now known as Oku_OS-away15:06
*** rmart04 has quit IRC15:06
smcginnistobasco: You had the other issue in the past though, right? With Cinder volumes getting counted against local space.15:06
tobascosmcginnis: yeah, that's true we are working on moving as many versions as possible now, this is the first hop15:07
tobascoa lot of compatibility checking right now, and was no release notes on the above "force" to vdb mounting volumes as to vda when booting volume as root volume in liberty15:07
tobasco*compared to in liberty15:07
smcginnistobasco: Ah, can't really help you there, but I'm sure someone else here can. Good luck!15:08
*** baoli has joined #openstack-nova15:09
*** brault_ has quit IRC15:09
*** brault has joined #openstack-nova15:09
tobascosmcginnis: thanks15:09
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Remove some single use function from utils  https://review.openstack.org/49151315:10
*** gyee has joined #openstack-nova15:11
*** felipemonteiro has quit IRC15:12
*** dtantsur|bbl is now known as dtantsur15:13
*** baoli has quit IRC15:13
*** baoli has joined #openstack-nova15:14
*** markus_z has quit IRC15:15
*** rcernin has quit IRC15:15
*** yangyapeng has joined #openstack-nova15:15
*** sterdnotshaken has joined #openstack-nova15:16
*** baoli has quit IRC15:18
*** kylek3h has quit IRC15:20
*** Apoorva has joined #openstack-nova15:22
openstackgerritStephen Finucane proposed openstack/nova master: rbd: Remove unnecessary 'encode' calls  https://review.openstack.org/41235615:23
*** felipemonteiro has joined #openstack-nova15:24
*** iceyao has quit IRC15:25
*** yamamoto has joined #openstack-nova15:25
tobascoto answer my own question above, you can boot with a volume as root disk using vda if you the root_device_name on the image you are booting to something else and therefore tricking it15:28
tobascoglance image-update --property root_device_name=fake db08860c-84de-4096-a52f-a3223639640415:28
tobascougly fix, but this should have been in the release notes, and even perhaps a way to disable the behaviour15:28
tobascofor anybody finding this when searching, i haven't tested this other than with our own very specific use-case15:29
stephenfinmdbooth: Does this make sense? https://review.openstack.org/#/c/491589/15:30
*** yamamoto has quit IRC15:30
*** sterdnotshaken1 has joined #openstack-nova15:35
*** sterdnotshaken2 has joined #openstack-nova15:37
*** sterdnotshaken1 has quit IRC15:37
*** sterdnotshaken has quit IRC15:38
*** kylek3h has joined #openstack-nova15:39
*** hemna_ has joined #openstack-nova15:40
cfriesen_tobasco: isn't the patch you pointed to intended to cover the case where you are doing boot-from-image with a separate volume specified (where the volume isn't the boot disk)15:43
*** sahid has quit IRC15:44
*** tbachman has quit IRC15:44
*** tbachman has joined #openstack-nova15:44
*** crushil has quit IRC15:46
tobascocfriesen_: unsure, it does apply when just doing the "boot from image (create new volume)" way15:48
tobascowe only do pure cinder backed vm:s with a cinder volume as root disk, setting the root_device_name to something other than vda allowed us to boot the volume as vda.15:48
tobasconote that the ubuntu 16.04 vm interpreted it as one disk and mapped it to vda but openstack said it was vda and set it to "disk 1" instead of 0 in the XML on the kvm node15:49
*** jangutter has quit IRC15:49
*** dixiaoli has joined #openstack-nova15:50
*** dixiaoli has quit IRC15:54
*** belmoreira has quit IRC15:55
*** yangyapeng has quit IRC15:55
*** afanti has quit IRC15:55
*** thorst_afk has quit IRC15:55
*** yangyapeng has joined #openstack-nova15:55
*** thorst_afk has joined #openstack-nova15:57
*** crushil has joined #openstack-nova15:57
*** lpetrut has quit IRC15:59
*** yangyapeng has quit IRC15:59
*** thorst_afk has quit IRC16:01
*** tesseract has quit IRC16:04
*** thorst_afk has joined #openstack-nova16:05
*** voelzmo has quit IRC16:06
*** catintheroof has joined #openstack-nova16:10
mriedemdansmith: in the case that claim_resources fails for the dest node, what are you thinking we do? warn and continue to force or fail with NoValidHost?16:10
mriedems/NoValidHost/MigrationPreCheckError/16:10
cfriesen_tobasco: sorry, was testing this.  for what it's worth, in our Mitaka setup with libvirt/qemu/ceph-based-volumes in the "boot from image (create new volume)" case I get the volume on /dev/vda with the root filesystem on /dev/vda1.16:10
mriedemdansmith: i'm thinking we fail since if the RT isn't going to heal the allocations, we really don't want that missing being claimed for the dest host,16:11
openstackgerritMerged openstack/nova master: Add description on maximum placement API version  https://review.openstack.org/49205616:11
mriedemsince it would screw up scheduling decisions for other instances on that node later16:11
dansmithmriedem: yeah have to fail, IMHO16:12
cfriesen_tobasco: this is with no ephemeral/swap configured.16:12
*** rajathagasthya has joined #openstack-nova16:14
cfriesen_mriedem: dansmith: for what it's worth, I agree with failing if we can't claim resources.  otherwise it'd cause an unholy mess for things like cpu pinning, PCI devices, hugepages, etc.16:16
*** yamahata has quit IRC16:16
*** sterdnotshaken has joined #openstack-nova16:25
*** sterdnotshaken2 has quit IRC16:25
*** iceyao has joined #openstack-nova16:25
mriedemok got the code fix, running the functional test now to make sure it's legit16:26
*** yamamoto has joined #openstack-nova16:26
*** mdnadeem has quit IRC16:28
*** iceyao has quit IRC16:30
*** lpetrut has joined #openstack-nova16:30
*** jpena is now known as jpena|away16:31
*** ociuhandu has quit IRC16:31
*** yamamoto has quit IRC16:32
*** Apoorva has quit IRC16:33
*** Apoorva has joined #openstack-nova16:34
*** yamahata has joined #openstack-nova16:35
*** pcaruana has quit IRC16:37
*** itlinux has joined #openstack-nova16:38
*** Apoorva has quit IRC16:38
sterdnotshakenHow do you delete a network node entirely from Openstack?16:41
sterdnotshakenLet say I have 2 compute and 2 network nodes and the hardware for one of the network nodes fails entirely...16:41
sterdnotshakenSo I just want to delete all references to that network node from openstack and create a new network node on new hardware...16:41
mriedemsterdnotshaken: probably better asked in #openstack-operators16:41
*** sree has joined #openstack-nova16:42
sterdnotshakenok16:42
*** itlinux has quit IRC16:42
*** mvk_ has joined #openstack-nova16:45
mriedemwell look who it is https://www.youtube.com/watch?v=NzWw_uosDnM&index=6&list=PLOuHvpVx7kYksG0NFaCaQsSkrUlj3Oq4S16:45
*** mvk has quit IRC16:48
mriedemalright functional test is passing, time to fix up the unit tests16:50
mriedemmelwitt: are you going to sign up for the red hat pike ptg video this time?16:52
mriedembecause you should16:53
mriedemyou can be like, quotas this, quotas that, something something claims in the scheduler16:53
*** abalutoiu has joined #openstack-nova16:56
*** efoley has quit IRC16:58
*** felipemonteiro__ has quit IRC16:58
*** crushil has quit IRC17:01
*** derekh has quit IRC17:03
openstackgerritMerged openstack/nova master: Add track_instance_changes note in disable_group_policy_check_upcall  https://review.openstack.org/49062717:05
openstackgerritMerged openstack/nova master: doc: code review considerations for online data migrations  https://review.openstack.org/49188517:05
openstackgerritMerged openstack/nova master: Fix a wrong link  https://review.openstack.org/49410917:06
*** moshele has joined #openstack-nova17:07
*** crushil has joined #openstack-nova17:09
openstackgerritDrew Fisher proposed openstack/nova master: Add language for compute node configuration  https://review.openstack.org/48964317:10
*** moshele has quit IRC17:12
*** thorst_afk has quit IRC17:13
*** lpetrut has quit IRC17:18
*** lpetrut has joined #openstack-nova17:19
*** jpena|away is now known as jpena17:22
*** sambetts is now known as sambetts|afk17:22
*** Swami has joined #openstack-nova17:23
*** Swami has quit IRC17:23
*** Swami has joined #openstack-nova17:24
*** abalutoiu has quit IRC17:25
*** yamamoto has joined #openstack-nova17:28
*** yamamoto has quit IRC17:35
mriedemwtf, this is super helpful https://gist.github.com/mriedem/706bcfbac773660310c38ad319ce7fe217:35
mriedemdoesn't exist, create it, sorry it already exists, ok give me it, sorry, it doesn't exist, dummy17:36
*** gbarros has quit IRC17:38
*** shan has joined #openstack-nova17:42
mriedemoh SmallFakeDriver, you'll be the death of me17:43
*** rajathagasthya has quit IRC17:45
*** sree has quit IRC17:46
*** thorst_afk has joined #openstack-nova17:49
*** liverpooler has quit IRC17:53
*** liverpooler has joined #openstack-nova17:53
*** yangyapeng has joined #openstack-nova17:56
*** ganlaksh has joined #openstack-nova17:57
ganlakshtest17:57
*** jpena is now known as jpena|off17:59
*** yangyapeng has quit IRC18:01
*** jlk has joined #openstack-nova18:02
*** rajathagasthya has joined #openstack-nova18:03
*** sterdnotshaken1 has joined #openstack-nova18:03
clarkbmriedem: dansmith https://docs.openstack.org/nova/latest/admin/ssh-configuration.html says that you need to configure the nova user so that nova can ssh to other compute hosts to move disks around. We don't set this up in devstack-gate/devstack multinode jobs. Is this actually required if using libvirt which ssh's as root?18:03
jlkspecifically curious about instance resize18:04
*** sterdnotshaken1 has quit IRC18:04
*** dtantsur is now known as dtantsur|afk18:05
*** sterdnotshaken1 has joined #openstack-nova18:05
mriedemdevstack configures some stuff for live migration using ssh here https://github.com/openstack-dev/devstack/blob/master/lib/nova_plugins/hypervisor-libvirt#L4518:05
mriedemthat option is deprecated though18:05
mriedemyou can tunnel but i believe that's discouraged18:05
*** itlinux has joined #openstack-nova18:06
mriedemi had brought up the live_migration_uri confusion in http://lists.openstack.org/pipermail/openstack-dev/2017-June/117987.html18:06
*** sterdnotshaken has quit IRC18:06
*** gbarros has joined #openstack-nova18:06
mriedembecause i was trying to remove that from devstack18:06
clarkboh is it using the stack user?18:07
*** sterdnotshaken has joined #openstack-nova18:07
mriedemyes18:07
clarkbthen why do we set up ssh for the root user?18:07
clarkb(also I'll have to dig more to see where it set up stack user)18:07
*** eharney has quit IRC18:07
mriedemidk18:08
*** sterdnotshaken1 has quit IRC18:08
*** moshele has joined #openstack-nova18:14
jlkmriedem: is all of instance resize handled by the migration code paths now?18:16
mriedemjlk: it always was18:16
jlkmriedem: I could have sworn that in older releases (mitaka/newton) that a resize specifically did some ssh'ing around as the user running the nova process18:16
mriedemresize has always equaled the cold migration code paths,18:17
mriedemonly difference is the flavor being the same or not18:17
jlkbut maybe that's because we had: live_migration_uri = "qemu+ssh://nova@%s/system?keyfile={{ nova.state_path }}/.ssh/id_rsa"18:17
*** mvk_ has quit IRC18:18
*** thorst_a_ has joined #openstack-nova18:18
mriedemdansmith: tests are passing, just doing another run with everything to make sure i'm not missing some failing test18:18
clarkbmy understanding when we set this up for multinode testing wasw there isn't any reason to not just use root beacuse libvirt ~= root. Which is why we set up root ssh. But its been a while. I bet jogo remembers18:18
jlkI think our local config was not happy about allowing incoming root ssh18:19
mriedemi think if you tunnel via libvirt between the two nodes then that might be ok, but i don't think we're tunneling18:19
jlkso we shunted it to nova18:19
mriedemin devstack i mean18:19
mriedemganlaksh: hi, i saw your email, sorry i've been busy and haven't had a chance to respond18:20
*** thorst_afk has quit IRC18:20
mriedemganlaksh: https://docs.openstack.org/nova/latest/#for-contributors would be good to step through if you haven't yet18:20
mriedemnote that some of it might be outdated18:20
*** dixiaoli has joined #openstack-nova18:21
*** Apoorva has joined #openstack-nova18:21
ganlakshmriedem: Thanks! Yes I have been going through these docs .. Will continue to look into it..18:22
*** eharney has joined #openstack-nova18:23
*** moshele has quit IRC18:25
*** dixiaoli has quit IRC18:25
*** itlinux has quit IRC18:26
mriedemganlaksh: are you interested in working on a specific part of nova?18:27
mriedemalso, what timezone are you in?18:27
openstackgerritMatt Riedemann proposed openstack/nova master: Remove source node allocation after live migration completes  https://review.openstack.org/49603218:28
openstackgerritMatt Riedemann proposed openstack/nova master: Allocate resources on forced dest host during live migration  https://review.openstack.org/49603118:28
mriedemdansmith: cfriesen_: here we are ^18:28
*** yamamoto has joined #openstack-nova18:31
ganlakshmriedem: I am in the PT zone.. with respect to my areas of interest . i dont have any specific right now.. I would like to pick up some bugs and go through the process.. from the top of my mind.. cells,live-migration, Vmware would be some areas I would be interested in.. I am looking at the tracking page here for the subteams  .18:34
*** voelzmo has joined #openstack-nova18:34
mriedemok, vmware hasn't had much activity in awhile, so if you could dig through some vmware-related bugs and see if they are still valid that would be helpful18:35
ganlakshmriedem: https://etherpad.openstack.org/p/pike-nova-priorities-tracking. tracking page that i referenced18:35
mriedemganlaksh: ok that's likely stale at this point18:35
mriedempike is about to be released, so we'll start focusing on the next release, which is named queens18:35
mriedemganlaksh: here are open vmware bugs https://bugs.launchpad.net/nova/+bugs?field.tag=vmware18:36
mriedemi don't really know of any easy things for live migration or cells v2 to get started; there were some blueprints related to live migration in pike that had approved design specs but the owners couldn't work on them so they didn't get done18:37
*** yamamoto has quit IRC18:37
mriedemspecifically https://specs.openstack.org/openstack/nova-specs/specs/pike/approved/live-migration-force-after-timeout.html and https://specs.openstack.org/openstack/nova-specs/specs/pike/approved/live-migration-per-instance-timeout.html18:37
mriedemwe know we're going to need to work on all of these items for cells v2 in queens https://docs.openstack.org/nova/latest/user/cellsv2_layout.html#operations-requiring-upcalls18:38
mriedemthose aren't trivial though18:38
ganlakshmriedem:Ok.. sure. thanks ! Well.let me go through these specs.. arent there any bugs (low hanging fruits!) that i can start working on with respect to live-migration and cells.18:38
mriedemlive migration is really never a low hanging fruit bug type thing :)18:38
ganlakshmriedem : :)18:39
*** chyka has quit IRC18:39
mriedemlooks like there are some open low hanging fruit bugs you could look at though https://bugs.launchpad.net/nova/+bugs?field.tag=low-hanging-fruit18:39
mriedemthe next upcoming in-person event is the ptg in denver, colorado the week of 9/1118:40
mriedemtopics for nova at the ptg are being listed here https://etherpad.openstack.org/p/nova-ptg-queens18:40
mriedemif you wanted to get an idea of what we'll be thinking about for the next release18:41
ganlakshmriedem: Thanks ! i will go through these..18:41
*** itlinux has joined #openstack-nova18:42
openstackgerritMerged openstack/nova master: Skip test_rebuild_server_in_error_state for cells v1  https://review.openstack.org/49307618:42
mriedemganlaksh: final thing, are you subscribed to the openstack-dev mailing list?18:42
ganlakshmriedem: yes..i am .. i am getting the mails...18:42
mriedemok, be sure to setup filters and route things to folders if you don't want to get overwhelmed18:42
*** slaweq has joined #openstack-nova18:42
mriedeme.g. i have a nova folder and i send things there that have [nova] in the subject18:42
ganlakshmriedem: One final question .. I have been using only devstack for playing around.. Is that good enough or what is the recommended thing to do for working on bugs ..18:43
ganlakshmriedem: Sure will have a folder to get all nova stuff..18:43
*** slaweq has quit IRC18:45
mriedemdevstack is good enough18:45
mriedemif you want to poke around on the CLI and test things out in a single-node env18:45
*** sridharg has quit IRC18:46
*** voelzmo has quit IRC18:46
ganlakshmriedem: Ok cool !18:46
*** imacdonn has joined #openstack-nova18:47
*** cdent has joined #openstack-nova18:47
*** amotoki has quit IRC18:53
*** moshele has joined #openstack-nova18:55
*** sterdnotshaken has quit IRC18:57
*** yangyapeng has joined #openstack-nova18:57
*** moshele has quit IRC18:58
openstackgerritMatt Riedemann proposed openstack/nova master: Remove source node allocation after live migration completes  https://review.openstack.org/49603219:00
*** yangyapeng has quit IRC19:02
mriedemcfriesen_: were you working on this? https://bugs.launchpad.net/nova/+bug/171221019:02
openstackLaunchpad bug 1712210 in OpenStack Compute (nova) "Live migration does not restrict to the original cell" [Medium,Triaged] - Assigned to Chris Friesen (cbf123)19:02
mriedemif not i'll fix it quick19:02
*** jlk has left #openstack-nova19:03
mriedemdansmith: something we likely don't want to think about, but if we allocate resources in placement for the dest host during live migration but then something fails and the instance never makes it to the dest node, we aren't cleaning up those allocations anywhere19:05
mriedemthe periodic task would have, but that's no longer doing it once everything is upgraded19:06
mriedemi reckon once have the allocations counted against a migration uuid, we could put a periodic in compute that checks for failed migrations where dest_compute == CONF.host and removes any leftover allocations19:07
*** sterdnotshaken has joined #openstack-nova19:08
*** sterdnotshaken1 has joined #openstack-nova19:10
*** mnestratov|2 has quit IRC19:10
openstackgerritEric Berglund proposed openstack/nova master: WIP: PowerVM Driver: config drive  https://review.openstack.org/40940419:12
openstackgerritEric Berglund proposed openstack/nova master: WIP: PowerVM Driver: config drive  https://review.openstack.org/40940419:12
*** sterdnotshaken has quit IRC19:13
cdentmriedem: migration uuid will fix everything!19:14
mriedemi hope so19:15
cdent_everything_19:15
mriedemhttps://bugs.launchpad.net/nova/+bug/1712411 for tracking19:16
openstackLaunchpad bug 1712411 in OpenStack Compute (nova) "Allocations may not be removed from dest node during failed migrations" [Undecided,New]19:16
*** slaweq has joined #openstack-nova19:16
*** shan has quit IRC19:17
mriedemi'm not sure we'd even need the allocation tracked against the migration uuid19:17
mriedemthe migration record has a status (error), dest_compute, and instance_uuid in it, that's basically all we'd need for a periodic task in the compute to look for failed migrations targeted themselves and remove the allocations for the dest node and the instance involved in the migration19:17
*** gixxer1k has joined #openstack-nova19:18
mriedemusing scheduler report client remove_provider_from_instance_allocation19:18
*** gixxer1k has quit IRC19:18
*** itlinux has quit IRC19:21
*** iceyao has joined #openstack-nova19:28
*** iceyao has quit IRC19:32
*** yamamoto has joined #openstack-nova19:33
cdentmriedem: your attention to detail is appreciated19:34
*** sbezverk has quit IRC19:35
*** pchavva has quit IRC19:36
*** sbezverk has joined #openstack-nova19:37
dansmithmriedem: the allocation for the migration_uuid can be cleanup-able by whoever doesn't have the instance after the failure,19:38
*** yamamoto has quit IRC19:38
dansmithand we could have a nova-manage command (or something) that would look at all the active migrations, see which are stalled/failed, and make sure to clean up the allocations for them or something19:38
dansmithbut yeah19:39
mriedemsure it doesn't really matter who does it19:39
mriedemthings also get weird when you have the ability to cancel an in-progress migration19:43
mriedemif only we had, like, a periodic task in the compute service that would, like, automatically heal the allocations....19:45
mriedemo-)19:45
*** sree has joined #openstack-nova19:46
*** itlinux has joined #openstack-nova19:47
*** chyka has joined #openstack-nova19:50
*** sree has quit IRC19:50
cburgess@dansmit Do I recall correctly something about an issue with flavor migration on upgrade to N or O around the created_at, deleted_at, and updated_at columns? I feel like you mentioned that to me at a summit or PTG or something?19:51
cburgess@dansmith even ^^^^19:51
dansmithum19:52
dansmithcburgess: which flavor migration are you talking about? the more recent one with moving them from the nova to api database?19:52
cburgessYeah the code in nova/objects/flavor in Ocata.19:52
*** armax has quit IRC19:52
cburgessdansmith Though it looks like Newton does the same thing.19:52
cburgessMaybe..19:53
dansmithmaybe that there is no soft delete in the api database?19:53
mriedemthere would be no deleted_at column either19:53
mriedembecause of what dan said19:53
mriedemcburgess: you see it in newton b/c it was added in newton19:54
mriedemhttps://github.com/openstack/nova/commit/e05acd2005d22556918a60a7621e463b593c34e619:54
cburgessRight ok..19:55
cburgessSo we are getting a mysql exception when we try and do the online migration. Its due to the data time formant. The DB has it stored as ISO formant but the migration is expecting it in mysql datetime it looks like. Does that ring a bell?19:55
cburgessLike we missed a step?19:55
*** slaweq has quit IRC19:56
cburgessFeels like we have to be missing something because this is too obvious a bug.19:56
mriedemseems like someone was in here talking about something similar a couple of weeks ago19:57
*** kbringard has joined #openstack-nova19:57
cburgessMaybe @kbringard who is hitting it on our side?19:57
kbringardhttp://i.imgur.com/SMI1LKj.gif19:57
*** yangyapeng has joined #openstack-nova19:58
kbringard@cburgess what now?19:59
cburgess@kbringard well seems like @mriedem and @dansmith don't recall anything like this so... file a bug and propose your patch. Assuming we are right and it merges it would be worth of a backport to the stable branches.19:59
cburgessI need to stop @20:00
cburgessStupid twitter habbit.20:00
dansmithcburgess: kbringard yeah I don't know anything about a date format issue20:01
dansmithkbringard: sorry I missed your ping in -dev earlier .. I was out for a bit20:01
kbringardno worries20:01
kbringardthe crux of it looks like, the migrate code gets the data from created_at in nova.instance_types and stores it as a datetime.datetime object with TimeZone (like it's supposed to)20:02
kbringardbut it's ISO compliant20:02
kbringardso it looks like so: 2017-08-18 16:45:33+00:0020:02
kbringardas a string20:02
*** yangyapeng has quit IRC20:03
kbringardor datetime.datetime(2017, 8, 10, 16, 50, 6, tzinfo=<iso8601.Utc> as the object20:03
kbringardthen, when it calles flavor_flavor_create the it generates an insert query like so:20:03
kbringardINSERT INTO flavors (created_at, updated_at, id, name, memory_mb, vcpus, root_gb, ephemeral_gb, flavorid, swap, rxtx_factor, vcpu_weight, disabled, is_public) VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s)'] [parameters: (datetime.datetime(2017, 8, 10, 16, 50, 6, tzinfo=<iso8601.Utc>), None, 18, 'VCO_cisco_metapod_validation_flavor', 2048, 1, 10, 0, 'db6d7ce0-1d85-49ee-8a73-13f6f64bd46e', 0, 1.0, 0, 0, 1)]20:03
kbringardand fails with20:04
kbringard(1292, "Incorrect datetime value: '2017-08-10 16:50:06+00:00' for column 'created_at' at row 1")20:04
kbringardbecause ISO compliant datetime != mysql compliant datetime20:04
kbringardsimply running it through nova.utils.strtime(), which changes the string to 2017-08-18T16:45:33.000000, fixes it20:04
kbringardso I did a dumb hack like this: http://paste.openstack.org/show/619091/20:05
kbringardwhich probably isn't the right way to do it20:05
kbringardbut it verifies that if you simply change the object to be mysql datetime compliant the problem goes away and it migrates fine20:06
kbringardso I guess the question I'd have for you, dansmith, since it looks like you did a lot of the base object code, specifically the DateTime objects20:06
cburgess@kbringard Did we look at the earlier schema migrates to see if one of them changes the table schema and we some how misses that one?20:06
kbringardis there some other, earlier, place we should modifying the object20:06
mriedemflavor_values['deleted_at'] = utils.strtime(flavor_values['deleted_at']) is wrong20:06
mriedemthere is no deleted_at column in the nova_api.flavors table20:07
kbringardcburgess: yea, I looked at it, they're both datetime20:07
cburgesskbringard k... ok well file a bit and propose the patch I guess... lets see what they say.20:07
mriedemmaybe "if 'deleted_at' in flavor_values" is just always False so you never hit that20:07
kbringardmriedem: sure, but it exists in the original nova one20:07
mriedemright, but we don't migrate that column20:07
kbringardso if they're all NULL then it works fine20:07
kbringardif created_at or updated_at isn't NULL then it fails20:07
kbringardand like you said it just drops deleted_at20:08
kbringardI only added it in the patch for sanity20:08
kbringardand I mean, I don't think this is necessarily a good patch20:08
dansmithI'm confused how do you think this is working upstream if the code is wrong for the column data type?20:08
kbringardwell, I don't know20:08
kbringardthat's what we're trying to figure out20:08
dansmiththere have been oslo changes around timeutils, maybe you've got something crossed there?20:08
kbringardyea, I dunno, that's what I'm trying to get some insight into… I don't know this code very well (or really at all)20:10
mriedembesides the deleted and deleted_at columns, is the table schema the same between nova.instance_types and nova_api.flavors?20:10
kbringardhttps://github.com/openstack/nova/blob/stable/ocata/nova/objects/base.py#L154-L16420:10
kbringardthis is the base object20:10
kbringardhttps://github.com/openstack/nova/blob/stable/ocata/nova/objects/flavor.py#L733-L75820:11
kbringardthis is the migration object code20:11
kbringardspecifically when it does this: https://github.com/openstack/nova/blob/stable/ocata/nova/objects/flavor.py#L744-L74520:11
kbringardthe field: it creates has the TZ as +00:0020:11
kbringardso when you dump the JSON you can see the string is "wrong"20:12
mriedemyeah the objects aren't tz-aware20:12
cburgessActually..20:12
kbringardof course that's the print stuff doing the strings, so you know20:12
cburgess@mriedem @kbringard https://github.com/openstack/oslo.versionedobjects/blob/master/oslo_versionedobjects/fields.py#L459-L46020:12
cburgessThats in master.20:13
kbringardright, so there's the other thing I was looking at cburgess20:13
kbringardthat same code has existed for awhile, iirc20:13
cburgessSo I wonder if the issue here is the version of oslo_versionedobjects.. along the lines of what dansmith said.20:13
mriedemthat's been around forever https://github.com/openstack/oslo.versionedobjects/commit/b6e71f4524c0fece34e2f7e2a8d317653853891220:14
kbringard^^20:14
cburgesskbringard What version of versionedobjects do we have?20:14
kbringardwhen we're running this it's stable/ocata20:14
cburgessWe are checking that out from git and building it in a venv or using something RedHat provided?20:14
kbringardpython-oslo-versionedobjects-1.21.0-1.el7ost.noarch20:15
kbringardpython-oslo-versionedobjects-lang-1.21.0-1.el7ost.noarch20:15
kbringardvanilla Rh package20:15
dansmithit's likely a timeutils thing not an o.vo thing right?20:15
cburgessGood point20:15
cburgessWe use oslo.timeutiles to do the conversion20:15
cburgesskbringard so what version of oslo_utils do we have?20:16
kbringardpython-oslo-utils-lang-3.22.0-1.el7ost.noarch20:16
kbringardpython-oslo-utils-3.22.0-1.el7ost.noarch20:16
*** timgclark has joined #openstack-nova20:17
kbringardmy initial thought was if we maybe don't have enough test coverage?20:17
cburgesskbringard netwon was constrained to 3.16.120:17
kbringardlike, the default flavors we used to create had NULL for all those guys20:18
kbringardand that all works20:18
kbringardso I'm wondering if this has just been a bug that we'd not caught before, and if no one was doing these migrations (or said anything when they did) then maybe we just never discovered it before?20:18
cfriesen_mriedem: did you want me to do a fix for the live migration cell restriction on top of your fix at https://review.openstack.org/#/c/49603 ?20:18
cfriesen_mriedem: or were you going to propose a patch for that?20:19
mriedemcfriesen_: wrong link? i've got a patch though20:22
mriedemjust finishing unit tests20:22
cfriesen_mriedem: gah, I meant https://review.openstack.org/#/c/49603120:22
cfriesen_anyways, cool20:23
mriedemand yes it's on top of that series20:23
mriedemto avoid merge conflicts20:23
*** igordc has quit IRC20:23
*** egonzalez has joined #openstack-nova20:25
cfriesen_mriedem: looking at that commit, in the future if we pass "skip-filters" to the scheduler wouldn't we also want to skip the initial placement checks? (since they're essentially what used to be filters) Presumably the "claim resources on destination" step would fail though.20:27
mriedemcfriesen_: tbd20:28
mriedemcfriesen_: conductor already essentially does the RamFilter20:29
mriedemwhich is replaced by Placement's check on MEMORY_MB20:29
*** gouthamr has quit IRC20:29
mriedemso the thing that would be different would be filtering, via placement, on VCPU and DISK_GB20:29
cfriesen_mriedem: I think that should be pulled out since it was probably legacy code from before we ran the scheduler filters20:29
mriedem?20:29
cfriesen_having conductor do the memory check, I mean20:30
mriedempretty sure that was added in 2.3020:30
cfriesen_guess I didn't review that patch20:30
*** claudiub has quit IRC20:30
mriedembecause that happens in the force host flow20:30
mriedemwhich doesn't call select_destinations20:30
cfriesen_ah, sure.  in the force flow it makes sense20:30
*** lucasxu has quit IRC20:31
mriedemactually looks like you're right20:31
mriedemhttps://review.openstack.org/#/c/29077/20:31
mriedemthat's way old20:31
cfriesen_I was just thinking that in the force case you could skip the placement checks and filters in the scheduler and just jump right to the resource claim.20:31
mriedempredates select_destinations20:32
mriedemgoes back to havana20:32
*** jmlowe has quit IRC20:32
mriedemso yeah that ram check probably shouldn't even be in conductor20:33
*** gixxer1k has joined #openstack-nova20:33
*** psachin has quit IRC20:34
cfriesen_arguably it makes sense in the current flow since it's a critical resource...hard to overcommit ram the way you can with cpu20:34
*** yamamoto has joined #openstack-nova20:35
*** MasterOfBugs has joined #openstack-nova20:36
*** yamamoto has quit IRC20:38
*** yamamoto has joined #openstack-nova20:38
*** yamamoto has quit IRC20:39
*** gbarros has quit IRC20:41
*** jmlowe has joined #openstack-nova20:41
*** jmlowe has quit IRC20:43
*** slaweq has joined #openstack-nova20:43
*** mikal has quit IRC20:44
*** mikal has joined #openstack-nova20:45
*** Apoorva_ has joined #openstack-nova20:49
*** rcernin has joined #openstack-nova20:50
*** abalutoiu has joined #openstack-nova20:51
*** Apoorva has quit IRC20:52
*** gouthamr has joined #openstack-nova20:53
*** slaweq has quit IRC20:56
*** slaweq has joined #openstack-nova20:58
openstackgerritMatt Riedemann proposed openstack/nova master: Restrict live migration to same cell  https://review.openstack.org/49641920:58
*** dave-mccowan has quit IRC20:58
mriedemcfriesen_: dansmith: there is the live migration restricted to same cell fix ^20:58
*** yangyapeng has joined #openstack-nova20:59
*** itlinux has quit IRC20:59
*** priteau has quit IRC21:01
*** eharney has quit IRC21:01
*** tbachman has quit IRC21:02
*** dave-mccowan has joined #openstack-nova21:03
*** yangyapeng has quit IRC21:03
*** jmlowe has joined #openstack-nova21:04
*** armax has joined #openstack-nova21:04
*** itlinux has joined #openstack-nova21:06
*** slaweq has quit IRC21:06
*** tbachman has joined #openstack-nova21:07
*** tjones has joined #openstack-nova21:08
*** slaweq has joined #openstack-nova21:09
*** tjones has quit IRC21:09
*** yamamoto has joined #openstack-nova21:10
*** slaweq has quit IRC21:13
*** mnestratov|2 has joined #openstack-nova21:14
*** yamamoto has quit IRC21:15
*** mtanino has quit IRC21:16
*** thorst_a_ has quit IRC21:21
*** thorst_afk has joined #openstack-nova21:24
*** awaugama has quit IRC21:26
*** thorst_afk has quit IRC21:28
*** cdent has quit IRC21:30
*** iceyao has joined #openstack-nova21:30
*** lpetrut has quit IRC21:30
*** iceyao has quit IRC21:34
*** xyang1 has quit IRC21:51
*** lyan has quit IRC21:54
*** lyan has joined #openstack-nova21:59
*** yangyapeng has joined #openstack-nova21:59
*** catintheroof has quit IRC22:01
*** thorst_afk has joined #openstack-nova22:02
*** itlinux has quit IRC22:03
*** yangyapeng has quit IRC22:04
cfriesen_mriedem: you're a machine with all these fixes. :)22:05
*** thorst_afk has quit IRC22:06
mriedemall these 2 fixes22:07
*** thorst_afk has joined #openstack-nova22:08
*** crushil has quit IRC22:08
cfriesen_is there a way to query the hosts in a cell?22:08
cfriesen_don't see anything in the api-ref22:08
cfriesen_where I'm going with this is...how does the admin know which hosts are part of the same cell?22:10
*** yamamoto_ has joined #openstack-nova22:11
*** hemna_ has quit IRC22:13
*** abalutoiu has quit IRC22:14
*** yamamoto_ has quit IRC22:17
*** edmondsw has quit IRC22:17
*** thorst_afk has quit IRC22:18
*** mtanino has joined #openstack-nova22:18
*** thorst_afk has joined #openstack-nova22:18
mriedemcfriesen_: https://docs.openstack.org/nova/latest/user/cells.html#faqs22:20
mriedemwe probably need another cli in queens for that22:21
mriedemor build on list_cells22:21
*** marst has quit IRC22:22
*** thorst_afk has quit IRC22:22
*** lyan has quit IRC22:23
*** rcernin has quit IRC22:32
cfriesen_mriedem: okay, makes sense22:33
*** _pewp_ has quit IRC22:33
cfriesen_mriedem: would we need a spec for nova-manage?  (does it count as a public API?)22:36
*** crushil has joined #openstack-nova22:38
*** _pewp_ has joined #openstack-nova22:38
*** mnestratov|2 has quit IRC22:49
*** crushil has quit IRC22:49
*** crushil has joined #openstack-nova22:50
*** egonzalez has quit IRC22:53
*** itlinux has joined #openstack-nova22:54
mriedemnope22:57
*** artom has quit IRC22:59
*** yangyapeng has joined #openstack-nova23:00
*** thorst_afk has joined #openstack-nova23:00
*** priteau has joined #openstack-nova23:01
*** chyka has quit IRC23:04
*** chyka has joined #openstack-nova23:04
*** yangyapeng has quit IRC23:05
*** priteau has quit IRC23:06
*** artom has joined #openstack-nova23:10
*** hongbin has quit IRC23:13
*** yamamoto_ has joined #openstack-nova23:13
*** kbringard has quit IRC23:15
*** gouthamr has quit IRC23:16
*** yamamoto_ has quit IRC23:18
*** yangyapeng has joined #openstack-nova23:19
*** yangyapeng has quit IRC23:24
*** esberglu has quit IRC23:24
*** esberglu has joined #openstack-nova23:25
*** esberglu has quit IRC23:29
openstackgerritMatt Riedemann proposed openstack/nova master: Remove source node allocation after live migration completes  https://review.openstack.org/49603223:37
openstackgerritMatt Riedemann proposed openstack/nova master: Restrict live migration to same cell  https://review.openstack.org/49641923:37
openstackgerritMatt Riedemann proposed openstack/nova master: Allocate resources on forced dest host during live migration  https://review.openstack.org/49603123:37
*** efried has quit IRC23:42
*** chyka has quit IRC23:46
*** itlinux has quit IRC23:47
*** dave-mccowan has quit IRC23:48
*** gyee has quit IRC23:53
*** crushil has quit IRC23:54
*** edmondsw has joined #openstack-nova23:55
*** efried has joined #openstack-nova23:56
*** gyee has joined #openstack-nova23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!