| *** thingee_ has quit IRC | 00:00 | |
| *** yassine has quit IRC | 00:06 | |
| *** itlinux has quit IRC | 00:06 | |
| *** thorst has quit IRC | 00:09 | |
| *** thorst has joined #openstack-nova | 00:10 | |
| *** thorst has quit IRC | 00:11 | |
| *** yassine has joined #openstack-nova | 00:14 | |
| *** priteau has joined #openstack-nova | 00:16 | |
| *** k2so is now known as sdake | 00:16 | |
| *** Sukhdev has quit IRC | 00:16 | |
| *** edmondsw has joined #openstack-nova | 00:17 | |
| *** yangyapeng has quit IRC | 00:18 | |
| *** priteau has quit IRC | 00:20 | |
| *** sbezverk has quit IRC | 00:21 | |
| *** edmondsw has quit IRC | 00:22 | |
| *** rajathagasthya has joined #openstack-nova | 00:24 | |
| *** slaweq has joined #openstack-nova | 00:25 | |
| *** smatzek has joined #openstack-nova | 00:27 | |
| *** slaweq has quit IRC | 00:29 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: List/show all server migration types https://review.openstack.org/489029 | 00:32 |
|---|---|---|
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: Enable cold migration with target host https://review.openstack.org/489031 | 00:33 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: Update a URL https://review.openstack.org/489028 | 00:33 |
| *** suresh12 has joined #openstack-nova | 00:42 | |
| *** suresh12 has quit IRC | 00:46 | |
| *** suresh12 has joined #openstack-nova | 00:48 | |
| *** jichen has joined #openstack-nova | 00:49 | |
| *** zhurong has joined #openstack-nova | 00:51 | |
| *** esberglu has joined #openstack-nova | 00:58 | |
| *** esberglu has quit IRC | 01:02 | |
| *** phuongnh has joined #openstack-nova | 01:03 | |
| *** markvoelker has joined #openstack-nova | 01:03 | |
| *** itlinux has joined #openstack-nova | 01:04 | |
| * alex_xu is sick, probably off the whole day | 01:04 | |
| *** Shunli has joined #openstack-nova | 01:04 | |
| *** litao__ has joined #openstack-nova | 01:09 | |
| *** Apoorva_ has quit IRC | 01:09 | |
| *** thorst has joined #openstack-nova | 01:11 | |
| *** gyee has quit IRC | 01:14 | |
| *** gyee has joined #openstack-nova | 01:14 | |
| *** rajathagasthya has quit IRC | 01:16 | |
| *** thorst has quit IRC | 01:17 | |
| *** yangyapeng has joined #openstack-nova | 01:21 | |
| *** slaweq has joined #openstack-nova | 01:27 | |
| dims | alex_xu : hope you feel better | 01:29 |
| dims | soon :) | 01:29 |
| *** jpena|off is now known as jpena | 01:30 | |
| *** yamahata has quit IRC | 01:31 | |
| *** slaweq has quit IRC | 01:31 | |
| *** PsionTheory has quit IRC | 01:35 | |
| *** hongbin has joined #openstack-nova | 01:38 | |
| *** jpena is now known as jpena|off | 01:38 | |
| *** mingyu has joined #openstack-nova | 01:39 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Remove RamFilter and DiskFilter in default filter https://review.openstack.org/492765 | 01:52 |
| *** suresh12 has quit IRC | 02:03 | |
| *** edmondsw has joined #openstack-nova | 02:06 | |
| *** edmondsw has quit IRC | 02:10 | |
| *** sree has joined #openstack-nova | 02:10 | |
| *** tiantian has joined #openstack-nova | 02:10 | |
| *** hemna__ has joined #openstack-nova | 02:11 | |
| *** zsli_ has joined #openstack-nova | 02:11 | |
| *** yangyape_ has joined #openstack-nova | 02:11 | |
| *** hongbin_ has joined #openstack-nova | 02:11 | |
| *** hemna_ has quit IRC | 02:11 | |
| *** thorst has joined #openstack-nova | 02:12 | |
| *** jichen_ has joined #openstack-nova | 02:12 | |
| *** sree has quit IRC | 02:14 | |
| *** coreywright_ has joined #openstack-nova | 02:14 | |
| *** rdo has joined #openstack-nova | 02:15 | |
| *** priteau has joined #openstack-nova | 02:17 | |
| *** gongysh has joined #openstack-nova | 02:17 | |
| *** thorst has quit IRC | 02:17 | |
| *** hongbin has quit IRC | 02:18 | |
| *** yangyapeng has quit IRC | 02:18 | |
| *** coreywright has quit IRC | 02:18 | |
| *** huangtianhua has quit IRC | 02:18 | |
| *** Shunli has quit IRC | 02:18 | |
| *** jichen has quit IRC | 02:18 | |
| *** jistr has quit IRC | 02:18 | |
| *** rdo_ has quit IRC | 02:18 | |
| *** clayton has quit IRC | 02:18 | |
| *** aloga has quit IRC | 02:18 | |
| *** edleafe has quit IRC | 02:18 | |
| *** jichen_ is now known as jichen | 02:19 | |
| *** clayton has joined #openstack-nova | 02:19 | |
| *** john51 has quit IRC | 02:20 | |
| *** openstackgerrit has quit IRC | 02:21 | |
| *** armax has quit IRC | 02:21 | |
| *** lifeless_ has joined #openstack-nova | 02:21 | |
| *** john51 has joined #openstack-nova | 02:21 | |
| *** armax has joined #openstack-nova | 02:21 | |
| *** priteau has quit IRC | 02:22 | |
| *** jistr has joined #openstack-nova | 02:23 | |
| *** chyka has joined #openstack-nova | 02:24 | |
| *** suresh12 has joined #openstack-nova | 02:24 | |
| *** edleafe has joined #openstack-nova | 02:24 | |
| *** gbarros has quit IRC | 02:26 | |
| *** tojuvone has quit IRC | 02:28 | |
| *** lifeless has quit IRC | 02:28 | |
| *** yamahata has joined #openstack-nova | 02:28 | |
| *** slaweq has joined #openstack-nova | 02:28 | |
| *** suresh12 has quit IRC | 02:28 | |
| *** chyka has quit IRC | 02:28 | |
| *** tojuvone has joined #openstack-nova | 02:28 | |
| *** openstackgerrit has joined #openstack-nova | 02:29 | |
| openstackgerrit | Merged openstack/nova master: Remove provider allocs in confirm/revert resize https://review.openstack.org/488510 | 02:29 |
| *** ekhugen has quit IRC | 02:30 | |
| *** coreywright_ has quit IRC | 02:30 | |
| *** gbarros has joined #openstack-nova | 02:31 | |
| *** slaweq has quit IRC | 02:32 | |
| *** kristian__ has joined #openstack-nova | 02:33 | |
| *** ekhugen has joined #openstack-nova | 02:33 | |
| *** hongbin_ has quit IRC | 02:43 | |
| *** suresh12 has joined #openstack-nova | 02:47 | |
| *** coreywright_ has joined #openstack-nova | 02:49 | |
| *** yamamoto has quit IRC | 02:52 | |
| *** yamamoto has joined #openstack-nova | 02:53 | |
| *** hongbin has joined #openstack-nova | 02:55 | |
| *** suresh12 has quit IRC | 02:57 | |
| *** dave-mccowan has quit IRC | 03:06 | |
| *** kiennt has joined #openstack-nova | 03:11 | |
| *** thorst has joined #openstack-nova | 03:13 | |
| *** jichen has quit IRC | 03:13 | |
| *** smatzek has quit IRC | 03:20 | |
| *** nicolasbock has joined #openstack-nova | 03:21 | |
| *** thorst has quit IRC | 03:21 | |
| *** mriedem has quit IRC | 03:22 | |
| *** sbezverk has joined #openstack-nova | 03:24 | |
| *** mriedem has joined #openstack-nova | 03:27 | |
| *** mingyu has quit IRC | 03:28 | |
| *** slaweq has joined #openstack-nova | 03:29 | |
| *** slaweq has quit IRC | 03:34 | |
| *** gongysh has quit IRC | 03:34 | |
| *** psachin has joined #openstack-nova | 03:41 | |
| *** udesale has joined #openstack-nova | 03:41 | |
| *** rajathagasthya has joined #openstack-nova | 03:43 | |
| *** psachin has quit IRC | 03:43 | |
| *** itlinux_ has joined #openstack-nova | 03:44 | |
| *** gmann has joined #openstack-nova | 03:44 | |
| *** jichen has joined #openstack-nova | 03:47 | |
| *** psachin has joined #openstack-nova | 03:51 | |
| *** yangyape_ has quit IRC | 03:51 | |
| *** gbarros has quit IRC | 03:53 | |
| *** edmondsw has joined #openstack-nova | 03:54 | |
| *** hongbin has quit IRC | 03:56 | |
| *** mvk has joined #openstack-nova | 03:57 | |
| *** SamYaple has quit IRC | 03:57 | |
| *** edmondsw has quit IRC | 03:58 | |
| *** zhouyaguo has left #openstack-nova | 04:03 | |
| *** itlinux_ has quit IRC | 04:03 | |
| *** sbezverk has quit IRC | 04:07 | |
| *** kristian__ has quit IRC | 04:07 | |
| *** itlinux_ has joined #openstack-nova | 04:16 | |
| *** thorst has joined #openstack-nova | 04:17 | |
| *** jichen_ has joined #openstack-nova | 04:17 | |
| *** priteau has joined #openstack-nova | 04:18 | |
| *** hamzy has joined #openstack-nova | 04:18 | |
| *** itlinux_ has quit IRC | 04:19 | |
| *** itlinux_ has joined #openstack-nova | 04:19 | |
| *** hareesh has joined #openstack-nova | 04:21 | |
| *** jichen has quit IRC | 04:21 | |
| *** jichen_ is now known as jichen | 04:21 | |
| *** thorst has quit IRC | 04:22 | |
| *** priteau has quit IRC | 04:22 | |
| *** itlinux_ has quit IRC | 04:23 | |
| *** suresh12 has joined #openstack-nova | 04:27 | |
| *** kristian__ has joined #openstack-nova | 04:28 | |
| *** adisky__ has joined #openstack-nova | 04:31 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Avoid chowning console logs in libvirt https://review.openstack.org/472229 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: First attempt at adding a privsep user to nova itself. https://review.openstack.org/459166 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move execs of touch to privsep. https://review.openstack.org/489190 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move libvirts dmcrypt support to privsep. https://review.openstack.org/490737 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move execs of tee to privsep. https://review.openstack.org/489438 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: Don't shell out to mkdir, use ensure_tree() https://review.openstack.org/492326 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move libvirt usages of chown to privsep. https://review.openstack.org/471972 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move ploop commands to privsep. https://review.openstack.org/492325 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: Read from console ptys using privsep. https://review.openstack.org/489486 | 04:31 |
| openstackgerrit | Michael Still proposed openstack/nova master: Refactor libvirt.utils.execute() away. https://review.openstack.org/489816 | 04:31 |
| *** jogo has quit IRC | 04:31 | |
| *** kristian__ has quit IRC | 04:32 | |
| *** mingyu has joined #openstack-nova | 04:39 | |
| *** mingyu has quit IRC | 04:45 | |
| *** rajathagasthya has quit IRC | 04:48 | |
| *** gyee has quit IRC | 04:50 | |
| *** tbachman has quit IRC | 04:50 | |
| *** jogo has joined #openstack-nova | 04:56 | |
| *** tbachman has joined #openstack-nova | 04:59 | |
| *** yamamoto has quit IRC | 05:03 | |
| *** yamamoto has joined #openstack-nova | 05:04 | |
| *** ratailor has joined #openstack-nova | 05:06 | |
| *** claudiub has joined #openstack-nova | 05:09 | |
| *** sree has joined #openstack-nova | 05:10 | |
| *** yamamoto has quit IRC | 05:11 | |
| *** sree has quit IRC | 05:15 | |
| *** shan has joined #openstack-nova | 05:16 | |
| *** thorst has joined #openstack-nova | 05:17 | |
| *** thorst has quit IRC | 05:22 | |
| *** vks1 has joined #openstack-nova | 05:30 | |
| *** slaweq has joined #openstack-nova | 05:31 | |
| *** sapcc-bot has joined #openstack-nova | 05:33 | |
| *** kristian__ has joined #openstack-nova | 05:34 | |
| *** slaweq has quit IRC | 05:35 | |
| *** sapcc-bot1 has quit IRC | 05:37 | |
| *** kristian__ has quit IRC | 05:38 | |
| *** claudiub has quit IRC | 05:38 | |
| *** edmondsw has joined #openstack-nova | 05:42 | |
| *** gongysh has joined #openstack-nova | 05:43 | |
| *** edmondsw has quit IRC | 05:46 | |
| *** suresh12 has quit IRC | 05:48 | |
| *** kiennt has quit IRC | 05:50 | |
| *** armax has quit IRC | 05:51 | |
| *** lpetrut has joined #openstack-nova | 05:52 | |
| *** armax has joined #openstack-nova | 05:52 | |
| *** armax has quit IRC | 05:52 | |
| *** armax has joined #openstack-nova | 05:52 | |
| *** armax has quit IRC | 05:53 | |
| *** armax has joined #openstack-nova | 05:53 | |
| *** armax has quit IRC | 05:54 | |
| *** armax has joined #openstack-nova | 05:54 | |
| *** armax has quit IRC | 05:54 | |
| *** itlinux has quit IRC | 05:55 | |
| *** armax has joined #openstack-nova | 05:55 | |
| *** armax has quit IRC | 05:55 | |
| *** armax has joined #openstack-nova | 05:56 | |
| *** armax has quit IRC | 05:56 | |
| *** armax has joined #openstack-nova | 05:57 | |
| *** armax has quit IRC | 05:57 | |
| *** itlinux has joined #openstack-nova | 05:57 | |
| *** armax has joined #openstack-nova | 05:57 | |
| *** armax has quit IRC | 05:58 | |
| *** gmann has quit IRC | 06:01 | |
| *** slaweq has joined #openstack-nova | 06:04 | |
| *** kiennt has joined #openstack-nova | 06:08 | |
| *** rajathagasthya has joined #openstack-nova | 06:10 | |
| *** Oku_OS-away is now known as Oku_OS | 06:11 | |
| *** _pewp_ has quit IRC | 06:13 | |
| *** diga has joined #openstack-nova | 06:14 | |
| *** _pewp_ has joined #openstack-nova | 06:14 | |
| *** tesseract has joined #openstack-nova | 06:16 | |
| *** thorst has joined #openstack-nova | 06:18 | |
| *** priteau has joined #openstack-nova | 06:18 | |
| *** yamamoto has joined #openstack-nova | 06:19 | |
| *** Sukhdev has joined #openstack-nova | 06:22 | |
| *** kiennt has quit IRC | 06:22 | |
| *** rcernin has joined #openstack-nova | 06:22 | |
| *** kiennt has joined #openstack-nova | 06:23 | |
| *** thorst has quit IRC | 06:23 | |
| *** priteau has quit IRC | 06:23 | |
| *** yamamoto has quit IRC | 06:24 | |
| *** itlinux has quit IRC | 06:28 | |
| *** phuongnh has quit IRC | 06:28 | |
| *** phuongnh has joined #openstack-nova | 06:29 | |
| *** rtjure has joined #openstack-nova | 06:32 | |
| *** kristian__ has joined #openstack-nova | 06:33 | |
| *** Sukhdev has quit IRC | 06:34 | |
| *** kristian__ has quit IRC | 06:34 | |
| *** mingyu has joined #openstack-nova | 06:35 | |
| *** libin_ has joined #openstack-nova | 06:43 | |
| *** sahid has joined #openstack-nova | 06:44 | |
| *** phuongnh has quit IRC | 06:45 | |
| *** lpetrut has quit IRC | 06:52 | |
| *** yamamoto has joined #openstack-nova | 06:52 | |
| *** amotoki has joined #openstack-nova | 06:57 | |
| *** Swami has quit IRC | 06:59 | |
| *** kristian__ has joined #openstack-nova | 07:00 | |
| *** jaosorior has quit IRC | 07:03 | |
| openstackgerrit | Merged openstack/nova master: Resource tracker compatibility with Ocata and Pike https://review.openstack.org/491012 | 07:06 |
| *** yamamoto has quit IRC | 07:07 | |
| *** aarefiev_afk is now known as aarefiev | 07:08 | |
| *** moshele has joined #openstack-nova | 07:11 | |
| *** rajathagasthya has quit IRC | 07:12 | |
| *** saphi has joined #openstack-nova | 07:13 | |
| *** jaosorior has joined #openstack-nova | 07:15 | |
| *** markus_z has joined #openstack-nova | 07:16 | |
| *** ioggstream has joined #openstack-nova | 07:17 | |
| *** aloga has joined #openstack-nova | 07:19 | |
| *** thorst has joined #openstack-nova | 07:19 | |
| *** gmann has joined #openstack-nova | 07:21 | |
| *** thorst has quit IRC | 07:23 | |
| *** kristian__ has quit IRC | 07:23 | |
| *** gmann has quit IRC | 07:28 | |
| *** slaweq has quit IRC | 07:28 | |
| *** slaweq has joined #openstack-nova | 07:29 | |
| *** gmann has joined #openstack-nova | 07:37 | |
| *** sree has joined #openstack-nova | 07:40 | |
| *** kristian__ has joined #openstack-nova | 07:41 | |
| *** ralonsoh has joined #openstack-nova | 07:41 | |
| *** aloga has quit IRC | 07:43 | |
| *** aloga has joined #openstack-nova | 07:43 | |
| *** slaweq has quit IRC | 07:47 | |
| openstackgerrit | jichenjc proposed openstack/nova master: refactory some code on get_password https://review.openstack.org/449458 | 07:50 |
| openstackgerrit | Markus Zoeller (markus_z) proposed openstack/nova master: docs: Explain the flow of the "serial console" feature https://review.openstack.org/476188 | 07:51 |
| *** kristia__ has joined #openstack-nova | 07:51 | |
| *** kristian__ has quit IRC | 07:53 | |
| *** karthiks has joined #openstack-nova | 07:57 | |
| *** phuoc_ has joined #openstack-nova | 07:57 | |
| *** alexchadin has joined #openstack-nova | 07:58 | |
| *** openstackgerrit has quit IRC | 08:02 | |
| *** sridharg has joined #openstack-nova | 08:04 | |
| *** yamamoto has joined #openstack-nova | 08:04 | |
| *** gmann has quit IRC | 08:07 | |
| *** diga has quit IRC | 08:08 | |
| *** mvk has quit IRC | 08:14 | |
| *** derekh has joined #openstack-nova | 08:14 | |
| *** diga has joined #openstack-nova | 08:15 | |
| *** priteau has joined #openstack-nova | 08:16 | |
| *** yamamoto has quit IRC | 08:17 | |
| *** mvk has joined #openstack-nova | 08:21 | |
| *** openstackgerrit has joined #openstack-nova | 08:24 | |
| openstackgerrit | Ilya Popov proposed openstack/nova master: Tests: Add cleanup of 'instances' directory https://review.openstack.org/491589 | 08:24 |
| *** yangyapeng has joined #openstack-nova | 08:30 | |
| *** moshele has quit IRC | 08:34 | |
| *** sahid has quit IRC | 08:43 | |
| *** yamamoto has joined #openstack-nova | 08:44 | |
| *** sahid has joined #openstack-nova | 08:47 | |
| *** mingyu has quit IRC | 08:48 | |
| *** lucas-afk is now known as lucasagomes | 08:49 | |
| *** dtantsur|afk is now known as dtantsur | 08:54 | |
| *** yamamoto has quit IRC | 08:56 | |
| *** priteau has quit IRC | 08:58 | |
| *** shan is now known as shan|afk | 09:01 | |
| *** sambetts|afk is now known as sambetts | 09:02 | |
| *** yangyapeng has quit IRC | 09:03 | |
| *** cdent has joined #openstack-nova | 09:05 | |
| *** priteau has joined #openstack-nova | 09:08 | |
| *** alexchadin has quit IRC | 09:09 | |
| *** diga_ has joined #openstack-nova | 09:17 | |
| *** markvoelker has quit IRC | 09:17 | |
| *** diga has quit IRC | 09:18 | |
| *** phuoc_ has left #openstack-nova | 09:20 | |
| *** thorst has joined #openstack-nova | 09:21 | |
| *** yamamoto has joined #openstack-nova | 09:24 | |
| *** thorst has quit IRC | 09:25 | |
| openstackgerrit | yfzhao proposed openstack/python-novaclient master: Fix wrong links https://review.openstack.org/492921 | 09:27 |
| *** mriedem has quit IRC | 09:30 | |
| *** priteau has quit IRC | 09:33 | |
| gibi | good morning | 09:34 |
| *** yamamoto has quit IRC | 09:35 | |
| *** zsli_ has quit IRC | 09:37 | |
| *** jichen has quit IRC | 09:38 | |
| bauzas | gibi: good lunch :p | 09:39 |
| gibi | bauzas: the day started earlier a bit but I was occupied with internal meetings | 09:41 |
| gibi | bauzas: but yes, a lunch is about to happen too | 09:42 |
| gibi | bauzas: did Matt cut rc1 last night? | 09:42 |
| bauzas | gibi: no | 09:43 |
| bauzas | gibi: https://review.openstack.org/#/c/492788/2 | 09:43 |
| bauzas | he was waiting for the merge IIRC | 09:43 |
| bauzas | gibi: now, the main problem is about the Ironic job | 09:43 |
| bauzas | dtantsur: around ? | 09:43 |
| bauzas | dtantsur: context is https://review.openstack.org/#/c/487954/14 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: replace chance with filter scheduler in func tests https://review.openstack.org/491529 | 09:44 |
| bauzas | dtantsur: that change is atm a RC1 blocker but I don't see the Ironic job providing the log saying that the flavor is modified | 09:44 |
| gibi | bauzas: thanks for the info | 09:45 |
| bauzas | dtantsur: if we cut RC1 without ^, that could possibly be an upgrade problem for Queens | 09:45 |
| bauzas | so I would appreciate any ironic folks support now :) | 09:45 |
| bauzas | TheJulia: around too ? | 09:46 |
| *** vks11 has joined #openstack-nova | 09:46 | |
| *** vks1 has quit IRC | 09:47 | |
| smcginnis | bauzas: Do you need to hold that RC request? | 09:47 |
| *** mingyu has joined #openstack-nova | 09:48 | |
| smcginnis | bauzas: Oh, nevermind. Now I see your comment there. | 09:49 |
| bauzas | smcginnis: yeah, I'd like to discuss with matt about whether we cut RC1 without the change I provided in my comment | 09:50 |
| bauzas | smcginnis: do you accept that ? is it possible to cut RC1 only on Friday? | 09:50 |
| bauzas | I mean, it's also a branch | 09:50 |
| smcginnis | bauzas: I think we're probably fine waiting until Monday if we have to. | 09:50 |
| smcginnis | bauzas: You're just waiting on one patch, right? | 09:50 |
| bauzas | smcginnis: yup, I just rebased the releases tag with the merge sha1 | 09:51 |
| bauzas | smcginnis: so if we just cut the tag without the above change, a +W would only be needed | 09:51 |
| bauzas | the only blocker for us is https://review.openstack.org/#/c/487954/ | 09:51 |
| bauzas | other bugs would be treated in other RCs | 09:52 |
| bauzas | HTH | 09:52 |
| smcginnis | bauzas: Cool, I think we're fine waiting a little then. | 09:52 |
| *** mingyu has quit IRC | 09:53 | |
| *** ratailor has quit IRC | 09:54 | |
| *** priteau has joined #openstack-nova | 09:54 | |
| dtantsur | morning bauzas | 09:55 |
| dtantsur | I'll start looking in it in a few minutes | 09:55 |
| *** priteau has quit IRC | 09:59 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: test server evacuation with placement https://review.openstack.org/492548 | 10:00 |
| *** sdague has joined #openstack-nova | 10:00 | |
| *** kiennt has quit IRC | 10:01 | |
| *** egonzalez has joined #openstack-nova | 10:03 | |
| bauzas | dtantsur: FWIW, I'm forging a DNM patch for adding more voerbosity | 10:03 |
| *** trungnv has quit IRC | 10:03 | |
| *** priteau has joined #openstack-nova | 10:04 | |
| *** yangyapeng has joined #openstack-nova | 10:04 | |
| dtantsur | cool | 10:04 |
| *** gmann has joined #openstack-nova | 10:04 | |
| *** sapd has joined #openstack-nova | 10:06 | |
| *** ociuhandu has quit IRC | 10:08 | |
| *** yangyapeng has quit IRC | 10:09 | |
| *** mingyu has joined #openstack-nova | 10:09 | |
| *** ratailor has joined #openstack-nova | 10:13 | |
| *** mingyu has quit IRC | 10:14 | |
| *** mingyu has joined #openstack-nova | 10:14 | |
| *** Drankis has joined #openstack-nova | 10:16 | |
| *** Drankis has quit IRC | 10:16 | |
| *** Drankis has joined #openstack-nova | 10:16 | |
| openstackgerrit | Sylvain Bauza proposed openstack/nova master: Make compute log less verbose with allocs autocorrection https://review.openstack.org/492571 | 10:16 |
| *** markvoelker has joined #openstack-nova | 10:18 | |
| dtantsur | bauzas: I don't really understand the CI failure there.. it seems unrelated to me | 10:18 |
| bauzas | dtantsur: hence me logging more | 10:19 |
| bauzas | dtantsur: I'm even not sure we run the thread | 10:19 |
| bauzas | given it's in a conditional | 10:19 |
| dtantsur | we should not, it only runs for nodes with resource_class != None | 10:20 |
| dtantsur | bauzas: I can make https://review.openstack.org/#/c/491777/ depends-on this patch, to see how it behaves with resource_classes. wdyt? | 10:21 |
| *** thorst has joined #openstack-nova | 10:22 | |
| bauzas | dtantsur: sure | 10:22 |
| * dtantsur doing | 10:22 | |
| *** psachin has quit IRC | 10:22 | |
| bauzas | dtantsur: if that doesn't trample you waiting for devstack patch being merged | 10:22 |
| bauzas | dtantsur: I mean, if you can wait for that devstack patch to be merged, that's fine to me | 10:23 |
| dtantsur | we need to make sure it won't blow up after merging the both changes :) | 10:23 |
| bauzas | yeah | 10:23 |
| *** markvoelker has quit IRC | 10:23 | |
| bauzas | anyway, just doing an urgent internal bug thingy and then I'm back to the DNM patch | 10:23 |
| dtantsur | ack | 10:23 |
| *** sree has quit IRC | 10:24 | |
| *** thorst has quit IRC | 10:26 | |
| dtantsur | ok, both patches updated, waiting for the CI | 10:27 |
| *** yamamoto has joined #openstack-nova | 10:32 | |
| *** psachin has joined #openstack-nova | 10:35 | |
| *** markvoelker has joined #openstack-nova | 10:39 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/nova master: Deprecate bare metal filters https://review.openstack.org/492563 | 10:41 |
| *** vks11 has quit IRC | 10:41 | |
| dtantsur | bauzas: meanwhile, do you think we can also get ^^ in? | 10:42 |
| *** markvoelker_ has joined #openstack-nova | 10:44 | |
| *** markvoelker has quit IRC | 10:44 | |
| *** markvoelker_ has quit IRC | 10:44 | |
| *** markvoelker has joined #openstack-nova | 10:45 | |
| *** yamamoto has quit IRC | 10:48 | |
| *** suresh12 has joined #openstack-nova | 10:48 | |
| *** suresh12 has quit IRC | 10:53 | |
| bauzas | dtantsur: looks to me hard for RC1 | 10:53 |
| bauzas | dtantsur: even if we haven't yet merged it | 10:53 |
| bauzas | tagged it, sorry | 10:53 |
| dtantsur | ok, that's fine. I just have an ironic docs patch depending on it, I may need to split it | 10:53 |
| bauzas | dtantsur: we're already past the deadline but I leave matt make the hard call :) | 10:53 |
| dtantsur | vdrok: first of all, please review https://review.openstack.org/#/c/487954/ | 10:54 |
| vdrok | dtantsur: looking | 10:54 |
| dtantsur | vdrok: it fails the ironic CI for some reason. I see network connection problems between various services, so it is not necessary related to the patch itself | 10:56 |
| vdrok | dtantsur: yup, there is some socket error in the vbmc log as well | 10:56 |
| dtantsur | I've rechecked it, let's see | 10:56 |
| dtantsur | vdrok: our next step would be to make https://review.openstack.org/491777 and https://review.openstack.org/476968 pass the CI - reviews welcome there too | 10:57 |
| bauzas | dtantsur: I'm more concerned by the fact I don't see the logs mentioning the flavor update rather than the Ironic job giving us -1 :) | 10:57 |
| bauzas | dtantsur: in other words, I feel brave enough to +2 some ironic change if I'm sure the job issues are unrelated | 10:57 |
| dtantsur | bauzas: why should we see any updates, given that the nodes don't have resource classes yet? | 10:58 |
| bauzas | oh f**** | 10:58 |
| * bauzas facepalms | 10:58 | |
| bauzas | dtantsur: you killed me :p | 10:59 |
| dtantsur | bear metal powerzzz! | 10:59 |
| bauzas | dtantsur: those ironic nodes aren't having resource classes | 10:59 |
| bauzas | ? | 10:59 |
| *** saphi has quit IRC | 10:59 | |
| bauzas | yet, I mean ? | 10:59 |
| *** vks1 has joined #openstack-nova | 11:00 | |
| dtantsur | bauzas: yep. your logging line should show up in https://review.openstack.org/491777 instead - hence I made it depends-on the nova patch | 11:00 |
| *** zhurong has quit IRC | 11:00 | |
| bauzas | dtantsur: oh snap https://review.openstack.org/#/c/491777/9/devstack/lib/ironic@1821 right? | 11:01 |
| bauzas | until that devstack change, the gate nodes aren't yet correctly having resource classes | 11:01 |
| bauzas | I thought it was already the case | 11:01 |
| bauzas | dtantsur: IMHO, we should invert the depends-on | 11:02 |
| dtantsur | hah, sorry for not figuring out the confusion earlier | 11:02 |
| bauzas | dtantsur: why would you make the devstack change dependent on the nova change ? | 11:02 |
| dtantsur | bauzas: yeah, good call probably. wanna me drop the depends-on from my patch? | 11:02 |
| bauzas | if the nova change uses what's provided by the devstack one ? | 11:03 |
| dtantsur | I wanted one of them to depend on the other, I don't care which exactly :) | 11:03 |
| * dtantsur updates | 11:03 | |
| bauzas | dtantsur: yeah, please remove the depends-on on the devstack one | 11:03 |
| bauzas | dtantsur: and then I'll update https://review.openstack.org/#/c/487954/ to include devstack | 11:03 |
| dtantsur | bauzas: done | 11:04 |
| *** priteau has quit IRC | 11:04 | |
| bauzas | dtantsur: I have to apologize, I wasn't having a full view of the situation | 11:04 |
| vdrok | dtantsur: so, for that code to be triggered, we have to have an active instance booted with old flavor, and afterwards being updated with resource class right? | 11:04 |
| bauzas | dtantsur: okay, I'm on https://review.openstack.org/#/c/487954/ | 11:04 |
| vdrok | code in https://review.openstack.org/#/c/487954/14 I mean | 11:04 |
| dtantsur | bauzas: no problem, thanks for helping us with this stuff anyway | 11:04 |
| bauzas | vdrok: for the nova code to be triggered, you have to set resource classes for ironic nodes firsrt | 11:05 |
| *** mingyu has quit IRC | 11:05 | |
| bauzas | vdrok: that would be done by devstack in the job we discuss | 11:05 |
| *** mingyu has joined #openstack-nova | 11:05 | |
| *** yangyapeng has joined #openstack-nova | 11:05 | |
| dtantsur | vdrok: I think vdrok's point is that we still won't see the log message, because it needs the resource_class to not be present initially.. | 11:06 |
| vdrok | dtantsur: bauzas exactly | 11:06 |
| openstackgerrit | Sylvain Bauza proposed openstack/nova master: Handle addition of new nodes/instances in ironic flavor migration https://review.openstack.org/487954 | 11:06 |
| dtantsur | so I wonder if the only option to test it is to actually get a devstack locally, and try it | 11:06 |
| *** mriedem has joined #openstack-nova | 11:07 | |
| bauzas | dtantsur: done ^ | 11:07 |
| bauzas | dtantsur: just to make it clear, I'm just updating it but just for testing purposes | 11:07 |
| dtantsur | vdrok: in any case, could you please review https://review.openstack.org/#/c/491777/ ? this is something we must get in today to not block nova further | 11:07 |
| *** hieulq has quit IRC | 11:07 | |
| bauzas | dtantsur: once we're sure the flavor is correctly updated, I feel fine to just revert it to PS14 and +W it since melwitt already gave her +2 | 11:08 |
| vdrok | dtantsur: yeah that one looks fine to me | 11:08 |
| *** ratailor has quit IRC | 11:08 | |
| *** edmondsw has joined #openstack-nova | 11:10 | |
| mriedem | bauzas: you know you could have pushed a change on top that depended on https://review.openstack.org/#/c/491777/ | 11:10 |
| *** yangyapeng has quit IRC | 11:10 | |
| bauzas | mriedem: snap, my bad | 11:10 |
| mriedem | now you have to run https://review.openstack.org/#/c/487954/ back through twice | 11:10 |
| *** slaweq has joined #openstack-nova | 11:10 | |
| mriedem | i'm already tagging rc1 | 11:10 |
| bauzas | mriedem: yeah, good point | 11:10 |
| bauzas | mriedem: I just updated the RC1 patch | 11:11 |
| bauzas | mriedem: with the latest merge sha1 | 11:11 |
| bauzas | mriedem: I can revert back to PS14 so we won't need to run yet again jenkins | 11:11 |
| bauzas | and I'll do what you say | 11:11 |
| vdrok | dtantsur: I'll just test this locally now I think. and then we'll try to make the grenade do this resource class setting to see the whole process | 11:11 |
| bauzas | mriedem: ack ? | 11:11 |
| mriedem | bauzas: i think https://review.openstack.org/#/c/492788/ is ready to go | 11:12 |
| dtantsur | vdrok: cool, thanks! | 11:12 |
| *** chyka has joined #openstack-nova | 11:12 | |
| mriedem | the ironic stuff is rc2 | 11:12 |
| dtantsur | that will require backporting to stable/pike, right? | 11:13 |
| dtantsur | also morning mriedem | 11:13 |
| mriedem | dtantsur: yes | 11:13 |
| bauzas | mriedem: okay, I'm fine then | 11:13 |
| dtantsur | ack | 11:13 |
| bauzas | mriedem: removing my -1 | 11:13 |
| bauzas | smcginnis: ^ | 11:13 |
| mriedem | but that's just because we don't have milestone-proposed anymore | 11:13 |
| *** sapd has quit IRC | 11:14 | |
| openstackgerrit | Sylvain Bauza proposed openstack/nova master: Handle addition of new nodes/instances in ironic flavor migration https://review.openstack.org/487954 | 11:16 |
| mriedem | dtantsur: i was not sure what to make of http://logs.openstack.org/68/476968/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/02053cf/logs/screen-n-sch.txt.gz#_Aug_09_20_35_41_533621 | 11:16 |
| mriedem | dtantsur: when i dug through those logs, | 11:16 |
| mriedem | the ironic driver wasn't populating inventory in placement, | 11:16 |
| mriedem | which would have auto-created the custom resource class | 11:16 |
| mriedem | i'm not sure if we have some chicken and egg issue | 11:17 |
| * TheJulia reads | 11:17 | |
| dtantsur | mriedem: it seems to be that it tries to proceed, and actually fails on http://logs.openstack.org/68/476968/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/02053cf/logs/screen-n-sch.txt.gz#_Aug_09_20_35_41_588272 | 11:17 |
| dtantsur | I'm not sure it's expected or not | 11:17 |
| *** chyka has quit IRC | 11:17 | |
| dtantsur | if it is, then I'm pretty sure we have a chicked and egg situation | 11:17 |
| mriedem | dtantsur: i think that's a side effect | 11:17 |
| *** gongysh has quit IRC | 11:17 | |
| mriedem | there is a periodic task in the compute service that pulls inventory from ironic https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L775 | 11:18 |
| mriedem | ^ includes any custom resource class on the node | 11:18 |
| mriedem | the resource tracker in the compute service calls that from here https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L834 | 11:18 |
| *** udesale has quit IRC | 11:18 | |
| mriedem | and if there is a custom resource class in that inventory, it would auto-create it in placement here https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L775 | 11:19 |
| mriedem | when i was looking at the logs on that failed job, i never saw _update_inventory get called | 11:19 |
| mriedem | so with my limited understanding of how the ironic driver works, when does the node cache in the driver actually have something show up here? https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L735 | 11:20 |
| vdrok | dtantsur: locally, I see "The flavor extra_specs for Ironic instance 0b8460b1-22 | 11:20 |
| vdrok | 57-44dc-8b96-4c17182a9a64 have been updated for custom resource class 'baremetal'." | 11:20 |
| cdent | mriedem, bauzas any pending crises that need attention? | 11:20 |
| mriedem | cdent: not really, just trying to sort out https://review.openstack.org/#/c/487954/1 | 11:20 |
| mriedem | https://review.openstack.org/#/c/487954/ i mean | 11:20 |
| vdrok | dtantsur: mriedem http://paste.openstack.org/show/618160/ | 11:21 |
| mriedem | and this http://logs.openstack.org/68/476968/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/02053cf/logs/screen-n-sch.txt.gz#_Aug_09_20_35_41_533621 | 11:21 |
| vdrok | so same thing as you see I guess | 11:21 |
| openstackgerrit | Sylvain Bauza proposed openstack/nova master: DNM: Add more logging + hook devstack https://review.openstack.org/492957 | 11:21 |
| bauzas | cdent: nothing really critical | 11:22 |
| bauzas | cdent: ironic flavor migration is hold for RC2 | 11:22 |
| mriedem | "Unable to allocate inventory for resource provider 68d57495-2daa-46b3-8e2c-f2f0a19dbaf8: No such resource class CUSTOM_BAREMETAL." | 11:22 |
| bauzas | cdent: and RC1 is on its way | 11:22 |
| bauzas | mriedem: dtantsur: https://review.openstack.org/492957 HTH | 11:22 |
| *** thorst has joined #openstack-nova | 11:22 | |
| dtantsur | mriedem: I guess it does it once in 2 minutes. this may be the cause of the problem: we may need to wait for Placement to get it. Do we have any CLI for placement so far? | 11:22 |
| mriedem | dtantsur: there is a series of unmerged osc changes | 11:23 |
| * bauzas drops for a a couple of minutes | 11:23 | |
| bauzas | (lunch) | 11:23 |
| mriedem | https://blueprints.launchpad.net/nova/+spec/placement-osc-plugin | 11:23 |
| *** priteau has joined #openstack-nova | 11:23 | |
| *** shan|afk is now known as shan | 11:23 | |
| vdrok | dtantsur: don't think there is a problem with waiting, I still see the same error after 4 minutes | 11:23 |
| *** priteau has quit IRC | 11:24 | |
| dtantsur | oh | 11:24 |
| dtantsur | thanks vdrok. this does look like a problem to me now | 11:24 |
| *** egonzalez has quit IRC | 11:24 | |
| *** cdent has quit IRC | 11:24 | |
| *** sridharg has quit IRC | 11:24 | |
| *** kristia__ has quit IRC | 11:24 | |
| *** aloga has quit IRC | 11:24 | |
| *** tojuvone has quit IRC | 11:24 | |
| *** yamahata has quit IRC | 11:24 | |
| mriedem | this is really weird | 11:25 |
| mriedem | Aug 11 11:18:56 ubuntu nova-compute[7647]: INFO nova.scheduler.client.report [None req-267b8c81-5ea5-4e13-9ea8-02354628c37f None None] Compute node 68d57495-2daa-46b3-8e2c-f2f0a19dbaf8 reported no inventory but previous inventory was detected. Deleting existing inventory records. | 11:25 |
| mriedem | ^ is if the get_inventory method in the driver reported some inventory at one point, but now it doesn't | 11:26 |
| *** hareesh has quit IRC | 11:26 | |
| * dtantsur is confused | 11:26 | |
| mriedem | was the node disabled? | 11:26 |
| dtantsur | vdrok: ^^^ what was your testing scenario? | 11:27 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L741 | 11:27 |
| *** ratailor has joined #openstack-nova | 11:27 | |
| *** thorst has quit IRC | 11:27 | |
| *** sapd has joined #openstack-nova | 11:28 | |
| vdrok | dtantsur: mriedem I had an instance booted yesterday, devstack setup also from yesterday, with no custom non-merged patches. then I updated nova code with this flavor migration change, restarted n-cpu, updated the resource class of the node the instance was on from None to baremetal | 11:28 |
| dtantsur | mriedem: oh. it seems that we don't report inventory for ACTIVE nodes | 11:29 |
| dtantsur | https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L324-L329 | 11:29 |
| mriedem | vdrok: ok and we see that get picked up here | 11:29 |
| mriedem | Aug 11 11:18:56 ubuntu nova-compute[7647]: DEBUG nova.virt.ironic.driver [None req-267b8c81-5ea5-4e13-9ea8-02354628c37f None None] The flavor extra_specs for Ironic instance 0b8460b1-22 57-44dc-8b96-4c17182a9a64 have been updated for custom resource class 'baremetal'. {{(pid=7647) _pike_flavor_migration /opt/stack/nova/nova/virt/ironic/driver.py:561}} | 11:29 |
| vdrok | yup | 11:29 |
| dtantsur | which is... wrong? | 11:29 |
| mriedem | dtantsur: ACTIVE? | 11:30 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L176 | 11:30 |
| mriedem | that state checking seems fine | 11:30 |
| mriedem | if it's not available, don't say it is | 11:30 |
| dtantsur | states.ACTIVE is not in good state | 11:30 |
| dtantsur | which is the state we have when we have an instance provisioned | 11:30 |
| *** yamahata has joined #openstack-nova | 11:31 | |
| dtantsur | yeah, but should we return an empty inventory for nodes with an instance? actually, I guess, we should, right | 11:31 |
| mriedem | no idea | 11:31 |
| dtantsur | but maybe instead of an empty dict we should return all values with zeroes? | 11:31 |
| *** sridharg has joined #openstack-nova | 11:31 | |
| dtantsur | mriedem: ^^^ | 11:31 |
| dtantsur | like CUSTOM_FOOBAR=0, VCPU=0, etc? | 11:31 |
| mriedem | we can't report 0 inventory to placement | 11:32 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L752 | 11:32 |
| mriedem | min_unit is minimum of 1 | 11:32 |
| dtantsur | hmmm | 11:32 |
| dtantsur | then the placement indeed has no idea about the new resource class | 11:33 |
| dtantsur | we never return it from virt/ironic | 11:33 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handlers/inventory.py#L39 | 11:33 |
| mriedem | yeah inventory total has to be at least 1 | 11:33 |
| dtantsur | but wait, cannot a hypervisor have 0 free memory, for example? | 11:33 |
| mriedem | dtantsur: is that the chicken and egg? | 11:33 |
| *** tojuvone has joined #openstack-nova | 11:33 | |
| dtantsur | (please pardon my ignorance) | 11:33 |
| *** aloga has joined #openstack-nova | 11:34 | |
| dtantsur | but yes, I suspect we cannot create resource classes for such nodes, because we don't report them back ever | 11:34 |
| * mriedem wishes jaypipes were around | 11:34 | |
| *** brault has quit IRC | 11:35 | |
| mriedem | ok so the node has the resource_class set after there is an instance associated and that's how we migrate the flavor extra spec, | 11:35 |
| * dtantsur wonders if we should call to Placement from within the ironic driver every time we encounter a new node.resource_class | 11:35 | |
| mriedem | but once the instance is associated, the node is in an ACTIVE state which means we don't report inventory for it? | 11:35 |
| dtantsur | correct | 11:35 |
| mriedem | and thus can't auto-create the newly added resource class | 11:35 |
| *** yamamoto has joined #openstack-nova | 11:35 | |
| *** cdent has joined #openstack-nova | 11:36 | |
| mriedem | and that instance <> node is what's already consuming the existing vcpu/memory_mb/disk_gb inventory that we can't delete now | 11:36 |
| mriedem | Aug 11 11:18:56 ubuntu nova-compute[7647]: WARNING nova.scheduler.client.report [None req-267b8c81-5ea5-4e13-9ea8-02354628c37f None None] [req-27dbace7-c527-4f8f-add8-d732047d7382] We c annot delete inventory 'VCPU, MEMORY_MB, DISK_GB' for resource provider 68d57495-2daa-46b3-8e2c-f2f0a19dbaf8 because the inventory is in use. | 11:36 |
| dtantsur | also correct | 11:36 |
| mriedem | heh, yeah, that warning shows up all the time in an ironic ci job run | 11:37 |
| mriedem | http://logs.openstack.org/54/487954/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/041c03a/logs/screen-n-cpu.txt.gz#_Aug_09_19_31_21_252127 | 11:38 |
| mriedem | i'll open a bug for this since i think it's something we haven't considered, obviously | 11:38 |
| dtantsur | yes please | 11:38 |
| dtantsur | mriedem: can we create resource classes in Placement from the ironic driver each time we encounter a new resource_class? | 11:39 |
| dtantsur | or is it a crazy idea for some reason? | 11:39 |
| mriedem | well, | 11:39 |
| *** mdbooth has quit IRC | 11:39 | |
| mriedem | i suppose the idea we return 0 inventory in this case is because there is an instance consuming the node, | 11:39 |
| cdent | i seem to have been disconnected briefly so going back in the log, saw some discussion about trying to report 0 inventory for a ironic node with an instance on it | 11:39 |
| cdent | this is bad | 11:40 |
| mriedem | so we don't want to have the scheduler think there is a node available | 11:40 |
| mriedem | for building a new instance | 11:40 |
| dtantsur | right | 11:40 |
| mriedem | as the node is wholly consumed | 11:40 |
| cdent | the inventory should be whatever the capacity is, and then allocations to cover the instance | 11:40 |
| dtantsur | right, and we cannot return VCPU=0 | 11:40 |
| * dtantsur does not understand why we have min_unit, to be honest | 11:41 | |
| *** sbezverk has joined #openstack-nova | 11:42 | |
| *** mdbooth has joined #openstack-nova | 11:42 | |
| dtantsur | cdent: I tend to agree, I'm not sure why we do it | 11:42 |
| *** slaweq has quit IRC | 11:42 | |
| cdent | it’s not a question of tend to agree. if you’re doing that, it violates the principles of how placement is supposed to work... | 11:43 |
| cdent | min_unit in the ironic case doesn’t make a lot of sense | 11:43 |
| cdent | but for vms where you don’t want to allow people to slice up the host into lots of tiny pieces, it is meaningful | 11:43 |
| dtantsur | cdent: I used "tend to agree" to designate that I do not know Nova well enough, not to question your findings | 11:44 |
| cdent | I didn’t think you were questioning, I was just reinforcing the point: sounds like weird stuff afoot | 11:44 |
| *** shan has quit IRC | 11:44 | |
| dtantsur | ok | 11:45 |
| dtantsur | so | 11:45 |
| *** liverpooler has joined #openstack-nova | 11:45 | |
| dtantsur | should we just fix it to remove min_unit and always return the correct inventory? | 11:45 |
| dtantsur | s/correct/complete/ | 11:45 |
| dtantsur | oh, I think I know why it was done | 11:46 |
| * cdent needs to read the backlog a bit more | 11:46 | |
| cdent | one sec | 11:46 |
| vdrok | so _refresh_cache is called in the driver.get_available_nodes from compute manager's update_available_resource periodic, and we migrate the flavor there. then we call the update_available_resource, which calls get_available_resource. we still include the resoruce_class in the return dict in https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L335. | 11:47 |
| dtantsur | cdent: this is mimicking the old behavior with bare metal nodes. if we always report the complete inventory, e.g. 2Gi of RAM. and there is an instance with 1Gi of RAM. the Placement will think that 1Gi of RAM is still free | 11:47 |
| vdrok | dtantsur: so do you propose to call the placement to create resource class right during the update_available_resource? | 11:47 |
| dtantsur | vdrok: something like that.. but let's figure out the inventory problem first | 11:47 |
| mriedem | https://bugs.launchpad.net/nova/+bug/1710141 | 11:48 |
| openstack | Launchpad bug 1710141 in OpenStack Compute (nova) "Continual warnings in n-cpu logs about being unable to delete inventory for an ironic node with an instance on it" [High,Triaged] | 11:48 |
| mriedem | cdent: dtantsur: vdrok: ^ | 11:48 |
| dtantsur | thanks mriedem | 11:48 |
| *** yamamoto has quit IRC | 11:48 | |
| *** sapd has quit IRC | 11:48 | |
| *** yamamoto has joined #openstack-nova | 11:48 | |
| dtantsur | anyway, cdent, mriedem, wdyt about returning the custom resource class in the inventory *always*, even for occupied nodes? | 11:49 |
| vdrok | dtantsur: I think the reason of having min_unit=0 is because if the resource provider can provide 0 of some resource, it;s not really that resource's provider :) | 11:49 |
| vdrok | err, min_unit=1 | 11:49 |
| *** dikonoor has joined #openstack-nova | 11:49 | |
| vdrok | if that's what you're talking about | 11:49 |
| cdent | dtantsur: are you talking about the get_inventory call in the virt driver? | 11:50 |
| *** sbezverk has quit IRC | 11:50 | |
| *** boolman has joined #openstack-nova | 11:50 | |
| dtantsur | cdent: yes. maybe I should make a DNM patch showing it.. | 11:50 |
| cdent | if the physical hardware hasn’t changed, that should always return the same thing, without regard to presence of an instance | 11:50 |
| *** kristian__ has joined #openstack-nova | 11:51 | |
| cdent | so I think the answer to your question is "yes" | 11:51 |
| mriedem | as cdent pointed out, it seems we should be reporting the inventory regardless of what's allocated on that provider, and let the allocation consume the inventory so the scheduler will ignore it | 11:51 |
| mriedem | i.e. this node has 1 VCPU and that 1 VCPU is consumed, so it's not eligible for building another instance | 11:51 |
| *** yuchenghui has joined #openstack-nova | 11:52 | |
| boolman | hi peeps, Can I disable local disk on hypervisors? eg: openstack server create --image xenial --security-group default --key-name emil --network backend --flavor smallish demo -- currently this creates the instance on local disk on the hypervisors | 11:52 |
| mriedem | boolman: you'd have to use a volume | 11:52 |
| boolman | since I'm using ceph rbd storage i want to force that | 11:52 |
| openstackgerrit | Dmitry Tantsur proposed openstack/nova master: DNM PoC for fixing ironic with resource classes https://review.openstack.org/492964 | 11:52 |
| dtantsur | cdent, mriedem, something like ^^^ | 11:52 |
| mriedem | boolman: boot from volume that deletes on termination | 11:52 |
| openstackgerrit | Chris Dent proposed openstack/nova master: Optional separate database for placement API https://review.openstack.org/362766 | 11:52 |
| *** priteau has joined #openstack-nova | 11:53 | |
| *** priteau has quit IRC | 11:53 | |
| boolman | mriedem: so I can't actually disable local disk? the user have to create a volume to use when creating the instance? | 11:53 |
| *** vks1 has quit IRC | 11:53 | |
| mriedem | dtantsur: i'm not sure that will work, i'd expect the PUT /resource_providers/uuid/inventories to fail to remove the inventory for the vcpu/memory_mb/disk_gb because it's already being used | 11:54 |
| mriedem | it would auto-create the custom resource class though, | 11:54 |
| mriedem | if that's your aim | 11:54 |
| *** lucasagomes is now known as lucas-hungry | 11:54 | |
| dtantsur | mriedem: it already fails at removing the inventory. I'm trying to fix auto-creation for now | 11:54 |
| mriedem | boolman: you could use the rbd imagebackend on the compute so your computes are shared a ceph pool of disk | 11:54 |
| mriedem | if you don't want local being used | 11:54 |
| mriedem | *sharing | 11:54 |
| *** yamamoto has quit IRC | 11:55 | |
| mriedem | dtantsur: yeah, this is just probably not the way to do this i don't think | 11:55 |
| boolman | mriedem: you mean by modifying the pool in virsh? | 11:55 |
| mriedem | it's super tightly coupled to knowing exactly how the inventory is used by the RT and the report client | 11:55 |
| mriedem | boolman: see http://lists.openstack.org/pipermail/openstack-dev/2017-May/117012.html | 11:56 |
| dtantsur | mriedem: but isn't it the correct thing to do? I mean, always return the inventory of this custom resource class? | 11:56 |
| *** yamamoto has joined #openstack-nova | 11:57 | |
| dtantsur | (given that we will remove the hacks around VCPU and friends in Queens) | 11:57 |
| mriedem | sdague: docs migration annoyance of the day, | 11:57 |
| mriedem | when i search for things in the nova docs now, they search all of docs.o.o | 11:57 |
| cdent | dtantsur: the issue is that if there is already inventory in use that is based on vcpus, then you won’t be able to change the inventory | 11:57 |
| mriedem | not just the nova docs | 11:57 |
| dtantsur | cdent: why should I? | 11:57 |
| cdent | as I read that code you are trying to replace existin inventory, but maybe I’m not understanding? | 11:58 |
| dtantsur | okay, we're trying to solve two problems at the same time: | 11:58 |
| mriedem | boolman: no i'm talking about this https://github.com/openstack/nova/blob/master/nova/conf/libvirt.py#L631 | 11:58 |
| dtantsur | 1. broken ironic scheduling with custom resource classes | 11:58 |
| vdrok | dtantsur: you mean something like http://paste.openstack.org/show/618161/ | 11:58 |
| vdrok | ? | 11:58 |
| *** yuchenghui has quit IRC | 11:58 | |
| dtantsur | 2. warning on trying to delete the inventory, because we stop reporting it correctly | 11:58 |
| dtantsur | I'm trying to fix #1 first, as it's a hard blocker for this work | 11:58 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/virt/libvirt/imagebackend.py#L788 | 11:58 |
| dtantsur | vdrok: yes, see the DNM patch I posted above | 11:59 |
| cdent | okay, let’s dismiss #2 entirely for a moment | 11:59 |
| boolman | mriedem: ok thanks, will try that | 11:59 |
| vdrok | dtantsur: ah, right, /me is slow :) | 11:59 |
| dtantsur | cdent: so, I think we all agree that our get_inventory is incorrect. We cannot fix it at once, because of the nature of bare metal nodes. we can fix reporting the custom resource class, and just wait for VCPU handling to be removed in Queens completely. Does it make more sense? | 12:00 |
| cdent | dtantsur: can’t you point me at some irc or test logs where the #1 problem is explained or demonstrated? | 12:00 |
| mriedem | cdent: that's in https://bugs.launchpad.net/nova/+bug/1710141 | 12:01 |
| openstack | Launchpad bug 1710141 in OpenStack Compute (nova) "Continual warnings in n-cpu logs about being unable to delete inventory for an ironic node with an instance on it" [High,Triaged] | 12:01 |
| cdent | dtantsur: your dnm code is create an entire new inventory, with just the resource class set | 12:01 |
| cdent | thanks mriedem | 12:01 |
| *** sapd has joined #openstack-nova | 12:01 | |
| dtantsur | I think this bug is about #2, not #1 | 12:01 |
| mriedem | they are related | 12:01 |
| *** yuchenghui has joined #openstack-nova | 12:01 | |
| mriedem | cdent: dtantsur has a patch up in ironic to set a custom resource class on the node and then create an instance on that node, but that's failing here http://logs.openstack.org/68/476968/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/02053cf/logs/screen-n-sch.txt.gz#_Aug_09_20_35_41_533621 | 12:02 |
| mriedem | during scheduling, because the custom resource class doesn't exist, and nova never creates it | 12:02 |
| mriedem | nova never gets inventory off the node | 12:02 |
| mriedem | dtantsur: that does confuse me though, are we racing? | 12:02 |
| mriedem | wouldn't nova-compute need to report the node before the scheduler could use it anyway? | 12:02 |
| dtantsur | mriedem: this is during a migration from resource_class=None to resource_class=something | 12:03 |
| dtantsur | so the resource class was never reported | 12:03 |
| mriedem | dtantsur: yeah but in that log ^ there was never an instance created yet i don't tihnk | 12:03 |
| dtantsur | ok, so we have 3 problems :) | 12:03 |
| cdent | :) | 12:03 |
| mriedem | basically, when does the driver report that there are available nodes? | 12:03 |
| mriedem | b/c once it does, then we pull inventory from those nodes and put that in placement | 12:04 |
| mriedem | which the scheduler will use to create an instance | 12:04 |
| dtantsur | it polls ironic once in IIRC 2 minutes | 12:04 |
| dtantsur | so there is some space for a race indeed | 12:04 |
| * dtantsur thinks of getting an etherpad with all the findings | 12:04 | |
| mriedem | but how would this not fail all of the ironic ci jobs that use nova to create instances? | 12:04 |
| aarefiev | dtantsur: but we report empty inventory, right https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L741 | 12:05 |
| mriedem | regardless of the resource class stuff | 12:05 |
| dtantsur | mriedem: we used to wait for 'nova hypervisor-stats' to show available CPUS > 0 | 12:05 |
| mriedem | dtantsur: and you're not now? | 12:05 |
| *** egonzalez has joined #openstack-nova | 12:05 | |
| dtantsur | mriedem: that patch tries not reporting VCPU any more | 12:05 |
| dtantsur | maybe it's a bit premature | 12:06 |
| mriedem | ok, so we don't wait for the compute node to be registered in nova-compute, | 12:06 |
| mriedem | and try to create the instance, | 12:06 |
| mriedem | and since we didn't wait, we don't have the resource class created yet | 12:06 |
| mriedem | and we NoValidHost | 12:06 |
| mriedem | like a champ | 12:06 |
| dtantsur | right, maybe a wait loop until we get something in placement (hence my question about its CLI) solves it | 12:06 |
| sdague | mriedem: yes, not just all of docs.o.o, also ask.o.o | 12:06 |
| sdague | mriedem: that's definitely an issue | 12:07 |
| *** ioggstream has quit IRC | 12:07 | |
| sdague | mriedem: going to have to be brought up at PTG I think | 12:07 |
| cdent | dtantsur: placement is so easy to curl that no one has bothered yet | 12:07 |
| *** yuchenghui has quit IRC | 12:07 | |
| mriedem | sdague: complaining in -doc | 12:07 |
| mriedem | cdent: there have been unmerged patches | 12:08 |
| mriedem | cdent: https://review.openstack.org/#/q/project:openstack/osc-placement | 12:08 |
| cdent | mriedem: yes, I know | 12:08 |
| mriedem | ok | 12:08 |
| cdent | i’m one of the few reviewers on those patches, and mentioned them for several months on the rp update weekly messages and finally stopped when no one was reviewing | 12:08 |
| cdent | because I assumed nobody cared | 12:08 |
| mriedem | :( | 12:08 |
| *** thorst has joined #openstack-nova | 12:08 | |
| cdent | :( is right | 12:08 |
| mriedem | once we want to start integrating them into CI, people will care | 12:09 |
| mriedem | well, dev people | 12:09 |
| *** markvoelker_ has joined #openstack-nova | 12:10 | |
| cdent | dtantsur, mriedem: so do you think you’ve gotten past at least a first hurdle with the conceptual wait loop? If so, once that’s cleared out, I’d like eventually to come back to this issue of reporting or not report inventory for nodes that have instances on them | 12:10 |
| dtantsur | folks, I've dumped my/our findings on https://etherpad.openstack.org/p/nova-ironic-resource-class-migration | 12:10 |
| dtantsur | I cannot keep so much in my head :) | 12:10 |
| cdent | good idea | 12:10 |
| cdent | if we merge this those silly html error responses (in the pastes there) will go away: https://review.openstack.org/#/c/489772/ | 12:11 |
| *** ratailor has quit IRC | 12:13 | |
| mriedem | so like this http://logs.openstack.org/72/489772/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/655a0b3/logs/screen-n-cpu.txt.gz?level=TRACE#_Aug_02_12_12_16_584946 | 12:13 |
| *** markvoelker has quit IRC | 12:13 | |
| cdent | mriedem: yeah, no line feeds... | 12:14 |
| *** dikonoor has quit IRC | 12:15 | |
| *** dikonoor has joined #openstack-nova | 12:16 | |
| *** phealy has joined #openstack-nova | 12:16 | |
| mriedem | like this http://logs.openstack.org/85/490085/7/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/5835515/logs/screen-n-cpu.txt.gz?level=TRACE#_Aug_03_15_47_53_683694 | 12:16 |
| cdent | right | 12:16 |
| *** mwhahaha has quit IRC | 12:19 | |
| *** zioproto has quit IRC | 12:19 | |
| *** TheJulia has quit IRC | 12:19 | |
| *** betherly has quit IRC | 12:19 | |
| *** TheJulia has joined #openstack-nova | 12:19 | |
| *** gouthamr has joined #openstack-nova | 12:19 | |
| *** zioproto has joined #openstack-nova | 12:19 | |
| *** betherly has joined #openstack-nova | 12:20 | |
| *** mwhahaha has joined #openstack-nova | 12:20 | |
| *** gongysh has joined #openstack-nova | 12:20 | |
| *** gongysh has quit IRC | 12:20 | |
| *** clayton has quit IRC | 12:21 | |
| *** lpetrut has joined #openstack-nova | 12:22 | |
| *** rtjure has quit IRC | 12:23 | |
| *** efried is now known as fried_rice | 12:23 | |
| cdent | dtantsur: so currently plan is is wait and see how https://review.openstack.org/#/c/476968/ turns out? | 12:23 |
| *** clayton has joined #openstack-nova | 12:24 | |
| mriedem | sdague: http://lists.openstack.org/pipermail/openstack-dev/2017-August/121042.html | 12:24 |
| dtantsur | cdent: this is the plan for #1. for #2 and #3, I can try fixing get_inventory indeed. | 12:24 |
| *** dave-mccowan has joined #openstack-nova | 12:25 | |
| cdent | dtantsur: let me know if there’s something I can help with | 12:25 |
| dtantsur | sure, thanks! | 12:25 |
| *** libin_ has quit IRC | 12:25 | |
| *** rtjure has joined #openstack-nova | 12:26 | |
| *** libin_ has joined #openstack-nova | 12:26 | |
| * bauzas back | 12:26 | |
| *** baoli has quit IRC | 12:27 | |
| *** xyang1 has joined #openstack-nova | 12:29 | |
| openstackgerrit | OpenStack Release Bot proposed openstack/nova master: Update reno for stable/pike https://review.openstack.org/492982 | 12:29 |
| *** catintheroof has joined #openstack-nova | 12:30 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/nova master: DNM PoC for fixing ironic with resource classes https://review.openstack.org/492964 | 12:32 |
| dtantsur | cdent: something like ^^^? | 12:32 |
| dtantsur | mriedem: ^^ | 12:33 |
| * cdent looks | 12:34 | |
| boolman | mriedem: ok I got it to work now, thanks | 12:34 |
| *** gongysh has joined #openstack-nova | 12:35 | |
| *** lyan has joined #openstack-nova | 12:37 | |
| dtantsur | vdrok: mind testing again with my patch above? | 12:37 |
| cdent | dtantsur: yes. Was there some additional thing to do to make sure that get_inventory gets called often enough? I’m guessing (giving the log messages) that that’s not a problem? | 12:38 |
| vdrok | dtantsur: ok, will do | 12:38 |
| dtantsur | cdent: I'm not sure, let's see how it looks for vdrok | 12:38 |
| vdrok | yeah, after instance deletion we'll have some time window when the resources reported by placement will be incorrect | 12:38 |
| cdent | ✔ | 12:38 |
| *** kylek3h has joined #openstack-nova | 12:38 | |
| * cdent gazes in wide wonder at the miracle of rc1 | 12:40 | |
| sdague | mriedem: I'll see if I can hack around it | 12:40 |
| dtantsur | once we get custom resource classes to work with ironic, we can ask operators to upgrade. then they won't see issues with VCPU reporting.. | 12:41 |
| *** mingyu has quit IRC | 12:43 | |
| cdent | biab | 12:44 |
| *** cdent has quit IRC | 12:44 | |
| bauzas | mriedem: dtantsur: could you please tl;dr the issues with ironic ? | 12:46 |
| bauzas | and how I could help ? | 12:46 |
| bauzas | tons of channel logs :) | 12:47 |
| *** ioggstream has joined #openstack-nova | 12:47 | |
| dtantsur | bauzas: this is the tl;dr https://etherpad.openstack.org/p/nova-ironic-resource-class-migration | 12:48 |
| bauzas | excellent, thanks | 12:48 |
| *** ioggstream has quit IRC | 12:52 | |
| *** edleafe is now known as figleaf | 12:53 | |
| vdrok | dtantsur: see comment | 12:54 |
| vdrok | right now requests to placement fail | 12:54 |
| vdrok | because of max_unit=0 | 12:54 |
| *** jpena|off is now known as jpena | 12:54 | |
| dtantsur | ugh, right | 12:54 |
| openstackgerrit | Dmitry Tantsur proposed openstack/nova master: PoC for fixing ironic with resource classes https://review.openstack.org/492964 | 12:55 |
| dtantsur | vdrok: please try ^^^ | 12:55 |
| vdrok | yup | 12:55 |
| * dtantsur gets food, brb | 12:56 | |
| *** jaypipes has joined #openstack-nova | 12:57 | |
| *** ioggstream has joined #openstack-nova | 12:57 | |
| *** gbarros has joined #openstack-nova | 12:59 | |
| *** jaypipes has quit IRC | 13:00 | |
| *** jaypipes has joined #openstack-nova | 13:00 | |
| *** mpaolino has joined #openstack-nova | 13:03 | |
| *** lucas-hungry is now known as lucasagomes | 13:05 | |
| *** yangyapeng has joined #openstack-nova | 13:07 | |
| *** lyan has quit IRC | 13:07 | |
| *** MVenesio has joined #openstack-nova | 13:07 | |
| *** iogg has joined #openstack-nova | 13:08 | |
| *** ioggstream has quit IRC | 13:08 | |
| *** sbezverk has joined #openstack-nova | 13:10 | |
| vdrok | dtantsur: mriedem with https://review.openstack.org/492964 seems to work fine http://paste.openstack.org/show/618171/ | 13:10 |
| vdrok | will now look at what's in the nova_api db | 13:10 |
| *** dikonoo has joined #openstack-nova | 13:11 | |
| *** yangyapeng has quit IRC | 13:11 | |
| figleaf | wow, it usually takes me 5 minutes to read the overnight scrollback. Today it was more like 20 | 13:13 |
| *** egonzalez has quit IRC | 13:13 | |
| *** MVenesio has quit IRC | 13:13 | |
| *** MVenesio has joined #openstack-nova | 13:13 | |
| figleaf | so... anything I can pitch in and help with right now? | 13:14 |
| *** josecastroleon has joined #openstack-nova | 13:15 | |
| *** dikonoor has quit IRC | 13:15 | |
| *** lyan has joined #openstack-nova | 13:15 | |
| mriedem | vdrok: yeah i suppose that's why we get here now | 13:16 |
| mriedem | Aug 11 13:07:03 ubuntu nova-compute[11924]: DEBUG nova.scheduler.client.report [None req-b88f01be-3920-4bc0-8708-b96b4f9e8aa7 None None] Updated inventory for 935678ef-67b2-440d-8190-875fb6dea1c6 at generation 3 {{(pid=11924) _update_inventory_attempt /opt/stack/nova/nova/scheduler/client/report.py:652}} | 13:16 |
| mriedem | figleaf: https://etherpad.openstack.org/p/nova-ironic-resource-class-migration | 13:16 |
| *** egonzalez has joined #openstack-nova | 13:16 | |
| vdrok | dtantsur: mriedem what's in nova_api seems to be correct, instance_extra.flavor too, but see this http://paste.openstack.org/show/618173/ | 13:16 |
| figleaf | mriedem: yeah, got that open already | 13:16 |
| vdrok | namely, negative free values in compute_nodes | 13:16 |
| mriedem | vdrok: that might be a latent problem? | 13:16 |
| mriedem | i never look at hypervisor-stats, especially for ironic | 13:17 |
| vdrok | mriedem: might be yeah | 13:17 |
| vdrok | I'll try to boot another instance | 13:17 |
| mriedem | vdrok: https://bugs.launchpad.net/nova/+bug/1699947 ? | 13:17 |
| openstack | Launchpad bug 1699947 in OpenStack Compute (nova) "nova hypervisor-stats/hypervisor-show shows wrong resource usage for baremetal node" [Low,Confirmed] | 13:17 |
| vdrok | yup, that is an old one :) | 13:17 |
| *** mingyu has joined #openstack-nova | 13:18 | |
| *** baoli has joined #openstack-nova | 13:18 | |
| *** mingyu has quit IRC | 13:18 | |
| *** cdent has joined #openstack-nova | 13:18 | |
| *** randomhack has joined #openstack-nova | 13:18 | |
| vdrok | ok, scheduling seems to work fine too | 13:18 |
| *** oanson has quit IRC | 13:19 | |
| *** mingyu has joined #openstack-nova | 13:19 | |
| *** mingyu has quit IRC | 13:19 | |
| *** oanson has joined #openstack-nova | 13:19 | |
| dtantsur | sweet! thanks for testing vdrok :) | 13:20 |
| dtantsur | so, what are the next steps? wait for the CI, check that the warning is gone, then write some unit tests and merge? | 13:21 |
| *** lyan has quit IRC | 13:21 | |
| *** bhagyashris has quit IRC | 13:22 | |
| dtantsur | mriedem: do you think it will still try to delete the allocation? | 13:23 |
| *** randomhack has quit IRC | 13:23 | |
| *** randomhack has joined #openstack-nova | 13:23 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: doc: add another up-call caveat for cells v2 for xenapi aggregates https://review.openstack.org/493006 | 13:25 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: doc: add superconductor up-call caveat for cross_az_attach=False https://review.openstack.org/493007 | 13:25 |
| mriedem | dansmith: melwitt: ^ superconductor up-call limitations for the docs - i found another one today | 13:25 |
| mriedem | dtantsur: you mean the inventory? | 13:25 |
| dtantsur | mriedem: yes. sorry, tired already :) | 13:25 |
| *** awaugama has joined #openstack-nova | 13:25 | |
| dtantsur | Friday is not the best day to debug Nova :) | 13:26 |
| mriedem | dtantsur: no because inv_data will not be empty https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L779 | 13:26 |
| dtantsur | mriedem: right, so the warning should be gone, no? we won't try to delete it, just update? | 13:26 |
| mriedem | dtantsur: i'd expect to get a 409 response from placement here https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L566 | 13:27 |
| mriedem | dtantsur: plus, that doesn't really fix the bug that exists in ocata already, because your fix would only bypass the delete_inventory path iff there is a node.resource_class set | 13:27 |
| mriedem | dtantsur: in other words, i think there are two bugs | 13:27 |
| dtantsur | the 4th problems \o/ | 13:28 |
| dtantsur | should I mark it as Related-Bug then? | 13:28 |
| mriedem | the one i reported about the warnings is latent, and exists in ocata | 13:28 |
| mriedem | dtantsur: that would be ok probably | 13:28 |
| mriedem | i.e. in ocata, if i've got a baremetal env, i'm going to see these warnings in n-cpu every 60 seconds for all nodes | 13:28 |
| mriedem | for all *consumed* nodes | 13:28 |
| mriedem | which is annoying | 13:28 |
| dtantsur | mriedem: wait, why? we no longer return an empty inventory for valid nodes. we return an inventory with s/vcpus/vcpus_used/. I think we can backport it to Ocata even | 13:29 |
| * dtantsur sees jaypipes lurking | 13:30 | |
| dtantsur | jaypipes: hi, you may want to join the party :) | 13:30 |
| mriedem | oh i see | 13:30 |
| mriedem | i hadn't seen the latest patch https://review.openstack.org/#/c/492964/3/nova/virt/ironic/driver.py | 13:30 |
| *** udesale has joined #openstack-nova | 13:30 | |
| dtantsur | ah! | 13:30 |
| jaypipes | dtantsur: what kind of party? ;) | 13:30 |
| dtantsur | jaypipes: an ironic party! | 13:30 |
| *** jaypipes is now known as leakypipes | 13:30 | |
| dtantsur | leakypipes: https://etherpad.openstack.org/p/nova-ironic-resource-class-migration | 13:31 |
| mriedem | dtantsur: yeah that might just work | 13:32 |
| dtantsur | okay, let's wait for Jenkins | 13:32 |
| *** esberglu has joined #openstack-nova | 13:33 | |
| mriedem | ok so the *_used values for inventory will/should match in placement what we have consumed for allocations on that node provider | 13:34 |
| mriedem | so we shouldn't try to remove any inventory, and thus avoid the 409, | 13:34 |
| mriedem | and create the custom resource class when it's added to the node, | 13:34 |
| cdent | that’s the hoe | 13:34 |
| mriedem | and take the node out of scheduling decisions since inventory == allocation | 13:34 |
| cdent | hope | 13:34 |
| *** suresh12 has joined #openstack-nova | 13:34 | |
| mriedem | who you callin a ho | 13:34 |
| mriedem | ?! | 13:34 |
| dtantsur | LOOOL | 13:34 |
| cdent | hoe for capitalism | 13:35 |
| dtantsur | but yeah, this is the plan | 13:35 |
| *** vladikr has quit IRC | 13:36 | |
| *** suresh12 has quit IRC | 13:40 | |
| *** diga_ has quit IRC | 13:41 | |
| cdent | gibi is an evolved tool user. on https://review.openstack.org/#/c/491529/ are you saying you think you found a bug in shelve/unshelve itself, or in the tests? | 13:42 |
| *** weshay is now known as weshay_doc | 13:43 | |
| *** hongbin has joined #openstack-nova | 13:44 | |
| * dtantsur wonders why "tox -epy27 -- -r ironic" does not work for nova.. | 13:44 | |
| cdent | dtantsur: because it has been shortcutted: tox -epy27 ironic | 13:44 |
| gibi | cdent: I think it is in the shelve/unshelve | 13:45 |
| gibi | cdent: but I'm still busy with the evacuation fix | 13:45 |
| cdent | gibi: go you. your powers are strong. | 13:45 |
| dtantsur | awesome, thanks cdent | 13:45 |
| gibi | cdent: after I pushed the evac fix I can create a shelve/unshelve test | 13:46 |
| * cdent writes a short rp update | 13:46 | |
| *** takedakn has joined #openstack-nova | 13:46 | |
| cdent | there’s loads of random code floating around | 13:46 |
| *** jmlowe_ has joined #openstack-nova | 13:47 | |
| *** jpena is now known as jpena|off | 13:48 | |
| *** jmlowe has quit IRC | 13:49 | |
| mriedem | afk for a bit | 13:49 |
| *** lyan has joined #openstack-nova | 13:49 | |
| *** lyan has quit IRC | 13:51 | |
| *** _pewp_ has quit IRC | 13:52 | |
| *** markvoelker_ has quit IRC | 13:52 | |
| *** suresh12 has joined #openstack-nova | 13:53 | |
| *** lucasxu has joined #openstack-nova | 13:54 | |
| *** felipemonteiro has joined #openstack-nova | 13:55 | |
| *** _pewp_ has joined #openstack-nova | 13:55 | |
| *** Oku_OS is now known as Oku_OS-away | 13:56 | |
| *** randomhack has quit IRC | 14:00 | |
| *** lyan has joined #openstack-nova | 14:03 | |
| *** trinaths has joined #openstack-nova | 14:03 | |
| *** mvk_ has joined #openstack-nova | 14:06 | |
| *** pchavva has joined #openstack-nova | 14:07 | |
| *** yangyapeng has joined #openstack-nova | 14:08 | |
| *** mvk has quit IRC | 14:08 | |
| *** yangyapeng has quit IRC | 14:12 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/nova master: Fix reporting inventory for the Ironic driver https://review.openstack.org/492964 | 14:12 |
| dtantsur | cdent, mriedem, bauzas, cleaned up version of my patch ^^^ | 14:12 |
| * cdent reads | 14:12 | |
| dtantsur | aaaaand the patch using resource classes has passed CI: https://review.openstack.org/#/c/476968/ | 14:13 |
| dtantsur | bauzas: you may want to check it for logging ^^^ | 14:13 |
| * cdent recommends today’s google doodle as a nice break from today’s chaos | 14:17 | |
| *** sambetts is now known as sambetts|afk | 14:21 | |
| *** psachin has quit IRC | 14:24 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use ksa adapter for placement conf & requests https://review.openstack.org/492247 | 14:25 |
| *** mdavidson has quit IRC | 14:26 | |
| bauzas | dtantsur: cdent: mriedem: sorry in an internal meeting atm | 14:26 |
| bauzas | sdague: I could have a stupid question but worth asking | 14:27 |
| bauzas | sdague: if someone reports an issue only appearing with an old microversion, I guess we still have to fix it ? | 14:27 |
| bauzas | sdague: the context being that if using a recent microversion, the flag that was creating that bug is no longer supported | 14:28 |
| sdague | bauzas: it depends | 14:29 |
| dansmith | mriedem: is the az not available to compute via the requestspec or something like that? | 14:29 |
| dansmith | mriedem: if not, that would be a simpler fix than the moving of things to conductor | 14:29 |
| sdague | bauzas: can you be more specific with the bug | 14:29 |
| *** Drankis has quit IRC | 14:30 | |
| bauzas | sdague: related point, while novaclient tries to use the latest microversion the server can support (capped by its own max version), it seems OSC just tries to use v2.1 | 14:30 |
| bauzas | sdague: that's an internal BZ that was popped up | 14:30 |
| sdague | yes, osc does work differently | 14:30 |
| *** armax has joined #openstack-nova | 14:31 | |
| sdague | I don't know the current status of osc microversion support | 14:31 |
| bauzas | sdague: but tl,dr: since 2.25 we are now no longer accepting disk_over_commit, which is generating some HTTP400 if you use it with older versions | 14:31 |
| *** takedakn has quit IRC | 14:32 | |
| leakypipes | dansmith: I thought you were vacationing, superdan? :) | 14:32 |
| sdague | bauzas: you are really going to have to get a bug filed | 14:32 |
| dansmith | leakypipes: inlaw visits are not vacation | 14:32 |
| leakypipes | ah | 14:32 |
| leakypipes | tru nuf | 14:32 |
| bauzas | sdague: yeah will do | 14:32 |
| sdague | because is that a regression? | 14:33 |
| bauzas | sdague: but needs to check the internal bug with novaclient first | 14:33 |
| bauzas | sdague: that's a mitaka bug from waht I know | 14:33 |
| bauzas | sdague: but I need to do more coverage before filling the buig | 14:33 |
| *** itlinux has joined #openstack-nova | 14:34 | |
| dansmith | mriedem: +2 on both of those doc patches | 14:34 |
| sdague | yeh, I mean, clearly mitaka is no longer upstream supported, so there is that. But the point is if there is a regression, a regression should be fixed. But if it was always that way, and new microversions make it fine, I'd err on the side that we don't touch it | 14:34 |
| * dansmith feels like he made himself useful | 14:34 | |
| *** mdavidson has joined #openstack-nova | 14:35 | |
| *** udesale has quit IRC | 14:37 | |
| *** vks1 has joined #openstack-nova | 14:38 | |
| cfriesen | does anyone know if libvirt/qemu supports block live migration with a config drive but with instance storage on a ceph volume? | 14:41 |
| bauzas | sdague: sure, that's why I need to do further tests against master before filling the bug | 14:43 |
| *** coreywright_ has quit IRC | 14:44 | |
| *** yangyapeng has joined #openstack-nova | 14:44 | |
| *** kristian__ has quit IRC | 14:46 | |
| mriedem | dansmith: during boot from volume it might be | 14:48 |
| mriedem | but, | 14:48 |
| mriedem | not really sure, as the az for the host wouldn't be known until we know the host, and i don't know if we update the request spec after that | 14:49 |
| mriedem | that's a bauzas question | 14:49 |
| mriedem | dansmith: btw, good morning sleepy head! | 14:49 |
| *** zhouyaguo has joined #openstack-nova | 14:51 | |
| cfriesen | question....if a compute node is using RBD for instance disks, would we expect it to use RBD for the config drive as well? | 14:53 |
| *** crushil has joined #openstack-nova | 14:54 | |
| *** sbezverk has quit IRC | 14:54 | |
| *** felipemonteiro_ has joined #openstack-nova | 14:55 | |
| *** felipemonteiro has quit IRC | 14:55 | |
| *** sbezverk has joined #openstack-nova | 14:55 | |
| *** rcernin has quit IRC | 14:57 | |
| *** coreywright_ has joined #openstack-nova | 14:57 | |
| dansmith | mriedem: lol | 14:58 |
| *** thingee_ has joined #openstack-nova | 14:58 | |
| leakypipes | cfriesen: I don't think so. I think config drives are always iso9660, no? and local to the compute node? | 14:58 |
| dansmith | leakypipes: no | 14:58 |
| dansmith | leakypipes: can be vfat | 14:58 |
| leakypipes | dansmith: no? | 14:58 |
| leakypipes | ah | 14:58 |
| dansmith | and can also be on ceph I think | 14:58 |
| leakypipes | oh, well, cfriesen I don't know anything then :) | 14:58 |
| * leakypipes slinks away, suitably humbled. | 14:59 | |
| dansmith | I just came here to humble leakypipes | 14:59 |
| leakypipes | Mission Accomplished. :P | 14:59 |
| fried_rice | mtreinish About to restack - any update? | 15:00 |
| *** dikonoo has quit IRC | 15:02 | |
| mriedem | dansmith: leakypipes: don't forget the config drive can be on scaleio and is then 8GB | 15:04 |
| dansmith | mriedem: right that's how I know :) | 15:04 |
| mtreinish | fried_rice: not really, I'm still hitting the same issue | 15:04 |
| bauzas | mriedem: dansmith: in a meeting atm, how can I help ? | 15:04 |
| mtreinish | fried_rice: I've got another devstack setup locally and I'm trying different config permutations. I feel like I've gone back 2 months because I was debugging the same thing back when we originally added glance support | 15:05 |
| fried_rice | mtreinish You're not needing to restack every time, right? Just muck with some confs, restart some services, and try the image create again? | 15:06 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: test server evacuation with placement https://review.openstack.org/492548 | 15:06 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: delete allocation of evacuated instance https://review.openstack.org/493037 | 15:06 |
| mtreinish | fried_rice: yeah | 15:07 |
| fried_rice | cool | 15:07 |
| fried_rice | mtreinish Let me know if there's anything I can do to help. | 15:07 |
| *** claudiub has joined #openstack-nova | 15:09 | |
| *** mpaolino has quit IRC | 15:09 | |
| *** bswartz has joined #openstack-nova | 15:09 | |
| mtreinish | fried_rice: well I at least figured out why I thought it worked before. The config I have up there now drops the chunked data on the floor. (when you talk to uwsgi directly instead of going through the proxy) | 15:12 |
| mtreinish | so the request gets a good response, but the data isn't actually used | 15:13 |
| fried_rice | mtreinish Hah, so I would get a zero-size image, or better yet, a full-sized image full of zeros? | 15:13 |
| mtreinish | heh, it's a zero size image | 15:13 |
| mtreinish | I think the 502s from apache are it realizes the request isn't being properly handled and bails out | 15:14 |
| *** annegentle has joined #openstack-nova | 15:14 | |
| *** Dinesh_Bhor has quit IRC | 15:15 | |
| *** dklyle has joined #openstack-nova | 15:15 | |
| *** david-lyle has quit IRC | 15:15 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Update api doc with latest updates in api framework https://review.openstack.org/493041 | 15:18 |
| vdrok | sdague: mriedem could you also take a look at https://review.openstack.org/492579 if you have a bit of time? This is fixing https://bugs.launchpad.net/nova/ocata/+bug/1706772 we are seeing sometimes on the ocata grenade job, as placement start triggers reload of apache, so keystone becomes inaccessible and n-cpu fails to start | 15:21 |
| openstack | Launchpad bug 1706772 in OpenStack Compute (nova) ocata "InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver" [Medium,In progress] - Assigned to Matt Riedemann (mriedem) | 15:21 |
| *** karthiks has quit IRC | 15:23 | |
| *** mvk has joined #openstack-nova | 15:24 | |
| openstackgerrit | Merged openstack/nova master: Deprecate bare metal filters https://review.openstack.org/492563 | 15:24 |
| sdague | vdrok: ok, as a backport | 15:25 |
| *** mvk_ has quit IRC | 15:25 | |
| vdrok | sdague: yup, thanks! | 15:26 |
| *** jaosorior has quit IRC | 15:27 | |
| openstackgerrit | Merged openstack/nova master: Update reno for stable/pike https://review.openstack.org/492982 | 15:27 |
| *** baoli has quit IRC | 15:28 | |
| *** dikonoo has joined #openstack-nova | 15:29 | |
| *** mvk has quit IRC | 15:29 | |
| *** mvk has joined #openstack-nova | 15:29 | |
| *** gyee has joined #openstack-nova | 15:30 | |
| *** baoli has joined #openstack-nova | 15:30 | |
| dtantsur | mriedem: can/should I request a backport for https://review.openstack.org/492563 now? | 15:33 |
| *** dikonoo has quit IRC | 15:33 | |
| *** ociuhandu has joined #openstack-nova | 15:34 | |
| bauzas | folks, time to hang up for a couple of weeks | 15:36 |
| cdent | enjoy the time bauzas | 15:36 |
| bauzas | gentle reminder, I'll be back on 31st of August | 15:36 |
| figleaf | bauzas: thanks for helping with https://review.openstack.org/487954 overnight | 15:36 |
| dtantsur | bauzas: enjoy! | 15:36 |
| figleaf | bauzas: and have a great holiday! | 15:36 |
| *** chyka has joined #openstack-nova | 15:37 | |
| bauzas | figleaf: dtantsur: cdent: appreciated, both your warm comments and your help during that very difficult release | 15:37 |
| bauzas | see ya | 15:37 |
| *** bauzas is now known as bauzas_afk | 15:37 | |
| bauzas_afk | figleaf: uh, actually, thanks for the reminder, will remove my -W now | 15:38 |
| *** sahid has quit IRC | 15:39 | |
| *** chyka_ has joined #openstack-nova | 15:41 | |
| *** dikonoo has joined #openstack-nova | 15:42 | |
| figleaf | bauzas_afk: thx | 15:42 |
| *** chyka has quit IRC | 15:43 | |
| *** chyka has joined #openstack-nova | 15:45 | |
| *** itlinux has quit IRC | 15:46 | |
| *** chyka_ has quit IRC | 15:46 | |
| *** aarefiev is now known as aarefiev_afk | 15:47 | |
| *** dtp has joined #openstack-nova | 15:48 | |
| openstackgerrit | Merged openstack/nova master: doc: add another up-call caveat for cells v2 for xenapi aggregates https://review.openstack.org/493006 | 15:49 |
| openstackgerrit | Merged openstack/nova master: doc: add superconductor up-call caveat for cross_az_attach=False https://review.openstack.org/493007 | 15:50 |
| mriedem | dtantsur: to stable/pike? | 15:51 |
| dtantsur | mriedem: yeah | 15:51 |
| mriedem | um, idk | 15:51 |
| mriedem | didn't realize that merged | 15:52 |
| dtantsur | the problem is that these filters will be unusable with ironic in Queens | 15:52 |
| dtantsur | so deprecating them in Pike is IMO fair | 15:53 |
| dtantsur | I've proposed the backport in https://review.openstack.org/#/c/493052/ and will leave it up to you | 15:53 |
| mriedem | dtantsur: i see in the ironic release notes that resource_class can't be changed on an active node https://docs.openstack.org/releasenotes/ironic/unreleased.html | 15:54 |
| mriedem | but don't see anything saying resource_class is required | 15:54 |
| dtantsur | mriedem: it's on the way: https://review.openstack.org/491773 | 15:55 |
| mriedem | and wouldn't setting a resource_class be required for compute scheduling? or maybe that's just a requirement on the nova side, and not for standalone ironic | 15:55 |
| mriedem | ah | 15:55 |
| *** suresh12 has quit IRC | 15:57 | |
| *** Apoorva has joined #openstack-nova | 15:58 | |
| *** yassine has quit IRC | 15:58 | |
| *** dikonoo has quit IRC | 15:59 | |
| *** yassine has joined #openstack-nova | 16:01 | |
| *** tbachman has quit IRC | 16:01 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Update api doc with latest updates in api framework https://review.openstack.org/493041 | 16:01 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: test shelve and shelve offload with placement https://review.openstack.org/493062 | 16:04 |
| *** armax has quit IRC | 16:04 | |
| *** sbezverk has quit IRC | 16:05 | |
| gibi | cdent: bug for the shelve offload problem: https://bugs.launchpad.net/nova/+bug/1710249 | 16:06 |
| openstack | Launchpad bug 1710249 in OpenStack Compute (nova) "nova doesn't clean up the resources after shelve offload" [Undecided,New] | 16:06 |
| gibi | cdent: also pushed a regression test for it https://review.openstack.org/#/c/493062/ | 16:06 |
| * cdent wants whatever gibi is taking | 16:06 | |
| *** lucasxu has quit IRC | 16:07 | |
| gibi | cdent: just regular caffeine :) | 16:07 |
| gibi | but now it is time to leave for the weekend. See you on Monday | 16:08 |
| * cdent waveas | 16:08 | |
| * gibi waves back | 16:09 | |
| *** sridharg has quit IRC | 16:09 | |
| *** ociuhandu has quit IRC | 16:10 | |
| *** egonzalez has quit IRC | 16:12 | |
| *** dikonoo has joined #openstack-nova | 16:17 | |
| *** lpetrut has quit IRC | 16:18 | |
| *** gongysh has quit IRC | 16:19 | |
| *** dtantsur is now known as dtantsur|afk | 16:20 | |
| *** markvoelker has joined #openstack-nova | 16:25 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Add ``HostPortProfileInfo`` class https://review.openstack.org/441590 | 16:27 |
| mriedem | sdague: i'm going to grind through stable branch reviews today before i'm out for a week, can you hit this series? https://review.openstack.org/#/q/topic:bug/1686116+branch:stable/ocata | 16:28 |
| *** tbachman has joined #openstack-nova | 16:29 | |
| *** lyan has quit IRC | 16:29 | |
| *** amotoki is now known as amotoki__away | 16:30 | |
| mriedem | another stable/ocata one that needs another stable core to push through https://review.openstack.org/#/c/475902/ | 16:32 |
| mriedem | claudiub: ^? | 16:32 |
| *** itlinux has joined #openstack-nova | 16:33 | |
| *** jogo has quit IRC | 16:34 | |
| *** jmlowe_ has quit IRC | 16:34 | |
| *** derekh has quit IRC | 16:35 | |
| mriedem | another one that needs final +2 https://review.openstack.org/#/q/topic:bug/1607714+branch:stable/ocata | 16:35 |
| *** tbachman has quit IRC | 16:36 | |
| *** psachin has joined #openstack-nova | 16:36 | |
| *** tbachman has joined #openstack-nova | 16:38 | |
| *** iogg has quit IRC | 16:38 | |
| *** tesseract has quit IRC | 16:41 | |
| *** lucasagomes is now known as lucas-afk | 16:41 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Skip test_rebuild_server_in_error_state for cells v1 https://review.openstack.org/493076 | 16:43 |
| *** dklyle has quit IRC | 16:44 | |
| *** dklyle has joined #openstack-nova | 16:45 | |
| *** egonzalez has joined #openstack-nova | 16:46 | |
| *** rajathagasthya has joined #openstack-nova | 16:46 | |
| *** trinaths has left #openstack-nova | 16:46 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Update api doc with latest updates in api framework https://review.openstack.org/493041 | 16:50 |
| mriedem | cdent: fun catch on that one https://review.openstack.org/#/c/492477/ | 16:52 |
| mriedem | would be a reasonable thing if they changed it into a policy rule | 16:52 |
| mriedem | and did it on master | 16:53 |
| cdent | mriedem: I’m guess they just don’t know the process | 16:53 |
| mriedem | yeah probably not | 16:53 |
| mriedem | https://docs.openstack.org/project-team-guide/stable-branches.html#appropriate-fixes huzzah | 16:54 |
| mriedem | i'll link that in there | 16:54 |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Add __str__ method to Host* objects https://review.openstack.org/493082 | 16:54 |
| *** vks1 has quit IRC | 16:55 | |
| *** jmlowe has joined #openstack-nova | 16:56 | |
| *** suresh12 has joined #openstack-nova | 16:58 | |
| *** jogo has joined #openstack-nova | 16:59 | |
| *** markvoelker has quit IRC | 16:59 | |
| *** markus_z has quit IRC | 17:00 | |
| *** Apoorva_ has joined #openstack-nova | 17:01 | |
| *** mdrabe is now known as mdrabe_afk | 17:02 | |
| *** Apoorva has quit IRC | 17:04 | |
| *** cdent has quit IRC | 17:08 | |
| *** psachin has quit IRC | 17:08 | |
| gmann | mriedem: sdague alex_xu can you check this. API doc updated with new routing things -https://review.openstack.org/#/c/493041/ | 17:10 |
| mriedem | i think oomichi said he wanted to review that | 17:10 |
| mriedem | as my proxy | 17:11 |
| gmann | after this i will merge api_v2.rst into api.rst | 17:11 |
| *** lyan has joined #openstack-nova | 17:12 | |
| *** lyan has quit IRC | 17:12 | |
| *** felipemonteiro_ has quit IRC | 17:14 | |
| *** lyan has joined #openstack-nova | 17:15 | |
| *** lyan has quit IRC | 17:16 | |
| *** mvk has quit IRC | 17:17 | |
| *** lyan has joined #openstack-nova | 17:17 | |
| *** lyan has quit IRC | 17:18 | |
| *** dikonoor has joined #openstack-nova | 17:21 | |
| *** dikonoo has quit IRC | 17:24 | |
| *** lyan has joined #openstack-nova | 17:28 | |
| *** annegentle has quit IRC | 17:33 | |
| *** simondodsley has joined #openstack-nova | 17:33 | |
| *** pchavva has quit IRC | 17:35 | |
| *** tosika has quit IRC | 17:37 | |
| *** gjayavelu has joined #openstack-nova | 17:37 | |
| *** Swami has joined #openstack-nova | 17:38 | |
| *** crushil has quit IRC | 17:39 | |
| *** yamamoto has quit IRC | 17:43 | |
| *** ralonsoh has quit IRC | 17:45 | |
| *** yamahata has quit IRC | 17:53 | |
| *** markvoelker has joined #openstack-nova | 17:55 | |
| *** egonzalez has quit IRC | 17:56 | |
| *** Apoorva_ has quit IRC | 18:03 | |
| *** crushil has joined #openstack-nova | 18:03 | |
| *** Apoorva has joined #openstack-nova | 18:03 | |
| *** egonzalez has joined #openstack-nova | 18:04 | |
| *** gbarros has quit IRC | 18:05 | |
| *** annegentle has joined #openstack-nova | 18:05 | |
| *** trinaths has joined #openstack-nova | 18:05 | |
| *** thingee_ has quit IRC | 18:07 | |
| *** egonzalez has quit IRC | 18:08 | |
| *** esberglu has quit IRC | 18:16 | |
| *** esberglu has joined #openstack-nova | 18:16 | |
| *** sdague has quit IRC | 18:17 | |
| *** sdague has joined #openstack-nova | 18:17 | |
| *** esberglu has quit IRC | 18:21 | |
| *** tosika has joined #openstack-nova | 18:22 | |
| *** inara has quit IRC | 18:23 | |
| *** yamahata has joined #openstack-nova | 18:25 | |
| *** inara has joined #openstack-nova | 18:25 | |
| *** priteau has joined #openstack-nova | 18:25 | |
| *** gmann has quit IRC | 18:25 | |
| *** markvoelker has quit IRC | 18:29 | |
| *** baoli has quit IRC | 18:30 | |
| *** lyan has quit IRC | 18:30 | |
| *** lyan has joined #openstack-nova | 18:31 | |
| *** baoli has joined #openstack-nova | 18:31 | |
| *** gjayavelu has quit IRC | 18:41 | |
| *** Sukhdev has joined #openstack-nova | 18:43 | |
| *** nicolasbock has quit IRC | 18:43 | |
| *** yamamoto has joined #openstack-nova | 18:44 | |
| *** kylek3h has quit IRC | 18:48 | |
| *** yamamoto has quit IRC | 18:49 | |
| *** annabelleB has joined #openstack-nova | 18:51 | |
| annabelleB | hey Nova team—Anne Bertucio from the Foundation here. We’re trying to confirm some features that the Community Roadmap team had highlighted for Pike. Did the allowing multiple cells v2 feature land in Pike? | 18:52 |
| *** mdrabe_afk is now known as mdrabe | 18:58 | |
| *** annegentle has quit IRC | 19:00 | |
| mriedem | annabelleB: i need to get back to your email don't i :) | 19:02 |
| *** dtp has quit IRC | 19:02 | |
| mriedem | annabelleB: the prelude to the pike rc1 release notes has the major stuff https://docs.openstack.org/releasenotes/nova/pike.html | 19:02 |
| mriedem | multi-cell support landed but with caveats | 19:02 |
| mriedem | documented here https://docs.openstack.org/nova/latest/user/cellsv2_layout.html#caveats-of-a-multi-cell-deployment | 19:03 |
| annabelleB | mriedem: hehe, there was a lot of excitement around this, so wanted to make sure I got it in :) | 19:03 |
| annabelleB | mriedem: perfect; I’ll read that! thank you! | 19:03 |
| *** crushil has quit IRC | 19:04 | |
| mriedem | placement is a more confusing and less well documented story probably | 19:04 |
| *** crushil has joined #openstack-nova | 19:12 | |
| *** annegentle has joined #openstack-nova | 19:17 | |
| *** avolkov has quit IRC | 19:21 | |
| *** lpetrut has joined #openstack-nova | 19:25 | |
| *** markvoelker has joined #openstack-nova | 19:27 | |
| *** trinaths has quit IRC | 19:32 | |
| *** Apoorva has quit IRC | 19:32 | |
| sdague | mriedem: I'm going to drop off before too long, anything else you need me to look at or do before then? | 19:34 |
| mriedem | i've just been going through stable/newton now | 19:36 |
| mriedem | there are several ready for +W | 19:36 |
| mriedem | https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:stable/newton | 19:36 |
| *** suresh12 has quit IRC | 19:37 | |
| *** adisky__ has quit IRC | 19:39 | |
| *** tbachman has quit IRC | 19:40 | |
| *** baoli has quit IRC | 19:41 | |
| *** fried_rice has quit IRC | 19:41 | |
| *** baoli has joined #openstack-nova | 19:41 | |
| sdague | mriedem: https://review.openstack.org/#/c/487536/ doesn't really hurt anything to bring it back | 19:42 |
| *** baoli has quit IRC | 19:42 | |
| mriedem | it's specifically for another change that needs to be put on top of it | 19:42 |
| mriedem | which still needs work in ocata | 19:42 |
| mriedem | i didn't -1 it, just no reason to merge it yet | 19:42 |
| sdague | yeh, it just seems fine to merge it as it doesn't hurt anything, and just makes other fixes potentially easier to pull back | 19:43 |
| *** baoli has joined #openstack-nova | 19:43 | |
| sdague | https://review.openstack.org/#/c/470347 and stack seems pretty extensive for newton | 19:45 |
| mriedem | it wasn't 6 months ago | 19:45 |
| mriedem | well, | 19:45 |
| mriedem | so that's for re-enabling a tempest test | 19:46 |
| sdague | jun 2 | 19:46 |
| mriedem | https://review.openstack.org/#/c/349011/ | 19:46 |
| sdague | ok | 19:46 |
| mriedem | yeah, i started backporting that to newton once it was fixed in ocata and passing https://review.openstack.org/#/c/349011/ | 19:46 |
| mriedem | so we can't do https://review.openstack.org/#/c/349011/ w/o it being fixed in all branches | 19:46 |
| *** yamamoto has joined #openstack-nova | 19:46 | |
| sdague | ah | 19:47 |
| sdague | ok, I guess you sold me | 19:47 |
| mriedem | yeah, been working on that since i was at ibm public cloud :) | 19:47 |
| mriedem | which was last summer | 19:47 |
| sdague | heh | 19:49 |
| *** egonzalez has joined #openstack-nova | 19:51 | |
| *** fried_rice has joined #openstack-nova | 19:53 | |
| *** yamamoto has quit IRC | 19:55 | |
| *** dtp has joined #openstack-nova | 19:58 | |
| *** markvoelker has quit IRC | 19:59 | |
| *** lpetrut has quit IRC | 20:01 | |
| *** lpetrut has joined #openstack-nova | 20:02 | |
| *** priteau has quit IRC | 20:06 | |
| *** tbachman has joined #openstack-nova | 20:08 | |
| *** suresh12 has joined #openstack-nova | 20:13 | |
| *** gouthamr has quit IRC | 20:14 | |
| *** MVenesio has quit IRC | 20:14 | |
| *** slagle has quit IRC | 20:15 | |
| *** suresh12 has quit IRC | 20:15 | |
| *** suresh12 has joined #openstack-nova | 20:15 | |
| *** catintheroof has quit IRC | 20:15 | |
| *** Apoorva has joined #openstack-nova | 20:16 | |
| *** suresh12_ has joined #openstack-nova | 20:17 | |
| *** suresh12 has quit IRC | 20:17 | |
| *** suresh12_ has quit IRC | 20:17 | |
| mriedem | vdrok: do we have a good ci run for ironic + resource classes with https://review.openstack.org/#/c/492964/ ? | 20:18 |
| vdrok | mriedem: not sure if dtantsur|afk made a test patch with depends on. Can do in ~an hour when I get to keyboard | 20:21 |
| *** annabelleB has quit IRC | 20:22 | |
| mriedem | i think it's probably https://review.openstack.org/#/c/476968/ ? | 20:27 |
| *** annabelleB has joined #openstack-nova | 20:28 | |
| *** tbachman_ has joined #openstack-nova | 20:28 | |
| *** tbachman has quit IRC | 20:30 | |
| *** tbachman_ is now known as tbachman | 20:30 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: Add more logging + hook devstack https://review.openstack.org/492957 | 20:30 |
| mriedem | vdrok: fyi i think ^ will hit the entire thing | 20:30 |
| mriedem | the flavor migration + dtantsur|afk's inventory fix + the ironic+devstack changes to use resource classes | 20:31 |
| vdrok | mriedem: yes, but the actual flavor migration won't happen, as we can only see it in grenade I think | 20:32 |
| *** gouthamr has joined #openstack-nova | 20:32 | |
| mriedem | ah because the node doesn't have the resource_class set to migrate | 20:32 |
| *** suresh12 has joined #openstack-nova | 20:33 | |
| vdrok | mriedem: Ive done this one I1ac1b8501cbed901941e7c89fc55c5b9bea0cb4f but it does not seem to work yet | 20:33 |
| oomichi | toabctl: commented on https://review.openstack.org/#/c/398308 | 20:33 |
| vdrok | mriedem: with that, we'd have one instance created by Nova in resource create phase, and we'd update it's resource class | 20:34 |
| vdrok | *Its node's class | 20:34 |
| mriedem | ok i've approved the flavor migration patch anyway | 20:35 |
| mriedem | i think you guys have shown we're good there | 20:35 |
| vdrok | Thanks! | 20:35 |
| mriedem | the remaining issue was the scheduling piece with the custom resource class missing, which is dtantsur|afk's patch | 20:35 |
| figleaf | \o/ | 20:36 |
| *** weshay_doc is now known as weshay | 20:39 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle addition of new nodes/instances in ironic flavor migration https://review.openstack.org/487954 | 20:42 |
| mriedem | whoa wt | 20:43 |
| mriedem | oh gdi | 20:43 |
| mriedem | we don't have git review setup yet | 20:43 |
| mriedem | on stable/pike | 20:43 |
| *** jmlowe has quit IRC | 20:45 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle addition of new nodes/instances in ironic flavor migration https://review.openstack.org/487954 | 20:45 |
| *** avolkov has joined #openstack-nova | 20:46 | |
| *** itlinux has quit IRC | 20:46 | |
| *** annegentle has quit IRC | 20:47 | |
| *** jmlowe has joined #openstack-nova | 20:47 | |
| *** awaugama has quit IRC | 20:48 | |
| mriedem | ok here we go https://review.openstack.org/#/c/493227/ | 20:49 |
| *** dikonoor has quit IRC | 20:51 | |
| *** thorst has quit IRC | 20:52 | |
| *** baoli has quit IRC | 20:52 | |
| sdague | mriedem: I approved the patch, it just hasn't landed yet | 20:54 |
| sdague | https://review.openstack.org/#/c/492980/ | 20:55 |
| *** tosika has quit IRC | 20:55 | |
| *** jmlowe has quit IRC | 20:56 | |
| *** markvoelker has joined #openstack-nova | 20:56 | |
| mriedem | yup | 20:56 |
| mriedem | i backported on top of that series | 20:56 |
| *** gjayavelu has joined #openstack-nova | 20:59 | |
| mriedem | ok i've sent the todo list to dansmith publicly in the ML | 20:59 |
| mriedem | i will now retire with a bag of chips to my basement to prepare for vacation | 21:00 |
| *** Apoorva_ has joined #openstack-nova | 21:00 | |
| *** rajathagasthya has quit IRC | 21:00 | |
| *** edmondsw has quit IRC | 21:01 | |
| *** jistr is now known as jistr|off | 21:02 | |
| *** gyee has quit IRC | 21:02 | |
| *** rajathagasthya has joined #openstack-nova | 21:02 | |
| *** Apoorva has quit IRC | 21:04 | |
| sdague | heh | 21:04 |
| sdague | mriedem: go find yourself a saspirila | 21:04 |
| mriedem | i do have a bottle of fancy root beer in the fridge | 21:05 |
| *** crushil has quit IRC | 21:06 | |
| *** egonzalez has quit IRC | 21:11 | |
| *** dave-mccowan has quit IRC | 21:12 | |
| mriedem | melwitt: can you hit the two bottom changes here? https://review.openstack.org/#/c/450105/ - just small placement api-ref changes, then we'll have the job running | 21:13 |
| melwitt | mriedem: sure thing | 21:13 |
| mriedem | thanks | 21:13 |
| *** crushil has joined #openstack-nova | 21:14 | |
| *** rajathagasthya has quit IRC | 21:15 | |
| *** priteau has joined #openstack-nova | 21:21 | |
| *** priteau has quit IRC | 21:24 | |
| *** gyee has joined #openstack-nova | 21:29 | |
| *** markvoelker has quit IRC | 21:30 | |
| *** MVenesio has joined #openstack-nova | 21:33 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use ksa adapter for placement conf & requests https://review.openstack.org/492247 | 21:33 |
| openstackgerrit | Eric Fried proposed openstack/nova master: nova.utils.get_ksa_adapter() https://review.openstack.org/488137 | 21:33 |
| *** rajathagasthya has joined #openstack-nova | 21:34 | |
| *** Apoorva_ has quit IRC | 21:38 | |
| *** Apoorva has joined #openstack-nova | 21:38 | |
| *** thorst has joined #openstack-nova | 21:44 | |
| *** thorst has quit IRC | 21:48 | |
| mtreinish | fried_rice: I pushed a new rev on: https://review.openstack.org/#/c/492651/3 which now has a depends on for: https://review.openstack.org/#/c/493231/2 | 21:48 |
| mtreinish | if you wanted to give it a try | 21:49 |
| fried_rice | mtreinish Ack, looking... | 21:49 |
| fried_rice | mtreinish I have a nice stable (mod_wsgi) stack at the moment, so... | 21:49 |
| mtreinish | fried_rice: hmm, well if you don't want to rock the boat. I'm still testing things locally | 21:51 |
| fried_rice | rgr | 21:51 |
| fried_rice | mtreinish Storing the whole image in memory... doesn't sound like it'll fly. | 21:51 |
| mtreinish | it definitely works when I talk to the uwsgi server directly, but it looks like the apache config still needs some tweaking because I'm getting a 502 going through the proxy | 21:52 |
| fried_rice | mtreinish Here's where it would be nice to be able to use a fifo, where glance can suck it down in parallel with the send. | 21:52 |
| fried_rice | mtreinish swhat we do in the powervm driver when populating a boot disk *from* glance. | 21:53 |
| mtreinish | yeah, I'm still trying to figure out the best way to handle that. I was just basing that middleware on what I found in the eventlet code | 21:53 |
| mtreinish | and I still ahven't figured out how eventlet is doing it | 21:54 |
| *** xyang1 has quit IRC | 21:54 | |
| mtreinish | fried_rice: the trick here is to make the data look like what webob is expecting after calling uwsgi.chunked_read() but not putting it all in memory | 21:54 |
| fried_rice | mtreinish Can you point me to the source for chunked_read? | 21:55 |
| *** annegentle has joined #openstack-nova | 21:55 | |
| mtreinish | sure, one sec | 21:55 |
| fried_rice | Could it be this? https://github.com/unbit/uwsgi/blob/master/core/chunked.c#L86 | 21:56 |
| mtreinish | yeah that's the inner c function | 21:57 |
| mtreinish | the python interface is defined here: https://github.com/unbit/uwsgi/blob/master/plugins/python/uwsgi_pymodule.c#L1185-L1200 | 21:57 |
| *** markvoelker has joined #openstack-nova | 22:10 | |
| *** gbarros has joined #openstack-nova | 22:12 | |
| *** lbragstad has quit IRC | 22:17 | |
| *** MVenesio_ has joined #openstack-nova | 22:18 | |
| *** figleaf is now known as edleafe | 22:20 | |
| *** MVenesio has quit IRC | 22:22 | |
| *** lpetrut has quit IRC | 22:23 | |
| *** cfriesen has quit IRC | 22:27 | |
| *** cfriesen has joined #openstack-nova | 22:27 | |
| *** cfriesen has quit IRC | 22:31 | |
| *** dtp has quit IRC | 22:33 | |
| *** markvoelker has quit IRC | 22:33 | |
| *** avolkov has quit IRC | 22:37 | |
| *** annegentle has quit IRC | 22:50 | |
| *** MVenesio_ has quit IRC | 22:51 | |
| fried_rice | sdague / leakypipes still around? | 23:03 |
| *** claudiub has quit IRC | 23:04 | |
| *** Sukhdev has quit IRC | 23:04 | |
| *** sdague has quit IRC | 23:09 | |
| *** annabelleB has quit IRC | 23:12 | |
| *** hongbin has quit IRC | 23:12 | |
| *** lyan has quit IRC | 23:13 | |
| *** esberglu has joined #openstack-nova | 23:17 | |
| *** clayton has quit IRC | 23:18 | |
| *** clayton has joined #openstack-nova | 23:18 | |
| *** krtaylor has quit IRC | 23:21 | |
| *** esberglu has quit IRC | 23:21 | |
| *** suresh12_ has joined #openstack-nova | 23:24 | |
| *** suresh12 has quit IRC | 23:28 | |
| *** rajathagasthya has quit IRC | 23:32 | |
| *** zzzeek has quit IRC | 23:43 | |
| *** zzzeek has joined #openstack-nova | 23:44 | |
| *** Apoorva_ has joined #openstack-nova | 23:50 | |
| *** Apoorva has quit IRC | 23:54 | |
| *** suresh12_ has quit IRC | 23:54 | |
| *** Apoorva_ has quit IRC | 23:55 | |
| *** baoli has joined #openstack-nova | 23:57 | |
| *** chyka has quit IRC | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!