| *** hj-hp has joined #openstack-operators | 00:01 | |
| *** hj-hp has quit IRC | 00:01 | |
| *** esker has quit IRC | 00:03 | |
| *** emagana has joined #openstack-operators | 00:04 | |
| *** emagana has quit IRC | 00:05 | |
| *** Marga_ has quit IRC | 00:08 | |
| *** dmsimard is now known as dmsimard_away | 00:10 | |
| *** emagana has joined #openstack-operators | 00:13 | |
| *** Marga_ has joined #openstack-operators | 00:16 | |
| *** VW_ has joined #openstack-operators | 00:22 | |
| *** SimonChung has joined #openstack-operators | 00:23 | |
| *** SimonChung has quit IRC | 00:23 | |
| *** SimonChung2 has joined #openstack-operators | 00:23 | |
| *** SimonChung1 has quit IRC | 00:23 | |
| *** SimonChung2 has quit IRC | 00:24 | |
| *** SimonChung has joined #openstack-operators | 00:24 | |
| mgagne | not much luck finding a solution to my live migration. I think it's the equivalent of migrating from a host running ubuntu 13.10 (qemu 1.5) to ubuntu 14.04 (qemu 2.0) | 00:24 |
|---|---|---|
| *** SimonChung1 has joined #openstack-operators | 00:25 | |
| *** SimonChung has quit IRC | 00:25 | |
| *** david-lyle is now known as david-lyle_afk | 00:25 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 00:47 | |
| *** Marga_ has quit IRC | 00:48 | |
| *** emagana has quit IRC | 00:53 | |
| *** emagana has joined #openstack-operators | 00:54 | |
| *** emagana has quit IRC | 00:54 | |
| *** emagana has joined #openstack-operators | 00:54 | |
| *** SimonChung has joined #openstack-operators | 01:02 | |
| *** SimonChung1 has quit IRC | 01:02 | |
| *** SimonChung1 has joined #openstack-operators | 01:04 | |
| *** SimonChung has quit IRC | 01:04 | |
| *** mdorman has quit IRC | 01:07 | |
| *** openstack has joined #openstack-operators | 01:11 | |
| *** VW_ has quit IRC | 01:16 | |
| *** delattec has quit IRC | 01:16 | |
| *** radez_g0n3 has quit IRC | 01:16 | |
| *** Nebula__ has quit IRC | 01:16 | |
| *** radez_g0n3 has joined #openstack-operators | 01:20 | |
| *** Nebula__ has joined #openstack-operators | 01:20 | |
| *** georgem1 has joined #openstack-operators | 01:27 | |
| *** jamespd has quit IRC | 01:31 | |
| *** jamespd has joined #openstack-operators | 01:32 | |
| *** Ti-mo has quit IRC | 01:35 | |
| *** fsaad has quit IRC | 01:35 | |
| *** _nick has quit IRC | 01:35 | |
| *** ruagair has quit IRC | 01:35 | |
| *** andrewbogott has quit IRC | 01:35 | |
| *** B_Smith_ has quit IRC | 01:35 | |
| *** zz_avozza has quit IRC | 01:35 | |
| *** kfjohnson has quit IRC | 01:35 | |
| *** andrewbogott has joined #openstack-operators | 01:39 | |
| *** _nick has joined #openstack-operators | 01:39 | |
| *** kfjohnson has joined #openstack-operators | 01:39 | |
| *** Ti-mo has joined #openstack-operators | 01:39 | |
| *** fsaad has joined #openstack-operators | 01:39 | |
| *** ruagair has joined #openstack-operators | 01:39 | |
| *** B_Smith_ has joined #openstack-operators | 01:39 | |
| *** zz_avozza has joined #openstack-operators | 01:39 | |
| *** Ti-mo has quit IRC | 01:40 | |
| *** fsaad has quit IRC | 01:40 | |
| *** _nick has quit IRC | 01:40 | |
| *** ruagair has quit IRC | 01:40 | |
| *** andrewbogott has quit IRC | 01:40 | |
| *** B_Smith_ has quit IRC | 01:40 | |
| *** zz_avozza has quit IRC | 01:40 | |
| *** kfjohnson has quit IRC | 01:40 | |
| *** david-lyle_afk has quit IRC | 01:40 | |
| *** delattec has joined #openstack-operators | 01:40 | |
| *** andrewbogott has joined #openstack-operators | 01:41 | |
| *** _nick has joined #openstack-operators | 01:41 | |
| *** kfjohnson has joined #openstack-operators | 01:41 | |
| *** Ti-mo has joined #openstack-operators | 01:41 | |
| *** fsaad has joined #openstack-operators | 01:41 | |
| *** ruagair has joined #openstack-operators | 01:41 | |
| *** B_Smith_ has joined #openstack-operators | 01:41 | |
| *** zz_avozza has joined #openstack-operators | 01:41 | |
| *** alop has quit IRC | 01:42 | |
| *** delattec has quit IRC | 01:42 | |
| mgagne | looks like I'm in a dead end: qemu 1.5 (coming from UCA which is in fact saucy at that time) still used qemu-kvm which is not compatible with upstream qemu (qemu 2.0 in trusty). So I can't live migrate without applying a workaround (already done for precise->trusty) in libvirt and qemu for my specific machine type. =( | 01:42 |
| jlk | kinda glad we don't support live migrate right now | 01:54 |
| mgagne | now I want to defenestrate myself | 01:55 |
| jlk | I'm chasing problems allocating network ports | 01:55 |
| jlk | if I throw a lot of builds at once | 01:56 |
| jlk | I'm guessing neutron is just getting worked, but it doesn't really error | 01:56 |
| jlk | just.. times out | 01:56 |
| mgagne | hmmm | 01:56 |
| jlk | I'm putting vif_plugging_timeout back up to the default of 300, to see what happens. | 01:56 |
| mgagne | define "lot of builds" =) | 01:59 |
| *** david-lyle_afk has joined #openstack-operators | 01:59 | |
| mgagne | is it the neutron timeout issue? | 01:59 |
| jlk | 100 | 01:59 |
| jlk | I think it's /a/ timeout but I'm not sure what is timing out where | 02:00 |
| jlk | this is a 3 node cluster, 2 controllers that also do compute, and one pure compute node | 02:00 |
| mgagne | unfortunately, I didn't come yet to test that kind of scenarios :-/ | 02:01 |
| mgagne | and now it's 9pm and I'm hungry so it's time to go home. good luck ;) | 02:02 |
| jlk | haha, thanks. | 02:02 |
| jlk | whoh, just got 100 out of 100 | 02:04 |
| *** harlowja has quit IRC | 02:07 | |
| *** harlowja_ has joined #openstack-operators | 02:07 | |
| *** david-lyle_afk has quit IRC | 02:10 | |
| *** esker has joined #openstack-operators | 02:10 | |
| jlk | geez, delete 100 instances and nova-linuxbridge-agent loses its mind for a while deleting ipsets | 02:12 |
| *** david-lyle_afk has joined #openstack-operators | 02:16 | |
| *** SimonChung1 has quit IRC | 02:18 | |
| *** emagana has quit IRC | 02:19 | |
| *** georgem1 has quit IRC | 02:20 | |
| *** emagana has joined #openstack-operators | 02:20 | |
| *** georgem1 has joined #openstack-operators | 02:22 | |
| *** blair has quit IRC | 02:22 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 02:24 | |
| *** emagana has quit IRC | 02:24 | |
| *** signed8bit has quit IRC | 02:26 | |
| *** georgem1 has quit IRC | 02:26 | |
| *** reed has quit IRC | 02:30 | |
| *** reed_ has joined #openstack-operators | 02:30 | |
| *** jamespd has quit IRC | 02:34 | |
| *** jamespd has joined #openstack-operators | 02:35 | |
| *** georgem1 has joined #openstack-operators | 02:40 | |
| *** reed_ is now known as reed | 02:48 | |
| *** reed has quit IRC | 02:48 | |
| *** reed has joined #openstack-operators | 02:48 | |
| *** swat30 has quit IRC | 02:54 | |
| *** markvoelker has quit IRC | 02:56 | |
| *** markvoelker has joined #openstack-operators | 02:57 | |
| *** swat30 has joined #openstack-operators | 03:00 | |
| *** markvoelker has quit IRC | 03:01 | |
| *** Nebula__ has quit IRC | 03:09 | |
| *** Nebula_ has joined #openstack-operators | 03:09 | |
| *** devlaps has joined #openstack-operators | 03:14 | |
| *** blair has joined #openstack-operators | 03:17 | |
| *** devlaps has quit IRC | 03:40 | |
| *** reed has quit IRC | 03:55 | |
| *** SimonChung has joined #openstack-operators | 04:02 | |
| *** SimonChung1 has joined #openstack-operators | 04:03 | |
| *** markvoelker has joined #openstack-operators | 04:06 | |
| *** harlowja_ is now known as harlowja_away | 04:06 | |
| *** SimonChung has quit IRC | 04:06 | |
| *** georgem1 has quit IRC | 04:15 | |
| *** ozialien has joined #openstack-operators | 04:29 | |
| *** sanjayu has joined #openstack-operators | 04:40 | |
| *** Marga_ has joined #openstack-operators | 04:57 | |
| *** Marga_ has quit IRC | 05:06 | |
| *** Marga_ has joined #openstack-operators | 05:07 | |
| *** ozialien has quit IRC | 05:09 | |
| *** blairo has joined #openstack-operators | 05:44 | |
| *** blair has quit IRC | 05:48 | |
| *** blairo has quit IRC | 05:49 | |
| *** Miouge has joined #openstack-operators | 07:30 | |
| *** markvoelker has quit IRC | 07:32 | |
| *** markvoelker has joined #openstack-operators | 07:33 | |
| *** markvoelker has quit IRC | 07:37 | |
| *** Marga_ has quit IRC | 08:00 | |
| *** Marga_ has joined #openstack-operators | 08:00 | |
| *** matrohon has joined #openstack-operators | 08:21 | |
| *** Marga_ has quit IRC | 08:22 | |
| *** andrewbogott is now known as andrewbogott_afk | 08:47 | |
| *** VW_ has joined #openstack-operators | 08:48 | |
| *** VW_ has quit IRC | 08:48 | |
| *** VW_ has joined #openstack-operators | 08:49 | |
| *** bvandenh has joined #openstack-operators | 08:58 | |
| *** blair has joined #openstack-operators | 09:00 | |
| *** racedo has joined #openstack-operators | 09:04 | |
| *** markvoelker has joined #openstack-operators | 09:16 | |
| *** markvoelker has quit IRC | 09:21 | |
| *** derekh has joined #openstack-operators | 09:25 | |
| *** Miouge has quit IRC | 09:35 | |
| *** Miouge has joined #openstack-operators | 09:42 | |
| *** jawed has joined #openstack-operators | 09:52 | |
| *** bvandenh has quit IRC | 10:04 | |
| *** bvandenh has joined #openstack-operators | 10:05 | |
| *** markvoelker has joined #openstack-operators | 10:17 | |
| *** Miouge has quit IRC | 10:20 | |
| *** markvoelker has quit IRC | 10:22 | |
| *** Miouge has joined #openstack-operators | 10:27 | |
| *** Miouge has quit IRC | 10:28 | |
| *** VW__ has joined #openstack-operators | 10:48 | |
| *** VW_ has quit IRC | 10:49 | |
| *** VW__ has quit IRC | 10:54 | |
| *** VW_ has joined #openstack-operators | 10:54 | |
| *** sanjayu has quit IRC | 10:55 | |
| *** markvoelker has joined #openstack-operators | 11:18 | |
| *** markvoelker has quit IRC | 11:23 | |
| *** Miouge has joined #openstack-operators | 11:28 | |
| *** VW_ has quit IRC | 11:29 | |
| *** Miouge has quit IRC | 12:02 | |
| *** Miouge has joined #openstack-operators | 12:04 | |
| *** jaypipes has joined #openstack-operators | 12:18 | |
| *** markvoelker has joined #openstack-operators | 12:19 | |
| *** VW_ has joined #openstack-operators | 12:20 | |
| *** markvoelker has quit IRC | 12:24 | |
| *** VW_ has quit IRC | 12:36 | |
| *** turnerg has joined #openstack-operators | 12:39 | |
| *** pboros has joined #openstack-operators | 12:39 | |
| *** VW_ has joined #openstack-operators | 12:47 | |
| *** VW_ has quit IRC | 12:48 | |
| *** VW_ has joined #openstack-operators | 12:48 | |
| *** sandywalsh has quit IRC | 12:49 | |
| *** georgem1 has joined #openstack-operators | 12:52 | |
| *** markvoelker has joined #openstack-operators | 13:20 | |
| *** Miouge has quit IRC | 13:25 | |
| *** markvoelker has quit IRC | 13:25 | |
| *** sandywalsh has joined #openstack-operators | 13:28 | |
| *** Miouge has joined #openstack-operators | 13:32 | |
| *** georgem1 has quit IRC | 13:36 | |
| *** derekh has quit IRC | 13:44 | |
| *** zerda has joined #openstack-operators | 13:49 | |
| *** derekh has joined #openstack-operators | 13:53 | |
| *** georgem1 has joined #openstack-operators | 13:57 | |
| *** georgem1 has quit IRC | 13:58 | |
| *** blair has quit IRC | 14:01 | |
| *** georgem1 has joined #openstack-operators | 14:02 | |
| *** Miouge has quit IRC | 14:07 | |
| *** cpschult has joined #openstack-operators | 14:09 | |
| *** VW_ has quit IRC | 14:12 | |
| *** markvoelker has joined #openstack-operators | 14:21 | |
| *** Miouge has joined #openstack-operators | 14:22 | |
| *** markvoelker has quit IRC | 14:26 | |
| *** VW_ has joined #openstack-operators | 14:29 | |
| *** Miouge has quit IRC | 14:29 | |
| *** VW__ has joined #openstack-operators | 14:30 | |
| *** radez_g0n3 is now known as radez | 14:32 | |
| *** VW_ has quit IRC | 14:34 | |
| *** Miouge has joined #openstack-operators | 14:41 | |
| *** VW__ has quit IRC | 14:44 | |
| *** david-lyle_afk is now known as david-lyle | 14:48 | |
| *** esker has quit IRC | 14:50 | |
| *** csoukup has joined #openstack-operators | 14:52 | |
| *** markvoelker has joined #openstack-operators | 14:52 | |
| *** markvoelker has quit IRC | 14:53 | |
| *** jawed has quit IRC | 14:55 | |
| *** VW_ has joined #openstack-operators | 15:00 | |
| *** blair has joined #openstack-operators | 15:02 | |
| *** j05h has joined #openstack-operators | 15:07 | |
| *** j05h has quit IRC | 15:10 | |
| *** j05h has joined #openstack-operators | 15:10 | |
| *** blair has quit IRC | 15:10 | |
| *** georgem1 has quit IRC | 15:15 | |
| *** dmsimard_away is now known as dmsimard | 15:33 | |
| *** esker has joined #openstack-operators | 15:35 | |
| *** hj-hp has joined #openstack-operators | 15:39 | |
| *** signed8bit has joined #openstack-operators | 15:42 | |
| *** emagana has joined #openstack-operators | 15:45 | |
| *** yapeng has joined #openstack-operators | 15:45 | |
| *** matrohon has quit IRC | 15:48 | |
| *** Piet has quit IRC | 15:48 | |
| *** j05h has quit IRC | 15:54 | |
| *** j05h has joined #openstack-operators | 16:05 | |
| *** mdorman has joined #openstack-operators | 16:06 | |
| *** blair has joined #openstack-operators | 16:06 | |
| *** blair has quit IRC | 16:11 | |
| *** georgem1 has joined #openstack-operators | 16:12 | |
| *** turnerg1 has joined #openstack-operators | 16:19 | |
| *** turnerg has quit IRC | 16:20 | |
| klindgren | jlk re: neutron timeout are you on icehouse or juno? | 16:35 |
| *** reed has joined #openstack-operators | 16:38 | |
| *** Marga_ has joined #openstack-operators | 16:38 | |
| *** Marga__ has joined #openstack-operators | 16:38 | |
| *** alop has joined #openstack-operators | 16:40 | |
| *** turnerg1 has quit IRC | 16:40 | |
| *** turnerg has joined #openstack-operators | 16:41 | |
| *** Marga_ has quit IRC | 16:42 | |
| *** zerda has quit IRC | 16:45 | |
| *** j05h has quit IRC | 16:47 | |
| *** bvandenh has quit IRC | 16:58 | |
| *** hj-hp has quit IRC | 17:02 | |
| *** hj-hp has joined #openstack-operators | 17:03 | |
| *** VW__ has joined #openstack-operators | 17:04 | |
| *** blair has joined #openstack-operators | 17:07 | |
| *** markvoelker has joined #openstack-operators | 17:07 | |
| *** VW_ has quit IRC | 17:07 | |
| *** blair has quit IRC | 17:11 | |
| *** Marga__ has quit IRC | 17:12 | |
| mgagne | I found conflict info about the live migration issue between 1.5 -> 2.0. In the qemu package: "In 14.04 Ubuntu switched from the qemu-kvm source tree to the qemu source tree.". In the Ubuntu wiki: "During 12.10 (raring), we switched to the qemu source tree." | 17:13 |
| *** VW__ has quit IRC | 17:33 | |
| *** VW_ has joined #openstack-operators | 17:34 | |
| *** Marga_ has joined #openstack-operators | 17:47 | |
| *** andrewbogott_afk is now known as andrewbogott | 17:48 | |
| *** Marga_ has quit IRC | 17:48 | |
| *** Marga_ has joined #openstack-operators | 17:48 | |
| *** derekh has quit IRC | 17:56 | |
| *** turnerg has quit IRC | 17:57 | |
| *** VW_ has quit IRC | 17:57 | |
| *** VW_ has joined #openstack-operators | 17:58 | |
| *** turnerg has joined #openstack-operators | 18:01 | |
| *** hj-hp has quit IRC | 18:05 | |
| *** blair has joined #openstack-operators | 18:08 | |
| *** Marga_ has quit IRC | 18:10 | |
| *** Marga_ has joined #openstack-operators | 18:10 | |
| *** blair has quit IRC | 18:12 | |
| *** yapeng has quit IRC | 18:14 | |
| *** georgem1 has quit IRC | 18:19 | |
| *** hj-hp has joined #openstack-operators | 18:21 | |
| *** Miouge has quit IRC | 18:28 | |
| *** hj-hp has quit IRC | 18:32 | |
| *** georgem1 has joined #openstack-operators | 18:44 | |
| *** Marga_ has quit IRC | 18:58 | |
| *** Marga_ has joined #openstack-operators | 18:58 | |
| *** blair has joined #openstack-operators | 19:08 | |
| *** j05h has joined #openstack-operators | 19:12 | |
| *** blair has quit IRC | 19:13 | |
| *** VW_ has quit IRC | 19:15 | |
| *** Marga_ has quit IRC | 19:20 | |
| *** Marga_ has joined #openstack-operators | 19:20 | |
| *** reed has quit IRC | 19:25 | |
| *** reed has joined #openstack-operators | 19:28 | |
| *** turnerg has quit IRC | 19:37 | |
| *** emagana has quit IRC | 20:08 | |
| *** blair has joined #openstack-operators | 20:09 | |
| *** emagana has joined #openstack-operators | 20:11 | |
| *** matrohon has joined #openstack-operators | 20:11 | |
| *** blair has quit IRC | 20:14 | |
| *** emagana has quit IRC | 20:16 | |
| *** emagana has joined #openstack-operators | 20:30 | |
| *** Piet has joined #openstack-operators | 20:30 | |
| *** hj-hp has joined #openstack-operators | 21:01 | |
| *** VW_ has joined #openstack-operators | 21:01 | |
| *** blair has joined #openstack-operators | 21:10 | |
| *** dmsimard is now known as dmsimard_away | 21:12 | |
| *** blair has quit IRC | 21:14 | |
| *** georgem1 has quit IRC | 21:19 | |
| *** j05h has quit IRC | 21:20 | |
| *** pboros has quit IRC | 21:25 | |
| *** blair has joined #openstack-operators | 21:30 | |
| andrewbogott | A question about upgrade path: I’m currently running nova Icehouse on Precise. What kind of upgrade path have people taken from that? | 21:32 |
| andrewbogott | Best I can tell, Icehouse is not in the cloud archive for Trusty. Does that mean that Icehouse is the stock version on Trusty? | 21:32 |
| dvorak | yes | 21:33 |
| jlk | yeah, we don't use the packages | 21:35 |
| andrewbogott | ok, so if I want to do an in-place upgrade… I would remove the cloud-archive repo, and then do a distro upgrade. | 21:35 |
| *** markvoelker has quit IRC | 21:35 | |
| dvorak | in theory that should work | 21:35 |
| andrewbogott | Which in theory will upgrade my Ubuntu but leave OpenStack packages as they are? | 21:35 |
| andrewbogott | Yeah, ‘in theory’ :( | 21:35 |
| dvorak | I suspect it'll probably upgrade the packages to the latest trusty versions | 21:35 |
| *** markvoelker has joined #openstack-operators | 21:36 | |
| andrewbogott | It scares me but migrating all my VMs to new hosts also scares me | 21:36 |
| andrewbogott | dvorak: Ah, but that’s my question — aren’t the latest trusy version == the icehouse version in the precise cloud archive? | 21:36 |
| andrewbogott | I guess I should run experiments on all of this. Was hoping that someone here would say “I did that last month and it worked great!” | 21:37 |
| *** markvoelker has quit IRC | 21:40 | |
| *** markvoelker has joined #openstack-operators | 21:42 | |
| *** j05h has joined #openstack-operators | 21:45 | |
| dvorak | I think mgagne was talking about doing something similar earlier today | 21:46 |
| dvorak | but I think his was in the context of live migration | 21:46 |
| *** VW_ has quit IRC | 21:47 | |
| *** georgem1 has joined #openstack-operators | 21:47 | |
| *** VW_ has joined #openstack-operators | 21:47 | |
| andrewbogott | Yeah, building new compute nodes and then block-migrating is an option as well. | 21:49 |
| dvorak | that's generally what we would do | 21:52 |
| *** Marga_ has quit IRC | 21:53 | |
| *** radez is now known as radez_g0n3 | 21:53 | |
| andrewbogott | And I guess it’s not especially disruptive to switch to a new keystone or scheduler... | 21:56 |
| andrewbogott | the network node, on the other hand… I’m not sure how I move an instance from one to another | 21:56 |
| jlk | fun scenario time | 21:57 |
| jlk | running neutron, ml2 | 21:57 |
| dvorak | andrewbogott: what sort of networking are you doing? | 21:57 |
| jlk | single router | 21:57 |
| jlk | we're seeing all the firewall rules for all the instances get applied to the router host by way of linuxbridge-agent. | 21:57 |
| andrewbogott | nova-network, flat dhcp | 21:57 |
| jlk | even for ports that don't exist on that host | 21:58 |
| jlk | this makes neutron slow | 21:58 |
| mgagne | andrewbogott: my plan: precise/icehouse -> trusty/icehouse -> trusty/juno | 21:59 |
| andrewbogott | mgagne: that’s my plan too — you want to go first? :) | 21:59 |
| mgagne | andrewbogott: challenges are with QEMU upgrade and issues with live migration | 21:59 |
| mgagne | andrewbogott: I'm already working on it =) | 21:59 |
| mgagne | andrewbogott: and found this serious issue: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1425619 | 21:59 |
| openstack | Launchpad bug 1425619 in qemu (Ubuntu) "Migration fails between QEMU 1.5 and QEMU 2.0" [Undecided,Confirmed] | 21:59 |
| andrewbogott | are you upgrading in place, or moving to new hosts? | 21:59 |
| mgagne | andrewbogott: we have QEMU 1.0 and QEMU 1.5 in prod and soon QEMU 2.0. We wish to upgrade everything to QEMU 2.0 to ease operation and maintenance | 22:00 |
| andrewbogott | mgagne: so when you moved from precise to trusty, that upgrade qemu? | 22:00 |
| mgagne | andrewbogott: QEMU first since we need it to migrate compute nodes to trusty/qemu2.0 | 22:00 |
| mgagne | andrewbogott: as for the trusty upgrade itself: trash management nodes and recreate, live migrate instances to new compute nodes | 22:01 |
| andrewbogott | mgagne: on my systems… qemu-system 2.0.0+dfsg-2ubuntu1.6~cloud0 | 22:01 |
| andrewbogott | so I’m already running 2.0 it seems | 22:01 |
| andrewbogott | mgagne: what about networking? | 22:02 |
| mgagne | andrewbogott: did you install from scratch with icehouse? or are you coming from grizzly/havana? | 22:02 |
| mgagne | andrewbogott: we are using neutron since grizzly | 22:02 |
| andrewbogott | mgagne: I’ve upgrade incrementally lots of times. Since diablo | 22:02 |
| andrewbogott | Hm, wait, that’s not true, this cluster started out with havana | 22:03 |
| mgagne | andrewbogott: so I'm not sure how you ended up with qemu 2.0 without rebooting any instances | 22:03 |
| mgagne | andrewbogott: unless you jumped from qemu 1.0 to qemu 2.0 which is possible and works | 22:03 |
| andrewbogott | It seems to, I’ve certainly restarted instances since the upgrade. | 22:03 |
| andrewbogott | mgagne: so, even with neutron… how do you switch from one network node to another? (Or is each compute node also a network node?) | 22:04 |
| mgagne | andrewbogott: we don't have any network nodes =) | 22:04 |
| mgagne | andrewbogott: we use hardware | 22:04 |
| andrewbogott | ah, ok | 22:05 |
| andrewbogott | hm | 22:05 |
| mgagne | andrewbogott: much less trouble imo | 22:05 |
| andrewbogott | mgagne: can you tell me about your decision to live-migrade instances rather than upgrade the compute nodes in place? | 22:05 |
| mgagne | andrewbogott: less risky I would say. live migrate allows you to upgrade kernel and other critical packages | 22:06 |
| mgagne | andrewbogott: like open-iscsi | 22:06 |
| andrewbogott | you’re using ceph for instance storage? Or are you doing block-migrate? | 22:06 |
| mgagne | andrewbogott: most are boot from volume. | 22:07 |
| mgagne | andrewbogott: some are fully local, no shared storage. | 22:07 |
| andrewbogott | ok, so, block-migrate | 22:07 |
| mgagne | andrewbogott: it depends on the region | 22:07 |
| mgagne | andrewbogott: yes, probably | 22:07 |
| andrewbogott | That means service interruptions during the migrate, huh? | 22:07 |
| andrewbogott | That may be tolerable but will make my users sad | 22:07 |
| mgagne | andrewbogott: block migrate doesn't impact the service afaik | 22:08 |
| dvorak | andrewbogott: we use neutron w/OVS. To rebuild a network node (control node in our case), we just move all the routers from one to another | 22:08 |
| andrewbogott | block-migrate causes instances to suspend briefly during the final stage of the copy. Sometimes it’s several minutes | 22:08 |
| mgagne | andrewbogott: ok, our customers might not have heavy load on their instances then. | 22:09 |
| mgagne | andrewbogott: tbh, I'm not the one heavily using live-migrate in prod, my coworker is | 22:09 |
| andrewbogott | dvorak: What does ‘move all the routers’ consist of? | 22:09 |
| dvorak | not sure to be honest, we have a script where you tell it to do it and it does :) | 22:11 |
| dvorak | it moves all the routers on a given node to the node you tell it to, or we have one to balance across available nodes | 22:11 |
| *** Marga_ has joined #openstack-operators | 22:11 | |
| andrewbogott | hm… | 22:12 |
| andrewbogott | I supposed if I migrate everything, the new compute nodes can be configured to use the new network node | 22:12 |
| andrewbogott | so I can just abandon the old network node rather than moving anything in place. | 22:12 |
| andrewbogott | Damn, I am going to have to buy so many more servers now :( | 22:13 |
| *** Marga_ has quit IRC | 22:17 | |
| *** georgem1 has quit IRC | 22:31 | |
| *** esker has quit IRC | 22:33 | |
| *** csoukup has quit IRC | 22:35 | |
| *** hj-hp has quit IRC | 22:37 | |
| *** hj-hp has joined #openstack-operators | 22:39 | |
| *** cdelatte has joined #openstack-operators | 22:40 | |
| *** emagana has quit IRC | 22:40 | |
| *** emagana has joined #openstack-operators | 22:41 | |
| *** emagana has quit IRC | 22:45 | |
| *** matrohon has quit IRC | 22:46 | |
| *** Marga_ has joined #openstack-operators | 22:48 | |
| *** hj-hp has quit IRC | 22:49 | |
| *** Marga__ has joined #openstack-operators | 22:51 | |
| *** Marga_ has quit IRC | 22:52 | |
| *** cpschult has quit IRC | 22:54 | |
| *** j05h has quit IRC | 22:59 | |
| *** hj-hp has joined #openstack-operators | 23:00 | |
| *** signed8b_ has joined #openstack-operators | 23:05 | |
| *** signed8bit has quit IRC | 23:07 | |
| *** hj-hp has quit IRC | 23:10 | |
| *** reed has quit IRC | 23:13 | |
| *** j05h has joined #openstack-operators | 23:23 | |
| *** j05h has quit IRC | 23:27 | |
| *** j05h has joined #openstack-operators | 23:28 | |
| *** markvoelker has quit IRC | 23:42 | |
| *** markvoelker has joined #openstack-operators | 23:42 | |
| *** markvoelker has quit IRC | 23:47 | |
| *** signed8b_ is now known as signed8bit_ZZZzz | 23:48 | |
| *** markvoelker has joined #openstack-operators | 23:49 | |
| *** Piet has quit IRC | 23:49 | |
| *** blair has quit IRC | 23:51 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!