| *** Marga__ has quit IRC | 00:02 | |
| *** Marga_ has joined #openstack-operators | 00:02 | |
| *** Marga_ has quit IRC | 00:03 | |
| *** Marga_ has joined #openstack-operators | 00:04 | |
| mdorman | we have it mostly done in dev | 00:04 |
|---|---|---|
| mdorman | we’ve had to spend a few days porting over our custom scheduler patches to juno. there was quite a bit of change in that code base since icehouse | 00:04 |
| mdorman | seems like a good approach re: rmq. i just wish the clients were better at handling these situations in teh first place. | 00:05 |
| *** Marga_ has quit IRC | 00:06 | |
| *** Marga_ has joined #openstack-operators | 00:06 | |
| *** Marga_ has quit IRC | 00:07 | |
| *** Marga_ has joined #openstack-operators | 00:07 | |
| *** blair has quit IRC | 00:07 | |
| *** Piet has joined #openstack-operators | 00:10 | |
| *** Marga_ has quit IRC | 00:10 | |
| *** reed_ has quit IRC | 00:10 | |
| *** Marga_ has joined #openstack-operators | 00:11 | |
| *** Marga_ has quit IRC | 00:11 | |
| *** Marga_ has joined #openstack-operators | 00:11 | |
| *** Marga_ has quit IRC | 00:12 | |
| *** Marga_ has joined #openstack-operators | 00:12 | |
| *** SimonChung1 has joined #openstack-operators | 00:16 | |
| *** SimonChung has quit IRC | 00:16 | |
| *** Marga_ has quit IRC | 00:21 | |
| *** Marga_ has joined #openstack-operators | 00:21 | |
| *** david-lyle has joined #openstack-operators | 00:25 | |
| *** Marga_ has quit IRC | 00:26 | |
| *** esker has joined #openstack-operators | 00:27 | |
| *** dmsimard is now known as dmsimard_away | 00:29 | |
| *** esker has quit IRC | 00:31 | |
| *** sbadia has joined #openstack-operators | 00:40 | |
| *** mdorman has quit IRC | 00:41 | |
| *** mdorman has joined #openstack-operators | 00:41 | |
| *** SimonChung has joined #openstack-operators | 00:44 | |
| *** SimonChung1 has quit IRC | 00:44 | |
| *** SimonChung has quit IRC | 00:46 | |
| *** mdorman has quit IRC | 00:48 | |
| *** mdorman has joined #openstack-operators | 00:48 | |
| *** alop has quit IRC | 00:48 | |
| *** SimonChung has joined #openstack-operators | 00:50 | |
| *** emagana has quit IRC | 00:53 | |
| *** mdorman has quit IRC | 00:53 | |
| *** emagana has joined #openstack-operators | 00:53 | |
| *** VW__ has quit IRC | 00:53 | |
| *** mdorman has joined #openstack-operators | 00:54 | |
| *** emagana has quit IRC | 00:58 | |
| dvorak | we're going to do the control plane upgrades in dev tomorrow, staging next week if everything goes well | 00:59 |
| mdorman | cool. let us know how it goes or if you get stuck on anything. i have a bunch of notes, but haven’t posted them publically anywhere yet | 01:00 |
| mdorman | heading out now, though, have a good night. | 01:01 |
| *** mdorman has quit IRC | 01:01 | |
| *** david-lyle has quit IRC | 01:08 | |
| *** blair has joined #openstack-operators | 01:08 | |
| *** j05h has quit IRC | 01:09 | |
| *** blair has quit IRC | 01:13 | |
| *** Guest97735 is now known as mfisch | 01:20 | |
| *** mfisch has joined #openstack-operators | 01:20 | |
| *** david-lyle has joined #openstack-operators | 01:26 | |
| *** SimonChung has quit IRC | 01:30 | |
| jlk | we're doing havana -> juno | 01:34 |
| *** openstack has joined #openstack-operators | 01:35 | |
| *** dmsimard_away is now known as dmsimard | 01:53 | |
| *** dmsimard is now known as dmsimard_away | 02:00 | |
| *** david-lyle has quit IRC | 02:01 | |
| dvorak | ok, wow | 02:02 |
| dvorak | we're doing icehouse -> juno | 02:02 |
| *** blair has joined #openstack-operators | 02:09 | |
| *** blair has quit IRC | 02:14 | |
| *** david-lyle has joined #openstack-operators | 02:42 | |
| *** david-lyle has quit IRC | 02:42 | |
| *** Marga_ has joined #openstack-operators | 02:44 | |
| *** Marga_ has quit IRC | 02:46 | |
| *** Marga__ has joined #openstack-operators | 02:46 | |
| *** blair has joined #openstack-operators | 02:49 | |
| *** harlowja is now known as harlowja_away | 02:57 | |
| *** dmsimard_away is now known as dmsimard | 03:03 | |
| *** Marga__ has quit IRC | 03:08 | |
| *** dmsimard is now known as dmsimard_away | 03:15 | |
| *** Marga_ has joined #openstack-operators | 03:45 | |
| *** signed8bit has joined #openstack-operators | 03:45 | |
| *** fifieldt__ has joined #openstack-operators | 04:16 | |
| *** Marga_ has quit IRC | 04:34 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 04:54 | |
| *** signed8bit_ZZZzz has quit IRC | 04:56 | |
| jlk | I have an ansible playbook that does the move, also upgrading percona 5.5 to 5.6, and moving to clustered rabbit. Does it all live, and the outages are fairly minimal. | 05:20 |
| jlk | we were already on neutron, so there's that, and we're doing ovs -> ml2 in a different upgrade before the openstack upgrade. | 05:20 |
| *** blair has quit IRC | 07:18 | |
| *** belmoreira has joined #openstack-operators | 07:44 | |
| *** Miouge has joined #openstack-operators | 07:52 | |
| *** blair has joined #openstack-operators | 08:19 | |
| *** blair has quit IRC | 08:23 | |
| *** derekh has joined #openstack-operators | 09:26 | |
| *** racedo_ has joined #openstack-operators | 09:31 | |
| *** racedo_ is now known as racedo | 09:32 | |
| *** avozza is now known as zz_avozza | 09:35 | |
| *** zz_avozza is now known as avozza | 09:35 | |
| *** avozza is now known as zz_avozza | 09:36 | |
| *** zz_avozza is now known as avozza | 09:37 | |
| *** blair has joined #openstack-operators | 09:44 | |
| *** david-lyle has joined #openstack-operators | 09:46 | |
| *** avozza is now known as zz_avozza | 09:48 | |
| *** blair has quit IRC | 09:49 | |
| *** david-lyle has quit IRC | 10:08 | |
| *** bvandenh has joined #openstack-operators | 10:08 | |
| *** bvandenh has quit IRC | 10:35 | |
| *** bvandenh has joined #openstack-operators | 10:36 | |
| *** pasquier-s has quit IRC | 10:39 | |
| *** pasquier-s has joined #openstack-operators | 10:39 | |
| *** bvandenh has quit IRC | 10:41 | |
| *** bvandenh has joined #openstack-operators | 10:42 | |
| *** david-lyle has joined #openstack-operators | 11:17 | |
| *** dmsimard_away is now known as dmsimard | 12:05 | |
| *** pboros has joined #openstack-operators | 12:27 | |
| *** bvandenh has quit IRC | 12:44 | |
| *** signed8bit has joined #openstack-operators | 12:54 | |
| *** esker has joined #openstack-operators | 13:01 | |
| *** david-lyle has quit IRC | 13:11 | |
| *** Marga_ has joined #openstack-operators | 13:24 | |
| *** emagana has joined #openstack-operators | 13:28 | |
| *** signed8bit has quit IRC | 13:29 | |
| *** jaypipes has joined #openstack-operators | 13:35 | |
| *** jaypipes is now known as leakypipes | 13:49 | |
| *** puck` has quit IRC | 13:55 | |
| *** Miouge_ has joined #openstack-operators | 13:56 | |
| *** puck has joined #openstack-operators | 13:56 | |
| *** Miouge has quit IRC | 13:59 | |
| *** Miouge_ is now known as Miouge | 13:59 | |
| *** xavpaice has quit IRC | 14:02 | |
| *** xavpaice has joined #openstack-operators | 14:16 | |
| *** bvandenh has joined #openstack-operators | 14:28 | |
| *** radez_g0` is now known as radez_g0n3 | 14:34 | |
| *** radez_g0n3 is now known as radez | 14:37 | |
| *** VW_ has joined #openstack-operators | 14:38 | |
| *** emagana has quit IRC | 15:00 | |
| *** emagana has joined #openstack-operators | 15:00 | |
| *** bvandenh has quit IRC | 15:03 | |
| *** zz_avozza is now known as avozza | 15:04 | |
| *** emagana has quit IRC | 15:05 | |
| *** j05h has joined #openstack-operators | 15:35 | |
| *** j05h has quit IRC | 15:39 | |
| *** j05h has joined #openstack-operators | 15:39 | |
| *** mdorman has joined #openstack-operators | 15:40 | |
| *** avozza is now known as zz_avozza | 15:44 | |
| *** emagana has joined #openstack-operators | 15:45 | |
| *** emagana has quit IRC | 15:55 | |
| *** emagana has joined #openstack-operators | 15:56 | |
| *** klindgren_ has quit IRC | 15:56 | |
| *** klindgren_ has joined #openstack-operators | 15:57 | |
| *** emagana has quit IRC | 16:00 | |
| *** emagana has joined #openstack-operators | 16:04 | |
| *** Miouge has quit IRC | 16:19 | |
| *** Miouge has joined #openstack-operators | 16:21 | |
| *** j05h has quit IRC | 16:23 | |
| *** zz_avozza is now known as avozza | 16:38 | |
| *** alop has joined #openstack-operators | 16:45 | |
| *** dmsimard is now known as dmsimard_away | 16:46 | |
| *** dmsimard_away is now known as dmsimard | 16:47 | |
| *** radez is now known as radez_g0n3 | 16:49 | |
| *** belmoreira has quit IRC | 16:53 | |
| *** emagana has quit IRC | 16:59 | |
| *** emagana has joined #openstack-operators | 17:00 | |
| *** emagana_ has joined #openstack-operators | 17:03 | |
| *** emagana has quit IRC | 17:04 | |
| *** Marga_ has quit IRC | 17:10 | |
| *** pasquier-s has quit IRC | 17:27 | |
| *** derekh has quit IRC | 17:31 | |
| *** Marga_ has joined #openstack-operators | 17:41 | |
| *** Marga_ has quit IRC | 17:41 | |
| *** Marga_ has joined #openstack-operators | 17:42 | |
| dvorak | are you running galera? | 18:00 |
| *** bvandenh has joined #openstack-operators | 18:00 | |
| *** Miouge has quit IRC | 18:00 | |
| dvorak | the issue for us doing the upgrades is the database migrations mostly | 18:00 |
| *** Marga_ has quit IRC | 18:00 | |
| dvorak | since you end up with mixed code and db versions | 18:00 |
| *** bvandenh has quit IRC | 18:01 | |
| dvorak | we run 3 control nodes, shut down services on two of them, then upgrade the remaining one | 18:01 |
| *** Marga_ has joined #openstack-operators | 18:01 | |
| *** bvandenh has joined #openstack-operators | 18:01 | |
| dvorak | the outage is however long it takes to upgrade packages and databases | 18:01 |
| *** bvandenh has quit IRC | 18:01 | |
| *** Marga_ has quit IRC | 18:02 | |
| *** Marga_ has joined #openstack-operators | 18:03 | |
| *** VW_ has quit IRC | 18:07 | |
| *** Miouge has joined #openstack-operators | 18:17 | |
| *** harlowja_away is now known as harlowja | 18:18 | |
| *** Marga_ has quit IRC | 18:26 | |
| *** Marga_ has joined #openstack-operators | 18:27 | |
| *** puck has quit IRC | 18:32 | |
| *** puck has joined #openstack-operators | 18:33 | |
| *** Marga_ has quit IRC | 18:34 | |
| *** Marga_ has joined #openstack-operators | 18:34 | |
| *** xavpaice has quit IRC | 18:35 | |
| *** Marga__ has joined #openstack-operators | 18:35 | |
| *** Marga__ has quit IRC | 18:35 | |
| *** Marga_ has quit IRC | 18:36 | |
| *** Marga_ has joined #openstack-operators | 18:36 | |
| *** Marga_ has quit IRC | 18:42 | |
| *** Marga_ has joined #openstack-operators | 18:42 | |
| *** Marga_ has quit IRC | 18:43 | |
| *** Marga_ has joined #openstack-operators | 18:43 | |
| *** Marga_ has quit IRC | 18:48 | |
| *** Marga_ has joined #openstack-operators | 18:48 | |
| *** Marga_ has quit IRC | 18:50 | |
| *** Marga_ has joined #openstack-operators | 18:50 | |
| *** Marga_ has quit IRC | 18:55 | |
| *** Marga_ has joined #openstack-operators | 18:55 | |
| *** radez_g0n3 is now known as radez | 18:59 | |
| *** Marga_ has quit IRC | 19:03 | |
| *** Marga_ has joined #openstack-operators | 19:03 | |
| *** Marga_ has quit IRC | 19:04 | |
| *** xavpaice has joined #openstack-operators | 19:04 | |
| *** Marga_ has joined #openstack-operators | 19:04 | |
| *** avozza is now known as zz_avozza | 19:05 | |
| *** Marga_ has quit IRC | 19:10 | |
| *** Marga_ has joined #openstack-operators | 19:10 | |
| *** SimonChung has joined #openstack-operators | 19:13 | |
| *** Marga_ has quit IRC | 19:14 | |
| *** Marga_ has joined #openstack-operators | 19:14 | |
| *** zz_avozza is now known as avozza | 19:20 | |
| *** racedo has quit IRC | 19:28 | |
| *** Marga_ has quit IRC | 19:29 | |
| *** Marga_ has joined #openstack-operators | 19:29 | |
| *** Marga_ has quit IRC | 19:30 | |
| *** Marga_ has joined #openstack-operators | 19:30 | |
| *** avozza is now known as zz_avozza | 19:31 | |
| klindgren_ | Anyone here using ipset in neutron? | 19:35 |
| klindgren_ | and has it working? | 19:36 |
| klindgren_ | I just got done debugging something where everytime ipset=True was enabled vif_type=binding failed | 19:36 |
| klindgren_ | even though I could see the ipset command being succesfully ran by neutron and neutron didn't report any errors | 19:36 |
| klindgren_ | and an ipset list shows the ipsets being created | 19:37 |
| *** VW_ has joined #openstack-operators | 19:37 | |
| jlk | we're using it | 19:37 |
| jlk | we have to be running a sufficiently new enough ipset for neutron to be happy | 19:37 |
| jlk | and for sure it's ipset usage generating your binding_failed issues? | 19:37 |
| *** Marga_ has quit IRC | 19:40 | |
| *** Marga_ has joined #openstack-operators | 19:40 | |
| *** Marga_ has quit IRC | 19:49 | |
| *** Marga_ has joined #openstack-operators | 19:49 | |
| *** VW_ has quit IRC | 19:52 | |
| *** Marga_ has quit IRC | 19:53 | |
| *** Marga_ has joined #openstack-operators | 19:53 | |
| *** signed8bit has joined #openstack-operators | 19:57 | |
| *** Marga_ has quit IRC | 19:57 | |
| *** Marga_ has joined #openstack-operators | 19:57 | |
| *** Marga_ has quit IRC | 20:06 | |
| *** Marga_ has joined #openstack-operators | 20:07 | |
| *** VW_ has joined #openstack-operators | 20:07 | |
| *** blair has joined #openstack-operators | 20:07 | |
| *** radez is now known as radez_g0n3 | 20:12 | |
| *** VW_ has quit IRC | 20:13 | |
| *** VW_ has joined #openstack-operators | 20:14 | |
| *** radez_g0n3 is now known as radez | 20:15 | |
| *** zz_avozza is now known as avozza | 20:23 | |
| *** pboros has quit IRC | 20:26 | |
| *** Marga_ has quit IRC | 20:29 | |
| *** Marga_ has joined #openstack-operators | 20:30 | |
| *** Marga_ has quit IRC | 20:30 | |
| *** Marga_ has joined #openstack-operators | 20:31 | |
| *** avozza is now known as zz_avozza | 20:32 | |
| *** signed8bit has quit IRC | 20:36 | |
| *** signed8bit has joined #openstack-operators | 20:42 | |
| *** VW_ has quit IRC | 20:43 | |
| *** VW_ has joined #openstack-operators | 20:43 | |
| *** Marga_ has quit IRC | 20:52 | |
| *** signed8bit has quit IRC | 21:00 | |
| *** csoukup has joined #openstack-operators | 21:02 | |
| *** emagana_ has quit IRC | 21:02 | |
| *** SimonChung1 has joined #openstack-operators | 21:02 | |
| *** SimonChung has quit IRC | 21:03 | |
| *** emagana has joined #openstack-operators | 21:03 | |
| *** SimonChung1 has quit IRC | 21:03 | |
| *** SimonChung has joined #openstack-operators | 21:03 | |
| *** SimonChung1 has joined #openstack-operators | 21:04 | |
| *** SimonChung has quit IRC | 21:04 | |
| *** SimonChung has joined #openstack-operators | 21:04 | |
| *** SimonChung1 has quit IRC | 21:04 | |
| *** emagana has quit IRC | 21:04 | |
| *** emagana has joined #openstack-operators | 21:05 | |
| *** SimonChung1 has joined #openstack-operators | 21:05 | |
| *** SimonChung has quit IRC | 21:05 | |
| *** emagana has quit IRC | 21:09 | |
| *** emagana has joined #openstack-operators | 21:15 | |
| klindgren_ | jlk - I htoguht it was - but further testing seemed to indicate an error in our custom code. I thought it was ipset because - I disabled it, restarted neutron and the next few vm deploys worked. | 21:16 |
| klindgren_ | But then they started failing again :-/ | 21:17 |
| klindgren_ | pretty sure we narrowed it down to customer scheduler code trying to deploy a vm to a HV that couldn't support the asked for network. | 21:18 |
| *** zz_avozza is now known as avozza | 21:23 | |
| jlk | ah | 21:24 |
| *** VW__ has joined #openstack-operators | 21:33 | |
| *** VW_ has quit IRC | 21:33 | |
| *** VW__ has quit IRC | 21:33 | |
| *** VW_ has joined #openstack-operators | 21:34 | |
| *** leakypipes has quit IRC | 21:38 | |
| *** radez is now known as radez_g0n3 | 21:41 | |
| *** csoukup has quit IRC | 21:57 | |
| *** avozza is now known as zz_avozza | 21:57 | |
| *** csoukup has joined #openstack-operators | 22:11 | |
| *** Marga_ has joined #openstack-operators | 22:13 | |
| *** Marga_ has quit IRC | 22:15 | |
| *** Marga_ has joined #openstack-operators | 22:16 | |
| *** SimonChung1 has quit IRC | 22:19 | |
| *** j05h has joined #openstack-operators | 22:23 | |
| *** blair has quit IRC | 22:24 | |
| *** dmsimard is now known as dmsimard_away | 22:39 | |
| *** sk91 has joined #openstack-operators | 22:40 | |
| sk91 | Hi, anybody knows how to solve nova network-create ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) ? i have gathered all log informations on https://ask.openstack.org/en/question/58558/nova-network-create-error-the-server-has-either-erred-or-is-incapable-of-performing-the-requested-operation-http-500/ | 22:41 |
| *** SimonChung has joined #openstack-operators | 22:44 | |
| *** Marga_ has quit IRC | 22:45 | |
| *** Marga_ has joined #openstack-operators | 22:45 | |
| *** SimonChung1 has joined #openstack-operators | 22:53 | |
| *** SimonChung has quit IRC | 22:53 | |
| *** Marga_ has quit IRC | 22:54 | |
| *** Marga_ has joined #openstack-operators | 22:54 | |
| *** signed8bit has joined #openstack-operators | 22:59 | |
| *** csoukup has quit IRC | 23:00 | |
| *** emagana has quit IRC | 23:04 | |
| *** emagana has joined #openstack-operators | 23:04 | |
| *** zz_avozza is now known as avozza | 23:07 | |
| *** avozza is now known as zz_avozza | 23:08 | |
| *** emagana has quit IRC | 23:09 | |
| *** emagana has joined #openstack-operators | 23:11 | |
| *** VW_ has quit IRC | 23:16 | |
| *** zz_avozza is now known as avozza | 23:19 | |
| *** blair has joined #openstack-operators | 23:25 | |
| *** blair has quit IRC | 23:30 | |
| *** Marga_ has quit IRC | 23:39 | |
| *** emagana has quit IRC | 23:39 | |
| *** Marga_ has joined #openstack-operators | 23:40 | |
| *** emagana has joined #openstack-operators | 23:40 | |
| *** signed8bit has quit IRC | 23:41 | |
| *** emagana has quit IRC | 23:44 | |
| *** VW_ has joined #openstack-operators | 23:47 | |
| *** avozza is now known as zz_avozza | 23:49 | |
| *** sk91 has quit IRC | 23:51 | |
| *** dmsimard_away is now known as dmsimard | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!