Wednesday, 2015-02-11

« Tuesday, 2015-02-10 Index Thursday, 2015-02-12 »
*** dmsimard is now known as dmsimard_away00:01
*** markvoelker has quit IRC00:17
*** j05h has quit IRC00:20
*** mdorman has quit IRC00:29
*** j05h has joined #openstack-operators00:34
*** SimonChung1 has joined #openstack-operators00:34
*** SimonChung has quit IRC00:34
*** Piet has quit IRC00:48
*** signed8bit is now known as signed8bit_ZZZzz00:49
*** markvoelker has joined #openstack-operators00:52
*** markvoelker has quit IRC00:56
*** markvoelker_ has joined #openstack-operators00:56
*** j05h has quit IRC01:10
*** VW_ has quit IRC01:15
*** RaginBajin has joined #openstack-operators01:16
*** blairo has joined #openstack-operators01:19
*** blair has quit IRC01:22
*** blairo has quit IRC01:23
*** david-lyle has quit IRC01:26
*** Piet has joined #openstack-operators01:27
*** RaginBajin has quit IRC01:34
*** raginbaj- has joined #openstack-operators01:34
*** raginbaj- is now known as raginbajin01:34
*** SimonChung has joined #openstack-operators01:36
*** SimonChung1 has quit IRC01:36
*** klindgren_ has joined #openstack-operators01:40
*** blair has joined #openstack-operators01:42
*** klindgren has quit IRC01:44
*** SimonChung has quit IRC01:49
*** raginbajin has quit IRC01:51
*** raginbajin has joined #openstack-operators01:52
*** Marga_ has quit IRC01:54
*** Marga_ has joined #openstack-operators01:54
*** david-lyle has joined #openstack-operators02:08
*** Marga_ has quit IRC02:10
*** Marga_ has joined #openstack-operators02:11
david-lyler1chardj0n3s: is https://review.openstack.org/#/c/141273 your highest priority patch to merge?02:27
*** Marga_ has quit IRC02:33
*** david-lyle has quit IRC02:46
*** harlowja is now known as harlowja_away02:46
*** david-lyle has joined #openstack-operators02:50
*** signed8bit_ZZZzz has quit IRC02:54
*** blair has quit IRC03:02
*** blair has joined #openstack-operators03:09
*** Marga_ has joined #openstack-operators03:25
*** david-lyle has quit IRC03:31
*** VW_ has joined #openstack-operators03:32
*** Marga_ has quit IRC04:03
*** Marga_ has joined #openstack-operators04:04
*** blair has quit IRC04:09
*** david-lyle has joined #openstack-operators04:09
*** wabu has quit IRC04:42
*** wabu has joined #openstack-operators04:43
*** avozza is now known as zz_avozza04:55
*** zz_avozza is now known as avozza04:56
*** klindgren__ has joined #openstack-operators05:02
*** klindgren_ has quit IRC05:05
*** sanjayu has joined #openstack-operators05:12
*** blair has joined #openstack-operators05:29
*** sanjayu has quit IRC05:44
*** alop has quit IRC05:46
*** blair has quit IRC05:59
*** sanjayu has joined #openstack-operators06:10
*** blair has joined #openstack-operators06:11
*** VW_ has quit IRC06:12
*** blair has quit IRC06:45
*** markvoelker_ has quit IRC07:28
*** Miouge has joined #openstack-operators07:40
*** avozza is now known as zz_avozza07:44
*** belmoreira has joined #openstack-operators07:51
*** blair has joined #openstack-operators07:57
*** blair has quit IRC08:09
*** zz_avozza is now known as avozza08:16
*** blair has joined #openstack-operators08:36
*** blair has quit IRC08:47
*** belmoreira has quit IRC08:51
*** bvandenh has joined #openstack-operators09:13
*** derekh has joined #openstack-operators09:22
*** belmoreira has joined #openstack-operators09:55
*** blair has joined #openstack-operators10:04
*** blair has quit IRC10:21
*** Miouge_ has joined #openstack-operators11:48
*** Miouge has quit IRC11:49
*** Miouge_ is now known as Miouge11:49
*** Miouge has quit IRC11:52
*** reed has joined #openstack-operators11:55
*** Miouge has joined #openstack-operators12:24
*** Miouge has quit IRC12:32
*** Miouge has joined #openstack-operators12:49
*** markvoelker has joined #openstack-operators12:51
*** VW_ has joined #openstack-operators13:22
*** VW_ has quit IRC13:23
*** sanjayu has quit IRC14:23
*** radez is now known as radez_g0n314:25
*** signed8bit has joined #openstack-operators14:26
*** j05h has joined #openstack-operators14:26
*** j05h has quit IRC14:28
*** j05h has joined #openstack-operators14:29
*** ctina has joined #openstack-operators14:30
*** signed8bit has quit IRC14:32
*** signed8bit has joined #openstack-operators14:37
*** VW_ has joined #openstack-operators14:42
*** Piet has quit IRC15:18
*** mdorman has joined #openstack-operators15:22
*** j05h has quit IRC15:26
*** beddari has quit IRC15:36
*** beddari has joined #openstack-operators15:39
*** Piet has joined #openstack-operators15:40
*** emagana has joined #openstack-operators15:44
*** beddari has quit IRC15:53
*** j05h has joined #openstack-operators16:15
*** Piet has quit IRC16:17
*** radez_g0n3 is now known as radez16:25
*** klindgren__ is now known as klindgren16:26
*** VW_ has quit IRC16:29
*** j05h has quit IRC16:29
*** VW_ has joined #openstack-operators16:30
*** VW_ has quit IRC16:34
*** j05h has joined #openstack-operators16:41
*** Marga_ has quit IRC16:47
*** dmsimard_away is now known as dmsimard16:47
*** Piet has joined #openstack-operators16:48
*** VW_ has joined #openstack-operators16:56
*** SimonChung has joined #openstack-operators17:01
*** alop has joined #openstack-operators17:09
*** ctina has quit IRC17:11
*** ctina has joined #openstack-operators17:14
*** derekh has quit IRC17:25
*** cpschult has joined #openstack-operators17:40
*** Marga_ has joined #openstack-operators17:47
*** harlowja_away is now known as harlowja17:47
mfischmay have asked this before, but does anyone here at all use heat?17:54
jlkI think we have it in our offering, but we may not have it enabled for anybody17:57
jlkwe don't use it ourselves, that's what Ansible is for :)17:57
mdormansame here, we have it set up but pretty sure nobody uses it17:58
*** Piet has quit IRC18:00
mdormanjlk:  along the lines of the recent thread about cafile setting…  do you know off the top of your head where/how the cafile should be configured such that the command line tools will use the proper cafile for validation?   specifically the keystone cli tool is what i’m fighting against now18:01
jlkgood question!18:01
mdormanhah18:01
mdorman--os_cacert on the command line.  but how to put that in a conf file18:03
*** SimonChung has quit IRC18:03
*** SimonChung1 has joined #openstack-operators18:03
jlkOS_CACERT=/etc/ssl/my-root-cert.pem18:03
jlkoh in a conf file...18:03
jlkdidn't know they read from a conf18:03
mdormanyeah maybe they don't18:06
mdormansee, it’s supposed to default ot using the system ca bundle18:06
mdormanwhich i thought was /etc/pki/tls/certs/ca-bundle.crt18:06
mdormani mean that’s what curl uses.  but i think urllib3 uses something else.  b/c curl works, but python clients don't18:06
klindgrenstrace!18:07
mdormangood idea kris18:09
mdormanit’d be pretty frustrating if this rquires another command line argument.  b/c then it’s going to require retooing all the keystone resource puppet providers18:09
*** SimonChung has joined #openstack-operators18:18
*** SimonChung1 has quit IRC18:18
jlkah18:18
jlkpython on some platforms has their own CA bundle18:18
jlkin some of our set ups, we were symlinkin python requests's CA bundle to the system CA bundle, /etc/ssl/certs/ca-certificates or something. Now we just specifically point to our CA file in API configs18:19
jlkmdorman: how are you passing along auth details? User/pass/tenant?18:19
mdormani believe in teh puppet providers it just sticks tthe user and pass on the command line18:22
mdormanyeah i suspect python is using it’s own ca bundle18:22
mdormanso thinking along those same lines, figure out where that is and symlink18:22
*** bvandenh has quit IRC18:23
verdurinThere's an [ssl] section in keystone.conf where you can configure this18:24
verdurincertfile=, keyfile=, ca_certs= etc.18:25
mdormanverdurin:   right, but when running the keystone command line tool, it only grabs options from the command line, not from the conf file (as far as i can tell)18:26
mdormanfyi /usr/lib/python2.7/site-packages/requests/cacert.pem ftw.  dropped my other certs in there, and success!18:27
jlkverdurin: that's not exactly the same18:27
jlkverdurin: keystone client doesn't read keystone.conf file18:28
*** SimonChung1 has joined #openstack-operators18:29
*** SimonChung has quit IRC18:29
*** emagana has quit IRC18:30
*** SimonChung has joined #openstack-operators18:30
*** SimonChung1 has quit IRC18:30
*** emagana has joined #openstack-operators18:30
*** SimonChung has quit IRC18:30
*** SimonChung1 has joined #openstack-operators18:30
*** david-lyle is now known as david-lyle_afk18:31
*** emagana has quit IRC18:31
*** emagana has joined #openstack-operators18:31
*** avozza is now known as zz_avozza18:33
*** Piet has joined #openstack-operators18:39
*** Piet has quit IRC18:42
*** Miouge has quit IRC18:44
*** Piet has joined #openstack-operators18:54
*** SimonChung has joined #openstack-operators18:56
*** SimonChung1 has quit IRC18:56
*** emagana has quit IRC18:58
*** emagana has joined #openstack-operators18:59
*** emagana has quit IRC19:02
*** emagana has joined #openstack-operators19:03
*** belmoreira has quit IRC19:03
klindgrenDid anyone ever figure out why with neutron you must install every plugin just to do a db sync?19:04
*** VW__ has joined #openstack-operators19:04
*** VW__ has quit IRC19:04
klindgrenSeem's crazy to install everything - just to uninstall it later.19:05
*** VW__ has joined #openstack-operators19:05
*** VW_ has quit IRC19:05
jlkwhat?19:06
jlkno...19:06
jlkwe only have the ml2 plugin installed and that's what we use19:06
*** zz_avozza is now known as avozza19:06
jlkwe reference neutron.conf and ml2 config in the neutron-manage call19:06
klindgrenfrom icehouse -> juno19:11
klindgrenfor db-upgrade19:11
jlkyeah19:11
jlkwe do havana -> juno that way19:11
klindgrenit would blow up if we didn't have all hte plugins installed19:11
jlkthat's... odd19:11
jlkhttps://github.com/blueboxgroup/ursula/blob/master/roles/neutron-control/tasks/main.yml#L2519:12
jlkWe do this just before as well https://github.com/blueboxgroup/ursula/blob/master/upgrade.yml#L23419:12
*** Piet has quit IRC19:14
klindgrenneutron-db-manage --config-file /etc/neutron/neutron.conf --config-file <your plugin config file> current19:15
klindgrenneutron-db-manage --config-file /etc/neutron/neutron.conf --config-file <your plugin config file> upgrade juno19:15
*** signed8bit is now known as signed8bit_ZZZzz19:15
klindgrenis what we are doing19:15
*** signed8bit_ZZZzz is now known as signed8bit19:15
jlkcurrent just reports things, doesn't actually /do/ anything19:15
klindgrenbut that command only works if we install all the plugins - like bigswitch, brocade, cisco, ovs, ect ect19:15
*** Piet has joined #openstack-operators19:16
jlkanybody know where in nova code the services table gets created, populated?19:31
mfischklindgren: we also dont have that problem19:35
mfischklindgren: we also stamped like jlk said, we did that weeks ago,19:36
*** VW__ has quit IRC19:36
*** Marga_ has quit IRC19:41
*** VW_ has joined #openstack-operators19:41
klindgrenhrm19:43
klindgrenyou guys are using ubuntu packages?19:44
jlkno19:46
jlk.... and now I find myself reading up on how python implements socket.gethostname()19:46
klindgrenjust apply the glibc updates and reboot ;-)19:47
jlknot for that19:47
jlkTrying to determine impact of changing the hostname of a system19:47
jlkon some systems the short hostname was defined as foo.bar19:47
jlkwe want to change it so that shortname is foo, full name is foo.bar19:47
jlkbut I don't know how python is getting the hostname that it openstack uses for the services tables and other things19:48
mfischklindgren: we are using ubuntu packages19:50
klindgrenjlk - you are using venv's?19:50
jlkklindgren: we will soon, but right now it's git clones + pip installs19:51
*** SimonChung1 has joined #openstack-operators19:51
*** SimonChung has quit IRC19:51
*** david-lyle_afk is now known as david-lyle19:51
dvorakmdorman: the puppet providers all pass username/password/etc via the environment19:58
dvorakjlk: last I looked into the migrations, there is some conditional code in there around which plugins are configured.  maybe that's related19:59
*** emagana has quit IRC20:03
*** cdelatte has joined #openstack-operators20:05
klindgrenwondering if I am missing a specifc config directive in the neutron.conf20:05
*** cdelatte has quit IRC20:06
*** cdelatte has joined #openstack-operators20:06
*** cdelatte has quit IRC20:07
*** cdelatte has joined #openstack-operators20:07
*** emagana has joined #openstack-operators20:09
jlkklindgren: what do you have for core_plugin ?20:11
klindgrencore_plugin=neutron.plugins.ml2.plugin.Ml2Plugin20:12
*** Marga_ has joined #openstack-operators20:12
jlkhrm.20:12
jlkyeah20:12
*** emagana has quit IRC20:13
*** Marga_ has quit IRC20:14
*** Marga_ has joined #openstack-operators20:14
*** Marga_ has quit IRC20:18
*** emagana has joined #openstack-operators20:22
dvorakjlk: have you stamped the db?20:31
dvorakours wasn't stamped, I think because of a bug in the puppet modules20:31
jlkdvorak: we stamp ours as part of the upgrade from havana yes.20:33
jlkafter that we won't stamp it20:33
dvorakwell, in theory you shouldn't ever need to20:33
dvorakbut yeah, that's how we did ours too20:33
jlkyeah, theory. However20:33
jlkthe upgrade guides tell you to stamp it, so...20:33
dvorakI was just wondering, because when I hadn't stamped ours, it exploded when I ran upgrade :)20:33
dvorakbah, who reads the upgrade guide?20:34
dvorakactually, I don't think there is an upgrade guide for juno20:34
dvorakwhich seems kind of crazy20:34
jlksure there is20:34
jlkhttps://wiki.openstack.org/wiki/ReleaseNotes/Juno20:35
jlkhttps://wiki.openstack.org/wiki/ReleaseNotes/Juno#Upgrade_Notes_620:35
dvorakapparently you're right.  I couldn't easily find it when I looked a few weeks ago20:36
dvorakwe did our upgrade mostly based on the release notes and experimentation20:36
jlkI've stared at them a lot over the past month or so20:36
dvorakeh, I wouldn't call that an upgrade guide :)20:36
jlkupgrade hints :)20:37
dvorakI found this - https://git.openstack.org/cgit/openstack/operations-guide/commit/?id=ae8d4b91c2f60d427bdde57acc3f1b769cca393f20:37
dvorakwhich translates to this url - http://docs.openstack.org/openstack-ops/content/upgrade-icehouse-juno.html20:38
jlkrendered as http://docs.openstack.org/openstack-ops/content/upgrade-icehouse-juno.html20:38
dvorakheh20:38
dvorakit would have been pretty handy to find that before we did the upgrade20:38
jlklooks like some extra steps in here that are unnecessary20:39
dvorakwell, and for us, moving to the master branch for the stackforge puppet modules did most of that20:40
jlkthere's a gotcha as well, don't go from UUID to PKI tokens in keystone, otherwise you'll have to restart all your services ... again.20:40
dvorakwell, I think PKI was the default in icehouse, no?20:40
jlkwe're doing our upgrade one service at a time, keeping the whole thing operational minus that one service as we go.20:40
jlkdvorak: yeah, might have been. We''re coming from Havana, which a lot of places appear to still be on20:40
dvorakwe did everything in one shot, one site last night, the other tomorrow night20:40
jlk(looking at the openstack marketplace)20:41
dvorakyeah, I think it'd be interesting to see how many people are running what versions20:41
jlkwe have like 30 sites to do, it'll be a bit slower to get them all done, but we don't want full outage20:41
dvorakseems unavoidable given the db migrations required20:41
jlkjust per-service20:41
jlkyou can do nova stuff that doesn't involve glance while you upgrade glance20:42
dvorakour outage was like 15 minutes20:42
dvorakmost of that was package installations20:42
jlkwe also keep instances reachable and operational during the upgrade20:42
dvorakwe would have kept instances reachable if someone (me) hadn't accidently added openvswitch-switch to the list of services to shutdown20:43
jlkhah20:43
dvorakit's stupid, but it's a list of like twenty services to shut down, and like 3 other people reviewed the list.  unfortunately some screwups are bound to get through sometimes20:44
dvorakthankfully we realized what was going on quickly and had that fixed in about 10 minutes20:45
*** emagana has quit IRC20:46
*** emagana has joined #openstack-operators20:47
*** emagana has quit IRC20:48
*** emagana has joined #openstack-operators20:48
*** Piet has quit IRC21:00
*** Piet has joined #openstack-operators21:03
*** Piet has quit IRC21:14
*** Marga_ has joined #openstack-operators21:14
*** Piet has joined #openstack-operators21:16
*** j05h has quit IRC21:17
*** Marga_ has quit IRC21:18
*** j05h has joined #openstack-operators21:19
*** Marga_ has joined #openstack-operators21:49
*** blair has joined #openstack-operators21:50
*** blair has quit IRC21:55
*** blair has joined #openstack-operators21:57
*** ctina has quit IRC22:02
*** j05h has quit IRC22:06
*** radez is now known as radez_g0n322:16
*** j05h has joined #openstack-operators22:25
*** blair has quit IRC22:33
*** SimonChung has joined #openstack-operators22:38
*** SimonChung1 has quit IRC22:38
*** blair has joined #openstack-operators22:40
*** emagana has quit IRC22:52
*** Rockyg has joined #openstack-operators23:00
*** emagana has joined #openstack-operators23:00
*** SimonChung1 has joined #openstack-operators23:01
*** SimonChung has quit IRC23:01
*** cpschult has quit IRC23:05
*** Rockyg has quit IRC23:20
*** SimonChung has joined #openstack-operators23:23
*** SimonChung1 has quit IRC23:23
*** VW_ has quit IRC23:33
*** reed has quit IRC23:43
*** dmsimard is now known as dmsimard_away23:56
*** mdorman has quit IRC23:56
« Tuesday, 2015-02-10 Index Thursday, 2015-02-12 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!