Thursday, 2017-10-26

*** newmember has quit IRC00:00
*** dminer has quit IRC00:13
*** Apoorva_ has joined #openstack-operators00:32
*** Apoorva has quit IRC00:35
*** Apoorva_ has quit IRC00:36
*** shintaro has joined #openstack-operators00:53
*** trungnv has quit IRC01:15
*** trungnv has joined #openstack-operators01:49
*** AlexeyAbashkin has joined #openstack-operators01:51
*** gyee has quit IRC01:52
*** AlexeyAbashkin has quit IRC01:55
*** spectr has quit IRC02:03
*** spectr has joined #openstack-operators02:05
*** ckonstanski has quit IRC02:21
*** ckonstanski has joined #openstack-operators02:24
*** zerick has quit IRC02:26
*** zerick has joined #openstack-operators02:27
*** masuberu has quit IRC02:34
*** zerick has quit IRC02:43
*** zerick has joined #openstack-operators02:43
*** AlexeyAbashkin has joined #openstack-operators02:51
*** masber has joined #openstack-operators02:55
*** vijaykc4 has joined #openstack-operators02:55
*** AlexeyAbashkin has quit IRC02:55
*** masber has quit IRC02:57
*** masber has joined #openstack-operators02:57
*** masber has quit IRC03:19
*** gkadam has joined #openstack-operators03:42
*** AlexeyAbashkin has joined #openstack-operators03:51
*** AlexeyAbashkin has quit IRC03:55
*** vijaykc4 has quit IRC03:58
*** masber has joined #openstack-operators04:02
*** masber has quit IRC04:04
*** masber has joined #openstack-operators04:04
*** vijaykc4 has joined #openstack-operators04:18
*** markvoelker has quit IRC04:23
*** markvoelker has joined #openstack-operators04:55
*** vijaykc4 has quit IRC05:21
*** dmibrid_ has quit IRC05:22
*** markvoelker has quit IRC05:24
*** markvoelker has joined #openstack-operators05:24
*** markvoelker has quit IRC05:28
*** jbadiapa_ has quit IRC05:32
*** nikhil has quit IRC05:45
*** AlexeyAbashkin has joined #openstack-operators06:03
*** Oku_OS-away is now known as Oku_OS06:04
*** Miouge has joined #openstack-operators06:17
*** AlexeyAbashkin has quit IRC06:19
*** simon-AS559 has joined #openstack-operators06:24
*** vijaykc4 has joined #openstack-operators06:32
*** vijaykc4 has quit IRC06:34
*** vijaykc4 has joined #openstack-operators06:34
*** simon-AS559 has quit IRC06:43
*** jbadiapa_ has joined #openstack-operators06:57
*** jbadiapa_ is now known as jbadiapa06:57
*** rcernin has quit IRC07:04
*** tesseract has joined #openstack-operators07:09
*** yprokule has joined #openstack-operators07:20
*** vijaykc4 has quit IRC07:25
*** markvoelker has joined #openstack-operators07:25
*** simon-AS559 has joined #openstack-operators07:45
*** simon-AS5591 has joined #openstack-operators07:48
*** simon-AS559 has quit IRC07:49
*** vijaykc4 has joined #openstack-operators07:54
*** simon-AS5591 has quit IRC07:57
*** markvoelker has quit IRC07:59
*** AlexeyAbashkin has joined #openstack-operators08:03
*** simon-AS5591 has joined #openstack-operators08:05
*** slaweq has joined #openstack-operators08:14
*** Caterpillar has joined #openstack-operators08:17
*** slaweq has quit IRC08:18
*** jsheeren has joined #openstack-operators08:18
*** klindgren__ has joined #openstack-operators08:22
*** ckonstanski has quit IRC08:24
*** klindgren_ has quit IRC08:24
*** dbecker has joined #openstack-operators08:27
*** d0ugal has quit IRC08:32
*** d0ugal_ has joined #openstack-operators08:32
*** d0ugal_ has quit IRC08:33
*** d0ugal has joined #openstack-operators08:33
*** d0ugal has quit IRC08:33
*** d0ugal has joined #openstack-operators08:33
*** shintaro has quit IRC08:39
*** derekh has joined #openstack-operators08:45
*** markvoelker has joined #openstack-operators08:57
*** AlexeyAbashkin has quit IRC09:02
*** electrofelix has joined #openstack-operators09:03
*** racedo has joined #openstack-operators09:05
*** AlexeyAbashkin has joined #openstack-operators09:06
jsheerenhi all, with neutron rbac, is there a deny policy that can be used?09:15
*** markvoelker has quit IRC09:29
*** vijaykc4 has quit IRC09:34
*** AlexeyAbashkin has quit IRC09:37
*** vijaykc4 has joined #openstack-operators09:37
openstackgerritMartin Mágr proposed openstack/osops-tools-monitoring master: Revert "Removes unnecessary utf-8 encoding"  https://review.openstack.org/51533409:40
*** AlexeyAbashkin has joined #openstack-operators09:46
*** AlexeyAbashkin has quit IRC09:53
*** masber has quit IRC10:09
*** markvoelker has joined #openstack-operators10:26
openstackgerritMartin Mágr proposed openstack/osops-tools-monitoring master: python-psutil compatibility patch  https://review.openstack.org/51535310:30
*** vijaykc4 has quit IRC10:32
*** markvoelker has quit IRC10:59
*** yprokule has quit IRC11:05
*** AlexeyAbashkin has joined #openstack-operators11:07
*** jsheeren has left #openstack-operators11:09
*** vijaykc4 has joined #openstack-operators11:14
*** pontusf has quit IRC11:17
*** masber has joined #openstack-operators11:22
*** vijaykc4 has quit IRC11:29
*** vijaykc4 has joined #openstack-operators11:31
*** vijaykc4 has quit IRC11:31
*** pontusf has joined #openstack-operators11:35
*** portante has quit IRC11:38
*** portante has joined #openstack-operators11:44
*** ansmith has quit IRC11:47
*** vijaykc4 has joined #openstack-operators11:55
*** markvoelker has joined #openstack-operators11:57
*** simon-AS5591 has quit IRC12:05
*** simon-AS559 has joined #openstack-operators12:05
*** simon-AS5591 has joined #openstack-operators12:08
*** simon-AS559 has quit IRC12:10
*** yprokule has joined #openstack-operators12:21
*** markvoelker has quit IRC12:29
*** dminer has joined #openstack-operators12:33
*** VW has joined #openstack-operators12:34
*** markvoelker has joined #openstack-operators12:40
*** ansmith has joined #openstack-operators12:41
*** mriedem has joined #openstack-operators13:11
*** gkadam_ has joined #openstack-operators13:26
*** gkadam has quit IRC13:27
*** rmart04 has joined #openstack-operators13:27
*** gkadam_ has quit IRC13:37
*** shintaro has joined #openstack-operators13:39
*** simon-AS5591 has quit IRC13:56
*** ckonstanski has joined #openstack-operators13:58
*** Miouge has quit IRC14:04
*** lvdombrkr has joined #openstack-operators14:05
lvdombrkrolks, where can i found documentation how to upgrade from old openstack version to newer version (from Kilo->Liberty->Mitaka->Newton->Ocata?)14:05
*** vijaykc4 has quit IRC14:07
*** simon-AS5591 has joined #openstack-operators14:07
*** jbadiapa has quit IRC14:07
*** rcernin has joined #openstack-operators14:08
rmart04Ivodmbrkr, Essentially you have got to do a lot of digging, release notes/upgrade notes are a good start14:08
AlexeyAbashkinlvdombrkr: for such long path it is better to set up brand new and move the workloads14:09
lvdombrkrAlexeyAbashkin: you mean, deploy new ocata/pike openstack, and than migrate workloads from existing Kilo?14:12
*** marst has joined #openstack-operators14:13
rmart04Do you have some examples of how you have ported your users infrastructure with this method AA?14:16
*** catintheroof has joined #openstack-operators14:17
lvdombrkrrmart04: i have same question14:22
ckonstanskiThe question of "how to upgrade openstack" is huge. You can upgrade one service at a time. (Yes upgrading is possible.) Perhaps you might want to pick a single service, let's say keystone, and focus on that. Some more specific questions will arise from the effort, and specific questions are easier to answer.14:24
ckonstanskiDefinitely practice in a lab first.14:25
*** newmember has joined #openstack-operators14:25
rmart04On that not ckonstaski, is there any documentation of compatability between component and their versions? I.E cinder newton <> nova Liberty etc?14:26
rmart04note*14:26
rmart04I’ve not come accross any, but would be interested if that was available!14:26
ckonstanskiSo would I. If it exists, I would have to google for it. Not an "insider", just an openstack user. I have had one particular experience with glance. I was trying to upgrade glance from mitaka to newton. It turned out to be impossible because cinder was still on mitaka and there was a dependency in there somewhere. If dependency issues arise, they will likely be of the devil-in-the-details sort. Start with the core services and work your14:29
ckonstanskiway out. And only jump one release at a time.14:29
rmart04Oh, were you running from packages on nodes with co-located services?14:30
ckonstanskiActually we had all the services dockerized. That made upgrades much simpler. We only had to worry about the database and config files. (The config files were volume-mounted on the host.)14:32
AlexeyAbashkinlvdombrkr: yes. set up new cloud, recreate tenant/user/role tree and copy VMs with volumes with network....14:33
lvdombrkrckonstanski: actually right know we have two openstack clouds, production on KILO, and second one in test lab Ocata. yesterday u tried for test purposes to migrate some DB etc. from Kilo to Ocata but without any success and it actually ) in production we have about 350 instances right now... so my question is how to better upgrade till Ocata with minimum downtime14:33
ckonstanskiBad news: that's too big of a jump. To upgrade that kilo cloud in place you will have to upgrade it 4 times, jumping one release each time.14:34
yankcrimermart04 anecdotally i can say that pike horizon, ocata {keystone,glance,cinder}, and liberty {neutron,nova} all worked fine together14:35
yankcrimei've never come across any definitive "compatibility matrix" though, at least not from an operators perspective14:35
yankcrimemight be worth trying to compile one14:35
AlexeyAbashkinrmart04: all my customers use ldap for identity... assignments, by turn, is copied via dump/restore14:35
yankcrimeas long as you're within range of a major API version though you should be fine, in my experience14:35
yankcrimeso the one pre-req to that arrangement working together was getting to keystone v3, which we did before departing kilo14:36
rmart04It’s too easy to blink and realise you are a bunch of releases behind… thanks YC, thats helpful. I think that could be really useful, I guess its very difficult to be 100% sure on compatability with so many features/options, enough to commit to, for other operators to rely on anyway!14:36
yankcrimethe best you can do is come up with a bunch of tests which replicate customer's deployment scenarios that you then run through yourself at each stage14:37
yankcrimei mostly found that either stuff broke in a fairly profound fashion, or it worked14:38
*** CrazyFish has quit IRC14:38
*** CrazyFish has joined #openstack-operators14:39
lvdombrkrAlexeyAbashkin: so in this scenario i need to copy all VMs networks manually with downtime, yes?14:40
*** nikhil has joined #openstack-operators14:41
lvdombrkryankcrime: what you think about AlexeyAbashkin suggestion?14:42
rmart04I guess no-one said it would be easy!14:42
lvdombrkrrmart04: unfortunately ...14:43
rmart04At least a lot of the older docs are a bit more accessible now, configuration references etc, that helps14:44
lvdombrkrnice to be listen best practises  from folks14:44
yankcrimelvdombrkr i suspect AlexeyAbashkin's approach might be the best14:44
AlexeyAbashkinlvdombrkr: why with dowm time? just recreate all supporting stuff and then move the VMs (with down time)14:45
yankcrimefor such a big jump14:45
lvdombrkrAlexeyAbashkin: yes i mean VMs with downtime, sorry for type14:46
AlexeyAbashkinand yes. it is not easy. but it easier than runnig K->L->M->N->O in-place and getting API/RPC incompatibility :-)14:46
lvdombrkrAlexeyAbashkin: agree, but migrate 350 VMs also not a sweet job14:49
AlexeyAbashkinwe did it for 2500 :-) yes, it is looooong time14:49
rmart04Do you have a ceph backend? You might be able to use the same ceph backend, and just import the volumes in the new side, rather than copy the data around14:50
rmart04I guess same goes for any shared storage?14:50
AlexeyAbashkinyes. shared storage helps a lot14:51
lvdombrkrAlexeyAbashkin: yeah we use ceph.... nice idea14:52
AlexeyAbashkinnot mine. thanks to rmart04 :-)14:52
lvdombrkrrmart04: thanks ))) but it is possible import cinder volumes from Kilo DB to Ocata DB??14:54
rmart04Isn’t there a action to take ownership of an existing volume14:54
rmart04‘cinder manage’ was the old cli option14:54
AlexeyAbashkinyou need to be careful with foreign keys in DB14:55
rmart04Interesting convo, gotta shoot, will catch up on eaves drop. Thanks guys.14:56
lvdombrkrrmart04: thanks in assist14:57
rmart04np14:57
*** rmart04 has quit IRC14:58
*** simon-AS5591 has quit IRC14:58
*** spectr has quit IRC15:02
lvdombrkrAlexeyAbashkin: thanks, any other things to pay attention or double-check?15:02
*** gkadam_ has joined #openstack-operators15:02
*** rcernin has quit IRC15:04
AlexeyAbashkintry on staging environment first :-)15:06
*** simon-AS5591 has joined #openstack-operators15:06
lvdombrkrby the way this is right channel to ask such a questions? (i mean about upgrades)15:08
*** shintaro has quit IRC15:12
*** liverpooler has joined #openstack-operators15:12
*** Oku_OS is now known as Oku_OS-away15:16
*** newmember has quit IRC15:19
*** newmember has joined #openstack-operators15:19
*** catintheroof has quit IRC15:20
*** catintheroof has joined #openstack-operators15:20
*** catintheroof has quit IRC15:25
*** AlexeyAbashkin has quit IRC15:29
*** yprokule has quit IRC15:39
*** gyee has joined #openstack-operators15:43
*** makowals has quit IRC15:47
*** klindgren_ has joined #openstack-operators15:48
*** klindgren__ has quit IRC15:50
*** catintheroof has joined #openstack-operators15:51
*** catintheroof has quit IRC15:55
*** Apoorva has joined #openstack-operators15:59
VWhey folks.  Anyone around for the LDT meeting?16:00
*** catintheroof has joined #openstack-operators16:01
VWgoing to kick it off and give people a few16:01
VW#startmeeting Large Deployments Team16:01
openstackMeeting started Thu Oct 26 16:01:29 2017 UTC and is due to finish in 60 minutes.  The chair is VW. Information about MeetBot at http://wiki.debian.org/MeetBot.16:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
*** openstack changes topic to " (Meeting topic: Large Deployments Team)"16:01
openstackThe meeting name has been set to 'large_deployments_team'16:01
VWgot an etherpad set up - https://etherpad.openstack.org/p/LDT_meeting_notes16:01
VWplease add your name if you are here for the meeting16:02
VWbut I think most folks are tied up elsewhere16:02
*** fragatina has quit IRC16:09
*** slaweq has joined #openstack-operators16:16
*** derekh has quit IRC16:17
*** ChiTo has joined #openstack-operators16:22
VWlooks like no one is available.16:34
VW#endmeeting16:34
*** openstack changes topic to "Discussion of topics related to operating Openstack infrastructures at scale | Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators | Logs: http://eavesdrop.openstack.org/irclogs/"16:34
openstackMeeting ended Thu Oct 26 16:34:08 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:34
openstackMinutes:        http://eavesdrop.openstack.org/meetings/large_deployments_team/2017/large_deployments_team.2017-10-26-16.01.html16:34
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/large_deployments_team/2017/large_deployments_team.2017-10-26-16.01.txt16:34
openstackLog:            http://eavesdrop.openstack.org/meetings/large_deployments_team/2017/large_deployments_team.2017-10-26-16.01.log.html16:34
*** slaweq has quit IRC16:48
*** slaweq has joined #openstack-operators16:48
*** racedo has quit IRC16:50
*** simon-AS5591 has quit IRC16:51
*** slaweq has quit IRC16:53
*** AlexeyAbashkin has joined #openstack-operators16:53
*** AlexeyAbashkin has quit IRC16:57
*** slaweq has joined #openstack-operators17:00
*** Miouge has joined #openstack-operators17:01
*** fragatina has joined #openstack-operators17:10
*** jamesden_ has joined #openstack-operators17:17
*** jamesden_ is now known as jamesdenton17:18
*** slaweq has quit IRC17:22
*** newmember has quit IRC17:33
*** gkadam_ has quit IRC17:40
*** tesseract has quit IRC17:45
*** AlexeyAbashkin has joined #openstack-operators17:48
*** newmember has joined #openstack-operators17:50
*** Apoorva has quit IRC17:51
*** AlexeyAbashkin has quit IRC17:52
*** VW has quit IRC17:54
*** VW has joined #openstack-operators17:55
*** Apoorva has joined #openstack-operators17:58
*** slaweq has joined #openstack-operators18:00
*** slaweq has quit IRC18:01
*** catintheroof has quit IRC18:13
*** electrofelix has quit IRC18:14
*** slaweq has joined #openstack-operators18:26
*** slaweq has quit IRC18:29
*** AlexeyAbashkin has joined #openstack-operators18:30
*** AlexeyAbashkin has quit IRC18:34
*** AlexeyAbashkin has joined #openstack-operators18:47
*** catintheroof has joined #openstack-operators18:51
*** AlexeyAbashkin has quit IRC18:52
*** catintheroof has quit IRC18:56
*** catintheroof has joined #openstack-operators19:05
*** slaweq has joined #openstack-operators19:06
*** catintheroof has quit IRC19:09
*** simon-AS559 has joined #openstack-operators19:18
*** catintheroof has joined #openstack-operators19:28
*** harlowja has quit IRC19:46
*** dmibrid has joined #openstack-operators19:49
*** liverpooler has quit IRC20:02
*** Apoorva has quit IRC20:06
*** slaweq has quit IRC20:09
*** slaweq has joined #openstack-operators20:10
*** slaweq has quit IRC20:14
*** newmember has quit IRC20:28
*** AlexeyAbashkin has joined #openstack-operators20:31
*** harlowja has joined #openstack-operators20:33
*** Apoorva has joined #openstack-operators20:35
*** AlexeyAbashkin has quit IRC20:35
*** ansmith has quit IRC20:38
*** Miouge has quit IRC20:39
*** Miouge has joined #openstack-operators20:45
*** AlexeyAbashkin has joined #openstack-operators20:47
*** catintheroof has quit IRC20:49
*** AlexeyAbashkin has quit IRC20:52
*** dmibrid has quit IRC20:58
*** ChiTo has quit IRC21:14
*** ansmith has joined #openstack-operators21:27
*** Miouge has quit IRC21:33
*** dminer has quit IRC21:33
*** marst has quit IRC22:00
*** AlexeyAbashkin has joined #openstack-operators22:46
*** AlexeyAbashkin has quit IRC22:50
*** mriedem is now known as mriedem_away23:07
*** AlexeyAbashkin has joined #openstack-operators23:07
*** AlexeyAbashkin has quit IRC23:11
*** VW has quit IRC23:21
*** VW has joined #openstack-operators23:23
*** AlexeyAbashkin has joined #openstack-operators23:27
*** jamesdenton has quit IRC23:28
*** jamesdenton has joined #openstack-operators23:31
*** AlexeyAbashkin has quit IRC23:32
*** Caterpillar has quit IRC23:47
*** gkadam_ has joined #openstack-operators23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!