Monday, 2014-03-17

*** matsuhashi has joined #openstack-trove00:12
*** matsuhashi has quit IRC00:31
*** rhodgin has joined #openstack-trove00:36
*** matsuhashi has joined #openstack-trove00:52
*** nosnos has joined #openstack-trove01:30
*** shakamunyi has joined #openstack-trove01:38
*** robertmyers has quit IRC01:51
*** robertmyers has joined #openstack-trove01:52
*** haomaiw__ has quit IRC02:17
*** haomaiwa_ has joined #openstack-trove02:18
*** haomai___ has joined #openstack-trove02:31
*** haomaiwa_ has quit IRC02:35
*** erkules_ has joined #openstack-trove02:38
*** erkules has quit IRC02:40
*** matsuhashi has quit IRC02:48
*** matsuhas_ has joined #openstack-trove02:52
*** dkehn has joined #openstack-trove03:04
*** dkehn_ has quit IRC03:06
*** ViswaV has joined #openstack-trove03:09
*** mrsnivvel has joined #openstack-trove03:16
*** matsuhas_ has quit IRC03:22
*** dkehn is now known as dkehn_03:23
*** ViswaV has quit IRC03:45
*** robertmyers has quit IRC03:47
*** ViswaV has joined #openstack-trove03:49
*** rhodgin has quit IRC03:56
*** achampion has quit IRC04:10
*** ViswaV has quit IRC04:23
openstackgerritSlickNik proposed a change to openstack/python-troveclient: Get rid of XML related trove client bindings  https://review.openstack.org/6999904:34
*** achampion has joined #openstack-trove04:36
*** matsuhashi has joined #openstack-trove04:43
*** achampion has quit IRC04:47
*** erkules_ is now known as erkules04:50
*** achampion has joined #openstack-trove05:43
*** achampion has quit IRC05:47
*** nosnos has quit IRC05:54
*** nosnos has joined #openstack-trove05:54
*** matsuhashi has quit IRC05:56
*** matsuhashi has joined #openstack-trove05:57
*** matsuhashi has quit IRC05:57
*** matsuhashi has joined #openstack-trove06:00
*** matsuhashi has quit IRC06:09
*** matsuhashi has joined #openstack-trove06:10
*** matsuhas_ has joined #openstack-trove06:12
*** matsuhashi has quit IRC06:14
*** nosnos has quit IRC06:24
*** nosnos has joined #openstack-trove06:25
*** matsuhas_ has quit IRC06:25
*** matsuhashi has joined #openstack-trove06:25
*** matsuhashi has quit IRC06:39
*** matsuhashi has joined #openstack-trove06:40
*** saju_m has joined #openstack-trove06:47
*** rongze has joined #openstack-trove07:21
*** rongze has quit IRC07:23
*** flaper87|afk is now known as flaper8707:30
*** wrongfan has joined #openstack-trove07:50
*** nosnos has quit IRC08:13
*** nosnos has joined #openstack-trove08:14
*** matsuhashi has quit IRC08:17
*** matsuhashi has joined #openstack-trove08:17
*** openstack has quit IRC08:21
*** openstack has joined #openstack-trove08:29
*** openstackstatus has joined #openstack-trove08:30
*** nosnos has quit IRC08:34
*** matsuhas_ has quit IRC08:56
*** matsuhashi has joined #openstack-trove09:06
*** IvanZ has joined #openstack-trove09:10
*** nosnos has joined #openstack-trove09:14
*** dukhlov has joined #openstack-trove09:28
*** wrongfan has quit IRC09:49
*** wrongfan has joined #openstack-trove09:50
*** nosnos_ has joined #openstack-trove09:55
*** nosnos has quit IRC09:58
*** tattabbum has joined #openstack-trove10:04
*** nosnos_ has quit IRC10:10
*** nosnos has joined #openstack-trove10:12
*** saju_m has quit IRC10:17
*** iartarisi has joined #openstack-trove10:24
*** saju_m has joined #openstack-trove10:32
*** matsuhashi has quit IRC10:38
*** nosnos has quit IRC10:46
*** nosnos has joined #openstack-trove10:47
*** matsuhashi has joined #openstack-trove10:54
*** matsuhashi has quit IRC11:05
*** openstackgerrit has quit IRC11:10
*** openstackgerrit has joined #openstack-trove11:10
*** matsuhashi has joined #openstack-trove11:13
*** saju_m has quit IRC11:15
*** tattabbum has left #openstack-trove11:21
*** asterix has joined #openstack-trove11:22
*** matsuhashi has quit IRC11:31
*** saju_m has joined #openstack-trove11:36
asterixHello all. I would build a trove image (like ubuntu_mysql.qcow2 image) without using redstack. I would upload this image in an exting OpenStack environment. Is this scenario possible'12:00
asterix?12:00
*** pdmars has joined #openstack-trove12:12
*** pdmars has quit IRC12:14
*** pdmars has joined #openstack-trove12:20
*** matsuhashi has joined #openstack-trove12:27
*** matsuhashi has quit IRC12:37
*** nosnos_ has joined #openstack-trove12:37
*** nosnos has quit IRC12:37
*** matsuhashi has joined #openstack-trove12:37
*** matsuhashi has quit IRC12:42
*** asterix has quit IRC12:50
openstackgerritA change was merged to openstack/trove: Hide Datastores In List With No Active Versions  https://review.openstack.org/7951312:56
*** matsuhashi has joined #openstack-trove13:03
*** matsuhashi has quit IRC13:05
*** matsuhashi has joined #openstack-trove13:05
*** radez_g0n3 is now known as radez13:07
*** matsuhashi has quit IRC13:10
*** wrongfan has quit IRC13:12
*** nosnos_ has quit IRC13:12
*** mrsnivvel has quit IRC13:14
*** aterix has joined #openstack-trove13:18
*** rhodgin has joined #openstack-trove13:21
*** robertmyers has joined #openstack-trove13:34
*** robertmyers has quit IRC13:35
*** ViswaV has joined #openstack-trove13:37
*** robertmy_ has joined #openstack-trove13:39
openstackgerritIonut Artarisi proposed a change to openstack/trove: fix default rabbitmq configuration values in sample cfgs  https://review.openstack.org/7463813:40
*** robertmy_ has quit IRC13:40
*** robertmy_ has joined #openstack-trove13:40
*** robertmy_ has quit IRC13:41
*** robertmyers has joined #openstack-trove13:41
*** robertmyers has quit IRC13:42
*** robertmyers has joined #openstack-trove13:43
*** robertmy_ has joined #openstack-trove13:44
*** robertmyers has quit IRC13:44
*** achampion has joined #openstack-trove13:47
*** jcru has joined #openstack-trove13:48
*** Barker has joined #openstack-trove13:57
*** rramirez has joined #openstack-trove13:57
*** amytron has quit IRC14:00
*** rwsu has joined #openstack-trove14:07
*** kevinconway has joined #openstack-trove14:13
*** spredzy has joined #openstack-trove14:14
*** grapex has joined #openstack-trove14:16
*** grapex has quit IRC14:18
*** grapex has joined #openstack-trove14:19
*** flaper87 has quit IRC14:26
*** amytron has joined #openstack-trove14:26
*** flaper87|afk has joined #openstack-trove14:31
*** flaper87|afk is now known as flaper8714:32
*** flaper87 has quit IRC14:32
*** flaper87 has joined #openstack-trove14:32
*** datsun180b has joined #openstack-trove14:34
grapexuh-oh, yet another wealthy benefactor is trying to get in touch with me: https://gist.github.com/TimSimpsonR/960060914:46
*** Barker has quit IRC14:59
*** thedodd has joined #openstack-trove15:01
*** saju_m has quit IRC15:03
*** iartarisi has quit IRC15:08
*** saju_m has joined #openstack-trove15:20
aterixHello all. I would build a trove image (like ubuntu_mysql.qcow2 image) without using redstack. I would upload this image in an exting OpenStack environment. Is this scenario possible?15:22
*** shakamunyi has quit IRC15:31
*** ViswaV has quit IRC15:33
*** flaper87 is now known as flaper87|afk15:34
cp16nethello all15:45
*** Barker has joined #openstack-trove15:53
*** jmontemayor has joined #openstack-trove15:57
*** jmontemayor_ has joined #openstack-trove16:05
*** jmontemayor_ has quit IRC16:06
*** SnowDust has joined #openstack-trove16:06
*** ViswaV has joined #openstack-trove16:06
*** jmontemayor_ has joined #openstack-trove16:06
*** ViswaV_ has joined #openstack-trove16:07
*** ViswaV has quit IRC16:07
*** jmontemayor has quit IRC16:08
*** ViswaV_ has quit IRC16:08
*** ViswaV has joined #openstack-trove16:08
*** saju_m has quit IRC16:15
vgnbkrHappy Saint Patty's Day!16:16
hub_capaterix: it should be possible, sure, just upload it to glance, and name it aptly, like ubuntu_{datastore_type} (ubuhtu_mysql) in glance16:19
hub_capoh and howdy all, im back from the mountains16:19
hub_capwhre teh wind was plentiful and he internet was none16:19
grapexhub_cap: Sounds awful16:21
vgnbkrhub_cap: I'm working on what you describe above right now.  So how would the trove-guestagent (etc) get installed when you boot the trove instance?16:22
hub_capvgnbkr: well thats a scenario we solve in the dev env by ssh keys and rsync16:24
hub_capif u look into how the image is made, we use the same username as the host system, and we put a ssh key into the vm so the developer / rsync can get in16:25
vgnbkrRight, but how is it supposed to work in a real OpenStack environment.16:25
hub_capbut this is only for dev purposes :)16:25
hub_capvgnbkr: most people ive talked to package the guest in the vm16:25
vgnbkrRight, but there's nothing in Trove to tell you what you need to do for that, or any tools to help you, correct?16:26
hub_capcorrect. we have little/no deployment docs16:27
hub_capthere may be something in the manual install docs16:27
vgnbkrOK, that's basically what I surmised, but just wanted to make sure I hadn't missed something.16:28
hub_capbut vgnbkr we dont really build packages in openstack16:28
hub_capits up to deployers to do that, or external community peoples16:28
hub_capweve also wanted to split out the guest for a while, makign this less of a problem (guest gets its own pkg as well)16:28
hub_capthere is also tarballs.o.o16:28
hub_caphttp://tarballs.openstack.org/trove/16:29
hub_capand that has trove-master, so u could pull it from there and just pip install it, or use virtualenv16:29
hub_capther are a few ways to skin that cat hehe16:29
hub_capvgnbkr: do u know if anyone on yer end is starting any deployment docs? this kind of thing would be good to put in the docs id think16:31
vgnbkrMy understanding is that we would like to, but someone would have to tell the doc writer how to deploy it, which is why I'm trying to figure it out.16:32
openstackgerritMat Lowery proposed a change to openstack/trove: Remove IDENTIFIED BY clause for MySQL REVOKE  https://review.openstack.org/8069416:33
hub_capvgnbkr: :D16:36
grapexSlickNik: What command are you using to run the Tempest tests?16:37
grapex"./run_tempest.sh" works, but I can't seem to pass a module path to it and have it work as I expect.16:37
*** eghobo has joined #openstack-trove16:39
grapexSlickNik: Ditto with testr run --subunit tempest.api.database.flavors.test_flavors | subunit-2to1 | tools/colorizer.py16:39
*** eghobo has quit IRC16:39
*** ramashri has joined #openstack-trove16:46
SnowDustHappy HOLI to all .. from india !16:47
*** amcrn has joined #openstack-trove16:49
aterixhub_cap: how should I configure the image out of redstack? Are there particular parameters that should I be careful?16:50
hub_capaterix: for all of this to work, we assume some things in the dev env, id suggest you look @ the ubuntu-mysql elements we use16:53
aterixhub_cap: do you mean this? https://github.com/openstack/trove-integration/tree/master/scripts/files/elements/ubuntu-mysql16:56
hub_capaye aterix16:57
*** jmontemayor_ has quit IRC16:57
juicegood morning (afternoon or evening) all16:58
aterixhub_cap: but, that link allows to install the only DBMS! What should I build the image in order to run the trove guest-agent?16:59
amcrnmornin' juice17:01
juicegood morning amcrn17:04
aterix* That link allows to install the only DBMS! How should I build the image in order to run the trove guest-agent?17:05
aterixgood afternoon juice17:06
*** eghobo has joined #openstack-trove17:07
SnowDustaterix: disk image builder elements = ubuntu-mysql17:07
SnowDustaterix: juice is the disk image builder best help :)17:07
juiceaterix: it's been a while but I'd be happy to help17:08
*** harlowja_away is now known as harlowja17:09
hub_capaterix: there should be a *firstboot* file (let me find)17:10
hub_capaterix: this is incorrectly named, but here is the magic for teh guest17:11
hub_caphttps://github.com/openstack/trove-integration/blob/master/scripts/files/bootstrap_init-mysql.sh17:11
hub_capso effectively, u need to get the trove source into the vm, and potentially pip install or venv the pip's in requirments.txt17:11
hub_capthen make sure the init script is in the right place for the guest (trove-guest.init)17:12
aterixjuice: Well, I would build a trove image (like ubuntu_mysql.qcow2 image) without using redstack. I would upload this image in an exting OpenStack environment. I don't know what I should specify (variables, parameters, ssh key, user) disk-image-builder in order to build the image17:13
juiceaterix: and we use these elements to build the image (${DISTRO} ${EXTRA_ELEMENTS} vm heat-cfntools ${DISTRO}-guest ${DISTRO}-${SERVICE_TYPE}) (i.e. ubuntu vm heat-cnftools ubuntu-guest ubuntu-mysql).  Disk Image Builder aggregates all of those elements to shape the final image17:14
juiceaterix: each of those elements (found in trove-integration/files/elements) adds configurations, packages to the user.  They answer the question you are asking.17:17
juiceFor example (https://github.com/openstack/trove-integration/blob/master/scripts/files/elements/ubuntu-guest/extra-data.d/62-ssh-key) will show you how the ssh keys are added17:17
juiceaterix: function build_vm() in https://github.com/openstack/trove-integration/blob/master/scripts/functions_qemu has most if not all parameters that are used in disk-image-builder script17:19
*** aterix has quit IRC17:19
SlickNikgrapex: testr run --parallel tempest.api.database17:19
grapexSlickNik: Thanks. I could have sworn I tried that. I'm in between VMs now but I'll attempt that when I get a shot.17:21
SlickNikgrapex: no worries.17:22
*** ramashri has quit IRC17:22
*** eguz has joined #openstack-trove17:25
*** eguz has quit IRC17:25
*** eguz has joined #openstack-trove17:25
*** eghobo has quit IRC17:28
*** ViswaV has quit IRC17:32
*** ViswaV has joined #openstack-trove17:33
*** ViswaV has quit IRC17:34
*** michael-yu has joined #openstack-trove17:34
*** Barker has quit IRC17:34
*** michael-yu has quit IRC17:35
*** yidclare has joined #openstack-trove17:36
*** ViswaV has joined #openstack-trove17:38
*** tanisdl has joined #openstack-trove17:38
*** ViswaV_ has joined #openstack-trove17:39
*** ViswaV has quit IRC17:39
*** mattgriffin has joined #openstack-trove17:39
*** michael-yu has joined #openstack-trove17:40
*** yogesh has joined #openstack-trove17:42
*** khyati has joined #openstack-trove17:47
*** esp has left #openstack-trove17:55
*** esp has joined #openstack-trove17:55
*** jmontemayor has joined #openstack-trove17:56
*** isviridov has quit IRC17:58
SlickNikbp review meeting in 2 mins17:58
SlickNikJust a couple of bps to talk about17:59
SlickNikAgenda:17:59
SlickNikhttps://blueprints.launchpad.net/trove/+spec/upgrade-guestagent17:59
SlickNikhttps://blueprints.launchpad.net/trove/+spec/refactoring-datastore-options-in-cfg17:59
SlickNikesp: you around to follow up on https://blueprints.launchpad.net/trove/+spec/upgrade-guestagent18:00
*** SnowDust has quit IRC18:00
esphey18:01
espso does anyone have any questions regarding the bp?18:01
SlickNikWe mostly had agreement. Just a couple of open regarding the RPC API and tracking history, IIRC.18:01
SlickNikThat came up last time.18:01
*** SnowDust has joined #openstack-trove18:02
*** isviridov has joined #openstack-trove18:02
espI wanted to give hub_cap a little time to look at it (the event_history table)18:02
hub_cap:o18:03
espnot sure what the open question on the RPC API was..can you remind me?18:03
espsorry hub_cap, surprise!  there is an event history table18:03
grapexhub_cap: So the discussion on Wednesday was that event_history is something we could use on a lot of different things in Trove, and it resembled the action log or event or whatever it was called that you looked into in the past18:03
hub_capesp: link me to the bp plz18:03
espk18:03
esp#link https://wiki.openstack.org/wiki/Trove-Guest-Agent-Upgrades18:04
SlickNikesp: I think it was around whether implementing the RPC API versioning was being proposed as part of this BP, or something that would be done outside the scope of this BP.18:04
espSlickNik: #link https://wiki.openstack.org/wiki/Trove-Guest-Agent-Upgrades#Future_Follow_up_Blueprints18:05
amcrnfrom the meeting last week (regarding history/audit): http://eavesdrop.openstack.org/meetings/trove/2014/trove.2014-03-12-17.59.log.txt 18:06:2118:05
grapexI'm for pushing that to next time, did anyone disagree?18:05
SlickNikgrapex: nope. I think esp's on the same page regarding that.18:06
espthx amcrn and grapex :)18:06
grapexNow- the "event audit" stuff-18:06
esphehe18:06
grapexrather than say "let's punt" how about we make that into a fast-follow blueprint for this one?18:07
amcrnfrom the log it looks like we all agreed to a single row for now, and someone in parallel investigates what it means to solve audit/versioning generically (either looking @ kevinconway's suggestion, or finding another alternative)18:07
vipul+1 i personally don't think an upgrade needs to be recorded as an event18:07
grapexamcrn vipul: +118:07
vipulits enough to record the version somewhere18:07
vipulwhich could be the instance table18:08
espI looked into kevinconway suggestion I don't think that will work for what I was trying to do.18:08
grapexesp: I think kevinconway's idea was good but maybe not a total match for this particular problem. It seems worth considering at some point though.18:09
hub_capyea im not sure what we are trying to solve, ill have to catch up18:09
espgrapex: yep18:09
SlickNikI'm good with single update for now, and look into audit as a separate bp (follow up on hub_cap's actions?)18:09
SlickNikSo given those answers, are we good with approving this bp?18:10
grapexAye18:10
espso let me ask this18:10
espif we look at the back up feature18:10
hub_capassuming all that stuff u just mentioned is pending and wont be worked on18:10
espis the backups table useful at all?18:10
espcould we drop the backups table all together?18:11
grapexesp: It is, as backups is a query-able resource.18:11
vipulnope.. it's a resource18:11
grapexSame thing with the instance version- we'll be able to query for the current version18:11
grapexbut historical records of the different states a resource was in has no precedent in Trove and could be used for multiple things.18:12
espWhat I'm asking is, has anyone found the backups table useful in troubleshooting backups18:12
vipuli don't quite understand the point.. it's not about troubleshooting.. a Backup exists as a first-class thing in Trove18:12
grapexcorrect me if I'm wrong, but the backups table stores the current state of the backup, right? The one returned by the API get call for a backup? Or is there a second table I'm forgetting?18:12
amcrnesp: extending your question, couldn't security_groups and security_group_rules be dropped as well?18:13
vipulamcrn: Yes18:13
espamcrn: +118:13
amcrni actually agree with the premise, but it's a bit tangential to this blueprint18:13
vipulthat is one area that we should drop, since it's actually duplicated18:13
vipulbut backups do have a status like grapex says18:13
SlickNikOkay, I think we're going off on a bit of a tangent here.18:14
amcrnah, fair point, while it's in-flight you need some sort of indicator18:14
espI'm making the argument that an upgrade has enough moving parts to warrant multiple statuses18:14
grapexesp: I think it's a fair argument. My counterpoint is it will complicate the code, so if we make something like that we need to see how it could apply in multiple areas18:15
grapexI also think upgrades should be as simple as possible and should allow for different versions18:15
grapexI mean, allow for different strategies18:16
vipulyea in my mind.. it either succeeds and you have the new version recorded.. or fails and you don't get version update18:16
vipullike i don't care if it failed downloading a package18:17
vipulthe upgrade just failed18:17
grapexvipul: Agreed. I don't want us to have a ton of Trove code designed around creating a new package manager / deployment tool18:17
hub_cap++18:17
espSo when something fails you will have to go dig through logs.18:17
grapexesp: You need to talk to our operations guys here. That is pretty much how it works for every complex thing in Trove today and they do not like it. :p18:18
vipulesp: sure.. and that's what the expectation shoudl be.. you try to issue the upgrade again18:18
vipulyou don't care why it failed18:18
espgrapex: lol18:18
grapexesp: That's why if we take on the code to create an audit thing in the db I'd like it to be general enough to handle some other stuff as well.18:18
espgrapex: I already created the new table.18:19
hub_capdear god its too late *rimshot*18:19
esp#link https://wiki.openstack.org/wiki/Trove-Guest-Agent-Upgrades#Schema_Changes18:19
esphub_cap: lol18:20
espI think maybe folks haven't had enough time to absorb the changes to the bp maybe?18:20
espshould I kill the event_history table?  sounds like not right?18:20
vipuli think we're saying yes kill it18:20
espI hear grapex telling me to make it generic?18:21
SlickNikesp: I think the earlier discussion suggested that event history should be addressed as a separate bp.18:21
vipuland come up with a general auditing solution later, that handles more than upgrades18:21
hub_capyes lets not solve that in this bp18:21
amcrn+118:21
espk, I'm fine with this18:22
espwill make the event history a separate table18:23
esptable --> bp18:23
vipuloh good :)18:23
hub_caplol i was like huuuuh18:23
SlickNikOkay, so back to approving this. Given that "event history" will be a different BP, do people feel good with the upgrade bp?18:23
SlickNik+118:23
vipuldid you guys discuss agent hearbeats table?18:24
grapex+118:24
hub_capi will review and give esp any thoughts so +018:24
grapexSo... maybe this is a question of how much we should be nailing down here?18:24
espk18:24
grapexvipul: What was your thought on the agent heartbeats table? I just worry maybe now we might get too prescriptive18:24
grapexit seems easier to sort some questions out during the pull request18:24
vipulwell we have service_status for mysql status.. can the agent_status be anything but 'running'?18:24
hub_capgrapex: still good to discuss so we at least remember, somewhat, when reading the review18:25
grapexvipul: I suppose it could be "unknown"18:25
vipulseems like if the agent is down.. well then nothing is going to send that hearbeat18:25
vipulbut what will change it to unknown18:25
grapexvipul: Good point18:25
SlickNikgrapex: I think intent, scope and high level design of bp. We don't have to get all the design details fleshed out in one sitting.18:25
grapexvipul: I thought the purpose of that new status would be if the agent tries to do an upgrade, then gets itself into a jacked up state, it can at least report it18:26
hub_capwouldnt an old time be considered unknown?18:26
hub_caplike active, last heartbeat 200s ago18:26
grapexhub_cap: True... I guess we should trust conductor18:26
espwrt to setting the guest_agent_status I think it will be separate message.  I did not want to send it with every heart beat.18:26
vipulis this something we want to report to the end user? or is this purely for admin?18:26
grapexvipul: I figured it was for an admin / trove code18:27
amcrnadmin18:27
espvipul: the idea originally was to only allow admin to see it18:27
vipulesp: ok, are we concerned about the chattiness if we add another heartbeat18:27
hub_capadmin it is :)18:27
grapexvipul: I'm starting to agree18:28
hub_capim not sure we need another heartbeat, but just a larger message, right?18:28
espvipul: I was only planning to send the guest_agent_status on startup/restart of the guest agent18:28
vipulwell then now we don't have a good way to say it's 'unknown'18:28
hub_capthe heartbeat should be checking all status and sendign that up in a single msg18:28
SlickNikhub_cap: yes, I think same message, just another field (or two).18:29
esphub_cap: we could do this, I was just trying to keep the logic separate18:29
grapexSo does this mean the version gets put into every heart beat?18:29
SlickNiknot a completely different message.18:29
hub_capwell, if the msg is current, the guest is online18:29
hub_capso that can be assumed18:29
hub_capif needed18:29
hub_capand if the message is crrent and datastore status is "dead yo"18:30
vipulright.. so if it was bolted on to existing heartbeat, then it might be an useful status18:30
espyeah, it's less work.18:30
grapexSo I think we should also consider passing the guest agent version back on it's own message18:30
vipulgrapex: like a one time thing?18:31
grapexvipul: Yeah-18:31
*** asterix_ has joined #openstack-trove18:31
vipulthe concern i'd have about that is.. once the guests are upgraded.. you might be upgrading the control plane18:31
espgrapex: I like that18:31
vipuland if you happen to miss that one-time message while you're upgrading18:31
grapexvipul: That's a good point18:31
grapexvipul: Ok, you've sold me on it then18:31
espnot reason to hammer the instances table for every heartbeat18:31
vipulgrapex: that was easy!18:31
grapexI wonder in this case if long-term we might want to send the backup status on the heartbeat call as well18:32
hub_capgrapex: id prefer one msg if possible for all of these statii18:32
espso are we saying 1 message for everything?18:32
espI'm confused18:32
grapexOk, sorry for the tangent, I'm good with passing it back with the heartbeat18:32
hub_capis that a plural of status? /me thinks so18:32
grapexhub_cap: A group of status is technically referred to as a "murder"18:32
vipuli think we extend the heartbeat with the version + agent_status.. that seems to be the safest18:32
hub_capgrapex: nice18:33
grapexvipul: +118:33
espk, so 1 message in heartbeat (version + status)18:33
hub_capvipul: ++18:33
vipulesp: +118:33
espversion --> instances table18:33
espstatus --> agent_heartbeats table18:33
espanything else?18:33
amcrnwhat's your favorite color?18:33
grapexesp: I thought we decided there wouldn't be a status for the agent in the db- we'd just infer it from the time of the heartbeat?18:33
amcrnthat's the pressing question here.18:33
hub_capbluond amcrn18:34
espamcrn: black18:34
*** isviridov has quit IRC18:34
SlickNikokay, let's keep moving.18:34
hub_capgrapex: i think thats all we need for now18:34
SlickNikI think we're good with upgrades18:34
SlickNiknext in the pipeline:18:34
SlickNikhttps://blueprints.launchpad.net/trove/+spec/refactoring-datastore-options-in-cfg18:35
SlickNikSnowDust: here?18:35
SnowDustyes18:35
SnowDustshall i detail the work ?18:36
SlickNikYes, go ahead. You've got the floor.18:36
SnowDustok .. so18:36
SnowDustif we see the recent changes to trove/common/cfg.py18:36
vipuldo we have anyone here that's wokring on capabilities? isn't there some intersection here?18:37
SnowDusti have been suggesting how difficult it is to keep up with hardcoded changes for database options there18:37
SnowDustmy solution keeps datastore options in their own containers18:38
SnowDustso that trove is nutral to external or built in database support18:38
grapexSnowDust: Can you define "containers"?18:38
SnowDustgrapex: i meant  for trove the datastore should be a component18:38
hub_capi think hes saying use entry points to load the datastore impls18:39
SnowDustand the way the managers are loaded , a datastore may be implemented as separate python packages18:39
SnowDustthus they are separate containers.18:39
amcrncorrect, as an example cassandra lives by itself: https://review.openstack.org/#/c/80061/5/trove/guestagent/datastore/cassandra/options.py (vs. being in the same file as all other datastore cfgs)18:39
SnowDustamcrn : thanks u got it right18:39
SlickNikhub_cap: He's saying use entry points to load the datastore _configs_ I think.18:40
vipulso is this purely refactoring, and moving things around?  Or are we changing behavior18:40
SlickNik#link https://review.openstack.org/#/c/80061/518:40
grapexSo far I like this idea. Now if we could just move all the guest code into it's own directory before Juno my life would be complete. :)18:40
SnowDustvipul: its enhancing the current implementations 99% refactoring 1% more smartness :)18:40
amcrnvipul: see http://eavesdrop.openstack.org/irclogs/%23openstack-trove/%23openstack-trove.2014-03-10.log, specifically 2014-03-10T20:40:01 to 2014-03-10T20:44:1018:41
vipulamcrn: ok thx18:41
grapex1% more smartness? I hope you spread that across at least three commits, my brain can handle only 0.33% smartness on any given pull request.18:41
SlickNikvipul: purely refactoring around how the datastore configs are loaded.18:41
SlickNiklol @ grapex18:42
hub_capok so heres the thing18:42
SnowDust:D18:42
SnowDustlol18:42
hub_capat the end of the day, its still looking for [cassandra]... optgroups right?18:42
hub_cap[redis]... etc18:43
SnowDusthub_cap: its loaded differently and an external datastore can implement in similar pattern without a change in cfg.py18:43
grapexhub_cap: is your point that it still needs to be baked into an image?18:43
SnowDustsimilar to cassandra/redis as in the #80061/518:43
hub_capi agree w/ the split in the config file into things like18:43
*** asterix_ has quit IRC18:43
hub_cap[cassandra]... some options ... [redis]... some options ...18:44
hub_capas opposed to keeping things in default18:44
vipulSo the issue amcrn raised last time still woudl be an issue.. where you wanted to reuse an existing manager, but have different cfg opts18:44
SnowDustvipul: which issue ?18:45
*** IvanZ has quit IRC18:46
SnowDustdatastore_options = <datastore_manager> : class.from.which.to.load.the.options ( gets in conf files)18:46
vipulSInce you'll be loading datastore specific options.py, you can't have the scenario where you can reuse a manager, but supply different config18:46
SnowDustand then is loaded from cfg.py ..18:46
vipuloh i see18:46
SlickNikhub_cap: It's still keeping that structure. It's splitting out the config into different files (one per datastore), and loading those files dynamically based on a default config dict value.18:47
vipulyea i don't really see anything contentious about this BP18:48
SlickNikYeah, I'm good with it too.18:48
SnowDustvipul: additionally to that to keep the current behaviour  i have used a dict in cfg.py for already available datastores18:48
hub_capwill this require operators to change their configs?18:49
SnowDusthub_cap: no for default datastores no changes from their end18:49
hub_capcool18:49
amcrnone divergence from a pattern already in existence is https://github.com/openstack/trove/blob/fba8cabea326527bacdeca56760a97e14cdcc18f/trove/guestagent/dbaas.py#L34-L5118:50
esmuteinstead of defining the 'datastore_options_definition' in the cfg, can that be somehow obtained based on the datastore?18:50
amcrnwhere the defaults are force loaded, but the operator can add extensions18:50
amcrnwhereas this patch allows you to override everything18:50
SnowDusthub_cap: this adds the flexibility to the external datastore implementation ( where operators CAN kick in )18:50
SnowDustamcrn : right18:50
esmutelike the config would be obtained from trove.guestagent.datastore.[datastore].options18:50
SnowDustesmute: we can have them in the conf file itself18:50
SnowDustesmute: not like that i suggest ..18:51
esmutethat way the cfg file is totally decoupled from the datastore config18:51
hub_capif u put that conf value in the file18:51
hub_capitll override it, period18:52
hub_capthe trove.blah... wont matter18:52
vipulamcrn: ++ that would also address what esmute is saying.. have sane defaults already configured18:52
SnowDustvipul: cfg.py is loading the sane defaults if u see18:53
amcrnSnowDust: but your implementation is a purge-replace, see datastore_options @ https://review.openstack.org/#/c/80061/5/trove/common/cfg.py18:54
SnowDustbut to decouple completely, we may set datastore_options variable to default=dict()18:54
SnowDustand datastore_options may be defined in sample.conf for sane defaults18:54
amcrnthe point is, even if you decouple there, https://github.com/openstack/trove/blob/fba8cabea326527bacdeca56760a97e14cdcc18f/trove/guestagent/dbaas.py#L34-L51 still exists18:54
grapexamcrn: So you're saying "choose a path"?18:55
amcrni'm saying that the in-flight patch as-is is dangerous, because it allows you to sever the registration of a datastore without cleaning up https://github.com/openstack/trove/blob/fba8cabea326527bacdeca56760a97e14cdcc18f/trove/guestagent/dbaas.py#L34-L51; it's an incomplete solution.18:56
SnowDustamcrn: its about the options not the datastore manager class18:56
grapexWhat if this self-contained, datastore specific code could also append that "defaults" dict?18:56
amcrngrapex: right, all i'm asking for is consistency; that would be one option.18:56
grapexamcrn: What if "defaults" was made into an empty dict, then this extra code, when loaded, would add to the dict?18:56
amcrnthat's an option18:57
SlickNikamcrn: agreed.18:57
grapexamcrn: I get it. I second making that a requirement and enforcing it during the pull request.18:57
*** esp has left #openstack-trove18:57
grapexSo... are we good with this?18:58
SlickNikgrapex: sounds good.18:58
SnowDusti am ready to take notes18:58
amcrnhave to bounce, bbl.18:59
grapexMe too- I've got a meeting in a minute or so.18:59
SlickNikThat's all we had for today anyhow.18:59
hub_caphttps://github.com/openstack/cinder/blob/master/cinder/volume/configuration.py18:59
SlickNikThanks guys. Catch you later.18:59
grapexOk, cool. ttyl19:00
SnowDustguys: is the BP approved ?19:00
hub_capi think its still pending, we should disduss later today19:00
hub_capwhen the peoples get back who had to leave19:01
SlickNikSnowDust: still needs some discussion.19:01
SnowDustSlickNik: sure19:01
*** jcru has quit IRC19:01
*** robertmy_ has quit IRC19:02
*** robertmyers has joined #openstack-trove19:02
*** kevinconway_ has joined #openstack-trove19:03
*** kevinconway has quit IRC19:05
*** kevinconway_ is now known as kevinconway19:05
*** ViswaV_ has quit IRC19:05
*** ViswaV has joined #openstack-trove19:07
*** ViswaV_ has joined #openstack-trove19:08
*** ViswaV has quit IRC19:08
*** ViswaV has joined #openstack-trove19:09
*** ViswaV_ has quit IRC19:09
*** demorris has joined #openstack-trove19:10
spredzyIs it possible to specify a keypair when creating an instance with trove-cli ?19:35
*** michael-yu has quit IRC19:37
*** jcru has joined #openstack-trove19:38
*** esp has joined #openstack-trove19:49
*** SnowDust has quit IRC19:53
*** michael-yu has joined #openstack-trove19:57
*** datsun180b has quit IRC20:04
*** ViswaV has quit IRC20:23
*** IvanZ has joined #openstack-trove20:26
*** ViswaV has joined #openstack-trove20:26
*** ViswaV_ has joined #openstack-trove20:29
*** ViswaV has quit IRC20:29
*** radez is now known as radez_g0n320:40
openstackgerritSlickNik proposed a change to openstack/trove: Update sqlalchemy migrate scripts for postgres  https://review.openstack.org/8107320:44
*** harlowja is now known as harlowja_away20:44
openstackgerritSlickNik proposed a change to openstack/trove: Update sqlalchemy migrate scripts for postgres  https://review.openstack.org/8107320:45
SlickNikspredzy: No. You don't get ssh access to the trove instance (by design). You're only allowed to access the datastore (eg. mysql) on the appropriate port(s) (eg. 3306).20:48
*** jasonb365 has joined #openstack-trove20:48
juiceis anyone using the "notifier_queue*" configurations in etc/trove/trove-taskmanager.conf?20:49
spredzySlickNik, Thanks. The by-design was the information I was looking for20:49
*** jasonb365 has quit IRC20:49
spredzyaslo I was wondering how one can create datastore when not using redstack ?20:50
spredzytrove cli and trove-manage cli does not seems to be willing to do it. Does it has to be done manually ?20:50
SlickNikspredzy: Yes, you'd have to use diskimage-builder to build a datastore image.20:51
spredzyBy datastore image, an image with trove-guestagent + the proper db packages is meant ?20:51
spredzyI've been reading the doc but I couldn't get a clear picture of that point20:52
SlickNikspredzy: This image would have to have the datastore and trove-guestagent installed, have connectivity to the trove rabbitmq queues, and start the guestagent on bootup.20:52
spredzyand the entry in datastores and datastore_versions tables needs to be done manually, right (as for now)?20:52
SlickNikspredzy: Yes, that is correct (for now).20:53
SlickNikjuice: I think nobody's using them. There's a review to clean them up in-flight.20:53
SlickNikjuice: https://review.openstack.org/#/c/74638/10/etc/trove/trove-taskmanager.conf.sample20:54
spredzySlickNik, thanks for all those info it does make sense now20:54
*** grapex has quit IRC20:54
juicethanks slicknik20:54
SlickNikspredzy: You're welcome. Ping us in the channel if you need more help with any of this.20:54
spredzyWill do for sure. Thanks again for the help20:55
*** pdmars has quit IRC21:02
openstackgerritViswa Vutharkar proposed a change to openstack/trove-integration: Adds support to kickstart diff datastore versions  https://review.openstack.org/7280421:09
openstackgerritSlickNik proposed a change to openstack/trove: Turning off XML fake-mode tests  https://review.openstack.org/7000021:12
*** rwsu has quit IRC21:16
openstackgerritAuston McReynolds proposed a change to openstack/python-troveclient: Remove Duplicate ClientExceptions and Merge  https://review.openstack.org/8032821:22
*** rwsu has joined #openstack-trove21:31
*** asterix has joined #openstack-trove21:34
*** achampion has quit IRC21:44
*** tanisdl_ has joined #openstack-trove21:47
*** tanisdl has quit IRC21:50
*** tanisdl_ is now known as tanisdl21:50
*** yogesh has quit IRC21:58
*** IvanZ has quit IRC22:04
*** thedodd has quit IRC22:08
*** robertmyers has quit IRC22:09
*** rhodgin has quit IRC22:12
*** harlowja_away is now known as harlowja22:17
*** datsun180b has joined #openstack-trove22:17
openstackgerritGiuseppe Galeota proposed a change to openstack/trove: Trove Manual Installation guide  https://review.openstack.org/7860822:24
*** michael-yu has quit IRC22:29
*** tanisdl_ has joined #openstack-trove22:30
*** tanisdl has quit IRC22:32
*** tanisdl_ is now known as tanisdl22:32
*** openstackgerrit has quit IRC22:39
*** openstackgerrit has joined #openstack-trove22:39
*** cweid has quit IRC22:41
*** michael-yu has joined #openstack-trove22:42
*** mattgriffin has quit IRC22:51
*** rhodgin has joined #openstack-trove22:52
*** tanisdl_ has joined #openstack-trove22:59
*** tanisdl has quit IRC23:02
cp16nethmm anyone used the trove cli to list more than the paginated limit?23:03
cp16neti dont see a way of passing in the marker23:04
cp16netor a new limit23:04
*** tanisdl_ has quit IRC23:04
*** demorris has quit IRC23:05
*** michael-yu has quit IRC23:08
*** michael-yu has joined #openstack-trove23:09
*** jcru has quit IRC23:16
*** eguz_ has joined #openstack-trove23:16
SlickNikcp16net: is this for backups?23:17
*** eguz has quit IRC23:17
SlickNikcp16net: I haven't tried it myself. robertmyers would be the best person to ask.23:17
*** yidclare has quit IRC23:18
cp16netno this is for instances23:18
cp16netlooks like the cli doesnt support this23:18
cp16netwith optional args23:19
cp16netbut the client lib does23:19
cp16netneed a bug for this.23:19
SlickNikcp16net: gotcha. Can you open one for this, please?23:19
*** kevinconway has quit IRC23:22
openstackgerritGiuseppe Galeota proposed a change to openstack/trove: Trove Manual Installation guide  https://review.openstack.org/8111223:23
*** rramirez has quit IRC23:26
asterixplease don't consider the review I posted https://review.openstack.org/8111223:27
*** achampion has joined #openstack-trove23:30
juiceasterix: is that an attempt at reverse-psychology23:32
juiceasterix: did you know there was a person on this channel name aterix earlier?23:32
asterixjuice: no, I didn't23:33
*** ViswaV_ has quit IRC23:33
*** amytron has quit IRC23:33
openstackgerritGiuseppe Galeota proposed a change to openstack/trove: Trove Manual Installation guide  https://review.openstack.org/8111723:38
asterixOK, this review is good23:39
asterixSo, now I change my nickname23:40
*** asterix has quit IRC23:41
*** tattabbum has joined #openstack-trove23:41
*** tattabbum has quit IRC23:46
*** jmontemayor has quit IRC23:48

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!