Wednesday, 2015-01-07

openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: [WIP] Normalized event data  https://review.openstack.org/14374400:08
*** alexismonville has joined #storyboard00:14
*** alexismonville has quit IRC00:41
*** mattfarina has joined #storyboard00:57
*** reed has quit IRC01:19
*** reed has joined #storyboard01:22
*** wuhg has joined #storyboard01:40
*** reed has quit IRC01:40
*** Piet has quit IRC02:42
*** mattfarina has quit IRC04:09
*** mattfarina has joined #storyboard05:10
*** alexismonville has joined #storyboard06:13
*** alexismonville has quit IRC07:31
*** MaxV has joined #storyboard07:36
*** mrmartin has joined #storyboard07:41
*** MaxV has quit IRC07:43
*** MaxV has joined #storyboard07:43
*** MaxV has quit IRC07:48
*** jtomasek has joined #storyboard08:27
*** MaxV has joined #storyboard08:36
*** alexismonville has joined #storyboard08:49
*** jedimike has joined #storyboard08:55
*** jcoufal has joined #storyboard09:07
*** ssam2 has joined #storyboard09:25
*** alexismonville has quit IRC09:29
*** alexismonville has joined #storyboard09:50
*** alexismonville has quit IRC09:57
*** alexismonville has joined #storyboard09:57
*** zaro has quit IRC10:05
*** zaro has joined #storyboard10:06
*** ajayaa has joined #storyboard10:07
ajayaaHi guys. Why does the story board try to bind to local ports 3306, 5672 and 15672.10:08
ajayaaThese are ports for mysql and rabbitmq and rabbitmqcli.10:08
ajayaaI am installing via the vm method.10:09
*** wdutch has quit IRC10:14
*** wdutch has joined #storyboard10:14
ajayaayolanda ^^10:15
yolandaajayaa, rabbit is needed for notifications10:17
yolandaand mysql for data storage10:17
ajayaayolanda, would storyboard in vm use rabbit of host machine?10:17
ajayaaand same question goes for mysql.10:17
yolandaajayaa, here it explains a bit how to deploy http://ci.openstack.org/storyboard/install/development.html10:18
yolandaso if you are using the vm approach, you can point to the localhost for rabbit and mysql10:19
ajayaalet me try the vm approach.10:20
yolandak10:23
ajayaaWhen I do vagrant up, I get error because in 3306 mysql is running in host machine. Is there a way to install everything mysql, rabbit inside the vm?10:24
rcarrillocruzajayaa: you may need to tweak the prov scripts10:26
rcarrillocruzgive me a sec10:26
ajayaaI have done that. +1 for every port. I wonder what is the point in forwarding those ports to local machine.10:27
CTtpollarddo you have to use the vagrant vm method ajayaa?10:27
rcarrillocruzi guess it's a matter of preference10:27
rcarrillocruzi'd also put the mysql and rabbit ON the VM as well10:27
ajayaanope. I thought it would isolate the storyboard dev env.10:27
yolandai'm deploying locally, with a local mysql and rabbit but vm is cleaner10:28
ajayaaWhen I forward my 3306 port from vm to 3307 to host, that means when I connect to host 3307 it actually connects to vm 3306.10:28
ajayaaWhy would someone connect to host 3307?10:29
ajayaawhich service would connect to 3307?10:29
CTtpollardmy deployment is local also10:30
yolandaajayaa, if you create a vm with mysql, rabbit, and storyboard inside, when you point to 127.0.0.1, it points to the mysql in the vm. Why are you doing port forwarding?10:31
ajayaayolanda, Those are present is Vagrantfile in the first place. If the vm created would have its own rabbit and mysql then port forwarding shouldn't be a part of Vagrantfile.10:33
ajayaaIt is confusing.10:33
ajayaaPlease correct me if I wrong.10:33
ajayaaI am* wrong.10:34
yolandaajayaa, haven't touched vagrant so much, but i see that puppet manifests are creating rabbit and mysql10:35
yolandai can see a conflict in that port forwarding, if you already are running mysql or rabbit in your host this could cause trouble10:36
ajayaayolanda, my vm is coming up in few minutes. It will clear the confusion.10:36
ajayaayolanda, yes. What is the use of port-forwarding at all?10:36
rcarrillocruzi guess it was put to make amendments on queues and mysql from the host10:37
rcarrillocruzi.e. having a session outside of the VM session to put data/manipulate queues10:37
rcarrillocruzand then see how it behaves for dev purposes10:37
rcarrillocruzbut that's just me guessing10:37
yolandayes, i don't see the need to have mysql forwarded locally10:38
yolandayou can tweak the vagrantfile if needed, to remove that port forwarding, or change target port if it conflicts10:38
*** alexismonville has quit IRC10:52
*** alexismonville has joined #storyboard10:59
*** alexismonville has quit IRC11:04
*** jcoufal_ has joined #storyboard11:45
*** jcoufal has quit IRC11:49
*** mattfarina has quit IRC11:49
*** mattfarina has joined #storyboard11:58
*** ssam2 has quit IRC12:11
*** ssam2 has joined #storyboard12:25
openstackgerrityolanda.robla proposed openstack-infra/storyboard-webclient: Add grunt-lintspaces module to check cr-at-end in js files  https://review.openstack.org/14548312:29
*** petefoth has left #storyboard12:33
*** miqui has quit IRC12:36
*** MaxV has quit IRC12:44
*** ssam2 has quit IRC12:44
*** alexismonville has joined #storyboard12:46
*** mase_x200 has joined #storyboard12:48
*** alexismonville1 has joined #storyboard12:50
*** alexismonville has quit IRC12:50
*** ssam2 has joined #storyboard12:57
*** alexismonville1 has quit IRC13:00
*** alexismonville has joined #storyboard13:02
*** MaxV has joined #storyboard13:06
ajayaa HI yolanda, got development env up and running.13:12
ajayaaplease suggest a small task.13:12
yolandaajayaaa, nice, using vm approach13:13
yolanda?13:13
*** mattfarina has quit IRC13:13
*** mattfarina has joined #storyboard13:14
ajayaayolanda, yes.13:18
ajayaaonly two aa's :)13:18
yolandawhere do you want to work, in the backend or frontend?13:18
ajayaabackend.13:19
ajayaaIs there a place where I can find api documentation.13:19
*** mattfarina has quit IRC13:21
*** mattfarina has joined #storyboard13:22
ajayaaI think doc/source/webapi/v1.rst is the place for docs.13:23
*** mattfarina has quit IRC13:27
*** jcoufal_ has quit IRC13:31
*** jcoufal has joined #storyboard13:31
*** mase_x200 has quit IRC13:31
yolandahttp://ci.openstack.org/storyboard/webapi/v1.html13:32
yolandasame as the rst you mentioned i think13:32
yolandathat looks as a simple task to start , although i don't have much details https://storyboard.openstack.org/#!/story/16513:34
ajayaayolanda, do you examples of REST calls?13:44
ajayaafor e.g. I need to create  a user. I would call POST /users with a body and optional http headers.13:45
yolandaajayaa, it's following pecan standards13:46
yolandaso you post /v1/users13:46
yolandaand in the body you send a json with the parameters stated in the User type13:46
yolandayou can find the classes in storyboard/api/v1/wmodels.py13:48
ajayaayolanda, thanks! :)13:51
yolandaanytime13:53
ajayaayolanda, one more thing. How do I authenticate with storyboard before POST. It replies me with 401 now(unauthorized).14:01
yolandaajayaa, for testing backend, you need to take a look at how authentication is handled there14:02
yolandanormal workflow is to login from the frontend14:02
yolandabut you can use a fake auth for testing14:02
*** alexismonville has quit IRC14:29
*** alexismonville has joined #storyboard14:32
krotscheckI’m awake!14:45
krotscheckGood morning everyone :)14:45
*** mattfarina has joined #storyboard14:53
*** alexismonville has quit IRC14:56
*** ajayaa has quit IRC14:57
yolandahi krotscheck14:58
rcarrillocruzhelo krotscheck15:02
rcarrillocruzyolanda: could you describe that fake auth a bit?15:03
rcarrillocruzthat'd be helpful for testing the websocket auth part i'm working on15:03
krotscheckrcarrillocruz: If you have a login already, you can issue yourself a long lasting OAuth token from the user preferences UI.15:03
yolandai was talking about the mock_data used in the tests15:06
yolandanot really auth but allows to bypass it for testing api15:06
yolandabut yes, krotscheck created that useful token feature, that should be better for you to test15:06
rcarrillocruzlet me investigate, thx15:08
krotscheckOh, right.15:09
yolandalook at user_tokens stuff15:09
krotscheckthe mock data in the functional tests have a token called “valid_superuser_token” and “valid_user_token"15:09
*** alexismonville has joined #storyboard15:15
krotscheckjedimike: You around?15:27
jedimikekrotscheck, hello! here but swamped, on gozer support duty this week15:31
*** alexismonville has quit IRC15:42
*** alexismonville has joined #storyboard15:42
yolandakrotscheck, i finally added the check for js files, and added newlines to all that were failing15:44
*** ajayaa has joined #storyboard15:45
* yolanda is tired of all unrelated newlines in all changes15:46
krotscheckyolanda: Awesome.15:48
krotscheckajayaa: The reason we have our VM bind to localhost is because it most closely mirrors the build environment. Our jenkins build nodes run both rabbit and mysql on localhost, and that is baked into openstack’s testing frameworks in many different places.15:50
krotscheckI put some time into trying to make the jenkins build run off of our own vagrant vm, and realized that apparently it’s not possible to run a VM inside a VM.15:51
rcarrillocruzwootz15:52
rcarrillocruza decade valid token15:52
rcarrillocruzthat's awesome :-)15:52
krotscheckI was going to add 100 year tokens, but that seemed ambitious :)15:54
ajayaakrotscheck, I was curious about the need of port forwarding.15:58
*** alexismonville has quit IRC15:58
*** jtomasek has quit IRC15:58
ajayaakrotscheck, How do I create a token to send POST request to the api server?16:00
ajayaakrotscheck, my first question is already answered. sorry for asking again. :)16:01
*** alexismonville has joined #storyboard16:16
*** reed has joined #storyboard16:25
*** phschwartz_ has quit IRC16:33
*** phschwartz has joined #storyboard16:33
krotscheckajayaa: two ways. Either via the UI, or by inserting a token into the tokens table. Alternatively, if you’re writing tests, you can just extend base.FunctionalTest and use the mock token named “valid_user_token"16:40
ajayaakrotscheck, I don't see token table in storyboard schema.16:44
ajayaaI have run "tox -e venv "storyboard-db-manage --config-file ./etc/storyboard.conf upgrade head""16:45
ajayaahttp://paste.openstack.org/show/155869/16:47
CTtpollardaccesstokens ?16:48
krotscheckajayaa: There’s two tables there. Access tokens for the first step of oauth, and bearer tokens for the actual token that will give you API access.16:48
krotscheckWait, I may be wrong16:48
krotscheckI am wrong!16:48
krotscheckajayaa: You want AccessToken16:49
*** MaxV has quit IRC16:49
ajayaaokay I will insert one entry to accesstokens table and try out an api request.16:50
*** jtomasek has joined #storyboard16:50
*** coolsvap is now known as coolsvap|afk16:51
*** coolsvap|afk is now known as coolsvap16:51
*** coolsvap is now known as coolsvap|afk16:52
ajayaakrotscheck, the two fields expires_in and expires_at seem like they serve the same purpose.16:55
ajayaawhat are they?16:55
*** jcoufal has quit IRC17:05
ajayaaCTtpollard, curl --header "Authorization: token" -X POST -d user.json 127.0.0.1:8080/v1/users17:12
ajayaaThe above request gives 500.17:12
*** wdutch has quit IRC17:24
*** CTtpollard has quit IRC17:27
*** CTtpollard has joined #storyboard17:28
*** CTtpollard has quit IRC17:28
*** CTtpollard has joined #storyboard17:29
krotscheckajayaa: 500 responses usually indicate some kind of a server response, you’ll have to debug it from the trace.17:34
ajayaakrotscheck, can you give me an example of curl request you send to server?17:35
ajayaathat would be most helpful.17:35
krotscheckajayaa: I don’t use curl, I use the webclient.17:35
krotscheckajayaa: You might have some luck looking at https://review.openstack.org/#/c/138092/17:36
krotscheckThat’s the first commit in our python client library17:36
*** ssam2 has quit IRC17:37
rcarrillocruzajayaa: i think SB expects a bearer token17:48
rcarrillocruzthat may be the reason for getting a 500 on that REST call17:48
krotscheckYeah, that —header needs to be “Authorization: Bearer token"17:49
rcarrillocruze.g. "Authorization: Bearer damnlongstring"17:49
*** wuhg has quit IRC18:04
*** alexismonville has quit IRC18:11
*** ajayaa has quit IRC18:24
krotscheckI’m a little annoyed at our current database abstraction. One of the features of SQLAlchemy is for there to exist a certain amount of cached data in the request thread, however we open and close db sessions with every query, which means that our entity cache is flushed with every query.18:39
krotscheckugh so many tests.18:53
*** jedimike has quit IRC20:03
*** jedimike has joined #storyboard20:08
*** alexismonville has joined #storyboard20:58
*** openstackgerrit has quit IRC21:05
*** openstackgerrit has joined #storyboard21:06
*** Piet has joined #storyboard21:10
*** mrmartin has quit IRC21:29
*** Piet has quit IRC21:35
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: [WIP] Normalized event data  https://review.openstack.org/14374421:41
krotscheckUgh 1200 lines.21:42
krotscheckThankfully most of that is tests.21:42
*** alexismonville has quit IRC21:58
*** Piet has joined #storyboard22:11
*** mattfarina has quit IRC22:15
*** jtomasek has quit IRC22:58
jedimikekrotscheck, hi, i'm off support duty now, was there something you wanted to ask me earlier?23:08
krotscheckjedimike: Was curious about where you were. I’m guessing you’re not on call anymore :)23:11
jedimikekrotscheck, heh, not for the next 8 hours anyway :) just my luck to be on support the first week back, and everything is on fire!23:12
krotscheckYay fire!23:19
krotscheckWait.23:19
krotscheckOk, so you’re off doing more important things until monday. Gotcha :)23:19
*** alexismonville has joined #storyboard23:19
*** cody-somerville has quit IRC23:26
jedimikekrotscheck, maybe, if the fires are out tomorrow, i'll be around. Wish me luck! :)23:31
krotscheckYou’ve got my best!23:32
*** jedimike has quit IRC23:34
*** alexismonville has quit IRC23:39
*** cody-somerville has joined #storyboard23:40

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!