openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: [WIP] Normalized event data https://review.openstack.org/143744 | 00:08 |
---|---|---|
*** alexismonville has joined #storyboard | 00:14 | |
*** alexismonville has quit IRC | 00:41 | |
*** mattfarina has joined #storyboard | 00:57 | |
*** reed has quit IRC | 01:19 | |
*** reed has joined #storyboard | 01:22 | |
*** wuhg has joined #storyboard | 01:40 | |
*** reed has quit IRC | 01:40 | |
*** Piet has quit IRC | 02:42 | |
*** mattfarina has quit IRC | 04:09 | |
*** mattfarina has joined #storyboard | 05:10 | |
*** alexismonville has joined #storyboard | 06:13 | |
*** alexismonville has quit IRC | 07:31 | |
*** MaxV has joined #storyboard | 07:36 | |
*** mrmartin has joined #storyboard | 07:41 | |
*** MaxV has quit IRC | 07:43 | |
*** MaxV has joined #storyboard | 07:43 | |
*** MaxV has quit IRC | 07:48 | |
*** jtomasek has joined #storyboard | 08:27 | |
*** MaxV has joined #storyboard | 08:36 | |
*** alexismonville has joined #storyboard | 08:49 | |
*** jedimike has joined #storyboard | 08:55 | |
*** jcoufal has joined #storyboard | 09:07 | |
*** ssam2 has joined #storyboard | 09:25 | |
*** alexismonville has quit IRC | 09:29 | |
*** alexismonville has joined #storyboard | 09:50 | |
*** alexismonville has quit IRC | 09:57 | |
*** alexismonville has joined #storyboard | 09:57 | |
*** zaro has quit IRC | 10:05 | |
*** zaro has joined #storyboard | 10:06 | |
*** ajayaa has joined #storyboard | 10:07 | |
ajayaa | Hi guys. Why does the story board try to bind to local ports 3306, 5672 and 15672. | 10:08 |
ajayaa | These are ports for mysql and rabbitmq and rabbitmqcli. | 10:08 |
ajayaa | I am installing via the vm method. | 10:09 |
*** wdutch has quit IRC | 10:14 | |
*** wdutch has joined #storyboard | 10:14 | |
ajayaa | yolanda ^^ | 10:15 |
yolanda | ajayaa, rabbit is needed for notifications | 10:17 |
yolanda | and mysql for data storage | 10:17 |
ajayaa | yolanda, would storyboard in vm use rabbit of host machine? | 10:17 |
ajayaa | and same question goes for mysql. | 10:17 |
yolanda | ajayaa, here it explains a bit how to deploy http://ci.openstack.org/storyboard/install/development.html | 10:18 |
yolanda | so if you are using the vm approach, you can point to the localhost for rabbit and mysql | 10:19 |
ajayaa | let me try the vm approach. | 10:20 |
yolanda | k | 10:23 |
ajayaa | When I do vagrant up, I get error because in 3306 mysql is running in host machine. Is there a way to install everything mysql, rabbit inside the vm? | 10:24 |
rcarrillocruz | ajayaa: you may need to tweak the prov scripts | 10:26 |
rcarrillocruz | give me a sec | 10:26 |
ajayaa | I have done that. +1 for every port. I wonder what is the point in forwarding those ports to local machine. | 10:27 |
CTtpollard | do you have to use the vagrant vm method ajayaa? | 10:27 |
rcarrillocruz | i guess it's a matter of preference | 10:27 |
rcarrillocruz | i'd also put the mysql and rabbit ON the VM as well | 10:27 |
ajayaa | nope. I thought it would isolate the storyboard dev env. | 10:27 |
yolanda | i'm deploying locally, with a local mysql and rabbit but vm is cleaner | 10:28 |
ajayaa | When I forward my 3306 port from vm to 3307 to host, that means when I connect to host 3307 it actually connects to vm 3306. | 10:28 |
ajayaa | Why would someone connect to host 3307? | 10:29 |
ajayaa | which service would connect to 3307? | 10:29 |
CTtpollard | my deployment is local also | 10:30 |
yolanda | ajayaa, if you create a vm with mysql, rabbit, and storyboard inside, when you point to 127.0.0.1, it points to the mysql in the vm. Why are you doing port forwarding? | 10:31 |
ajayaa | yolanda, Those are present is Vagrantfile in the first place. If the vm created would have its own rabbit and mysql then port forwarding shouldn't be a part of Vagrantfile. | 10:33 |
ajayaa | It is confusing. | 10:33 |
ajayaa | Please correct me if I wrong. | 10:33 |
ajayaa | I am* wrong. | 10:34 |
yolanda | ajayaa, haven't touched vagrant so much, but i see that puppet manifests are creating rabbit and mysql | 10:35 |
yolanda | i can see a conflict in that port forwarding, if you already are running mysql or rabbit in your host this could cause trouble | 10:36 |
ajayaa | yolanda, my vm is coming up in few minutes. It will clear the confusion. | 10:36 |
ajayaa | yolanda, yes. What is the use of port-forwarding at all? | 10:36 |
rcarrillocruz | i guess it was put to make amendments on queues and mysql from the host | 10:37 |
rcarrillocruz | i.e. having a session outside of the VM session to put data/manipulate queues | 10:37 |
rcarrillocruz | and then see how it behaves for dev purposes | 10:37 |
rcarrillocruz | but that's just me guessing | 10:37 |
yolanda | yes, i don't see the need to have mysql forwarded locally | 10:38 |
yolanda | you can tweak the vagrantfile if needed, to remove that port forwarding, or change target port if it conflicts | 10:38 |
*** alexismonville has quit IRC | 10:52 | |
*** alexismonville has joined #storyboard | 10:59 | |
*** alexismonville has quit IRC | 11:04 | |
*** jcoufal_ has joined #storyboard | 11:45 | |
*** jcoufal has quit IRC | 11:49 | |
*** mattfarina has quit IRC | 11:49 | |
*** mattfarina has joined #storyboard | 11:58 | |
*** ssam2 has quit IRC | 12:11 | |
*** ssam2 has joined #storyboard | 12:25 | |
openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Add grunt-lintspaces module to check cr-at-end in js files https://review.openstack.org/145483 | 12:29 |
*** petefoth has left #storyboard | 12:33 | |
*** miqui has quit IRC | 12:36 | |
*** MaxV has quit IRC | 12:44 | |
*** ssam2 has quit IRC | 12:44 | |
*** alexismonville has joined #storyboard | 12:46 | |
*** mase_x200 has joined #storyboard | 12:48 | |
*** alexismonville1 has joined #storyboard | 12:50 | |
*** alexismonville has quit IRC | 12:50 | |
*** ssam2 has joined #storyboard | 12:57 | |
*** alexismonville1 has quit IRC | 13:00 | |
*** alexismonville has joined #storyboard | 13:02 | |
*** MaxV has joined #storyboard | 13:06 | |
ajayaa | HI yolanda, got development env up and running. | 13:12 |
ajayaa | please suggest a small task. | 13:12 |
yolanda | ajayaaa, nice, using vm approach | 13:13 |
yolanda | ? | 13:13 |
*** mattfarina has quit IRC | 13:13 | |
*** mattfarina has joined #storyboard | 13:14 | |
ajayaa | yolanda, yes. | 13:18 |
ajayaa | only two aa's :) | 13:18 |
yolanda | where do you want to work, in the backend or frontend? | 13:18 |
ajayaa | backend. | 13:19 |
ajayaa | Is there a place where I can find api documentation. | 13:19 |
*** mattfarina has quit IRC | 13:21 | |
*** mattfarina has joined #storyboard | 13:22 | |
ajayaa | I think doc/source/webapi/v1.rst is the place for docs. | 13:23 |
*** mattfarina has quit IRC | 13:27 | |
*** jcoufal_ has quit IRC | 13:31 | |
*** jcoufal has joined #storyboard | 13:31 | |
*** mase_x200 has quit IRC | 13:31 | |
yolanda | http://ci.openstack.org/storyboard/webapi/v1.html | 13:32 |
yolanda | same as the rst you mentioned i think | 13:32 |
yolanda | that looks as a simple task to start , although i don't have much details https://storyboard.openstack.org/#!/story/165 | 13:34 |
ajayaa | yolanda, do you examples of REST calls? | 13:44 |
ajayaa | for e.g. I need to create a user. I would call POST /users with a body and optional http headers. | 13:45 |
yolanda | ajayaa, it's following pecan standards | 13:46 |
yolanda | so you post /v1/users | 13:46 |
yolanda | and in the body you send a json with the parameters stated in the User type | 13:46 |
yolanda | you can find the classes in storyboard/api/v1/wmodels.py | 13:48 |
ajayaa | yolanda, thanks! :) | 13:51 |
yolanda | anytime | 13:53 |
ajayaa | yolanda, one more thing. How do I authenticate with storyboard before POST. It replies me with 401 now(unauthorized). | 14:01 |
yolanda | ajayaa, for testing backend, you need to take a look at how authentication is handled there | 14:02 |
yolanda | normal workflow is to login from the frontend | 14:02 |
yolanda | but you can use a fake auth for testing | 14:02 |
*** alexismonville has quit IRC | 14:29 | |
*** alexismonville has joined #storyboard | 14:32 | |
krotscheck | I’m awake! | 14:45 |
krotscheck | Good morning everyone :) | 14:45 |
*** mattfarina has joined #storyboard | 14:53 | |
*** alexismonville has quit IRC | 14:56 | |
*** ajayaa has quit IRC | 14:57 | |
yolanda | hi krotscheck | 14:58 |
rcarrillocruz | helo krotscheck | 15:02 |
rcarrillocruz | yolanda: could you describe that fake auth a bit? | 15:03 |
rcarrillocruz | that'd be helpful for testing the websocket auth part i'm working on | 15:03 |
krotscheck | rcarrillocruz: If you have a login already, you can issue yourself a long lasting OAuth token from the user preferences UI. | 15:03 |
yolanda | i was talking about the mock_data used in the tests | 15:06 |
yolanda | not really auth but allows to bypass it for testing api | 15:06 |
yolanda | but yes, krotscheck created that useful token feature, that should be better for you to test | 15:06 |
rcarrillocruz | let me investigate, thx | 15:08 |
krotscheck | Oh, right. | 15:09 |
yolanda | look at user_tokens stuff | 15:09 |
krotscheck | the mock data in the functional tests have a token called “valid_superuser_token” and “valid_user_token" | 15:09 |
*** alexismonville has joined #storyboard | 15:15 | |
krotscheck | jedimike: You around? | 15:27 |
jedimike | krotscheck, hello! here but swamped, on gozer support duty this week | 15:31 |
*** alexismonville has quit IRC | 15:42 | |
*** alexismonville has joined #storyboard | 15:42 | |
yolanda | krotscheck, i finally added the check for js files, and added newlines to all that were failing | 15:44 |
*** ajayaa has joined #storyboard | 15:45 | |
* yolanda is tired of all unrelated newlines in all changes | 15:46 | |
krotscheck | yolanda: Awesome. | 15:48 |
krotscheck | ajayaa: The reason we have our VM bind to localhost is because it most closely mirrors the build environment. Our jenkins build nodes run both rabbit and mysql on localhost, and that is baked into openstack’s testing frameworks in many different places. | 15:50 |
krotscheck | I put some time into trying to make the jenkins build run off of our own vagrant vm, and realized that apparently it’s not possible to run a VM inside a VM. | 15:51 |
rcarrillocruz | wootz | 15:52 |
rcarrillocruz | a decade valid token | 15:52 |
rcarrillocruz | that's awesome :-) | 15:52 |
krotscheck | I was going to add 100 year tokens, but that seemed ambitious :) | 15:54 |
ajayaa | krotscheck, I was curious about the need of port forwarding. | 15:58 |
*** alexismonville has quit IRC | 15:58 | |
*** jtomasek has quit IRC | 15:58 | |
ajayaa | krotscheck, How do I create a token to send POST request to the api server? | 16:00 |
ajayaa | krotscheck, my first question is already answered. sorry for asking again. :) | 16:01 |
*** alexismonville has joined #storyboard | 16:16 | |
*** reed has joined #storyboard | 16:25 | |
*** phschwartz_ has quit IRC | 16:33 | |
*** phschwartz has joined #storyboard | 16:33 | |
krotscheck | ajayaa: two ways. Either via the UI, or by inserting a token into the tokens table. Alternatively, if you’re writing tests, you can just extend base.FunctionalTest and use the mock token named “valid_user_token" | 16:40 |
ajayaa | krotscheck, I don't see token table in storyboard schema. | 16:44 |
ajayaa | I have run "tox -e venv "storyboard-db-manage --config-file ./etc/storyboard.conf upgrade head"" | 16:45 |
ajayaa | http://paste.openstack.org/show/155869/ | 16:47 |
CTtpollard | accesstokens ? | 16:48 |
krotscheck | ajayaa: There’s two tables there. Access tokens for the first step of oauth, and bearer tokens for the actual token that will give you API access. | 16:48 |
krotscheck | Wait, I may be wrong | 16:48 |
krotscheck | I am wrong! | 16:48 |
krotscheck | ajayaa: You want AccessToken | 16:49 |
*** MaxV has quit IRC | 16:49 | |
ajayaa | okay I will insert one entry to accesstokens table and try out an api request. | 16:50 |
*** jtomasek has joined #storyboard | 16:50 | |
*** coolsvap is now known as coolsvap|afk | 16:51 | |
*** coolsvap|afk is now known as coolsvap | 16:51 | |
*** coolsvap is now known as coolsvap|afk | 16:52 | |
ajayaa | krotscheck, the two fields expires_in and expires_at seem like they serve the same purpose. | 16:55 |
ajayaa | what are they? | 16:55 |
*** jcoufal has quit IRC | 17:05 | |
ajayaa | CTtpollard, curl --header "Authorization: token" -X POST -d user.json 127.0.0.1:8080/v1/users | 17:12 |
ajayaa | The above request gives 500. | 17:12 |
*** wdutch has quit IRC | 17:24 | |
*** CTtpollard has quit IRC | 17:27 | |
*** CTtpollard has joined #storyboard | 17:28 | |
*** CTtpollard has quit IRC | 17:28 | |
*** CTtpollard has joined #storyboard | 17:29 | |
krotscheck | ajayaa: 500 responses usually indicate some kind of a server response, you’ll have to debug it from the trace. | 17:34 |
ajayaa | krotscheck, can you give me an example of curl request you send to server? | 17:35 |
ajayaa | that would be most helpful. | 17:35 |
krotscheck | ajayaa: I don’t use curl, I use the webclient. | 17:35 |
krotscheck | ajayaa: You might have some luck looking at https://review.openstack.org/#/c/138092/ | 17:36 |
krotscheck | That’s the first commit in our python client library | 17:36 |
*** ssam2 has quit IRC | 17:37 | |
rcarrillocruz | ajayaa: i think SB expects a bearer token | 17:48 |
rcarrillocruz | that may be the reason for getting a 500 on that REST call | 17:48 |
krotscheck | Yeah, that —header needs to be “Authorization: Bearer token" | 17:49 |
rcarrillocruz | e.g. "Authorization: Bearer damnlongstring" | 17:49 |
*** wuhg has quit IRC | 18:04 | |
*** alexismonville has quit IRC | 18:11 | |
*** ajayaa has quit IRC | 18:24 | |
krotscheck | I’m a little annoyed at our current database abstraction. One of the features of SQLAlchemy is for there to exist a certain amount of cached data in the request thread, however we open and close db sessions with every query, which means that our entity cache is flushed with every query. | 18:39 |
krotscheck | ugh so many tests. | 18:53 |
*** jedimike has quit IRC | 20:03 | |
*** jedimike has joined #storyboard | 20:08 | |
*** alexismonville has joined #storyboard | 20:58 | |
*** openstackgerrit has quit IRC | 21:05 | |
*** openstackgerrit has joined #storyboard | 21:06 | |
*** Piet has joined #storyboard | 21:10 | |
*** mrmartin has quit IRC | 21:29 | |
*** Piet has quit IRC | 21:35 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: [WIP] Normalized event data https://review.openstack.org/143744 | 21:41 |
krotscheck | Ugh 1200 lines. | 21:42 |
krotscheck | Thankfully most of that is tests. | 21:42 |
*** alexismonville has quit IRC | 21:58 | |
*** Piet has joined #storyboard | 22:11 | |
*** mattfarina has quit IRC | 22:15 | |
*** jtomasek has quit IRC | 22:58 | |
jedimike | krotscheck, hi, i'm off support duty now, was there something you wanted to ask me earlier? | 23:08 |
krotscheck | jedimike: Was curious about where you were. I’m guessing you’re not on call anymore :) | 23:11 |
jedimike | krotscheck, heh, not for the next 8 hours anyway :) just my luck to be on support the first week back, and everything is on fire! | 23:12 |
krotscheck | Yay fire! | 23:19 |
krotscheck | Wait. | 23:19 |
krotscheck | Ok, so you’re off doing more important things until monday. Gotcha :) | 23:19 |
*** alexismonville has joined #storyboard | 23:19 | |
*** cody-somerville has quit IRC | 23:26 | |
jedimike | krotscheck, maybe, if the fires are out tomorrow, i'll be around. Wish me luck! :) | 23:31 |
krotscheck | You’ve got my best! | 23:32 |
*** jedimike has quit IRC | 23:34 | |
*** alexismonville has quit IRC | 23:39 | |
*** cody-somerville has joined #storyboard | 23:40 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!