openstackgerrit | Ruslan Kamaldinov proposed a change to openstack-infra/storyboard: Added documentation for REST API layer. https://review.openstack.org/69212 | 00:02 |
---|---|---|
*** drdee has joined #storyboard | 02:16 | |
*** drdee has quit IRC | 03:21 | |
*** drdee has joined #storyboard | 03:37 | |
*** drdee has quit IRC | 03:43 | |
*** david-lyle has joined #storyboard | 03:51 | |
*** drdee has joined #storyboard | 03:55 | |
*** drdee has quit IRC | 04:22 | |
*** drdee has joined #storyboard | 04:28 | |
*** drdee has quit IRC | 05:47 | |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 06:04 | |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 06:31 | |
*** miqui has quit IRC | 06:33 | |
*** miqui has joined #storyboard | 06:33 | |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 06:57 | |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 07:20 | |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 07:48 | |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 08:03 | |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 08:03 | |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 08:17 | |
*** che-arne has quit IRC | 08:40 | |
openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Load projects from yaml file https://review.openstack.org/66280 | 09:18 |
*** _ruhe is now known as ruhe | 09:35 | |
ttx | ilyashakhat, SergeyLukjanov_, NikitaKonovalov_, ruhe : progress on the visa ? | 10:46 |
*** NikitaKonovalov_ is now known as NikitaKonovalov | 10:47 | |
ruhe | ttx: SergeyLukjanov_, NikitaKonovalov_, ruhe still don't have visas. our chances aren't good | 10:47 |
ttx | damn | 10:47 |
ruhe | yeah, turns out belgium embassy has a bad reputation here for not allowing people to enter without any reason | 10:48 |
ttx | ruhe: if there is anything I can do to help, let me know | 10:48 |
ruhe | ttx: thank you. our HR do the best they can, but they can't even request current status of our visas. we only know they're still on review. | 10:49 |
ruhe | there is a claim on the website that it take no more than 10 days to process visa application. it's already past 20 working days since we applied | 10:50 |
ttx | ruhe: was looking if france would be more accommodating, but apparently you need to apply in the country you'll stay in (which is Belgium) so that wouldn't help | 10:51 |
ruhe | ttx: well, in case if we don't make it, you guys please scrupulously document everything you agree on :) | 11:00 |
*** ruhe is now known as _ruhe | 11:12 | |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 11:17 | |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 11:33 | |
*** _ruhe is now known as ruhe | 11:39 | |
openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Load projects from yaml file https://review.openstack.org/66280 | 12:01 |
*** ruhe is now known as _ruhe | 12:52 | |
*** _ruhe is now known as ruhe | 12:54 | |
*** david-lyle has quit IRC | 13:05 | |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 13:31 | |
ttx | looks unstuck but the graph really looks funny | 13:49 |
*** miqui has joined #storyboard | 14:09 | |
*** drdee has joined #storyboard | 14:18 | |
*** drdee has quit IRC | 14:39 | |
openstackgerrit | Ruslan Kamaldinov proposed a change to openstack-infra/storyboard: Update documentation https://review.openstack.org/69211 | 14:54 |
mordred | morning all | 15:06 |
* mordred is sad about visas :( | 15:06 | |
mordred | perhaps next time we should pick a country that's easy for both russians and americans ... I think finland is friendly to both? and latvia? | 15:07 |
mordred | ruhe: I'm going to spin up a database and a cloud server to try your puppet out on | 15:07 |
mordred | ruhe: can you fix one thing real quick? (or I can) - the hostname in site.pp should not be capitalized | 15:08 |
*** ruhe is now known as _ruhe | 15:12 | |
*** cody-somerville has joined #storyboard | 15:17 | |
openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Database fixture added https://review.openstack.org/69384 | 15:21 |
mordred | _ruhe: nevermind - I needed to make a couple of other small changes too | 15:28 |
*** _ruhe is now known as ruhe | 15:33 | |
mordred | ruhe: I'm rebasing your change on top of the projects.yaml rework | 15:35 |
ruhe | mordred: can you point me to patch? :) which one you referring to? | 15:36 |
mordred | NikitaKonovalov: your load-from-yaml patch is WIP - anything I can help poke at there? | 15:37 |
mordred | ruhe: the puppet patch | 15:37 |
ruhe | mordred: ah, this is my favourite patch | 15:37 |
mordred | ruhe: I'm about to test it out on a new server :) | 15:38 |
mordred | ruhe: I also changed it to consume an external db | 15:38 |
ruhe | mordred: awesome! | 15:38 |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 15:38 | |
*** david-lyle has joined #storyboard | 15:42 | |
*** drdee has joined #storyboard | 15:45 | |
miqui | ..hello... | 15:48 |
miqui | ruhe: am curious did you build a new puppet type to read an external db? say like mysql? | 15:49 |
ruhe | miqui: mordred already did that | 15:49 |
ruhe | mordred: is it going to be Trove managed MySQL database? | 15:50 |
mordred | yes | 15:58 |
mordred | so it actually means it's easier - we don't have to manage the db in puppet at all | 15:58 |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 15:58 | |
*** NikitaKonovalov is now known as NikitaKonovalov_ | 16:00 | |
ruhe | mordred: one more question. you added $projects_file, but there is no action to execute "storyboard-db-manage load-projects". is it intentional? | 16:01 |
mordred | well, I wanted to go ahead and add the file - but then the load-projects patch hasnt' landed yet | 16:03 |
ruhe | mordred: i still -1 that patch because it lacks test coverage. i don't want something untested to be used every day in production | 16:04 |
ruhe | Nikita already did a good job, soon he will upload testing infrastructure and all these stuff will be tested | 16:05 |
mordred | cool | 16:06 |
mordred | ruhe: well, I'm testing the puppet right now on the nwe server I created | 16:06 |
mordred | ruhe, ttx, NikitaKonovalov_: storyboard.openstack.org is now runing - it doesn't seem to do anything | 16:18 |
ruhe | mordred: did you fix webclient tarball url? | 16:20 |
ruhe | in init.pp line 25 | 16:20 |
ruhe | at this moment there's only http://tarballs.openstack.org/storyboard-webclient/storyboard-webclient-master.tar.gz available | 16:21 |
ruhe | mordred: also http://storyboard.openstack.org/api/v1/projects returns 500 error. probably there is something wrong with storyboard-api | 16:22 |
ruhe | mordred: assuming index now display a nice page, i guess you fixed fix webclient tarball url | 16:23 |
ruhe | anyway, i'm happy storyboard.openstack.org is now online :) | 16:24 |
ruhe | i'll step away, for a couple of hours | 16:25 |
*** ruhe is now known as _ruhe | 16:25 | |
openstackgerrit | Monty Taylor proposed a change to openstack-infra/storyboard: Don't try to install file that doesn't exist https://review.openstack.org/69402 | 16:28 |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 16:30 | |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 16:54 | |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 17:03 | |
openstackgerrit | A change was merged to openstack-infra/storyboard: Don't try to install file that doesn't exist https://review.openstack.org/69402 | 17:03 |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 17:26 | |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 17:41 | |
openstackgerrit | Monty Taylor proposed a change to openstack-infra/storyboard: Added documentation for REST API layer. https://review.openstack.org/69212 | 17:42 |
*** NikitaKonovalov_ is now known as NikitaKonovalov | 18:02 | |
*** NikitaKonovalov is now known as NikitaKonovalov_ | 18:05 | |
*** david-lyle has quit IRC | 18:06 | |
*** NikitaKonovalov_ is now known as NikitaKonovalov | 18:09 | |
*** krotscheck has joined #storyboard | 18:14 | |
*** david-lyle has joined #storyboard | 18:21 | |
NikitaKonovalov | hi everyone | 18:25 |
* krotscheck is aghast. People have actually done code reviews. MADNESS! | 18:25 | |
NikitaKonovalov | the log file told me, we've got a serrver running, correct? | 18:26 |
krotscheck | NikitaKonovalov: No idea, I don't have a shell that stays connected to IRC overnight | 18:27 |
*** NikitaKonovalov is now known as NikitaKonovalov_ | 18:27 | |
*** _ruhe is now known as ruhe | 18:32 | |
*** NikitaKonovalov_ is now known as NikitaKonovalov | 18:33 | |
ruhe | krotscheck: znc is a pretty good and easy to use irc bouncer | 18:34 |
ruhe | NikitaKonovalov: krotscheck: quote - <mordred> ruhe, ttx, NikitaKonovalov_: storyboard.openstack.org is now runing - it doesn't seem to do anything | 18:35 |
NikitaKonovalov | I'm using it right now, but it takes some time for messages to arrive | 18:36 |
ruhe | mordred: is there any way i could get access to server logs from storyboard.openstack.org? | 18:37 |
krotscheck | kk | 18:38 |
krotscheck | ruhe: Neither http nor https are resolving for me. | 18:38 |
openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Database fixture added https://review.openstack.org/69384 | 18:40 |
krotscheck | Network unreachable on storyboard.o.o - both from inside and outside of HP's network. It looks like it's trying to resolve IPv6 though | 18:40 |
NikitaKonovalov | I cant get any response either | 18:41 |
krotscheck | Well, I can ping the box. Ergo, we need server access to see what's going on. mordred's on a plane, his response time will be iffy | 18:42 |
ruhe | krotscheck: NikitaKonovalov: it was browser cache. but i've seen it working :) at least there were html pages | 18:46 |
krotscheck | ruhe: Given that your patch still hasn't landed, it's probably safe to say that all the plumbing isn't ther eyet. | 18:47 |
krotscheck | ...or has it | 18:48 |
krotscheck | Nope. | 18:48 |
NikitaKonovalov | ok, then it's time to focus on load_projects patch, so that there is some data to display | 18:50 |
ruhe | krotscheck: on the other hand, https://review.openstack.org/#/c/65017/ has +2 from mordred | 18:51 |
ruhe | which is huge success for me :) | 18:51 |
krotscheck | ruhe: Hellz yeah | 18:51 |
ruhe | even though he added couple of changes to that patch | 18:51 |
krotscheck | ruhe: I'm currently updating the various artifact upload patches to use "latest" | 18:52 |
*** NikitaKonovalov is now known as NikitaKonovalov_ | 18:53 | |
*** SergeyLukjanov_ is now known as SergeyLukjanov | 18:53 | |
*** NikitaKonovalov_ is now known as NikitaKonovalov | 18:57 | |
*** NikitaKonovalov is now known as NikitaKonovalov_ | 19:12 | |
*** ruhe is now known as _ruhe | 19:15 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added no_api env https://review.openstack.org/68610 | 19:20 |
krotscheck | NikitaKonovalov_- I just added some README text and renamed the node venv to venv, since that's hardcoded all over the place in infra. | 19:21 |
mordred | morning | 19:47 |
mordred | krotscheck: re: tox - we normally have an env that when run runs tests, and one called venv that doesn't do anything other than pass through commands to the venv - which we normally call venv | 19:52 |
krotscheck | mordred: Interesting. Is that documented anywhere? | 19:52 |
mordred | krotscheck: https://wiki.openstack.org/wiki/ProjectTestingInterface | 19:54 |
mordred | krotscheck: now - that's python - so some things want to be different of course | 19:54 |
krotscheck | Ugh | 19:55 |
krotscheck | mordred: Righto then | 19:56 |
krotscheck | I can revert those. I'm currently working on the puppet module though. | 19:56 |
mordred | krotscheck: the current patch on the top of the stack seems to install properly - whatcha doing? | 19:58 |
krotscheck | jeblair left some comments | 19:58 |
mordred | cool | 19:58 |
* mordred goes to look | 19:58 | |
mordred | krotscheck: so - the current issue I'm seeing is that when I try to go there , I get 503s, are you seeing that too? | 19:59 |
krotscheck | mordred: You mean storyboard.o.o? | 20:00 |
krotscheck | I'm not getting anything | 20:00 |
mordred | oh. well that's different from me at least :) | 20:00 |
mordred | I get Error 503 Service Unavailable from 166.78.175.27 | 20:00 |
mordred | BUT - if I curl the api url from a machien that is not my laptop , I get an empty list | 20:01 |
krotscheck | That COULD be correct. | 20:01 |
krotscheck | I don't get an HTTP response from 166.78.175.27 at all | 20:01 |
krotscheck | traceroute and ping work though, so that's a thing. | 20:02 |
krotscheck | mordred: Would it make more sense to "curl $tarball | tar xvz" into /var/lib/storyboard/dist and then "rsync" from there to /var/lib/storyboard/www? | 20:03 |
mordred | krotscheck: yes. probably so | 20:04 |
krotscheck | I don't know how rsync works with that race condition you mentioned. | 20:05 |
*** openstackgerrit has quit IRC | 20:06 | |
*** openstackgerrit has joined #storyboard | 20:06 | |
*** _ruhe is now known as ruhe | 20:06 | |
mordred | the only way to be sure we have no race condition would be to untar into a new dir and then have /var/lib/storyboard/www be a synlink to that | 20:07 |
mordred | so taht we can do ln -sf /var/lib/storyboard/dist/xxxxx /var/lib/storyboard/www | 20:07 |
mordred | as an atomic action | 20:07 |
mordred | HOWEVER - expressing that in puppet might be a bit crap | 20:07 |
mordred | so we could just do rsync --delete from /var/lib/storyboard/dist to /var/lib/storyboard/www and be ok with the fact that there is a split second of time where we might have half of the html/js copied over and half of the old version | 20:08 |
cody-somerville | Shouldn't we have the js files and stuff with a versioned url? | 20:10 |
mordred | that would very quickly become rather unworkable, no? | 20:10 |
mordred | we're talking about deploying every commit | 20:10 |
krotscheck | cody-somerville: There's actually a packaging step in grunt that appends part of the md5sum to the filename. | 20:11 |
mordred | oh. nevermind. /me shuts up | 20:11 |
krotscheck | cody-somerville: That's not enabled yet though, but it's a common strategy for cachebusting. | 20:11 |
* cody-somerville nods. | 20:11 | |
ruhe | mordred: doesn't file { $unpack_target: purge => true, } solve all the possible race errors? | 20:11 |
krotscheck | So rsync --delete is probably more dangerous. | 20:11 |
mordred | ruhe: does it? I thought puppet would just copy and then delete files - if it's smarter than that, then neat | 20:12 |
ruhe | mordred: it should just clear all the contents of the dir on each run because all the files in this directory aren't managed by puppet | 20:13 |
ruhe | i'm not 100% sure about this, but i can test it tomorrow (during night in US) | 20:14 |
krotscheck | Hey, shouldn't there be a service { 'httpd': ensure => running} somewhere? | 20:14 |
mordred | I think that's handled by the apache class? | 20:14 |
ruhe | krotscheck: mordred: yes, it should be handled by apache class | 20:15 |
krotscheck | ruhe: mordred: Got it | 20:15 |
ruhe | mordred: are you going to resolve comments from jeblair? or do you want me to resolve them? | 20:15 |
mordred | ruhe: I think krotscheck is | 20:16 |
krotscheck | Working on it. | 20:16 |
ruhe | krotscheck: cool, thank you | 20:16 |
ruhe | collaborative work produces best results | 20:16 |
*** drdee has quit IRC | 20:19 | |
ruhe | krotscheck: pleas note that file { $unpack_target: purge => true, } might resolve race issues, but we need to test it | 20:20 |
ruhe | there are folks (puppet gurus) in infra channel who can confirm it, but don't remember their nicks | 20:22 |
* mordred just asked AaronGr to pop in here | 20:25 | |
*** AaronGr has joined #storyboard | 20:25 | |
mordred | AaronGr: we have questions aroudn the atomicity of file { $unpack_target: purge => true, } | 20:27 |
AaronGr | mordred: what would you like to know? | 20:28 |
mordred | ruhe: meet AaronGr , he knows everything about puppet. also, my network is very laggy | 20:29 |
mordred | krotscheck: where can I find your ssh key? ruhe same question | 20:30 |
AaronGr | ruhe: monty lies, i know not nearly enough, but i'm working on it :) | 20:30 |
ruhe | AaronGr: hi! | 20:31 |
ruhe | AaronGr: so i have comments from jeblair here https://review.openstack.org/#/c/65017/14/modules/storyboard/manifests/init.pp | 20:31 |
ruhe | comments about tmpdir races | 20:32 |
AaronGr | ruhe: ok, i can see those .. what's the question? | 20:33 |
mordred | AaronGr: we want to lay out new html/js/css dirs from a tarball - and we'd like to do it atomicly | 20:34 |
mordred | so that we dont' server half-old/half-new applications | 20:34 |
krotscheck | mordred: Sec. Trying to resolve a bloody rebase conflict... | 20:38 |
mordred | krotscheck: enjoy that | 20:39 |
AaronGr | ruhe: sorry, i've gotta ask - what race condition is jeblair worried will happen? | 20:42 |
*** SergeyLukjanov is now known as SergeyLukjanov_ | 20:44 | |
AaronGr | ruhe: i can see the todo mentioning a race condition, what will definitely cause a breakage while it runs, but that's not what's being commented on. | 20:46 |
*** ruhe is now known as _ruhe | 20:46 | |
krotscheck | mordred: You removed review.projects.yaml? | 20:47 |
krotscheck | mordred: n/m | 20:48 |
mordred | AaronGr: two different issues - I believe jeblair is concerned about tempdir stuff - I'm worried about atomic updates | 20:50 |
AaronGr | mordred: i would personally not use /tmp for these operations, since worst case it's a garbage can. the rm/move is a bit ugly, that's definitely not atomic -- the operations in /tmp though look to be serial | 20:54 |
krotscheck | AaronGr, mordred, _ruhe: I've just updated the patch. | 20:55 |
krotscheck | All changes are between line 119 and 153 (with a bit of a change at the top where I added curl as a package dependency) | 20:56 |
*** _ruhe is now known as ruhe | 20:56 | |
krotscheck | I took ruhe's suggestion to just use file{} rather than rsync | 20:57 |
mordred | krotscheck: yeah. worth a try! | 20:59 |
AaronGr | krotscheck: pre-lunch so my thought process isn't totally clear, but this looks like get-webclient will run every time -- is that intentional? | 20:59 |
mordred | krotscheck: so - one quick thing - how does that know there is a new webclietn tarball to pull? | 21:00 |
mordred | AaronGr: jinx | 21:00 |
ruhe | yeah, it'll update webclient on each puppet run, which every 15 minutes if i'm not mistaken | 21:01 |
krotscheck | Oh, crap. Forgot that this'd be an agent run. | 21:01 |
AaronGr | looks like it's just curl -> unpack to folder. could you not do wget/curl to disk, then subscribe the unpack to that file? | 21:01 |
* krotscheck is still new to puppet | 21:01 | |
AaronGr | kind of a mix of the previous patch and this one | 21:01 |
ruhe | this is the pain you get when you install from tarball | 21:03 |
AaronGr | krotscheck: it does deal with i/o blockage during an rm -- but it's still not atomic, since you are waiting on tar/gz | 21:03 |
AaronGr | wait, i must need food. i see, unpacks to dist/, then puppet copies files around. yeah, that's better, other than the re-download. back in a bit, food now. | 21:06 |
krotscheck | I really just need to figure out how to only download the tarball when the Cache header changes. | 21:07 |
AaronGr | krotscheck: something like http://blog.yjl.im/2012/03/downloading-only-when-modified-using.html ? | 21:10 |
krotscheck | AaronGr: Found the exact same flag on a different page, trying it now. | 21:12 |
krotscheck | AaronGr: well, now it doesn't download every time, but it still triggers the untar and the file. | 21:27 |
krotscheck | curl -z still exits 0 if it doesn't download anything :/ | 21:28 |
krotscheck | I recall there being an option where it'll return how much it pulled down, seeing if I can trigge ron that... | 21:28 |
ruhe | honestly, i did a lot of web search before i decided to use this ugly method: download->compare->unpack | 21:29 |
*** drdee has joined #storyboard | 21:32 | |
*** miqui has quit IRC | 21:48 | |
*** ruhe is now known as _ruhe | 21:48 | |
krotscheck | _ruhe: I'm (mostly) reverting to your method. | 21:56 |
*** drdee has quit IRC | 22:24 | |
*** drdee has joined #storyboard | 22:27 | |
krotscheck | jesusaurus, you happen to know what that untar flag is off the top of your head? | 22:28 |
jesusaurus | i think its just --delete | 22:28 |
jesusaurus | but i would have to open the manpage to double check | 22:29 |
*** _ruhe is now known as ruhe | 22:30 | |
krotscheck | jesusaurus: Yeah, that only works when creating an archive. | 22:31 |
jesusaurus | oh... | 22:31 |
jesusaurus | krotscheck: maybe --remove-files does what you want? | 22:33 |
*** ruhe is now known as _ruhe | 22:38 | |
krotscheck | mordred: So should I be changing the two tox reviews back to node rather than venv? | 22:46 |
mordred | krotscheck: I think we can call the other one whatever makes sense to you | 22:48 |
mordred | krotscheck: I think if venv doesn't take an argument, people will get confused | 22:48 |
mordred | so, longwinded- yeah, I think so | 22:48 |
krotscheck | kk | 23:08 |
krotscheck | mordred: Ok, done. | 23:19 |
krotscheck | mordred: Though it seems like those changes are dependent on a whole bunch of things. | 23:20 |
krotscheck | mordred: or not. | 23:20 |
*** _ruhe is now known as ruhe | 23:22 | |
ruhe | krotscheck: re https://review.openstack.org/#/c/69204/3/modules/openstack_project/files/jenkins_job_builder/config/storyboard.yaml | 23:23 |
ruhe | i'd like to keep storyboard-docs jobs in file named storyboard.yaml | 23:23 |
ruhe | is it ok with you? | 23:23 |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added no_api env https://review.openstack.org/68610 | 23:23 |
krotscheck | ruhe: Yes, though I'm a big fan of making _all_ the docs builds use scp. | 23:25 |
ruhe | so it seems i need to base my patch on https://review.openstack.org/#/c/67731/ | 23:30 |
mordred | krotscheck: we all are | 23:38 |
mordred | krotscheck, ruhe: https://review.openstack.org/69502 https://review.openstack.org/69503 | 23:38 |
mordred | I thought I'd landed those ages ago, seems I may have never uploaded them | 23:39 |
mordred | they're pre-reqs for landing the config patches to split the projects.yaml into projects.yaml and projects.ini | 23:39 |
mordred | eyeballs would be kindly appreciated | 23:39 |
*** david-lyle has quit IRC | 23:40 | |
*** drdee_ has joined #storyboard | 23:43 | |
*** drdee_ has quit IRC | 23:44 | |
*** ruhe is now known as _ruhe | 23:44 | |
*** drdee has quit IRC | 23:48 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!