| *** oubiwann-lambda has quit IRC | 00:00 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Make ES Heap Size configurable. https://review.openstack.org/52727 | 00:00 |
|---|---|---|
| clarkb | Ryan_Lane: mordred ^ something like that | 00:00 |
| clarkb | Ryan_Lane: I think you will want to wait for that change before you run puppet. I am not sure what mlockall will do when locking 16GB on an 8GB host | 00:01 |
| Ryan_Lane | yeah :) | 00:01 |
| Ryan_Lane | I didn't yet | 00:01 |
| Ryan_Lane | I worry about the same | 00:01 |
| clarkb | that would be a fun thing to try on a test box :) | 00:02 |
| Ryan_Lane | heh | 00:02 |
| clarkb | I am going to noop mode run that on elasticsearch.o.o and if it comes through clean will approve | 00:02 |
| *** davidhadas has quit IRC | 00:03 | |
| *** oubiwann has joined #openstack-infra | 00:04 | |
| clarkb | Ryan_Lane: you can try the same on wiki.o.o `puppet agent --test --environment development --noop` | 00:04 |
| clarkb | it looks clean on elasticsearch.o.o did you want to try ^ before I approve it? | 00:05 |
| Ryan_Lane | running | 00:05 |
| Ryan_Lane | environments. I wish I could use that | 00:05 |
| Ryan_Lane | yeah, looks good | 00:05 |
| clarkb | cool I will approve | 00:05 |
| openstackgerrit | A change was merged to openstack-infra/config: Make ES Heap Size configurable. https://review.openstack.org/52727 | 00:08 |
| *** vipul-away is now known as vipul | 00:08 | |
| Ryan_Lane | clarkb: should I wait till 15 after to run puppet? | 00:10 |
| clarkb | Ryan_Lane: yes, or use the development env for now (though that isn't guarunteed to stay the same for long I may need to go path a thing real quick) | 00:10 |
| Ryan_Lane | ok. I'll wait | 00:10 |
| Ryan_Lane | clarkb: cool. thanks for the help. | 00:11 |
| *** boris-42 has quit IRC | 00:11 | |
| jerryz | when starting elastic-recheck , i got the following error /usr/lib/python2.7/dist-packages/paramiko/client.py:95: UserWarning: Unknown ssh-rsa host key for [10.145.81.234]:29418: d66f73d0140cfd8dff7a7aceb739cb2f (key.get_name(), hostname, hexlify(key.get_fingerprint()))) , could anyone help? | 00:16 |
| jerryz | i already tested the key by ssh , it works | 00:17 |
| clarkb | jerryz: the remote host's ssh key isn't known yet | 00:17 |
| clarkb | jerryz: you need to add it to your known hosts | 00:17 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Upgrade the version of node for etherpad-lite. https://review.openstack.org/52729 | 00:17 |
| *** Bada has joined #openstack-infra | 00:18 | |
| jerryz | when testing the key, gerrit's server host key is added to recheck's know hosts | 00:18 |
| clarkb | jerryz: is it the same user? | 00:19 |
| jerryz | yeah, under /home/recheck/.ssh | 00:19 |
| clarkb | I am not sure then | 00:19 |
| jerryz | when successfully logged in gerrit, it automatically is added . i also tried manually adding [10.145.81.234]:29418 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzZUSTUAI3B/YooGahQRB2sjUhZH6oYSEpo/X1WF/BsID4OmCZSCICLonEMVir4YbrBXmiHWWmIXn+Y6CKWEhVvCBN11o2yh21uQB1H1FKBggWL0/fJQSvk1/onT0OZB0ra0XXGgb/HzRkWrw/+ReT5gJeoHGcD16Ap1EUxS4JNFoPGF+3M0uD+rHNznirJLlLJBkyV6yfxf1lz/hy5lT+akApGmsOI68si8zV1GUqB91Ajja2JLNmR7K+Sue1fwbds7IvnLe+O0NoHgTqAsu | 00:20 |
| clarkb | are you ssh'ing to port 29418 or port 22? | 00:21 |
| jerryz | root@elasticrecheck:/var/log/upstart# sudo -u recheck ssh -P -p 29418 10.145.81.234 **** Welcome to Gerrit Code Review **** | 00:21 |
| jerryz | it is successful | 00:21 |
| jerryz | [gerrit] user=recheck host=10.145.81.234 query_file=/etc/elastic-recheck/queries.yaml key=/home/recheck/.ssh/id_rsa | 00:22 |
| clarkb | jerryz: how are you running e-r? | 00:24 |
| *** sarob has quit IRC | 00:25 | |
| *** SergeyLukjanov has quit IRC | 00:25 | |
| *** sarob has joined #openstack-infra | 00:25 | |
| jerryz | when i start the service, it is quiet , no log. so i use python elasticRecheck.py /etc/elastic-recheck/elastic-recheck.conf to test | 00:26 |
| *** Bada has quit IRC | 00:26 | |
| jerryz | sudo -u recheck python /opt/elastic-recheck/elastic_recheck/elasticRecheck.py /etc/elastic-recheck/elastic-recheck.conf | 00:26 |
| clarkb | jerryz: nothing is coming to mind. jog0 and/or mtreinish may have ideas | 00:27 |
| *** alexpilotti has quit IRC | 00:27 | |
| jerryz | clarkb: thank you | 00:29 |
| *** sarob has quit IRC | 00:30 | |
| Ryan_Lane | upgrading the wiki | 00:37 |
| * clarkb -> home | 00:44 | |
| *** wenlock has quit IRC | 00:47 | |
| jog0 | jerryz: the service should be quiet unless you turn debug logs on | 00:51 |
| jerryz | jog0: i have jenkins comment on my gerrit and store log to a location where there is http service | 00:51 |
| jog0 | jerryz: and you need those logs to be pushed into elasticsearch | 00:52 |
| jog0 | so e-r can query em | 00:52 |
| jerryz | what query string e-r use | 00:52 |
| jerryz | since e-r has known the failing part yet | 00:53 |
| jerryz | has not knwn | 00:53 |
| jog0 | jerryz: http://git.openstack.org/cgit/openstack-infra/elastic-recheck/tree/elastic_recheck/elasticRecheck.py#n104 | 00:53 |
| jog0 | we go through the list of queries and apply that template to them and search | 00:55 |
| jerryz | how e-r filters out the Traceback | 00:56 |
| jog0 | click on the logstash links here http://status.openstack.org/elastic-recheck/ | 00:57 |
| jog0 | to get an idea of what is going on | 00:57 |
| *** xeyed4good has joined #openstack-infra | 01:02 | |
| *** xeyed4good has left #openstack-infra | 01:02 | |
| *** SergeyLukjanov has joined #openstack-infra | 01:06 | |
| jerryz | jog0: how queries.yaml is maintained? | 01:14 |
| jog0 | jerryz: by hand | 01:15 |
| jog0 | we have a script to identify closed bugs to remove | 01:15 |
| jog0 | but new ones are generated by hand | 01:16 |
| jerryz | jog0: and query message is also by hand? | 01:16 |
| jog0 | the actual query to search, yes | 01:16 |
| jog0 | we don'thave automatic anomaly detection for logs yet | 01:17 |
| jerryz | jog0: you watch the bug list and extract debug info into queries.yaml | 01:17 |
| jog0 | more or less yes | 01:18 |
| jog0 | e-r comments in -qa every time we have an unclassified failure and I usually spend a few minutes each day looking at those | 01:19 |
| *** leifmadsen has joined #openstack-infra | 01:23 | |
| jerryz | i see. i always use elasticsearch the opposite way around. find my failing log and extract Traceback and query elasticsearch to see if there are any hits in the community. so i am thinking if e-r can do this automatically for me. | 01:24 |
| mordred | #status alert Etherpad going down for maint. ETA 5 minutes | 01:27 |
| clarkb | did we lose statusbot again? | 01:27 |
| mordred | dammit. you'd think I'd know how to use that | 01:27 |
| clarkb | oh well | 01:27 |
| mordred | it's late on friday. people will deal | 01:28 |
| clarkb | is it #alert? | 01:28 |
| mordred | #alert Etherpad going down for maint. ETA 5 minutes | 01:28 |
| mordred | nope | 01:28 |
| clarkb | oh well friday night | 01:28 |
| jerryz | jog0: the scenario is even simpler for me now. i just need my own logstash and elasticsearch to ship and index my jenkins log. and have e-r to query the elasticsearch and try to find a match against the known bugs in queries.yaml | 01:33 |
| *** SergeyLukjanov has quit IRC | 01:33 | |
| jerryz | jog0: am i correct? | 01:34 |
| jog0 | yup | 01:35 |
| *** sarob has joined #openstack-infra | 01:36 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: port of elasticRecheck to ResultSet https://review.openstack.org/52731 | 01:36 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: first iteration on ResultSet and Hit objects https://review.openstack.org/52698 | 01:36 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: don't explode if a query no longer has failures https://review.openstack.org/52509 | 01:36 |
| mordred | bodepd_: https://github.com/stackforge/puppet-ceph | 01:37 |
| mordred | all fixed | 01:37 |
| *** reed has quit IRC | 01:37 | |
| *** sarob has quit IRC | 01:41 | |
| *** nati_ueno has quit IRC | 01:58 | |
| *** thomasm has joined #openstack-infra | 01:59 | |
| *** thomasm has quit IRC | 01:59 | |
| *** wenlock has joined #openstack-infra | 02:00 | |
| *** yolanda has quit IRC | 02:06 | |
| *** ArxCruz has quit IRC | 02:09 | |
| *** Bada has joined #openstack-infra | 02:11 | |
| *** Ryan_Lane has quit IRC | 02:11 | |
| *** ArxCruz has joined #openstack-infra | 02:12 | |
| openstackgerrit | Jerry Zhao proposed a change to openstack-infra/elastic-recheck: The key's value is misleading in the config sample. A private key is required here instead of public key. https://review.openstack.org/52734 | 02:17 |
| *** jerryz has quit IRC | 02:31 | |
| *** cody-somerville has joined #openstack-infra | 02:32 | |
| fungi | i had forgotten what a wasteland of crappy internet and no phone signal my parents' house is | 02:34 |
| fungi | trying to catch up on scrollback but i will probably just skim it | 02:34 |
| *** ArxCruz has quit IRC | 02:37 | |
| clarkb | pleia2: next time you are in town you should show me bitlbee twitter magic. | 02:39 |
| bodepd_ | mordred: you're my hero | 02:41 |
| fungi | excellent--looks like nothing urgent in scrollback any longer. clearly i picked the right time to check back in ;) | 02:41 |
| *** amotoki_ has quit IRC | 02:42 | |
| fungi | last night's talk went well. i told lots of graduating college seniors to contribute to free software projects, and several of them followed me out into the hall and kept asking questions | 02:44 |
| fungi | i expected most of them to sleep through it, so i was pleasantly surprised | 02:44 |
| clarkb | nice | 02:45 |
| *** Bada has quit IRC | 02:46 | |
| clarkb | fungi: was it an openstack talk or more FOSS focused? | 02:47 |
| fungi | it was set up as mostly q&a and i let them drive the discussion in whatever direction they wanted to go. it ended up being a lot heavier on openstack than i'd intended, but they had more openstack-related questions than i thought they would | 02:48 |
| clarkb | neat. I should try and make more time for PSU | 02:49 |
| fungi | yeah, i felt really great being able to give them this sort of information, because even though i know the compsci instructors at public universities are frequently pro-free-software, the curriculum's aren't and so they have to struggle to find ways to expose the students to it | 02:51 |
| clarkb | fungi: ya, a big problem I noticed while in school is that the accreditors really want individual work to be done so you don't get much exposure to collaborative open work environmeents | 02:52 |
| fungi | they actually had lots of great questions about free software community collaboration and communication dynamics, so that was super fun to talk about | 02:53 |
| fungi | for example, "how are developers from competing employers able to work together to produce something?" | 02:54 |
| fungi | but yeah, i definitely talked about how individual devs or small groups wandering off and designing solutions on their own without involvement from the greater community tended to result in problems | 02:57 |
| openstackgerrit | Jerry Zhao proposed a change to openstack-infra/elastic-recheck: The key's value is misleading in the config sample. https://review.openstack.org/52734 | 02:58 |
| fungi | which is sort of counter to academia's "produce and polish behind closed doors, then publish and take credit" model | 02:59 |
| fungi | and then hiking today took up way more time (which is why i only just got back to internets), but it was perfect weather | 03:00 |
| fungi | hopefully tomorrow i can catch up on any work i'm holding up | 03:01 |
| *** ericw has joined #openstack-infra | 03:05 | |
| *** yaguang has joined #openstack-infra | 03:14 | |
| *** ericw has quit IRC | 03:18 | |
| *** x05h has joined #openstack-infra | 03:22 | |
| *** vipul is now known as vipul-away | 03:24 | |
| *** dims has quit IRC | 03:35 | |
| *** x05h has quit IRC | 03:35 | |
| *** wenlock_ has joined #openstack-infra | 03:47 | |
| *** wenlock has quit IRC | 03:49 | |
| *** wenlock_ is now known as wenlock | 03:50 | |
| *** amotoki_ has joined #openstack-infra | 04:13 | |
| *** wenlock has quit IRC | 04:14 | |
| *** oubiwann has quit IRC | 04:20 | |
| *** oubiwann has joined #openstack-infra | 04:21 | |
| *** amotoki_ has quit IRC | 04:45 | |
| *** wenlock has joined #openstack-infra | 04:50 | |
| *** Ryan_Lane has joined #openstack-infra | 04:51 | |
| *** nati_ueno has joined #openstack-infra | 04:52 | |
| *** sarob has joined #openstack-infra | 05:23 | |
| *** wusui has quit IRC | 05:37 | |
| *** wusui has joined #openstack-infra | 05:39 | |
| *** thomasbiege has quit IRC | 06:06 | |
| *** sarob has quit IRC | 06:10 | |
| *** sarob has joined #openstack-infra | 06:11 | |
| *** sarob has quit IRC | 06:16 | |
| *** dafter has joined #openstack-infra | 06:33 | |
| *** oubiwann_ has joined #openstack-infra | 06:41 | |
| *** SergeyLukjanov has joined #openstack-infra | 06:42 | |
| *** dafter has quit IRC | 06:50 | |
| *** vipul-away is now known as vipul | 06:56 | |
| *** Loquacities has joined #openstack-infra | 06:56 | |
| *** Loquacious has joined #openstack-infra | 06:59 | |
| *** Loquacities has quit IRC | 07:08 | |
| *** Loquacious has quit IRC | 07:08 | |
| *** Loquacity has joined #openstack-infra | 07:08 | |
| *** sarob has joined #openstack-infra | 07:12 | |
| *** Loquacities has joined #openstack-infra | 07:13 | |
| *** Loquacity has quit IRC | 07:16 | |
| *** sarob has quit IRC | 07:20 | |
| *** Ryan_Lane has quit IRC | 07:23 | |
| *** Ryan_Lane has joined #openstack-infra | 07:23 | |
| *** rpodolyaka has quit IRC | 07:24 | |
| *** oubiwann_ has quit IRC | 07:25 | |
| *** boris-42 has joined #openstack-infra | 07:27 | |
| *** vipul is now known as vipul-away | 07:29 | |
| *** SergeyLukjanov has quit IRC | 07:36 | |
| *** thomasbiege has joined #openstack-infra | 07:58 | |
| *** che-arne has quit IRC | 07:58 | |
| *** thomasbiege has quit IRC | 07:58 | |
| *** rwsu is now known as rwsu-away | 07:59 | |
| *** luhrs1 has quit IRC | 07:59 | |
| *** vipul-away is now known as vipul | 08:00 | |
| *** che-arne has joined #openstack-infra | 08:03 | |
| *** katyafervent has quit IRC | 08:03 | |
| *** thomasbiege has joined #openstack-infra | 08:03 | |
| *** Ryan_Lane has quit IRC | 08:09 | |
| *** rpodolyaka has joined #openstack-infra | 08:10 | |
| *** thomasbiege has quit IRC | 08:14 | |
| *** sarob has joined #openstack-infra | 08:16 | |
| *** wenlock has quit IRC | 08:20 | |
| *** sarob has quit IRC | 08:21 | |
| *** Bada has joined #openstack-infra | 08:27 | |
| *** oubiwann_ has joined #openstack-infra | 08:36 | |
| *** oubiwann_ has quit IRC | 08:41 | |
| *** nati_ueno has quit IRC | 08:50 | |
| *** nati_ueno has joined #openstack-infra | 08:50 | |
| *** nati_ueno has quit IRC | 08:55 | |
| *** fifieldt has quit IRC | 08:55 | |
| *** fifieldt has joined #openstack-infra | 08:55 | |
| *** Bada has quit IRC | 09:05 | |
| *** sarob has joined #openstack-infra | 09:17 | |
| *** sarob has quit IRC | 09:21 | |
| openstackgerrit | Alexander Braverman proposed a change to openstack-infra/jenkins-job-builder: Jenkins Ownership Plugin https://review.openstack.org/51441 | 09:48 |
| openstackgerrit | Alexander Braverman proposed a change to openstack-infra/jenkins-job-builder: Jenkins Ownership Plugin https://review.openstack.org/51441 | 09:52 |
| openstackgerrit | Alexander Braverman proposed a change to openstack-infra/jenkins-job-builder: Jenkins Ownership Plugin https://review.openstack.org/51441 | 10:03 |
| *** sarob has joined #openstack-infra | 10:17 | |
| *** CaptTofu has quit IRC | 10:20 | |
| *** CaptTofu has joined #openstack-infra | 10:20 | |
| *** sarob has quit IRC | 10:22 | |
| *** CaptTofu has quit IRC | 10:25 | |
| *** CaptTofu has joined #openstack-infra | 10:31 | |
| *** CaptTofu has quit IRC | 10:33 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: port of elasticRecheck to ResultSet https://review.openstack.org/52731 | 10:41 |
| *** ericw has joined #openstack-infra | 11:06 | |
| *** ericw has quit IRC | 11:09 | |
| *** sarob has joined #openstack-infra | 11:18 | |
| *** sarob has quit IRC | 11:22 | |
| *** ericw has joined #openstack-infra | 11:47 | |
| *** ericw has quit IRC | 11:59 | |
| *** basha has joined #openstack-infra | 12:02 | |
| *** dizquierdo has joined #openstack-infra | 12:04 | |
| *** basha has quit IRC | 12:15 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-dev/pbr: Use wheels for installation https://review.openstack.org/48803 | 12:32 |
| *** adalbas has joined #openstack-infra | 12:46 | |
| *** sarob has joined #openstack-infra | 12:48 | |
| *** sarob has quit IRC | 12:52 | |
| *** davidhadas has joined #openstack-infra | 13:04 | |
| *** hemna has quit IRC | 13:04 | |
| *** odyi has quit IRC | 13:04 | |
| *** hemna has joined #openstack-infra | 13:05 | |
| *** SlickNik has quit IRC | 13:05 | |
| *** juice has quit IRC | 13:05 | |
| *** LinuxJedi has quit IRC | 13:05 | |
| *** LinuxJedi has joined #openstack-infra | 13:05 | |
| *** echohead has quit IRC | 13:06 | |
| *** devananda has quit IRC | 13:06 | |
| *** echohead has joined #openstack-infra | 13:07 | |
| *** hashar has joined #openstack-infra | 13:07 | |
| *** devananda has joined #openstack-infra | 13:07 | |
| *** juice has joined #openstack-infra | 13:11 | |
| openstackgerrit | A change was merged to openstack-dev/pbr: Comply with pep440 https://review.openstack.org/46996 | 13:11 |
| *** SlickNik has joined #openstack-infra | 13:12 | |
| *** davidhadas has quit IRC | 13:23 | |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Remove now-deprecated fetch-remotes command https://review.openstack.org/49958 | 13:30 |
| mordred | dstufft: how hard would it be to make an amended version of -U for pip install that would upgrade the current install if the current install did not meet the version spec of the requested requirement? | 13:40 |
| mordred | dstufft: so that you could do pip install --safe-update -r requirements.txt | 13:41 |
| mordred | dstufft: and if a package existed on the system and satisfied the requested version, it would not be touched - but if it existed and did not meet the requested version, it would be upgraded? | 13:41 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Remove explicit depends on transitive pip deps https://review.openstack.org/51402 | 13:42 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Use pip install -U instead of setup.py install https://review.openstack.org/51004 | 13:42 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Update projects.yaml for new upstream tracking https://review.openstack.org/49957 | 13:45 |
| mordred | fungi: if you happen to be awake, ^^ should probably land since we merged https://review.openstack.org/49958 to jeepyb | 13:46 |
| mordred | clarkb, jeblair ^^ | 13:46 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Update projects.yaml for new upstream tracking https://review.openstack.org/49957 | 13:47 |
| *** fallenpegasus has quit IRC | 13:48 | |
| *** sarob has joined #openstack-infra | 13:49 | |
| *** odyi has joined #openstack-infra | 13:52 | |
| *** odyi has joined #openstack-infra | 13:52 | |
| *** fallenpegasus has joined #openstack-infra | 13:53 | |
| fungi | mordred: ahh,okay | 13:53 |
| fungi | didn't notice that one had a dependency mentioned | 13:53 |
| *** sarob has quit IRC | 13:54 | |
| *** hashar has quit IRC | 13:54 | |
| fungi | but yeah, this will save us from a steady stream of cronspam and missing upstream updates | 13:56 |
| *** Bada has joined #openstack-infra | 14:00 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Make pip install from upstream better https://review.openstack.org/51425 | 14:08 |
| mordred | pleia2: when you wake up - just wanted to let you know that my new saucy xubuntu install had decided that it should suspend when I shut my laptop screen even though i have it configured to never do that | 14:16 |
| *** thomasm has joined #openstack-infra | 14:18 | |
| *** thomasm is now known as Guest2138 | 14:18 | |
| *** Guest2138 is now known as thomasem | 14:20 | |
| *** Bada has quit IRC | 14:21 | |
| *** fifieldt has quit IRC | 14:24 | |
| *** thomasem has quit IRC | 14:25 | |
| *** basha has joined #openstack-infra | 14:25 | |
| fungi | mordred: clearly you were not designed to use ubuntu | 14:25 |
| *** adalbas has quit IRC | 14:25 | |
| mordred | fungi: clearly | 14:28 |
| *** fallenpegasus has quit IRC | 14:32 | |
| *** sarob has joined #openstack-infra | 14:33 | |
| pleia2 | mordred: that's no good, I'll do some tests in a bit and see if we can get a fixable bug up (I always use suspend myself, so didn't catch it in the pre-release) | 14:35 |
| pleia2 | "suspend works, woo!" didn't think to test not-suspend | 14:36 |
| mordred | pleia2: I usually have it off because I'm often connected to the vpn at home and I don't want to disconnect | 14:36 |
| mordred | :) | 14:36 |
| mordred | right? | 14:36 |
| pleia2 | yeah, that makes sense | 14:36 |
| ekarlso | win 35 | 14:38 |
| *** sarob has quit IRC | 14:38 | |
| *** mikal has quit IRC | 14:42 | |
| *** mikal has joined #openstack-infra | 14:43 | |
| *** dizquierdo has left #openstack-infra | 14:43 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/git-review: Preserve merges when doing a rebase https://review.openstack.org/50400 | 14:45 |
| *** dkehn_ has joined #openstack-infra | 14:45 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/git-review: Ignore content of merge commits in reporting https://review.openstack.org/50401 | 14:46 |
| *** basha has quit IRC | 14:47 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Make the gitweb links in gerrit point to git.o.o https://review.openstack.org/42694 | 14:48 |
| *** dkehn has quit IRC | 14:49 | |
| *** Steely_Dan is now known as dansmith | 14:50 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/gerritlib: Remove use of d2to1 https://review.openstack.org/52776 | 14:51 |
| *** oubiwann_ has joined #openstack-infra | 14:56 | |
| *** dirk has joined #openstack-infra | 14:58 | |
| *** dirk has quit IRC | 15:05 | |
| mordred | fungi: https://review.openstack.org/#/c/52469/ nudge | 15:12 |
| fungi | mordred: so on that one, the goal is to only merge tags which are on commits present in milestone-proposed? earlier non-rc milestones should be ignored? | 15:14 |
| mordred | fungi: yah. well, we only make tags on milestone-proposed branches | 15:15 |
| mordred | or, rather, those are the only branches for which tags need to be merged to master | 15:15 |
| mordred | all other tags just get made directly on their branches | 15:15 |
| fungi | got it. so g2 et cetera don't get merged to master because they're already on master | 15:16 |
| fungi | took a moment to wrap my brains around | 15:16 |
| *** ericw has joined #openstack-infra | 15:16 | |
| openstackgerrit | A change was merged to openstack-infra/config: Move the milestone-proposed logic to tag script https://review.openstack.org/52469 | 15:19 |
| *** ericw has quit IRC | 15:23 | |
| *** nati_ueno has joined #openstack-infra | 15:24 | |
| *** nati_ueno has quit IRC | 15:28 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add branch tarballs for tuskar projects https://review.openstack.org/51406 | 15:28 |
| *** nati_ueno has joined #openstack-infra | 15:29 | |
| *** nati_ueno has quit IRC | 15:29 | |
| *** nati_ueno has joined #openstack-infra | 15:29 | |
| *** tvb has joined #openstack-infra | 15:30 | |
| *** tvb has left #openstack-infra | 15:32 | |
| openstackgerrit | A change was merged to openstack/requirements: Pin iso8601 to 0.1.4 https://review.openstack.org/52671 | 15:32 |
| *** yaguang has quit IRC | 15:34 | |
| openstackgerrit | A change was merged to openstack/requirements: Require python-cinderclient>=1.0.6 https://review.openstack.org/50372 | 15:36 |
| openstackgerrit | A change was merged to openstack/requirements: Added lower version boundary for netaddr https://review.openstack.org/49530 | 15:37 |
| *** nicedice has quit IRC | 16:08 | |
| *** nicedice has joined #openstack-infra | 16:08 | |
| *** dcramer_ has quit IRC | 16:10 | |
| *** SergeyLukjanov has joined #openstack-infra | 16:11 | |
| *** adalbas has joined #openstack-infra | 16:12 | |
| *** nati_ueno has quit IRC | 16:39 | |
| *** nati_ueno has joined #openstack-infra | 16:39 | |
| *** weshay has joined #openstack-infra | 16:43 | |
| *** nati_ueno has quit IRC | 16:44 | |
| *** SergeyLukjanov has quit IRC | 17:01 | |
| *** SergeyLukjanov has joined #openstack-infra | 17:14 | |
| *** SergeyLukjanov has quit IRC | 17:15 | |
| *** SergeyLukjanov has joined #openstack-infra | 17:16 | |
| *** dcramer_ has joined #openstack-infra | 17:22 | |
| *** SergeyLukjanov has quit IRC | 17:26 | |
| mordred | ah shuttleworth. where would the world be without your particular brand of self-aggrandizing history rewrites http://news.slashdot.org/story/13/10/19/1210232/mark-shuttleworth-complains-about-the-open-source-tea-party | 17:30 |
| *** senk has joined #openstack-infra | 18:03 | |
| *** senk has quit IRC | 18:11 | |
| *** senk has joined #openstack-infra | 18:29 | |
| *** senk has quit IRC | 18:35 | |
| *** wenlock has joined #openstack-infra | 18:49 | |
| bodepd_ | screen -r | 19:19 |
| * fungi pretends to be bodepd_'s screen session | 19:23 | |
| *** alexpilotti has joined #openstack-infra | 19:32 | |
| *** dcramer_ has quit IRC | 19:39 | |
| *** dcramer_ has joined #openstack-infra | 19:51 | |
| *** DennyZhang has joined #openstack-infra | 20:06 | |
| *** dripton has quit IRC | 20:12 | |
| *** Ryan_Lane has joined #openstack-infra | 20:22 | |
| *** dripton has joined #openstack-infra | 20:44 | |
| sdague | fungi: hmmm... cirros image caching still not working? - http://logs.openstack.org/87/52787/1/check/gate-tempest-devstack-vm-large-ops/c0428a1/console.html | 20:57 |
| fungi | i'll see if i can tel | 21:03 |
| fungi | l | 21:04 |
| *** dcramer_ has quit IRC | 21:06 | |
| *** DennyZhang has quit IRC | 21:10 | |
| fungi | wow. these log files crash my browser any more. have to remember to use the txt urls instead | 21:15 |
| fungi | the browser crashes aren't especially annoying. it's the 10 minutes of thrashing swap on a memory card on this little netbook before i can regain control of xwindows which aggravates me | 21:16 |
| fungi | bah, i can't find/remember the url i need to be able to tell it not to preprocess a log file (the >50% packet loss here is not helping matters either). i'll just scp it down off the server | 21:25 |
| *** dims has joined #openstack-infra | 21:38 | |
| fungi | i picked another random devstack slave from the same az in hpcloud and confirmed that /home/jenkins/workspace-cache/devstack/files/ doesn't have any cirros images precached in it | 21:44 |
| sdague | ?content-type=text/plain | 21:53 |
| sdague | fungi: what's your browser? | 21:54 |
| fungi | sdague: firefox | 21:55 |
| clarkb | fungi you should xforward from a real machine :) | 21:55 |
| fungi | clarkb: ha. the lack of real working internet here would make that even worse, i think | 21:55 |
| sdague | :) | 21:55 |
| sdague | what's the machine? | 21:55 |
| fungi | sdague: an asus netbook with about 512mb of ram trying to also do other things in a browser at the same time (gerrit's not exactly easy on a browser either, nor launchpad) | 21:56 |
| sdague | heh, yeh | 21:57 |
| fungi | anyway, i checked a devstack slave from another az and similarly no cirros image cached in it | 21:57 |
| sdague | honestly though, all we added to the console.html is the date links | 21:57 |
| fungi | yeah, i've seen it thrash similarly on the logs before. but i think maybe the logs have also gotten longer over the past 6+ months | 21:58 |
| fungi | i'm going to see if i can remember where the devstack prep logs for nodepool's snapshot refresh runs end up | 21:59 |
| clarkb | /var/log/nodepool iirc | 22:00 |
| fungi | ahh, yep, image.log | 22:01 |
| fungi | i can see where it logs that it's running the command to download the cirros images, but can't tell if it's succeeding or simply not reporting the output/return code | 22:05 |
| sdague | yeh, things have gotten a bit bigger, though that's only 3.5 MB uncompressed as a log. I'm surprised it's causing that much pain. Though 512 is an impressively small amount of mem to be working with :) | 22:11 |
| *** dims has quit IRC | 22:11 | |
| clarkb | the tripleo folks want 32GB in their laptops for running portable clouds :) | 22:12 |
| boris-42 | omg | 22:13 |
| clarkb | I just pulled 8GB out of desktop and had to underclock the remaining 8GB in order to have a working machine | 22:14 |
| clarkb | it was very sad | 22:14 |
| sdague | heh | 22:14 |
| boris-42 | btw guys did you see Rally announce? | 22:14 |
| sdague | yeh, my new home desktop is a 32GB box | 22:14 |
| fungi | well, my new desktop has 16gib ram, but i prefer to travel light | 22:14 |
| boris-42 | could we make some integration with OpenStack CI?) | 22:15 |
| boris-42 | Is it some way to get nodes from pool?) | 22:15 |
| clarkb | boris-42 sure just propose a job the runs on the d-g nodes | 22:15 |
| clarkb | look at pbr's rawinstall job as an example | 22:16 |
| boris-42 | clarkb is there instucation?) manual?) | 22:16 |
| boris-42 | clarkb okay thanks | 22:16 |
| boris-42 | clarkb btw Rally could be good thing to avoid long debates https://wiki.openstack.org/wiki/Rally#Interesting_results_of_Rally_work | 22:17 |
| boris-42 | =) | 22:17 |
| boris-42 | at least I hope that we will concentrate on fixing problems not speaking and debating only=) | 22:17 |
| clarkb | ++ to fixing problems | 22:18 |
| boris-42 | clarkb btw how much RAM have nodepools? | 22:18 |
| boris-42 | clarkb we are able to run 1 compute node / 200 mb RAM | 22:19 |
| boris-42 | servers from node pool* | 22:19 |
| sdague | boris-42: I still don't get why rally is implementing it's own scenarios and not just contributing / reusing the tempest scenarios | 22:22 |
| boris-42 | sdague did you read mailing list? | 22:23 |
| clarkb | 8GB nodes with 4vcpu | 22:23 |
| boris-42 | sdague because tempest is designed to verify cloud | 22:23 |
| sdague | it was a busy week for email, so I probably missed it | 22:23 |
| boris-42 | sdague let me find the answer on this question | 22:24 |
| boris-42 | sdague http://www.mail-archive.com/openstack-dev@lists.openstack.org/msg06454.html | 22:24 |
| fungi | okay, looks like maybe devstack-cache.py doesn't currently report the results of its attempts to download things | 22:25 |
| boris-42 | sdague so the goal of Rally is that we should improve DevStack, improve Verify system (tempest) and use as components of Rally | 22:26 |
| *** dims has joined #openstack-infra | 22:26 | |
| sdague | boris-42: my issue is I think the "benchmark tests" - part 3 in your flow - are completely appropriate in tempest | 22:26 |
| boris-42 | sdauge Imho when I am benchmarking I don't want to care about deploying & verification process, but I need both=) | 22:26 |
| sdague | and the fact that you are duplicating that effort, seems odd | 22:27 |
| sdague | I get part 4, the data collection, being a new thing, and tying it all together... | 22:27 |
| boris-42 | sdauge as David (in mailing list said) it is the small part of both systems | 22:27 |
| boris-42 | sdague that could & should be shared | 22:27 |
| sdague | anyway, maybe I'll respond on list later | 22:28 |
| boris-42 | sdague but it still small | 22:28 |
| sdague | https://github.com/stackforge/rally/tree/master/rally/benchmark/scenarios/nova - just seems odd that directory is there at all | 22:28 |
| boris-42 | benchmarks & verification are complete different tasks IMHO | 22:28 |
| boris-42 | we should have both | 22:28 |
| sdague | boris-42: all that demonstrates to me is that you haven't kept up with the stress test or large ops work in tempest | 22:29 |
| *** SergeyLukjanov has joined #openstack-infra | 22:30 | |
| boris-42 | sdague I have the same question did you try to use Rally in stress tests? | 22:33 |
| boris-42 | sdague one more time Becnhmarking & Verification (even Stress testing) are different tasks | 22:33 |
| boris-42 | sdague and one more time we should have different tools.. | 22:34 |
| sdague | boris-42: rally showed up later, and we have an active community around tempest where multiple individuals from multiple organizations collaborated on the new stress tests | 22:39 |
| fungi | okay, trying to update the devstack-precise image for hpcloud-az3 to see if it caches the cirros files properly | 22:40 |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack/requirements: Unpin iso8601 but skip bad versions https://review.openstack.org/52797 | 22:41 |
| sdague | anyway, email sent back. not really into debating on irc tonight about it. But rally definitely comes across as something that is going to generate a lot of duplication, and not integration, which irks me. But we can debate over in email. | 22:42 |
| boris-42 | sdague okay I think that mailing list is better for debating | 22:43 |
| dims | hi all, we were battling iso8601 in the oslo gate jobs on friday. finally got a fresh version from iso8601 folks and i've confirmed that olso jobs are good (https://review.openstack.org/#/c/52796/) and have opened a fresh review against global requirements here - https://review.openstack.org/#/c/52797/ | 22:48 |
| fungi | dims: saw it--just waiting to see what jenkins has to say before i +2 | 22:53 |
| fungi | thanks! | 22:54 |
| fungi | okay, image update for hpcloud az3 finished, now deleting unused nodes in az3 so new ones will get generated | 23:00 |
| *** oubiwann has quit IRC | 23:05 | |
| *** CaptTofu has joined #openstack-infra | 23:06 | |
| *** oubiwann has joined #openstack-infra | 23:06 | |
| mordred | fungi: we might need to figure out a way to verify devstack-cache.py operations and whatnot. testing, etc | 23:16 |
| fungi | mordred: agreed. it would be nice to at least know whether the image build process encountered errors retrieving and caching things | 23:17 |
| fungi | it's possible that does get logged and i'm just looking in the wrong logs/scripts | 23:18 |
| mordred | ++ | 23:18 |
| *** yolanda has joined #openstack-infra | 23:21 | |
| dims | fungi, thanks. looks like we got all green on it. | 23:24 |
| dims | mordred, thanks for the +2 | 23:24 |
| *** yamahata has joined #openstack-infra | 23:26 | |
| * fungi nods | 23:26 | |
| fungi | it's in the gate already | 23:27 |
| fungi | i think jenkins02 has possibly gone to lunch. nodepool logged an error a little while ago about being unable to communicate with it and zuul seems to be running all jobs on 01 | 23:29 |
| *** SergeyLukjanov has quit IRC | 23:29 | |
| *** fifieldt has joined #openstack-infra | 23:29 | |
| mordred | ossum | 23:31 |
| mordred | well, I'm about to take off on a plane | 23:31 |
| fungi | yeah, i'm trying to poke at it but going several minutes at a stretch with no internet and then getting a few seconds to get packets through to try to connect to things | 23:32 |
| *** SergeyLukjanov has joined #openstack-infra | 23:33 | |
| fungi | also, nodepool eventually built some new nodes in hcloud az3, but still don't seem to have cirros downloads cached (but i can manually download the files at those urls successfully) | 23:34 |
| mordred | ossum | 23:37 |
| mordred | dowloading to another place perhaps? | 23:38 |
| *** wenlock has quit IRC | 23:38 | |
| clarkb | jenkins02 seems up, not running any jobs though | 23:52 |
| openstackgerrit | A change was merged to openstack/requirements: Unpin iso8601 but skip bad versions https://review.openstack.org/52797 | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!