*** darvon has quit IRC | 00:00 | |
*** pfalleno1 has quit IRC | 00:02 | |
*** Qiming has joined #openstack-infra | 00:04 | |
*** pfallenop has joined #openstack-infra | 00:05 | |
*** darvon has joined #openstack-infra | 00:05 | |
*** salv-orl_ has joined #openstack-infra | 00:06 | |
*** otter768 has quit IRC | 00:06 | |
*** salv-orlando has quit IRC | 00:09 | |
*** markvoelker has joined #openstack-infra | 00:12 | |
*** Qiming has quit IRC | 00:18 | |
*** tzn has joined #openstack-infra | 00:18 | |
*** zeih has joined #openstack-infra | 00:30 | |
*** zeih has quit IRC | 00:34 | |
*** oomichi has joined #openstack-infra | 00:41 | |
*** otter768 has joined #openstack-infra | 00:55 | |
*** dingyichen has quit IRC | 00:57 | |
*** dingyichen has joined #openstack-infra | 00:58 | |
*** camunoz has quit IRC | 01:01 | |
*** camunoz has joined #openstack-infra | 01:01 | |
*** aeng has quit IRC | 01:04 | |
*** pahuang has quit IRC | 01:05 | |
*** tzn has quit IRC | 01:09 | |
*** salv-orl_ has quit IRC | 01:11 | |
*** zz_dimtruck is now known as dimtruck | 01:12 | |
*** salv-orlando has joined #openstack-infra | 01:12 | |
*** aeng has joined #openstack-infra | 01:17 | |
*** dimtruck is now known as zz_dimtruck | 01:22 | |
*** pahuang has joined #openstack-infra | 01:23 | |
*** chlong has joined #openstack-infra | 01:25 | |
*** tzn has joined #openstack-infra | 01:26 | |
*** Qiming has joined #openstack-infra | 01:28 | |
*** armax has quit IRC | 01:29 | |
*** zeih has joined #openstack-infra | 01:31 | |
openstackgerrit | hardik proposed openstack-infra/project-config: Add Job for mistral-docker-imagebuild https://review.openstack.org/261249 | 01:35 |
---|---|---|
waynr | can anyone tell me if this is within the normal variation of run times for the jenkins-job-builder-compare-xml test: https://review.openstack.org/#/c/263062/ | 01:35 |
*** zeih has quit IRC | 01:35 | |
waynr | it looks to be within the general range of values for commits in the jjb-2.0.0-api topic | 01:36 |
waynr | i only looked at a couple recent runs for reviews on the master branch of jenkins-job-builder but they were in the ~5m range | 01:38 |
*** tzn has quit IRC | 01:41 | |
*** tzn has joined #openstack-infra | 01:53 | |
*** moravec has quit IRC | 01:56 | |
*** masber has quit IRC | 01:57 | |
*** tzn has quit IRC | 01:58 | |
*** Sukhdev has joined #openstack-infra | 01:59 | |
*** gongysh has joined #openstack-infra | 02:00 | |
*** zz_dimtruck is now known as dimtruck | 02:01 | |
*** pahuang has quit IRC | 02:08 | |
*** aeng has quit IRC | 02:09 | |
*** baoli has joined #openstack-infra | 02:09 | |
*** pahuang has joined #openstack-infra | 02:10 | |
*** baoli has quit IRC | 02:10 | |
*** dimtruck is now known as zz_dimtruck | 02:11 | |
*** zhurong has joined #openstack-infra | 02:13 | |
*** baoli has joined #openstack-infra | 02:16 | |
*** masayukig has quit IRC | 02:22 | |
*** aeng has joined #openstack-infra | 02:22 | |
*** masayukig has joined #openstack-infra | 02:23 | |
*** baoli has quit IRC | 02:29 | |
*** zhenguo has joined #openstack-infra | 02:29 | |
*** zeih has joined #openstack-infra | 02:32 | |
*** masber has joined #openstack-infra | 02:33 | |
*** pahuang has quit IRC | 02:35 | |
*** zeih has quit IRC | 02:36 | |
*** baoli has joined #openstack-infra | 02:37 | |
*** baoli has quit IRC | 02:43 | |
*** Liuqing has joined #openstack-infra | 02:46 | |
*** sdake has joined #openstack-infra | 02:47 | |
*** pahuang has joined #openstack-infra | 02:48 | |
*** sdake_ has joined #openstack-infra | 02:49 | |
*** sdake has quit IRC | 02:52 | |
fungi | for those reading scrollback, reminder i'm not around monday (stuck in a car most of the day), but will still be around all of tuesday as usual | 02:54 |
*** dkranz has joined #openstack-infra | 02:54 | |
Clint | fungi: good luck escaping the car | 02:55 |
pleia2 | fungi: safe travels! | 02:55 |
fungi | thanks! | 02:55 |
*** baoli has joined #openstack-infra | 02:56 | |
fungi | i'll make sure someone leaves the window cracked so i don't suffocate in there | 02:56 |
*** krtaylor has joined #openstack-infra | 02:56 | |
pleia2 | hehe | 02:56 |
*** gmann has quit IRC | 02:59 | |
*** sdake_ is now known as sdake | 03:00 | |
*** baoli has quit IRC | 03:06 | |
*** dkranz has quit IRC | 03:07 | |
crinkle | fungi: will you want to be doing the paste downtime on tuesday? or save that for later? | 03:12 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/statusbot: Post message to twitter on 'ok' status https://review.openstack.org/263099 | 03:13 |
fungi | crinkle: i was toying with doing it from my hotel room right now | 03:13 |
fungi | i think i might take this opportunity to replace the old mysql 5.1 trove instance we had for it before with a mysql 5.6 instance too, so we don't need a second db transfer later | 03:14 |
fungi | lemme go do that real quick first and retest it | 03:14 |
crinkle | cool | 03:14 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/statusbot: Post message to twitter on 'ok' status https://review.openstack.org/263099 | 03:14 |
*** yamahata has quit IRC | 03:16 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/puppet-openstackid: Write update output to a logfile https://review.openstack.org/262630 | 03:18 |
fungi | okay, newer mysql 5.6 trove instance created, tested and updated in hiera | 03:25 |
*** Sukhdev has quit IRC | 03:26 | |
fungi | i'll do a quick outage of paste.o.o by stopping apache and lodgeit long enough to dump the db, source it in the trove instance, and then reenable/update puppet and start services again | 03:26 |
fungi | i've created http://paste.openstack.org/show/482926 as a canary to confirm the dump/load was complete | 03:28 |
*** unicell has quit IRC | 03:28 | |
*** unicell has joined #openstack-infra | 03:28 | |
*** unicell1 has joined #openstack-infra | 03:31 | |
*** zeih has joined #openstack-infra | 03:32 | |
*** binbincong has joined #openstack-infra | 03:33 | |
fungi | dump complete, loading into trove now | 03:33 |
*** unicell has quit IRC | 03:33 | |
*** coolsvap|away is now known as coolsvap | 03:33 | |
fungi | the export is just shy of 1gb, so not too long | 03:34 |
*** Sukhdev has joined #openstack-infra | 03:34 | |
fungi | mysqld is also stopped on paste.o.o now so we don't accidentally connect to the new db and get confused while testing it out | 03:35 |
fungi | import looks good from the cli. updating puppet now | 03:37 |
*** zeih has quit IRC | 03:37 | |
*** beekneemech has quit IRC | 03:37 | |
*** bnemec has joined #openstack-infra | 03:39 | |
*** unicell has joined #openstack-infra | 03:39 | |
fungi | mmm, puppetboard says we have a lot of failed nodes, in particular all our jenkins masters? | 03:40 |
*** unicell1 has quit IRC | 03:41 | |
openstackgerrit | Merged openstack-infra/zuul: Bump APScheduler to >=3.0 https://review.openstack.org/260637 | 03:41 |
fungi | looks like the issue with the jenkins masters is that they're failing to update the python-jenkins package to the latest release? | 03:46 |
*** Sukhdev_ has joined #openstack-infra | 03:47 | |
*** Sukhdev has quit IRC | 03:49 | |
openstackgerrit | Merged openstack-infra/zuul: Deprecated tox -downloadcache option removed https://review.openstack.org/256671 | 03:50 |
jhesketh | fungi: hmm looks like python-jenkins is already at the latest... maybe the nodes are having trouble querying pypi? | 03:51 |
*** links has joined #openstack-infra | 03:54 | |
fungi | possible | 03:56 |
fungi | as for paste, it looks like when puppet ran it didn't update the dburi in /srv/lodgeit/openstack/manage.py | 03:56 |
fungi | i'm going to manually update the script while i look into what's going on with it | 03:56 |
*** larainema has quit IRC | 03:58 | |
*** masber has quit IRC | 03:58 | |
fungi | test pastes are working as expected now, including the test paste i created immediately prior to the db dump | 03:59 |
*** gmann has joined #openstack-infra | 03:59 | |
fungi | and mysqld is definitely not running, which means we're hitting the trove instance | 03:59 |
fungi | so just need to figure out why the manage script didn't get the update | 03:59 |
*** davideag_ has quit IRC | 04:00 | |
fungi | oh, i may have enabled puppet mid-ansible-run | 04:00 |
fungi | the "successful" report from 03:49 utc took 0 seconds | 04:01 |
fungi | and reported no changes | 04:01 |
fungi | waiting for the next pulse to see what happens | 04:01 |
*** zz_dimtruck is now known as dimtruck | 04:02 | |
fungi | as soon as i see it update correctly, i'll un-wip 262321 | 04:03 |
*** kushal has joined #openstack-infra | 04:04 | |
*** dcentral has joined #openstack-infra | 04:04 | |
* jhesketh nods | 04:04 | |
fungi | and then we're just down to two remaining servers with local mysql databases? | 04:05 |
*** masber has joined #openstack-infra | 04:05 | |
fungi | hrm, the subsequent puppetdb report from 04:07 also shows no changes for paste.o.o | 04:09 |
fungi | double-checking that what we have in system-config is actually correct | 04:10 |
*** dimtruck is now known as zz_dimtruck | 04:11 | |
openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/262945 | 04:12 |
*** sdake has quit IRC | 04:14 | |
fungi | the system-config checkout in /opt/system-config/production on paste.o.o shows its last commit was december 1 | 04:18 |
fungi | leads me to suspect ansible is not updating system-config there | 04:18 |
fungi | same on nodepool.o.o | 04:19 |
fungi | so seems ansible isn't propagating system-config updates? | 04:19 |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/requirements: Bump minimum tempest-lib version https://review.openstack.org/263106 | 04:20 |
fungi | it's updating hiera correctly though | 04:21 |
fungi | so the problem is that the new hiera keys are not being called from the stale version of system-config on the server | 04:21 |
openstackgerrit | Gal Sagie proposed openstack-infra/project-config: Remove python3 checks from Dragonflow gate https://review.openstack.org/262981 | 04:23 |
clarkb | I dont think its puppet applying yet | 04:24 |
fungi | oh, hrm | 04:26 |
*** vilobhmm11 has joined #openstack-infra | 04:26 | |
fungi | so it's still calling back to puppetmaster via puppet agent? | 04:26 |
fungi | i guess i can try manually running `puppet agent --test` and see what happens? is that still safe? | 04:27 |
*** rguillebert has quit IRC | 04:27 | |
fungi | and yeah, digging into the puppet role in ansible i don't see it doing any git checkout or looking at anything in /opt locally on the servers | 04:28 |
*** gongysh has quit IRC | 04:28 | |
fungi | which supports your theory | 04:28 |
fungi | yeah, roles/puppet/library/puppet is still calling apply | 04:30 |
*** zeih has joined #openstack-infra | 04:33 | |
*** otter768 has quit IRC | 04:34 | |
*** kushal has quit IRC | 04:35 | |
nibalizer | the way it would copy the code is with rsync | 04:35 |
*** kushal has joined #openstack-infra | 04:35 | |
nibalizer | but it should be still agent | 04:35 |
fungi | thanks clarkb, that provided enough debugging to remind me that until 262321 merges i can't remove the old paste_mysql_root_password hiera key nor leave the local mysqld stopped | 04:36 |
nibalizer | fungi: did you mean still calling agent? | 04:36 |
fungi | nibalizer: yeah | 04:36 |
nibalizer | ok | 04:36 |
fungi | rather than apply | 04:36 |
fungi | nibalizer: why rsync and not just git? | 04:37 |
nibalizer | i asked that question as well | 04:37 |
*** zeih has quit IRC | 04:37 | |
nibalizer | it is faster to rsync | 04:38 |
fungi | are we needing to apply some sort of transformation of what we have in system-config git now? | 04:38 |
nibalizer | rsyncing the modules directory has the nice effect of making sure every node runs the same puppet code | 04:39 |
nibalizer | if two nodes both ran install_modules.sh at different times (after someone landed something on a module) they might get different versions | 04:39 |
nibalizer | sortof like the project-config-ref issue x 60 | 04:39 |
fungi | oh, syncing all modules, not just system-config | 04:40 |
fungi | got iy | 04:40 |
fungi | it | 04:40 |
crinkle | paste seems to be down? | 04:41 |
crinkle | nm it is back up | 04:42 |
fungi | i think puppet stopped it in a failed attempt to restart it when i did the apply a minute ago | 04:42 |
fungi | i manually started the openstack-paste service which brought it back up again | 04:43 |
*** Sukhdev_ has quit IRC | 04:43 | |
*** Sukhdev has joined #openstack-infra | 04:44 | |
*** apoorvad has joined #openstack-infra | 04:45 | |
*** treaki_ has joined #openstack-infra | 04:47 | |
*** treaki__ has quit IRC | 04:51 | |
fungi | anyway, if it seems to remain stable now, 262321 should be ready to go in. i've cleared my wip | 04:53 |
*** armax has joined #openstack-infra | 04:53 | |
fungi | if someone gets to that in the next few minutes, i'll take care of the manual followup cleanup mentioned in my review comment | 04:54 |
crinkle | nibalizer: ^ seemed to be here | 04:55 |
nibalizer | sure | 04:58 |
fungi | 'preciated! | 04:58 |
*** gnuoy has quit IRC | 05:00 | |
*** jamespage has quit IRC | 05:00 | |
*** davideagnello has joined #openstack-infra | 05:00 | |
*** jamespage has joined #openstack-infra | 05:00 | |
*** gnuoy has joined #openstack-infra | 05:00 | |
*** dchen has joined #openstack-infra | 05:02 | |
*** davideagnello has quit IRC | 05:05 | |
*** salv-orl_ has joined #openstack-infra | 05:07 | |
*** salv-orlando has quit IRC | 05:07 | |
openstackgerrit | Merged openstack-infra/system-config: Revert "Add a local MySQL database to paste.o.o" https://review.openstack.org/262321 | 05:15 |
fungi | cool, i'll do the last manual cleanup now | 05:15 |
*** baoli has joined #openstack-infra | 05:18 | |
*** dchen has quit IRC | 05:19 | |
*** apoorvad has quit IRC | 05:20 | |
*** dchen has joined #openstack-infra | 05:21 | |
*** apoorvad has joined #openstack-infra | 05:22 | |
*** baoli has quit IRC | 05:23 | |
*** apoorvad has quit IRC | 05:25 | |
*** Eva-i has quit IRC | 05:26 | |
*** abregman has joined #openstack-infra | 05:27 | |
fungi | okay, puppetmaster has updated with that, i've cleaned up the old hiera key and uninstalled the local mysql service and the puppet manifest is applying cleanly | 05:32 |
fungi | and paste still seems to be running fine | 05:32 |
fungi | i'll take that as a cue to get some sleep. day full of driving coming up | 05:33 |
crinkle | o7 | 05:33 |
*** zeih has joined #openstack-infra | 05:35 | |
*** sam_wan has joined #openstack-infra | 05:37 | |
*** zeih has quit IRC | 05:39 | |
*** markvoelker has quit IRC | 05:39 | |
*** dchen has quit IRC | 05:44 | |
*** harlowja_at_home has joined #openstack-infra | 05:51 | |
*** masber has quit IRC | 05:55 | |
*** davideagnello has joined #openstack-infra | 06:01 | |
*** zz_dimtruck is now known as dimtruck | 06:03 | |
*** Sukhdev_ has joined #openstack-infra | 06:04 | |
*** salv-orlando has joined #openstack-infra | 06:06 | |
*** davideagnello has quit IRC | 06:06 | |
*** Sukhdev has quit IRC | 06:07 | |
*** harlowja_at_home has quit IRC | 06:08 | |
*** salv-orl_ has quit IRC | 06:09 | |
*** dimtruck is now known as zz_dimtruck | 06:12 | |
*** masber has joined #openstack-infra | 06:17 | |
*** vilobhmm11 has quit IRC | 06:19 | |
gsagie | Hello all, regarding https://review.openstack.org/#/c/262981/2/zuul/layout.yaml trying to put python3 tests in the check (non voting) i guess the way i did it is not the correct way, can anyone please suggest? | 06:22 |
*** vilobhmm11 has joined #openstack-infra | 06:25 | |
*** masber has quit IRC | 06:25 | |
craige | How long ago did you run that rechack gsagie? | 06:30 |
*** camunoz has quit IRC | 06:30 | |
gsagie | just run it now craige | 06:31 |
gsagie | few minutes ago | 06:31 |
gsagie | the syntax seems ok to you? | 06:31 |
craige | Ok. I couldn't see any obvious problems so let's see how that goes :-) | 06:31 |
gsagie | craige: ok thanks! | 06:32 |
*** FallenPegasus has joined #openstack-infra | 06:33 | |
*** larainema has joined #openstack-infra | 06:33 | |
craige | It's failed again gsagie but I'd think it's a problem with your change, unless I've missed something. | 06:34 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/263143 | 06:35 |
gsagie | craige: you mean its not a problem with my change ? or it is? | 06:35 |
*** otter768 has joined #openstack-infra | 06:35 | |
gsagie | i havent seen any example of a job that has this as a check, so i am assume its something there | 06:36 |
craige | You've still got other references to python3 in that file. | 06:36 |
craige | Should they be removed to? | 06:36 |
gsagie | craige: where? | 06:37 |
craige | I'm now sure it's your change and you've not successfully removed pthon3-jobs as you'd hoped. | 06:37 |
craige | Lines 378 - 382 | 06:39 |
gsagie | i am not sure you look at the correct patch, mine is https://review.openstack.org/#/c/262981/ | 06:40 |
*** markvoelker has joined #openstack-infra | 06:40 | |
craige | I'll double check | 06:40 |
*** otter768 has quit IRC | 06:41 | |
*** irenab has quit IRC | 06:42 | |
*** camunoz has joined #openstack-infra | 06:44 | |
*** markvoelker has quit IRC | 06:45 | |
*** masber has joined #openstack-infra | 06:47 | |
craige | Had the right change but was slightly confused gsagie | 06:47 |
*** jtomasek has joined #openstack-infra | 06:51 | |
*** armax has quit IRC | 06:52 | |
gsagie | craige: np | 06:52 |
*** Sukhdev_ has quit IRC | 06:52 | |
craige | I think I see where your problem lies gsagie | 06:54 |
craige | You remove python3-jobs from the check but python-jobs remains in the template. I don't *know* that's a problem but it's suspicious to me. | 06:54 |
craige | I'm looking for examples of how to acheive what you're trying to do properly. | 06:55 |
*** chlong has quit IRC | 06:55 | |
*** isaacb has joined #openstack-infra | 06:56 | |
gsagie | craige: thanks, i am trying to run python3 tests but want them to be non-voting (as Andreas suggested in the comment, because before that i removed it completely and it pass jenkins) | 06:57 |
gsagie | but i guess i did it wrong (just copy paste python3-jobs to check | 06:58 |
craige | That makes sense. | 06:59 |
craige | Your change doesn't look that different from others in that file either | 06:59 |
craige | I can't find any other examples of "python3-jobs" being used in the check field, gsagie. | 07:02 |
*** davideagnello has joined #openstack-infra | 07:02 | |
gsagie | craige: yeah i know, searched that as well :) | 07:02 |
craige | :-) | 07:05 |
craige | I've not looked at that file before so I'm trying to get my head around it as well. | 07:05 |
Thelo | Hi all, I just deploy a CI using : http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/README.md, at the end, should there be jobs automatically loaded inside jenkins or I need to load some by myself? | 07:06 |
*** davideagnello has quit IRC | 07:07 | |
craige | On line 378 gsagie, python30jobs is defined as "gate-{name}-python34" - does such a file exist for dragonflow? If it doesm you could call that check directly. | 07:07 |
*** aopincar has joined #openstack-infra | 07:08 | |
*** sam_wan has quit IRC | 07:11 | |
*** irenab has joined #openstack-infra | 07:13 | |
craige | Both andreas and myself have added what we think is the answer to your change, gsagie | 07:16 |
gsagie | craige: saw, thanks, will address it soon :) | 07:17 |
gsagie | thanks for your help | 07:17 |
*** oomichi has quit IRC | 07:17 | |
craige | no probs gsagie. I got a lot out of it too :-D | 07:17 |
*** vilobhmm11 has quit IRC | 07:18 | |
*** aopincar has quit IRC | 07:20 | |
*** lennyb_ has joined #openstack-infra | 07:31 | |
*** isaacb has quit IRC | 07:34 | |
*** ifarkas has joined #openstack-infra | 07:34 | |
*** salv-orlando has quit IRC | 07:34 | |
*** aopincar has joined #openstack-infra | 07:35 | |
*** salv-orlando has joined #openstack-infra | 07:35 | |
*** _nadya_ has joined #openstack-infra | 07:37 | |
*** amotoki has joined #openstack-infra | 07:38 | |
*** salv-orlando has quit IRC | 07:42 | |
*** salv-orlando has joined #openstack-infra | 07:42 | |
*** treaki_ has quit IRC | 07:43 | |
*** aopincar has quit IRC | 07:43 | |
*** kevinbenton has quit IRC | 07:49 | |
*** isaacb has joined #openstack-infra | 07:50 | |
*** kevinbenton has joined #openstack-infra | 07:54 | |
*** zz_dimtruck is now known as dimtruck | 08:00 | |
*** markus_z has joined #openstack-infra | 08:02 | |
*** davideagnello has joined #openstack-infra | 08:03 | |
*** arxcruz has joined #openstack-infra | 08:05 | |
* ttx yawns. Happy new year everyone | 08:07 | |
*** isaacb has quit IRC | 08:08 | |
*** davideagnello has quit IRC | 08:08 | |
GheRivero | ttx: Happy new year! | 08:08 |
*** kevinbenton has quit IRC | 08:08 | |
gsagie | Happy new year ttx! | 08:08 |
gsagie | and everyone else , and special thanks to everyone in the Infrastructure team making our lifes a lot simples :) | 08:09 |
gsagie | simpler | 08:09 |
*** hdd has quit IRC | 08:09 | |
*** dimtruck is now known as zz_dimtruck | 08:10 | |
*** masber has quit IRC | 08:11 | |
openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Noop whitespace change to resync calendars https://review.openstack.org/263162 | 08:12 |
dmellado | happy new year everyone ;) | 08:12 |
*** zeih has joined #openstack-infra | 08:18 | |
*** samuelBartel has joined #openstack-infra | 08:18 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Noop whitespace change to resync calendars https://review.openstack.org/263162 | 08:19 |
*** jordanP has joined #openstack-infra | 08:20 | |
*** _nadya_ has quit IRC | 08:20 | |
*** ildikov has quit IRC | 08:21 | |
*** ildikov has joined #openstack-infra | 08:21 | |
*** Qiming has quit IRC | 08:24 | |
*** dingyichen has quit IRC | 08:24 | |
*** bexelbie_ has joined #openstack-infra | 08:26 | |
*** esikachev has joined #openstack-infra | 08:27 | |
*** matrohon has joined #openstack-infra | 08:28 | |
*** sam_wan has joined #openstack-infra | 08:28 | |
*** flepied has joined #openstack-infra | 08:28 | |
*** zeih has quit IRC | 08:28 | |
*** xek_ is now known as xek | 08:29 | |
*** bexelbie_ is now known as bexelbie | 08:29 | |
*** ihrachys has joined #openstack-infra | 08:31 | |
*** jed56 has joined #openstack-infra | 08:32 | |
*** salv-orlando has quit IRC | 08:34 | |
*** salv-orlando has joined #openstack-infra | 08:35 | |
*** otter768 has joined #openstack-infra | 08:36 | |
*** lezbar has joined #openstack-infra | 08:39 | |
*** Hal has joined #openstack-infra | 08:39 | |
*** masber has joined #openstack-infra | 08:39 | |
*** Hal is now known as Guest66157 | 08:40 | |
*** markvoelker has joined #openstack-infra | 08:41 | |
*** otter768 has quit IRC | 08:41 | |
*** jlanoux has joined #openstack-infra | 08:42 | |
*** lezbar has quit IRC | 08:43 | |
*** shardy has joined #openstack-infra | 08:44 | |
*** markvoelker has quit IRC | 08:45 | |
*** aspiers has joined #openstack-infra | 08:46 | |
*** pblaho has joined #openstack-infra | 08:48 | |
*** peterlisak has joined #openstack-infra | 08:48 | |
*** _nadya_ has joined #openstack-infra | 08:49 | |
*** lezbar has joined #openstack-infra | 08:58 | |
*** links has quit IRC | 09:00 | |
*** oomichi has joined #openstack-infra | 09:00 | |
*** fhubik has joined #openstack-infra | 09:00 | |
*** fhubik is now known as fhubik_brb | 09:01 | |
*** ihrachys_ has joined #openstack-infra | 09:02 | |
*** links has joined #openstack-infra | 09:04 | |
*** ihrachys has quit IRC | 09:04 | |
*** davideagnello has joined #openstack-infra | 09:04 | |
*** sshnaidm_ has joined #openstack-infra | 09:04 | |
*** kzaitsev_mb has joined #openstack-infra | 09:04 | |
*** egonzalez has joined #openstack-infra | 09:04 | |
*** masber has quit IRC | 09:05 | |
*** dcentral has quit IRC | 09:06 | |
*** Eva-i has joined #openstack-infra | 09:07 | |
*** sdake has joined #openstack-infra | 09:08 | |
*** davideagnello has quit IRC | 09:08 | |
*** jistr has joined #openstack-infra | 09:12 | |
odyssey4me | morning all, for some reason one of our job skipping rules is not taking effect any more, eg https://review.openstack.org/258196 should only run the 'gate-openstack-ansible-docs' job, but is instead running all jobs | 09:15 |
odyssey4me | it should skip based on https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L1994-L2000 | 09:16 |
*** sfinucan has joined #openstack-infra | 09:17 | |
*** ihrachys_ has quit IRC | 09:17 | |
*** ihrachys has joined #openstack-infra | 09:17 | |
*** yaume has joined #openstack-infra | 09:18 | |
*** ihrachys has quit IRC | 09:19 | |
*** ihrachys has joined #openstack-infra | 09:20 | |
openstackgerrit | Merged openstack-infra/system-config: Fix stackforge and github links https://review.openstack.org/262863 | 09:21 |
*** fhubik_brb is now known as fhubik | 09:21 | |
*** jcoufal has joined #openstack-infra | 09:21 | |
openstackgerrit | Merged openstack-infra/project-config: Add release-schedule-generator project https://review.openstack.org/261135 | 09:22 |
*** Qiming has joined #openstack-infra | 09:25 | |
*** dcentral has joined #openstack-infra | 09:26 | |
*** dcentral has quit IRC | 09:27 | |
*** ihrachys has quit IRC | 09:30 | |
*** ihrachys has joined #openstack-infra | 09:30 | |
*** ihrachys has quit IRC | 09:30 | |
openstackgerrit | Merged openstack-infra/project-config: Magnum: Add new job to do mesos functional testing https://review.openstack.org/261894 | 09:31 |
*** [1]Thelo has joined #openstack-infra | 09:32 | |
openstackgerrit | Merged openstack-infra/project-config: New Project - ekko https://review.openstack.org/262614 | 09:33 |
*** ihrachys has joined #openstack-infra | 09:33 | |
*** Thelo has quit IRC | 09:34 | |
*** [1]Thelo is now known as Thelo | 09:34 | |
openstackgerrit | Merged openstack-infra/project-config: Add feature/2.0.x branch reporting to #openstack-infra https://review.openstack.org/262829 | 09:34 |
*** esikachev has quit IRC | 09:37 | |
*** ihrachys has quit IRC | 09:38 | |
*** lxsli_festive is now known as lxsli | 09:39 | |
openstackgerrit | Merged openstack-infra/infra-manual: add additional information about APIImpact https://review.openstack.org/233729 | 09:41 |
openstackgerrit | Merged openstack-infra/infra-manual: Moved Python project guide to Project Team Guide https://review.openstack.org/244851 | 09:41 |
*** ihrachys has joined #openstack-infra | 09:43 | |
*** ihrachys has quit IRC | 09:43 | |
openstackgerrit | Ramana Raja proposed openstack-infra/project-config: Add Manila with CephFSNative driver CI job https://review.openstack.org/259323 | 09:46 |
*** zeih has joined #openstack-infra | 09:46 | |
*** rguillebert has joined #openstack-infra | 09:47 | |
*** pblaho has quit IRC | 09:48 | |
*** pblaho has joined #openstack-infra | 09:49 | |
*** goodygum has joined #openstack-infra | 09:50 | |
openstackgerrit | Merged openstack-infra/infra-manual: Remove StackForge rename details Creator's Guide https://review.openstack.org/253687 | 09:51 |
*** HeOS has joined #openstack-infra | 09:54 | |
*** vipuls has quit IRC | 09:55 | |
*** SlickN1k has quit IRC | 09:55 | |
*** spiffxp_ has quit IRC | 09:55 | |
*** SlickN1k has joined #openstack-infra | 09:56 | |
*** spiffxp_ has joined #openstack-infra | 09:57 | |
*** vipuls has joined #openstack-infra | 09:58 | |
*** cdent has joined #openstack-infra | 09:58 | |
*** fhubik is now known as fhubik_brb | 09:58 | |
*** zz_dimtruck is now known as dimtruck | 10:01 | |
*** FallenPegasus has quit IRC | 10:02 | |
*** BobBall-XMAS is now known as BobBall | 10:02 | |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/requirements: WIP: Cap Babel for avoiding gate issue https://review.openstack.org/263191 | 10:02 |
*** openstackgerrit has quit IRC | 10:02 | |
*** openstackgerrit has joined #openstack-infra | 10:02 | |
*** Daisy_ has joined #openstack-infra | 10:03 | |
*** coolsvap is now known as coolsvap|away | 10:04 | |
*** davideagnello has joined #openstack-infra | 10:05 | |
*** masber has joined #openstack-infra | 10:05 | |
*** Daisy_ has quit IRC | 10:08 | |
*** Liuqing has quit IRC | 10:08 | |
*** zhurong has quit IRC | 10:10 | |
*** dimtruck is now known as zz_dimtruck | 10:11 | |
*** davideagnello has quit IRC | 10:11 | |
*** luv has left #openstack-infra | 10:11 | |
*** luv has joined #openstack-infra | 10:11 | |
*** zeih has quit IRC | 10:12 | |
*** acabot has joined #openstack-infra | 10:13 | |
openstackgerrit | Gal Sagie proposed openstack-infra/project-config: Remove python3 checks from Dragonflow gate https://review.openstack.org/262981 | 10:13 |
*** HeOS has quit IRC | 10:15 | |
*** zeih has joined #openstack-infra | 10:17 | |
*** ihrachys has joined #openstack-infra | 10:18 | |
*** kzaitsev_mb has quit IRC | 10:19 | |
*** jistr has quit IRC | 10:24 | |
*** pblaho has quit IRC | 10:24 | |
*** ihrachys has quit IRC | 10:24 | |
*** arxcruz has quit IRC | 10:24 | |
*** fhubik_brb has quit IRC | 10:24 | |
*** ihrachys_ has joined #openstack-infra | 10:24 | |
*** SotK_ is now known as SotK | 10:28 | |
*** jistr has joined #openstack-infra | 10:30 | |
*** aopincar has joined #openstack-infra | 10:30 | |
*** jistr has quit IRC | 10:30 | |
*** samueldmq1 is now known as samueldmq | 10:34 | |
*** otter768 has joined #openstack-infra | 10:37 | |
*** kzaitsev_mb has joined #openstack-infra | 10:40 | |
*** markvoelker has joined #openstack-infra | 10:42 | |
*** otter768 has quit IRC | 10:42 | |
*** ganso has joined #openstack-infra | 10:45 | |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/requirements: WIP: Cap setuptools for avoiding gate issue https://review.openstack.org/263191 | 10:45 |
*** sam_wan has quit IRC | 10:45 | |
*** markvoelker has quit IRC | 10:46 | |
*** sam_wan has joined #openstack-infra | 10:48 | |
*** fhubik_brb has joined #openstack-infra | 10:49 | |
openstackgerrit | Beth Elwell proposed openstack-infra/project-config: New project for Ironic UI plugin https://review.openstack.org/254845 | 10:52 |
*** tzn has joined #openstack-infra | 10:54 | |
openstackgerrit | Thierry Carrez proposed openstack-infra/infra-manual: Update release management chapter https://review.openstack.org/260610 | 10:55 |
*** hashar has joined #openstack-infra | 10:59 | |
*** arxcruz has joined #openstack-infra | 11:00 | |
*** zeih has quit IRC | 11:03 | |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/requirements: WIP: Cap setuptools for avoiding gate issue https://review.openstack.org/263191 | 11:05 |
*** e0ne has joined #openstack-infra | 11:06 | |
*** ihrachys_ has quit IRC | 11:07 | |
*** davideagnello has joined #openstack-infra | 11:07 | |
*** ihrachys has joined #openstack-infra | 11:08 | |
*** rfolco has joined #openstack-infra | 11:11 | |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/requirements: Cap setuptools for avoiding gate issue https://review.openstack.org/263191 | 11:12 |
*** davideagnello has quit IRC | 11:12 | |
*** markmcd has quit IRC | 11:14 | |
*** zeih has joined #openstack-infra | 11:15 | |
*** Liuqing has joined #openstack-infra | 11:15 | |
*** kzaitsev_mb has quit IRC | 11:16 | |
*** markmcd has joined #openstack-infra | 11:16 | |
*** sdague has joined #openstack-infra | 11:21 | |
*** zz_dimtruck is now known as dimtruck | 11:22 | |
*** markmcd has quit IRC | 11:22 | |
*** markmcd has joined #openstack-infra | 11:24 | |
*** zeih has quit IRC | 11:24 | |
openstackgerrit | Gal Sagie proposed openstack-infra/project-config: Remove python3 checks from Dragonflow gate https://review.openstack.org/262981 | 11:29 |
*** daemontool has joined #openstack-infra | 11:29 | |
*** shardy has quit IRC | 11:29 | |
*** shardy has joined #openstack-infra | 11:30 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Send instructions to workers to upload metadata https://review.openstack.org/263218 | 11:30 |
*** claudiub has joined #openstack-infra | 11:36 | |
*** fhubik_brb is now known as fhubik | 11:40 | |
*** dims has joined #openstack-infra | 11:40 | |
*** dims has quit IRC | 11:40 | |
*** dims has joined #openstack-infra | 11:41 | |
*** pblaho has joined #openstack-infra | 11:41 | |
*** jistr has joined #openstack-infra | 11:41 | |
*** pblaho has quit IRC | 11:42 | |
*** pblaho has joined #openstack-infra | 11:42 | |
*** Guest66157 has quit IRC | 11:43 | |
*** sam_wan has quit IRC | 11:45 | |
*** kzaitsev_mb has joined #openstack-infra | 11:48 | |
openstackgerrit | Merged openstack-infra/storyboard-webclient: Display the most recent commit SHA on the about page https://review.openstack.org/258583 | 11:48 |
*** cdent has quit IRC | 11:48 | |
*** BobBall has quit IRC | 11:53 | |
*** kzaitsev_mb has quit IRC | 11:53 | |
*** erlon has joined #openstack-infra | 11:53 | |
*** fhubik is now known as fhubik_brb | 11:57 | |
*** GnomeKing has joined #openstack-infra | 11:57 | |
*** fhubik_brb is now known as fhubik | 12:00 | |
*** FallenPegasus has joined #openstack-infra | 12:02 | |
*** chlong has joined #openstack-infra | 12:03 | |
*** hashar has quit IRC | 12:03 | |
*** sshnaidm_ has quit IRC | 12:04 | |
*** kzaitsev_mb has joined #openstack-infra | 12:04 | |
*** zhurong has joined #openstack-infra | 12:06 | |
*** salv-orl_ has joined #openstack-infra | 12:06 | |
*** salv-orl_ has quit IRC | 12:07 | |
*** salv-orl_ has joined #openstack-infra | 12:07 | |
*** FallenPegasus has quit IRC | 12:08 | |
*** salv-orlando has quit IRC | 12:09 | |
*** tzn has quit IRC | 12:10 | |
*** markvoelker has joined #openstack-infra | 12:12 | |
*** kzaitsev_mb has quit IRC | 12:12 | |
kragniz | hey, could someone add me as the initial member of release-schedule-generator-core and release-schedule-generator-release? | 12:15 |
*** kdas_ has joined #openstack-infra | 12:17 | |
*** dimtruck is now known as zz_dimtruck | 12:17 | |
*** markvoelker has quit IRC | 12:17 | |
*** kushal has quit IRC | 12:19 | |
*** zeih has joined #openstack-infra | 12:20 | |
*** zz_dimtruck is now known as dimtruck | 12:21 | |
*** kdas_ has quit IRC | 12:22 | |
*** kushal has joined #openstack-infra | 12:22 | |
*** masber has quit IRC | 12:24 | |
*** gordc has joined #openstack-infra | 12:24 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Don't hide paging controls for xs window sizes https://review.openstack.org/263235 | 12:28 |
*** Liuqing has quit IRC | 12:29 | |
*** doug-fish has joined #openstack-infra | 12:31 | |
*** tzn has joined #openstack-infra | 12:32 | |
*** links has quit IRC | 12:34 | |
*** _nadya_ has quit IRC | 12:38 | |
*** otter768 has joined #openstack-infra | 12:38 | |
*** sdake has quit IRC | 12:39 | |
*** sdake has joined #openstack-infra | 12:40 | |
openstackgerrit | Merged openstack-infra/storyboard-webclient: Use a modal to add projects https://review.openstack.org/257872 | 12:41 |
*** Daisy has joined #openstack-infra | 12:42 | |
*** otter768 has quit IRC | 12:43 | |
*** rhallisey has joined #openstack-infra | 12:45 | |
*** arxcruz has quit IRC | 12:46 | |
*** zul has quit IRC | 12:47 | |
*** zul has joined #openstack-infra | 12:47 | |
openstackgerrit | Ryan Hallisey proposed openstack/diskimage-builder: The mirror for installing epel is timing out https://review.openstack.org/262050 | 12:49 |
*** jistr has quit IRC | 12:50 | |
*** pblaho has quit IRC | 12:50 | |
*** thorst has joined #openstack-infra | 12:50 | |
*** pblaho has joined #openstack-infra | 12:52 | |
*** sdake_ has joined #openstack-infra | 12:53 | |
*** sshnaidm_ has joined #openstack-infra | 12:54 | |
*** markvoelker has joined #openstack-infra | 12:55 | |
*** gongysh has joined #openstack-infra | 12:55 | |
*** GnomeKing is now known as BobBall | 12:56 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: (WIP) Upload metadata for pseudo folder https://review.openstack.org/263240 | 12:56 |
*** _nadya_ has joined #openstack-infra | 12:57 | |
*** sdake has quit IRC | 12:57 | |
*** Daisy has quit IRC | 12:58 | |
*** jistr has joined #openstack-infra | 13:02 | |
*** baoli has joined #openstack-infra | 13:05 | |
*** dosaboy_ is now known as dosaboy | 13:05 | |
*** mgrosz has joined #openstack-infra | 13:07 | |
*** mwagner_lap has quit IRC | 13:07 | |
*** larainema has quit IRC | 13:08 | |
mgrosz | Hello, I would like to add Vitrage documentation to the following web page: http://docs.openstack.org/developer/openstack-projects.html. Haw can it be done? What configuration do I need to add? | 13:08 |
*** kzaitsev_mb has joined #openstack-infra | 13:08 | |
*** davideagnello has joined #openstack-infra | 13:09 | |
fungi | mgrosz: vitrage needs to be maintained by an official openstack project team if it's going to publish to docs.openstack.org | 13:11 |
*** fhubik is now known as fhubik_brb | 13:11 | |
fungi | the docs team has, in the past, expressed concern over unofficial projects publishing documentation on that site | 13:12 |
*** davideagnello has quit IRC | 13:13 | |
*** salv-orl_ has quit IRC | 13:13 | |
*** fhubik_brb is now known as fhubik | 13:14 | |
*** salv-orlando has joined #openstack-infra | 13:14 | |
*** dprince has joined #openstack-infra | 13:18 | |
*** dkranz has joined #openstack-infra | 13:19 | |
*** edmondsw has joined #openstack-infra | 13:20 | |
*** chlong has quit IRC | 13:20 | |
*** otter768 has joined #openstack-infra | 13:20 | |
zaro | yolanda: ping | 13:26 |
mgrosz | fungi: thanks. What does it mean technically to "be maintained by an official openstack project team"? Only by that? | 13:26 |
*** pradk has joined #openstack-infra | 13:29 | |
SamYaple | odyssey4me: did you get an answer to your job skipping rules not effecting anymore? | 13:30 |
*** amuller has joined #openstack-infra | 13:31 | |
*** amrith is now known as _amrith_ | 13:31 | |
*** jpr1 has quit IRC | 13:32 | |
*** daemontool has quit IRC | 13:33 | |
*** chlong has joined #openstack-infra | 13:33 | |
*** daemontool has joined #openstack-infra | 13:33 | |
*** daemontool has quit IRC | 13:33 | |
*** aopincar has quit IRC | 13:33 | |
*** ihrachys_ has joined #openstack-infra | 13:34 | |
*** daemontool has joined #openstack-infra | 13:34 | |
openstackgerrit | Jim Rollenhagen proposed openstack-infra/project-config: Add reno jobs for ironic-python-agent https://review.openstack.org/258736 | 13:35 |
*** otter768 has quit IRC | 13:35 | |
*** baoli_ has joined #openstack-infra | 13:36 | |
*** larainema has joined #openstack-infra | 13:36 | |
*** ihrachys has quit IRC | 13:36 | |
*** fhubik is now known as fhubik_brb | 13:37 | |
*** fhubik_brb is now known as fhubik | 13:38 | |
*** baoli has quit IRC | 13:38 | |
*** unicell1 has joined #openstack-infra | 13:38 | |
*** moravec has joined #openstack-infra | 13:40 | |
*** unicell has quit IRC | 13:41 | |
*** kzaitsev_mb has quit IRC | 13:42 | |
*** bcourt has joined #openstack-infra | 13:45 | |
*** zhurong has quit IRC | 13:49 | |
*** thiagop has joined #openstack-infra | 13:49 | |
*** bcourt has quit IRC | 13:50 | |
*** FallenPegasus has joined #openstack-infra | 13:51 | |
*** zhurong has joined #openstack-infra | 13:52 | |
openstackgerrit | Merged openstack-infra/release-tools: start sending release announcements to openstack-dev by default https://review.openstack.org/260989 | 13:52 |
*** Hal has joined #openstack-infra | 13:53 | |
fungi | mgrosz: http://governance.openstack.org/reference/new-projects-requirements.html | 13:53 |
SamYaple | can someone add me to the ekko-core and ekko-release group? it is a new project I submitted that was recently merged. https://review.openstack.org/#/admin/groups/1236,members https://review.openstack.org/#/admin/groups/1237,members https://review.openstack.org/#/c/262614/ | 13:53 |
pabelanger | ohai | 13:53 |
*** Hal is now known as Guest21972 | 13:54 | |
*** mwagner_lap has joined #openstack-infra | 13:55 | |
*** links has joined #openstack-infra | 13:56 | |
*** FallenPegasus has quit IRC | 13:56 | |
*** irenab has quit IRC | 13:57 | |
*** fawadkhaliq has joined #openstack-infra | 13:59 | |
*** zhurong has quit IRC | 14:00 | |
*** zhurong has joined #openstack-infra | 14:04 | |
*** pblaho has quit IRC | 14:04 | |
*** pblaho has joined #openstack-infra | 14:05 | |
*** bcourt has joined #openstack-infra | 14:05 | |
*** links has quit IRC | 14:07 | |
*** bdemers has joined #openstack-infra | 14:07 | |
*** otter768 has joined #openstack-infra | 14:08 | |
*** otter768 has quit IRC | 14:08 | |
*** davideagnello has joined #openstack-infra | 14:10 | |
*** sdake has joined #openstack-infra | 14:11 | |
*** bdemers has quit IRC | 14:11 | |
*** sdake_ has quit IRC | 14:12 | |
*** bdemers has joined #openstack-infra | 14:13 | |
*** hashar has joined #openstack-infra | 14:14 | |
*** Kennan has quit IRC | 14:14 | |
*** davideagnello has quit IRC | 14:15 | |
*** Kennan has joined #openstack-infra | 14:15 | |
*** zhurong has quit IRC | 14:16 | |
*** dimtruck is now known as zz_dimtruck | 14:18 | |
openstackgerrit | Merged openstack-infra/storyboard-webclient: Tidy up project groups states https://review.openstack.org/253049 | 14:21 |
odyssey4me | SamYaple nope, no response just yet - I've been waiting for everyone to come back online | 14:22 |
odyssey4me | SamYaple do you have some jobs working differently too? | 14:22 |
*** julim has joined #openstack-infra | 14:23 | |
anteaya | odyssey4me: do a git blame of the skipping rules for zuul/layout.yaml in project-config | 14:23 |
*** jswarren has joined #openstack-infra | 14:23 | |
*** ayoung has joined #openstack-infra | 14:23 | |
odyssey4me | anteaya the skip rule that's not happening hasn't changed, but something else has changed that clearly affects it | 14:23 |
anteaya | odyssey4me: it is possible that the skipping rules you depend on have been overwritten by a change occuring after yours | 14:23 |
anteaya | right, if a new rule was added later in the file that affects the regex it could over write the rule you are expecting to work | 14:24 |
*** weshay_xchat has joined #openstack-infra | 14:24 | |
anteaya | you can do a git blame yourself or wait for me, but I just came online and am getting oriented so I don't have a time line for when I can get to it | 14:24 |
SamYaple | odyssey4me: yea a similiar thing to what anteaya said tripped my up with the gate names for multinode | 14:25 |
gsagie | anyone from project-config that can review this patch: https://review.openstack.org/#/c/262981/ it will be much appreciated, currently blocks us from working on unit tests :) | 14:25 |
*** peristeri has joined #openstack-infra | 14:26 | |
anteaya | Thelo: you have to define your jenkins jobs yourself, we have no way of knowing what jobs you want to run on your system | 14:26 |
zaro | fungi: was wondering if you could provide an opinion for this? https://review.openstack.org/#/c/260284/ | 14:27 |
odyssey4me | oh yes, in other news the ubuntu-trusty node types seem to have forgotten to resize2fs - they have an 80GB partition, but only 16GB file system | 14:29 |
odyssey4me | btw thanks anteaya :) and happy new year to everyone :) | 14:29 |
*** jpeeler has joined #openstack-infra | 14:29 | |
*** jpeeler has quit IRC | 14:29 | |
*** jpeeler has joined #openstack-infra | 14:29 | |
anteaya | odyssey4me: welcome, happy new year to you as well | 14:30 |
SamYaple | happy new year to you as well odyssey4me | 14:30 |
SamYaple | ah beat me to it anteaya | 14:30 |
*** jistr has quit IRC | 14:30 | |
anteaya | odyssey4me: can you link to some details on your assertion about the failure to resize? | 14:30 |
anteaya | odyssey4me: a build log perhaps | 14:31 |
anteaya | fungi: safe travels today | 14:31 |
*** jistr has joined #openstack-infra | 14:31 | |
anteaya | and one for the channel, I'm out doing errands following the third-party meeting. My driving service is back from holidays and I have to buy groceries, been out of milk for 4 days. :( | 14:32 |
SamYaple | anteaya: do you have the ability to members to groups? im not sure who can do that. I have a new project and it has no users to merge code :) | 14:32 |
odyssey4me | anteaya sure thing: see the disk device size at http://logs.openstack.org/47/252247/7/check/gate-openstack-ansible-commit-nv/02869f3/console.html#_2016-01-04_11_30_28_527 and the file system http://logs.openstack.org/47/252247/7/check/gate-openstack-ansible-commit-nv/02869f3/console.html#_2016-01-04_11_30_28_523 | 14:33 |
anteaya | SamYaple: I do not have the ability to add members to groups. infra-root has gerrit admin permissions, which is what is required to add members to groups | 14:35 |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to set Gerrit sshd options to control connections https://review.openstack.org/262820 | 14:35 |
SotK | I want to set up the email plugin in storyboard.openstack.org, is there an smtp server somewhere I can configure it to use? | 14:35 |
mordred | morning all | 14:36 |
anteaya | SamYaple: https://review.openstack.org/#/admin/groups/306,members | 14:36 |
anteaya | mordred: morning | 14:36 |
mordred | SotK: we run email servers on each server as needed | 14:36 |
mordred | SotK: so 'localhost' will be your best bet | 14:36 |
SamYaple | anteaya: awesome! monty is on that list ;) | 14:36 |
anteaya | odyssey4me: thank you, I or someone else will look when we get a chance | 14:36 |
mordred | anteaya, SamYaple what do I nede to do? | 14:36 |
anteaya | SamYaple: indeed | 14:36 |
pabelanger | any diskimage-builder-core care to review: https://review.openstack.org/#/c/262050 Fixes centos7 DIBs because of a changed mirror | 14:36 |
SamYaple | mordred: 13:54:05 < SamYaple> can someone add me to the ekko-core and ekko-release group? it is a new project I submitted that was recently merged. https://review.openstack.org/#/admin/groups/1236,members https://review.openstack.org/#/admin/groups/1237,members https://review.openstack.org/#/c/262614/ | 14:37 |
mordred | SamYaple: searching for "sam yaple" in gerrit does not find you - who are you? | 14:38 |
*** erikwilson has joined #openstack-infra | 14:38 | |
mordred | (in gerrit) | 14:38 |
*** erikwilson has quit IRC | 14:38 | |
SamYaple | samyaple | 14:38 |
*** mriedem has joined #openstack-infra | 14:38 | |
*** kzaitsev_mb has joined #openstack-infra | 14:38 | |
SamYaple | or if caps matter, i think im SamYaple | 14:38 |
*** erikwilson has joined #openstack-infra | 14:38 | |
SotK | mordred: Thanks. Is there something I need to add to the puppet manifest to enable that? | 14:38 |
*** zeih has quit IRC | 14:39 | |
mordred | wow. they do matter | 14:39 |
mordred | SamYaple: done | 14:39 |
kragniz | mordred: while you're on the gerrit groups, could you add me as the initial member of release-schedule-generator-core and release-schedule-generator-release? | 14:39 |
mordred | SotK: one sec - looking | 14:39 |
SamYaple | mordred: thanks! and thankns for that link anteaya, i was unware of how that worked | 14:39 |
mordred | SotK: make sure manage_exim => true, | 14:40 |
fungi | odyssey4me: probably the resize on boot needs to get fired properly in glean? mordred may have more details on what's missing | 14:40 |
*** jlvacation is now known as jlvillal | 14:40 | |
SotK | mordred: Will do, thanks. | 14:40 |
*** _nadya_ has quit IRC | 14:40 | |
mordred | SotK: is in your openstack_project::template invocation | 14:41 |
*** eharney has joined #openstack-infra | 14:41 | |
zaro | mordred: you might be interested in this, was wondering if you would like to add your opinion? https://review.openstack.org/#/c/260284/ | 14:41 |
mordred | fungi: it used to resize on boot | 14:41 |
greghaynes | openstackgerrit: mordred fungi There is an element in DIB which resizes rootfs, we might not be using it | 14:41 |
greghaynes | oh, actually, I fixed a bug with it | 14:41 |
greghaynes | one sed | 14:41 |
fungi | zaro: i agree with jhesketh that a thread on the -dev ml makes the most sense for coming up with some idea of whether our development community is on the whole in favor, against or indifferent to 260284 | 14:42 |
anteaya | SamYaple: welcome | 14:42 |
odyssey4me | greghaynes fungi mordred yep, it worked before the holidays :p | 14:42 |
fungi | SotK: the storyboard server's smtp service should work just fine? a.k.a. 127.0.0.1:25 or ::25 | 14:42 |
*** zeih has joined #openstack-infra | 14:43 | |
greghaynes | odyssey4me: mordred fungi https://review.openstack.org/#/c/259748/ | 14:43 |
greghaynes | DIB might need a release | 14:43 |
fungi | thanks for tracking that down, greghaynes! | 14:43 |
greghaynes | which I was planning on doing today anyways | 14:43 |
greghaynes | fungi: np | 14:43 |
fungi | and now i need to check out of this hotel and disappear for most of the day | 14:44 |
fungi | catch you all tonight/tomorrow | 14:44 |
*** irenab has joined #openstack-infra | 14:44 | |
*** fhubik is now known as fhubik_brb | 14:44 | |
fungi | keep in mind that paste.o.o is using trove again now, so if it becomes completely unusable for some unforseen reason, that might be why | 14:44 |
fungi | but so far it's looking stable | 14:44 |
pabelanger | fungi: mind helping: https://review.openstack.org/#/c/250315/7 land for zuul? | 14:44 |
anteaya | fungi: enjoy your day | 14:45 |
mordred | fungi: oh wow. I missed something completely | 14:45 |
anteaya | yay stable paste | 14:45 |
mordred | fungi: did we stop using trove for it for a sec? | 14:45 |
pabelanger | fungi: nevermind :) | 14:45 |
fungi | pabelanger: maybe tomorrow? | 14:45 |
anteaya | yes the trove instance was disconnecting for some reason about 6 months ago? | 14:45 |
pabelanger | fungi: will find another soul! Enjoy your travels | 14:45 |
anteaya | can recall the reason or the fix | 14:46 |
fungi | mordred: yeah, for something like a year. that was back before we discovered that rackspace set the connection timeout way short but that we could adjust it in configuration | 14:46 |
anteaya | can't | 14:46 |
anteaya | ah yes, that was why | 14:46 |
mordred | nod | 14:46 |
greghaynes | odyssey4me: Is that actively breaking things? once I cut a DIB release we are going to need to wait until new images go out (24h) before we find out if it actually is the issue... | 14:46 |
fungi | so we fixed it on review-dev but never got around to moving paste back to trove | 14:46 |
fungi | until last night | 14:46 |
pabelanger | odyssey4me: keep in mind, there was some changes to the ansible templates in zuul. So, this might be a side affect | 14:46 |
fungi | anyway, /me -> out | 14:47 |
pabelanger | odyssey4me: mind you, I haven't dived into this issue | 14:47 |
*** nelsnelson has joined #openstack-infra | 14:47 | |
zaro | fungi: thanks | 14:47 |
odyssey4me | greghaynes it's a non voting gate check for us, so not crucial - just a canary :) | 14:47 |
*** _nadya_ has joined #openstack-infra | 14:47 | |
*** zeih has quit IRC | 14:47 | |
greghaynes | odyssey4me: ok, awesome | 14:47 |
openstackgerrit | Alexandre Viau proposed openstack-dev/pbr: dont include submodules in _find_git_files https://review.openstack.org/263297 | 14:53 |
*** asselin_ has joined #openstack-infra | 14:54 | |
*** mtanino has joined #openstack-infra | 14:55 | |
*** ihrachys_ is now known as ihrachys | 14:55 | |
*** sdake_ has joined #openstack-infra | 14:55 | |
openstackgerrit | Alexandre Viau proposed openstack-dev/pbr: dont include submodules in _find_git_files https://review.openstack.org/263297 | 14:57 |
*** sdake has quit IRC | 14:58 | |
*** sdake has joined #openstack-infra | 15:00 | |
*** rbrndt_ has joined #openstack-infra | 15:00 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 15:01 | |
*** kgiusti has joined #openstack-infra | 15:02 | |
*** sdake_ has quit IRC | 15:03 | |
*** jsavak has joined #openstack-infra | 15:05 | |
*** amitgandhinz has joined #openstack-infra | 15:07 | |
*** jaosorior has joined #openstack-infra | 15:07 | |
*** jaosorior has quit IRC | 15:08 | |
*** zeih has joined #openstack-infra | 15:10 | |
*** Daisy has joined #openstack-infra | 15:10 | |
*** davideagnello has joined #openstack-infra | 15:10 | |
openstackgerrit | Alexandre Viau proposed openstack-dev/pbr: include submodules in _find_git_files https://review.openstack.org/263297 | 15:11 |
*** kzaitsev_mb has quit IRC | 15:12 | |
*** zz_dimtruck is now known as dimtruck | 15:12 | |
*** regXboi has joined #openstack-infra | 15:12 | |
kragniz | anyone in infra-core around to add me to a newly created group? | 15:13 |
anteaya | kragniz: best to drag your url that created the group or repo with you when you ask | 15:13 |
anteaya | increases your rate of return on your asking | 15:13 |
*** tsg has joined #openstack-infra | 15:13 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Bump APScheduler to >=3.0 https://review.openstack.org/262017 | 15:13 |
kragniz | anteaya: thanks | 15:14 |
anteaya | kragniz: welcome | 15:14 |
kragniz | here's the review: https://review.openstack.org/#/c/261135/ | 15:14 |
*** zeih has quit IRC | 15:14 | |
*** fhubik_brb is now known as fhubik | 15:15 | |
*** Daisy has quit IRC | 15:15 | |
*** fhubik is now known as fhubik_brb | 15:15 | |
*** davideagnello has quit IRC | 15:15 | |
openstackgerrit | Alexandre Viau proposed openstack-dev/pbr: include submodules in _find_git_files https://review.openstack.org/263297 | 15:16 |
*** aorourke has joined #openstack-infra | 15:17 | |
*** thiagop is now known as thiagop-lunch | 15:17 | |
*** fhubik_brb is now known as fhubik | 15:18 | |
*** qadaemon has quit IRC | 15:18 | |
*** pradk_ has joined #openstack-infra | 15:19 | |
*** pradk_ has quit IRC | 15:19 | |
*** pradk has quit IRC | 15:19 | |
anteaya | odyssey4me: did you get anywhere on your skip if regex? | 15:20 |
*** markvan has quit IRC | 15:20 | |
*** masber has joined #openstack-infra | 15:20 | |
odyssey4me | anteaya nope, it seems plausible that one of my consequent checks may have broken things... but I need a better educated mind to validate that suspicion | 15:21 |
*** pradk has joined #openstack-infra | 15:22 | |
*** markvan has joined #openstack-infra | 15:22 | |
*** AJaeger has joined #openstack-infra | 15:22 | |
*** sdake_ has joined #openstack-infra | 15:22 | |
AJaeger | Happy New Year, everybody! | 15:22 |
anteaya | which consequent checks? | 15:22 |
odyssey4me | s/consequent checks/subsequent jobs/ | 15:22 |
anteaya | AJaeger: Happy New Year | 15:23 |
odyssey4me | HNY AJaeger ! | 15:23 |
anteaya | odyssey4me: can you link me or name them? | 15:23 |
*** ajmiller has joined #openstack-infra | 15:23 | |
odyssey4me | anteaya https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L2007 was added in Nov, and it seems that the break may have happened at around that time | 15:23 |
*** davideagnello has joined #openstack-infra | 15:24 | |
pabelanger | AJaeger: o/ | 15:24 |
AJaeger | odyssey4me: can you give me an example run where this did not work? | 15:24 |
*** sdake has quit IRC | 15:25 | |
SamYaple | odyssey4me: it seems like between those two regex you could have no jobs and im not sure how that owuld be handled | 15:25 |
anteaya | odyssey4me: is http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n2006 your only skip-if clause? | 15:26 |
SamYaple | odyssey4me: for instance if you updated only https://github.com/openstack/openstack-ansible/blob/master/releasenotes/source/unreleased.rst | 15:26 |
*** piet has joined #openstack-infra | 15:26 | |
anteaya | SamYaple: if the skip-ifs manage to remove all jobs from a patch, the patch won't be tested and can't merge | 15:26 |
*** weshay_xchat has quit IRC | 15:26 | |
AJaeger | odyssey4me: here's what zuul has in its config: http://paste.openstack.org/show/482946/ | 15:27 |
anteaya | SamYaple: we managed to learn this when skipping some project-config jobs | 15:27 |
odyssey4me | AJaeger https://review.openstack.org/262370 :) | 15:27 |
SamYaple | hah ok anteaya | 15:27 |
AJaeger | odyssey4me: that's a change that only changes documentation - how does that related to releasnotes? | 15:27 |
anteaya | SamYaple: learn by doing :) | 15:27 |
*** erikmwilson_ has joined #openstack-infra | 15:28 | |
AJaeger | odyssey4me: so L2007 should not trigger at all. | 15:28 |
anteaya | AJaeger: where did you find what zuul has in its config? | 15:28 |
odyssey4me | AJaeger that job is not skipping all jobs except the docs job, and it started failing after adding the release notes skip | 15:28 |
AJaeger | anteaya: click on the layout check link for any recent job | 15:28 |
odyssey4me | SamYaple you have found a nice little problem there :) to date that has not been an issue though as that file is static... but I'll remember that in the future | 15:29 |
AJaeger | odyssey4me: I think I get what you mean... | 15:29 |
*** fhubik is now known as fhubik_brb | 15:29 | |
*** erikwilson has quit IRC | 15:29 | |
AJaeger | odyssey4me: you mean lines 1998 is ignored? | 15:29 |
anteaya | AJaeger: thanks | 15:29 |
odyssey4me | AJaeger yep | 15:30 |
*** fhubik_brb is now known as fhubik | 15:30 | |
odyssey4me | instead of only running the docs job, it's running all jobs | 15:30 |
AJaeger | odyssey4me: full spec: http://paste.openstack.org/show/482947/ | 15:30 |
*** mdenny has joined #openstack-infra | 15:30 | |
AJaeger | So, what happens is that oyu have two regexes that apply and the last is taken, let's look at gate-openstack-ansible-lint | 15:30 |
AJaeger | only the releasenotes regex is used for that. | 15:31 |
odyssey4me | ah, I see | 15:31 |
AJaeger | odyssey4me: so, you need to rewrite those | 15:31 |
AJaeger | and theny click on the layout link and check how the conditions are applied, see my paste... | 15:32 |
*** egonzalez has quit IRC | 15:32 | |
*** _nadya_ has quit IRC | 15:32 | |
AJaeger | odyssey4me: hope that gets you going | 15:32 |
anteaya | AJaeger: thanks for walking me through that | 15:32 |
* AJaeger has to play with the kids for a bit... | 15:32 | |
odyssey4me | so we need a match that only ever gets a single result | 15:32 |
anteaya | stared at that many times, now it makes sense | 15:32 |
anteaya | AJaeger: enjoy | 15:32 |
AJaeger | thanks, anteaya | 15:33 |
anteaya | odyssey4me: or gets results you want for that file | 15:33 |
openstackgerrit | Adam Coldrick proposed openstack-infra/puppet-storyboard: Add config template for the email plugin https://review.openstack.org/263304 | 15:33 |
*** odlD2 has quit IRC | 15:33 | |
SamYaple | so to be clear if a job matches two of the name regex, the job gets the last match AJaeger? | 15:33 |
AJaeger | SamYaple: yes | 15:34 |
SamYaple | ok ill have t oremember that | 15:34 |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: TEST: this is supposed to trigger a major upgrade https://review.openstack.org/260466 | 15:34 |
AJaeger | Always check the layout link and see what it does;) | 15:34 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Uncap pyzmq requirements https://review.openstack.org/262019 | 15:34 |
anteaya | odyssey4me: as an example: http://logs.openstack.org/81/262981/4/check/gate-project-config-layout/812636e/console.html#_2016-01-04_11_42_53_122 | 15:35 |
SamYaple | so odyssey4me i guess you wont run into that bug i just said you might | 15:35 |
anteaya | I have to get ready to go run errands, as I said earlier I'm out of milk in the house, not sure when I will be back | 15:36 |
*** mgrosz has quit IRC | 15:36 | |
*** fhubik is now known as fhubik_brb | 15:37 | |
*** sdake has joined #openstack-infra | 15:38 | |
odyssey4me | oh dear, my brain just exploded :p | 15:38 |
*** jpr has joined #openstack-infra | 15:38 | |
*** _amrith_ is now known as amrith | 15:38 | |
*** sdake_ has quit IRC | 15:39 | |
*** fhubik_brb is now known as fhubik | 15:40 | |
*** weshay_xchat has joined #openstack-infra | 15:40 | |
*** FallenPegasus has joined #openstack-infra | 15:40 | |
*** tonytan4ever has joined #openstack-infra | 15:41 | |
asselin_ | does anyone know how gerrit is configured to disable e-mails for 3rd party ci? https://review.openstack.org/#/admin/groups/270,info | 15:41 |
SamYaple | odyssey4me: you could just do - name: ^gate-openstack-ansible-(?!(releasenotes|docs)).*$ | 15:43 |
SamYaple | on the release jobs | 15:43 |
anteaya | asselin_: zaro likely does | 15:44 |
*** Sukhdev has joined #openstack-infra | 15:44 | |
*** FallenPegasus has quit IRC | 15:45 | |
*** doug-fish has quit IRC | 15:45 | |
*** aspiers has quit IRC | 15:45 | |
*** qadaemon has joined #openstack-infra | 15:46 | |
odyssey4me | SamYaple so the goal is to only have the docs job run when only docs are edited, but only release notes run when release notes are edited | 15:46 |
SamYaple | odyssey4me: i meant keep the docs just, just modify that line above ^ | 15:46 |
*** mtreinish has quit IRC | 15:46 | |
SamYaple | that gets you what you want, mostly. cept the docs just would still run... | 15:47 |
*** odlD2 has joined #openstack-infra | 15:47 | |
*** kashyap has joined #openstack-infra | 15:47 | |
SamYaple | i say you redefine the goal to include wanting the docs job to run with the release notes | 15:47 |
*** mtreinish has joined #openstack-infra | 15:48 | |
odyssey4me | yeah, I get what you mean - I could simply consolidate the two skips and whether docs or release notes are edited, both jobs run | 15:48 |
odyssey4me | that would also solve the issue you raised | 15:48 |
anteaya | asselin_: this is the only thing I found so far: https://review.openstack.org/Documentation/access-control.html#capability_emailReviewers | 15:48 |
odyssey4me | but it is a little bit of a waste of nodes, and I was trying to be nice to -infra :) | 15:49 |
anteaya | odyssey4me: we appreciciate it | 15:49 |
anteaya | but get your jobs testing what you want to be tested first | 15:49 |
SamYaple | that works too. just updating the second job would mean that you are only ever wasting one machine when you do a releasenotes (and thats assuming the docs job isnt useful to the release notes) | 15:49 |
asselin_ | anteaya, thanks will look into that | 15:49 |
SamYaple | as oppose to combining them and wasting releasenotes everytime you update docs | 15:50 |
*** annegentle has joined #openstack-infra | 15:50 | |
anteaya | asselin_: didn't really evaluate to see if it was useful to you, it may not be | 15:50 |
SamYaple | though i dont know how frequent you do either of those | 15:50 |
anteaya | have to run now, see y'all later | 15:50 |
*** ari has joined #openstack-infra | 15:50 | |
odyssey4me | SamYaple sure, but I think if the releasenotes/*.rst files are updated then the releasenotes wouldn't build | 15:50 |
SamYaple | no no we already rules that out | 15:51 |
odyssey4me | so I think it's best to combine them - it covers all scenario's... even if it is a little more wasteful | 15:51 |
SamYaple | since it would be overriden with the release notes task | 15:51 |
SamYaple | it will run | 15:51 |
*** doug-fish has joined #openstack-infra | 15:51 | |
odyssey4me | ah yes, of course | 15:51 |
*** erikmwilson_ has quit IRC | 15:53 | |
odyssey4me | SamYaple I wonder if the mat can include a negative match - because I could also deliberately exclude ^releasenotes/.* from the docs skip to be more explicit | 15:54 |
SamYaple | i mean odyssey4me docs is only going to run if you modify the release notes rst (or other matches) | 15:56 |
*** doug-fish has quit IRC | 15:56 | |
SamYaple | so you could just do a !releasenotes on the docs job | 15:56 |
AJaeger | odyssey4me: I'll have an idea, need to check this, should have a patch for you later today... But let's work indpedent on this and see what works better ;) | 15:56 |
odyssey4me | what's getting me is where the clash is actually happening... is it due to the match on the project name? | 15:57 |
SamYaple | odyssey4me: my understanding is yes | 15:57 |
*** tsg has quit IRC | 15:57 | |
*** tsg_ has joined #openstack-infra | 15:57 | |
odyssey4me | another option here is that the project match can be removed, as the gate name is enough... and this would also mean that the skip would probably work for other roles too | 15:57 |
SamYaple | odyssey4me: that _should_ get you what you want http://paste.openstack.org/show/482952/ | 15:58 |
*** rbrndt_ has quit IRC | 15:58 | |
SamYaple | not sure that change on the docs job is a valid regex though. but you get the idea | 15:58 |
*** corvus is now known as jeblair | 15:58 | |
odyssey4me | AJaeger thanks :) I'll put in a patch shortly, but am curious about your other idea | 15:59 |
odyssey4me | ultimately I'd even like us to skip the releasenotes/docs jobs if there are no docs/releasenotes changes in the patch | 15:59 |
odyssey4me | but yeah, perhaps I'm just making my own life too complicated | 15:59 |
AJaeger | let's optimize the common case... | 16:00 |
odyssey4me | in fact, wouldn't it make sense to do that across the board - only run the docs/release notes jobs when there are pertinent changes in the repo at hand? | 16:01 |
AJaeger | odyssey4me: we do that already | 16:02 |
AJaeger | for releasenotes... | 16:02 |
*** jsavak has quit IRC | 16:02 | |
*** qadaemon has quit IRC | 16:02 | |
openstackgerrit | Graham Hayes proposed openstack/requirements: Add kosmos to projects.txt https://review.openstack.org/263318 | 16:02 |
odyssey4me | AJaeger ah yes, we're troublesome due to our not using the stable/* branch names :) | 16:02 |
AJaeger | see line 2069 | 16:03 |
*** harlowja_at_home has joined #openstack-infra | 16:04 | |
*** jsavak has joined #openstack-infra | 16:04 | |
odyssey4me | AJaeger ah yes, I remember that - so does that not make http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n2007 redundant then? | 16:05 |
AJaeger | odyssey4me: I need a bit of time to understand this mess ;) | 16:05 |
AJaeger | on it now... | 16:05 |
*** devananda has quit IRC | 16:07 | |
odyssey4me | AJaeger if we can optimise the use of the docs job in a better way, or all project can in a similar way to the release notes, then I'm totally open to the change :) | 16:07 |
AJaeger | odyssey4me: we cannot, since projects might document python code via autodocs... | 16:08 |
*** bastelfreak is now known as foxxx0 | 16:08 | |
odyssey4me | AJaeger ah, good call | 16:08 |
*** gongysh has quit IRC | 16:08 | |
*** kzaitsev_mb has joined #openstack-infra | 16:08 | |
*** bhunter71 has joined #openstack-infra | 16:09 | |
odyssey4me | AJaeger thanks for looking into this, my brain appears to be as badly addled as my liver :p | 16:09 |
*** hdd has joined #openstack-infra | 16:09 | |
*** otter768 has joined #openstack-infra | 16:09 | |
*** foxxx0 is now known as bastelfreak | 16:09 | |
*** austin81 has joined #openstack-infra | 16:10 | |
*** kmartin has joined #openstack-infra | 16:13 | |
*** kzaitsev_mb has quit IRC | 16:13 | |
*** otter768 has quit IRC | 16:13 | |
*** ningy has joined #openstack-infra | 16:14 | |
*** devananda has joined #openstack-infra | 16:15 | |
ningy | @here could someone help me to take a look at this patch https://review.openstack.org/#/c/262381 ? it's blocking rally monasca test jenkins job | 16:15 |
pedroalvarez | It looks like zuul post queue is not moving | 16:17 |
AJaeger | ningy: that's a change for requirements - please state so and ping the requirements cores | 16:17 |
AJaeger | pedroalvarez: post queue has lower priority | 16:17 |
pedroalvarez | aha, good to know :) | 16:18 |
rajinir | Is there an easy way to search the IRC logs? | 16:18 |
clarkb | rajinir I use google | 16:18 |
*** odlD2 has quit IRC | 16:19 | |
mordred | rajinir: site:eavesdrop.openstack.org ^^ that | 16:19 |
ningy | k. thanks | 16:19 |
rajinir | site search, that's great. Many thanks mordred and clarkb | 16:20 |
*** erikwilson has joined #openstack-infra | 16:21 | |
*** treaki_ has joined #openstack-infra | 16:23 | |
ningy | @Ajaeger, is there a channel for requirements? and do u know who are the requirements cores? | 16:24 |
*** fhubik is now known as fhubik_brb | 16:25 | |
AJaeger | ningy: there's no channel - and you can check yourself, go to your review, click on project-settings icon right to the project line, click on Access and then on the core group | 16:25 |
*** fhubik_brb is now known as fhubik | 16:27 | |
*** harlowja_at_home has quit IRC | 16:29 | |
AJaeger | odyssey4me: and then you even have ^gate-openstack-ansible.*-pep8$ ;( What fun... | 16:29 |
*** odlD2 has joined #openstack-infra | 16:30 | |
*** erikwilson has quit IRC | 16:31 | |
openstackgerrit | Swann Croiset proposed openstack-infra/project-config: Set DocImpact group for LMA projects https://review.openstack.org/263334 | 16:32 |
*** thiagop-lunch is now known as thiagop | 16:32 | |
odyssey4me | AJaeger yeah, unfortunately we still have a (barely) active juno branch | 16:33 |
*** fhubik has quit IRC | 16:34 | |
*** jsavak has quit IRC | 16:34 | |
*** jsavak has joined #openstack-infra | 16:35 | |
openstackgerrit | Vladyslav Drok proposed openstack-infra/project-config: Add python-ironicclient to PROJECTS https://review.openstack.org/263335 | 16:36 |
pleia2 | good morning | 16:37 |
AJaeger | happy new year and good morning, pleia2 | 16:38 |
pleia2 | AJaeger: thanks! happy new year to you too :) | 16:39 |
AJaeger | thanks, pleia2 | 16:39 |
*** lindsayk has quit IRC | 16:39 | |
*** ashleighfarnham has joined #openstack-infra | 16:39 | |
*** lindsayk has joined #openstack-infra | 16:40 | |
*** FallenPegasus has joined #openstack-infra | 16:41 | |
*** hdd has quit IRC | 16:44 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add an "Unlimited" option to the paging controls https://review.openstack.org/235993 | 16:45 |
*** jsavak has quit IRC | 16:45 | |
*** jsavak has joined #openstack-infra | 16:46 | |
*** FallenPegasus has quit IRC | 16:46 | |
*** ifarkas has quit IRC | 16:47 | |
openstackgerrit | Swann Croiset proposed openstack-infra/project-config: Set DocImpact group for LMA projects https://review.openstack.org/263334 | 16:47 |
*** unicell1 has quit IRC | 16:47 | |
*** unicell has joined #openstack-infra | 16:47 | |
*** Qiming has quit IRC | 16:48 | |
clarkb | elasticsearch died on es06 sometime after december 31st. VM has been up 55 days and no OOM killer or ext4 timeouts are logged | 16:48 |
clarkb | so not sure why it died | 16:48 |
*** e0ne has quit IRC | 16:48 | |
*** sridhar_ram has joined #openstack-infra | 16:49 | |
clarkb | I have started it back up again | 16:49 |
clarkb | and logstash-worker20 tripped the OOMkiller again so its definitely a lot more memory hungry than the old version of logstash :( | 16:49 |
*** AJaeger has quit IRC | 16:50 | |
pleia2 | :\ | 16:50 |
greghaynes | odyssey4me: Just release new DIB | 16:50 |
greghaynes | so tomorrow images should be resizing | 16:51 |
*** hashar has quit IRC | 16:51 | |
*** jsavak has quit IRC | 16:51 | |
*** flepied has quit IRC | 16:52 | |
*** unicell has quit IRC | 16:52 | |
*** flepied has joined #openstack-infra | 16:52 | |
*** rfolco_ has joined #openstack-infra | 16:53 | |
openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Skip openstack-ansible-docs gate/post jobs for juno branch https://review.openstack.org/263341 | 16:53 |
odyssey4me | greghaynes thanks - will recheck some jobs late tomorrow to confirm | 16:53 |
*** rfolco has quit IRC | 16:54 | |
*** piet has quit IRC | 16:56 | |
*** rbrndt_ has joined #openstack-infra | 16:58 | |
*** ihrachys has quit IRC | 16:59 | |
*** sputnik13_ has joined #openstack-infra | 16:59 | |
*** sputnik13_ has quit IRC | 16:59 | |
*** jsavak has joined #openstack-infra | 16:59 | |
*** nihilifer has quit IRC | 17:00 | |
clarkb | mordred: can we bump the bluebox max node count up for testing again or is it stillgetting cpus replaced? | 17:00 |
*** kashyap has left #openstack-infra | 17:01 | |
mordred | clarkb: yes! | 17:01 |
mordred | clarkb: the cpus have been replaced | 17:01 |
mordred | clarkb: it is now a great time to bump it again | 17:01 |
mordred | unless we want to do any testing to see if we should change the flavor definition | 17:01 |
mordred | but I suppose just bumping it and then looking at the run times will be a good start | 17:01 |
clarkb | ya thats probably the easiest way to do it | 17:02 |
mtreinish | clarkb, mordred: have you seen the group_by node provider on: http://status.openstack.org/openstack-health/#/ | 17:04 |
*** jlanoux has quit IRC | 17:04 | |
mtreinish | I still need to add a run time graph to the second page, so we can see per node_provider run times though | 17:04 |
clarkb | mtreinish: I haven't | 17:04 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder https://review.openstack.org/263349 | 17:04 |
*** nihilifer has joined #openstack-infra | 17:04 | |
*** sfinucan has quit IRC | 17:05 | |
openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Revert "Turn bluebox servers off in nodepool." https://review.openstack.org/263350 | 17:05 |
mtreinish | clarkb: its a good visualization of how much more things are failing on ovh and bluebox | 17:05 |
clarkb | mordred: anteaya ^ that change sets us back to using a single test node for now | 17:05 |
clarkb | well shouldn;t be failing at all on bluebox because no test nodes | 17:05 |
*** piet has joined #openstack-infra | 17:06 | |
mtreinish | clarkb: it goes back like 20 days | 17:06 |
clarkb | ah | 17:06 |
*** matrohon has quit IRC | 17:06 | |
clarkb | and the lack of swap should account for some of the failures on ovh | 17:06 |
*** tlian has joined #openstack-infra | 17:07 | |
*** armax has joined #openstack-infra | 17:07 | |
mtreinish | wasn't that an issue on only one class of job where things were more ram starved? | 17:07 |
clarkb | mtreinish: that we know of, I wouldn't be surprised if we are memory starved elsewhere since we apparently lean on swap way more than we should | 17:08 |
mtreinish | :/ hmm, ok. I wouldn't be too surprised by that I guess. We've had issues in the past with ram consumption | 17:09 |
*** kzaitsev_mb has joined #openstack-infra | 17:09 | |
openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-openstackci: Initial sphynx doc setup for publishing https://review.openstack.org/259245 | 17:09 |
*** markus_z has quit IRC | 17:09 | |
*** kzaitsev_mb has quit IRC | 17:14 | |
*** gyee has joined #openstack-infra | 17:14 | |
openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder: Updated to support changes to openshift pipeline plugin https://review.openstack.org/263354 | 17:16 |
clarkb | crinkle: did we ever send an email about wiki downtime? | 17:16 |
jeblair | mtreinish, clarkb: it's worth noting that since we have not completed the transition to dib, some providers don't run all types of jobs | 17:16 |
* clarkb wonders if he is on the clock this morning for that | 17:16 | |
*** tjones has joined #openstack-infra | 17:17 | |
clarkb | jeblair: yup, though I think generally the health dashboard is still only looking at the jobs that can and do run on dib/snapshots | 17:17 |
jeblair | kk | 17:17 |
*** nihilifer has quit IRC | 17:17 | |
*** samuelBartel has quit IRC | 17:18 | |
*** nihilifer has joined #openstack-infra | 17:18 | |
*** Swami has joined #openstack-infra | 17:18 | |
mtreinish | it's still only tempest and grenade jobs | 17:18 |
mtreinish | we can expand it to everything pretty easily though | 17:19 |
*** sabeen has joined #openstack-infra | 17:22 | |
*** sdake_ has joined #openstack-infra | 17:23 | |
*** jistr has quit IRC | 17:23 | |
zaro | morning | 17:23 |
*** abregman has quit IRC | 17:24 | |
crinkle | clarkb: no, i can write that up and send it out today | 17:24 |
*** sdake has quit IRC | 17:25 | |
crinkle | clarkb: i wasn't sure if paste was going down at the same time or not | 17:25 |
clarkb | crinkle: oh right. Do you still want to do it today? I have to pop out at 1pmish assuming ice goes away | 17:25 |
clarkb | mtreinish: https://jenkins05.openstack.org/job/gate-neutron-dsvm-api/2542/consoleFull is random ovh fail I noticed in gate just now. But I have a hard time understanding how that could be an ovh problem or memory problem. So thats an odd one | 17:25 |
openstackgerrit | Philip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 17:25 |
*** annegentle has quit IRC | 17:26 | |
*** bharathm has joined #openstack-infra | 17:26 | |
*** annegentle has joined #openstack-infra | 17:27 | |
*** piet has quit IRC | 17:27 | |
*** kzaitsev_mb has joined #openstack-infra | 17:27 | |
*** piet has joined #openstack-infra | 17:27 | |
*** sabeen3 has joined #openstack-infra | 17:27 | |
crinkle | clarkb: oops i thought we were doing it tomorrow even though i wrote down today | 17:27 |
mtreinish | clarkb: actually I know what caused that | 17:28 |
crinkle | clarkb: let's do tomorrow after the meeting? | 17:28 |
clarkb | crinkle: tomorrow should be fine too | 17:28 |
mtreinish | clarkb: https://github.com/openstack-dev/devstack/commit/0d81785bbe1228e477e395595d37bef9775f1cab | 17:28 |
clarkb | crinkle: +1 | 17:28 |
clarkb | mtreinish: so is that going to fail neutron across the board? | 17:29 |
mtreinish | yep | 17:29 |
*** sabeen has quit IRC | 17:29 | |
mtreinish | those neutron api jobs were using a deprecated option, which is on the block for removal soon | 17:29 |
mtreinish | we preemptively stopped configuring them in devstack | 17:29 |
*** yaume has quit IRC | 17:30 | |
clarkb | armax: amuller mestery ^ FYI the neutron dsvm api test is probably going to fail a lot until that is addressed | 17:31 |
* amuller looking | 17:31 | |
*** cinerama` is now known as cinerama | 17:31 | |
pabelanger | jeblair: clarkb: do you mind helping land: https://review.openstack.org/#/c/250315/7 for zuul? | 17:31 |
*** dtantsur is now known as dtantsur|afk | 17:32 | |
clarkb | thats an interesting design choice | 17:33 |
clarkb | pabelanger: has a bug been filed upstream? | 17:34 |
amuller | clarkb: thanks for letting us know | 17:34 |
openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Merge openstack-ansible skip-if to resolve conflict https://review.openstack.org/263360 | 17:34 |
timrc | yolanda: *bats eyelashes* https://review.openstack.org/#/c/252094/ | 17:34 |
hrubi | Hi, I've reached point in zuul https://review.openstack.org/247500 where the job gate-zuul-python27 complains that the testrepository output is bigger than 50MB. How should I proceed? Revise (new) tests if they can be merged together, so they take less time during setup and produce less output? Or trying to cut down the overall output of all tests, eg. by lowering the log level? | 17:35 |
clarkb | hrubi: I would decrease the log level | 17:35 |
hrubi | ok, thanks | 17:35 |
clarkb | hrubi: that much verbosity isn't helpful during nomal test runs | 17:35 |
clarkb | you can always increase it o nspecific runs if you have trouble with a particular test | 17:36 |
hrubi | right | 17:36 |
pabelanger | clarkb: IIRC, no. I guess they should have done a 3.x.x release or default to false not to break existing installs | 17:36 |
clarkb | pabelanger: or not use a thing that requires root privs | 17:36 |
clarkb | imo thats a bug in the lib | 17:36 |
pabelanger | Ya, guess it all comes down to how you launch the application. | 17:37 |
clarkb | (daemons don't need root) | 17:37 |
pabelanger | agreed | 17:37 |
*** AJaeger has joined #openstack-infra | 17:37 | |
clarkb | +2'd but not approving to give jeblair a chance to look | 17:39 |
clarkb | (can approve later if that doesn't ahppen) | 17:39 |
*** jordanP has quit IRC | 17:39 | |
*** aopincar has joined #openstack-infra | 17:39 | |
pabelanger | clarkb: thanks. Also note, we'd used the code a few times already for nodepool and elasticsearch (I think?) | 17:40 |
*** jsavak has quit IRC | 17:41 | |
*** masuberu has joined #openstack-infra | 17:43 | |
jeblair | approved, though it's on a bit of a stack | 17:44 |
asselin_ | clarkb, how did you setup permissions for this: https://review.openstack.org/#/admin/groups/270,info ? I couldn't find it in project-config | 17:44 |
AJaeger | odyssey4me: your change 263360 is probably the best option - I came up with the same. Restricting docs jobs as well is not worth it... | 17:44 |
clarkb | asselin_: its in all-projects | 17:45 |
*** masber has quit IRC | 17:45 | |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks https://review.openstack.org/163117 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent https://review.openstack.org/238948 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter https://review.openstack.org/243250 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose https://review.openstack.org/247487 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug. https://review.openstack.org/192457 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: support github pull reqeust labels https://review.openstack.org/247421 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github https://review.openstack.org/247500 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub https://review.openstack.org/239138 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs https://review.openstack.org/258448 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow using webapp from connections https://review.openstack.org/215642 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow list values in template parameters. https://review.openstack.org/191208 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for github commit status https://review.openstack.org/239303 | 17:47 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Lower the log level in tests https://review.openstack.org/263364 | 17:47 |
*** yolanda has quit IRC | 17:48 | |
*** flepied has quit IRC | 17:48 | |
*** kevinbenton has joined #openstack-infra | 17:49 | |
odyssey4me | AJaeger so https://review.openstack.org/263360 is good then, and you think that https://review.openstack.org/263341 isn't worth it? | 17:52 |
asselin_ | clarkb, ok found it. I seem to have the ability to edit those permissions, but I probably shouldn't: https://review.openstack.org/#/admin/projects/All-Projects,access | 17:52 |
asselin_ | shouldn't have the ability* | 17:53 |
clarkb | asselin_: I don't think you actually do, you can submit a change to propose the edits which will be ignored | 17:53 |
clarkb | though maybe thats a decent way to do it for all projects (we don't currently do it that way) | 17:53 |
*** yolanda has joined #openstack-infra | 17:54 | |
*** ajmiller has quit IRC | 17:55 | |
*** vilobhmm11 has joined #openstack-infra | 17:55 | |
clarkb | asselin_: if you lcick edit do you get a save changes button or just a save for review button? | 17:55 |
asselin_ | clarkb, https://review.openstack.org/#/c/263371/ | 17:56 |
armax | clarkb, amuller, mtreinish: I think we already see breakages in the gate | 17:56 |
*** sdake_ is now known as sdake | 17:56 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 17:57 |
AJaeger | odyssey4me: I think you need both, don't you? | 17:57 |
odyssey4me | AJaeger I do think it makes sense to have both | 17:58 |
openstackgerrit | Merged openstack-infra/project-config: Revert "Turn bluebox servers off in nodepool." https://review.openstack.org/263350 | 17:58 |
odyssey4me | we have the scaffolding for docs jobs in place in the juno branch, but running them is a waste as they build no real content | 17:58 |
asselin_ | clarkb, so yes, save for review. | 17:58 |
AJaeger | odyssey4me: i suggest to base one change on the other so that we can review how they work together. | 17:59 |
clarkb | asselin_: there is another button "save changes" if yo ucan directly merge the changes without review | 17:59 |
*** kzaitsev_mb has quit IRC | 17:59 | |
asselin_ | and I don't have that one, as expected | 17:59 |
*** ajmiller has joined #openstack-infra | 18:00 | |
*** odlD2 has quit IRC | 18:00 | |
openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Skip openstack-ansible-docs gate/post jobs for juno branch https://review.openstack.org/263341 | 18:00 |
*** trown is now known as trown|lunch | 18:00 | |
odyssey4me | AJaeger done | 18:01 |
clarkb | asselin_: that was a new feature added in 2.8 iirc. So well after we had jeepyb independently managing acls for us | 18:01 |
AJaeger | thanks, odyssey4me. I'll wait for jenkins to finish and then review... | 18:01 |
clarkb | (I personally like the jeepyb approach because it keeps things centralized with lots of prior art and a review body that groks gerrit acls) | 18:02 |
asselin_ | me too...easier to grep for changes too | 18:02 |
odyssey4me | thanks AJaeger | 18:02 |
nibalizer | ya the grepping is key | 18:03 |
nibalizer | for me anyways | 18:03 |
*** kevinbenton has quit IRC | 18:03 | |
nibalizer | all this got setup way before I got here so being able to cargo cult is great | 18:03 |
clarkb | similar thing with jjb | 18:03 |
*** sshnaidm_ has quit IRC | 18:04 | |
*** harlowja has quit IRC | 18:04 | |
*** harlowja has joined #openstack-infra | 18:04 | |
*** _nadya_ has joined #openstack-infra | 18:04 | |
*** FallenPegasus has joined #openstack-infra | 18:05 | |
*** salv-orl_ has joined #openstack-infra | 18:06 | |
*** salv-orl_ has quit IRC | 18:06 | |
*** thiagop has quit IRC | 18:07 | |
*** salv-orl_ has joined #openstack-infra | 18:07 | |
*** nelsnels_ has joined #openstack-infra | 18:07 | |
*** salv-orlando has quit IRC | 18:08 | |
*** kevinbenton has joined #openstack-infra | 18:09 | |
*** thiagop has joined #openstack-infra | 18:09 | |
clarkb | oh hrm I think I can set it up so that on logstash 2.0 the http output talks to many hosts. This may mean I won't need the local elasticsearch daemon and will cut back on memory use | 18:09 |
* clarkb checks into this | 18:09 | |
*** nelsnelson has quit IRC | 18:10 | |
*** doug-fish has joined #openstack-infra | 18:10 | |
*** otter768 has joined #openstack-infra | 18:10 | |
*** angdraug has joined #openstack-infra | 18:10 | |
*** vgridnev has joined #openstack-infra | 18:11 | |
*** armax has quit IRC | 18:11 | |
clarkb | ya it takes an array and will load balance across them | 18:11 |
*** tonytan4ever has quit IRC | 18:11 | |
clarkb | I suppose this is worth a shot | 18:11 |
AJaeger | wow, 109 changes in the post queue of zuul - seems everybody is back to approve ;) | 18:12 |
jeblair | clarkb: cool | 18:12 |
kragniz | anyone in infra-core around to add me to a newly created group? Groups created in this review: https://review.openstack.org/#/c/261135/ | 18:13 |
*** odlD2 has joined #openstack-infra | 18:13 | |
*** jsavak has joined #openstack-infra | 18:13 | |
*** vilobhmm11 has quit IRC | 18:14 | |
pleia2 | kragniz: I'll have a look | 18:14 |
kragniz | pleia2: thanks! | 18:14 |
*** dkranz has quit IRC | 18:15 | |
*** otter768 has quit IRC | 18:15 | |
openstackgerrit | Merged openstack-infra/project-config: Remove pep8/bashate targets https://review.openstack.org/260917 | 18:15 |
clarkb | logstash-worker20 is now running without a local daemon and should load balance indexing across the data nodes directly | 18:17 |
clarkb | if this doesn't completely fall over in the next hour or so I will push a puppet change to deploy logstash 2.0 this way | 18:17 |
*** claudiub has quit IRC | 18:17 | |
*** laurelm has quit IRC | 18:19 | |
AJaeger | mordred: could you answer my question for 262600, please? | 18:19 |
*** FallenPegasus has quit IRC | 18:19 | |
pleia2 | kragniz: since this is release tooling related and dhellmann +1ed the change I'm going to assume for now that it's ok to add you louis@kragniz.eu, the patch author, as core&release here, but you probably want to follow up with him about other members :) | 18:20 |
*** FallenPegasus has joined #openstack-infra | 18:20 | |
kragniz | pleia2: will do | 18:20 |
kragniz | pleia2: thanks for the help! | 18:20 |
*** laurelm has joined #openstack-infra | 18:21 | |
pleia2 | kragniz: you're welcome | 18:21 |
*** sputnik13_ has joined #openstack-infra | 18:22 | |
openstackgerrit | Merged openstack-infra/project-config: Basic validation for gerritbot/channels.yaml https://review.openstack.org/261046 | 18:22 |
openstackgerrit | Merged openstack-infra/project-config: Remove redundant node declarations https://review.openstack.org/260400 | 18:23 |
*** claudiub has joined #openstack-infra | 18:23 | |
openstackgerrit | Merged openstack-infra/project-config-example: Remove pep8 target https://review.openstack.org/260919 | 18:23 |
openstackgerrit | Merged openstack-infra/project-config: Report openstack-specs changes to openstack-dev https://review.openstack.org/259932 | 18:23 |
*** e0ne has joined #openstack-infra | 18:23 | |
openstackgerrit | Merged openstack-infra/project-config: Use python-jobs template where possible https://review.openstack.org/262141 | 18:23 |
*** thiagop has quit IRC | 18:23 | |
pleia2 | ^^ AJaeger happy new year ;) | 18:23 |
*** thiagop has joined #openstack-infra | 18:24 | |
jesusaurus | clarkb: what do you mean 'without a local daemon'? without a local es daemon? i thought a local es daemon did the load balancing | 18:24 |
*** _nadya_ has quit IRC | 18:24 | |
clarkb | jesusaurus: ya on old logstash I ran a local es daemon to do load balancing, but that eats a bunch of memory. new logstash can http and load balance itself without a local daemon | 18:24 |
clarkb | jesusaurus: and since I am having OOMing issues removing the local es daemon and having logstash load balance itself is hopefully going to alleviate memory pressure | 18:25 |
jesusaurus | oh, so you give it a list of endpoints and it round-robins or somesuch? | 18:25 |
*** eil397 has joined #openstack-infra | 18:25 | |
clarkb | yup | 18:25 |
jesusaurus | cool | 18:26 |
*** bharathm has quit IRC | 18:26 | |
openstackgerrit | Merged openstack-infra/project-config: Remove ACL for refs/heads/release- for mistral https://review.openstack.org/260379 | 18:26 |
*** baoli_ has quit IRC | 18:27 | |
AJaeger | pleia2: thanks for all the reviews! | 18:28 |
*** Sukhdev has quit IRC | 18:28 | |
AJaeger | pleia2: now we only have 128 open project-config reviews ;) | 18:29 |
*** julim_ has joined #openstack-infra | 18:30 | |
*** baoli has joined #openstack-infra | 18:31 | |
*** tzn has quit IRC | 18:31 | |
*** openstackgerrit has quit IRC | 18:32 | |
*** openstackgerrit has joined #openstack-infra | 18:32 | |
*** julim has quit IRC | 18:32 | |
*** tonytan4ever has joined #openstack-infra | 18:33 | |
sputnik13_ | can someone with +2 for openstack/requirements please review https://review.openstack.org/#/c/261074/ | 18:33 |
*** sridhar_ram has quit IRC | 18:34 | |
sputnik13_ | it already has a +2, just needs one more | 18:34 |
*** bexelbie has quit IRC | 18:34 | |
*** Guest21972 has quit IRC | 18:34 | |
sputnik13_ | aaaand devstack... https://review.openstack.org/#/c/260661/ :) | 18:35 |
pleia2 | AJaeger: it ever ends! | 18:35 |
*** ari has quit IRC | 18:36 | |
*** sabeen3 has quit IRC | 18:37 | |
AJaeger | pleia2: but it's down from over 150 early December... | 18:38 |
*** doug-fish has quit IRC | 18:38 | |
*** trown|lunch is now known as trown | 18:40 | |
mordred | AJaeger: aha! good call | 18:40 |
crinkle | clarkb: https://etherpad.openstack.org/p/nodepool-wiki-mysql-downtime good? | 18:41 |
*** doug-fish has joined #openstack-infra | 18:41 | |
*** david-lyle_ has joined #openstack-infra | 18:42 | |
clarkb | crinkle: looks good to me | 18:42 |
*** yamahata has joined #openstack-infra | 18:42 | |
* AJaeger has to leave again... | 18:43 | |
crinkle | clarkb: ty | 18:43 |
*** AJaeger has quit IRC | 18:43 | |
*** bpokorny has joined #openstack-infra | 18:43 | |
nibalizer | crinkle: lgtm | 18:43 |
clarkb | looks like logstash-worker20 fell over again :/ but not due to an OOM, there are log complains about timestamp formats so addressing those and restarting | 18:43 |
*** piet has quit IRC | 18:43 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: DO NOT MERGE changes needed for delorean promotion https://review.openstack.org/258140 | 18:47 |
*** pvaneck has joined #openstack-infra | 18:47 | |
*** piet has joined #openstack-infra | 18:47 | |
*** jsavak has quit IRC | 18:49 | |
*** ari has joined #openstack-infra | 18:49 | |
*** doug-fish has quit IRC | 18:49 | |
*** HeOS has joined #openstack-infra | 18:50 | |
*** doug-fish has joined #openstack-infra | 18:50 | |
*** isq has quit IRC | 18:50 | |
*** isq has joined #openstack-infra | 18:51 | |
*** doug-fish has quit IRC | 18:51 | |
openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add releasenotes jobs for os-client-config https://review.openstack.org/262600 | 18:51 |
*** bharathm has joined #openstack-infra | 18:51 | |
clarkb | bah disk space of course | 18:52 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Upgrade mysql module to 3.6.1 https://review.openstack.org/257640 | 18:52 |
crinkle | ^ is ready to re-review | 18:53 |
*** boris-42 has quit IRC | 18:53 | |
crinkle | also https://review.openstack.org/#/c/258193 should not make any actual changes to the system on its own if anyone wants to take that plunge | 18:54 |
*** angdraug has quit IRC | 18:55 | |
*** jsavak has joined #openstack-infra | 18:55 | |
*** kzaitsev_mb has joined #openstack-infra | 18:56 | |
*** aopincar has quit IRC | 18:57 | |
*** bnemec has quit IRC | 18:58 | |
*** vilobhmm11 has joined #openstack-infra | 18:58 | |
*** jsavak has quit IRC | 19:01 | |
*** jsavak has joined #openstack-infra | 19:02 | |
*** piet has quit IRC | 19:03 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Normalize server objects https://review.openstack.org/262627 | 19:05 |
*** baoli has quit IRC | 19:06 | |
*** baoli has joined #openstack-infra | 19:06 | |
*** baoli has quit IRC | 19:07 | |
*** sdake has quit IRC | 19:08 | |
*** jsavak has quit IRC | 19:08 | |
*** jsavak has joined #openstack-infra | 19:09 | |
*** bgmccollum has joined #openstack-infra | 19:10 | |
*** sc68cal has quit IRC | 19:11 | |
*** bharathm has quit IRC | 19:11 | |
*** FallenPegasus is now known as MarkAtwood | 19:11 | |
*** baoli has joined #openstack-infra | 19:11 | |
*** bharathm has joined #openstack-infra | 19:12 | |
openstackgerrit | Merged openstack-infra/statusbot: Update to pbr-based build https://review.openstack.org/92676 | 19:13 |
openstackgerrit | Merged openstack-infra/statusbot: Add twitter support to statusbot https://review.openstack.org/92677 | 19:14 |
*** sc68cal has joined #openstack-infra | 19:14 | |
crinkle | i've found a machine that seems to have some kind of historical significance to it, with these users on it: | 19:14 |
crinkle | clarkb: clint cmsj corvus devananda elizabeth fungi ironic jogo mordred nobodycam robertc shared slukjanov stack yazz | 19:14 |
crinkle | its ip address is 15.184.52.200 | 19:14 |
*** dkranz has joined #openstack-infra | 19:14 | |
clarkb | crinkle: is that addressed to me or am I on the host? | 19:14 |
* Clint squints. | 19:15 | |
crinkle | clarkb: you are on the host | 19:15 |
crinkle | should any of this be backed up? is it still in use by anybody? | 19:15 |
crinkle | greghaynes: ^ | 19:15 |
jeblair | i wonder if it's a long-lost hp backup server? | 19:15 |
jeblair | oh, this is the infra-cloud hardware? | 19:15 |
crinkle | jeblair: yes | 19:15 |
greghaynes | crinkle: I have nothing that should need backing up | 19:15 |
devananda | crinkle: do you know the physical ... oh. | 19:15 |
clarkb | ya I don't have anything needing backups | 19:15 |
devananda | crinkle: what is the hostname? | 19:15 |
crinkle | devananda: bm-aw1az2-freecloud0001 | 19:16 |
devananda | I suspect that's the old jump host | 19:16 |
*** HeOS has quit IRC | 19:16 | |
jeblair | freecloud is an old project | 19:16 |
greghaynes | Seems plausible | 19:16 |
*** regXboi has quit IRC | 19:17 | |
devananda | I hvae not logged into that host in 18 months. nothing I need is there | 19:17 |
pabelanger | jeblair: do you mind helping https://review.openstack.org/#/c/261055/ land? Just removing requirements cap for webob | 19:17 |
*** _nadya_ has joined #openstack-infra | 19:17 | |
devananda | SpamapS: it looks like you had some activity on that box last year | 19:18 |
jeblair | i think it predated trystack | 19:18 |
jeblair | pabelanger: done | 19:19 |
pabelanger | jeblair: danke | 19:19 |
*** tjones has left #openstack-infra | 19:19 | |
pabelanger | jeblair: do you think we can do another zuul 2.x.x release before zuulv3? | 19:20 |
pabelanger | not today | 19:20 |
*** david-lyle_ has quit IRC | 19:20 | |
jeblair | pabelanger: yeah, don't see why not | 19:20 |
openstackgerrit | Paul Michali proposed openstack-infra/project-config: Constraint based experimental jobs for neutron-vpnaas https://review.openstack.org/263398 | 19:20 |
pabelanger | great | 19:20 |
*** bnemec has joined #openstack-infra | 19:20 | |
*** openstackstatus has quit IRC | 19:20 | |
*** sdake has joined #openstack-infra | 19:21 | |
*** openstackstatus has joined #openstack-infra | 19:21 | |
*** ChanServ sets mode: +v openstackstatus | 19:21 | |
*** sridhar_ram has joined #openstack-infra | 19:22 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Run package-intalls with py3k if we must https://review.openstack.org/254386 | 19:22 |
*** regXboi has joined #openstack-infra | 19:22 | |
clarkb | greghaynes: that commit title always makes me think of eeyore | 19:22 |
clarkb | "if we must" | 19:22 |
openstackgerrit | Merged openstack/diskimage-builder: The mirror for installing epel is timing out https://review.openstack.org/262050 | 19:23 |
greghaynes | clarkb: I am glad my feelings toward that bug come through so well in my commit msg | 19:23 |
*** odlD2 has quit IRC | 19:23 | |
clarkb | https://jenkins02.openstack.org/job/gate-grenade-dsvm/9735/ that job is running on bluebox | 19:24 |
openstackgerrit | Merged openstack-infra/zuul: Remove webob requirements cap https://review.openstack.org/261055 | 19:26 |
*** bharathm has quit IRC | 19:28 | |
clarkb | jeblair: are you wanting to do more testing beyond "test runs and works" before bumping max servers back to 39? | 19:29 |
*** nmagnezi has joined #openstack-infra | 19:30 | |
*** ybathia has joined #openstack-infra | 19:30 | |
*** kzaitsev_mb has quit IRC | 19:30 | |
jeblair | clarkb: nope -- we'll get more info by running real jobs i think | 19:31 |
*** [1]Thelo has joined #openstack-infra | 19:32 | |
*** flepied has joined #openstack-infra | 19:32 | |
*** bharathm has joined #openstack-infra | 19:32 | |
*** sabeen has joined #openstack-infra | 19:33 | |
*** Thelo has quit IRC | 19:34 | |
*** [1]Thelo is now known as Thelo | 19:34 | |
*** changbl has quit IRC | 19:35 | |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks https://review.openstack.org/163117 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent https://review.openstack.org/238948 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Lower the log level in tests https://review.openstack.org/263364 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter https://review.openstack.org/243250 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose https://review.openstack.org/247487 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug. https://review.openstack.org/192457 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: support github pull reqeust labels https://review.openstack.org/247421 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github https://review.openstack.org/247500 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub https://review.openstack.org/239138 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs https://review.openstack.org/258448 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow using webapp from connections https://review.openstack.org/215642 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow list values in template parameters. https://review.openstack.org/191208 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 19:36 |
openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for github commit status https://review.openstack.org/239303 | 19:36 |
*** Kiall has quit IRC | 19:36 | |
*** Kiall has joined #openstack-infra | 19:36 | |
*** odlD2 has joined #openstack-infra | 19:36 | |
*** masuberu has quit IRC | 19:37 | |
*** sabeen3 has joined #openstack-infra | 19:39 | |
*** hashar has joined #openstack-infra | 19:39 | |
*** sabeen has quit IRC | 19:40 | |
*** fawadkhaliq has quit IRC | 19:41 | |
*** fawadkhaliq has joined #openstack-infra | 19:42 | |
*** dims_ has joined #openstack-infra | 19:46 | |
*** bharathm has quit IRC | 19:46 | |
*** dims has quit IRC | 19:47 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 19:47 |
*** tzn has joined #openstack-infra | 19:50 | |
*** bharathm has joined #openstack-infra | 19:50 | |
*** annegentle has quit IRC | 19:51 | |
*** mwagner_lap has quit IRC | 19:51 | |
*** annegentle has joined #openstack-infra | 19:53 | |
*** odlD2 has quit IRC | 19:55 | |
*** baoli has quit IRC | 19:56 | |
*** aopincar has joined #openstack-infra | 19:56 | |
clarkb | thta grenade job finished successfully in about 45 minutes | 19:57 |
*** rguillebert has quit IRC | 19:57 | |
clarkb | https://jenkins04.openstack.org/job/gate-tempest-dsvm-postgres-full/8554/console is now running which will tell us if tempest is happy too | 19:58 |
*** daemontool has quit IRC | 19:59 | |
*** bharathm has quit IRC | 20:00 | |
*** megm has quit IRC | 20:00 | |
*** amuller is now known as amuller_food | 20:00 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 20:01 |
clarkb | nibalizer: how is nodepool against infracloud going? | 20:02 |
*** megm has joined #openstack-infra | 20:03 | |
*** amitgandhinz has quit IRC | 20:05 | |
*** bharathm has joined #openstack-infra | 20:05 | |
clarkb | nibalizer: is it building and booting our images yet ? would be neat to run some jobs on it | 20:05 |
*** amitgandhinz has joined #openstack-infra | 20:06 | |
*** woodster_ has joined #openstack-infra | 20:06 | |
*** kzaitsev_mb has joined #openstack-infra | 20:07 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 20:08 |
*** odlD2 has joined #openstack-infra | 20:08 | |
openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/263143 | 20:08 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 20:09 |
openstackgerrit | Davide Agnello proposed openstack-infra/project-config: Moving Cue rally test to non-voting check job https://review.openstack.org/259188 | 20:10 |
*** otter768 has joined #openstack-infra | 20:11 | |
nibalizer | i haven't poked it since we fixed the quota issue | 20:12 |
nibalizer | and there were some network issues that crinkle helped me resolve | 20:12 |
clarkb | was that the security groups? | 20:13 |
crinkle | it was the dns per subnet issue | 20:13 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 20:13 |
nibalizer | it was the dns issue | 20:14 |
nibalizer | nodepool is booting a node now, we can see if it works | 20:14 |
clarkb | dns per subnet? our images should use google | 20:14 |
crinkle | right, if we didn't specify that they would try to use the beginning of the allocation pool | 20:14 |
crinkle | we had to set it explicitly | 20:15 |
nibalizer | i haven't set up our nodepool configuration on my nodepool host | 20:15 |
nibalizer | just an example one | 20:15 |
nibalizer | so its not building our images | 20:15 |
clarkb | I see | 20:15 |
*** otter768 has quit IRC | 20:16 | |
jeblair | nibalizer: i copied the image i was using locally | 20:16 |
jeblair | let me use more words | 20:16 |
jeblair | nibalizer: i copied the images i was using from nodepool.o.o to my local machine, and copied in the relevant record for the 'snapshot_images' table as well | 20:17 |
nibalizer | oh | 20:18 |
jeblair | nibalizer: (well, only the first is needed if you want to upload the image which you will probably need to do... only the second is needed if you want to re-use an existing snapshot on a provider the production nodepool knows about) | 20:18 |
jeblair | i'm apparently out of practice communicating technical things, but it'll get better :) | 20:18 |
* nibalizer nods | 20:18 | |
*** hdd has joined #openstack-infra | 20:19 | |
nibalizer | I've got some other stuff I'm working on today so I won't really dig into nodepool today, but tomorrow I'll probabaly want to engage more on this | 20:19 |
openstackgerrit | Paul Michali proposed openstack-infra/project-config: Skip py27/34 jobs when VPN doc (only) change https://review.openstack.org/263409 | 20:19 |
jeblair | nibalizer: cool, let me know if i can clarify further :) | 20:20 |
*** jcoufal has quit IRC | 20:20 | |
clarkb | its relatively easy to just have localnodepoold do it all | 20:20 |
ari | Can I get a review - https://review.openstack.org/#/c/263354/ | 20:21 |
*** bharathm has quit IRC | 20:21 | |
clarkb | takes 45 minutes for dib builds here | 20:21 |
nibalizer | clarkb: yea my dib build succeeds | 20:21 |
nibalizer | the node doesn't network good once booted though, which is unfortunate | 20:22 |
nibalizer | cirros images get networking so probably something in the dib image | 20:22 |
clarkb | using simple-init and glean? | 20:23 |
*** Sukhdev has joined #openstack-infra | 20:23 | |
nibalizer | wait no I think I know what the issue is | 20:24 |
*** bharathm has joined #openstack-infra | 20:24 | |
*** krtaylor has quit IRC | 20:26 | |
*** rfolco_ has quit IRC | 20:29 | |
crinkle | greghaynes: SpamapS: there are files /home/shared/machine-information-tab.txt and /home/shared/machine-information-tab.txt.bak, do you happen to remember these files and recall why .bak has more machines in it? | 20:29 |
*** vgridnev has quit IRC | 20:30 | |
greghaynes | crinkle: hrm, are you sure there are more machines? I think I remember doing some work to figure out where the data was incorrect in the .bak and might have removed a couple that were duped or somesuch | 20:30 |
*** sputnik13_ has quit IRC | 20:30 | |
*** aopincar has quit IRC | 20:31 | |
*** bharathm has quit IRC | 20:31 | |
crinkle | greghaynes: yes, there are several that seem to exist that are missing from certain lists | 20:31 |
crinkle | all the lists seem to be a little bit different | 20:32 |
*** hdd has quit IRC | 20:32 | |
*** _nadya_ has quit IRC | 20:32 | |
*** hdd has joined #openstack-infra | 20:32 | |
*** sputnik13_ has joined #openstack-infra | 20:32 | |
greghaynes | crinkle: Seems about right. The .bak was just a straight copy from the hp wiki IIRC | 20:32 |
*** kzaitsev_mb has quit IRC | 20:33 | |
*** kmartin has quit IRC | 20:33 | |
*** bharathm has joined #openstack-infra | 20:34 | |
greghaynes | crinkle: none of that should be the source of truth for anything ATM though, the original source for those files was the hp wiki and the source for that was hp's inventory | 20:34 |
*** sputnik13_ has quit IRC | 20:35 | |
clarkb | looks like the bluebox postgres tempest run is going to fail, not sure if due to bluebox or the chagne yet | 20:35 |
clarkb | something to look at before bumping to 39 nodes I guess | 20:36 |
mtreinish | clarkb: looks like it's failing everything cinder | 20:36 |
clarkb | mtreinish: its from that https://review.openstack.org/#/c/259515/ | 20:36 |
clarkb | so may just be related to the change | 20:37 |
*** sputnik13_ has joined #openstack-infra | 20:37 | |
crinkle | greghaynes: they seem to have disappeared from the wiki and the cmdb so it's all i have to go on | 20:37 |
mtreinish | yeah, it's the change | 20:37 |
greghaynes | crinkle: hah | 20:37 |
jeblair | zaro: what's the possibility of using the workflow plugin with our new gerrit? | 20:37 |
jeblair | zaro: er, the 'work in progress' plugin | 20:38 |
greghaynes | crinkle: So it is probably important that what HP thinks we have and what we think we have match | 20:38 |
crinkle | greghaynes: yes | 20:38 |
greghaynes | crinkle: does the inventory.json have all the hosts in the machine-infrmation-tab.bak file? | 20:38 |
greghaynes | crinkle: I think it may... | 20:39 |
greghaynes | er, inventory-full | 20:39 |
crinkle | greghaynes: no, it has the subset of machines | 20:39 |
greghaynes | hrm | 20:39 |
clarkb | notmorgan: not sure how often you deal with icey fun, but beware falling ice | 20:40 |
clarkb | notmorgan: and basically beware anyone driving a car right now | 20:40 |
notmorgan | clarkb: grew up in the snow and ice | 20:40 |
greghaynes | or anyone looking like they are thinking of driving a car | 20:40 |
*** piet has joined #openstack-infra | 20:40 | |
notmorgan | clarkb: learned to drive on icy mountain roads :) | 20:40 |
*** bharathm has quit IRC | 20:40 | |
greghaynes | notmorgan: The problem is the rest of portland | 20:40 |
clarkb | oh good, just remember no one can drive in ice and/or snow here | 20:40 |
greghaynes | :p | 20:40 |
notmorgan | clarkb: thanks for the heads up! :) | 20:40 |
*** annegentle has quit IRC | 20:40 | |
clarkb | also I am watching all the ice fall right now | 20:41 |
notmorgan | clarkb: hah i think most people i know even growing up in snow and ice suck at driving in it | 20:41 |
*** ihrachys has joined #openstack-infra | 20:41 | |
greghaynes | crinkle: which hosts are missing? Are there any notes on the side in the file for them? | 20:41 |
notmorgan | clarkb: but all wheel drive helps a lot | 20:41 |
ari | zaro# Can I get a review when you have a chance? https://review.openstack.org/#/c/263354/ | 20:42 |
*** annegentle has joined #openstack-infra | 20:42 | |
*** bharathm has joined #openstack-infra | 20:42 | |
*** sputnik13_ has quit IRC | 20:42 | |
*** Sukhdev has quit IRC | 20:43 | |
crinkle | greghaynes: no, the hosts with errors noted do not correspond to the missing ones | 20:44 |
*** esikachev has joined #openstack-infra | 20:44 | |
crinkle | greghaynes: okay, some of them did make it into inventory-full.json, just one had its password typoed | 20:46 |
crinkle | greghaynes: 10.10.16.12 (which is the bastion) and 10.10.16.13 did not make it | 20:46 |
greghaynes | crinkle: ok, and that is all commited in system-config now, right? | 20:46 |
*** rkukura has quit IRC | 20:46 | |
greghaynes | crinkle: got it, .13 is the bifrost node? | 20:46 |
crinkle | greghaynes: i'm going to add .12 and .13 in | 20:46 |
crinkle | yes | 20:46 |
greghaynes | crinkle: ok, I wonder if there is a way to disable them... | 20:47 |
greghaynes | crinkle: the reason those arent in there should be obvious... | 20:47 |
greghaynes | It is fine to put them in, but it is really easy to foot-gun | 20:47 |
crinkle | greghaynes: we worked that out: https://review.openstack.org/#/c/231757/27/templates/bifrost/inventory.hpuswest.json.erb | 20:48 |
*** tonytan4ever has quit IRC | 20:48 | |
*** sputnik13_ has joined #openstack-infra | 20:49 | |
greghaynes | crinkle: oh, sweet | 20:49 |
greghaynes | crinkle: The other bit of useful info is serials | 20:49 |
crinkle | greghaynes: yeah i was thinking that too | 20:50 |
*** gongysh has joined #openstack-infra | 20:50 | |
greghaynes | crinkle: I think bifrost is fine with extra data in the inventory file, I am unsure if we want to make serials public | 20:50 |
*** baoli has joined #openstack-infra | 20:51 | |
crinkle | greghaynes: i'm not sure how someone would exploit that | 20:51 |
clarkb | are they basically just mac addrs? | 20:51 |
greghaynes | clarkb: nope | 20:51 |
*** ihrachys_ has joined #openstack-infra | 20:51 | |
*** ihrachys has quit IRC | 20:52 | |
clarkb | https://jenkins04.openstack.org/job/gate-designate-dsvm-powerdns/374/console another bluebox job | 20:52 |
greghaynes | crinkle: Yea, I dunno, that is probably an HP internal question thoug | 20:52 |
*** weshay_xchat is now known as weshay | 20:54 | |
sdague | so, what's the story on the pypi wheel mirrors? | 20:54 |
*** jsavak has quit IRC | 20:55 | |
*** jsavak has joined #openstack-infra | 20:55 | |
*** sarob_ has joined #openstack-infra | 20:55 | |
*** PsionTheory has joined #openstack-infra | 20:56 | |
openstackgerrit | Paul Michali proposed openstack-infra/project-config: Constraint based experimental jobs for neutron-vpnaas https://review.openstack.org/263398 | 20:56 |
*** ihrachys_ is now known as ihrachys | 20:56 | |
*** doug-fish has joined #openstack-infra | 20:56 | |
*** amitgandhinz has quit IRC | 20:57 | |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder https://review.openstack.org/263349 | 21:01 |
*** e0ne has quit IRC | 21:01 | |
*** amuller_food is now known as amuller | 21:02 | |
*** rkukura has joined #openstack-infra | 21:04 | |
*** tonytan4ever has joined #openstack-infra | 21:04 | |
*** ihrachys_ has joined #openstack-infra | 21:05 | |
*** amrith is now known as _amrith_ | 21:06 | |
*** matrohon has joined #openstack-infra | 21:06 | |
*** sputnik13_ has quit IRC | 21:07 | |
openstackgerrit | Merged openstack-infra/subunit2sql: Fix hard coded filter in get_test_run_series() https://review.openstack.org/262986 | 21:07 |
openstackgerrit | Merged openstack-infra/subunit2sql: Add missing tests for db api functions with implicit joins https://review.openstack.org/262987 | 21:08 |
*** tzn has quit IRC | 21:08 | |
*** ihrachys has quit IRC | 21:08 | |
*** rbrndt_ has quit IRC | 21:10 | |
*** sarob_ has quit IRC | 21:11 | |
*** matrohon has quit IRC | 21:12 | |
*** dprince has quit IRC | 21:12 | |
*** baoli has quit IRC | 21:13 | |
*** baoli has joined #openstack-infra | 21:13 | |
*** baoli has quit IRC | 21:14 | |
*** ihrachys_ is now known as ihrachys | 21:14 | |
*** baoli has joined #openstack-infra | 21:14 | |
*** matrohon has joined #openstack-infra | 21:15 | |
*** tzn has joined #openstack-infra | 21:15 | |
*** hashar has quit IRC | 21:15 | |
*** bharathm has quit IRC | 21:16 | |
*** amitgandhinz has joined #openstack-infra | 21:16 | |
*** kmartin has joined #openstack-infra | 21:17 | |
dmsimard | Does anyone know what's the right place to ask for help in recovering an account for openstackid.org ? | 21:19 |
*** baoli has quit IRC | 21:19 | |
anteaya | dmsimard: here is as good a place as any | 21:19 |
clarkb | dmsimard: on openstackid is a lost password link | 21:19 |
anteaya | clarkb: ah thank you | 21:20 |
dmsimard | clarkb: the e-mail address registered is probably the one from my previous employer | 21:20 |
dmsimard | :/ | 21:20 |
*** ari has quit IRC | 21:20 | |
*** ari has joined #openstack-infra | 21:20 | |
clarkb | dmsimard: and you don't remember the password so the reset would be sent to an inaccessible location? | 21:20 |
*** tzn has quit IRC | 21:21 | |
dmsimard | clarkb: correct - let me dig some more to try and see if I have the password somewhere :( | 21:21 |
clarkb | if you hvae the password you can change the email addr associated with the account, if you don't have the password I can find a good contact address to sort it out | 21:22 |
*** hdd has quit IRC | 21:23 | |
anteaya | clarkb: you said in backscroll logstash 2.0 is using more memory on 20 than 1.3 was and keeps getting taken out by the OOMkiller | 21:23 |
clarkb | anteaya: yes, I think I have a viable workaround for that with logstash2.0 though | 21:24 |
anteaya | woooooo | 21:24 |
anteaya | is it in backscroll? I haven't caught up yet | 21:24 |
clarkb | yes at 18:09:55 UTC | 21:25 |
* anteaya goes back to reading logs and lurking in the stable meeting | 21:25 | |
*** bhunter71 has quit IRC | 21:25 | |
anteaya | thanks | 21:25 |
dmsimard | clarkb: okay, I'm in, don't see an option to change the e-mail address.. though. | 21:25 |
clarkb | let me see | 21:25 |
*** kgiusti has quit IRC | 21:25 | |
*** Swami_ has joined #openstack-infra | 21:25 | |
*** bharathm has joined #openstack-infra | 21:25 | |
*** Swami has quit IRC | 21:25 | |
clarkb | oh, you may have to do it through the foundation profile side? | 21:26 |
*** esikachev has quit IRC | 21:26 | |
anteaya | clarkb: so when you say it takes an array do you mean you need more than one server? | 21:26 |
*** julim_ has quit IRC | 21:26 | |
clarkb | anteaya: ya so on old logstash we had it talk to a single ES daemon which ran locally, that daemon was then doing load balancing for us. With new logstash we can give it a list and it will load balance for us | 21:27 |
anteaya | oh, helpful | 21:27 |
anteaya | so how many servers are you envisioning for a trial run? | 21:28 |
clarkb | anteaya: I just have it on logstash-worker20 right now, but it is talking to all of the elasticsearch data nodes | 21:28 |
dmsimard | clarkb: that was it, thanks :) | 21:28 |
anteaya | clarkb: oh I see what you are saying, I think | 21:28 |
anteaya | clarkb: how does the memory usage compare, or can you tell yet? | 21:29 |
*** gongysh has quit IRC | 21:29 | |
clarkb | anteaya: comparing 01 and 20 is about 1GB difference looks like | 21:30 |
clarkb | cacti should show that | 21:30 |
clarkb | granted 20 has only been running a couple hours under new setup | 21:30 |
* anteaya goes to cacti | 21:30 | |
clarkb | 01 has been running much longer so has had more time to soak up memory | 21:30 |
* anteaya nods | 21:30 | |
*** ari has quit IRC | 21:30 | |
clarkb | dmsimard: all sorted then? I can find out who to contact if necessary (will ask them to put ocntact info on the website regardless) | 21:32 |
*** hdd has joined #openstack-infra | 21:32 | |
dmsimard | clarkb: yeah all good. | 21:32 |
anteaya | clarkb: how long do you think the logstash 20 server should run to get a realistic sense of its expected memory usage over time? | 21:34 |
*** lucasagomes has joined #openstack-infra | 21:34 | |
clarkb | anteaya: probably a day or two with real work (so not during holidays) | 21:34 |
anteaya | fair enough | 21:34 |
anteaya | so look again the end of this week? | 21:34 |
*** lucasagomes is now known as lucas-dinner | 21:34 | |
clarkb | ya | 21:34 |
jeblair | did i stop holidaying too soon? | 21:35 |
anteaya | clarkb: cool | 21:35 |
clarkb | I dunno, I can't tell if everyone is back to normal this week or not | 21:35 |
anteaya | jeblair: I'm glad you're back | 21:35 |
* jeblair goes to turn the lights back on | 21:35 | |
clarkb | I myself am in a weird haze of house shopping, doctor visits, and freezing rain | 21:36 |
anteaya | I had to go shopping today, was out of milk and my taxi was on holidays until today | 21:36 |
*** ok_delta has joined #openstack-infra | 21:36 | |
*** ok___delta has joined #openstack-infra | 21:36 | |
jeblair | freezing haze | 21:36 |
anteaya | stay inside on the freezing rain days, that can get nasty | 21:36 |
clarkb | anteaya: yup | 21:36 |
anteaya | clarkb: how is house hunting going? | 21:37 |
anteaya | my sister's family went canoeing on christmas day and my brother's family went swimming, cold now though - wore the parka today | 21:37 |
clarkb | anteaya: so so, it takes time and patience and time | 21:37 |
anteaya | yeah | 21:38 |
clarkb | zaro: looking at gerrit memory use graphs, we still appear ok | 21:38 |
clarkb | zaro: but its creeping up in usage. over the last day mean is 7GB and max is 12GB | 21:38 |
anteaya | mriedem: what do you need from infra regarding a channel topic, just someone to change it once you have decided what you want? | 21:40 |
*** baoli has joined #openstack-infra | 21:40 | |
mriedem | anteaya: yeah | 21:40 |
anteaya | mriedem: cool | 21:40 |
mriedem | it's low priority though | 21:40 |
clarkb | zaro: there was some garbage collecting too, but nothing crazy and not consistently bad | 21:40 |
anteaya | mriedem: yup, just trying to follow along | 21:41 |
anteaya | mriedem: nice first meeting, yay stable team | 21:41 |
mriedem | \o/ | 21:41 |
*** tzn has joined #openstack-infra | 21:41 | |
*** ihrachys has quit IRC | 21:44 | |
jhesketh | Morning | 21:46 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add baremetal hpuswest node definition https://review.openstack.org/208751 | 21:46 |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud modules to modules.env https://review.openstack.org/209617 | 21:46 |
bknudson_ | I thought stable meeting was tomorrow | 21:46 |
*** austin81 has left #openstack-infra | 21:47 | |
clarkb | zaro: you can really see how much time we spend above the old 8GB though | 21:48 |
anteaya | morning jhesketh | 21:49 |
clarkb | mtreinish: is https://jenkins04.openstack.org/job/gate-designate-dsvm-powerdns/374/console the same issue neutron ran into with the chagne in config for tempest creds? | 21:49 |
*** trown is now known as trown|outttypeww | 21:49 | |
anteaya | bknudson_: was today | 21:49 |
*** matrohon has quit IRC | 21:49 | |
anteaya | bknudson_: in -4 | 21:50 |
openstackgerrit | Timur Sufiev proposed openstack-infra/project-config: Use scripts from horizon repo in integration job test hooks https://review.openstack.org/263457 | 21:50 |
*** matrohon has joined #openstack-infra | 21:51 | |
bknudson_ | I got messed up on odd/even weeks | 21:51 |
anteaya | I can never win on those | 21:51 |
anteaya | I just channel flip and catch the ones I catch | 21:51 |
anteaya | the ones I chair I hold every week, no changes | 21:52 |
bknudson_ | is this an odd week? | 21:52 |
anteaya | so I know when they are | 21:52 |
anteaya | bknudson_: aren't they all? | 21:52 |
jeblair | it's certainly not... | 21:52 |
jeblair | drat anteaya beat me to it | 21:52 |
anteaya | I can't tell what determines an even or odd week | 21:52 |
* anteaya beat jeblair at something! first time! | 21:52 | |
jeblair | that'll teach me to review changes | 21:53 |
anteaya | ha ha ha | 21:53 |
anteaya | you should stay in channel to win the quip draws | 21:53 |
anteaya | so yeah, if anyone knows how to determine what constitues an odd week, do share | 21:54 |
anteaya | I have no idea | 21:54 |
anteaya | tonyb: do you know? | 21:54 |
* tonyb reads scrollback | 21:55 | |
jeblair | http://git.openstack.org/cgit/openstack-infra/yaml2ical/tree/README.rst#n152 | 21:55 |
tonyb | bknudson_: yeas this is an odd week. | 21:55 |
jeblair | `biweekly-odd` are weeks where the ISO week number is an odd value. Correspondingly `biweekly-even` are weeks where the ISO week number is even. This unfortunately will break down on the transition from 2015 to 2016 as 2015 has 53 ISO weeks (an odd value) and then the first week of 2016 is week 1 (also an odd value). | 21:55 |
jeblair | so it's *especially odd* | 21:56 |
anteaya | ha ha ha | 21:56 |
bknudson_ | what was last week? 0? | 21:56 |
clarkb | at Intel they give you a badge size work week calendar to wear with your badge | 21:56 |
bknudson_ | oh, 53 | 21:56 |
clarkb | thats how confusing this stuff is | 21:56 |
tonyb | bknudson_: we had 2 odd weeks in a row | 21:56 |
tonyb | the last week of 2015 was 53, the first of 2016 is 1 | 21:57 |
jeblair | we need like julian weeks | 21:57 |
bknudson_ | my calender application says this is week 2, so I guess it's not using ISO. | 21:57 |
clarkb | https://jenkins03.openstack.org/job/gate-tempest-dsvm-full/28667/ thats another bluebox run of normal tempest | 21:57 |
tonyb | jeblair: no we need to specify a start date and then biweekly | 21:57 |
jeblair | or epoch weeks: "weeks since december 31 1969" | 21:57 |
tonyb | which is what we really *mean* the odd/even thing was a quick implementation | 21:57 |
jeblair | tonyb: i was still attempting humor, but in reality, don't we need to do whatever ical does? does it support this? | 21:58 |
* tonyb is coding the start_date thing on top of his outstanding reviews | 21:58 | |
tonyb | jeblair: Ahh | 21:58 |
tonyb | jeblair: so yeah iCal does exactly what I said but we currently can't represent that in *our* yaml | 21:59 |
*** ningy has quit IRC | 21:59 | |
tonyb | we cheat by guessing the start date basedon the DoW and the time yaml2ical is run | 21:59 |
jeblair | tonyb: okay cool... so hopefully we can fix this by next year :) | 21:59 |
tonyb | jeblair: so we loose history *and* the event dates can more from year to year | 22:00 |
tonyb | jeblair: yeah | 22:00 |
tonyb | jeblair: actually 2018 is the next time it's a problem | 22:00 |
*** sdake has quit IRC | 22:00 | |
jeblair | tonyb: i totally promise to help review that change before 2018. | 22:00 |
tonyb | jeblair: so it isn't time critical ;P | 22:00 |
* tonyb will hold jeblair to that :D | 22:00 | |
*** sdake has joined #openstack-infra | 22:00 | |
jeblair | it could be my 2017 new years resolution | 22:00 |
tonyb | jeblair: or I could do it this week and we could forget about it ;P | 22:01 |
*** regXboi has quit IRC | 22:01 | |
*** jsavak has quit IRC | 22:01 | |
tonyb | jeblair: can you look at https://review.openstack.org/#/c/245525/3 and help me understand what I actually need to do? | 22:02 |
*** thorst has quit IRC | 22:02 | |
jeblair | tonyb: is that the right change? | 22:03 |
*** thorst has joined #openstack-infra | 22:03 | |
mtreinish | clarkb: looks like it | 22:03 |
jeblair | tonyb: "Set ZUUL_BRANCH for periodic unittest bitrot jobs" | 22:03 |
anteaya | date +%V | 22:04 |
tonyb | jeblair: yeah BUT not PS4 I don't want to use ZUUL_BRANCH | 22:04 |
anteaya | displays the ISO week number | 22:04 |
tonyb | jeblair: I'm not certain I understand why I need to create whoel new set of macros | 22:04 |
jeblair | tonyb: okay, unexpected change of subject :) gimme a minute to catch up | 22:04 |
tonyb | jeblair: sorry, I thought we'd done the odd week thing | 22:05 |
*** bharathm has quit IRC | 22:05 | |
*** rbrndt_ has joined #openstack-infra | 22:05 | |
*** changbl has joined #openstack-infra | 22:06 | |
*** thorst has quit IRC | 22:07 | |
jeblair | tonyb: yeah, because zuul doesn't set the branch specificier for periodic jobs, the jobs themselves need to specify the branch, and we don't want to touch that for regular jobs | 22:08 |
tonyb | to be very silly: bash -c "[ $(( $( date +%V ) % 2 ) == 0 ] && echo even || echo odd" | 22:08 |
*** alexpilotti_ has joined #openstack-infra | 22:08 | |
jeblair | tonyb: the *best* solution would be to modify the zuul timer trigger to do that, but it's not super-easy. | 22:09 |
* anteaya hands tonyb another ) | 22:09 | |
tonyb | anteaya: Gah I pasted the wrong one ;P | 22:09 |
*** bharathm has joined #openstack-infra | 22:10 | |
*** sputnik13_ has joined #openstack-infra | 22:10 | |
*** bcourt has quit IRC | 22:10 | |
clarkb | zaro: so I think we keep watching it and see how it does as time goes on (and as work picks up post holiday) | 22:10 |
clarkb | zaro: if it reaches a steady state with this level of load then I think we are good otherwise more memory may be appropriate or those other tuning options you mentioned | 22:11 |
*** rhallisey has quit IRC | 22:11 | |
tonyb | jeblair: so I'll look at the zuul thing and lean on jhesketh ;P but in the mean time would accepting the somethign liek the review be okay? | 22:11 |
*** otter768 has joined #openstack-infra | 22:12 | |
tonyb | and isn't that review only modifying the periodic jobs not the regular jobs? | 22:12 |
jeblair | tonyb: the "pytho27" macro is used *everywhere* | 22:12 |
tonyb | jeblair: Oh I see. I made bad assumptions. Thanks. | 22:14 |
jeblair | tonyb: see http://logs.openstack.org/25/245525/3/check/project-config-compare-xml/67927d2/console.html for all the jobs it changes | 22:14 |
* jhesketh reads scrollback | 22:15 | |
*** sputnik13_ has quit IRC | 22:15 | |
tonyb | jeblair: okay so if I created a python27-branch (or similar) macro that used the branch and explitly called that from the peridoic queue that'd be okay? | 22:15 |
jeblair | i don't think we should do that before zuulv3 | 22:15 |
tonyb | jeblair: ... while I look at the zuul thing | 22:15 |
*** salv-orl_ has quit IRC | 22:15 | |
jeblair | tonyb: yeah, i think that's the most workable thing at the moment | 22:15 |
tonyb | jeblair: and should I do the zuul trigger thing on zuulv3? | 22:16 |
*** bdemers has quit IRC | 22:16 | |
*** otter768 has quit IRC | 22:17 | |
*** eharney has quit IRC | 22:18 | |
jeblair | tonyb: yeah, v3 is our priority with zuul | 22:18 |
openstackgerrit | Matthew Treinish proposed openstack/os-testr: Add tool to create a subunit streams https://review.openstack.org/263465 | 22:18 |
tonyb | jeblair: okay thanks for the direction. | 22:19 |
*** ok___delta has quit IRC | 22:19 | |
clarkb | Kiall: FYI your designate dsvm tempest jobs appear to be failing due to a change in the tempest config (devstack stopped writing deprecated options there) | 22:19 |
*** ok_delta has quit IRC | 22:19 | |
*** mriedem is now known as mriedem_jedi | 22:20 | |
*** mriedem_jedi is now known as mriedem | 22:21 | |
*** dkranz has quit IRC | 22:22 | |
*** matrohon has quit IRC | 22:23 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: use send-announcements-to metadata for deliverables https://review.openstack.org/262281 | 22:25 |
*** alexpilotti_ has quit IRC | 22:26 | |
tonyb | okay another subject change .... How do I get something added to the topic of an "offical" channel? | 22:27 |
anteaya | tonyb: tell us what it is and someone with permissions will change the topic | 22:27 |
clarkb | (or any other channel op) | 22:27 |
anteaya | so decide what dashboard link you want and then post back here | 22:27 |
tonyb | anteaya: Thanks. | 22:28 |
*** larainema has quit IRC | 22:28 | |
anteaya | welcome | 22:28 |
anteaya | tonyb: I'd suggest a url shortener you can redirect, that way the link in the channel topic is the same and you can control the url it redirects to if you want to change the dashboard | 22:28 |
anteaya | dashboard links can get really long | 22:29 |
tonyb | anteaya: That's what I'm looking into right now. goo.gl and bit.ly seem to modify the URL as the referenced URL changes | 22:29 |
anteaya | tinyurl? | 22:29 |
openstackgerrit | James E. Blair proposed openstack/gertty: Cache counts of project changes https://review.openstack.org/260085 | 22:30 |
*** angdraug has joined #openstack-infra | 22:30 | |
*** sputnik13_ has joined #openstack-infra | 22:31 | |
openstackgerrit | Matthew Treinish proposed openstack/os-testr: Add tool to create a subunit stream https://review.openstack.org/263465 | 22:31 |
tonyb | anteaya: Ahh tiny.cc allows edits. | 22:32 |
anteaya | yay tiny.cc | 22:33 |
*** shardy has quit IRC | 22:33 | |
*** holser_ has left #openstack-infra | 22:34 | |
*** e0ne has joined #openstack-infra | 22:34 | |
*** annegentle has quit IRC | 22:36 | |
*** bdemers has joined #openstack-infra | 22:37 | |
*** sputnik13_ has quit IRC | 22:39 | |
jeblair | clarkb: (zaro?) what's the status of https://review.openstack.org/181965 | 22:39 |
*** peristeri has quit IRC | 22:39 | |
*** darrenc is now known as darrenc_afk | 22:39 | |
*** bhunter71 has joined #openstack-infra | 22:40 | |
clarkb | I think the assertion is wrong (jgit issue was unrelated) | 22:41 |
clarkb | but if gerrit packs for us then we dont need to | 22:41 |
jeblair | clarkb: i'm not sure it repacks as well as we do | 22:42 |
*** zaro has quit IRC | 22:42 | |
jeblair | (we do -afd because nova is big, does it?) | 22:42 |
clarkb | I do not know what options it uses | 22:43 |
jeblair | it's probably more complicated than that since it uses jgit -- i think the question is more like "is the algorithm it uses comparable or better at optimizing the size of the nova repo than 'git repack -afd'" | 22:44 |
jeblair | ( ^ + "over time") | 22:44 |
openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-infracloud: Add bifrost manifest https://review.openstack.org/231757 | 22:45 |
*** tonytan4ever has quit IRC | 22:46 | |
*** amitgandhinz has quit IRC | 22:46 | |
*** jpr has quit IRC | 22:48 | |
*** onovy has left #openstack-infra | 22:48 | |
*** Sukhdev has joined #openstack-infra | 22:49 | |
*** vilobhmm11 has left #openstack-infra | 22:50 | |
craige | o/ | 22:52 |
*** bharathm has quit IRC | 22:52 | |
craige | Oh jeblair, thanks for gertty, loving it. | 22:52 |
jeblair | craige: glad to hear it! | 22:53 |
*** zaro has joined #openstack-infra | 22:53 | |
*** darrenc_afk is now known as darrenc | 22:54 | |
clarkb | It looks like we can induce a gerrit gc against a specific repo | 22:55 |
openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-openstackci: Initial sphynx doc setup for publishing https://review.openstack.org/259245 | 22:55 |
clarkb | so if we copy say nova, the gc with gerrit and with git we can compare the results | 22:55 |
clarkb | that may not be sufficient to say one eay or another though | 22:55 |
jeblair | clarkb: the trick is we're starting with a repacked nova repo | 22:55 |
jeblair | after a week, the effect might be noticable, i don't know | 22:56 |
*** woodster_ has quit IRC | 22:56 | |
jeblair | i know that when we established the repack command it was *hundreds of mb* of difference | 22:56 |
jeblair | so pretty easy to spot :) | 22:56 |
anteaya | should gc happen prior to each repack? | 22:57 |
*** mriedem is now known as mriedem_away | 22:57 | |
*** sputnik13_ has joined #openstack-infra | 22:57 | |
tonyb | can @irc-ops please update the topic in #openstack-stable to "reviews: http://tiny.cc/os-stable-dash issues: https://etherpad.openstack.org/p/stable-tracker" | 22:58 |
jeblair | anteaya: i believe the operations performed by a gc are included in our repacks | 22:58 |
jeblair | tonyb: i don't know what the '@' sign there was for | 22:58 |
anteaya | jeblair: ah | 22:58 |
jeblair | tonyb: but i'm happy to update it | 22:58 |
anteaya | I think @is a hipchat ism | 22:58 |
anteaya | and hipchatters get confused, I saw one in backscroll using hipchat isms | 22:59 |
tonyb | jeblair: Oh somehow I thought that was the accpeted way of denoteing a group rather than individual | 22:59 |
* tonyb dosn't know what hipchat is | 22:59 | |
anteaya | tonyb: the only group we have in this channel is infra-root | 22:59 |
anteaya | which you signal by typing the name | 22:59 |
anteaya | tonyb: lucky you | 23:00 |
*** nelsnels_ has quit IRC | 23:00 | |
tonyb | anteaya: Ah okay | 23:00 |
mordred | anteaya: it's not just hipchat, it's also twitter and github and slack | 23:00 |
clarkb | jeblair gerrit didnt do it until a much newer version aiui | 23:00 |
*** nelsnelson has joined #openstack-infra | 23:00 | |
mordred | anteaya: amazingly, people tell me those have "better" UIs than IRC even though they don't have tab-completion without an @ prefix | 23:00 |
anteaya | mordred: @here is from hipchat I do believe | 23:01 |
anteaya | the person earlier was @here'ing in channel | 23:01 |
mordred | anteaya: ah. yeah. that isn't going to work :) | 23:01 |
*** bharathm has joined #openstack-infra | 23:01 | |
mordred | the best way to say something to everyone in the channel is ... to say something | 23:01 |
pleia2 | @here and @all are a huge reason I won't use hipchat ;) | 23:01 |
anteaya | which is why I figured hipcaht | 23:01 |
mordred | pleia2: ++ | 23:01 |
anteaya | pleia2: I hear that | 23:01 |
pleia2 | (also it crashes all the time in linux and it's not in my workflow) | 23:01 |
anteaya | mordred: yup | 23:01 |
mordred | pleia2: it's also not open source, and doesn't use an open protocol, and provides no value that I do not receive from things that are open source on open protocols | 23:02 |
mordred | pleia2: so, basically, yes :) | 23:02 |
*** dahoo has joined #openstack-infra | 23:02 | |
pleia2 | mordred: yeah | 23:02 |
clarkb | jeblair I think it is safe to keeo running out of band repacks | 23:03 |
craige | mordred +1 | 23:03 |
clarkb | so easiest thing is leave it as is | 23:03 |
jeblair | clarkb: cool; then someone with lots of extra time can figure out if 'gerrit gc' is not worse :) | 23:03 |
jeblair | i'm using the gertty topics feature to review puppet-* changes! | 23:04 |
craige | oh, I'll have to play with that feature. | 23:04 |
jeblair | craige: i haven't landed it yet, it's here: https://review.openstack.org/260085 | 23:05 |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit's sendmail.includeDiff option https://review.openstack.org/260283 | 23:05 |
*** ildikov is now known as ildikov_afk | 23:05 | |
jeblair | craige: if you try it out, make a copy of .gertty.db first because it includes a database migration | 23:05 |
craige | ah, I wondered why I hadn;t seen it :-D | 23:05 |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit's garbage collection options https://review.openstack.org/262072 | 23:05 |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Fix Gerrit's puppet mimetype specifier https://review.openstack.org/262601 | 23:06 |
dahoo | clarkb: hi, i can't login to review.o.o with lp openid today, it kept redirecting me to https://review.openstack.org/#SignInFailure,SIGN_IN,Contact+site+administrator | 23:06 |
*** Daisy_ has joined #openstack-infra | 23:06 | |
jeblair | mordred: can you https://review.openstack.org/258718 :) | 23:06 |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Allow direct download of .properties files https://review.openstack.org/262603 | 23:07 |
jeblair | dahoo: can you log into launchpad itself? | 23:07 |
mordred | jeblair: done | 23:07 |
mordred | jeblair: what is that warning? | 23:07 |
dahoo | jeblair: yes | 23:07 |
jeblair | mordred: docaedo got it talking to rax i think? | 23:07 |
*** jtomasek has quit IRC | 23:07 | |
mordred | jeblair: that's so nice | 23:08 |
zaro | jeblair, clarkb : i believe gerrit can schedule a git gc, i'm not sure if a gc includes a repack. as far as i am aware you cannot schedule a git repack thru gerrit. | 23:08 |
dahoo | jeblair: i delete one email address that was not used anymore in my lp account. it might have caused the issue | 23:08 |
* docaedo reads backscroll in hopes of finding out what he did to rax | 23:09 | |
dahoo | jeblair: my previous account is zhaoxinyu@huawei.com and the current one is xyzjerry@gmail.com | 23:09 |
*** kzaitsev_mb has joined #openstack-infra | 23:09 | |
*** dingyichen has joined #openstack-infra | 23:09 | |
jeblair | mordred, docaedo: and i think it's in very-new-requests | 23:09 |
Thelo | Hi all, I just deploy a CI using : http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/README.md, at the end, should there be jobs automatically loaded inside jenkins or I need to load some by myself. | 23:09 |
zaro | jeblair, clarkb: i think https://review.openstack.org/181965 should be abandoned. | 23:10 |
jeblair | Thelo: i think there's a single test job that should be there | 23:10 |
openstackgerrit | Merged openstack-infra/requestsexceptions: Add SNIMissingWarning https://review.openstack.org/258718 | 23:10 |
asselin_ | Thelo, there should be jobs loaded | 23:10 |
clarkb | zaro ok can do | 23:10 |
*** Daisy_ has quit IRC | 23:11 | |
docaedo | jeblair: I don't specifically remember the rax bit, but I know that 258728 fixed at least one of the SSL connections that made my link check thing have the sads | 23:11 |
Thelo | OO | 23:11 |
Thelo | if there is none | 23:11 |
Thelo | what should I look at? | 23:11 |
*** e0ne has quit IRC | 23:11 | |
craige | 261412 is a minor change that could do with an eye over it at your leisure jeblair. | 23:12 |
jeblair | docaedo, mordred: requestsexceptions 1.1.2 tag pushed | 23:12 |
asselin_ | Thelo, which project-config repo did you use to start with?' | 23:12 |
docaedo | way to ring in the new year jeblair! | 23:12 |
openstackgerrit | Merged openstack/gertty: Updated Debian availability. https://review.openstack.org/261412 | 23:12 |
jeblair | craige: thanks :) | 23:12 |
*** ddieterly has joined #openstack-infra | 23:13 | |
zaro | jeblair: gerrit wip plugin is still a no go. how it's currently implemented doesn't really work right and the right way won't get accepted upstream. I asked DavidO about it at the gerrit hackathon and he said that he's pretty much given up on that. | 23:13 |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Fix to allow Gerrit to download html files directly https://review.openstack.org/262605 | 23:14 |
*** gsagie has quit IRC | 23:14 | |
jeblair | clarkb: status of https://review.openstack.org/242715 ? | 23:14 |
*** baoli has quit IRC | 23:14 | |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Allow puppet to configure Gerrit's receive.maxObjectSizeLimit option https://review.openstack.org/262610 | 23:14 |
clarkb | jeblair we implemtned the groovy init fix instead, could add that as belt and suspenders or abandon ifwe are happy with groovy | 23:15 |
jeblair | zaro: hrm. that's really unfortunate. i thought it worked in 2.11 and that's a big thing we were hoping to get out of the upgrade. | 23:15 |
Thelo | asselin_: https://git.openstack.org/cgit/openstack-infra/project-config-example | 23:15 |
zaro | jeblair: maybe the last ditch effort is to change gerrit so that states are extendable (i don't believe it is yet). so that a new state can be added thru the plugin. | 23:15 |
Thelo | this one | 23:15 |
ddieterly | seems like our tempest tests in our gate are failing now | 23:16 |
jeblair | zaro: perhaps focusing on making sure that notedb can support the concept would be better? | 23:16 |
ddieterly | is there an irc channel for tempest? | 23:16 |
asselin_ | Thelo, yeah, that one creates 2 jobs I believe. Do you have your puppet output saved? | 23:16 |
Thelo | sure | 23:16 |
Thelo | let me paste it | 23:16 |
jeblair | ddieterly: #openstack-qa | 23:16 |
ddieterly | thanks | 23:16 |
zaro | jeblair: the concept of wip or concept of extendable states? | 23:16 |
*** dimtruck is now known as zz_dimtruck | 23:16 | |
jeblair | zaro: either :) | 23:16 |
zaro | jeblair: yeah, makes sense. | 23:17 |
*** edmondsw has quit IRC | 23:17 | |
dahoo | jeblair: ssh also failed | 23:17 |
Thelo | asselin_: here http://paste.openstack.org/show/482982/ | 23:17 |
clarkb | I wonder if dahoo's account was inactivated? | 23:17 |
clarkb | dahoo what is the account username/email? | 23:18 |
jeblair | that makes more sense if ssh failed | 23:18 |
clarkb | dahoo and is the account used for CI? | 23:18 |
dahoo | clarkb: Jerry Zhao xyzjerry@gmail.com | 23:18 |
dahoo | clarkb: no | 23:18 |
clarkb | ( I have to feed some babies but can check after) | 23:19 |
asselin_ | Thelo, do you have the output for when you ran puppet the first time? | 23:19 |
anteaya | clarkb: enjoy babies | 23:19 |
*** piet has quit IRC | 23:19 | |
dahoo | clarkb: thanks | 23:19 |
*** piet has joined #openstack-infra | 23:20 | |
Thelo | does puppet save the output somewhere? if nom then I don't have it | 23:21 |
*** tchaypo has quit IRC | 23:21 | |
*** tchaypo has joined #openstack-infra | 23:21 | |
pleia2 | Thelo: should land in /var/log/syslog | 23:22 |
pleia2 | (though I'm making a lot of assumptions here) | 23:22 |
jhesketh | jeblair: do you have a few minutes to discuss zuulv3? | 23:22 |
jeblair | jhesketh: yep | 23:23 |
Thelo | asselin_: no I don't have then | 23:23 |
asselin_ | Thelo, check the contents of /etc/jenkins_jobs/config/ | 23:23 |
asselin_ | there should be some files there. You can delete them and run puppet again. save that output | 23:23 |
jhesketh | jeblair: now most of the connection stuff has merged, I'd like to be helping out more with the v3 work since I put my hand up.. but it's not clear what the best way to divide that up is or where/what you're up to | 23:24 |
jhesketh | are you tracking the work in an etherpad or something per chance? | 23:24 |
jhesketh | or phrased another way, what else could I be doing to help | 23:24 |
jeblair | jhesketh: yeah, i've been thinking about that as well. i've been really roughly attacking the code in changes i've pushed up to gerrit; i think i have some of the really substantial changes at least roughed-in so we can start to see what it looks like | 23:26 |
crinkle | mordred: could you validate whether the last four patchsets from https://review.openstack.org/#/c/198417 are consistent with what you intended as its author? | 23:26 |
Thelo | asselin_: Here, ( now I can see three jobs ) http://paste.openstack.org/show/482984/ | 23:27 |
dahoo | clarkb: i am sorry, ssh works. but web login still fails | 23:27 |
jeblair | jhesketh: i'm wondering if maybe the way forward is to merge that and then start finding smaller areas we can divide an conquer | 23:27 |
loquacities | jhesketh: just caught up on the docimpact thing | 23:27 |
*** gsagie has joined #openstack-infra | 23:28 | |
jhesketh | jeblair: yep, so that refactoring is ready for review? | 23:28 |
asselin_ | Thelo, ok...seems there a race or something that caused them to fail loading... | 23:28 |
*** baoli has joined #openstack-infra | 23:28 | |
jeblair | jhesketh: a lot of other people put up their hands too, but some of them have different jobs now, so we may want to get another show of hands | 23:28 |
*** angdraug has quit IRC | 23:29 | |
jhesketh | jeblair: if we divide the work first that might make it easier for people to see what they're raising their hands for | 23:29 |
jhesketh | jeblair: but we could also do a call for reviews if its up to that point yet | 23:29 |
jeblair | jhesketh: well, i mean, it's terrible -- we would never merge that into the master branch. | 23:29 |
jhesketh | I've held off, for example, as I wasn't sure if it was ready | 23:29 |
clarkb | dahoo then the account is active | 23:29 |
jeblair | jhesketh: it doesn't even really work -- all it does is make a single demonstation test pass (but it does do that :) | 23:30 |
dahoo | clarkb: just openid failed to work | 23:30 |
*** larainema has joined #openstack-infra | 23:30 | |
*** baoli has quit IRC | 23:30 | |
jhesketh | yeah, so maybe the steps are: 1) define the work to be done after the existing refactors are merged, 2) use that to help create some guidelines on how to review the existing work (ie, it's fine that the tests are turned off for example) | 23:30 |
jeblair | jhesketh: so if we go with this approach, i think it's worth looking at those changes so we can all follow the progression together and make suggestions, etc... but i'd like to just fall forward and fix things in future patches rather than rebase, etc. | 23:31 |
*** baoli has joined #openstack-infra | 23:31 | |
openstackgerrit | Doug Wiegley proposed openstack-infra/nodepool: WIP - nodepool setting to make it easier to use neutron provider nets https://review.openstack.org/263476 | 23:31 |
jhesketh | jeblair: so you're saying read, but don't review and just +W them? | 23:32 |
Thelo | asselin_: thanks, is there anything that will trigger jenkins jobs by default? | 23:32 |
jeblair | jhesketh: yeah? give that a shot? if something looks bad, fix it in a new commit? :) we won't hold to this forever, but here in the really early days, i think it'll help us move quickly -- since we don't need to keep everything working, which is our usual goal -- we actually need to break everything for a bit :) | 23:33 |
*** boris-42 has joined #openstack-infra | 23:33 | |
jhesketh | jeblair: works for me.. I'll read through the patches and +2 them. Do we still want to require 2*cores | 23:34 |
jeblair | jhesketh: most of those commits actually tell a decent, if rough, narrative, one of them is just a mess. sorry. | 23:34 |
jhesketh | or to help reduce reviewer load maybe we just merge them? | 23:34 |
jhesketh | heh, to be expected in such a large refactor though | 23:34 |
jeblair | jhesketh: yeah, i'm leaning toward merge these as a starting plase, then divide up the work as you suggest (having gone over this will help understand that work better) and work from there | 23:35 |
jhesketh | sounds good | 23:35 |
*** pradk has quit IRC | 23:35 | |
jeblair | jhesketh: i have one more patch in my head that i'd like to get in, so maybe we can aim for discussing this in earnest at next week's meeting (or around then if you can't make the meeting)? | 23:36 |
jhesketh | I'll try and review them all today.. I've skimmed a couple so I should be able to get through them (I am, however, taking some leave from tomorrow until next tuesday) | 23:36 |
jeblair | jhesketh: oh that sounds like it might work out for both of us then :) | 23:36 |
jhesketh | discussing the division of the work? | 23:36 |
jeblair | jhesketh: yeah | 23:36 |
jhesketh | yep, I'll be at that meeting | 23:37 |
jeblair | jhesketh: and letting folks now it's time to get involved :) | 23:37 |
*** baoli has quit IRC | 23:37 | |
jeblair | 'letting folks know' | 23:37 |
jhesketh | sounds good to me :-) | 23:37 |
jeblair | w00t | 23:37 |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Run package-intalls with py3k if we must https://review.openstack.org/254386 | 23:37 |
jeblair | clarkb: now i hear that patch saying "nobody loves me" | 23:38 |
jhesketh | jeblair: in semi-zuul relatedness, there are some changes for enable_swift which affect zuul: https://review.openstack.org/#/q/status:open+topic:enable_swift | 23:38 |
jhesketh | clarkb: ^ if you have some time for enable_swift reviews | 23:38 |
jeblair | jhesketh: oh sure | 23:39 |
jhesketh | jeblair: hopefully small enough to do before v3 | 23:39 |
jeblair | yeah, i think that fits into what we should be maintaining in v2 :) | 23:39 |
asselin_ | Thelo, sorry need to step away. note that there's a bug so running on master doesn't work currently | 23:39 |
jhesketh | coolioi | 23:39 |
asselin_ | Thelo, you need to run on a jenkins slave | 23:40 |
jhesketh | jeblair: the other one to discuss is the sqlalchemy one... if you've got a moment, can we discuss that to unblock it please? (even if the outcome is "it waits until after v3") | 23:40 |
*** bharathm has quit IRC | 23:40 | |
jeblair | jhesketh: which is that? | 23:41 |
jhesketh | https://review.openstack.org/#/c/223333/ | 23:41 |
jhesketh | there were 2 discussions. 1) which engine(s) to support, and 2) alembic/multiple table support | 23:41 |
*** asselin_ has quit IRC | 23:41 | |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder https://review.openstack.org/263349 | 23:41 |
jhesketh | so #1 I think I agree with you. If we want to support other engines we can do that another time, so lets just stick with mysql and only test that | 23:42 |
jeblair | whew | 23:42 |
jhesketh | #2 using alembic (which I think is a good idea) made it too difficult to support different tables for results... Different tables could be a useful feature, but not one I care enough about to find a solution just yet | 23:43 |
jhesketh | ie if it becomes important later maybe we could find a solution later | 23:43 |
jhesketh | although we should perhaps check with mtreinish how he wants results stored for os-health | 23:43 |
jeblair | yeah, what's the use case for multiple tables? | 23:44 |
*** nmagnezi has quit IRC | 23:44 | |
Thelo | asselin_: sorry it might be a stupid question but how do I do this? it is simply run a build with a specifc ZMQ event publisher label expression? | 23:44 |
*** tzn has quit IRC | 23:45 | |
mtreinish | jhesketh: well I'm not sure the schema matters too much as long as there is a python api for getting at it | 23:45 |
*** erlon has quit IRC | 23:46 | |
*** sigmavirus24 is now known as sigmavirus24_awa | 23:46 | |
jhesketh | jeblair: originally a zuul reporter didn't know if a paritcular build set had passed or failed.. it just knew it had to report to a certain reporter | 23:46 |
jhesketh | that's now refactored enough that we can store a pass/fail in the table | 23:47 |
zaro | jeblair: would you mind taking another look? https://review.openstack.org/#/c/262053/ | 23:47 |
jhesketh | but before then it was useful to have a table for passed builds and one for failed builds | 23:47 |
jhesketh | so that's the history | 23:47 |
zaro | i will am making more changes like that | 23:47 |
jhesketh | the other reason would be table size... you could truncate/store a passed table more aggressively than you would a failed table, for example | 23:48 |
lifeless | does infra have a policy on things like the curlsh in https://review.openstack.org/#/c/245362/ ? | 23:48 |
jhesketh | although this was before the use case of os-health where keeping the stats is important | 23:48 |
jhesketh | basically it'd just be as a db optimisation at this point (since the rest can be determined from a query) so it's probably something we can worry about in the future | 23:49 |
jeblair | zaro: my -1 stands. in that module unspecified parameters default to '' and we should not write them to config files if they are set like that. we should be consistent and do that for every parameter. most of your other changes were fine. only that one and one other went afoul of the standard. | 23:49 |
clarkb | lifeless ww dont want to gate eg nova on that, but if the test is just for tooz then I dont think we care | 23:49 |
*** bharathm has joined #openstack-infra | 23:49 | |
*** yuanying has quit IRC | 23:50 | |
jeblair | jhesketh: my general feeling is that having zuul manage a single table (or known set of tables rather that arbitrary user defined table names with zuul-defined schemas) and do so using alembic is good. | 23:50 |
jhesketh | yep, I'm in agreement | 23:51 |
jeblair | jhesketh: i think that a more complicated schema (including zuul-defined user-named tables) is crossing a boundary of concerns, and would like to avoid that | 23:51 |
jhesketh | sure | 23:51 |
jeblair | jhesketh: (because negotiating who is responsible for the schema starts to get complicated) | 23:51 |
*** yuanying has joined #openstack-infra | 23:51 | |
jhesketh | okay, so the main thing is to re-roll the patch for just mysql support and make use of the opportunistic testing | 23:51 |
jeblair | jhesketh: yeah, and i think at least for the moment, all our use cases can handle a single table, so stick with that | 23:52 |
zaro | jeblair: ok, i was a bit confused. i thought you wanted all vars to take strings as default instead of mixing strings and integers. | 23:52 |
jeblair | zaro: i think sshd_batch_threads should default to '', and iff it is not '' should we write the value to the file | 23:53 |
zaro | but your actually talking about setting not setting them if the var is not specified. | 23:53 |
Thelo | Hi all, in my case nodepool fails to ssh one of its node (http://paste.openstack.org/show/482987/), I notice that the node running has no key, so how does nodepool ssh the machine? | 23:53 |
zaro | jeblair: ok. i get it. | 23:53 |
jeblair | zaro: (basically, it should also look just like the existing "sshd_threads" argument) | 23:54 |
openstackgerrit | Merged openstack-infra/puppet-jenkins: Add cli manifest to Jenkins https://review.openstack.org/222923 | 23:55 |
jhesketh | jeblair: coolio, thanks | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!